2024-09-12T00:19:33.522 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:19:33.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:19:33.632 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7901869' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNT0PMGu3t+dhzpL6cgRhF+o+uih/rz4rwRqj4bJWfZCHRHdtrAPCWE+YUO67el5kEED14HpD7ForppLMH6laQ= smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPwOQjrqcfjEGllmoriuwtmy/ZdR86ditD/wYZNGDsibzYIsVJr/LAWCEXO63cM1FWDVefig3ma+g/rKqlkN1nc= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:19:33.632 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:19:33.633 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:19:33.633 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:19:33.635 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:19:33.655 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:19:33.656 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:19:33.656 INFO:teuthology.packaging:ref: None 2024-09-12T00:19:33.656 INFO:teuthology.packaging:tag: None 2024-09-12T00:19:33.656 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:19:33.656 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:19:33.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:19:33.808 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753.gd011c522 2024-09-12T00:19:33.809 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:19:33.815 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:19:33.815 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:19:33.839 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:19:33.857 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:19:33.873 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:19:33.901 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:14:34.779881', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNT0PMGu3t+dhzpL6cgRhF+o+uih/rz4rwRqj4bJWfZCHRHdtrAPCWE+YUO67el5kEED14HpD7ForppLMH6laQ='} 2024-09-12T00:19:33.927 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:14:34.781645', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPwOQjrqcfjEGllmoriuwtmy/ZdR86ditD/wYZNGDsibzYIsVJr/LAWCEXO63cM1FWDVefig3ma+g/rKqlkN1nc='} 2024-09-12T00:19:33.927 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:19:33.933 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:19:33.933 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:19:33.933 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:19:34.027 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa49e9cfbe0>, signals=[15]) 2024-09-12T00:19:34.027 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:19:34.034 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:19:34.034 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T00:19:34.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:19:34.128 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T00:19:34.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:19:34.237 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:19:34.243 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-09-12T00:19:34.261 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-09-12T00:19:34.262 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-09-12T00:19:34.319 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-09-12T00:19:34.319 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9" 2024-09-12T00:19:34.319 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-09-12T00:19:34.319 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:19:34.319 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9" 2024-09-12T00:19:34.319 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:19:34.319 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:19:34.319 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-09-12T00:19:34.319 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:19:34.320 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:19:34.320 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:19:34.320 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:19:34.320 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:19:34.320 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:19:34.320 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-09-12T00:19:34.353 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-09-12T00:19:34.371 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-09-12T00:19:34.372 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-09-12T00:19:34.429 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:19:34.430 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:19:34.431 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:19:34.431 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-09-12T00:19:34.453 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:19:34.462 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:19:34.490 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:19:34.490 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:19:34.493 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:19:34.509 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:19:34.549 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:19:34.549 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:19:34.551 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:19:34.650 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:19:34.722 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:19:34.736 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:19:34.736 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:19:34.737 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:19:34.737 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:19:34.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:19:34.755 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-09-12T00:19:34.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:19:34.757 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-12T00:19:34.813 INFO:teuthology.orchestra.run.smithi083.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:19:34.813 INFO:teuthology.task.kernel:Running kernel on smithi083: 5.14.0-503.el9.x86_64 2024-09-12T00:19:34.813 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum install -y kernel 2024-09-12T00:19:34.814 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:19:34.814 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.14.0-503.el9.x86_64 2024-09-12T00:19:34.815 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2024-09-12T00:19:37.708 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.2 MB 00:01 2024-09-12T00:19:38.190 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-09-12T00:19:39.651 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-12T00:19:45.894 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-12T00:19:47.561 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-12T00:19:48.257 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 20 MB 00:08 2024-09-12T00:19:48.332 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T00:19:52.416 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-12T00:19:53.704 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T00:19:53.858 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-12T00:19:54.646 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T00:19:55.736 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:19:55.736 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:19:55.836 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-12T00:19:55.845 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-12T00:19:55.845 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-12T00:19:55.845 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-12T00:19:55.845 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-12T00:19:55.845 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:19:55.845 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-12T00:19:55.846 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:19:55.846 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:19:55.846 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:19:55.846 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:19:55.846 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-12T00:19:55.846 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-12T00:19:55.846 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-09-12T00:19:55.846 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:19:55.847 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 79 M 2024-09-12T00:19:55.847 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 126 M 2024-09-12T00:19:55.847 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-12T00:19:55.981 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 261 kB/s | 23 kB 00:00 2024-09-12T00:19:56.373 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-12T00:19:56.757 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-12T00:19:57.074 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-12T00:19:57.074 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:19:57.074 INFO:teuthology.orchestra.run.smithi120.stdout:Total 64 MB/s | 79 MB 00:01 2024-09-12T00:19:57.750 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-12T00:19:58.106 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-12T00:19:58.106 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-12T00:19:59.083 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-12T00:19:59.083 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-12T00:20:00.043 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-12T00:20:01.525 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-12T00:20:02.008 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:20:02.008 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:20:02.102 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout: Package Architecture Version Repository Size 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:20:02.118 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:20:02.119 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-12T00:20:02.119 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-12T00:20:02.119 INFO:teuthology.orchestra.run.smithi083.stdout:Install 4 Packages 2024-09-12T00:20:02.119 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:20:02.119 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 79 M 2024-09-12T00:20:02.119 INFO:teuthology.orchestra.run.smithi083.stdout:Installed size: 126 M 2024-09-12T00:20:02.119 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-12T00:20:02.237 INFO:teuthology.orchestra.run.smithi083.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 234 kB/s | 23 kB 00:00 2024-09-12T00:20:02.428 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:20:02.526 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:20:05.107 INFO:teuthology.orchestra.run.smithi083.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.3 MB/s | 16 MB 00:02 2024-09-12T00:20:05.332 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:20:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:20:06.645 INFO:teuthology.orchestra.run.smithi083.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.5 MB/s | 29 MB 00:04 2024-09-12T00:20:07.678 INFO:teuthology.orchestra.run.smithi083.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.2 MB/s | 35 MB 00:05 2024-09-12T00:20:07.679 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:20:07.679 INFO:teuthology.orchestra.run.smithi083.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-12T00:20:08.367 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-12T00:20:08.723 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-12T00:20:08.723 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-12T00:20:09.661 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-12T00:20:09.662 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-12T00:20:10.284 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:20:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:20:12.138 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-12T00:20:12.811 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:20:12.890 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:20:15.235 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:20:15.673 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:20:15.909 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:20:20.719 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:20:20.876 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:20:25.729 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:20:53.321 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:20:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:20:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:20:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:20:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:20:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:20:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:20:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:20:54.555 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-12T00:20:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:20:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:20:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:20:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:20:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:20:54.556 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-12T00:20:54.931 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:20:55.021 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:20:55.022 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:20:55.022 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:20:55.022 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:20:55.022 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:20:55.022 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:20:55.022 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:20:55.022 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:20:55.081 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:20:55.081 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:20:55.081 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2024-09-12T00:20:55.117 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2024-09-12T00:20:55.117 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2024-09-12T00:20:55.117 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.06 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 82.el9 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Group : Unspecified 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 8274670 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : builder@centos.org 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2024-09-12T00:20:55.118 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2024-09-12T00:20:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:20:55.119 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:20:55.119 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:20:55.119 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:20:55.119 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2024-09-12T00:20:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:20:55.119 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:20:55.120 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:20:55.120 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:20:55.120 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:20:55.777 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:20:57.122 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-09-12T00:20:57.125 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-12T00:20:57.141 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.6Srb7ySPh9 2024-09-12T00:20:57.141 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6Srb7ySPh9 2024-09-12T00:20:57.209 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.6Srb7ySPh9 2024-09-12T00:20:57.350 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.6Srb7ySPh9 is 6KB 2024-09-12T00:20:57.399 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.6Srb7ySPh9 2024-09-12T00:20:57.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:20:57.476 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:20:57.476 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:20:57.476 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:20:57.476 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:20:57.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:20:57.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-09-12T00:21:03.821 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:21:03.861 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:21:04.213 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:21:04.213 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:21:04.213 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:21:04.213 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:21:05.080 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:21:05.080 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:21:05.080 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-09-12T00:21:05.080 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:21:05.080 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:21:05.080 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:21:05.081 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:21:05.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:21:05.081 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-12T00:21:05.459 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:21:05.552 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:21:05.552 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:21:05.552 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:21:05.553 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:21:05.553 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:21:05.553 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:21:05.553 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:21:05.553 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:21:05.612 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:21:05.612 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:21:05.613 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -qi grub2-tools 2024-09-12T00:21:05.648 INFO:teuthology.orchestra.run.smithi083.stdout:Name : grub2-tools 2024-09-12T00:21:05.648 INFO:teuthology.orchestra.run.smithi083.stdout:Epoch : 1 2024-09-12T00:21:05.648 INFO:teuthology.orchestra.run.smithi083.stdout:Version : 2.06 2024-09-12T00:21:05.648 INFO:teuthology.orchestra.run.smithi083.stdout:Release : 82.el9 2024-09-12T00:21:05.648 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: x86_64 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Group : Unspecified 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Size : 8274670 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:License : GPLv3+ 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Packager : builder@centos.org 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Vendor : CentOS 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Summary : Support tools for GRUB. 2024-09-12T00:21:05.649 INFO:teuthology.orchestra.run.smithi083.stdout:Description : 2024-09-12T00:21:05.650 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:21:05.650 INFO:teuthology.orchestra.run.smithi083.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:21:05.650 INFO:teuthology.orchestra.run.smithi083.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:21:05.650 INFO:teuthology.orchestra.run.smithi083.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:21:05.650 INFO:teuthology.orchestra.run.smithi083.stdout:hardware devices. 2024-09-12T00:21:05.650 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:21:05.650 INFO:teuthology.orchestra.run.smithi083.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:21:05.651 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:21:05.651 INFO:teuthology.task.kernel:Updating grub on smithi083 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:21:05.651 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:21:06.314 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2024-09-12T00:21:07.663 INFO:teuthology.orchestra.run.smithi083.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:21:07.692 INFO:teuthology.orchestra.run.smithi083.stderr:done 2024-09-12T00:21:07.695 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-09-12T00:21:07.710 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.kL8lIUWOlC 2024-09-12T00:21:07.711 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kL8lIUWOlC 2024-09-12T00:21:07.778 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.kL8lIUWOlC 2024-09-12T00:21:07.911 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.kL8lIUWOlC is 6KB 2024-09-12T00:21:07.960 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.kL8lIUWOlC 2024-09-12T00:21:07.974 DEBUG:teuthology.orchestra.run.smithi083:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:21:08.037 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:21:08.037 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:21:08.037 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:21:08.037 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:21:08.038 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:21:08.186 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2024-09-12T00:21:27.649 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:21:27.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T00:21:27.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:21:38.197 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:21:38.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-12T00:21:38.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:21:46.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-12T00:21:55.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T00:21:55.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:21:56.673 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-09-12T00:21:58.237 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-12T00:22:05.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-12T00:22:05.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:22:08.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-09-12T00:22:10.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T00:22:10.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:22:20.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-12T00:22:20.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:22:42.091 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-12T00:22:42.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T00:22:42.469 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:22:42.469 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-12T00:22:42.483 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:22:42.484 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:22:42.484 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:22:42.484 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:22:43.485 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:22:43.485 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:22:43.559 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-09-12T00:22:43.583 DEBUG:teuthology.parallel:result is None 2024-09-12T00:22:52.583 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-09-12T00:22:52.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-12T00:22:52.971 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:22:52.971 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-09-12T00:22:52.988 INFO:teuthology.orchestra.run.smithi083.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:22:52.988 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:22:52.989 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:22:52.989 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:22:53.990 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:22:53.990 DEBUG:teuthology.orchestra.run.smithi083:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:22:54.172 INFO:teuthology.orchestra.run.smithi083.stdout:ttyS1 2024-09-12T00:22:54.203 DEBUG:teuthology.parallel:result is None 2024-09-12T00:22:54.203 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:22:54.350 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:22:54.351 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:22:54.353 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:22:54.386 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:22:54.392 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:22:54.428 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:22:54.428 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:22:54.431 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:22:54.528 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:22:54.537 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:22:54.537 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:22:54.540 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:22:54.570 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:22:54.581 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:22:54.581 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:22:54.599 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:22:54.601 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:22:54.621 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:22:54.621 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:22:54.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:22:54.670 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:22:54.681 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:22:54.681 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:22:54.683 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:22:54.725 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:22:54.812 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:22:54.890 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:22:54.970 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:22:55.036 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:22:55.036 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:22:55.101 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:22:55.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:22:55.202 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:22:55.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:22:55.331 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:22:55.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:22:55.397 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2024-09-12T00:22:55.399 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-09-12T00:22:55.445 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:22:55.498 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:22:55.840 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:22:55.861 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:22:55.861 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:22:55.923 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:22:56.022 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2024-09-12T00:22:56.098 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: 2024-09-12T00:22:56.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-09-12T00:22:56.168 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-09-12T00:22:56.170 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:22:56.170 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2024-09-12T00:22:56.193 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2024-09-12T00:22:56.193 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-09-12T00:22:56.213 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-09-12T00:22:56.213 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi083.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi120.front.sepia.ceph.com': 'permissive'} 2024-09-12T00:22:56.213 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:22:56.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:22:56.254 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:22:56.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:22:56.281 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:22:56.282 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:22:56.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:22:56.362 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:22:56.430 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:22:56.442 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:22:56.443 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi083.front.sepia.ceph.com,smithi120.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:26:39.261 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi083.front.sepia.ceph.com'), Remote(name='ubuntu@smithi120.front.sepia.ceph.com')] 2024-09-12T00:26:39.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-12T00:26:39.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:26:39.352 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-09-12T00:26:39.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-12T00:26:39.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T00:26:39.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:26:39.518 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-12T00:26:39.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-12T00:26:39.596 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:26:39.607 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:26:39.607 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:26:39.608 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:26:39.610 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:26:39.610 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:26:39.636 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:26:39.650 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:26:39.665 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:26:39.674 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2024-09-12T00:26:39.679 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:26:39.685 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2024-09-12T00:26:39.699 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:26:39.703 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-09-12T00:26:39.713 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:26:39.714 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-09-12T00:26:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:26:39.742 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:26:39.771 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:26:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:26:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-12T00:26:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:26:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:26:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:26:39.775 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:26:39.798 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:26:39.801 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:26:39.801 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-12T00:26:39.801 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:26:39.802 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:26:39.802 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:26:39.802 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:26:39.802 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:26:39.811 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:26:39.812 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:26:39.812 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:26:39.812 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:26:39.817 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:26:39.817 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:26:39.818 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:26:39.818 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:26:39.821 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:26:39.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:26:39.977 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:26:39.977 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:26:39.992 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:26:39.992 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:26:40.105 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:26:40.105 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:26:40.105 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:26:40.116 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:26:40.116 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:26:40.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:26:40.132 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:26:40.133 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:26:40.145 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:26:40.145 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:26:40.200 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:26:40.211 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:26:40.274 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:26:40.285 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:26:40.339 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2024-09-12T00:26:40.340 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2024-09-12T00:26:40.349 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-09-12T00:26:40.351 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-09-12T00:26:40.563 INFO:teuthology.orchestra.run.smithi083.stdout:45 files removed 2024-09-12T00:26:40.590 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:26:40.591 INFO:teuthology.orchestra.run.smithi120.stdout:45 files removed 2024-09-12T00:26:40.616 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:26:41.149 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-12T00:26:41.174 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-12T00:26:41.425 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-12T00:26:41.466 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-12T00:26:41.692 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-12T00:26:41.742 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-12T00:26:42.425 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-12T00:26:42.834 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.2 MB 00:01 2024-09-12T00:26:44.510 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-12T00:26:46.035 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-12T00:26:48.819 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T00:26:50.354 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-12T00:26:50.394 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T00:26:51.317 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-12T00:26:51.812 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 19 kB 00:00 2024-09-12T00:26:52.549 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-12T00:26:56.748 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T00:26:57.863 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T00:26:59.095 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:26:59.096 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:26:59.188 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-12T00:26:59.204 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================================== 2024-09-12T00:26:59.204 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================================== 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:26:59.205 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:26:59.206 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:26:59.207 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:26:59.207 INFO:teuthology.orchestra.run.smithi120.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:26:59.207 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-09-12T00:26:59.207 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:26:59.207 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:26:59.207 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-12T00:26:59.207 INFO:teuthology.orchestra.run.smithi120.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:26:59.207 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:26:59.208 INFO:teuthology.orchestra.run.smithi120.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:26:59.209 INFO:teuthology.orchestra.run.smithi120.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:26:59.210 INFO:teuthology.orchestra.run.smithi120.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:26:59.210 INFO:teuthology.orchestra.run.smithi120.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:26:59.210 INFO:teuthology.orchestra.run.smithi120.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:26:59.210 INFO:teuthology.orchestra.run.smithi120.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:26:59.210 INFO:teuthology.orchestra.run.smithi120.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:26:59.210 INFO:teuthology.orchestra.run.smithi120.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:26:59.210 INFO:teuthology.orchestra.run.smithi120.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:26:59.210 INFO:teuthology.orchestra.run.smithi120.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:26:59.210 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:26:59.211 INFO:teuthology.orchestra.run.smithi120.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:26:59.212 INFO:teuthology.orchestra.run.smithi120.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:26:59.213 INFO:teuthology.orchestra.run.smithi120.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:26:59.214 INFO:teuthology.orchestra.run.smithi120.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:26:59.215 INFO:teuthology.orchestra.run.smithi120.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:26:59.216 INFO:teuthology.orchestra.run.smithi120.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:26:59.217 INFO:teuthology.orchestra.run.smithi120.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:26:59.218 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:26:59.219 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:26:59.220 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:26:59.221 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:26:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:26:59.223 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:26:59.224 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:26:59.224 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:26:59.224 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:26:59.224 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:26:59.224 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:26:59.224 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:26:59.224 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:26:59.225 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:26:59.225 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:26:59.225 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:26:59.225 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:26:59.225 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:26:59.225 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:26:59.225 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:26:59.226 INFO:teuthology.orchestra.run.smithi120.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:26:59.227 INFO:teuthology.orchestra.run.smithi120.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:26:59.228 INFO:teuthology.orchestra.run.smithi120.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================================== 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout:Install 283 Packages 2024-09-12T00:26:59.229 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 2 Packages 2024-09-12T00:26:59.230 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:26:59.230 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 327 M 2024-09-12T00:26:59.230 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-12T00:27:00.107 INFO:teuthology.orchestra.run.smithi120.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-12T00:27:00.218 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:27:00.219 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:27:00.308 INFO:teuthology.orchestra.run.smithi120.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 4.4 MB/s | 899 kB 00:00 2024-09-12T00:27:00.311 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-12T00:27:00.328 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================== 2024-09-12T00:27:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2024-09-12T00:27:00.328 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================== 2024-09-12T00:27:00.328 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-09-12T00:27:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:27:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:27:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:27:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:27:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:27:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2024-09-12T00:27:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:27:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:27:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:27:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:27:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:27:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:27:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:27:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:27:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:27:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:27:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:27:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:27:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:27:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:27:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:27:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:27:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:27:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:27:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:27:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout:Installing weak dependencies: 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:27:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout:====================================================================================================== 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout:Install 283 Packages 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 2 Packages 2024-09-12T00:27:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:27:00.352 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 327 M 2024-09-12T00:27:00.352 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-12T00:27:00.374 INFO:teuthology.orchestra.run.smithi120.stdout:(3/285): ceph-immutable-object-cache-19.3.0-475 2.1 MB/s | 145 kB 00:00 2024-09-12T00:27:00.467 INFO:teuthology.orchestra.run.smithi120.stdout:(4/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-12T00:27:00.599 INFO:teuthology.orchestra.run.smithi120.stdout:(5/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-12T00:27:00.634 INFO:teuthology.orchestra.run.smithi120.stdout:(6/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 9.2 MB/s | 1.5 MB 00:00 2024-09-12T00:27:00.984 INFO:teuthology.orchestra.run.smithi120.stdout:(7/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-12T00:27:01.215 INFO:teuthology.orchestra.run.smithi083.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 41 kB/s | 6.6 kB 00:00 2024-09-12T00:27:01.268 INFO:teuthology.orchestra.run.smithi120.stdout:(8/285): ceph-common-19.3.0-4753.gd011c522.el9. 17 MB/s | 22 MB 00:01 2024-09-12T00:27:01.310 INFO:teuthology.orchestra.run.smithi120.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 610 kB/s | 25 kB 00:00 2024-09-12T00:27:01.698 INFO:teuthology.orchestra.run.smithi083.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 1.8 MB/s | 899 kB 00:00 2024-09-12T00:27:01.718 INFO:teuthology.orchestra.run.smithi120.stdout:(10/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 16 MB/s | 17 MB 00:01 2024-09-12T00:27:01.774 INFO:teuthology.orchestra.run.smithi083.stdout:(3/285): ceph-immutable-object-cache-19.3.0-475 1.9 MB/s | 145 kB 00:00 2024-09-12T00:27:01.843 INFO:teuthology.orchestra.run.smithi120.stdout:(11/285): ceph-radosgw-19.3.0-4753.gd011c522.el 13 MB/s | 11 MB 00:00 2024-09-12T00:27:01.877 INFO:teuthology.orchestra.run.smithi120.stdout:(12/285): libcephfs-devel-19.3.0-4753.gd011c522 200 kB/s | 32 kB 00:00 2024-09-12T00:27:01.891 INFO:teuthology.orchestra.run.smithi083.stdout:(4/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 6.6 MB/s | 5.5 MB 00:00 2024-09-12T00:27:01.911 INFO:teuthology.orchestra.run.smithi120.stdout:(13/285): libcephfs2-19.3.0-4753.gd011c522.el9. 11 MB/s | 755 kB 00:00 2024-09-12T00:27:01.936 INFO:teuthology.orchestra.run.smithi120.stdout:(14/285): libcephsqlite-19.3.0-4753.gd011c522.e 2.7 MB/s | 161 kB 00:00 2024-09-12T00:27:01.970 INFO:teuthology.orchestra.run.smithi120.stdout:(15/285): librados-devel-19.3.0-4753.gd011c522. 2.1 MB/s | 126 kB 00:00 2024-09-12T00:27:02.012 INFO:teuthology.orchestra.run.smithi120.stdout:(16/285): libradosstriper1-19.3.0-4753.gd011c52 6.6 MB/s | 508 kB 00:00 2024-09-12T00:27:02.032 INFO:teuthology.orchestra.run.smithi083.stdout:(5/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-12T00:27:02.079 INFO:teuthology.orchestra.run.smithi120.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 677 kB/s | 45 kB 00:00 2024-09-12T00:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 1.5 MB/s | 143 kB 00:00 2024-09-12T00:27:02.255 INFO:teuthology.orchestra.run.smithi120.stdout:(19/285): python3-cephfs-19.3.0-4753.gd011c522. 1.9 MB/s | 161 kB 00:00 2024-09-12T00:27:02.380 INFO:teuthology.orchestra.run.smithi120.stdout:(20/285): librgw2-19.3.0-4753.gd011c522.el9.x86 13 MB/s | 5.5 MB 00:00 2024-09-12T00:27:02.414 INFO:teuthology.orchestra.run.smithi120.stdout:(21/285): python3-rados-19.3.0-4753.gd011c522.e 2.0 MB/s | 322 kB 00:00 2024-09-12T00:27:02.416 INFO:teuthology.orchestra.run.smithi083.stdout:(6/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 3.7 MB/s | 2.4 MB 00:00 2024-09-12T00:27:02.439 INFO:teuthology.orchestra.run.smithi120.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 5.1 MB/s | 306 kB 00:00 2024-09-12T00:27:02.464 INFO:teuthology.orchestra.run.smithi120.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T00:27:02.491 INFO:teuthology.orchestra.run.smithi083.stdout:(7/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 10 MB/s | 4.8 MB 00:00 2024-09-12T00:27:02.498 INFO:teuthology.orchestra.run.smithi120.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-12T00:27:02.598 INFO:teuthology.orchestra.run.smithi120.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-12T00:27:02.699 INFO:teuthology.orchestra.run.smithi120.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4753.g 343 kB/s | 34 kB 00:00 2024-09-12T00:27:02.799 INFO:teuthology.orchestra.run.smithi120.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 1.5 MB/s | 154 kB 00:00 2024-09-12T00:27:02.874 INFO:teuthology.orchestra.run.smithi120.stdout:(28/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 7.7 MB/s | 3.2 MB 00:00 2024-09-12T00:27:03.433 INFO:teuthology.orchestra.run.smithi083.stdout:(8/285): ceph-radosgw-19.3.0-4753.gd011c522.el9 12 MB/s | 11 MB 00:00 2024-09-12T00:27:03.509 INFO:teuthology.orchestra.run.smithi083.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 336 kB/s | 25 kB 00:00 2024-09-12T00:27:04.158 INFO:teuthology.orchestra.run.smithi120.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 5.8 MB/s | 7.4 MB 00:01 2024-09-12T00:27:04.258 INFO:teuthology.orchestra.run.smithi120.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4753.gd0 2.8 MB/s | 291 kB 00:00 2024-09-12T00:27:04.350 INFO:teuthology.orchestra.run.smithi120.stdout:(31/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 538 kB/s | 49 kB 00:00 2024-09-12T00:27:04.434 INFO:teuthology.orchestra.run.smithi120.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4753.gd 197 kB/s | 16 kB 00:00 2024-09-12T00:27:04.526 INFO:teuthology.orchestra.run.smithi120.stdout:(33/285): ceph-volume-19.3.0-4753.gd011c522.el9 3.0 MB/s | 285 kB 00:00 2024-09-12T00:27:04.768 INFO:teuthology.orchestra.run.smithi120.stdout:(34/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 7.2 MB/s | 14 MB 00:01 2024-09-12T00:27:04.793 INFO:teuthology.orchestra.run.smithi120.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 2.9 MB/s | 782 kB 00:00 2024-09-12T00:27:04.927 INFO:teuthology.orchestra.run.smithi120.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 635 kB/s | 85 kB 00:00 2024-09-12T00:27:04.985 INFO:teuthology.orchestra.run.smithi120.stdout:(37/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.5 MB/s | 335 kB 00:00 2024-09-12T00:27:05.011 INFO:teuthology.orchestra.run.smithi120.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 590 kB/s | 49 kB 00:00 2024-09-12T00:27:05.045 INFO:teuthology.orchestra.run.smithi120.stdout:(39/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 4.4 MB/s | 262 kB 00:00 2024-09-12T00:27:05.079 INFO:teuthology.orchestra.run.smithi120.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2024-09-12T00:27:05.109 INFO:teuthology.orchestra.run.smithi083.stdout:(10/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 6.4 MB/s | 17 MB 00:02 2024-09-12T00:27:05.309 INFO:teuthology.orchestra.run.smithi083.stdout:(11/285): ceph-common-19.3.0-4753.gd011c522.el9 5.1 MB/s | 22 MB 00:04 2024-09-12T00:27:05.326 INFO:teuthology.orchestra.run.smithi083.stdout:(12/285): libcephfs-devel-19.3.0-4753.gd011c522 146 kB/s | 32 kB 00:00 2024-09-12T00:27:05.368 INFO:teuthology.orchestra.run.smithi083.stdout:(13/285): libcephsqlite-19.3.0-4753.gd011c522.e 3.8 MB/s | 161 kB 00:00 2024-09-12T00:27:05.418 INFO:teuthology.orchestra.run.smithi083.stdout:(14/285): libcephfs2-19.3.0-4753.gd011c522.el9. 6.8 MB/s | 755 kB 00:00 2024-09-12T00:27:05.443 INFO:teuthology.orchestra.run.smithi083.stdout:(15/285): librados-devel-19.3.0-4753.gd011c522. 1.6 MB/s | 126 kB 00:00 2024-09-12T00:27:05.494 INFO:teuthology.orchestra.run.smithi083.stdout:(16/285): libradosstriper1-19.3.0-4753.gd011c52 6.6 MB/s | 508 kB 00:00 2024-09-12T00:27:05.544 INFO:teuthology.orchestra.run.smithi083.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 902 kB/s | 45 kB 00:00 2024-09-12T00:27:05.562 INFO:teuthology.orchestra.run.smithi120.stdout:(41/285): ceph-test-19.3.0-4753.gd011c522.el9.x 12 MB/s | 50 MB 00:04 2024-09-12T00:27:05.587 INFO:teuthology.orchestra.run.smithi120.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 53 kB/s | 27 kB 00:00 2024-09-12T00:27:05.595 INFO:teuthology.orchestra.run.smithi083.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 2.8 MB/s | 143 kB 00:00 2024-09-12T00:27:05.629 INFO:teuthology.orchestra.run.smithi120.stdout:(43/285): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-12T00:27:05.644 INFO:teuthology.orchestra.run.smithi083.stdout:(19/285): python3-cephfs-19.3.0-4753.gd011c522. 3.2 MB/s | 161 kB 00:00 2024-09-12T00:27:05.663 INFO:teuthology.orchestra.run.smithi120.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-09-12T00:27:05.703 INFO:teuthology.orchestra.run.smithi083.stdout:(20/285): python3-rados-19.3.0-4753.gd011c522.e 5.4 MB/s | 322 kB 00:00 2024-09-12T00:27:05.738 INFO:teuthology.orchestra.run.smithi120.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-12T00:27:05.770 INFO:teuthology.orchestra.run.smithi083.stdout:(21/285): python3-rbd-19.3.0-4753.gd011c522.el9 4.5 MB/s | 306 kB 00:00 2024-09-12T00:27:05.797 INFO:teuthology.orchestra.run.smithi120.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T00:27:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:(47/285): libquadmath-11.5.0-2.el9.x86_64.rpm 736 kB/s | 191 kB 00:00 2024-09-12T00:27:05.865 INFO:teuthology.orchestra.run.smithi120.stdout:(48/285): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-12T00:27:05.879 INFO:teuthology.orchestra.run.smithi083.stdout:(22/285): librgw2-19.3.0-4753.gd011c522.el9.x86 13 MB/s | 5.5 MB 00:00 2024-09-12T00:27:05.890 INFO:teuthology.orchestra.run.smithi120.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-12T00:27:05.904 INFO:teuthology.orchestra.run.smithi083.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 746 kB/s | 99 kB 00:00 2024-09-12T00:27:05.915 INFO:teuthology.orchestra.run.smithi120.stdout:(50/285): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T00:27:05.938 INFO:teuthology.orchestra.run.smithi083.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-12T00:27:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:(51/285): python3-pycparser-2.20-6.el9.noarch.r 767 kB/s | 135 kB 00:00 2024-09-12T00:27:06.005 INFO:teuthology.orchestra.run.smithi083.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-12T00:27:06.040 INFO:teuthology.orchestra.run.smithi120.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 4.2 MB/s | 650 kB 00:00 2024-09-12T00:27:06.063 INFO:teuthology.orchestra.run.smithi083.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4753.g 587 kB/s | 34 kB 00:00 2024-09-12T00:27:06.122 INFO:teuthology.orchestra.run.smithi083.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 2.6 MB/s | 154 kB 00:00 2024-09-12T00:27:06.124 INFO:teuthology.orchestra.run.smithi120.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 851 kB/s | 71 kB 00:00 2024-09-12T00:27:06.216 INFO:teuthology.orchestra.run.smithi120.stdout:(54/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.1 MB/s | 523 kB 00:00 2024-09-12T00:27:06.281 INFO:teuthology.orchestra.run.smithi083.stdout:(28/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 8.4 MB/s | 3.2 MB 00:00 2024-09-12T00:27:06.383 INFO:teuthology.orchestra.run.smithi120.stdout:(55/285): apache-commons-io-2.8.0-8.el9.noarch. 1.7 MB/s | 283 kB 00:00 2024-09-12T00:27:06.450 INFO:teuthology.orchestra.run.smithi120.stdout:(56/285): apache-commons-codec-1.15-7.el9.noarc 927 kB/s | 302 kB 00:00 2024-09-12T00:27:06.517 INFO:teuthology.orchestra.run.smithi120.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 4.1 MB/s | 559 kB 00:00 2024-09-12T00:27:06.542 INFO:teuthology.orchestra.run.smithi120.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 944 kB/s | 87 kB 00:00 2024-09-12T00:27:06.601 INFO:teuthology.orchestra.run.smithi120.stdout:(59/285): atinject-1.0.3-6.el9.noarch.rpm 399 kB/s | 23 kB 00:00 2024-09-12T00:27:06.677 INFO:teuthology.orchestra.run.smithi120.stdout:(60/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-09-12T00:27:06.735 INFO:teuthology.orchestra.run.smithi120.stdout:(61/285): avahi-glib-0.8-21.el9.x86_64.rpm 256 kB/s | 15 kB 00:00 2024-09-12T00:27:06.769 INFO:teuthology.orchestra.run.smithi120.stdout:(62/285): atk-2.36.0-5.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-12T00:27:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-12T00:27:06.861 INFO:teuthology.orchestra.run.smithi120.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 581 kB/s | 53 kB 00:00 2024-09-12T00:27:06.937 INFO:teuthology.orchestra.run.smithi120.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2024-09-12T00:27:06.962 INFO:teuthology.orchestra.run.smithi120.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 609 kB/s | 61 kB 00:00 2024-09-12T00:27:07.020 INFO:teuthology.orchestra.run.smithi120.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 338 kB/s | 28 kB 00:00 2024-09-12T00:27:07.039 INFO:teuthology.orchestra.run.smithi083.stdout:(29/285): ceph-test-19.3.0-4753.gd011c522.el9.x 14 MB/s | 50 MB 00:03 2024-09-12T00:27:07.054 INFO:teuthology.orchestra.run.smithi120.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 1.2 MB/s | 113 kB 00:00 2024-09-12T00:27:07.148 INFO:teuthology.orchestra.run.smithi083.stdout:(30/285): ceph-mgr-diskprediction-local-19.3.0- 8.6 MB/s | 7.4 MB 00:00 2024-09-12T00:27:07.154 INFO:teuthology.orchestra.run.smithi120.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 3.8 MB/s | 525 kB 00:00 2024-09-12T00:27:07.173 INFO:teuthology.orchestra.run.smithi083.stdout:(31/285): ceph-mgr-modules-core-19.3.0-4753.gd0 2.1 MB/s | 291 kB 00:00 2024-09-12T00:27:07.200 INFO:teuthology.orchestra.run.smithi083.stdout:(32/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 986 kB/s | 49 kB 00:00 2024-09-12T00:27:07.224 INFO:teuthology.orchestra.run.smithi083.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4753.gd 328 kB/s | 16 kB 00:00 2024-09-12T00:27:07.257 INFO:teuthology.orchestra.run.smithi083.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 4.8 MB/s | 285 kB 00:00 2024-09-12T00:27:07.321 INFO:teuthology.orchestra.run.smithi120.stdout:(70/285): adwaita-icon-theme-40.1.1-3.el9.noarc 8.5 MB/s | 12 MB 00:01 2024-09-12T00:27:07.363 INFO:teuthology.orchestra.run.smithi120.stdout:(71/285): exiv2-0.27.5-2.el9.x86_64.rpm 3.1 MB/s | 980 kB 00:00 2024-09-12T00:27:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:(72/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 2.9 MB/s | 781 kB 00:00 2024-09-12T00:27:07.416 INFO:teuthology.orchestra.run.smithi083.stdout:(35/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 11 MB/s | 14 MB 00:01 2024-09-12T00:27:07.458 INFO:teuthology.orchestra.run.smithi083.stdout:(36/285): cephadm-19.3.0-4753.gd011c522.el9.noa 3.3 MB/s | 782 kB 00:00 2024-09-12T00:27:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 2.1 MB/s | 218 kB 00:00 2024-09-12T00:27:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:(74/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 1.9 MB/s | 325 kB 00:00 2024-09-12T00:27:07.531 INFO:teuthology.orchestra.run.smithi120.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 323 kB/s | 22 kB 00:00 2024-09-12T00:27:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 729 kB/s | 73 kB 00:00 2024-09-12T00:27:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-12T00:27:07.682 INFO:teuthology.orchestra.run.smithi120.stdout:(78/285): flatpak-1.12.9-1.el9.x86_64.rpm 6.4 MB/s | 1.7 MB 00:00 2024-09-12T00:27:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-12T00:27:07.791 INFO:teuthology.orchestra.run.smithi120.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 820 kB/s | 89 kB 00:00 2024-09-12T00:27:07.833 INFO:teuthology.orchestra.run.smithi083.stdout:(37/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 132 kB/s | 49 kB 00:00 2024-09-12T00:27:07.833 INFO:teuthology.orchestra.run.smithi120.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.2 MB/s | 124 kB 00:00 2024-09-12T00:27:07.867 INFO:teuthology.orchestra.run.smithi120.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 644 kB/s | 49 kB 00:00 2024-09-12T00:27:07.875 INFO:teuthology.orchestra.run.smithi083.stdout:(38/285): bluez-libs-5.56-6.el9.x86_64.rpm 185 kB/s | 85 kB 00:00 2024-09-12T00:27:07.934 INFO:teuthology.orchestra.run.smithi120.stdout:(83/285): graphene-1.10.6-2.el9.x86_64.rpm 971 kB/s | 64 kB 00:00 2024-09-12T00:27:07.967 INFO:teuthology.orchestra.run.smithi120.stdout:(84/285): google-guice-4.2.3-9.el9.noarch.rpm 3.5 MB/s | 473 kB 00:00 2024-09-12T00:27:08.018 INFO:teuthology.orchestra.run.smithi083.stdout:(39/285): ModemManager-glib-1.20.2-1.el9.x86_64 441 kB/s | 335 kB 00:00 2024-09-12T00:27:08.026 INFO:teuthology.orchestra.run.smithi120.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 370 kB/s | 34 kB 00:00 2024-09-12T00:27:08.076 INFO:teuthology.orchestra.run.smithi120.stdout:(86/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.2 MB/s | 3.0 MB 00:00 2024-09-12T00:27:08.084 INFO:teuthology.orchestra.run.smithi083.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 382 kB/s | 80 kB 00:00 2024-09-12T00:27:08.135 INFO:teuthology.orchestra.run.smithi120.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 566 kB/s | 33 kB 00:00 2024-09-12T00:27:08.193 INFO:teuthology.orchestra.run.smithi083.stdout:(41/285): libpciaccess-0.16-7.el9.x86_64.rpm 248 kB/s | 27 kB 00:00 2024-09-12T00:27:08.218 INFO:teuthology.orchestra.run.smithi083.stdout:(42/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 681 kB/s | 262 kB 00:00 2024-09-12T00:27:08.335 INFO:teuthology.orchestra.run.smithi083.stdout:(43/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 808 kB/s | 94 kB 00:00 2024-09-12T00:27:08.360 INFO:teuthology.orchestra.run.smithi120.stdout:(88/285): gtk3-3.24.31-5.el9.x86_64.rpm 22 MB/s | 4.9 MB 00:00 2024-09-12T00:27:08.394 INFO:teuthology.orchestra.run.smithi083.stdout:(44/285): libquadmath-11.5.0-2.el9.x86_64.rpm 952 kB/s | 191 kB 00:00 2024-09-12T00:27:08.419 INFO:teuthology.orchestra.run.smithi083.stdout:(45/285): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-12T00:27:08.527 INFO:teuthology.orchestra.run.smithi083.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 984 kB/s | 106 kB 00:00 2024-09-12T00:27:08.536 INFO:teuthology.orchestra.run.smithi120.stdout:(89/285): guava-30.1-6.el9.noarch.rpm 13 MB/s | 2.3 MB 00:00 2024-09-12T00:27:08.553 INFO:teuthology.orchestra.run.smithi083.stdout:(47/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-12T00:27:08.636 INFO:teuthology.orchestra.run.smithi120.stdout:(90/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 2.1 MB/s | 1.4 MB 00:00 2024-09-12T00:27:08.644 INFO:teuthology.orchestra.run.smithi083.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T00:27:08.670 INFO:teuthology.orchestra.run.smithi120.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 1.6 MB/s | 219 kB 00:00 2024-09-12T00:27:08.670 INFO:teuthology.orchestra.run.smithi083.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-12T00:27:08.704 INFO:teuthology.orchestra.run.smithi083.stdout:(50/285): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-09-12T00:27:08.770 INFO:teuthology.orchestra.run.smithi083.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-12T00:27:08.787 INFO:teuthology.orchestra.run.smithi120.stdout:(92/285): httpcomponents-core-4.4.13-7.el9.noar 5.3 MB/s | 632 kB 00:00 2024-09-12T00:27:08.895 INFO:teuthology.orchestra.run.smithi120.stdout:(93/285): gstreamer1-plugins-base-1.22.1-2.el9. 2.6 MB/s | 2.2 MB 00:00 2024-09-12T00:27:08.962 INFO:teuthology.orchestra.run.smithi120.stdout:(94/285): jakarta-annotations-1.3.5-13.el9.noar 675 kB/s | 45 kB 00:00 2024-09-12T00:27:08.979 INFO:teuthology.orchestra.run.smithi083.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.1 MB/s | 650 kB 00:00 2024-09-12T00:27:08.996 INFO:teuthology.orchestra.run.smithi120.stdout:(95/285): httpcomponents-client-4.5.13-3.el9.no 1.8 MB/s | 657 kB 00:00 2024-09-12T00:27:09.046 INFO:teuthology.orchestra.run.smithi083.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 1.0 MB/s | 71 kB 00:00 2024-09-12T00:27:09.080 INFO:teuthology.orchestra.run.smithi083.stdout:(54/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.7 MB/s | 523 kB 00:00 2024-09-12T00:27:09.080 INFO:teuthology.orchestra.run.smithi120.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 940 kB/s | 110 kB 00:00 2024-09-12T00:27:09.113 INFO:teuthology.orchestra.run.smithi083.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 4.4 MB/s | 302 kB 00:00 2024-09-12T00:27:09.155 INFO:teuthology.orchestra.run.smithi083.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 3.7 MB/s | 283 kB 00:00 2024-09-12T00:27:09.163 INFO:teuthology.orchestra.run.smithi120.stdout:(97/285): iso-codes-4.6.0-3.el9.noarch.rpm 9.4 MB/s | 3.5 MB 00:00 2024-09-12T00:27:09.205 INFO:teuthology.orchestra.run.smithi083.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 5.9 MB/s | 559 kB 00:00 2024-09-12T00:27:09.231 INFO:teuthology.orchestra.run.smithi083.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-09-12T00:27:09.263 INFO:teuthology.orchestra.run.smithi120.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 1.5 MB/s | 413 kB 00:00 2024-09-12T00:27:09.281 INFO:teuthology.orchestra.run.smithi083.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-09-12T00:27:09.306 INFO:teuthology.orchestra.run.smithi083.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 309 kB/s | 23 kB 00:00 2024-09-12T00:27:09.314 INFO:teuthology.orchestra.run.smithi120.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 261 kB/s | 13 kB 00:00 2024-09-12T00:27:09.356 INFO:teuthology.orchestra.run.smithi083.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-12T00:27:09.381 INFO:teuthology.orchestra.run.smithi120.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 798 kB/s | 53 kB 00:00 2024-09-12T00:27:09.381 INFO:teuthology.orchestra.run.smithi083.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 198 kB/s | 15 kB 00:00 2024-09-12T00:27:09.432 INFO:teuthology.orchestra.run.smithi083.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-12T00:27:09.439 INFO:teuthology.orchestra.run.smithi120.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 411 kB/s | 24 kB 00:00 2024-09-12T00:27:09.457 INFO:teuthology.orchestra.run.smithi083.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 708 kB/s | 53 kB 00:00 2024-09-12T00:27:09.491 INFO:teuthology.orchestra.run.smithi083.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-09-12T00:27:09.516 INFO:teuthology.orchestra.run.smithi083.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-12T00:27:09.541 INFO:teuthology.orchestra.run.smithi083.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 563 kB/s | 28 kB 00:00 2024-09-12T00:27:09.556 INFO:teuthology.orchestra.run.smithi120.stdout:(102/285): jsoup-1.13.1-10.el9.noarch.rpm 3.2 MB/s | 377 kB 00:00 2024-09-12T00:27:09.558 INFO:teuthology.orchestra.run.smithi083.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 2.6 MB/s | 113 kB 00:00 2024-09-12T00:27:09.609 INFO:teuthology.orchestra.run.smithi083.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 7.6 MB/s | 525 kB 00:00 2024-09-12T00:27:09.615 INFO:teuthology.orchestra.run.smithi120.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 610 kB/s | 35 kB 00:00 2024-09-12T00:27:09.659 INFO:teuthology.orchestra.run.smithi083.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 9.5 MB/s | 980 kB 00:00 2024-09-12T00:27:09.701 INFO:teuthology.orchestra.run.smithi083.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 8.3 MB/s | 781 kB 00:00 2024-09-12T00:27:09.707 INFO:teuthology.orchestra.run.smithi120.stdout:(104/285): lcms2-2.12-3.el9.x86_64.rpm 1.8 MB/s | 168 kB 00:00 2024-09-12T00:27:09.743 INFO:teuthology.orchestra.run.smithi083.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.8 MB/s | 325 kB 00:00 2024-09-12T00:27:09.749 INFO:teuthology.orchestra.run.smithi120.stdout:(105/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 267 kB/s | 11 kB 00:00 2024-09-12T00:27:09.768 INFO:teuthology.orchestra.run.smithi083.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 3.2 MB/s | 218 kB 00:00 2024-09-12T00:27:09.833 INFO:teuthology.orchestra.run.smithi120.stdout:(106/285): java-11-openjdk-devel-11.0.20.1.1-2. 4.4 MB/s | 3.3 MB 00:00 2024-09-12T00:27:09.852 INFO:teuthology.orchestra.run.smithi083.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 260 kB/s | 22 kB 00:00 2024-09-12T00:27:09.858 INFO:teuthology.orchestra.run.smithi120.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 223 kB/s | 24 kB 00:00 2024-09-12T00:27:09.916 INFO:teuthology.orchestra.run.smithi120.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 368 kB/s | 31 kB 00:00 2024-09-12T00:27:09.942 INFO:teuthology.orchestra.run.smithi120.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 273 kB/s | 23 kB 00:00 2024-09-12T00:27:09.944 INFO:teuthology.orchestra.run.smithi083.stdout:(75/285): flatpak-1.12.9-1.el9.x86_64.rpm 8.6 MB/s | 1.7 MB 00:00 2024-09-12T00:27:09.961 INFO:teuthology.orchestra.run.smithi083.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 672 kB/s | 73 kB 00:00 2024-09-12T00:27:09.992 INFO:teuthology.orchestra.run.smithi120.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 263 kB/s | 20 kB 00:00 2024-09-12T00:27:10.017 INFO:teuthology.orchestra.run.smithi120.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 526 kB/s | 40 kB 00:00 2024-09-12T00:27:10.019 INFO:teuthology.orchestra.run.smithi083.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-09-12T00:27:10.076 INFO:teuthology.orchestra.run.smithi120.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 180 kB/s | 15 kB 00:00 2024-09-12T00:27:10.101 INFO:teuthology.orchestra.run.smithi120.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 340 kB/s | 28 kB 00:00 2024-09-12T00:27:10.111 INFO:teuthology.orchestra.run.smithi083.stdout:(78/285): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-12T00:27:10.143 INFO:teuthology.orchestra.run.smithi120.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 321 kB/s | 21 kB 00:00 2024-09-12T00:27:10.162 INFO:teuthology.orchestra.run.smithi083.stdout:(79/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-12T00:27:10.169 INFO:teuthology.orchestra.run.smithi120.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 284 kB/s | 19 kB 00:00 2024-09-12T00:27:10.187 INFO:teuthology.orchestra.run.smithi083.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.2 MB/s | 89 kB 00:00 2024-09-12T00:27:10.211 INFO:teuthology.orchestra.run.smithi120.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 279 kB/s | 19 kB 00:00 2024-09-12T00:27:10.237 INFO:teuthology.orchestra.run.smithi083.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.6 MB/s | 124 kB 00:00 2024-09-12T00:27:10.253 INFO:teuthology.orchestra.run.smithi120.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 364 kB/s | 30 kB 00:00 2024-09-12T00:27:10.262 INFO:teuthology.orchestra.run.smithi083.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 644 kB/s | 49 kB 00:00 2024-09-12T00:27:10.286 INFO:teuthology.orchestra.run.smithi120.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-09-12T00:27:10.313 INFO:teuthology.orchestra.run.smithi083.stdout:(83/285): google-guice-4.2.3-9.el9.noarch.rpm 6.1 MB/s | 473 kB 00:00 2024-09-12T00:27:10.338 INFO:teuthology.orchestra.run.smithi083.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 856 kB/s | 64 kB 00:00 2024-09-12T00:27:10.345 INFO:teuthology.orchestra.run.smithi120.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 346 kB/s | 32 kB 00:00 2024-09-12T00:27:10.363 INFO:teuthology.orchestra.run.smithi083.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 681 kB/s | 34 kB 00:00 2024-09-12T00:27:10.402 INFO:teuthology.orchestra.run.smithi120.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 1.4 MB/s | 161 kB 00:00 2024-09-12T00:27:10.464 INFO:teuthology.orchestra.run.smithi083.stdout:(86/285): gstreamer1-plugins-base-1.22.1-2.el9. 22 MB/s | 2.2 MB 00:00 2024-09-12T00:27:10.506 INFO:teuthology.orchestra.run.smithi083.stdout:(87/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 8.6 MB/s | 1.4 MB 00:00 2024-09-12T00:27:10.523 INFO:teuthology.orchestra.run.smithi083.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 565 kB/s | 33 kB 00:00 2024-09-12T00:27:10.587 INFO:teuthology.orchestra.run.smithi120.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 999 kB/s | 241 kB 00:00 2024-09-12T00:27:10.613 INFO:teuthology.orchestra.run.smithi120.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 2.0 MB/s | 435 kB 00:00 2024-09-12T00:27:10.632 INFO:teuthology.orchestra.run.smithi083.stdout:(89/285): guava-30.1-6.el9.noarch.rpm 21 MB/s | 2.3 MB 00:00 2024-09-12T00:27:10.663 INFO:teuthology.orchestra.run.smithi120.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 411 kB/s | 31 kB 00:00 2024-09-12T00:27:10.715 INFO:teuthology.orchestra.run.smithi083.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 2.6 MB/s | 219 kB 00:00 2024-09-12T00:27:10.865 INFO:teuthology.orchestra.run.smithi083.stdout:(91/285): gtk3-3.24.31-5.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-12T00:27:10.940 INFO:teuthology.orchestra.run.smithi083.stdout:(92/285): httpcomponents-core-4.4.13-7.el9.noar 8.2 MB/s | 632 kB 00:00 2024-09-12T00:27:11.030 INFO:teuthology.orchestra.run.smithi120.stdout:(124/285): java-11-openjdk-headless-11.0.20.1.1 21 MB/s | 39 MB 00:01 2024-09-12T00:27:11.055 INFO:teuthology.orchestra.run.smithi120.stdout:(125/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 187 kB/s | 83 kB 00:00 2024-09-12T00:27:11.074 INFO:teuthology.orchestra.run.smithi083.stdout:(93/285): iso-codes-4.6.0-3.el9.noarch.rpm 26 MB/s | 3.5 MB 00:00 2024-09-12T00:27:11.106 INFO:teuthology.orchestra.run.smithi120.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 488 kB/s | 37 kB 00:00 2024-09-12T00:27:11.156 INFO:teuthology.orchestra.run.smithi120.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.4 MB/s | 142 kB 00:00 2024-09-12T00:27:11.182 INFO:teuthology.orchestra.run.smithi120.stdout:(128/285): libglvnd-1.3.4-1.el9.x86_64.rpm 261 kB/s | 135 kB 00:00 2024-09-12T00:27:11.208 INFO:teuthology.orchestra.run.smithi083.stdout:(94/285): adwaita-icon-theme-40.1.1-3.el9.noarc 4.8 MB/s | 12 MB 00:02 2024-09-12T00:27:11.233 INFO:teuthology.orchestra.run.smithi083.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 284 kB/s | 45 kB 00:00 2024-09-12T00:27:11.240 INFO:teuthology.orchestra.run.smithi120.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 943 kB/s | 79 kB 00:00 2024-09-12T00:27:11.265 INFO:teuthology.orchestra.run.smithi120.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 734 kB/s | 61 kB 00:00 2024-09-12T00:27:11.283 INFO:teuthology.orchestra.run.smithi083.stdout:(96/285): httpcomponents-client-4.5.13-3.el9.no 1.1 MB/s | 657 kB 00:00 2024-09-12T00:27:11.290 INFO:teuthology.orchestra.run.smithi120.stdout:(131/285): libgsf-1.14.47-5.el9.x86_64.rpm 1.4 MB/s | 256 kB 00:00 2024-09-12T00:27:11.309 INFO:teuthology.orchestra.run.smithi083.stdout:(97/285): jansi-2.3.3-6.el9.x86_64.rpm 1.1 MB/s | 110 kB 00:00 2024-09-12T00:27:11.316 INFO:teuthology.orchestra.run.smithi120.stdout:(132/285): libldac-2.0.2.3-10.el9.x86_64.rpm 547 kB/s | 41 kB 00:00 2024-09-12T00:27:11.334 INFO:teuthology.orchestra.run.smithi083.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 4.0 MB/s | 413 kB 00:00 2024-09-12T00:27:11.350 INFO:teuthology.orchestra.run.smithi120.stdout:(133/285): libnotify-0.7.9-8.el9.x86_64.rpm 520 kB/s | 44 kB 00:00 2024-09-12T00:27:11.375 INFO:teuthology.orchestra.run.smithi120.stdout:(134/285): libogg-1.3.4-6.el9.x86_64.rpm 400 kB/s | 34 kB 00:00 2024-09-12T00:27:11.401 INFO:teuthology.orchestra.run.smithi083.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 195 kB/s | 13 kB 00:00 2024-09-12T00:27:11.450 INFO:teuthology.orchestra.run.smithi120.stdout:(135/285): libosinfo-1.10.0-1.el9.x86_64.rpm 2.3 MB/s | 319 kB 00:00 2024-09-12T00:27:11.468 INFO:teuthology.orchestra.run.smithi083.stdout:(100/285): java-11-openjdk-devel-11.0.20.1.1-2. 18 MB/s | 3.3 MB 00:00 2024-09-12T00:27:11.492 INFO:teuthology.orchestra.run.smithi120.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-12T00:27:11.493 INFO:teuthology.orchestra.run.smithi083.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 576 kB/s | 53 kB 00:00 2024-09-12T00:27:11.517 INFO:teuthology.orchestra.run.smithi120.stdout:(137/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 957 kB/s | 160 kB 00:00 2024-09-12T00:27:11.518 INFO:teuthology.orchestra.run.smithi083.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 478 kB/s | 24 kB 00:00 2024-09-12T00:27:11.552 INFO:teuthology.orchestra.run.smithi083.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 377 kB 00:00 2024-09-12T00:27:11.576 INFO:teuthology.orchestra.run.smithi120.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 535 kB/s | 45 kB 00:00 2024-09-12T00:27:11.577 INFO:teuthology.orchestra.run.smithi083.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 606 kB/s | 35 kB 00:00 2024-09-12T00:27:11.611 INFO:teuthology.orchestra.run.smithi083.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-12T00:27:11.636 INFO:teuthology.orchestra.run.smithi083.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 189 kB/s | 11 kB 00:00 2024-09-12T00:27:11.668 INFO:teuthology.orchestra.run.smithi120.stdout:(139/285): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-12T00:27:11.669 INFO:teuthology.orchestra.run.smithi083.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 412 kB/s | 24 kB 00:00 2024-09-12T00:27:11.693 INFO:teuthology.orchestra.run.smithi120.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 1.4 MB/s | 164 kB 00:00 2024-09-12T00:27:11.695 INFO:teuthology.orchestra.run.smithi083.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 525 kB/s | 31 kB 00:00 2024-09-12T00:27:11.720 INFO:teuthology.orchestra.run.smithi083.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 454 kB/s | 23 kB 00:00 2024-09-12T00:27:11.736 INFO:teuthology.orchestra.run.smithi120.stdout:(141/285): libsndfile-1.0.31-8.el9.x86_64.rpm 949 kB/s | 206 kB 00:00 2024-09-12T00:27:11.746 INFO:teuthology.orchestra.run.smithi083.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-12T00:27:11.761 INFO:teuthology.orchestra.run.smithi120.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 529 kB/s | 36 kB 00:00 2024-09-12T00:27:11.779 INFO:teuthology.orchestra.run.smithi083.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 677 kB/s | 40 kB 00:00 2024-09-12T00:27:11.805 INFO:teuthology.orchestra.run.smithi083.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 258 kB/s | 15 kB 00:00 2024-09-12T00:27:11.820 INFO:teuthology.orchestra.run.smithi120.stdout:(143/285): libtiff-4.4.0-13.el9.x86_64.rpm 1.3 MB/s | 198 kB 00:00 2024-09-12T00:27:11.838 INFO:teuthology.orchestra.run.smithi083.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 487 kB/s | 28 kB 00:00 2024-09-12T00:27:11.863 INFO:teuthology.orchestra.run.smithi083.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 366 kB/s | 21 kB 00:00 2024-09-12T00:27:11.870 INFO:teuthology.orchestra.run.smithi120.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.3 MB/s | 144 kB 00:00 2024-09-12T00:27:11.889 INFO:teuthology.orchestra.run.smithi083.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 380 kB/s | 19 kB 00:00 2024-09-12T00:27:11.904 INFO:teuthology.orchestra.run.smithi120.stdout:(145/285): libtracker-sparql-3.1.2-3.el9.x86_64 1.9 MB/s | 324 kB 00:00 2024-09-12T00:27:11.914 INFO:teuthology.orchestra.run.smithi083.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 375 kB/s | 19 kB 00:00 2024-09-12T00:27:11.939 INFO:teuthology.orchestra.run.smithi083.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 605 kB/s | 30 kB 00:00 2024-09-12T00:27:11.954 INFO:teuthology.orchestra.run.smithi120.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 1.4 MB/s | 193 kB 00:00 2024-09-12T00:27:11.965 INFO:teuthology.orchestra.run.smithi083.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-12T00:27:11.985 INFO:teuthology.orchestra.run.smithi120.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 291 kB/s | 33 kB 00:00 2024-09-12T00:27:11.990 INFO:teuthology.orchestra.run.smithi083.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 632 kB/s | 32 kB 00:00 2024-09-12T00:27:12.010 INFO:teuthology.orchestra.run.smithi120.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 183 kB/s | 19 kB 00:00 2024-09-12T00:27:12.023 INFO:teuthology.orchestra.run.smithi083.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-12T00:27:12.043 INFO:teuthology.orchestra.run.smithi120.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 144 kB/s | 13 kB 00:00 2024-09-12T00:27:12.049 INFO:teuthology.orchestra.run.smithi083.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-09-12T00:27:12.086 INFO:teuthology.orchestra.run.smithi120.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 556 kB/s | 42 kB 00:00 2024-09-12T00:27:12.091 INFO:teuthology.orchestra.run.smithi083.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 6.3 MB/s | 435 kB 00:00 2024-09-12T00:27:12.108 INFO:teuthology.orchestra.run.smithi083.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 529 kB/s | 31 kB 00:00 2024-09-12T00:27:12.136 INFO:teuthology.orchestra.run.smithi120.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.4 MB/s | 133 kB 00:00 2024-09-12T00:27:12.150 INFO:teuthology.orchestra.run.smithi083.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-12T00:27:12.161 INFO:teuthology.orchestra.run.smithi120.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 168 kB/s | 13 kB 00:00 2024-09-12T00:27:12.175 INFO:teuthology.orchestra.run.smithi083.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.0 MB/s | 135 kB 00:00 2024-09-12T00:27:12.186 INFO:teuthology.orchestra.run.smithi120.stdout:(153/285): libwebp-1.2.0-8.el9.x86_64.rpm 1.5 MB/s | 277 kB 00:00 2024-09-12T00:27:12.201 INFO:teuthology.orchestra.run.smithi083.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 727 kB/s | 37 kB 00:00 2024-09-12T00:27:12.212 INFO:teuthology.orchestra.run.smithi120.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 474 kB/s | 36 kB 00:00 2024-09-12T00:27:12.234 INFO:teuthology.orchestra.run.smithi083.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-12T00:27:12.259 INFO:teuthology.orchestra.run.smithi083.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-12T00:27:12.279 INFO:teuthology.orchestra.run.smithi120.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T00:27:12.293 INFO:teuthology.orchestra.run.smithi083.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-09-12T00:27:12.304 INFO:teuthology.orchestra.run.smithi120.stdout:(156/285): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T00:27:12.318 INFO:teuthology.orchestra.run.smithi083.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-12T00:27:12.330 INFO:teuthology.orchestra.run.smithi120.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 1.3 MB/s | 151 kB 00:00 2024-09-12T00:27:12.352 INFO:teuthology.orchestra.run.smithi083.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 705 kB/s | 41 kB 00:00 2024-09-12T00:27:12.363 INFO:teuthology.orchestra.run.smithi120.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 211 kB/s | 18 kB 00:00 2024-09-12T00:27:12.385 INFO:teuthology.orchestra.run.smithi083.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 651 kB/s | 44 kB 00:00 2024-09-12T00:27:12.397 INFO:teuthology.orchestra.run.smithi120.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 135 kB/s | 9.0 kB 00:00 2024-09-12T00:27:12.411 INFO:teuthology.orchestra.run.smithi083.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 575 kB/s | 34 kB 00:00 2024-09-12T00:27:12.444 INFO:teuthology.orchestra.run.smithi083.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-12T00:27:12.464 INFO:teuthology.orchestra.run.smithi120.stdout:(160/285): maven-lib-3.6.3-15.el9.noarch.rpm 9.3 MB/s | 1.5 MB 00:00 2024-09-12T00:27:12.470 INFO:teuthology.orchestra.run.smithi083.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T00:27:12.503 INFO:teuthology.orchestra.run.smithi083.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-12T00:27:12.523 INFO:teuthology.orchestra.run.smithi120.stdout:(161/285): maven-resolver-1.6.1-10.el9.noarch.r 3.2 MB/s | 517 kB 00:00 2024-09-12T00:27:12.537 INFO:teuthology.orchestra.run.smithi083.stdout:(137/285): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-12T00:27:12.548 INFO:teuthology.orchestra.run.smithi120.stdout:(162/285): maven-shared-utils-3.3.4-3.el9.noarc 1.0 MB/s | 151 kB 00:00 2024-09-12T00:27:12.562 INFO:teuthology.orchestra.run.smithi083.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-09-12T00:27:12.581 INFO:teuthology.orchestra.run.smithi120.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 958 kB/s | 112 kB 00:00 2024-09-12T00:27:12.596 INFO:teuthology.orchestra.run.smithi083.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 3.5 MB/s | 206 kB 00:00 2024-09-12T00:27:12.615 INFO:teuthology.orchestra.run.smithi120.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 168 kB/s | 11 kB 00:00 2024-09-12T00:27:12.621 INFO:teuthology.orchestra.run.smithi083.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-12T00:27:12.655 INFO:teuthology.orchestra.run.smithi083.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2024-09-12T00:27:12.666 INFO:teuthology.orchestra.run.smithi120.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.6 MB/s | 139 kB 00:00 2024-09-12T00:27:12.680 INFO:teuthology.orchestra.run.smithi083.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 608 kB/s | 36 kB 00:00 2024-09-12T00:27:12.714 INFO:teuthology.orchestra.run.smithi083.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 5.4 MB/s | 324 kB 00:00 2024-09-12T00:27:12.724 INFO:teuthology.orchestra.run.smithi120.stdout:(166/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 623 kB/s | 36 kB 00:00 2024-09-12T00:27:12.739 INFO:teuthology.orchestra.run.smithi083.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-12T00:27:12.750 INFO:teuthology.orchestra.run.smithi120.stdout:(167/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-12T00:27:12.773 INFO:teuthology.orchestra.run.smithi083.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-12T00:27:12.798 INFO:teuthology.orchestra.run.smithi083.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 570 kB/s | 33 kB 00:00 2024-09-12T00:27:12.808 INFO:teuthology.orchestra.run.smithi120.stdout:(168/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 554 kB/s | 32 kB 00:00 2024-09-12T00:27:12.832 INFO:teuthology.orchestra.run.smithi083.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 331 kB/s | 19 kB 00:00 2024-09-12T00:27:12.833 INFO:teuthology.orchestra.run.smithi120.stdout:(169/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 422 kB/s | 46 kB 00:00 2024-09-12T00:27:12.857 INFO:teuthology.orchestra.run.smithi083.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 220 kB/s | 13 kB 00:00 2024-09-12T00:27:12.890 INFO:teuthology.orchestra.run.smithi083.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 716 kB/s | 42 kB 00:00 2024-09-12T00:27:12.892 INFO:teuthology.orchestra.run.smithi120.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-12T00:27:12.916 INFO:teuthology.orchestra.run.smithi083.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 277 kB 00:00 2024-09-12T00:27:12.949 INFO:teuthology.orchestra.run.smithi083.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-12T00:27:12.975 INFO:teuthology.orchestra.run.smithi083.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 215 kB/s | 13 kB 00:00 2024-09-12T00:27:12.992 INFO:teuthology.orchestra.run.smithi120.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.6 MB/s | 163 kB 00:00 2024-09-12T00:27:13.000 INFO:teuthology.orchestra.run.smithi083.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 712 kB/s | 36 kB 00:00 2024-09-12T00:27:13.034 INFO:teuthology.orchestra.run.smithi083.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T00:27:13.059 INFO:teuthology.orchestra.run.smithi083.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-12T00:27:13.093 INFO:teuthology.orchestra.run.smithi083.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T00:27:13.118 INFO:teuthology.orchestra.run.smithi083.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 301 kB/s | 18 kB 00:00 2024-09-12T00:27:13.177 INFO:teuthology.orchestra.run.smithi083.stdout:(158/285): maven-lib-3.6.3-15.el9.noarch.rpm 18 MB/s | 1.5 MB 00:00 2024-09-12T00:27:13.194 INFO:teuthology.orchestra.run.smithi083.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 120 kB/s | 9.0 kB 00:00 2024-09-12T00:27:13.243 INFO:teuthology.orchestra.run.smithi120.stdout:(172/285): opus-1.3.1-10.el9.x86_64.rpm 799 kB/s | 200 kB 00:00 2024-09-12T00:27:13.252 INFO:teuthology.orchestra.run.smithi083.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 6.7 MB/s | 517 kB 00:00 2024-09-12T00:27:13.277 INFO:teuthology.orchestra.run.smithi083.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 1.8 MB/s | 151 kB 00:00 2024-09-12T00:27:13.320 INFO:teuthology.orchestra.run.smithi083.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.6 MB/s | 112 kB 00:00 2024-09-12T00:27:13.420 INFO:teuthology.orchestra.run.smithi083.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 112 kB/s | 11 kB 00:00 2024-09-12T00:27:13.479 INFO:teuthology.orchestra.run.smithi083.stdout:(164/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-12T00:27:13.551 INFO:teuthology.orchestra.run.smithi120.stdout:(173/285): openblas-openmp-0.3.26-2.el9.x86_64. 6.9 MB/s | 4.9 MB 00:00 2024-09-12T00:27:13.585 INFO:teuthology.orchestra.run.smithi120.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 537 kB/s | 183 kB 00:00 2024-09-12T00:27:13.595 INFO:teuthology.orchestra.run.smithi083.stdout:(165/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 28 MB/s | 8.8 MB 00:00 2024-09-12T00:27:13.621 INFO:teuthology.orchestra.run.smithi083.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-12T00:27:13.654 INFO:teuthology.orchestra.run.smithi083.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 620 kB/s | 36 kB 00:00 2024-09-12T00:27:13.680 INFO:teuthology.orchestra.run.smithi083.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 782 kB/s | 46 kB 00:00 2024-09-12T00:27:13.707 INFO:teuthology.orchestra.run.smithi083.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 609 kB/s | 32 kB 00:00 2024-09-12T00:27:13.710 INFO:teuthology.orchestra.run.smithi120.stdout:(175/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 7.4 MB/s | 8.8 MB 00:01 2024-09-12T00:27:13.733 INFO:teuthology.orchestra.run.smithi083.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 730 kB/s | 38 kB 00:00 2024-09-12T00:27:13.778 INFO:teuthology.orchestra.run.smithi120.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 384 kB/s | 74 kB 00:00 2024-09-12T00:27:13.808 INFO:teuthology.orchestra.run.smithi083.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.1 MB/s | 163 kB 00:00 2024-09-12T00:27:13.853 INFO:teuthology.orchestra.run.smithi120.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 3.2 MB/s | 468 kB 00:00 2024-09-12T00:27:13.875 INFO:teuthology.orchestra.run.smithi083.stdout:(172/285): openblas-openmp-0.3.26-2.el9.x86_64. 30 MB/s | 4.9 MB 00:00 2024-09-12T00:27:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:(178/285): osinfo-db-20240701-2.el9.noarch.rpm 1.5 MB/s | 531 kB 00:00 2024-09-12T00:27:13.900 INFO:teuthology.orchestra.run.smithi083.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2024-09-12T00:27:13.934 INFO:teuthology.orchestra.run.smithi083.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-12T00:27:13.953 INFO:teuthology.orchestra.run.smithi120.stdout:(179/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 859 kB/s | 57 kB 00:00 2024-09-12T00:27:13.959 INFO:teuthology.orchestra.run.smithi083.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 8.9 MB/s | 531 kB 00:00 2024-09-12T00:27:13.987 INFO:teuthology.orchestra.run.smithi120.stdout:(180/285): p11-kit-server-0.25.3-2.el9.x86_64.r 1.1 MB/s | 246 kB 00:00 2024-09-12T00:27:14.012 INFO:teuthology.orchestra.run.smithi120.stdout:(181/285): pipewire-1.0.1-1.el9.x86_64.rpm 669 kB/s | 107 kB 00:00 2024-09-12T00:27:14.054 INFO:teuthology.orchestra.run.smithi120.stdout:(182/285): pipewire-jack-audio-connection-kit-1 91 kB/s | 9.1 kB 00:00 2024-09-12T00:27:14.062 INFO:teuthology.orchestra.run.smithi083.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 575 kB/s | 74 kB 00:00 2024-09-12T00:27:14.097 INFO:teuthology.orchestra.run.smithi120.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.6 MB/s | 135 kB 00:00 2024-09-12T00:27:14.143 INFO:teuthology.orchestra.run.smithi083.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 2.5 MB/s | 468 kB 00:00 2024-09-12T00:27:14.155 INFO:teuthology.orchestra.run.smithi120.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.9 MB/s | 192 kB 00:00 2024-09-12T00:27:14.169 INFO:teuthology.orchestra.run.smithi083.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 2.3 MB/s | 246 kB 00:00 2024-09-12T00:27:14.180 INFO:teuthology.orchestra.run.smithi120.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 309 kB/s | 26 kB 00:00 2024-09-12T00:27:14.203 INFO:teuthology.orchestra.run.smithi083.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-12T00:27:14.228 INFO:teuthology.orchestra.run.smithi083.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 977 kB/s | 57 kB 00:00 2024-09-12T00:27:14.239 INFO:teuthology.orchestra.run.smithi120.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 719 kB/s | 60 kB 00:00 2024-09-12T00:27:14.253 INFO:teuthology.orchestra.run.smithi083.stdout:(181/285): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-09-12T00:27:14.264 INFO:teuthology.orchestra.run.smithi120.stdout:(187/285): plexus-containers-component-annotati 220 kB/s | 18 kB 00:00 2024-09-12T00:27:14.287 INFO:teuthology.orchestra.run.smithi083.stdout:(182/285): pipewire-jack-audio-connection-kit-l 2.3 MB/s | 135 kB 00:00 2024-09-12T00:27:14.331 INFO:teuthology.orchestra.run.smithi120.stdout:(188/285): plexus-sec-dispatcher-1.4-37.el9.noa 505 kB/s | 34 kB 00:00 2024-09-12T00:27:14.345 INFO:teuthology.orchestra.run.smithi083.stdout:(183/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 21 MB/s | 1.9 MB 00:00 2024-09-12T00:27:14.368 INFO:teuthology.orchestra.run.smithi120.stdout:(189/285): plexus-interpolation-1.26-11.el9.noa 634 kB/s | 80 kB 00:00 2024-09-12T00:27:14.370 INFO:teuthology.orchestra.run.smithi083.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.2 MB/s | 192 kB 00:00 2024-09-12T00:27:14.404 INFO:teuthology.orchestra.run.smithi083.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 440 kB/s | 26 kB 00:00 2024-09-12T00:27:14.429 INFO:teuthology.orchestra.run.smithi083.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 1.0 MB/s | 60 kB 00:00 2024-09-12T00:27:14.463 INFO:teuthology.orchestra.run.smithi083.stdout:(187/285): plexus-containers-component-annotati 314 kB/s | 18 kB 00:00 2024-09-12T00:27:14.473 INFO:teuthology.orchestra.run.smithi120.stdout:(190/285): poppler-21.01.0-21.el9.x86_64.rpm 9.8 MB/s | 1.1 MB 00:00 2024-09-12T00:27:14.480 INFO:teuthology.orchestra.run.smithi083.stdout:(188/285): plexus-interpolation-1.26-11.el9.noa 1.5 MB/s | 80 kB 00:00 2024-09-12T00:27:14.522 INFO:teuthology.orchestra.run.smithi083.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 573 kB/s | 34 kB 00:00 2024-09-12T00:27:14.532 INFO:teuthology.orchestra.run.smithi120.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 1.2 MB/s | 254 kB 00:00 2024-09-12T00:27:14.556 INFO:teuthology.orchestra.run.smithi083.stdout:(190/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-12T00:27:14.598 INFO:teuthology.orchestra.run.smithi083.stdout:(191/285): poppler-21.01.0-21.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-09-12T00:27:14.648 INFO:teuthology.orchestra.run.smithi083.stdout:(192/285): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-09-12T00:27:14.658 INFO:teuthology.orchestra.run.smithi120.stdout:(192/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 3.0 MB/s | 1.9 MB 00:00 2024-09-12T00:27:14.673 INFO:teuthology.orchestra.run.smithi083.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-12T00:27:14.683 INFO:teuthology.orchestra.run.smithi120.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 1.0 MB/s | 152 kB 00:00 2024-09-12T00:27:14.716 INFO:teuthology.orchestra.run.smithi083.stdout:(194/285): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-12T00:27:14.740 INFO:teuthology.orchestra.run.smithi083.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-12T00:27:14.741 INFO:teuthology.orchestra.run.smithi120.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 7.0 MB/s | 1.9 MB 00:00 2024-09-12T00:27:14.784 INFO:teuthology.orchestra.run.smithi120.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 824 kB/s | 83 kB 00:00 2024-09-12T00:27:14.826 INFO:teuthology.orchestra.run.smithi120.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2024-09-12T00:27:14.909 INFO:teuthology.orchestra.run.smithi120.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 4.0 MB/s | 679 kB 00:00 2024-09-12T00:27:14.934 INFO:teuthology.orchestra.run.smithi120.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 2.2 MB/s | 245 kB 00:00 2024-09-12T00:27:14.993 INFO:teuthology.orchestra.run.smithi120.stdout:(199/285): python3-jsonpatch-1.21-16.el9.noarch 439 kB/s | 26 kB 00:00 2024-09-12T00:27:15.026 INFO:teuthology.orchestra.run.smithi120.stdout:(200/285): python3-jinja2-2.11.3-6.el9.noarch.r 2.1 MB/s | 248 kB 00:00 2024-09-12T00:27:15.052 INFO:teuthology.orchestra.run.smithi120.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 326 kB/s | 19 kB 00:00 2024-09-12T00:27:15.091 INFO:teuthology.orchestra.run.smithi083.stdout:(196/285): java-11-openjdk-headless-11.0.20.1.1 10 MB/s | 39 MB 00:03 2024-09-12T00:27:15.119 INFO:teuthology.orchestra.run.smithi120.stdout:(202/285): python3-markupsafe-1.1.1-12.el9.x86_ 522 kB/s | 35 kB 00:00 2024-09-12T00:27:15.124 INFO:teuthology.orchestra.run.smithi083.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 1.6 MB/s | 679 kB 00:00 2024-09-12T00:27:15.144 INFO:teuthology.orchestra.run.smithi120.stdout:(203/285): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-12T00:27:15.166 INFO:teuthology.orchestra.run.smithi083.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 3.2 MB/s | 245 kB 00:00 2024-09-12T00:27:15.191 INFO:teuthology.orchestra.run.smithi083.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 3.6 MB/s | 248 kB 00:00 2024-09-12T00:27:15.225 INFO:teuthology.orchestra.run.smithi083.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 439 kB/s | 26 kB 00:00 2024-09-12T00:27:15.250 INFO:teuthology.orchestra.run.smithi083.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 327 kB/s | 19 kB 00:00 2024-09-12T00:27:15.269 INFO:teuthology.orchestra.run.smithi120.stdout:(204/285): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-12T00:27:15.295 INFO:teuthology.orchestra.run.smithi120.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.6 MB/s | 250 kB 00:00 2024-09-12T00:27:15.334 INFO:teuthology.orchestra.run.smithi083.stdout:(202/285): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-09-12T00:27:15.359 INFO:teuthology.orchestra.run.smithi083.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 320 kB/s | 35 kB 00:00 2024-09-12T00:27:15.384 INFO:teuthology.orchestra.run.smithi083.stdout:(204/285): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-12T00:27:15.387 INFO:teuthology.orchestra.run.smithi120.stdout:(206/285): python3-packaging-20.9-5.el9.noarch. 842 kB/s | 77 kB 00:00 2024-09-12T00:27:15.418 INFO:teuthology.orchestra.run.smithi083.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-12T00:27:15.452 INFO:teuthology.orchestra.run.smithi083.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.2 MB/s | 222 kB 00:00 2024-09-12T00:27:15.454 INFO:teuthology.orchestra.run.smithi120.stdout:(207/285): python3-oauthlib-3.1.1-5.el9.noarch. 1.2 MB/s | 222 kB 00:00 2024-09-12T00:27:15.479 INFO:teuthology.orchestra.run.smithi120.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 459 kB/s | 42 kB 00:00 2024-09-12T00:27:15.485 INFO:teuthology.orchestra.run.smithi083.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.1 MB/s | 77 kB 00:00 2024-09-12T00:27:15.511 INFO:teuthology.orchestra.run.smithi083.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 719 kB/s | 42 kB 00:00 2024-09-12T00:27:15.555 INFO:teuthology.orchestra.run.smithi120.stdout:(209/285): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-12T00:27:15.578 INFO:teuthology.orchestra.run.smithi083.stdout:(209/285): python3-numpy-1.20.1-5.el9.x86_64.rp 21 MB/s | 5.1 MB 00:00 2024-09-12T00:27:15.595 INFO:teuthology.orchestra.run.smithi083.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.9 MB/s | 159 kB 00:00 2024-09-12T00:27:15.613 INFO:teuthology.orchestra.run.smithi120.stdout:(210/285): python3-protobuf-3.14.0-13.el9.noarc 1.7 MB/s | 269 kB 00:00 2024-09-12T00:27:15.620 INFO:teuthology.orchestra.run.smithi083.stdout:(211/285): python3-protobuf-3.14.0-13.el9.noarc 2.0 MB/s | 269 kB 00:00 2024-09-12T00:27:15.638 INFO:teuthology.orchestra.run.smithi120.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 998 kB/s | 159 kB 00:00 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi083.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 4.1 MB/s | 279 kB 00:00 2024-09-12T00:27:15.671 INFO:teuthology.orchestra.run.smithi083.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-12T00:27:15.680 INFO:teuthology.orchestra.run.smithi120.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 2.2 MB/s | 279 kB 00:00 2024-09-12T00:27:15.696 INFO:teuthology.orchestra.run.smithi083.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 712 kB/s | 54 kB 00:00 2024-09-12T00:27:15.706 INFO:teuthology.orchestra.run.smithi120.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 553 kB/s | 51 kB 00:00 2024-09-12T00:27:15.729 INFO:teuthology.orchestra.run.smithi083.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-12T00:27:15.731 INFO:teuthology.orchestra.run.smithi120.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 582 kB/s | 54 kB 00:00 2024-09-12T00:27:15.755 INFO:teuthology.orchestra.run.smithi083.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T00:27:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 715 kB/s | 36 kB 00:00 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi120.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-09-12T00:27:15.809 INFO:teuthology.orchestra.run.smithi083.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T00:27:15.830 INFO:teuthology.orchestra.run.smithi083.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-12T00:27:15.848 INFO:teuthology.orchestra.run.smithi120.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-12T00:27:15.873 INFO:teuthology.orchestra.run.smithi120.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 478 kB/s | 36 kB 00:00 2024-09-12T00:27:15.881 INFO:teuthology.orchestra.run.smithi083.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 6.6 MB/s | 510 kB 00:00 2024-09-12T00:27:15.906 INFO:teuthology.orchestra.run.smithi083.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 917 kB/s | 69 kB 00:00 2024-09-12T00:27:15.932 INFO:teuthology.orchestra.run.smithi120.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-12T00:27:15.948 INFO:teuthology.orchestra.run.smithi083.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-12T00:27:15.957 INFO:teuthology.orchestra.run.smithi120.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 671 kB/s | 56 kB 00:00 2024-09-12T00:27:15.973 INFO:teuthology.orchestra.run.smithi083.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 5.6 MB/s | 383 kB 00:00 2024-09-12T00:27:16.015 INFO:teuthology.orchestra.run.smithi083.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.2 MB/s | 152 kB 00:00 2024-09-12T00:27:16.033 INFO:teuthology.orchestra.run.smithi120.stdout:(220/285): slf4j-1.7.30-13.el9.noarch.rpm 919 kB/s | 69 kB 00:00 2024-09-12T00:27:16.076 INFO:teuthology.orchestra.run.smithi120.stdout:(221/285): sisu-0.3.4-10.el9.noarch.rpm 3.5 MB/s | 510 kB 00:00 2024-09-12T00:27:16.182 INFO:teuthology.orchestra.run.smithi083.stdout:(225/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-12T00:27:16.217 INFO:teuthology.orchestra.run.smithi083.stdout:(226/285): tracker-3.1.2-3.el9.x86_64.rpm 2.2 MB/s | 555 kB 00:00 2024-09-12T00:27:16.234 INFO:teuthology.orchestra.run.smithi120.stdout:(222/285): sound-theme-freedesktop-0.8-17.el9.n 2.4 MB/s | 383 kB 00:00 2024-09-12T00:27:16.241 INFO:teuthology.orchestra.run.smithi083.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 911 kB/s | 53 kB 00:00 2024-09-12T00:27:16.275 INFO:teuthology.orchestra.run.smithi083.stdout:(228/285): tracker-miners-3.1.2-4.el9.x86_64.rp 3.6 MB/s | 944 kB 00:00 2024-09-12T00:27:16.300 INFO:teuthology.orchestra.run.smithi083.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-12T00:27:16.317 INFO:teuthology.orchestra.run.smithi120.stdout:(223/285): socat-1.7.4.1-6.el9.x86_64.rpm 1.0 MB/s | 304 kB 00:00 2024-09-12T00:27:16.325 INFO:teuthology.orchestra.run.smithi083.stdout:(230/285): tzdata-java-2024a-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T00:27:16.343 INFO:teuthology.orchestra.run.smithi120.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 1.4 MB/s | 152 kB 00:00 2024-09-12T00:27:16.350 INFO:teuthology.orchestra.run.smithi083.stdout:(231/285): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 306 kB 00:00 2024-09-12T00:27:16.376 INFO:teuthology.orchestra.run.smithi083.stdout:(232/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-12T00:27:16.401 INFO:teuthology.orchestra.run.smithi083.stdout:(233/285): wireplumber-libs-0.4.14-1.el9.x86_64 4.6 MB/s | 358 kB 00:00 2024-09-12T00:27:16.426 INFO:teuthology.orchestra.run.smithi083.stdout:(234/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 562 kB/s | 42 kB 00:00 2024-09-12T00:27:16.452 INFO:teuthology.orchestra.run.smithi083.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 5.0 MB/s | 385 kB 00:00 2024-09-12T00:27:16.459 INFO:teuthology.orchestra.run.smithi120.stdout:(225/285): tracker-miners-3.1.2-4.el9.x86_64.rp 7.9 MB/s | 944 kB 00:00 2024-09-12T00:27:16.477 INFO:teuthology.orchestra.run.smithi083.stdout:(236/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 134 kB 00:00 2024-09-12T00:27:16.485 INFO:teuthology.orchestra.run.smithi120.stdout:(226/285): tracker-3.1.2-3.el9.x86_64.rpm 3.2 MB/s | 555 kB 00:00 2024-09-12T00:27:16.528 INFO:teuthology.orchestra.run.smithi083.stdout:(237/285): xkeyboard-config-2.33-2.el9.noarch.r 8.3 MB/s | 859 kB 00:00 2024-09-12T00:27:16.553 INFO:teuthology.orchestra.run.smithi083.stdout:(238/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 632 kB/s | 64 kB 00:00 2024-09-12T00:27:16.586 INFO:teuthology.orchestra.run.smithi083.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.5 MB/s | 505 kB 00:00 2024-09-12T00:27:16.652 INFO:teuthology.orchestra.run.smithi120.stdout:(227/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-12T00:27:16.653 INFO:teuthology.orchestra.run.smithi083.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-12T00:27:16.669 INFO:teuthology.orchestra.run.smithi120.stdout:(228/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 254 kB/s | 53 kB 00:00 2024-09-12T00:27:16.687 INFO:teuthology.orchestra.run.smithi083.stdout:(241/285): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T00:27:16.712 INFO:teuthology.orchestra.run.smithi083.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-12T00:27:16.744 INFO:teuthology.orchestra.run.smithi120.stdout:(229/285): tzdata-java-2024a-2.el9.noarch.rpm 887 kB/s | 230 kB 00:00 2024-09-12T00:27:16.770 INFO:teuthology.orchestra.run.smithi120.stdout:(230/285): upower-0.99.11-11.el9.x86_64.rpm 1.4 MB/s | 173 kB 00:00 2024-09-12T00:27:16.795 INFO:teuthology.orchestra.run.smithi120.stdout:(231/285): webrtc-audio-processing-0.3.1-8.el9. 2.4 MB/s | 306 kB 00:00 2024-09-12T00:27:16.837 INFO:teuthology.orchestra.run.smithi120.stdout:(232/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-09-12T00:27:16.838 INFO:teuthology.orchestra.run.smithi083.stdout:(243/285): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-12T00:27:16.863 INFO:teuthology.orchestra.run.smithi120.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 632 kB/s | 42 kB 00:00 2024-09-12T00:27:16.879 INFO:teuthology.orchestra.run.smithi083.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 947 kB/s | 26 kB 00:00 2024-09-12T00:27:16.905 INFO:teuthology.orchestra.run.smithi083.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T00:27:16.913 INFO:teuthology.orchestra.run.smithi120.stdout:(234/285): wireplumber-libs-0.4.14-1.el9.x86_64 2.4 MB/s | 358 kB 00:00 2024-09-12T00:27:16.930 INFO:teuthology.orchestra.run.smithi083.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T00:27:16.955 INFO:teuthology.orchestra.run.smithi083.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T00:27:16.980 INFO:teuthology.orchestra.run.smithi120.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.1 MB/s | 134 kB 00:00 2024-09-12T00:27:16.989 INFO:teuthology.orchestra.run.smithi083.stdout:(248/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-12T00:27:17.022 INFO:teuthology.orchestra.run.smithi083.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T00:27:17.039 INFO:teuthology.orchestra.run.smithi083.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T00:27:17.056 INFO:teuthology.orchestra.run.smithi083.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-12T00:27:17.073 INFO:teuthology.orchestra.run.smithi083.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 846 kB/s | 14 kB 00:00 2024-09-12T00:27:17.098 INFO:teuthology.orchestra.run.smithi083.stdout:(253/285): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-12T00:27:17.132 INFO:teuthology.orchestra.run.smithi083.stdout:(254/285): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-12T00:27:17.155 INFO:teuthology.orchestra.run.smithi120.stdout:(236/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 1.2 MB/s | 385 kB 00:00 2024-09-12T00:27:17.157 INFO:teuthology.orchestra.run.smithi083.stdout:(255/285): python3-google-auth-2.34.0-1.el9.noa 8.7 MB/s | 220 kB 00:00 2024-09-12T00:27:17.197 INFO:teuthology.orchestra.run.smithi120.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 293 kB/s | 64 kB 00:00 2024-09-12T00:27:17.216 INFO:teuthology.orchestra.run.smithi083.stdout:(256/285): python3-grpcio-1.46.7-10.el9.x86_64. 35 MB/s | 2.0 MB 00:00 2024-09-12T00:27:17.241 INFO:teuthology.orchestra.run.smithi083.stdout:(257/285): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-09-12T00:27:17.247 INFO:teuthology.orchestra.run.smithi120.stdout:(238/285): lua-devel-5.4.4-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2024-09-12T00:27:17.266 INFO:teuthology.orchestra.run.smithi083.stdout:(258/285): python3-grpcio-tools-1.46.7-10.el9.x 2.9 MB/s | 144 kB 00:00 2024-09-12T00:27:17.281 INFO:teuthology.orchestra.run.smithi120.stdout:(239/285): xkeyboard-config-2.33-2.el9.noarch.r 2.3 MB/s | 859 kB 00:00 2024-09-12T00:27:17.300 INFO:teuthology.orchestra.run.smithi083.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 681 kB/s | 18 kB 00:00 2024-09-12T00:27:17.315 INFO:teuthology.orchestra.run.smithi120.stdout:(240/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 3.1 MB/s | 505 kB 00:00 2024-09-12T00:27:17.325 INFO:teuthology.orchestra.run.smithi083.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 1.0 MB/s | 23 kB 00:00 2024-09-12T00:27:17.351 INFO:teuthology.orchestra.run.smithi083.stdout:(261/285): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-09-12T00:27:17.376 INFO:teuthology.orchestra.run.smithi083.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T00:27:17.390 INFO:teuthology.orchestra.run.smithi120.stdout:(241/285): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-09-12T00:27:17.401 INFO:teuthology.orchestra.run.smithi083.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T00:27:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:(242/285): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-09-12T00:27:17.435 INFO:teuthology.orchestra.run.smithi083.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-12T00:27:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:(243/285): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-12T00:27:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T00:27:17.468 INFO:teuthology.orchestra.run.smithi083.stdout:(265/285): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-09-12T00:27:17.494 INFO:teuthology.orchestra.run.smithi083.stdout:(266/285): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-12T00:27:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:(245/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.2 MB/s | 863 kB 00:00 2024-09-12T00:27:17.519 INFO:teuthology.orchestra.run.smithi083.stdout:(267/285): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T00:27:17.541 INFO:teuthology.orchestra.run.smithi120.stdout:(246/285): liboath-2.6.7-2.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2024-09-12T00:27:17.544 INFO:teuthology.orchestra.run.smithi083.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-12T00:27:17.570 INFO:teuthology.orchestra.run.smithi083.stdout:(269/285): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-12T00:27:17.575 INFO:teuthology.orchestra.run.smithi120.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-12T00:27:17.595 INFO:teuthology.orchestra.run.smithi083.stdout:(270/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T00:27:17.600 INFO:teuthology.orchestra.run.smithi120.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-12T00:27:17.620 INFO:teuthology.orchestra.run.smithi083.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-12T00:27:17.652 INFO:teuthology.orchestra.run.smithi120.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-12T00:27:17.654 INFO:teuthology.orchestra.run.smithi083.stdout:(272/285): protobuf-compiler-3.14.0-13.el9.x86_ 784 kB/s | 863 kB 00:01 2024-09-12T00:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T00:27:17.679 INFO:teuthology.orchestra.run.smithi083.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-12T00:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout:(251/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-12T00:27:17.713 INFO:teuthology.orchestra.run.smithi083.stdout:(274/285): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-12T00:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout:(252/285): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-12T00:27:17.738 INFO:teuthology.orchestra.run.smithi083.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi120.stdout:(253/285): python3-certifi-2023.05.07-4.el9.noa 336 kB/s | 14 kB 00:00 2024-09-12T00:27:17.763 INFO:teuthology.orchestra.run.smithi083.stdout:(276/285): python3-tempora-5.0.0-2.el9.noarch.r 327 kB/s | 36 kB 00:00 2024-09-12T00:27:17.785 INFO:teuthology.orchestra.run.smithi120.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T00:27:17.789 INFO:teuthology.orchestra.run.smithi083.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T00:27:17.814 INFO:teuthology.orchestra.run.smithi083.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2024-09-12T00:27:17.839 INFO:teuthology.orchestra.run.smithi083.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-12T00:27:17.853 INFO:teuthology.orchestra.run.smithi120.stdout:(255/285): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-12T00:27:17.865 INFO:teuthology.orchestra.run.smithi083.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T00:27:17.878 INFO:teuthology.orchestra.run.smithi120.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 2.3 MB/s | 220 kB 00:00 2024-09-12T00:27:17.890 INFO:teuthology.orchestra.run.smithi083.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:27:17.912 INFO:teuthology.orchestra.run.smithi120.stdout:(257/285): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-09-12T00:27:17.915 INFO:teuthology.orchestra.run.smithi083.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-12T00:27:17.937 INFO:teuthology.orchestra.run.smithi120.stdout:(258/285): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-12T00:27:17.957 INFO:teuthology.orchestra.run.smithi083.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T00:27:17.962 INFO:teuthology.orchestra.run.smithi120.stdout:(259/285): python3-jaraco-8.2.1-3.el9.noarch.rp 211 kB/s | 11 kB 00:00 2024-09-12T00:27:17.988 INFO:teuthology.orchestra.run.smithi120.stdout:(260/285): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-12T00:27:18.013 INFO:teuthology.orchestra.run.smithi120.stdout:(261/285): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-12T00:27:18.038 INFO:teuthology.orchestra.run.smithi120.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T00:27:18.064 INFO:teuthology.orchestra.run.smithi120.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-12T00:27:18.089 INFO:teuthology.orchestra.run.smithi120.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:27:18.114 INFO:teuthology.orchestra.run.smithi120.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T00:27:18.139 INFO:teuthology.orchestra.run.smithi120.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T00:27:18.173 INFO:teuthology.orchestra.run.smithi120.stdout:(267/285): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-12T00:27:18.174 INFO:teuthology.orchestra.run.smithi083.stdout:(284/285): librados2-19.3.0-4753.gd011c522.el9. 12 MB/s | 3.5 MB 00:00 2024-09-12T00:27:18.198 INFO:teuthology.orchestra.run.smithi120.stdout:(268/285): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-12T00:27:18.224 INFO:teuthology.orchestra.run.smithi120.stdout:(269/285): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-12T00:27:18.224 INFO:teuthology.orchestra.run.smithi083.stdout:(285/285): librbd1-19.3.0-4753.gd011c522.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-12T00:27:18.231 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:27:18.231 INFO:teuthology.orchestra.run.smithi083.stdout:Total 18 MB/s | 327 MB 00:17 2024-09-12T00:27:18.249 INFO:teuthology.orchestra.run.smithi120.stdout:(270/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T00:27:18.274 INFO:teuthology.orchestra.run.smithi120.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-12T00:27:18.300 INFO:teuthology.orchestra.run.smithi120.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T00:27:18.325 INFO:teuthology.orchestra.run.smithi120.stdout:(273/285): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T00:27:18.350 INFO:teuthology.orchestra.run.smithi120.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T00:27:18.376 INFO:teuthology.orchestra.run.smithi120.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T00:27:18.418 INFO:teuthology.orchestra.run.smithi120.stdout:(276/285): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-12T00:27:18.443 INFO:teuthology.orchestra.run.smithi120.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-12T00:27:18.468 INFO:teuthology.orchestra.run.smithi120.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-12T00:27:18.494 INFO:teuthology.orchestra.run.smithi120.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-12T00:27:18.519 INFO:teuthology.orchestra.run.smithi120.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T00:27:18.544 INFO:teuthology.orchestra.run.smithi120.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:27:18.569 INFO:teuthology.orchestra.run.smithi120.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-12T00:27:18.620 INFO:teuthology.orchestra.run.smithi120.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T00:27:18.837 INFO:teuthology.orchestra.run.smithi120.stdout:(284/285): librados2-19.3.0-4753.gd011c522.el9. 12 MB/s | 3.5 MB 00:00 2024-09-12T00:27:18.887 INFO:teuthology.orchestra.run.smithi120.stdout:(285/285): librbd1-19.3.0-4753.gd011c522.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-12T00:27:18.893 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:27:18.893 INFO:teuthology.orchestra.run.smithi120.stdout:Total 17 MB/s | 327 MB 00:19 2024-09-12T00:27:21.425 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-12T00:27:21.611 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-12T00:27:21.612 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-12T00:27:21.959 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-12T00:27:22.145 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-12T00:27:22.145 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-12T00:27:24.969 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-12T00:27:24.970 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-12T00:27:25.417 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-12T00:27:25.417 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-12T00:27:35.159 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:27:35.316 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:27:35.470 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-12T00:27:35.545 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:27:35.570 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:27:35.642 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:27:35.683 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:27:35.738 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:27:35.752 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:27:35.772 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:27:35.797 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:27:35.854 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:27:35.909 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:27:36.064 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-12T00:27:36.130 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:27:36.166 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:27:36.191 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:27:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:27:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:27:36.298 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:27:36.334 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:27:36.368 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:27:36.394 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:27:36.445 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:27:36.447 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:27:36.474 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:27:36.572 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:27:36.604 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:27:36.645 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:27:36.680 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:27:36.705 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:27:36.731 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:27:36.763 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:27:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:27:36.797 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:27:36.825 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:27:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:27:36.959 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:27:37.018 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:27:37.046 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:27:37.093 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:27:37.132 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:27:37.167 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:27:37.196 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:27:37.260 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:27:37.286 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:27:37.291 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:27:37.314 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:27:37.320 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:27:37.360 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:27:37.376 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:27:37.385 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:27:37.401 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:27:37.414 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:27:37.423 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:27:37.442 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:27:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:27:37.593 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:27:37.632 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:27:37.711 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:27:37.744 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:27:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:27:37.774 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:27:37.786 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:27:37.810 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:27:37.814 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:27:37.883 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:27:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:27:37.928 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:27:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:27:37.968 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:27:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:27:38.011 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:27:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:27:38.045 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:27:38.051 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:27:38.072 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:27:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:27:38.097 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:27:38.122 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:27:38.142 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:27:38.174 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:27:38.199 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:27:38.243 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:27:38.263 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:27:38.281 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:27:38.293 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:27:38.346 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:27:38.398 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:27:38.408 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:27:38.429 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:27:38.441 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:27:38.476 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:27:38.478 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:27:38.512 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:27:38.550 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:27:38.558 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:27:38.611 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:27:38.627 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:27:38.651 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:27:38.668 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:27:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:27:38.712 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:27:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:27:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:27:38.753 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:27:38.780 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:27:38.805 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:27:38.829 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:27:38.834 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:27:38.866 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:27:38.891 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:27:38.945 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:27:38.967 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:27:38.972 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:27:39.016 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:27:39.042 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:27:39.100 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:27:39.138 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:27:39.189 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:27:39.231 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:27:39.265 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:27:39.345 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:27:39.383 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:27:39.427 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:27:39.477 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:27:39.563 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:27:39.573 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:27:39.665 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:27:39.701 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:27:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:27:39.771 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:27:39.774 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:27:39.806 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:27:39.843 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:27:39.872 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:27:39.943 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:27:39.983 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:27:40.016 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:27:40.052 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:27:40.090 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:27:40.122 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:27:40.154 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:27:40.196 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:27:40.254 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:27:40.290 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:27:40.320 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:27:40.326 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:27:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:27:40.417 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:27:40.448 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:27:40.490 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:27:40.518 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:27:40.562 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:27:40.566 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:27:40.605 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:27:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:27:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:27:40.641 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:27:40.688 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:27:40.708 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:27:40.733 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:27:40.744 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:27:40.772 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:27:40.775 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:27:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:27:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:27:40.887 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:27:40.913 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:27:40.918 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:27:40.960 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:27:40.970 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:27:41.002 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:27:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:27:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:27:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:27:41.105 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:27:41.145 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:27:41.186 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:27:41.192 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:27:41.218 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:27:41.243 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:27:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:27:41.326 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:27:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:27:41.385 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:27:41.420 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:27:41.454 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:27:41.469 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:27:41.494 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:27:41.513 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:27:41.555 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:27:41.736 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:27:41.736 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:27:41.741 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:27:41.755 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:27:41.782 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:27:41.786 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:27:41.816 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:27:41.857 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:27:41.886 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:27:41.886 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:27:41.901 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:27:41.901 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:27:41.901 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:27:41.925 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:27:41.965 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:27:41.998 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:27:42.039 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:27:42.082 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:27:42.158 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:27:42.209 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:27:42.234 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:27:42.259 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:27:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:27:42.286 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:27:42.306 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:27:42.529 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:27:42.577 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:27:42.608 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:27:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:27:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:27:42.718 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:27:42.725 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:27:42.739 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:27:42.740 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:27:42.740 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:27:42.748 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:27:42.763 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:27:42.763 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:27:42.764 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:27:42.804 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:27:42.839 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:27:42.872 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:27:42.914 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:27:42.921 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:27:42.948 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:27:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:27:43.036 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:27:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:27:43.087 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:27:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:27:43.118 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:27:43.129 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:27:43.159 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:27:43.222 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:27:43.270 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:27:44.021 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:27:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:27:44.066 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:27:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:27:44.100 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:27:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:27:44.102 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:27:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:27:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:27:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:27:44.201 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:27:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:27:44.235 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:27:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:27:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:27:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:27:44.416 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:27:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:27:44.457 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:27:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:27:44.513 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:27:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:27:44.644 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:27:45.019 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:27:45.074 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:27:45.119 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:27:45.153 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:27:45.187 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:27:45.369 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:27:45.383 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:27:45.393 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:27:45.432 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:27:45.466 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:27:45.470 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:27:45.566 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:27:45.610 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:27:45.798 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:27:45.839 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:27:45.891 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:27:46.146 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:27:46.258 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:27:46.395 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:27:46.467 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:27:46.502 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:27:46.536 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:27:46.569 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:27:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:27:47.517 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:27:47.540 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:27:47.604 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:27:47.661 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:27:47.666 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:27:47.698 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:27:47.725 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:27:47.755 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:27:47.766 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:27:47.766 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:27:47.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:27:47.986 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:27:48.143 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:27:48.221 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:27:48.548 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:27:48.592 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:27:48.691 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:27:48.732 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:27:48.764 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:27:48.793 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:27:48.850 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:27:48.885 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:27:48.910 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:27:48.956 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:27:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:27:48.983 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:27:49.039 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:27:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:27:49.124 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:27:49.160 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:27:49.189 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:27:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:27:49.202 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:27:49.202 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:27:49.254 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:27:49.283 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:27:49.294 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:27:49.318 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:27:49.322 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:27:49.347 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:27:49.372 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:27:49.400 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:27:49.423 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:27:49.448 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:27:49.476 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:27:49.512 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:27:49.558 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:27:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:27:49.656 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:27:49.661 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:27:49.688 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:27:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:27:49.810 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:27:49.842 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:27:49.874 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:27:49.904 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:27:49.968 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:27:50.003 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:27:50.029 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:27:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:27:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:27:50.142 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:27:50.280 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:27:50.346 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:27:50.371 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:27:50.403 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:27:50.408 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:27:50.445 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:27:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:27:50.481 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:27:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:27:50.523 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:27:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:27:50.547 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:27:50.550 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:27:50.567 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:27:50.575 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:27:50.594 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:27:50.612 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:27:50.619 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:27:50.656 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:27:50.665 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:27:50.698 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:27:50.716 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:27:50.732 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:27:50.780 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:27:50.807 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:27:51.269 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:27:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:27:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:27:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:27:51.520 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:27:51.603 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:27:51.749 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:27:51.789 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:27:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:28:02.460 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:28:02.502 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:28:02.530 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:28:02.574 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:28:02.604 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:28:02.640 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:28:03.142 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:28:03.170 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:28:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:28:03.272 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:28:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:28:03.601 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:28:03.629 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:28:03.675 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:28:03.704 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:28:03.740 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:28:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:28:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:28:05.617 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:28:05.655 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:28:06.224 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:28:06.276 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:28:06.349 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:28:06.349 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:28:06.349 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:28:06.349 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:06.385 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:28:06.784 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:28:06.822 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:28:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:28:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:28:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:28:07.535 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:28:07.535 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:28:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:07.586 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:28:15.729 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:28:15.729 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2024-09-12T00:28:15.729 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2024-09-12T00:28:15.729 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2024-09-12T00:28:15.729 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2024-09-12T00:28:15.729 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2024-09-12T00:28:15.729 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /root 2024-09-12T00:28:15.729 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2024-09-12T00:28:15.729 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:15.901 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:28:15.916 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:28:15.917 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:15.917 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:28:15.917 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:17.009 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:28:17.009 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-09-12T00:28:17.009 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-09-12T00:28:17.009 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-09-12T00:28:17.010 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-09-12T00:28:17.010 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-09-12T00:28:17.010 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-09-12T00:28:17.010 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-09-12T00:28:17.010 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:17.195 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:28:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:28:17.211 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:17.211 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:28:17.211 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:17.368 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:28:17.396 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:28:17.396 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:17.396 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:28:17.396 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:28:17.396 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:28:17.396 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:17.619 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:28:17.642 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:28:17.643 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:17.643 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:28:17.643 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:28:17.643 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:28:17.643 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:18.086 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:18.212 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:28:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:28:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:28:18.698 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:18.699 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:28:18.699 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:28:18.699 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:28:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:18.922 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:28:18.945 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:28:18.945 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:18.945 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:28:18.945 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:28:18.946 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:28:18.946 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:19.516 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:28:21.057 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:28:21.171 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:28:21.228 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:28:21.284 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:28:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:28:21.524 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:28:21.602 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:28:21.690 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:28:21.821 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:28:21.866 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:28:21.909 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:28:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:28:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:28:22.581 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:28:22.768 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:28:22.775 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:28:22.821 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:28:22.823 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:28:22.925 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:28:23.154 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:28:23.173 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:28:23.200 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:28:23.213 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:28:23.244 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:28:23.247 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:28:23.280 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:28:23.314 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:28:23.352 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:28:23.379 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:28:23.405 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:28:23.431 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:28:23.455 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:28:23.481 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:28:23.532 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:28:23.559 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:28:23.589 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:28:23.617 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:28:23.652 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:28:23.688 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:28:23.719 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:28:23.753 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:28:23.788 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:28:23.816 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:28:23.855 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:28:23.897 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:28:23.941 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:28:23.973 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:28:23.996 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:28:24.048 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:28:24.081 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:28:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:28:24.111 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:28:24.140 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:28:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:28:24.174 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:28:24.343 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:28:24.375 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:28:24.402 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:28:24.431 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:28:24.463 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:28:24.532 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:28:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:28:24.581 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:28:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:28:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:28:24.645 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:28:24.661 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:28:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:28:24.713 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:28:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:28:24.743 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:28:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:28:24.794 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:28:24.818 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:28:24.844 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:28:24.861 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:28:24.870 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:28:24.898 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:28:24.898 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:28:24.920 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:28:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:28:24.951 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:28:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:28:24.974 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:28:24.981 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:28:25.017 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:28:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:28:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:28:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:28:25.162 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:28:25.200 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:28:25.243 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:28:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:28:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:28:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:28:25.396 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:28:25.423 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:28:25.435 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:28:25.453 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:28:25.465 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:28:25.469 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:28:25.470 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:28:25.470 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:25.495 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:28:25.520 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:28:25.688 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:28:25.704 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:28:25.721 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:28:25.748 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:28:25.773 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:28:25.774 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:28:25.808 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:28:25.812 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:28:25.849 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:28:25.874 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:28:25.945 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:28:26.005 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:28:26.074 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:28:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:28:26.239 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:28:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:28:26.279 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:28:26.294 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:28:26.300 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:28:26.315 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:28:26.345 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:28:26.368 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:28:26.795 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:28:26.815 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:28:26.855 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:28:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:28:26.871 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:28:26.871 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:26.873 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:28:26.916 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:28:26.945 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:28:27.105 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:28:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:28:27.192 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:28:27.220 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:28:27.241 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:28:27.272 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:28:27.292 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:28:27.335 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:28:27.373 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:28:27.384 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:28:27.407 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:28:27.427 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:28:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:28:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:28:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:28:27.901 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:28:27.930 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:28:27.964 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:28:28.030 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:28:28.055 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:28:28.304 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:28:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:28:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:28:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:28:28.638 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:28:28.693 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:28:28.719 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:28:28.741 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:28:28.778 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:28:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:28:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:28:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:28:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:28:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:28:28.982 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:28:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:28:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:28:29.487 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:28:29.554 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:28:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:28:31.230 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:28:31.294 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:28:32.252 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:28:32.286 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:28:32.402 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:28:32.565 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:28:32.605 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:28:32.628 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:28:32.629 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:32.629 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:28:32.629 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:28:32.629 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:28:32.629 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:32.680 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:28:32.692 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:28:32.715 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:28:32.745 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:28:32.793 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:28:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:28:32.825 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:28:32.841 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:28:32.841 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:28:32.841 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:32.851 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:28:33.800 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:28:33.818 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:28:33.824 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:28:33.824 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:33.824 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:28:33.824 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:28:33.824 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:28:33.824 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:33.851 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:28:33.867 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:28:33.890 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:28:33.890 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:33.890 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:28:33.890 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:33.966 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:28:34.130 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:28:34.154 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:28:34.176 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:28:34.177 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:34.177 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:28:34.177 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:28:34.177 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:28:34.177 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:34.201 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:28:34.225 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:28:34.225 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:34.225 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:28:34.225 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:28:34.225 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:28:34.225 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:34.229 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:28:34.240 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:28:34.264 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:28:34.293 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:28:34.350 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:28:34.389 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:28:34.405 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:28:34.406 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:28:34.406 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:28:35.389 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:28:35.389 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:35.389 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:28:35.389 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:28:35.389 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:28:35.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:35.432 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:28:35.455 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:28:35.455 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:35.455 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:28:35.455 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:35.766 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:28:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:28:35.790 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:28:35.790 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:28:35.790 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:28:35.790 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:28:35.790 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:38.880 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:28:38.921 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:28:38.953 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:28:39.057 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:28:39.112 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:28:39.144 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:28:39.144 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:28:39.237 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:28:39.328 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:28:39.344 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:28:39.350 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:28:39.359 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:28:39.369 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:28:39.370 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:28:39.370 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:28:39.370 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:39.420 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:28:39.488 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:28:40.495 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:28:40.536 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:28:40.576 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:28:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:28:40.744 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:28:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:28:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:28:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:28:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:28:40.959 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:28:40.975 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:28:40.981 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:28:40.990 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:28:41.001 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:28:41.001 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:28:41.001 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:28:41.001 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:28:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:28:49.569 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:28:49.569 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:28:49.570 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:28:49.571 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:28:49.572 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:28:49.572 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:28:49.572 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:28:49.572 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:28:49.600 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:28:49.601 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:28:49.603 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:28:49.604 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:28:49.605 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:28:49.606 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:28:49.607 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:28:49.608 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:28:49.609 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:28:49.610 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:28:49.611 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:28:49.612 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:28:49.613 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:28:49.614 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:28:49.616 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:28:49.617 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:28:49.617 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:28:49.617 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:28:49.617 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:28:49.617 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:28:49.617 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:28:49.617 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:28:49.617 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:28:49.617 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:28:49.618 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:28:49.619 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:28:49.620 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:28:49.621 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:28:49.621 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:28:49.621 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:28:51.587 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:28:51.587 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:28:51.587 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:28:51.587 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:28:51.587 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:28:51.587 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:28:51.588 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:28:51.589 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:28:51.589 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:28:51.589 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:28:51.589 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:28:51.589 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:28:51.589 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:28:51.589 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:28:51.589 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:28:51.589 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:28:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:28:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:28:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:28:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:28:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:28:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:28:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:28:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:28:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:28:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:28:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:28:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:28:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:28:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:28:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:28:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:28:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:28:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:28:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:28:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:28:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:28:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:28:52.922 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:28:52.922 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:52.922 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2024-09-12T00:28:52.922 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.922 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.922 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-09-12T00:28:52.922 INFO:teuthology.orchestra.run.smithi083.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:28:52.923 INFO:teuthology.orchestra.run.smithi083.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.924 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:52.925 INFO:teuthology.orchestra.run.smithi083.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:28:52.926 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:28:52.927 INFO:teuthology.orchestra.run.smithi083.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:28:52.928 INFO:teuthology.orchestra.run.smithi083.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:28:52.929 INFO:teuthology.orchestra.run.smithi083.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:28:52.930 INFO:teuthology.orchestra.run.smithi083.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:28:52.931 INFO:teuthology.orchestra.run.smithi083.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:28:52.932 INFO:teuthology.orchestra.run.smithi083.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:28:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:28:52.934 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:28:52.935 INFO:teuthology.orchestra.run.smithi083.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:28:52.936 INFO:teuthology.orchestra.run.smithi083.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:28:52.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:28:52.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.940 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:28:52.941 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:28:52.942 INFO:teuthology.orchestra.run.smithi083.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:28:52.943 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:28:52.944 INFO:teuthology.orchestra.run.smithi083.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:28:52.944 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:52.944 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-12T00:28:53.337 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:28:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:28:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:28:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:28:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:28:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:28:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:28:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:28:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:28:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:28:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:28:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:28:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:28:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:28:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:28:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:28:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:28:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:28:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:28:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:28:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:28:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:28:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:28:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:28:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:28:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:28:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:28:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:28:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:28:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:28:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:28:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:28:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:28:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:28:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:28:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:28:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:28:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:28:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:28:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:28:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:55.094 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-12T00:28:55.524 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:55.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:28:55.688 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:28:55.752 INFO:teuthology.orchestra.run.smithi083.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:28:55.753 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:28:55.753 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:28:55.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:28:55.915 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:28:55.980 INFO:teuthology.orchestra.run.smithi120.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:28:55.981 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:28:55.981 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:28:55.983 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:28:55.983 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:55.983 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:28:56.031 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:28:56.031 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:28:56.073 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:28:56.073 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:56.073 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:28:56.118 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:28:56.200 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:28:56.200 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:28:56.240 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:28:56.322 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:28:56.322 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:56.322 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:28:56.365 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:28:56.447 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:28:56.447 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:28:56.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:28:56.565 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:28:56.565 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:56.565 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:28:56.607 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:28:56.687 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:28:56.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:28:56.726 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:28:56.805 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:28:56.885 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:28:56.886 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2024-09-12T00:28:56.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-09-12T00:28:56.928 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:28:56.929 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:28:56.970 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:28:57.008 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:28:57.008 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:28:57.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:28:57.098 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:28:57.099 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:28:57.099 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7901869', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNT0PMGu3t+dhzpL6cgRhF+o+uih/rz4rwRqj4bJWfZCHRHdtrAPCWE+YUO67el5kEED14HpD7ForppLMH6laQ=', 'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPwOQjrqcfjEGllmoriuwtmy/ZdR86ditD/wYZNGDsibzYIsVJr/LAWCEXO63cM1FWDVefig3ma+g/rKqlkN1nc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:28:57.099 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:28:57.128 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:28:57.156 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:28:57.197 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:28:57.236 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:57.236 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:28:57.302 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:28:57.302 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2024-09-12T00:28:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:28:57.371 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:28:57.371 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T00:28:57.371 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:28:57.371 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:28:57.372 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-12 00:28:40.497166548 +0000 2024-09-12T00:28:57.372 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-12 00:26:19.015744833 +0000 2024-09-12T00:28:57.372 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-12 00:26:19.015744833 +0000 2024-09-12T00:28:57.372 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-12 00:26:19.015744833 +0000 2024-09-12T00:28:57.372 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:28:57.449 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-12T00:28:57.449 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-12T00:28:57.449 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000204692 s, 2.5 MB/s 2024-09-12T00:28:57.450 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:28:57.520 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2024-09-12T00:28:57.589 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:28:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:28:57.590 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T00:28:57.590 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:28:57.590 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:28:57.590 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-12 00:28:40.497166548 +0000 2024-09-12T00:28:57.590 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-12 00:26:19.327737233 +0000 2024-09-12T00:28:57.590 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-12 00:26:19.327737233 +0000 2024-09-12T00:28:57.590 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-12 00:26:19.327737233 +0000 2024-09-12T00:28:57.590 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:28:57.666 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-12T00:28:57.666 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-12T00:28:57.667 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000191864 s, 2.7 MB/s 2024-09-12T00:28:57.668 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:28:57.737 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2024-09-12T00:28:57.806 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:28:57.807 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:28:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T00:28:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:28:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:28:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-12 00:28:40.498166524 +0000 2024-09-12T00:28:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-12 00:26:19.659729146 +0000 2024-09-12T00:28:57.807 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-12 00:26:19.659729146 +0000 2024-09-12T00:28:57.807 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-12 00:26:19.659729146 +0000 2024-09-12T00:28:57.807 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:28:57.883 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-12T00:28:57.883 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-12T00:28:57.883 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000186056 s, 2.8 MB/s 2024-09-12T00:28:57.884 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:28:57.954 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2024-09-12T00:28:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:28:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:28:58.024 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T00:28:58.024 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:28:58.024 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:28:58.024 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-12 00:28:40.498166524 +0000 2024-09-12T00:28:58.024 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-12 00:26:19.990721083 +0000 2024-09-12T00:28:58.024 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-12 00:26:19.990721083 +0000 2024-09-12T00:28:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-12 00:26:19.990721083 +0000 2024-09-12T00:28:58.025 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:28:58.101 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-12T00:28:58.101 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-12T00:28:58.101 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000196275 s, 2.6 MB/s 2024-09-12T00:28:58.102 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:28:58.173 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:28:58.173 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:28:58.173 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:28:58.209 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:28:58.209 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-09-12T00:28:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:28:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:28:58.282 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T00:28:58.282 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:28:58.282 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:28:58.282 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-12 00:28:42.207478840 +0000 2024-09-12T00:28:58.282 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-12 00:26:19.030456096 +0000 2024-09-12T00:28:58.282 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-12 00:26:19.030456096 +0000 2024-09-12T00:28:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-12 00:26:19.030456096 +0000 2024-09-12T00:28:58.282 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:28:58.363 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-12T00:28:58.363 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-12T00:28:58.364 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000275451 s, 1.9 MB/s 2024-09-12T00:28:58.365 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:28:58.437 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-09-12T00:28:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:28:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:28:58.508 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T00:28:58.508 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:28:58.508 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:28:58.508 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-12 00:28:42.207478840 +0000 2024-09-12T00:28:58.508 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-12 00:26:19.366448137 +0000 2024-09-12T00:28:58.508 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-12 00:26:19.366448137 +0000 2024-09-12T00:28:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-12 00:26:19.366448137 +0000 2024-09-12T00:28:58.508 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:28:58.585 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-12T00:28:58.585 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-12T00:28:58.586 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000209476 s, 2.4 MB/s 2024-09-12T00:28:58.587 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:28:58.657 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-09-12T00:28:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:28:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:28:58.727 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T00:28:58.727 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:28:58.727 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:28:58.727 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-12 00:28:42.207478840 +0000 2024-09-12T00:28:58.727 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-12 00:26:19.686440558 +0000 2024-09-12T00:28:58.727 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-12 00:26:19.686440558 +0000 2024-09-12T00:28:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-12 00:26:19.686440558 +0000 2024-09-12T00:28:58.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:28:58.805 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-12T00:28:58.805 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-12T00:28:58.805 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000251307 s, 2.0 MB/s 2024-09-12T00:28:58.807 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:28:58.877 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-09-12T00:28:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:28:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:28:58.946 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T00:28:58.946 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:28:58.946 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:28:58.946 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-12 00:28:42.208478817 +0000 2024-09-12T00:28:58.946 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-12 00:26:20.033432339 +0000 2024-09-12T00:28:58.946 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-12 00:26:20.033432339 +0000 2024-09-12T00:28:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-12 00:26:20.033432339 +0000 2024-09-12T00:28:58.946 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:28:59.023 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-12T00:28:59.023 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-12T00:28:59.023 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000210586 s, 2.4 MB/s 2024-09-12T00:28:59.024 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:28:59.095 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:28:59.096 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:28:59.096 INFO:tasks.ceph:Generating config... 2024-09-12T00:28:59.097 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:28:59.097 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:28:59.097 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:28:59.097 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:28:59.097 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:28:59.098 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:28:59.098 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:28:59.099 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:28:59.099 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:28:59.099 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:28:59.099 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T00:28:59.099 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:28:59.099 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:28:59.099 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:28:59.099 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:28:59.099 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:28:59.099 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T00:28:59.099 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:28:59.099 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:28:59.099 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:28:59.099 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:28:59.100 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:28:59.101 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:28:59.101 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:28:59.101 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:28:59.173 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:28:59.176 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:28:59.234 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:28:59.272 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.83'), ('mon.c', '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]'), ('mon.b', '172.21.15.120')] 2024-09-12T00:28:59.273 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790],172.21.15.120', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:28:59.274 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:59.274 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:28:59.342 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.83 --addv c '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]' --add b 172.21.15.120 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:28:59.442 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:59.442 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:59.442 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:28:59.442 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: generated fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:setting min_mon_release = quincy 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 0 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:min_mon_release 17 (quincy) 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:election_strategy: 1 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:28:59.443 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:28:59.444 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:28:59.473 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a5119e9a-d5dd-4b87-aa73-8e94e0fd509b... 2024-09-12T00:28:59.474 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:28:59.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:28:59.570 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2024-09-12T00:28:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2024-09-12T00:28:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790],172.21.15.120" 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: mon client directed command retry = 5 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: ms inject socket failures = 5000 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: rgw override bucket index max shards = 1 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.574 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug trim objects = true 2024-09-12T00:28:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2024-09-12T00:28:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: bdev async discard = True 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: bdev enable discard = True 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore allocator = bitmap 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 1/20 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 1/20 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: debug objclass = 20 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 4/10 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: lockdep = True 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:28:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = bluestore 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: osd shutdown pgref assert = True 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.578 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:28:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: lockdep = True 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = True 2024-09-12T00:28:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2024-09-12T00:28:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:28:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:28:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: debug rgw = 20 2024-09-12T00:28:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: debug rgw notification = 20 2024-09-12T00:28:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: rgw bucket counters cache = True 2024-09-12T00:28:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: rgw crypt require ssl = False 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw s3 auth use sts = True 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw torrent flag = True 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: rgw user counters cache = True 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: setgroup = ceph 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: setuser = ceph 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2024-09-12T00:28:59.582 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2024-09-12T00:28:59.583 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2024-09-12T00:28:59.583 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-09-12T00:28:59.583 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-09-12T00:28:59.583 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:28:59.583 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-09-12T00:28:59.583 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.584 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:28:59.585 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790],172.21.15.120" 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: mon client directed command retry = 5 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject socket failures = 5000 2024-09-12T00:28:59.586 INFO:teuthology.orchestra.run.smithi120.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: rgw override bucket index max shards = 1 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-09-12T00:28:59.587 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-09-12T00:28:59.588 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-12T00:28:59.589 INFO:teuthology.orchestra.run.smithi120.stdout: debug objclass = 20 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: lockdep = True 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: osd shutdown pgref assert = True 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-09-12T00:28:59.590 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:28:59.591 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-09-12T00:28:59.592 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: lockdep = True 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = True 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: debug rgw = 20 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: debug rgw notification = 20 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: rgw bucket counters cache = True 2024-09-12T00:28:59.593 INFO:teuthology.orchestra.run.smithi120.stdout: rgw crypt require ssl = False 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw s3 auth use sts = True 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw torrent flag = True 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: rgw user counters cache = True 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: setgroup = ceph 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout: setuser = ceph 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-09-12T00:28:59.594 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2024-09-12T00:28:59.595 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2024-09-12T00:28:59.596 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:28:59.596 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:28:59.703 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:28:59.703 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:59.703 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:28:59.732 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:59.732 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:28:59.801 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T00:28:59.802 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:59.802 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:28:59.802 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:28:59.889 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:28:59.889 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:28:59.958 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T00:28:59.958 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:28:59.958 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:28:59.958 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:29:00.008 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:00.008 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:00.077 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:29:00.077 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:29:00.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:29:00.141 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:29:00.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:29:00.232 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:29:00.234 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:29:00.234 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:29:00.235 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:29:00.289 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:29:00.302 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:29:00.357 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:29:00.370 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:29:00.370 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:29:00.370 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:29:00.409 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:29:00.409 INFO:tasks.ceph:role: osd.0 2024-09-12T00:29:00.409 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T00:29:00.409 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:29:00.495 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:29:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:29:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:29:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:29:00.495 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:29:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:29:00.495 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:29:00.495 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:29:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:29:00.496 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:29:00.993 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-09-12T00:29:00.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-09-12T00:29:00.995 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:29:01.073 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:29:01.119 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:29:01.157 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:29:01.157 INFO:tasks.ceph:role: osd.1 2024-09-12T00:29:01.157 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T00:29:01.157 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:29:01.242 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:29:01.242 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:29:01.243 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:29:01.243 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:29:01.243 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:29:01.243 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:29:01.243 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:29:01.243 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:29:01.243 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:29:01.243 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:29:01.702 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-09-12T00:29:01.704 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-09-12T00:29:01.704 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:29:01.751 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:29:01.794 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:29:01.873 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:29:01.874 INFO:tasks.ceph:role: osd.2 2024-09-12T00:29:01.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T00:29:01.874 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:29:01.958 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:29:01.958 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:29:01.959 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:29:01.959 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:29:01.959 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:29:01.959 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:29:01.959 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:29:01.959 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:29:01.959 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:29:01.959 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:29:02.441 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-09-12T00:29:02.443 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-09-12T00:29:02.443 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:29:02.509 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:29:02.553 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:29:02.632 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:29:02.633 INFO:tasks.ceph:role: osd.3 2024-09-12T00:29:02.633 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T00:29:02.633 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:29:02.718 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:29:02.719 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:29:02.719 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:29:02.719 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:29:02.719 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:29:02.719 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:29:02.719 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:29:02.719 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:29:02.719 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:29:02.719 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:29:03.227 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-09-12T00:29:03.229 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-09-12T00:29:03.230 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:29:03.360 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:29:03.407 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:03.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:03.475+0000 7f4d1d6e4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:29:03.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:03.476+0000 7f4d1d6e4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:29:03.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:03.476+0000 7f4d1d6e4640 -1 bdev(0x559559e2f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:29:03.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:03.476+0000 7f4d1d6e4640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:29:06.392 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:29:06.438 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:06.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:06.502+0000 7f259c814640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:29:06.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:06.502+0000 7f259c814640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:29:06.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:06.502+0000 7f259c814640 -1 bdev(0x55b2243fd800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:29:06.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:06.502+0000 7f259c814640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:29:09.658 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:29:09.703 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:09.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:09.768+0000 7f58e7fdb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:29:09.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:09.768+0000 7f58e7fdb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:29:09.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:09.768+0000 7f58e7fdb640 -1 bdev(0x558808cbb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:29:09.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:09.768+0000 7f58e7fdb640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:29:12.674 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:29:12.719 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:12.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:12.783+0000 7fd00ba0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:29:12.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:12.783+0000 7fd00ba0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:29:12.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:12.784+0000 7fd00ba0e640 -1 bdev(0x563eb22c5800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:29:12.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:29:12.784+0000 7fd00ba0e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:29:15.949 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:29:15.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:29:16.040 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:29:16.041 INFO:tasks.ceph:role: osd.4 2024-09-12T00:29:16.041 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T00:29:16.041 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:29:16.090 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:29:16.090 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:29:16.090 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:29:16.090 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:29:16.090 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:29:16.090 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:29:16.090 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:29:16.090 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:29:16.091 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:29:16.091 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:29:16.601 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-12T00:29:16.603 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-12T00:29:16.604 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:29:16.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:29:16.757 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:29:16.797 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:29:16.797 INFO:tasks.ceph:role: osd.5 2024-09-12T00:29:16.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T00:29:16.797 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:29:16.884 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:29:17.347 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-12T00:29:17.349 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-12T00:29:17.349 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:29:17.413 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:29:17.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:29:17.535 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:29:17.535 INFO:tasks.ceph:role: osd.6 2024-09-12T00:29:17.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T00:29:17.535 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:29:17.620 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:29:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:29:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:29:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:29:17.621 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:29:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:29:17.621 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:29:17.621 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:29:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:29:17.621 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:29:18.112 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-12T00:29:18.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-12T00:29:18.114 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:29:18.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:29:18.251 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:29:18.330 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:29:18.330 INFO:tasks.ceph:role: osd.7 2024-09-12T00:29:18.330 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T00:29:18.330 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:29:18.417 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:29:18.417 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:29:18.417 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:29:18.417 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:29:18.418 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:29:18.418 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:29:18.418 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:29:18.418 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:29:18.418 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:29:18.418 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:29:18.922 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-12T00:29:18.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-12T00:29:18.925 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:29:19.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:29:19.082 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:19.198+0000 7fc15d62c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:29:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:19.199+0000 7fc15d62c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:29:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:19.199+0000 7fc15d62c640 -1 bdev(0x5649db9f9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:29:19.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:19.199+0000 7fc15d62c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:29:22.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:29:22.664 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:22.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:22.769+0000 7f4eec3ae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:29:22.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:22.769+0000 7f4eec3ae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:29:22.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:22.769+0000 7f4eec3ae640 -1 bdev(0x5584f53c1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:29:22.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:22.769+0000 7f4eec3ae640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:29:25.921 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:29:25.966 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:26.074+0000 7f58be14d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:29:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:26.074+0000 7f58be14d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:29:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:26.074+0000 7f58be14d640 -1 bdev(0x55df28327800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:29:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:26.074+0000 7f58be14d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:29:29.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:29:29.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:29.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:29.358+0000 7f0959a1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:29:29.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:29.359+0000 7f0959a1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:29:29.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:29.359+0000 7f0959a1c640 -1 bdev(0x564af3869800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:29:29.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-12T00:29:29.359+0000 7f0959a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:29:32.507 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:29:32.552 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:29:32.552 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:32.552 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:29:32.599 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:32.599 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:29:32.681 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:32.681 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:29:32.762 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:32.762 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:29:32.843 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:32.843 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:29:32.922 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:32.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:29:32.969 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:32.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:29:33.051 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:33.051 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:29:33.131 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:33.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:29:33.210 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:33.210 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:29:33.288 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:33.288 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:29:33.319 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:33.320 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:29:33.356 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:29:33.356 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:29:33.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:29:33.399 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDMNeJmp2GbCBAAHEDDnQREqu7HC8Z7KfwURw== 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDPNeJm7xNeHBAAdgDryBgwrCoRx1y0OPfroQ== 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDSNeJmB4/4HRAAaOY1/kWig8OnEBp/K2d6UQ== 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDVNeJmx4zVLRAAQlb+EWMBidftEZncfu6Zeg== 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDYNeJmF6nCLhAA3DPHXUqOmwUD2HrEaNFbsg== 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDMNeJmr/X4DRAAt7KkSdYp9H+F28c5H8IZHQ== 2024-09-12T00:29:33.400 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDfNeJmYh/0CxAA3OAIInp7d25quOzCkgnb9w== 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDiNeJm3cblLRAAhpyDMTaVyopM4B8yHgAf1g== 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDmNeJmXsB1BBAAGNSjDVRfwBMxYHBDgG+1bQ== 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDpNeJmV51rFRAACXf1QvlL5K+ID2nZ7bnhTw== 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDMNeJmBrFnERAAZ0OlyaFx4aPdeejblFy+jw== 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2024-09-12T00:29:33.401 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDMNeJm4Y1yFRAADqoG8yZ4i8brk3OaelZA+Q== 2024-09-12T00:29:33.432 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDMNeJmp2GbCBAAHEDDnQREqu7HC8Z7KfwURw== 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDPNeJm7xNeHBAAdgDryBgwrCoRx1y0OPfroQ== 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDSNeJmB4/4HRAAaOY1/kWig8OnEBp/K2d6UQ== 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDVNeJmx4zVLRAAQlb+EWMBidftEZncfu6Zeg== 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDYNeJmF6nCLhAA3DPHXUqOmwUD2HrEaNFbsg== 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDMNeJmr/X4DRAAt7KkSdYp9H+F28c5H8IZHQ== 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2024-09-12T00:29:33.433 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDfNeJmYh/0CxAA3OAIInp7d25quOzCkgnb9w== 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDiNeJm3cblLRAAhpyDMTaVyopM4B8yHgAf1g== 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDmNeJmXsB1BBAAGNSjDVRfwBMxYHBDgG+1bQ== 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDpNeJmV51rFRAACXf1QvlL5K+ID2nZ7bnhTw== 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDMNeJmBrFnERAAZ0OlyaFx4aPdeejblFy+jw== 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2024-09-12T00:29:33.434 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDMNeJm4Y1yFRAADqoG8yZ4i8brk3OaelZA+Q== 2024-09-12T00:29:33.435 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:29:33.445 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:29:33.541 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.544 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.607 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.610 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.673 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.675 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.740 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.806 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:29:33.809 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:29:33.873 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.940 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:33.942 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:34.006 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:34.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:34.073 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:34.075 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:29:34.139 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:29:34.141 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:29:34.208 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:29:34.212 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:29:34.279 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:29:34.279 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:29:34.317 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:29:34.427 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:29:34.466 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:29:34.544 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:29:34.655 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:29:34.693 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:29:34.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:29:34.842 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:29:34.879 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:34.881 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:29:34.949 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:29:34.950 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:29:34.950 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:29:34.953 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:29:34.953 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:29:34.953 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:29:34.955 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:29:34.955 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:29:34.955 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:29:34.992 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:29:34.993 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:29:34.993 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:29:34.993 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:29:34.995 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:29:34.995 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:29:34.995 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:29:34.997 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:29:34.997 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:29:34.998 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:29:34.998 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:29:40.363 INFO:teuthology.orchestra.run.smithi083.stderr:adjusted tunables profile to default 2024-09-12T00:29:40.375 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:29:40.375 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:29:40.375 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:40.375 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:29:40.415 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:40.415 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:29:40.494 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:40.494 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:29:40.573 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:29:40.573 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:29:40.651 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:40.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:29:40.697 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:40.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:29:40.778 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:40.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:29:40.858 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-12T00:29:40.858 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:29:40.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 66ca4695-461e-4894-8262-9a5a269ebf19 0 2024-09-12T00:29:41.170 INFO:teuthology.orchestra.run.smithi120.stdout:0 2024-09-12T00:29:41.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new d8f74abe-19a0-42c6-a142-179b54a63203 1 2024-09-12T00:29:41.378 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-09-12T00:29:41.389 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 3c379ffa-cb5a-437f-9733-62cac8619a76 2 2024-09-12T00:29:41.586 INFO:teuthology.orchestra.run.smithi120.stdout:2 2024-09-12T00:29:41.598 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 7fc14beb-1ccb-4c8e-abcc-7063db951995 3 2024-09-12T00:29:41.793 INFO:teuthology.orchestra.run.smithi120.stdout:3 2024-09-12T00:29:41.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new e5fb1b81-0151-46e1-afb2-476e3c46412e 4 2024-09-12T00:29:41.999 INFO:teuthology.orchestra.run.smithi120.stdout:4 2024-09-12T00:29:42.010 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 815f737a-4801-4c11-8564-c3b99138dfda 5 2024-09-12T00:29:42.204 INFO:teuthology.orchestra.run.smithi120.stdout:5 2024-09-12T00:29:42.215 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new afdea4da-e9bf-47fe-b8f0-57fb8fafa707 6 2024-09-12T00:29:42.411 INFO:teuthology.orchestra.run.smithi120.stdout:6 2024-09-12T00:29:42.422 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 077e1c60-be91-456c-abdf-317856836e66 7 2024-09-12T00:29:42.617 INFO:teuthology.orchestra.run.smithi120.stdout:7 2024-09-12T00:29:42.629 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:29:42.629 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:29:42.631 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:29:42.631 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:29:42.631 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:29:42.633 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:29:42.634 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:29:42.634 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:29:42.636 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:29:42.636 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:29:42.636 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:29:42.638 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:29:42.638 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:29:42.638 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:29:42.640 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:29:42.641 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:29:42.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:29:42.643 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:29:42.643 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:29:42.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:29:42.645 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:29:42.646 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:29:42.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:29:42.648 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:29:42.648 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:29:42.872 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:29:42.872 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":10,"fsid":"a5119e9a-d5dd-4b87-aa73-8e94e0fd509b","created":"2024-09-12T00:29:40.268728+0000","modified":"2024-09-12T00:29:42.616371+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:29:42.616371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"66ca4695-461e-4894-8262-9a5a269ebf19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d8f74abe-19a0-42c6-a142-179b54a63203","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c379ffa-cb5a-437f-9733-62cac8619a76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7fc14beb-1ccb-4c8e-abcc-7063db951995","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e5fb1b81-0151-46e1-afb2-476e3c46412e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"815f737a-4801-4c11-8564-c3b99138dfda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"afdea4da-e9bf-47fe-b8f0-57fb8fafa707","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"077e1c60-be91-456c-abdf-317856836e66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:29:42.883 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:29:42.884 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:29:43.690 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:29:43.864 INFO:teuthology.misc.health.smithi083.stdout: 2024-09-12T00:29:43.865 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":10,"fsid":"a5119e9a-d5dd-4b87-aa73-8e94e0fd509b","created":"2024-09-12T00:29:40.268728+0000","modified":"2024-09-12T00:29:42.616371+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:29:42.616371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"66ca4695-461e-4894-8262-9a5a269ebf19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d8f74abe-19a0-42c6-a142-179b54a63203","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c379ffa-cb5a-437f-9733-62cac8619a76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7fc14beb-1ccb-4c8e-abcc-7063db951995","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e5fb1b81-0151-46e1-afb2-476e3c46412e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"815f737a-4801-4c11-8564-c3b99138dfda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"afdea4da-e9bf-47fe-b8f0-57fb8fafa707","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"077e1c60-be91-456c-abdf-317856836e66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:29:43.874 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:29:44.134 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-12T00:29:44.135+0000 7f50a0c0c640 -1 Falling back to public interface 2024-09-12T00:29:44.167 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-12T00:29:44.169+0000 7f9b12ca5640 -1 Falling back to public interface 2024-09-12T00:29:44.362 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-09-12T00:29:44.363+0000 7f9495233640 -1 Falling back to public interface 2024-09-12T00:29:44.397 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-12T00:29:44.398+0000 7fa02712b640 -1 Falling back to public interface 2024-09-12T00:29:44.401 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-12T00:29:44.402+0000 7f7e8ce42640 -1 Falling back to public interface 2024-09-12T00:29:44.635 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-09-12T00:29:44.636+0000 7fc2f522e640 -1 Falling back to public interface 2024-09-12T00:29:44.636 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-09-12T00:29:44.637+0000 7efd2641c640 -1 Falling back to public interface 2024-09-12T00:29:44.636 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-09-12T00:29:44.637+0000 7fc2f379a640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6812/0: (98) Address already in use 2024-09-12T00:29:44.637 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-09-12T00:29:44.638+0000 7fc7a56b6640 -1 Falling back to public interface 2024-09-12T00:29:44.637 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-09-12T00:29:44.639+0000 7efd24dba640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6820/0: (98) Address already in use 2024-09-12T00:29:46.297 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-09-12T00:29:46.298+0000 7fa17aea7640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:29:46.297 INFO:tasks.ceph.mgr.y.smithi083.stderr:2024-09-12T00:29:46.298+0000 7fa17aea7640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:29:47.889 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-12T00:29:47.889+0000 7f50a0c0c640 -1 osd.4 0 log_to_monitors true 2024-09-12T00:29:47.914 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-09-12T00:29:47.916+0000 7f9495233640 -1 osd.2 0 log_to_monitors true 2024-09-12T00:29:47.988 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-12T00:29:47.988+0000 7f9b12ca5640 -1 osd.6 0 log_to_monitors true 2024-09-12T00:29:48.250 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-12T00:29:48.251+0000 7fa02712b640 -1 osd.7 0 log_to_monitors true 2024-09-12T00:29:48.473 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-12T00:29:48.474+0000 7f7e8ce42640 -1 osd.5 0 log_to_monitors true 2024-09-12T00:29:48.494 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-09-12T00:29:48.495+0000 7efd2641c640 -1 osd.1 0 log_to_monitors true 2024-09-12T00:29:48.500 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-09-12T00:29:48.502+0000 7fc2f522e640 -1 osd.0 0 log_to_monitors true 2024-09-12T00:29:48.501 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-09-12T00:29:48.503+0000 7fc7a56b6640 -1 osd.3 0 log_to_monitors true 2024-09-12T00:29:50.161 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-09-12T00:29:50.163+0000 7f94911c7640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:29:50.175 INFO:tasks.ceph.osd.2.smithi083.stderr:2024-09-12T00:29:50.177+0000 7f9488fe6640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:29:50.681 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:29:51.023 INFO:teuthology.misc.health.smithi083.stdout: 2024-09-12T00:29:51.023 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":13,"fsid":"a5119e9a-d5dd-4b87-aa73-8e94e0fd509b","created":"2024-09-12T00:29:40.268728+0000","modified":"2024-09-12T00:29:50.306914+0000","last_up_change":"2024-09-12T00:29:50.306914+0000","last_in_change":"2024-09-12T00:29:42.616371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"66ca4695-461e-4894-8262-9a5a269ebf19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d8f74abe-19a0-42c6-a142-179b54a63203","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c379ffa-cb5a-437f-9733-62cac8619a76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6801","nonce":1337722402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6803","nonce":1337722402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6807","nonce":1337722402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6805","nonce":1337722402}]},"public_addr":"172.21.15.83:6801/1337722402","cluster_addr":"172.21.15.83:6803/1337722402","heartbeat_back_addr":"172.21.15.83:6807/1337722402","heartbeat_front_addr":"172.21.15.83:6805/1337722402","state":["exists","up"]},{"osd":3,"uuid":"7fc14beb-1ccb-4c8e-abcc-7063db951995","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e5fb1b81-0151-46e1-afb2-476e3c46412e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"815f737a-4801-4c11-8564-c3b99138dfda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"afdea4da-e9bf-47fe-b8f0-57fb8fafa707","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"077e1c60-be91-456c-abdf-317856836e66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:29:51.037 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T00:29:51.063 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-12T00:29:51.063+0000 7f9b0ec39640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:29:51.079 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-12T00:29:51.080+0000 7f9b06a58640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:29:51.100 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-12T00:29:51.101+0000 7fa0230bf640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:29:51.109 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-12T00:29:51.110+0000 7f509cdf2640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:29:51.112 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-12T00:29:51.113+0000 7fa01aede640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:29:51.120 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-12T00:29:51.121+0000 7f50943fd640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:29:51.366 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-12T00:29:51.367+0000 7f7e895ea640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:29:51.378 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-12T00:29:51.379+0000 7f7e80bf5640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:29:51.915 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-09-12T00:29:51.916+0000 7efd21da1640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:29:51.926 INFO:tasks.ceph.osd.1.smithi083.stderr:2024-09-12T00:29:51.928+0000 7efd19bd1640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:29:51.962 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-09-12T00:29:51.964+0000 7fc2f0f95640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:29:51.975 INFO:tasks.ceph.osd.0.smithi083.stderr:2024-09-12T00:29:51.977+0000 7fc2e85b3640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:29:51.986 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-09-12T00:29:51.988+0000 7fc7a164a640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:29:51.996 INFO:tasks.ceph.osd.3.smithi083.stderr:2024-09-12T00:29:51.998+0000 7fc799469640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:29:57.845 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:29:58.146 INFO:teuthology.misc.health.smithi083.stdout: 2024-09-12T00:29:58.146 INFO:teuthology.misc.health.smithi083.stdout:{"epoch":18,"fsid":"a5119e9a-d5dd-4b87-aa73-8e94e0fd509b","created":"2024-09-12T00:29:40.268728+0000","modified":"2024-09-12T00:29:55.448793+0000","last_up_change":"2024-09-12T00:29:52.428909+0000","last_in_change":"2024-09-12T00:29:42.616371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:29:53.309907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66ca4695-461e-4894-8262-9a5a269ebf19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6809","nonce":1437963911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6811","nonce":1437963911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6819","nonce":1437963911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6815","nonce":1437963911}]},"public_addr":"172.21.15.83:6809/1437963911","cluster_addr":"172.21.15.83:6811/1437963911","heartbeat_back_addr":"172.21.15.83:6819/1437963911","heartbeat_front_addr":"172.21.15.83:6815/1437963911","state":["exists","up"]},{"osd":1,"uuid":"d8f74abe-19a0-42c6-a142-179b54a63203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6814","nonce":514291182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6818","nonce":514291182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6827","nonce":514291182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6823","nonce":514291182}]},"public_addr":"172.21.15.83:6814/514291182","cluster_addr":"172.21.15.83:6818/514291182","heartbeat_back_addr":"172.21.15.83:6827/514291182","heartbeat_front_addr":"172.21.15.83:6823/514291182","state":["exists","up"]},{"osd":2,"uuid":"3c379ffa-cb5a-437f-9733-62cac8619a76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6801","nonce":1337722402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6803","nonce":1337722402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6807","nonce":1337722402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6805","nonce":1337722402}]},"public_addr":"172.21.15.83:6801/1337722402","cluster_addr":"172.21.15.83:6803/1337722402","heartbeat_back_addr":"172.21.15.83:6807/1337722402","heartbeat_front_addr":"172.21.15.83:6805/1337722402","state":["exists","up"]},{"osd":3,"uuid":"7fc14beb-1ccb-4c8e-abcc-7063db951995","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6822","nonce":2252380026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6826","nonce":2252380026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6831","nonce":2252380026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6829","nonce":2252380026}]},"public_addr":"172.21.15.83:6822/2252380026","cluster_addr":"172.21.15.83:6826/2252380026","heartbeat_back_addr":"172.21.15.83:6831/2252380026","heartbeat_front_addr":"172.21.15.83:6829/2252380026","state":["exists","up"]},{"osd":4,"uuid":"e5fb1b81-0151-46e1-afb2-476e3c46412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6801","nonce":3447039892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6803","nonce":3447039892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6807","nonce":3447039892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6805","nonce":3447039892}]},"public_addr":"172.21.15.120:6801/3447039892","cluster_addr":"172.21.15.120:6803/3447039892","heartbeat_back_addr":"172.21.15.120:6807/3447039892","heartbeat_front_addr":"172.21.15.120:6805/3447039892","state":["exists","up"]},{"osd":5,"uuid":"815f737a-4801-4c11-8564-c3b99138dfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6825","nonce":1608674593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6827","nonce":1608674593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6831","nonce":1608674593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6829","nonce":1608674593}]},"public_addr":"172.21.15.120:6825/1608674593","cluster_addr":"172.21.15.120:6827/1608674593","heartbeat_back_addr":"172.21.15.120:6831/1608674593","heartbeat_front_addr":"172.21.15.120:6829/1608674593","state":["exists","up"]},{"osd":6,"uuid":"afdea4da-e9bf-47fe-b8f0-57fb8fafa707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6809","nonce":566663973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6811","nonce":566663973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6815","nonce":566663973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6813","nonce":566663973}]},"public_addr":"172.21.15.120:6809/566663973","cluster_addr":"172.21.15.120:6811/566663973","heartbeat_back_addr":"172.21.15.120:6815/566663973","heartbeat_front_addr":"172.21.15.120:6813/566663973","state":["exists","up"]},{"osd":7,"uuid":"077e1c60-be91-456c-abdf-317856836e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6817","nonce":3242240032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6819","nonce":3242240032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6823","nonce":3242240032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6821","nonce":3242240032}]},"public_addr":"172.21.15.120:6817/3242240032","cluster_addr":"172.21.15.120:6819/3242240032","heartbeat_back_addr":"172.21.15.120:6823/3242240032","heartbeat_front_addr":"172.21.15.120:6821/3242240032","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.551622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.500926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.877705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.484797+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.857567+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.434709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.947665+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.211481+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:29:58.158 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:29:58.158 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:29:58.158 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:29:58.515 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'rbd' created 2024-09-12T00:29:58.527 DEBUG:teuthology.orchestra.run.smithi083:> rbd --cluster ceph pool init rbd 2024-09-12T00:29:58.586 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:58.587 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:01.534 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:30:01.535 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:30:01.536 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:30:01.844 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:30:01.857 INFO:teuthology.orchestra.run.smithi083.stdout:[{"version":9,"timestamp":"2024-09-12T00:29:51.989545+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"5950.067568"}]}] 2024-09-12T00:30:01.858 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:30:01.858 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:30:01.858 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:30:01.858 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:30:02.208 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:30:02.218 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":2589227164},{"type":"v1","addr":"172.21.15.83:6833","nonce":2589227164}]},"active_addr":"172.21.15.83:6833/2589227164","active_change":"2024-09-12T00:29:45.286521+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":1426807862}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":582180069}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3794073448}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3485814597}]}]} 2024-09-12T00:30:02.223 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:30:02.223 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:30:02.224 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:30:02.527 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:30:02.527 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":22,"fsid":"a5119e9a-d5dd-4b87-aa73-8e94e0fd509b","created":"2024-09-12T00:29:40.268728+0000","modified":"2024-09-12T00:30:01.521136+0000","last_up_change":"2024-09-12T00:29:52.428909+0000","last_in_change":"2024-09-12T00:29:42.616371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:29:53.309907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:29:58.459554+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66ca4695-461e-4894-8262-9a5a269ebf19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6809","nonce":1437963911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6811","nonce":1437963911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6819","nonce":1437963911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6815","nonce":1437963911}]},"public_addr":"172.21.15.83:6809/1437963911","cluster_addr":"172.21.15.83:6811/1437963911","heartbeat_back_addr":"172.21.15.83:6819/1437963911","heartbeat_front_addr":"172.21.15.83:6815/1437963911","state":["exists","up"]},{"osd":1,"uuid":"d8f74abe-19a0-42c6-a142-179b54a63203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6814","nonce":514291182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6818","nonce":514291182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6827","nonce":514291182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6823","nonce":514291182}]},"public_addr":"172.21.15.83:6814/514291182","cluster_addr":"172.21.15.83:6818/514291182","heartbeat_back_addr":"172.21.15.83:6827/514291182","heartbeat_front_addr":"172.21.15.83:6823/514291182","state":["exists","up"]},{"osd":2,"uuid":"3c379ffa-cb5a-437f-9733-62cac8619a76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6801","nonce":1337722402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6803","nonce":1337722402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6807","nonce":1337722402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6805","nonce":1337722402}]},"public_addr":"172.21.15.83:6801/1337722402","cluster_addr":"172.21.15.83:6803/1337722402","heartbeat_back_addr":"172.21.15.83:6807/1337722402","heartbeat_front_addr":"172.21.15.83:6805/1337722402","state":["exists","up"]},{"osd":3,"uuid":"7fc14beb-1ccb-4c8e-abcc-7063db951995","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6822","nonce":2252380026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6826","nonce":2252380026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6831","nonce":2252380026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6829","nonce":2252380026}]},"public_addr":"172.21.15.83:6822/2252380026","cluster_addr":"172.21.15.83:6826/2252380026","heartbeat_back_addr":"172.21.15.83:6831/2252380026","heartbeat_front_addr":"172.21.15.83:6829/2252380026","state":["exists","up"]},{"osd":4,"uuid":"e5fb1b81-0151-46e1-afb2-476e3c46412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6801","nonce":3447039892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6803","nonce":3447039892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6807","nonce":3447039892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6805","nonce":3447039892}]},"public_addr":"172.21.15.120:6801/3447039892","cluster_addr":"172.21.15.120:6803/3447039892","heartbeat_back_addr":"172.21.15.120:6807/3447039892","heartbeat_front_addr":"172.21.15.120:6805/3447039892","state":["exists","up"]},{"osd":5,"uuid":"815f737a-4801-4c11-8564-c3b99138dfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6825","nonce":1608674593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6827","nonce":1608674593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6831","nonce":1608674593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6829","nonce":1608674593}]},"public_addr":"172.21.15.120:6825/1608674593","cluster_addr":"172.21.15.120:6827/1608674593","heartbeat_back_addr":"172.21.15.120:6831/1608674593","heartbeat_front_addr":"172.21.15.120:6829/1608674593","state":["exists","up"]},{"osd":6,"uuid":"afdea4da-e9bf-47fe-b8f0-57fb8fafa707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6809","nonce":566663973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6811","nonce":566663973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6815","nonce":566663973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6813","nonce":566663973}]},"public_addr":"172.21.15.120:6809/566663973","cluster_addr":"172.21.15.120:6811/566663973","heartbeat_back_addr":"172.21.15.120:6815/566663973","heartbeat_front_addr":"172.21.15.120:6813/566663973","state":["exists","up"]},{"osd":7,"uuid":"077e1c60-be91-456c-abdf-317856836e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6817","nonce":3242240032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6819","nonce":3242240032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6823","nonce":3242240032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6821","nonce":3242240032}]},"public_addr":"172.21.15.120:6817/3242240032","cluster_addr":"172.21.15.120:6819/3242240032","heartbeat_back_addr":"172.21.15.120:6823/3242240032","heartbeat_front_addr":"172.21.15.120:6821/3242240032","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.551622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.500926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.877705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.484797+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.857567+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.434709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.947665+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.211481+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:30:02.540 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:30:02.540 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:30:02.837 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:30:02.837 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":22,"fsid":"a5119e9a-d5dd-4b87-aa73-8e94e0fd509b","created":"2024-09-12T00:29:40.268728+0000","modified":"2024-09-12T00:30:01.521136+0000","last_up_change":"2024-09-12T00:29:52.428909+0000","last_in_change":"2024-09-12T00:29:42.616371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:29:53.309907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:29:58.459554+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66ca4695-461e-4894-8262-9a5a269ebf19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6809","nonce":1437963911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6811","nonce":1437963911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6819","nonce":1437963911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6815","nonce":1437963911}]},"public_addr":"172.21.15.83:6809/1437963911","cluster_addr":"172.21.15.83:6811/1437963911","heartbeat_back_addr":"172.21.15.83:6819/1437963911","heartbeat_front_addr":"172.21.15.83:6815/1437963911","state":["exists","up"]},{"osd":1,"uuid":"d8f74abe-19a0-42c6-a142-179b54a63203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6814","nonce":514291182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6818","nonce":514291182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6827","nonce":514291182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6823","nonce":514291182}]},"public_addr":"172.21.15.83:6814/514291182","cluster_addr":"172.21.15.83:6818/514291182","heartbeat_back_addr":"172.21.15.83:6827/514291182","heartbeat_front_addr":"172.21.15.83:6823/514291182","state":["exists","up"]},{"osd":2,"uuid":"3c379ffa-cb5a-437f-9733-62cac8619a76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6801","nonce":1337722402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6803","nonce":1337722402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6807","nonce":1337722402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6805","nonce":1337722402}]},"public_addr":"172.21.15.83:6801/1337722402","cluster_addr":"172.21.15.83:6803/1337722402","heartbeat_back_addr":"172.21.15.83:6807/1337722402","heartbeat_front_addr":"172.21.15.83:6805/1337722402","state":["exists","up"]},{"osd":3,"uuid":"7fc14beb-1ccb-4c8e-abcc-7063db951995","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6822","nonce":2252380026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6826","nonce":2252380026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6831","nonce":2252380026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6829","nonce":2252380026}]},"public_addr":"172.21.15.83:6822/2252380026","cluster_addr":"172.21.15.83:6826/2252380026","heartbeat_back_addr":"172.21.15.83:6831/2252380026","heartbeat_front_addr":"172.21.15.83:6829/2252380026","state":["exists","up"]},{"osd":4,"uuid":"e5fb1b81-0151-46e1-afb2-476e3c46412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6801","nonce":3447039892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6803","nonce":3447039892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6807","nonce":3447039892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6805","nonce":3447039892}]},"public_addr":"172.21.15.120:6801/3447039892","cluster_addr":"172.21.15.120:6803/3447039892","heartbeat_back_addr":"172.21.15.120:6807/3447039892","heartbeat_front_addr":"172.21.15.120:6805/3447039892","state":["exists","up"]},{"osd":5,"uuid":"815f737a-4801-4c11-8564-c3b99138dfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6825","nonce":1608674593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6827","nonce":1608674593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6831","nonce":1608674593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6829","nonce":1608674593}]},"public_addr":"172.21.15.120:6825/1608674593","cluster_addr":"172.21.15.120:6827/1608674593","heartbeat_back_addr":"172.21.15.120:6831/1608674593","heartbeat_front_addr":"172.21.15.120:6829/1608674593","state":["exists","up"]},{"osd":6,"uuid":"afdea4da-e9bf-47fe-b8f0-57fb8fafa707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6809","nonce":566663973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6811","nonce":566663973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6815","nonce":566663973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6813","nonce":566663973}]},"public_addr":"172.21.15.120:6809/566663973","cluster_addr":"172.21.15.120:6811/566663973","heartbeat_back_addr":"172.21.15.120:6815/566663973","heartbeat_front_addr":"172.21.15.120:6813/566663973","state":["exists","up"]},{"osd":7,"uuid":"077e1c60-be91-456c-abdf-317856836e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6817","nonce":3242240032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6819","nonce":3242240032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6823","nonce":3242240032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6821","nonce":3242240032}]},"public_addr":"172.21.15.120:6817/3242240032","cluster_addr":"172.21.15.120:6819/3242240032","heartbeat_back_addr":"172.21.15.120:6823/3242240032","heartbeat_front_addr":"172.21.15.120:6821/3242240032","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.551622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.500926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.877705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.484797+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.857567+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.434709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.947665+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.211481+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:30:02.851 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:30:02.851 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:30:02.852 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:30:02.852 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:30:02.852 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:30:02.853 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:30:02.853 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:30:02.854 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:30:03.113 INFO:teuthology.orchestra.run.smithi083.stdout:64424509446 2024-09-12T00:30:03.113 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:30:03.115 INFO:teuthology.orchestra.run.smithi083.stdout:64424509445 2024-09-12T00:30:03.115 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:30:03.116 INFO:teuthology.orchestra.run.smithi083.stdout:60129542149 2024-09-12T00:30:03.116 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:30:03.118 INFO:teuthology.orchestra.run.smithi083.stdout:60129542151 2024-09-12T00:30:03.119 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:30:03.120 INFO:teuthology.orchestra.run.smithi083.stdout:60129542150 2024-09-12T00:30:03.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:30:03.121 INFO:teuthology.orchestra.run.smithi083.stdout:64424509446 2024-09-12T00:30:03.122 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:30:03.123 INFO:teuthology.orchestra.run.smithi083.stdout:55834574854 2024-09-12T00:30:03.123 INFO:teuthology.orchestra.run.smithi083.stdout:60129542151 2024-09-12T00:30:03.124 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:30:03.124 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:30:03.705 INFO:teuthology.orchestra.run.smithi083.stdout:64424509446 2024-09-12T00:30:03.720 INFO:teuthology.orchestra.run.smithi083.stdout:60129542149 2024-09-12T00:30:03.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T00:30:03.727 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:03.732 INFO:teuthology.orchestra.run.smithi083.stdout:64424509445 2024-09-12T00:30:03.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-12T00:30:03.738 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:03.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-12T00:30:03.749 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:03.755 INFO:teuthology.orchestra.run.smithi083.stdout:60129542150 2024-09-12T00:30:03.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-12T00:30:03.768 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:03.789 INFO:teuthology.orchestra.run.smithi083.stdout:60129542151 2024-09-12T00:30:03.794 INFO:teuthology.orchestra.run.smithi083.stdout:60129542151 2024-09-12T00:30:03.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-09-12T00:30:03.803 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:03.806 INFO:teuthology.orchestra.run.smithi083.stdout:55834574854 2024-09-12T00:30:03.806 INFO:teuthology.orchestra.run.smithi083.stdout:64424509446 2024-09-12T00:30:03.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-09-12T00:30:03.809 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:03.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-12T00:30:03.820 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:03.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-12T00:30:03.821 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:03.821 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:30:03.821 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:30:04.158 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:30:04.158 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T00:30:04.170 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T00:30:03.295063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219152,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755568,"statfs":{"total":773094113280,"available":772869701632,"internally_reserved":0,"allocated":2965504,"data_stored":1789414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.780350"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.530986+0000","last_change":"2024-09-12T00:30:01.530986+0000","last_active":"2024-09-12T00:30:01.530986+0000","last_peered":"2024-09-12T00:30:01.530986+0000","last_clean":"2024-09-12T00:30:01.530986+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T00:30:01.530986+0000","last_undegraded":"2024-09-12T00:30:01.530986+0000","last_fullsized":"2024-09-12T00:30:01.530986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:52.048191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.610276+0000","last_change":"2024-09-12T00:30:01.610276+0000","last_active":"2024-09-12T00:30:01.610276+0000","last_peered":"2024-09-12T00:30:01.610276+0000","last_clean":"2024-09-12T00:30:01.610276+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T00:30:01.610276+0000","last_undegraded":"2024-09-12T00:30:01.610276+0000","last_fullsized":"2024-09-12T00:30:01.610276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:31.655155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.530154+0000","last_change":"2024-09-12T00:30:01.530154+0000","last_active":"2024-09-12T00:30:01.530154+0000","last_peered":"2024-09-12T00:30:01.530154+0000","last_clean":"2024-09-12T00:30:01.530154+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T00:30:01.530154+0000","last_undegraded":"2024-09-12T00:30:01.530154+0000","last_fullsized":"2024-09-12T00:30:01.530154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:56.892481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.575846+0000","last_change":"2024-09-12T00:30:01.575846+0000","last_active":"2024-09-12T00:30:01.575846+0000","last_peered":"2024-09-12T00:30:01.575846+0000","last_clean":"2024-09-12T00:30:01.575846+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T00:30:01.575846+0000","last_undegraded":"2024-09-12T00:30:01.575846+0000","last_fullsized":"2024-09-12T00:30:01.575846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:02.507794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.531631+0000","last_change":"2024-09-12T00:30:01.530685+0000","last_active":"2024-09-12T00:30:01.531631+0000","last_peered":"2024-09-12T00:30:01.531631+0000","last_clean":"2024-09-12T00:30:01.531631+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T00:30:01.531631+0000","last_undegraded":"2024-09-12T00:30:01.531631+0000","last_fullsized":"2024-09-12T00:30:01.531631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:49.919156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.610469+0000","last_change":"2024-09-12T00:30:01.610469+0000","last_active":"2024-09-12T00:30:01.610469+0000","last_peered":"2024-09-12T00:30:01.610469+0000","last_clean":"2024-09-12T00:30:01.610469+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T00:30:01.610469+0000","last_undegraded":"2024-09-12T00:30:01.610469+0000","last_fullsized":"2024-09-12T00:30:01.610469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:35.665518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.530206+0000","last_change":"2024-09-12T00:30:01.530206+0000","last_active":"2024-09-12T00:30:01.530206+0000","last_peered":"2024-09-12T00:30:01.530206+0000","last_clean":"2024-09-12T00:30:01.530206+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T00:30:01.530206+0000","last_undegraded":"2024-09-12T00:30:01.530206+0000","last_fullsized":"2024-09-12T00:30:01.530206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:48.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.530800+0000","last_change":"2024-09-12T00:30:01.530800+0000","last_active":"2024-09-12T00:30:01.530800+0000","last_peered":"2024-09-12T00:30:01.530800+0000","last_clean":"2024-09-12T00:30:01.530800+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T00:30:01.530800+0000","last_undegraded":"2024-09-12T00:30:01.530800+0000","last_fullsized":"2024-09-12T00:30:01.530800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:58.930249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.526802+0000","last_change":"2024-09-12T00:29:54.471707+0000","last_active":"2024-09-12T00:30:01.526802+0000","last_peered":"2024-09-12T00:30:01.526802+0000","last_clean":"2024-09-12T00:30:01.526802+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T00:30:01.526802+0000","last_undegraded":"2024-09-12T00:30:01.526802+0000","last_fullsized":"2024-09-12T00:30:01.526802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_clean_scrub_stamp":"2024-09-12T00:29:53.438265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.897736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:30:04.171 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:30:04.463 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:30:04.464 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T00:30:04.476 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T00:30:03.295063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219152,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755568,"statfs":{"total":773094113280,"available":772869701632,"internally_reserved":0,"allocated":2965504,"data_stored":1789414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.780350"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.530986+0000","last_change":"2024-09-12T00:30:01.530986+0000","last_active":"2024-09-12T00:30:01.530986+0000","last_peered":"2024-09-12T00:30:01.530986+0000","last_clean":"2024-09-12T00:30:01.530986+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T00:30:01.530986+0000","last_undegraded":"2024-09-12T00:30:01.530986+0000","last_fullsized":"2024-09-12T00:30:01.530986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:52.048191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.610276+0000","last_change":"2024-09-12T00:30:01.610276+0000","last_active":"2024-09-12T00:30:01.610276+0000","last_peered":"2024-09-12T00:30:01.610276+0000","last_clean":"2024-09-12T00:30:01.610276+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T00:30:01.610276+0000","last_undegraded":"2024-09-12T00:30:01.610276+0000","last_fullsized":"2024-09-12T00:30:01.610276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:31.655155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.530154+0000","last_change":"2024-09-12T00:30:01.530154+0000","last_active":"2024-09-12T00:30:01.530154+0000","last_peered":"2024-09-12T00:30:01.530154+0000","last_clean":"2024-09-12T00:30:01.530154+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T00:30:01.530154+0000","last_undegraded":"2024-09-12T00:30:01.530154+0000","last_fullsized":"2024-09-12T00:30:01.530154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:56.892481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.575846+0000","last_change":"2024-09-12T00:30:01.575846+0000","last_active":"2024-09-12T00:30:01.575846+0000","last_peered":"2024-09-12T00:30:01.575846+0000","last_clean":"2024-09-12T00:30:01.575846+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T00:30:01.575846+0000","last_undegraded":"2024-09-12T00:30:01.575846+0000","last_fullsized":"2024-09-12T00:30:01.575846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:02.507794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.531631+0000","last_change":"2024-09-12T00:30:01.530685+0000","last_active":"2024-09-12T00:30:01.531631+0000","last_peered":"2024-09-12T00:30:01.531631+0000","last_clean":"2024-09-12T00:30:01.531631+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T00:30:01.531631+0000","last_undegraded":"2024-09-12T00:30:01.531631+0000","last_fullsized":"2024-09-12T00:30:01.531631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:49.919156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.610469+0000","last_change":"2024-09-12T00:30:01.610469+0000","last_active":"2024-09-12T00:30:01.610469+0000","last_peered":"2024-09-12T00:30:01.610469+0000","last_clean":"2024-09-12T00:30:01.610469+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T00:30:01.610469+0000","last_undegraded":"2024-09-12T00:30:01.610469+0000","last_fullsized":"2024-09-12T00:30:01.610469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:35.665518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.530206+0000","last_change":"2024-09-12T00:30:01.530206+0000","last_active":"2024-09-12T00:30:01.530206+0000","last_peered":"2024-09-12T00:30:01.530206+0000","last_clean":"2024-09-12T00:30:01.530206+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T00:30:01.530206+0000","last_undegraded":"2024-09-12T00:30:01.530206+0000","last_fullsized":"2024-09-12T00:30:01.530206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:48.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.530800+0000","last_change":"2024-09-12T00:30:01.530800+0000","last_active":"2024-09-12T00:30:01.530800+0000","last_peered":"2024-09-12T00:30:01.530800+0000","last_clean":"2024-09-12T00:30:01.530800+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T00:30:01.530800+0000","last_undegraded":"2024-09-12T00:30:01.530800+0000","last_fullsized":"2024-09-12T00:30:01.530800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:58.930249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:30:01.526802+0000","last_change":"2024-09-12T00:29:54.471707+0000","last_active":"2024-09-12T00:30:01.526802+0000","last_peered":"2024-09-12T00:30:01.526802+0000","last_clean":"2024-09-12T00:30:01.526802+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T00:30:01.526802+0000","last_undegraded":"2024-09-12T00:30:01.526802+0000","last_fullsized":"2024-09-12T00:30:01.526802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_clean_scrub_stamp":"2024-09-12T00:29:53.438265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.897736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:30:04.476 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:30:04.477 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:30:04.477 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:30:04.477 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:30:04.810 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:30:04.810 INFO:teuthology.orchestra.run.smithi083.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:30:04.822 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:30:04.823 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:30:04.836 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T00:30:04.836 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:30:04.865 DEBUG:teuthology.orchestra.run.smithi083:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T00:30:05.576 INFO:teuthology.orchestra.run.smithi083.stderr:.+.+...+.....+.......+.................+.+..+.......+...+..+.+......+.....+....+......+.....+......+..........+........+.+...+......+..+...+......+.+..+.+.................+...+....+.....+.+...........+.+..+.+++++++++++++++++++++++++++++++++++++++++++++*.........+.+...+...+..+......+++++++++++++++++++++++++++++++++++++++++++++*........+.....+................+..+............+............+.+............+..+...+............+...............+.+.....+............+.+..+..........+..+.+.....+....+.....................+.........+..+.........+.+...+...+.....+......................+..+.........+............+...+......+.+........+.+........+...............+.......+..............+....+.................+...+.............+...............+..............+.+..+.+.................+.......+..+.........+......+.+...+......+..................+.....+.......+...+..+...+.+...........+.+.....+....+......+........+.......+........+.......+.....+...............+.......+...+.....+.......+..+...............+.+.....+.........+......+..........+...+..+...+......+...+...+.............+.....+.+.............................+......+.+.........+...............+.......................+.+.........+.....+...+...+.+..............+....+......+.....+......+...+...+..................+......+.+........+.........+..........+..+...+......+............+.........+.+..+.......+........+.+..+...+.........+......+......+.+...............+............+..+......+..........+...+..+....+........+.+.....+......+.+...+..............+................+.........+.....+.+.........+........+....+...+...........+.+......+........+.......+..+......+....+.....+.......+.....+.............+.....+..........+......+.................+...................+.....+......+...................+.....+....+...........+...+...+.............+..+...+.+.........+......+...............+.....+.+..............+...+.......+......+..............+.............+..+...+......+.+...........+...+....+.........................................+....+..+.+............+.....................+............+........+....+..+.+...............+..+..........+...+.........+...+......+.....................+........+.......+......+............+..+...+.............+............+...+...............+....................+....+..................+.....+.+......+...+......+......+.........+......+...............+...........+...+......+.+..+.......+++++ 2024-09-12T00:30:05.882 INFO:teuthology.orchestra.run.smithi083.stderr:....+.+..+............+...+++++++++++++++++++++++++++++++++++++++++++++*..+..+.+..+......+.......+...+.....+................+...+..+......+....+......+..............+....+......+.........+..+..........+.........+...+..+....+..+.............+..............+.+..+...+....+...+.........+........+.............+...+++++++++++++++++++++++++++++++++++++++++++++*.+...+......+.......+.....+...+.........+.............+........+.+...+.....+............+.+.....+...+.........+.+..............+...............+......+.+......+...+......+.....+....+...........+.........+............+.......+.....+................+..+....+...........+..........+...............+........+.......+...............+........+.......+...+..+............+..........+......+.........+..+...+.+.....+.+.....+...+......+...............+....+........+.......+...............+..+...+.+.....+...............................+........+.......+........+...+...+..........+..............+.+..+.........+......+....+.........+......+...+..+..........+......+........+....+........+..................+......+...............+..........+.........+......+...+...........+.........+.+..+....+......+.........+..............+.......+..................+..+....+...+...........+................+.....+..........+......+..+.......+......+.....+...+...................+.....+.+.........+...+..+......+...........................+...+.......+.....+...+......+.............+...+..+.+......+.....+..........+......+.......................+......+...+...+...+.......+........+++++ 2024-09-12T00:30:05.897 INFO:teuthology.orchestra.run.smithi083.stderr:----- 2024-09-12T00:30:05.903 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T00:30:05.943 DEBUG:teuthology.orchestra.run.smithi083:> sudo update-ca-trust 2024-09-12T00:30:07.038 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:30:07.068 DEBUG:teuthology.orchestra.run.smithi083:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi083.front.sepia.ceph.com 2024-09-12T00:30:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:.+......+....+........+.........+...+...............+.+..+...+....+...+..+..................+.......+.................+...+......+.......+...+..+...+..........+++++++++++++++++++++++++++++++++++++++*.+...........+......+.+..+++++++++++++++++++++++++++++++++++++++*..+....+......+..+.+.....+......+.........+.......+..+.............+....................+....+...+.....+.......+...+...+...+..+...+.+.....+....+..............+.+......+...+...+..+............+.+............+..+......+.......+..+....+......+...+........+...+....+..+...+......+.........+.+..+..........+..............+.+.....+...++++++ 2024-09-12T00:30:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:..........+.....+.......+...+..+.......+.....+..........+.........+.....+.+........+++++++++++++++++++++++++++++++++++++++*............+...+............+...+....+...+...+.....+..........+++++++++++++++++++++++++++++++++++++++*........+..+...+.........+.+..+.......+..+.+..+.+......+.........+..+...+......+......+.........+.........+.......+.....+.........+...+.++++++ 2024-09-12T00:30:07.186 INFO:teuthology.orchestra.run.smithi083.stderr:----- 2024-09-12T00:30:07.187 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:30:07.187 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:30:07.256 DEBUG:teuthology.orchestra.run.smithi083:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:30:07.334 INFO:teuthology.orchestra.run.smithi083.stderr:Certificate request self-signature ok 2024-09-12T00:30:07.334 INFO:teuthology.orchestra.run.smithi083.stderr:subject=CN=smithi083.front.sepia.ceph.com 2024-09-12T00:30:07.342 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:30:07.411 DEBUG:teuthology.orchestra.run.smithi083:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:30:07.482 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T00:30:07.482 DEBUG:teuthology.orchestra.run.smithi083:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:30:07.551 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:30:07.568 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-12T00:30:07.568 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:30:07.568 INFO:tasks.rgw:Creating data pools 2024-09-12T00:30:07.568 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:30:07.569 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T00:30:08.071 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:30:10.061 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:30:10.093 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:30:11.063 INFO:teuthology.orchestra.run.smithi083.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:30:11.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:30:12.092 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:30:12.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:30:13.114 INFO:teuthology.orchestra.run.smithi083.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:30:13.141 DEBUG:tasks.rgw:Pools created 2024-09-12T00:30:13.141 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:30:13.141 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:30:13.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:30:13.142 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:30:13.251 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:13.251 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:15.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.157+0000 7f0092482640 0 -- 172.21.15.83:0/2990727636 >> [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] conn(0x7eff68076380 msgr2=0x7eff68078840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:15.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.161+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.162+0000 7f0092482640 0 -- 172.21.15.83:0/3526306792 >> [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] conn(0x7eff58076470 msgr2=0x7eff58078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:15.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.163+0000 7f0095f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:15.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.163+0000 7f0095f3c800 20 realm 2024-09-12T00:30:15.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.163+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.163+0000 7f0095f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:15.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.163+0000 7f0095f3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:15.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.163+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.164+0000 7f0095f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:15.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.164+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.165+0000 7f0095f3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:15.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.165+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.166+0000 7f0095f3c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:30:15.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.166+0000 7f0095f3c800 20 searching for the correct realm 2024-09-12T00:30:15.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.177+0000 7f0095f3c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:30:15.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.177+0000 7f0095f3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:15.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.177+0000 7f0095f3c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:30:15.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.177+0000 7f0095f3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:15.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.177+0000 7f0095f3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:15.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.177+0000 7f0095f3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:15.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.177+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.177+0000 7f0095f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:15.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.177+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:15.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:30:15.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 20 zone default found 2024-09-12T00:30:15.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 4 Realm: () 2024-09-12T00:30:15.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:30:15.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:30:15.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:15.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 20 zonegroup default 2024-09-12T00:30:15.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:15.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:15.178+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:17.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:17.148+0000 7f0095f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:17.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:17.148+0000 7f0095f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:30:17.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:17.149+0000 7f0095f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:17.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:17.149+0000 7f0095f3c800 20 started sync module instance, tier type = 2024-09-12T00:30:17.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:17.149+0000 7f0095f3c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:30:19.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.183+0000 7f0095f3c800 20 add_watcher() i=0 2024-09-12T00:30:19.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.183+0000 7f0095f3c800 20 add_watcher() i=1 2024-09-12T00:30:19.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.183+0000 7f0095f3c800 20 add_watcher() i=2 2024-09-12T00:30:19.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.183+0000 7f0095f3c800 20 add_watcher() i=3 2024-09-12T00:30:19.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.183+0000 7f0095f3c800 20 add_watcher() i=4 2024-09-12T00:30:19.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.183+0000 7f0095f3c800 20 add_watcher() i=5 2024-09-12T00:30:19.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.183+0000 7f0095f3c800 20 add_watcher() i=6 2024-09-12T00:30:19.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.184+0000 7f0095f3c800 20 add_watcher() i=7 2024-09-12T00:30:19.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.184+0000 7f0095f3c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:19.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.185+0000 7f0095f3c800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:30:19.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.185+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:30:19.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.185+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.185+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:30:19.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.185+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:30:19.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.185+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.186+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:30:19.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.186+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:30:19.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.186+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.186+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:30:19.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.186+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:30:19.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.186+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.186+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.186+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.186+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.187+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.187+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.187+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.187+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.187+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.187+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.187+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.187+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:30:19.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.187+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:30:19.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.188+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.189+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:30:19.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.189+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:30:19.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.189+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.189+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:30:19.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.189+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:30:19.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.189+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.189+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.189+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.189+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:30:19.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.190+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:30:19.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.191+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:30:19.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:30:19.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:30:19.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:30:19.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.192+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.193+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:30:19.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.193+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:30:19.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.193+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.193+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.193+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.193+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.193+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.193+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.193+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:30:19.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.194+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:30:19.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.195+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:30:19.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.196+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.197+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.197+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.197+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.197+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.197+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.197+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.197+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.197+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:30:19.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.197+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.198+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:30:19.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.198+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:30:19.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.198+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.198+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:30:19.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.198+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:30:19.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.198+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.198+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:30:19.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.198+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:30:19.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.198+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.199+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:30:19.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.199+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:30:19.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.199+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.199+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:30:19.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.199+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:30:19.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.199+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.200+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.200+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.200+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.200+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.200+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.200+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:30:19.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.201+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:30:19.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.202+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:30:19.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.203+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.204+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.205+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.205+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.205+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.205+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.205+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.205+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.205+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.205+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.205+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.206+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:30:19.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:30:19.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:30:19.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:30:19.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:30:19.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:30:19.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.207+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:30:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.208+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:30:19.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.209+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:30:19.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.210+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:30:19.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.211+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:30:19.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.212+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.213+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.213+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.213+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.213+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.213+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.213+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.213+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:30:19.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.213+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.213+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:30:19.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.214+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.215+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.215+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.215+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.215+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.215+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.215+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.215+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.215+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.215+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:30:19.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.216+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:30:19.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.217+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.218+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:30:19.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:30:19.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:30:19.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:30:19.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:30:19.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:30:19.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.219+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.220+0000 7f0095f3c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:30:19.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.220+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:30:19.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.221+0000 7f0095f3c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:30:19.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.227+0000 7eff3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:19.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.227+0000 7f0095f3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:19.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:19.227+0000 7f0095f3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:22.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.185+0000 7f0095f3c800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:30:22.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.185+0000 7f0095f3c800 5 note: GC not initialized 2024-09-12T00:30:22.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.186+0000 7eff3e7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:22.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.186+0000 7f0095f3c800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:22.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.186+0000 7f0095f3c800 20 Filter name: none 2024-09-12T00:30:22.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.186+0000 7efe9ffff640 20 reqs_thread_entry: start 2024-09-12T00:30:22.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.211+0000 7eff3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:22.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.218+0000 7f0095f3c800 20 remove_watcher() i=0 2024-09-12T00:30:22.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.218+0000 7f0095f3c800 2 removed watcher, disabling cache 2024-09-12T00:30:22.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.219+0000 7f0095f3c800 20 remove_watcher() i=1 2024-09-12T00:30:22.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.220+0000 7f0095f3c800 20 remove_watcher() i=2 2024-09-12T00:30:22.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.221+0000 7f0095f3c800 20 remove_watcher() i=3 2024-09-12T00:30:22.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.223+0000 7f0095f3c800 20 remove_watcher() i=4 2024-09-12T00:30:22.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.224+0000 7f0095f3c800 20 remove_watcher() i=5 2024-09-12T00:30:22.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.225+0000 7f0095f3c800 20 remove_watcher() i=6 2024-09-12T00:30:22.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.226+0000 7f0095f3c800 20 remove_watcher() i=7 2024-09-12T00:30:22.256 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-09-12T00:30:22.256 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:30:22.256 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:30:22.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:30:22.257 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:30:22.322 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:22.323 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:22.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.350+0000 7f4462b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:22.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.350+0000 7f4462b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:22.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.354+0000 7f4320fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:22.368 INFO:teuthology.orchestra.run.smithi083.stdout:{"id":"ad4424e4-de7c-4376-b125-e717016a3484","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:30:22.368 DEBUG:tasks.util.rgw: json result: {'id': 'ad4424e4-de7c-4376-b125-e717016a3484', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:30:22.368 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:30:22.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:30:22.368 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:30:22.424 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:22.424 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:22.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.458+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.460+0000 7fa74d91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.460+0000 7fa74d91f800 20 realm 2024-09-12T00:30:22.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.460+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.460+0000 7fa74d91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.460+0000 7fa74d91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:22.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.460+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.460+0000 7fa74d91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.460+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.461+0000 7fa74d91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:22.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.461+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.461+0000 7fa74d91f800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:30:22.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.461+0000 7fa74d91f800 20 searching for the correct realm 2024-09-12T00:30:22.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.465+0000 7fa748ea1640 0 -- 172.21.15.83:0/3676303103 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fa740064920 msgr2=0x7fa74007d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:22.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.469+0000 7fa748ea1640 0 -- 172.21.15.83:0/3676303103 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55e78f1622b0 msgr2=0x55e78f164770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:22.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.473+0000 7fa74d91f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:30:22.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.473+0000 7fa74d91f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:22.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.473+0000 7fa74d91f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:30:22.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.473+0000 7fa74d91f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:22.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.473+0000 7fa74d91f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:22.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.473+0000 7fa74d91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:22.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.473+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:22.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:30:22.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 zone default found 2024-09-12T00:30:22.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 4 Realm: () 2024-09-12T00:30:22.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:30:22.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:30:22.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:22.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 zonegroup default 2024-09-12T00:30:22.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.474+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.475+0000 7fa74d91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.475+0000 7fa74d91f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.475+0000 7fa74d91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.475+0000 7fa74d91f800 20 started sync module instance, tier type = 2024-09-12T00:30:22.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.475+0000 7fa74d91f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:30:22.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.490+0000 7fa74d91f800 20 add_watcher() i=0 2024-09-12T00:30:22.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.490+0000 7fa74d91f800 20 add_watcher() i=1 2024-09-12T00:30:22.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.490+0000 7fa74d91f800 20 add_watcher() i=2 2024-09-12T00:30:22.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.490+0000 7fa74d91f800 20 add_watcher() i=3 2024-09-12T00:30:22.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.490+0000 7fa74d91f800 20 add_watcher() i=4 2024-09-12T00:30:22.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.490+0000 7fa74d91f800 20 add_watcher() i=5 2024-09-12T00:30:22.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.490+0000 7fa74d91f800 20 add_watcher() i=6 2024-09-12T00:30:22.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.492+0000 7fa74d91f800 20 add_watcher() i=7 2024-09-12T00:30:22.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.492+0000 7fa74d91f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:22.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.494+0000 7fa5ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:22.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.494+0000 7fa74d91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:22.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.494+0000 7fa74d91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:22.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.494+0000 7fa74d91f800 5 note: GC not initialized 2024-09-12T00:30:22.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.494+0000 7fa5fe7e4640 20 reqs_thread_entry: start 2024-09-12T00:30:22.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.494+0000 7fa74d91f800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:22.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.494+0000 7fa74d91f800 20 Filter name: none 2024-09-12T00:30:22.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.494+0000 7fa56ffff640 20 reqs_thread_entry: start 2024-09-12T00:30:22.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.503+0000 7fa5ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:22.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.506+0000 7fa74d91f800 20 remove_watcher() i=0 2024-09-12T00:30:22.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.506+0000 7fa74d91f800 2 removed watcher, disabling cache 2024-09-12T00:30:22.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.507+0000 7fa74d91f800 20 remove_watcher() i=1 2024-09-12T00:30:22.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.508+0000 7fa74d91f800 20 remove_watcher() i=2 2024-09-12T00:30:22.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.511+0000 7fa74d91f800 20 remove_watcher() i=3 2024-09-12T00:30:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.512+0000 7fa74d91f800 20 remove_watcher() i=4 2024-09-12T00:30:22.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.513+0000 7fa74d91f800 20 remove_watcher() i=5 2024-09-12T00:30:22.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.516+0000 7fa74d91f800 20 remove_watcher() i=6 2024-09-12T00:30:22.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.517+0000 7fa74d91f800 20 remove_watcher() i=7 2024-09-12T00:30:22.526 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-09-12T00:30:22.526 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:30:22.526 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:30:22.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:30:22.526 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:30:22.589 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:22.589 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:22.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.615+0000 7f9b7fc15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:22.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.615+0000 7f9b7fc15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.618+0000 7f99f9ffb640 20 reqs_thread_entry: start 2024-09-12T00:30:22.632 INFO:teuthology.orchestra.run.smithi083.stdout:{"id":"ad4424e4-de7c-4376-b125-e717016a3484","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:30:22.632 DEBUG:tasks.util.rgw: json result: {'id': 'ad4424e4-de7c-4376-b125-e717016a3484', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:30:22.632 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T00:30:22.633 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p /tmp/rgw_datacache 2024-09-12T00:30:22.661 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T00:30:22.739 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:30:22.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:30:22.740 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:30:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:22.835 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.869+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.871+0000 7f231292f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.871+0000 7f231292f800 20 realm 2024-09-12T00:30:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.871+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.871+0000 7f231292f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.871+0000 7f231292f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.871+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.871+0000 7f231292f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.871+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.872+0000 7f231292f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:22.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.872+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.872+0000 7f231292f800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:30:22.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.872+0000 7f231292f800 20 searching for the correct realm 2024-09-12T00:30:22.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.877+0000 7f2307fff640 0 -- 172.21.15.83:0/3172639135 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55587dffefb0 msgr2=0x55587e0013c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.880+0000 7f2307fff640 0 -- 172.21.15.83:0/3172639135 >> [v2:172.21.15.120:6800/3447039892,v1:172.21.15.120:6801/3447039892] conn(0x55587e008510 msgr2=0x55587e00a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.884+0000 7f231292f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:30:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.884+0000 7f231292f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.884+0000 7f231292f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:30:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.884+0000 7f231292f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.884+0000 7f231292f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:22.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.884+0000 7f231292f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:22.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.884+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:22.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:30:22.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 zone default found 2024-09-12T00:30:22.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 4 Realm: () 2024-09-12T00:30:22.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:30:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:30:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 zonegroup default 2024-09-12T00:30:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.885+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.886+0000 7f231292f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.886+0000 7f231292f800 20 rados->read ofs=0 len=0 2024-09-12T00:30:22.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.886+0000 7f231292f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:22.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.886+0000 7f231292f800 20 started sync module instance, tier type = 2024-09-12T00:30:22.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.886+0000 7f231292f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:30:22.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.901+0000 7f231292f800 20 add_watcher() i=0 2024-09-12T00:30:22.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.901+0000 7f231292f800 20 add_watcher() i=1 2024-09-12T00:30:22.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.901+0000 7f231292f800 20 add_watcher() i=2 2024-09-12T00:30:22.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.901+0000 7f231292f800 20 add_watcher() i=3 2024-09-12T00:30:22.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.901+0000 7f231292f800 20 add_watcher() i=4 2024-09-12T00:30:22.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.901+0000 7f231292f800 20 add_watcher() i=5 2024-09-12T00:30:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.907+0000 7f231292f800 20 add_watcher() i=6 2024-09-12T00:30:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.907+0000 7f231292f800 20 add_watcher() i=7 2024-09-12T00:30:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.907+0000 7f231292f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:22.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.909+0000 7f21c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.909+0000 7f231292f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.909+0000 7f231292f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.909+0000 7f231292f800 5 note: GC not initialized 2024-09-12T00:30:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.909+0000 7f213f7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.909+0000 7f231292f800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.909+0000 7f231292f800 20 Filter name: none 2024-09-12T00:30:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.909+0000 7f213d7fa640 20 reqs_thread_entry: start 2024-09-12T00:30:22.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.919+0000 7f21c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:22.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.921+0000 7f231292f800 20 remove_watcher() i=0 2024-09-12T00:30:22.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.921+0000 7f231292f800 2 removed watcher, disabling cache 2024-09-12T00:30:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.922+0000 7f231292f800 20 remove_watcher() i=1 2024-09-12T00:30:22.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.923+0000 7f231292f800 20 remove_watcher() i=2 2024-09-12T00:30:22.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.924+0000 7f231292f800 20 remove_watcher() i=3 2024-09-12T00:30:22.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.925+0000 7f231292f800 20 remove_watcher() i=4 2024-09-12T00:30:22.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.929+0000 7f231292f800 20 remove_watcher() i=5 2024-09-12T00:30:22.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.930+0000 7f231292f800 20 remove_watcher() i=6 2024-09-12T00:30:22.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:22.932+0000 7f231292f800 20 remove_watcher() i=7 2024-09-12T00:30:22.941 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-09-12T00:30:22.941 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:30:22.941 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:30:22.941 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:30:22.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:30:22.942 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:30:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:23.004 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:23.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.030+0000 7febe672e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:23.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.030+0000 7febe672e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:23.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.034+0000 7feaa4fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:23.047 INFO:teuthology.orchestra.run.smithi083.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:30:23.048 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:30:23.048 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:30:23.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:30:23.048 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:30:23.112 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:23.112 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:23.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.140+0000 7fbef7020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:23.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.140+0000 7fbef7020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:23.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.144+0000 7fbdb37fe640 20 reqs_thread_entry: start 2024-09-12T00:30:23.159 INFO:teuthology.orchestra.run.smithi083.stdout:{"id":"ad4424e4-de7c-4376-b125-e717016a3484","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:30:23.160 DEBUG:tasks.util.rgw: json result: {'id': 'ad4424e4-de7c-4376-b125-e717016a3484', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:30:23.160 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:30:23.160 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:30:23.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:30:23.160 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:30:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:23.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.248+0000 7f905fd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:23.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.248+0000 7f905fd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:23.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.252+0000 7f8e93fff640 20 reqs_thread_entry: start 2024-09-12T00:30:23.265 INFO:teuthology.orchestra.run.smithi083.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:30:23.265 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:30:23.265 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:30:23.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:30:23.266 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:30:23.330 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:23.330 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:23.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.357+0000 7f471a126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:23.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.357+0000 7f471a126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:23.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:30:23.361+0000 7f454bfff640 20 reqs_thread_entry: start 2024-09-12T00:30:23.374 INFO:teuthology.orchestra.run.smithi083.stdout:{"id":"ad4424e4-de7c-4376-b125-e717016a3484","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:30:23.375 DEBUG:tasks.util.rgw: json result: {'id': 'ad4424e4-de7c-4376-b125-e717016a3484', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:30:23.375 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:30:23.375 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-12T00:30:23.375 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:30:23.375 DEBUG:teuthology.orchestra.run.smithi083:> sudo echo -n https://smithi083.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:30:23.414 INFO:teuthology.orchestra.run.smithi083.stdout:https://smithi083.front.sepia.ceph.com:443 2024-09-12T00:30:23.415 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:30:23.493 DEBUG:teuthology.orchestra.run.smithi083:> sudo keytool -import -alias smithi083.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T00:30:23.729 INFO:teuthology.orchestra.run.smithi083.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T00:30:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:Certificate was added to keystore 2024-09-12T00:30:23.879 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:30:23.879 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:30:23.882 INFO:tasks.rgw.client.0:Started 2024-09-12T00:30:23.882 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi083.front.sepia.ceph.com:443/ 2024-09-12T00:30:23.882 DEBUG:teuthology.orchestra.run.smithi083:> curl https://smithi083.front.sepia.ceph.com:443/ 2024-09-12T00:30:23.921 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:30:23.921 INFO:teuthology.orchestra.run.smithi083.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:30:23.922 INFO:teuthology.orchestra.run.smithi083.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:30:23.922 INFO:teuthology.orchestra.run.smithi083.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:30:23.922 INFO:teuthology.orchestra.run.smithi083.stderr:curl: (7) Failed to connect to smithi083.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:30:24.520 INFO:tasks.rgw.client.0.smithi083.stdout:2024-09-12T00:30:24.522+0000 7fa30dc47880 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T00:30:24.923 DEBUG:teuthology.orchestra.run.smithi083:> curl https://smithi083.front.sepia.ceph.com:443/ 2024-09-12T00:30:24.956 INFO:teuthology.orchestra.run.smithi083.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:30:24.956 INFO:teuthology.orchestra.run.smithi083.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:30:25.007 INFO:teuthology.orchestra.run.smithi083.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 3596 0 --:--:-- --:--:-- --:--:-- 3666 2024-09-12T00:30:25.009 INFO:teuthology.orchestra.run.smithi083.stdout:anonymous 2024-09-12T00:30:25.009 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:30:25.022 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:30:25.022 DEBUG:teuthology.orchestra.run.smithi083:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:30:27.304 DEBUG:teuthology.orchestra.run.smithi083:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:30:27.818 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting tox==3.15.0 2024-09-12T00:30:27.871 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:30:28.025 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:30:28.040 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:30:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:30:28.306 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:30:28.537 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:30:28.551 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:30:28.678 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting packaging>=14 2024-09-12T00:30:28.695 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:30:28.782 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:30:28.796 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:30:28.871 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting toml>=0.9.4 2024-09-12T00:30:28.886 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:30:28.987 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:30:29.001 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:30:29.127 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:30:29.143 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:30:29.265 INFO:teuthology.orchestra.run.smithi083.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:30:29.279 INFO:teuthology.orchestra.run.smithi083.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:30:29.395 INFO:teuthology.orchestra.run.smithi083.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T00:30:30.225 INFO:teuthology.orchestra.run.smithi083.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:30:30.423 INFO:teuthology.orchestra.run.smithi083.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T00:30:30.423 INFO:teuthology.orchestra.run.smithi083.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T00:30:30.484 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:30:30.499 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:30:30.500 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:30:30.500 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:30.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:30:30.529 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:30:30.530 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:30.598 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:30.598 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:30:30.667 INFO:tasks.workunit:timeout=3h 2024-09-12T00:30:30.667 INFO:tasks.workunit:cleanup=True 2024-09-12T00:30:30.668 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:30:30.737 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:31:14.972 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-09-12T00:31:14.973 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:31:14.974 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-09-12T00:31:14.974 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:31:14.974 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-09-12T00:31:14.974 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:31:14.974 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:31:14.974 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:31:14.974 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:31:14.976 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:31:15.098 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:31:15.101 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:31:15.101 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:31:15.714 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:31:15.786 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:31:15.825 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:31:15.827 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:31:15.827 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:31:15.865 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:31:15.868 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:31:15.868 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:31:15.897 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T00:31:15.899 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T00:31:15.899 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:31:15.971 INFO:tasks.workunit.client.0.smithi083.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:31:15.971 INFO:tasks.workunit.client.0.smithi083.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:31:15.971 INFO:tasks.workunit.client.0.smithi083.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:31:18.402 INFO:tasks.workunit.client.0.smithi083.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:31:18.402 INFO:tasks.workunit.client.0.smithi083.stderr:++ deactivate nondestructive 2024-09-12T00:31:18.402 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:31:18.402 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:31:18.402 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:31:18.402 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-09-12T00:31:18.402 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:31:18.403 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:31:18.403 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:31:18.403 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:31:18.403 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV 2024-09-12T00:31:18.404 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:31:18.404 INFO:tasks.workunit.client.0.smithi083.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:31:18.404 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PATH 2024-09-12T00:31:18.404 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:31:18.404 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -z '' ']' 2024-09-12T00:31:18.405 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:31:18.405 INFO:tasks.workunit.client.0.smithi083.stderr:++ PS1='(rgw) ' 2024-09-12T00:31:18.405 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PS1 2024-09-12T00:31:18.405 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:31:18.405 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-09-12T00:31:18.405 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install pip --upgrade 2024-09-12T00:31:18.630 INFO:tasks.workunit.client.0.smithi083.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:31:18.815 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting pip 2024-09-12T00:31:18.866 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:31:19.029 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: pip 2024-09-12T00:31:19.029 INFO:tasks.workunit.client.0.smithi083.stdout: Attempting uninstall: pip 2024-09-12T00:31:19.030 INFO:tasks.workunit.client.0.smithi083.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:31:19.184 INFO:tasks.workunit.client.0.smithi083.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:31:19.189 INFO:tasks.workunit.client.0.smithi083.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:31:19.922 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed pip-24.2 2024-09-12T00:31:20.161 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install configobj 2024-09-12T00:31:20.523 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting configobj 2024-09-12T00:31:20.566 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T00:31:20.680 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting six (from configobj) 2024-09-12T00:31:20.695 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:31:20.758 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T00:31:20.831 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:31:20.903 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: six, configobj 2024-09-12T00:31:21.029 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T00:31:21.077 INFO:tasks.workunit.client.0.smithi083.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T00:31:21.108 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T00:31:21.109 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T00:31:21.110 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:21.111 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T00:31:21.111 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:31:21.111 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T00:31:21.159 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:21.160 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 45646/radosgw \ntcp6 0 0 :::443 :::* LISTEN 45646/radosgw \n' 2024-09-12T00:31:21.160 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:radosgw port: 443 2024-09-12T00:31:21.160 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T00:31:21.160 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T00:31:21.182 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:21.182 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'' 2024-09-12T00:31:21.182 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T00:31:21.324 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:21.324 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T00:31:21.301785Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T00:31:21.301770Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T00:31:21.325 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:Creating s3cmd config... 2024-09-12T00:31:21.325 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:proto for s3cmd config is https 2024-09-12T00:31:21.325 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:s3cmd config written 2024-09-12T00:31:21.325 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T00:31:21.515 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:21.515 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T00:31:21.515 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T00:31:21.782 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:21.782 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.1 seconds, 82.90 MB/s) [1 of 1]\n" 2024-09-12T00:31:21.782 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T00:31:21.988 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:21.989 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 198.43 MB/s)\n" 2024-09-12T00:31:21.989 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T00:31:22.529 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:22.529 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340032,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "etag": "8a8e77b28965f0b74eaf3377a4048ab2",\n "tag": "ad4424e4-de7c-4376-b125-e717016a3484.4511.15303589058333517854",\n "manifest": {\n "objs": [],\n "obj_size": 7340032,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 4190208,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "ad4424e4-de7c-4376-b125-e717016a3484.4511.1",\n "bucket_id": "ad4424e4-de7c-4376-b125-e717016a3484.4511.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4190208,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "ad4424e4-de7c-4376-b125-e717016a3484.4511.1",\n "bucket_id": "ad4424e4-de7c-4376-b125-e717016a3484.4511.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 4190208,\n "ofs": 7340032,\n "stripe_size": 3149824,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "ad4424e4-de7c-4376-b125-e717016a3484.4511.1",\n "bucket_id": "ad4424e4-de7c-4376-b125-e717016a3484.4511.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T00:31:21.763977Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "ad4424e4-de7c-4376-b125-e717016a3484.4511.15303589058333517854",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726101081/ctime:1726101081/gid:1333/gname:ubuntu/md5:8a8e77b28965f0b74eaf3377a4048ab2/mode:33188/mtime:1726101081/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T00:31:22.529 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:Cached object name is: .dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_ 2024-09-12T00:31:22.529 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T00:31:22.536 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:22.537 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'2\n' 2024-09-12T00:31:22.537 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:Check cache dir content: 2 2024-09-12T00:31:22.537 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(ls -l /tmp/rgw_datacache) 2024-09-12T00:31:22.539 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:22.539 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'total 7168\n-rw-r--r--. 1 ceph ceph 4190208 Sep 12 00:31 ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_0\n-rw-r--r--. 1 ceph ceph 3149824 Sep 12 00:31 ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1\n' 2024-09-12T00:31:22.539 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -name "*.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1") 2024-09-12T00:31:22.541 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:22.541 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'/tmp/rgw_datacache/ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1\n' 2024-09-12T00:31:22.541 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:Path of file in datacache is: /tmp/rgw_datacache/ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1 2024-09-12T00:31:22.542 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(basename /tmp/rgw_datacache/ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1) 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1\n' 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:Name of file in datacache is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:exec_cmd(rados ls -p default.rgw.buckets.data) 2024-09-12T00:31:22.600 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:command succeeded 2024-09-12T00:31:22.600 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:b'ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_0\nad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1\nad4424e4-de7c-4376-b125-e717016a3484.4511.1_7M.dat\n' 2024-09-12T00:31:22.601 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:rados ls output is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_0 2024-09-12T00:31:22.601 INFO:tasks.workunit.client.0.smithi083.stderr:ad4424e4-de7c-4376-b125-e717016a3484.4511.1__shadow_.dq18yO9G5qRx9TlVRsJboq8lC5X3EZm_1 2024-09-12T00:31:22.601 INFO:tasks.workunit.client.0.smithi083.stderr:ad4424e4-de7c-4376-b125-e717016a3484.4511.1_7M.dat 2024-09-12T00:31:22.601 INFO:tasks.workunit.client.0.smithi083.stderr:DEBUG:root:RGW Datacache test SUCCESS 2024-09-12T00:31:22.601 INFO:tasks.workunit.client.0.smithi083.stderr:INFO:root:Completed Datacache tests 2024-09-12T00:31:22.605 INFO:tasks.workunit.client.0.smithi083.stderr:+ deactivate 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ export PATH 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ hash -r 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset -f deactivate 2024-09-12T00:31:22.606 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo OK. 2024-09-12T00:31:22.607 INFO:tasks.workunit.client.0.smithi083.stdout:OK. 2024-09-12T00:31:22.607 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:31:22.608 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:31:22.689 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T00:31:22.689 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:31:23.019 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:23.020 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:23.058 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:23.058 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:23.146 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:23.146 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:31:23.158 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:31:23.159 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:31:23.159 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:23.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:31:23.188 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:31:23.188 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:23.257 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:23.257 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:31:23.326 INFO:tasks.workunit:timeout=3h 2024-09-12T00:31:23.326 INFO:tasks.workunit:cleanup=True 2024-09-12T00:31:23.326 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:31:23.395 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:32:08.349 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:08.350 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-09-12T00:32:08.351 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:08.351 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:32:08.351 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:08.351 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:32:08.354 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:32:08.422 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:32:08.424 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:32:08.424 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:32:08.471 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:32:08.521 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:32:08.560 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:32:08.562 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:32:08.562 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:32:08.600 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:32:08.603 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:32:08.603 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:32:08.678 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:32:08.680 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:32:08.680 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:32:08.752 INFO:tasks.workunit.client.0.smithi083.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:32:08.752 INFO:tasks.workunit.client.0.smithi083.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:32:08.752 INFO:tasks.workunit.client.0.smithi083.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:32:10.939 INFO:tasks.workunit.client.0.smithi083.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ deactivate nondestructive 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:32:10.940 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PATH 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -z '' ']' 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ PS1='(rgw) ' 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PS1 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-09-12T00:32:10.941 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install pip --upgrade 2024-09-12T00:32:11.170 INFO:tasks.workunit.client.0.smithi083.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:32:11.350 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting pip 2024-09-12T00:32:11.356 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:32:11.400 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: pip 2024-09-12T00:32:11.400 INFO:tasks.workunit.client.0.smithi083.stdout: Attempting uninstall: pip 2024-09-12T00:32:11.400 INFO:tasks.workunit.client.0.smithi083.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:32:11.554 INFO:tasks.workunit.client.0.smithi083.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:32:11.559 INFO:tasks.workunit.client.0.smithi083.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:32:12.291 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed pip-24.2 2024-09-12T00:32:12.340 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install boto3 2024-09-12T00:32:13.176 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting boto3 2024-09-12T00:32:13.220 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:32:13.831 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:32:13.847 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:32:13.953 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:32:13.969 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:32:14.093 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:32:14.109 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:32:14.237 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:32:14.255 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:32:14.405 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:32:14.420 INFO:tasks.workunit.client.0.smithi083.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:32:14.636 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:32:14.637 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:32:14.656 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:32:14.738 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:32:14.975 INFO:tasks.workunit.client.0.smithi083.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 54.9 MB/s eta 0:00:00 2024-09-12T00:32:14.989 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:32:15.054 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:32:15.122 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:32:15.192 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:32:15.234 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:32:15.307 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:32:16.330 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:32:16.445 INFO:tasks.workunit.client.0.smithi083.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:32:16.581 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:32:16.617 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:16.617 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:16.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.654+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.655+0000 7f65e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:16.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.655+0000 7f65e4726800 20 realm 2024-09-12T00:32:16.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.656+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.656+0000 7f65e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:16.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.656+0000 7f65e4726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:16.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.656+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.656+0000 7f65e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:16.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.656+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.657+0000 7f65e4726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:16.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.657+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.657+0000 7f65e4726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:16.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.657+0000 7f65e4726800 20 searching for the correct realm 2024-09-12T00:32:16.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.661+0000 7f65d7fff640 0 -- 172.21.15.83:0/38759554 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f65c806c920 msgr2=0x7f65c80943c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:16.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.665+0000 7f65e0c4c640 0 -- 172.21.15.83:0/38759554 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x562066249900 msgr2=0x56206624bda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:16.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.668+0000 7f65e4726800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:16.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.668+0000 7f65e4726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:16.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.668+0000 7f65e4726800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:16.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.668+0000 7f65e4726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:16.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.668+0000 7f65e4726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:16.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.668+0000 7f65e4726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:16.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:16.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:16.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:16.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 20 zone default found 2024-09-12T00:32:16.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 4 Realm: () 2024-09-12T00:32:16.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:16.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:16.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:16.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 20 zonegroup default 2024-09-12T00:32:16.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.669+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.670+0000 7f65e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:16.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.670+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.670+0000 7f65e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:16.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.670+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.670+0000 7f65e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:16.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.670+0000 7f65e4726800 20 started sync module instance, tier type = 2024-09-12T00:32:16.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.670+0000 7f65e4726800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:16.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.684+0000 7f65e4726800 20 add_watcher() i=0 2024-09-12T00:32:16.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.684+0000 7f65e4726800 20 add_watcher() i=1 2024-09-12T00:32:16.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.684+0000 7f65e4726800 20 add_watcher() i=2 2024-09-12T00:32:16.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.684+0000 7f65e4726800 20 add_watcher() i=3 2024-09-12T00:32:16.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.684+0000 7f65e4726800 20 add_watcher() i=4 2024-09-12T00:32:16.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.684+0000 7f65e4726800 20 add_watcher() i=5 2024-09-12T00:32:16.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.684+0000 7f65e4726800 20 add_watcher() i=6 2024-09-12T00:32:16.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.685+0000 7f65e4726800 20 add_watcher() i=7 2024-09-12T00:32:16.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.685+0000 7f65e4726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:16.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.686+0000 7f6496fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:16.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:16.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:16.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 5 note: GC not initialized 2024-09-12T00:32:16.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f6495fdb640 20 reqs_thread_entry: start 2024-09-12T00:32:16.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:16.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 20 Filter name: none 2024-09-12T00:32:16.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f64077fe640 20 reqs_thread_entry: start 2024-09-12T00:32:16.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:32:16.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:16.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:32:16.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:32:16.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:32:16.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.687+0000 7f65e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.688+0000 7f65e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.688+0000 7f65e4726800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.688+0000 7f65e4726800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.688+0000 7f65e4726800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.688+0000 7f65e4726800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.689+0000 7f65e4726800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.689+0000 7f65e4726800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.689+0000 7f65e4726800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.689+0000 7f64b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691841 cookie 94697152674640 notifier 4565 bl.length()=593 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.689+0000 7f64b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:32:16.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.689+0000 7f64b77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:32:16.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.691+0000 7f65e4726800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:32:16.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.691+0000 7f65e4726800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:32:16.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.691+0000 7f65e4726800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:32:16.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.691+0000 7f64b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94697152668384 notifier 4565 bl.length()=186 2024-09-12T00:32:16.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.691+0000 7f64b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:32:16.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.691+0000 7f64b77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:32:16.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.692+0000 7f6496fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:16.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.694+0000 7f65e4726800 20 remove_watcher() i=0 2024-09-12T00:32:16.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.694+0000 7f65e4726800 2 removed watcher, disabling cache 2024-09-12T00:32:16.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.696+0000 7f65e4726800 20 remove_watcher() i=1 2024-09-12T00:32:16.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.697+0000 7f65e4726800 20 remove_watcher() i=2 2024-09-12T00:32:16.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.698+0000 7f65e4726800 20 remove_watcher() i=3 2024-09-12T00:32:16.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.699+0000 7f65e4726800 20 remove_watcher() i=4 2024-09-12T00:32:16.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.700+0000 7f65e4726800 20 remove_watcher() i=5 2024-09-12T00:32:16.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.701+0000 7f65e4726800 20 remove_watcher() i=6 2024-09-12T00:32:16.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:16.702+0000 7f65e4726800 20 remove_watcher() i=7 2024-09-12T00:32:16.853 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:16.853 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:16.899 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:16.899 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:16.945 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:16.945 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:16.956 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:16.957 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:16.968 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:16.968 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:16.971 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:16.971 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:16.979 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:16.979 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:16.983 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:16.983 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:16.987 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:16.987 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:17.013 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:17.013 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:17.016 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:17.017 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:17.048 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:17.048 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:17.051 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:17.051 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:17.082 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:17.082 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:17.085 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:17.085 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:17.102 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:17.102 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:17.104 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:32:17.104 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:17.105 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:32:17.135 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:17.136 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:17.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.174+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.175+0000 7f393832b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.175+0000 7f393832b800 20 realm 2024-09-12T00:32:17.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.175+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.176+0000 7f393832b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.176+0000 7f393832b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:17.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.176+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.176+0000 7f393832b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.176+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.177+0000 7f393832b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:17.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.177+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.177+0000 7f393832b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:17.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.177+0000 7f393832b800 20 searching for the correct realm 2024-09-12T00:32:17.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.180+0000 7f392bfff640 0 -- 172.21.15.83:0/797814518 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f391c06b800 msgr2=0x7f391c07c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:17.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.183+0000 7f3934874640 0 -- 172.21.15.83:0/797814518 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55fcc0bde610 msgr2=0x55fcc0be0a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:17.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 zone default found 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 4 Realm: () 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 zonegroup default 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.188+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.189+0000 7f393832b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.189+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.189+0000 7f393832b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.189+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.189+0000 7f393832b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.189+0000 7f393832b800 20 started sync module instance, tier type = 2024-09-12T00:32:17.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.189+0000 7f393832b800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:17.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.202+0000 7f393832b800 20 add_watcher() i=0 2024-09-12T00:32:17.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.202+0000 7f393832b800 20 add_watcher() i=1 2024-09-12T00:32:17.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.202+0000 7f393832b800 20 add_watcher() i=2 2024-09-12T00:32:17.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.202+0000 7f393832b800 20 add_watcher() i=3 2024-09-12T00:32:17.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.202+0000 7f393832b800 20 add_watcher() i=4 2024-09-12T00:32:17.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.202+0000 7f393832b800 20 add_watcher() i=5 2024-09-12T00:32:17.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.202+0000 7f393832b800 20 add_watcher() i=6 2024-09-12T00:32:17.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.205+0000 7f393832b800 20 add_watcher() i=7 2024-09-12T00:32:17.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.205+0000 7f393832b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:17.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.207+0000 7f37eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:17.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.208+0000 7f393832b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:17.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.208+0000 7f393832b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:17.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.208+0000 7f393832b800 5 note: GC not initialized 2024-09-12T00:32:17.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.208+0000 7f37e9fdb640 20 reqs_thread_entry: start 2024-09-12T00:32:17.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.208+0000 7f393832b800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:17.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.208+0000 7f393832b800 20 Filter name: none 2024-09-12T00:32:17.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.208+0000 7f375b7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:17.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.208+0000 7f393832b800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:17.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.208+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.209+0000 7f393832b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:17.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.210+0000 7f393832b800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:17.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.213+0000 7f37eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:17.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.216+0000 7f393832b800 20 remove_watcher() i=0 2024-09-12T00:32:17.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.216+0000 7f393832b800 2 removed watcher, disabling cache 2024-09-12T00:32:17.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.217+0000 7f393832b800 20 remove_watcher() i=1 2024-09-12T00:32:17.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.218+0000 7f393832b800 20 remove_watcher() i=2 2024-09-12T00:32:17.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.219+0000 7f393832b800 20 remove_watcher() i=3 2024-09-12T00:32:17.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.220+0000 7f393832b800 20 remove_watcher() i=4 2024-09-12T00:32:17.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.221+0000 7f393832b800 20 remove_watcher() i=5 2024-09-12T00:32:17.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.222+0000 7f393832b800 20 remove_watcher() i=6 2024-09-12T00:32:17.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.224+0000 7f393832b800 20 remove_watcher() i=7 2024-09-12T00:32:17.235 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:32:17.263 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:17.263 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:17.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.300+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.302+0000 7f0f9133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.302+0000 7f0f9133d800 20 realm 2024-09-12T00:32:17.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.302+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.302+0000 7f0f9133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.302+0000 7f0f9133d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:17.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.302+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.302+0000 7f0f9133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.302+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.303+0000 7f0f9133d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:17.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.303+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.303+0000 7f0f9133d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:17.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.303+0000 7f0f9133d800 20 searching for the correct realm 2024-09-12T00:32:17.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.306+0000 7f0f87fff640 0 -- 172.21.15.83:0/797427768 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f0f7805f9f0 msgr2=0x7f0f78096a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:17.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.511+0000 7f0f8d82b640 0 -- 172.21.15.83:0/797427768 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55ab12e662c0 msgr2=0x55ab12e686b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:17.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:17.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:17.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:17.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:17.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:17.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:17.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.515+0000 7f0f9133d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 20 zone default found 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 4 Realm: () 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 20 zonegroup default 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.516+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.517+0000 7f0f9133d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.517+0000 7f0f9133d800 20 started sync module instance, tier type = 2024-09-12T00:32:17.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.517+0000 7f0f9133d800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:17.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.535+0000 7f0f9133d800 20 add_watcher() i=0 2024-09-12T00:32:17.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.535+0000 7f0f9133d800 20 add_watcher() i=1 2024-09-12T00:32:17.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.535+0000 7f0f9133d800 20 add_watcher() i=2 2024-09-12T00:32:17.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.535+0000 7f0f9133d800 20 add_watcher() i=3 2024-09-12T00:32:17.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.535+0000 7f0f9133d800 20 add_watcher() i=4 2024-09-12T00:32:17.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.535+0000 7f0f9133d800 20 add_watcher() i=5 2024-09-12T00:32:17.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.535+0000 7f0f9133d800 20 add_watcher() i=6 2024-09-12T00:32:17.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.537+0000 7f0f9133d800 20 add_watcher() i=7 2024-09-12T00:32:17.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.537+0000 7f0f9133d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:17.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.539+0000 7f0e437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:17.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.539+0000 7f0f9133d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:17.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.539+0000 7f0f9133d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:17.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.539+0000 7f0f9133d800 5 note: GC not initialized 2024-09-12T00:32:17.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.539+0000 7f0e427e4640 20 reqs_thread_entry: start 2024-09-12T00:32:17.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.539+0000 7f0f9133d800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:17.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.539+0000 7f0f9133d800 20 Filter name: none 2024-09-12T00:32:17.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.540+0000 7f0db3fff640 20 reqs_thread_entry: start 2024-09-12T00:32:17.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.540+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.540+0000 7f0f9133d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:17.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.540+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.541+0000 7f0f9133d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:17.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.541+0000 7f0f9133d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:17.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.541+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.541+0000 7f0f9133d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:17.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.541+0000 7f0f9133d800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.542+0000 7f0f9133d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:17.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.542+0000 7f0f9133d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:17.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.543+0000 7f0e437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:17.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.545+0000 7f0f9133d800 20 remove_watcher() i=0 2024-09-12T00:32:17.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.545+0000 7f0f9133d800 2 removed watcher, disabling cache 2024-09-12T00:32:17.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.546+0000 7f0f9133d800 20 remove_watcher() i=1 2024-09-12T00:32:17.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.547+0000 7f0f9133d800 20 remove_watcher() i=2 2024-09-12T00:32:17.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.548+0000 7f0f9133d800 20 remove_watcher() i=3 2024-09-12T00:32:17.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.549+0000 7f0f9133d800 20 remove_watcher() i=4 2024-09-12T00:32:17.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.550+0000 7f0f9133d800 20 remove_watcher() i=5 2024-09-12T00:32:17.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.551+0000 7f0f9133d800 20 remove_watcher() i=6 2024-09-12T00:32:17.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.553+0000 7f0f9133d800 20 remove_watcher() i=7 2024-09-12T00:32:17.563 INFO:tasks.workunit.client.0.smithi083.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 65, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:32:17.563 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:32:17.563 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:17.564 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:32:17.597 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:17.597 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:17.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.635+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.637+0000 7f88b9535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.637+0000 7f88b9535800 20 realm 2024-09-12T00:32:17.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.637+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.637+0000 7f88b9535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.637+0000 7f88b9535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:17.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.637+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.637+0000 7f88b9535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.637+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.638+0000 7f88b9535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:17.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.638+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.638+0000 7f88b9535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:17.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.638+0000 7f88b9535800 20 searching for the correct realm 2024-09-12T00:32:17.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.642+0000 7f88affff640 0 -- 172.21.15.83:0/1962520362 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f88a0083450 msgr2=0x7f88a00838b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:17.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.645+0000 7f88b52e4640 0 -- 172.21.15.83:0/1962520362 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f88b0075ba0 msgr2=0x7f88b005f0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:17.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.648+0000 7f88b9535800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:17.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.648+0000 7f88b9535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:17.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.648+0000 7f88b9535800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.648+0000 7f88b9535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.648+0000 7f88b9535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.648+0000 7f88b9535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.648+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 zone default found 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 4 Realm: () 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:17.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 zonegroup default 2024-09-12T00:32:17.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.649+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.650+0000 7f88b9535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.650+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.650+0000 7f88b9535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:17.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.650+0000 7f88b9535800 20 started sync module instance, tier type = 2024-09-12T00:32:17.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.650+0000 7f88b9535800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:17.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.666+0000 7f88b9535800 20 add_watcher() i=0 2024-09-12T00:32:17.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.666+0000 7f88b9535800 20 add_watcher() i=1 2024-09-12T00:32:17.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.666+0000 7f88b9535800 20 add_watcher() i=2 2024-09-12T00:32:17.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.666+0000 7f88b9535800 20 add_watcher() i=3 2024-09-12T00:32:17.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.666+0000 7f88b9535800 20 add_watcher() i=4 2024-09-12T00:32:17.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.666+0000 7f88b9535800 20 add_watcher() i=5 2024-09-12T00:32:17.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.666+0000 7f88b9535800 20 add_watcher() i=6 2024-09-12T00:32:17.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.669+0000 7f88b9535800 20 add_watcher() i=7 2024-09-12T00:32:17.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.669+0000 7f88b9535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.670+0000 7f876b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.671+0000 7f88b9535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.671+0000 7f88b9535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.671+0000 7f88b9535800 5 note: GC not initialized 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.671+0000 7f876a7e4640 20 reqs_thread_entry: start 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.671+0000 7f88b9535800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.671+0000 7f88b9535800 20 Filter name: none 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.671+0000 7f86dbfff640 20 reqs_thread_entry: start 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.671+0000 7f88b9535800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:17.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.671+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:17.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 20 rados->read ofs=0 len=0 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:17.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.672+0000 7f88b9535800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:17.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.673+0000 7f88b9535800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:32:17.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.673+0000 7f88b9535800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:32:17.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.674+0000 7f876b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:17.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.676+0000 7f88b9535800 20 remove_watcher() i=0 2024-09-12T00:32:17.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.676+0000 7f88b9535800 2 removed watcher, disabling cache 2024-09-12T00:32:17.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.677+0000 7f88b9535800 20 remove_watcher() i=1 2024-09-12T00:32:17.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.678+0000 7f88b9535800 20 remove_watcher() i=2 2024-09-12T00:32:17.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.679+0000 7f88b9535800 20 remove_watcher() i=3 2024-09-12T00:32:17.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.680+0000 7f88b9535800 20 remove_watcher() i=4 2024-09-12T00:32:17.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.681+0000 7f88b9535800 20 remove_watcher() i=5 2024-09-12T00:32:17.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.682+0000 7f88b9535800 20 remove_watcher() i=6 2024-09-12T00:32:17.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:17.683+0000 7f88b9535800 20 remove_watcher() i=7 2024-09-12T00:32:17.695 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:32:18.086 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:32:19.479 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:19.479 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:19.533 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:32:19.535 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:32:19.571 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:19.572 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:19.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.613+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.615+0000 7f3814a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:19.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.615+0000 7f3814a2f800 20 realm 2024-09-12T00:32:19.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.615+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.615+0000 7f3814a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:19.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.615+0000 7f3814a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:19.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.615+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.616+0000 7f3814a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:19.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.616+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.616+0000 7f3814a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:19.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.616+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.617+0000 7f3814a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:19.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.617+0000 7f3814a2f800 20 searching for the correct realm 2024-09-12T00:32:19.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.620+0000 7f380bfff640 0 -- 172.21.15.83:0/992137365 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f37fc02e070 msgr2=0x7f37fc06e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:19.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.826+0000 7f3812d1a640 0 -- 172.21.15.83:0/992137365 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x563620889230 msgr2=0x56362088b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.831+0000 7f3814a2f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.831+0000 7f3814a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.831+0000 7f3814a2f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.831+0000 7f3814a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.831+0000 7f3814a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.831+0000 7f3814a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.831+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.831+0000 7f3814a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:19.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.831+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 20 zone default found 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 4 Realm: () 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 20 zonegroup default 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:19.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.832+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.833+0000 7f3814a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:19.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.833+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.833+0000 7f3814a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:19.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.833+0000 7f3814a2f800 20 started sync module instance, tier type = 2024-09-12T00:32:19.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.833+0000 7f3814a2f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:19.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.845+0000 7f3814a2f800 20 add_watcher() i=0 2024-09-12T00:32:19.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.845+0000 7f3814a2f800 20 add_watcher() i=1 2024-09-12T00:32:19.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.845+0000 7f3814a2f800 20 add_watcher() i=2 2024-09-12T00:32:19.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.845+0000 7f3814a2f800 20 add_watcher() i=3 2024-09-12T00:32:19.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.845+0000 7f3814a2f800 20 add_watcher() i=4 2024-09-12T00:32:19.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.845+0000 7f3814a2f800 20 add_watcher() i=5 2024-09-12T00:32:19.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.845+0000 7f3814a2f800 20 add_watcher() i=6 2024-09-12T00:32:19.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.846+0000 7f3814a2f800 20 add_watcher() i=7 2024-09-12T00:32:19.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.846+0000 7f3814a2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:19.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.849+0000 7f36c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:19.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.849+0000 7f3814a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:19.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.849+0000 7f3814a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:19.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.849+0000 7f3814a2f800 5 note: GC not initialized 2024-09-12T00:32:19.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.849+0000 7f36437fe640 20 reqs_thread_entry: start 2024-09-12T00:32:19.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.849+0000 7f3814a2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:19.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.849+0000 7f3814a2f800 20 Filter name: none 2024-09-12T00:32:19.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.850+0000 7f36417fa640 20 reqs_thread_entry: start 2024-09-12T00:32:19.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.850+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.850+0000 7f3814a2f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:19.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.850+0000 7f3814a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:19.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.851+0000 7f3814a2f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:19.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.851+0000 7f3814a2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:19.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.851+0000 7f3814a2f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:19.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.851+0000 7f3814a2f800 20 INFO: main: starting shard=0 2024-09-12T00:32:19.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.851+0000 7f3814a2f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:19.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.851+0000 7f3814a2f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:32:19.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.851+0000 7f3814a2f800 20 INFO: main: done 2024-09-12T00:32:19.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.852+0000 7f36c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.855+0000 7f3814a2f800 20 remove_watcher() i=0 2024-09-12T00:32:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.855+0000 7f3814a2f800 2 removed watcher, disabling cache 2024-09-12T00:32:19.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.857+0000 7f3814a2f800 20 remove_watcher() i=1 2024-09-12T00:32:19.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.858+0000 7f3814a2f800 20 remove_watcher() i=2 2024-09-12T00:32:19.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.859+0000 7f3814a2f800 20 remove_watcher() i=3 2024-09-12T00:32:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.860+0000 7f3814a2f800 20 remove_watcher() i=4 2024-09-12T00:32:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.861+0000 7f3814a2f800 20 remove_watcher() i=5 2024-09-12T00:32:19.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.862+0000 7f3814a2f800 20 remove_watcher() i=6 2024-09-12T00:32:19.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:19.863+0000 7f3814a2f800 20 remove_watcher() i=7 2024-09-12T00:32:19.876 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:19.876 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:19.880 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:19.880 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:19.883 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:19.883 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:19.938 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:32:19.939 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:32:19.971 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:19.971 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:20.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.007+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.010+0000 7f2cbe613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.010+0000 7f2cbe613800 20 realm 2024-09-12T00:32:20.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.010+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.010+0000 7f2cbe613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.010+0000 7f2cbe613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:20.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.010+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.010+0000 7f2cbe613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.010+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.011+0000 7f2cbe613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:20.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.011+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.011+0000 7f2cbe613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:20.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.011+0000 7f2cbe613800 20 searching for the correct realm 2024-09-12T00:32:20.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.014+0000 7f2cb3fff640 0 -- 172.21.15.83:0/918548113 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f2ca40688b0 msgr2=0x7f2ca4069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:20.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.219+0000 7f2cba523640 0 -- 172.21.15.83:0/918548113 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55a9ad576700 msgr2=0x55a9ad578af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:20.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.223+0000 7f2cbe613800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:20.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.223+0000 7f2cbe613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:20.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.223+0000 7f2cbe613800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:20.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.223+0000 7f2cbe613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:20.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.223+0000 7f2cbe613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:20.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.223+0000 7f2cbe613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:20.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.223+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:20.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:20.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 20 zone default found 2024-09-12T00:32:20.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 4 Realm: () 2024-09-12T00:32:20.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:20.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:20.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:20.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 20 zonegroup default 2024-09-12T00:32:20.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.224+0000 7f2cbe613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.225+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.225+0000 7f2cbe613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.225+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.225+0000 7f2cbe613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.225+0000 7f2cbe613800 20 started sync module instance, tier type = 2024-09-12T00:32:20.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.225+0000 7f2cbe613800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:20.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.240+0000 7f2cbe613800 20 add_watcher() i=0 2024-09-12T00:32:20.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.240+0000 7f2cbe613800 20 add_watcher() i=1 2024-09-12T00:32:20.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.240+0000 7f2cbe613800 20 add_watcher() i=2 2024-09-12T00:32:20.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.240+0000 7f2cbe613800 20 add_watcher() i=3 2024-09-12T00:32:20.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.240+0000 7f2cbe613800 20 add_watcher() i=4 2024-09-12T00:32:20.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.240+0000 7f2cbe613800 20 add_watcher() i=5 2024-09-12T00:32:20.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.240+0000 7f2cbe613800 20 add_watcher() i=6 2024-09-12T00:32:20.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.241+0000 7f2cbe613800 20 add_watcher() i=7 2024-09-12T00:32:20.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.241+0000 7f2cbe613800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.243+0000 7f2b6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.243+0000 7f2cbe613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.243+0000 7f2cbe613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.243+0000 7f2cbe613800 5 note: GC not initialized 2024-09-12T00:32:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.243+0000 7f2b6a7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.243+0000 7f2cbe613800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.243+0000 7f2cbe613800 20 Filter name: none 2024-09-12T00:32:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.243+0000 7f2adffff640 20 reqs_thread_entry: start 2024-09-12T00:32:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.243+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.244+0000 7f2cbe613800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:20.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.244+0000 7f2cbe613800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.244+0000 7f2cbe613800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:20.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.244+0000 7f2cbe613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:20.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.244+0000 7f2cbe613800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:20.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.244+0000 7f2cbe613800 20 INFO: main: starting shard=0 2024-09-12T00:32:20.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.244+0000 7f2cbe613800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:20.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.245+0000 7f2cbe613800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:32:20.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.245+0000 7f2cbe613800 20 INFO: main: done 2024-09-12T00:32:20.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.246+0000 7f2b6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:20.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.248+0000 7f2cbe613800 20 remove_watcher() i=0 2024-09-12T00:32:20.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.248+0000 7f2cbe613800 2 removed watcher, disabling cache 2024-09-12T00:32:20.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.249+0000 7f2cbe613800 20 remove_watcher() i=1 2024-09-12T00:32:20.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.250+0000 7f2cbe613800 20 remove_watcher() i=2 2024-09-12T00:32:20.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.251+0000 7f2cbe613800 20 remove_watcher() i=3 2024-09-12T00:32:20.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.252+0000 7f2cbe613800 20 remove_watcher() i=4 2024-09-12T00:32:20.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.253+0000 7f2cbe613800 20 remove_watcher() i=5 2024-09-12T00:32:20.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.255+0000 7f2cbe613800 20 remove_watcher() i=6 2024-09-12T00:32:20.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.257+0000 7f2cbe613800 20 remove_watcher() i=7 2024-09-12T00:32:20.267 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:20.267 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:20.271 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:20.271 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:20.334 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:32:20.335 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:32:20.365 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:20.365 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:20.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.402+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.404+0000 7f23e8546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.404+0000 7f23e8546800 20 realm 2024-09-12T00:32:20.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.404+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.404+0000 7f23e8546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.404+0000 7f23e8546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:20.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.404+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.405+0000 7f23e8546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.405+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.405+0000 7f23e8546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:20.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.405+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.406+0000 7f23e8546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:20.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.406+0000 7f23e8546800 20 searching for the correct realm 2024-09-12T00:32:20.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.409+0000 7f23e6838640 0 -- 172.21.15.83:0/453278340 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f23d005fec0 msgr2=0x7f23d005f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:20.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.412+0000 7f23e6037640 0 -- 172.21.15.83:0/453278340 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f23e0076030 msgr2=0x7f23e00a8030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:20.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.416+0000 7f23e8546800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:20.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.416+0000 7f23e8546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.416+0000 7f23e8546800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.416+0000 7f23e8546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.416+0000 7f23e8546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.416+0000 7f23e8546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.416+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:20.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 20 zone default found 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 4 Realm: () 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 20 zonegroup default 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.417+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.418+0000 7f23e8546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.418+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.418+0000 7f23e8546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.418+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.418+0000 7f23e8546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.418+0000 7f23e8546800 20 started sync module instance, tier type = 2024-09-12T00:32:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.418+0000 7f23e8546800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:20.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.432+0000 7f23e8546800 20 add_watcher() i=0 2024-09-12T00:32:20.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.432+0000 7f23e8546800 20 add_watcher() i=1 2024-09-12T00:32:20.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.432+0000 7f23e8546800 20 add_watcher() i=2 2024-09-12T00:32:20.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.432+0000 7f23e8546800 20 add_watcher() i=3 2024-09-12T00:32:20.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.432+0000 7f23e8546800 20 add_watcher() i=4 2024-09-12T00:32:20.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.432+0000 7f23e8546800 20 add_watcher() i=5 2024-09-12T00:32:20.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.435+0000 7f23e8546800 20 add_watcher() i=6 2024-09-12T00:32:20.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.435+0000 7f23e8546800 20 add_watcher() i=7 2024-09-12T00:32:20.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.435+0000 7f23e8546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.437+0000 7f229cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.437+0000 7f23e8546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.437+0000 7f23e8546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.437+0000 7f23e8546800 5 note: GC not initialized 2024-09-12T00:32:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.437+0000 7f22177fe640 20 reqs_thread_entry: start 2024-09-12T00:32:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.437+0000 7f23e8546800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.437+0000 7f23e8546800 20 Filter name: none 2024-09-12T00:32:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.437+0000 7f22157fa640 20 reqs_thread_entry: start 2024-09-12T00:32:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.437+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.438+0000 7f23e8546800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:20.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.438+0000 7f23e8546800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.438+0000 7f23e8546800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:20.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.438+0000 7f23e8546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:20.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.438+0000 7f23e8546800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:20.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.438+0000 7f23e8546800 20 INFO: main: starting shard=0 2024-09-12T00:32:20.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.438+0000 7f23e8546800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:20.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.439+0000 7f23e8546800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:32:20.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.439+0000 7f23e8546800 20 INFO: main: done 2024-09-12T00:32:20.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.440+0000 7f229cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:20.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.442+0000 7f23e8546800 20 remove_watcher() i=0 2024-09-12T00:32:20.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.442+0000 7f23e8546800 2 removed watcher, disabling cache 2024-09-12T00:32:20.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.443+0000 7f23e8546800 20 remove_watcher() i=1 2024-09-12T00:32:20.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.444+0000 7f23e8546800 20 remove_watcher() i=2 2024-09-12T00:32:20.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.445+0000 7f23e8546800 20 remove_watcher() i=3 2024-09-12T00:32:20.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.446+0000 7f23e8546800 20 remove_watcher() i=4 2024-09-12T00:32:20.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.447+0000 7f23e8546800 20 remove_watcher() i=5 2024-09-12T00:32:20.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.448+0000 7f23e8546800 20 remove_watcher() i=6 2024-09-12T00:32:20.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.449+0000 7f23e8546800 20 remove_watcher() i=7 2024-09-12T00:32:20.462 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:20.462 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:20.465 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:20.465 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:20.526 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:32:20.527 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:32:20.560 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:20.560 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:20.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.596+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.598+0000 7f2383698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.598+0000 7f2383698800 20 realm 2024-09-12T00:32:20.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.598+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.598+0000 7f2383698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.598+0000 7f2383698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.598+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.598+0000 7f2383698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.598+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.599+0000 7f2383698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.599+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.600+0000 7f2383698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:20.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.600+0000 7f2383698800 20 searching for the correct realm 2024-09-12T00:32:20.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.603+0000 7f237bfff640 0 -- 172.21.15.83:0/1394775261 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f236c08d170 msgr2=0x7f236c0890c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:20.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.606+0000 7f2381182640 0 -- 172.21.15.83:0/1394775261 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f237c055b70 msgr2=0x7f237c07c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.610+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 zone default found 2024-09-12T00:32:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 4 Realm: () 2024-09-12T00:32:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 zonegroup default 2024-09-12T00:32:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:20.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 started sync module instance, tier type = 2024-09-12T00:32:20.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.611+0000 7f2383698800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.622+0000 7f2383698800 20 add_watcher() i=0 2024-09-12T00:32:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.622+0000 7f2383698800 20 add_watcher() i=1 2024-09-12T00:32:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.622+0000 7f2383698800 20 add_watcher() i=2 2024-09-12T00:32:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.622+0000 7f2383698800 20 add_watcher() i=3 2024-09-12T00:32:20.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.622+0000 7f2383698800 20 add_watcher() i=4 2024-09-12T00:32:20.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.622+0000 7f2383698800 20 add_watcher() i=5 2024-09-12T00:32:20.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.622+0000 7f2383698800 20 add_watcher() i=6 2024-09-12T00:32:20.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.623+0000 7f2383698800 20 add_watcher() i=7 2024-09-12T00:32:20.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.623+0000 7f2383698800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:20.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.625+0000 7f22377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:20.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.625+0000 7f2383698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:20.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.625+0000 7f2383698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:20.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.625+0000 7f2383698800 5 note: GC not initialized 2024-09-12T00:32:20.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.626+0000 7f22367e4640 20 reqs_thread_entry: start 2024-09-12T00:32:20.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.626+0000 7f2383698800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.626+0000 7f2383698800 20 Filter name: none 2024-09-12T00:32:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.626+0000 7f21a7fff640 20 reqs_thread_entry: start 2024-09-12T00:32:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.626+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.626+0000 7f2383698800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.626+0000 7f2383698800 20 rados->read ofs=0 len=0 2024-09-12T00:32:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.627+0000 7f2383698800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.627+0000 7f2383698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.627+0000 7f2383698800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.627+0000 7f2383698800 20 INFO: main: starting shard=0 2024-09-12T00:32:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.627+0000 7f2383698800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.627+0000 7f2383698800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:32:20.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.627+0000 7f2383698800 20 INFO: main: done 2024-09-12T00:32:20.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.628+0000 7f22377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.630+0000 7f2383698800 20 remove_watcher() i=0 2024-09-12T00:32:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.630+0000 7f2383698800 2 removed watcher, disabling cache 2024-09-12T00:32:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.631+0000 7f2383698800 20 remove_watcher() i=1 2024-09-12T00:32:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.632+0000 7f2383698800 20 remove_watcher() i=2 2024-09-12T00:32:20.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.633+0000 7f2383698800 20 remove_watcher() i=3 2024-09-12T00:32:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.635+0000 7f2383698800 20 remove_watcher() i=4 2024-09-12T00:32:20.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.636+0000 7f2383698800 20 remove_watcher() i=5 2024-09-12T00:32:20.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.636+0000 7f2383698800 20 remove_watcher() i=6 2024-09-12T00:32:20.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:20.637+0000 7f2383698800 20 remove_watcher() i=7 2024-09-12T00:32:20.649 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:20.650 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:20.654 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:32:21.042 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:32:21.434 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:32:21.434 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:21.435 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:32:21.468 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:21.468 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:21.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.505+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.507+0000 7fb781c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.507+0000 7fb781c40800 20 realm 2024-09-12T00:32:21.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.507+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.507+0000 7fb781c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.507+0000 7fb781c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:21.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.507+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.508+0000 7fb781c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.508+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.508+0000 7fb781c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:21.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.508+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.509+0000 7fb781c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:21.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.509+0000 7fb781c40800 20 searching for the correct realm 2024-09-12T00:32:21.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.512+0000 7fb77ef29640 0 -- 172.21.15.83:0/1048330173 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fb774008410 msgr2=0x7fb774008890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:21.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.516+0000 7fb77f72a640 0 -- 172.21.15.83:0/1048330173 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fb778017040 msgr2=0x7fb778049f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:21.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:21.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:21.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:21.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:21.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:21.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:21.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.520+0000 7fb781c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 20 zone default found 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 4 Realm: () 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 20 zonegroup default 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.521+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.522+0000 7fb781c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.522+0000 7fb781c40800 20 started sync module instance, tier type = 2024-09-12T00:32:21.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.522+0000 7fb781c40800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:21.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.532+0000 7fb781c40800 20 add_watcher() i=0 2024-09-12T00:32:21.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.532+0000 7fb781c40800 20 add_watcher() i=1 2024-09-12T00:32:21.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.532+0000 7fb781c40800 20 add_watcher() i=2 2024-09-12T00:32:21.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.532+0000 7fb781c40800 20 add_watcher() i=3 2024-09-12T00:32:21.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.532+0000 7fb781c40800 20 add_watcher() i=4 2024-09-12T00:32:21.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.532+0000 7fb781c40800 20 add_watcher() i=5 2024-09-12T00:32:21.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.532+0000 7fb781c40800 20 add_watcher() i=6 2024-09-12T00:32:21.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.534+0000 7fb781c40800 20 add_watcher() i=7 2024-09-12T00:32:21.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.534+0000 7fb781c40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:21.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.535+0000 7fb635fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:21.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.535+0000 7fb781c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:21.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.535+0000 7fb781c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:21.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.535+0000 7fb781c40800 5 note: GC not initialized 2024-09-12T00:32:21.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb634fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb781c40800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb781c40800 20 Filter name: none 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb5ae7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb781c40800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb781c40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb781c40800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb781c40800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb781c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.536+0000 7fb781c40800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.537+0000 7fb781c40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.537+0000 7fb781c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.537+0000 7fb781c40800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.537+0000 7fb781c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:21.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.537+0000 7fb781c40800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:21.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.537+0000 7fb781c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:21.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.537+0000 7fb781c40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.539+0000 7fb781c40800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T00:32:21.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.539+0000 7fb781c40800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:32:21.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.540+0000 7fb635fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:21.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.542+0000 7fb781c40800 20 remove_watcher() i=0 2024-09-12T00:32:21.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.542+0000 7fb781c40800 2 removed watcher, disabling cache 2024-09-12T00:32:21.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.543+0000 7fb781c40800 20 remove_watcher() i=1 2024-09-12T00:32:21.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.544+0000 7fb781c40800 20 remove_watcher() i=2 2024-09-12T00:32:21.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.545+0000 7fb781c40800 20 remove_watcher() i=3 2024-09-12T00:32:21.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.546+0000 7fb781c40800 20 remove_watcher() i=4 2024-09-12T00:32:21.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.547+0000 7fb781c40800 20 remove_watcher() i=5 2024-09-12T00:32:21.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.549+0000 7fb781c40800 20 remove_watcher() i=6 2024-09-12T00:32:21.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.550+0000 7fb781c40800 20 remove_watcher() i=7 2024-09-12T00:32:21.560 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: unlinked entries are not listable 2024-09-12T00:32:21.560 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:21.562 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.563 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.567 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:32:21.567 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:21.570 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.570 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.614 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.614 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.656 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:32:21.656 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:21.658 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:32:21.692 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:21.692 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:21.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.730+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.731+0000 7fc6a2735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.731+0000 7fc6a2735800 20 realm 2024-09-12T00:32:21.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.731+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.731+0000 7fc6a2735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.731+0000 7fc6a2735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:21.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.731+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.731+0000 7fc6a2735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.731+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.732+0000 7fc6a2735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:21.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.732+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.733+0000 7fc6a2735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:21.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.733+0000 7fc6a2735800 20 searching for the correct realm 2024-09-12T00:32:21.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.736+0000 7fc69ec7e640 0 -- 172.21.15.83:0/4055035147 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7fc6880cf020 msgr2=0x7fc68806e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:21.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.739+0000 7fc69e47d640 0 -- 172.21.15.83:0/4055035147 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fc698017070 msgr2=0x7fc69800c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:21.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:21.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:21.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:21.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:21.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:21.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:21.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:21.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.743+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:21.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 zone default found 2024-09-12T00:32:21.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 4 Realm: () 2024-09-12T00:32:21.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:21.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 zonegroup default 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.744+0000 7fc6a2735800 20 started sync module instance, tier type = 2024-09-12T00:32:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.745+0000 7fc6a2735800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:21.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.754+0000 7fc6a2735800 20 add_watcher() i=0 2024-09-12T00:32:21.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.754+0000 7fc6a2735800 20 add_watcher() i=1 2024-09-12T00:32:21.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.754+0000 7fc6a2735800 20 add_watcher() i=2 2024-09-12T00:32:21.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.754+0000 7fc6a2735800 20 add_watcher() i=3 2024-09-12T00:32:21.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.754+0000 7fc6a2735800 20 add_watcher() i=4 2024-09-12T00:32:21.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.754+0000 7fc6a2735800 20 add_watcher() i=5 2024-09-12T00:32:21.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.754+0000 7fc6a2735800 20 add_watcher() i=6 2024-09-12T00:32:21.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.756+0000 7fc6a2735800 20 add_watcher() i=7 2024-09-12T00:32:21.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.756+0000 7fc6a2735800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:21.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.757+0000 7fc554fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:21.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.757+0000 7fc6a2735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:21.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.757+0000 7fc6a2735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:21.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.757+0000 7fc6a2735800 5 note: GC not initialized 2024-09-12T00:32:21.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.757+0000 7fc4cf7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:21.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc6a2735800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:21.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc6a2735800 20 Filter name: none 2024-09-12T00:32:21.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc4cd7fa640 20 reqs_thread_entry: start 2024-09-12T00:32:21.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc6a2735800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:21.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc6a2735800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:21.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc6a2735800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:21.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc6a2735800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:21.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc6a2735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.758+0000 7fc6a2735800 20 rados->read ofs=0 len=0 2024-09-12T00:32:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.759+0000 7fc6a2735800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.759+0000 7fc6a2735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.759+0000 7fc6a2735800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.759+0000 7fc6a2735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.759+0000 7fc6a2735800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.759+0000 7fc6a2735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.759+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.760+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.760+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:c state=0x55758df552a8 s->prefetch_data=0 2024-09-12T00:32:21.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.760+0000 7fc6a2735800 20 get_obj_state: setting s->obj_tag to s0u0cw3b9ywe0v2zgqzuiy8s5t6kvq8u 2024-09-12T00:32:21.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.760+0000 7fc6a2735800 20 get_obj_state_impl: setting s->olh_tag to u2qqt4vqjzuo50l4ew89ez546e84fprg 2024-09-12T00:32:21.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.760+0000 7fc6a2735800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u2qqt4vqjzuo50l4ew89ez546e84fprg 2024-09-12T00:32:21.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.762+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.763+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.764+0000 7fc6a2735800 20 olh_log_entry: epoch=3 op=3 key=c[yeJuShbgOUqb6HT9fycFJP0wlS7fiOx] 2024-09-12T00:32:21.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.764+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:_:yeJuShbgOUqb6HT9fycFJP0wlS7fiOx_c state=0x55758df90d68 s->prefetch_data=0 2024-09-12T00:32:21.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.764+0000 7fc6a2735800 10 manifest: total_size = 22 2024-09-12T00:32:21.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.764+0000 7fc6a2735800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.4830747127950271562 2024-09-12T00:32:21.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.764+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:_:yeJuShbgOUqb6HT9fycFJP0wlS7fiOx_c state=0x55758df90d68 s->prefetch_data=0 2024-09-12T00:32:21.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.764+0000 7fc6a2735800 20 prepare_atomic_modification: state is not atomic. state=0x55758df90d68 2024-09-12T00:32:21.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.764+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.768+0000 7fc6a2735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:21.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.768+0000 7fc6a2735800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:32:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.768+0000 7fc6a2735800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:32:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.768+0000 7fc6a2735800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.2__shadow:yeJuShbgOUqb6HT9fycFJP0wlS7fiOx_.d1X__drFXh0L-dxJVXn2iVLv61q5Vev_0 2024-09-12T00:32:21.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.774+0000 7fc6a2735800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:32:21.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.774+0000 7fc5817fa640 20 handle_completion(): completion ok for obj=c[yeJuShbgOUqb6HT9fycFJP0wlS7fiOx] 2024-09-12T00:32:21.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.775+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.775+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.776+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.776+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.777+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:d state=0x55758df53fb8 s->prefetch_data=0 2024-09-12T00:32:21.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.777+0000 7fc6a2735800 20 get_obj_state: setting s->obj_tag to l4ganzb9zj4jcwft39wdlx3o5lwz66di 2024-09-12T00:32:21.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.777+0000 7fc6a2735800 20 get_obj_state_impl: setting s->olh_tag to y68yrad02e801b0ldytthzwsjk5d8qz5 2024-09-12T00:32:21.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.777+0000 7fc6a2735800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y68yrad02e801b0ldytthzwsjk5d8qz5 2024-09-12T00:32:21.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.780+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.785+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.785+0000 7fc6a2735800 20 olh_log_entry: epoch=3 op=3 key=d[XaiBlq3OkBX0SELSnwmKRf9EyouaxN.] 2024-09-12T00:32:21.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.785+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:_:XaiBlq3OkBX0SELSnwmKRf9EyouaxN._d state=0x55758df90d68 s->prefetch_data=0 2024-09-12T00:32:21.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.785+0000 7fc6a2735800 10 manifest: total_size = 22 2024-09-12T00:32:21.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.785+0000 7fc6a2735800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.8266099054418823228 2024-09-12T00:32:21.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.786+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:_:XaiBlq3OkBX0SELSnwmKRf9EyouaxN._d state=0x55758df90d68 s->prefetch_data=0 2024-09-12T00:32:21.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.786+0000 7fc6a2735800 20 prepare_atomic_modification: state is not atomic. state=0x55758df90d68 2024-09-12T00:32:21.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.786+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.789+0000 7fc6a2735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:21.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.789+0000 7fc6a2735800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:32:21.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.789+0000 7fc6a2735800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:32:21.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.789+0000 7fc6a2735800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.2__shadow:XaiBlq3OkBX0SELSnwmKRf9EyouaxN._.yLMagk3FaoPyj8K-PfqauVlz5f_N_ho_0 2024-09-12T00:32:21.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.790+0000 7fc581ffb640 20 handle_completion(): completion ok for obj=d[XaiBlq3OkBX0SELSnwmKRf9EyouaxN.] 2024-09-12T00:32:21.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.794+0000 7fc6a2735800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:32:21.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.796+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.796+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.802+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.802+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.802+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:e state=0x55758df53fb8 s->prefetch_data=0 2024-09-12T00:32:21.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.802+0000 7fc6a2735800 20 get_obj_state: setting s->obj_tag to onehl20ds8qdnttbxp1p9x0fabf6e1sx 2024-09-12T00:32:21.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.802+0000 7fc6a2735800 20 get_obj_state_impl: setting s->olh_tag to pilonzusskpczrnce8p3b5jj0bvbbzjy 2024-09-12T00:32:21.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.802+0000 7fc6a2735800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pilonzusskpczrnce8p3b5jj0bvbbzjy 2024-09-12T00:32:21.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.804+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.805+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.805+0000 7fc6a2735800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:32:21.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.805+0000 7fc6a2735800 20 olh_log_entry: epoch=2 op=3 key=e[IVkchtpgmciCHMu7h5YZs0EDz8nhqbO] 2024-09-12T00:32:21.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.805+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:_:IVkchtpgmciCHMu7h5YZs0EDz8nhqbO_e state=0x55758df515a8 s->prefetch_data=0 2024-09-12T00:32:21.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.806+0000 7fc6a2735800 10 manifest: total_size = 12 2024-09-12T00:32:21.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.806+0000 7fc6a2735800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.13272780601524469401 2024-09-12T00:32:21.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.806+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:_:IVkchtpgmciCHMu7h5YZs0EDz8nhqbO_e state=0x55758df515a8 s->prefetch_data=0 2024-09-12T00:32:21.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.806+0000 7fc6a2735800 20 prepare_atomic_modification: state is not atomic. state=0x55758df515a8 2024-09-12T00:32:21.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.806+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.809+0000 7fc6a2735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:21.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.809+0000 7fc6a2735800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:32:21.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.809+0000 7fc6a2735800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:32:21.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.809+0000 7fc6a2735800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.2__shadow:IVkchtpgmciCHMu7h5YZs0EDz8nhqbO_.ToIY74v251gr_Y2Y2k9IXiu-XS8uxzo_0 2024-09-12T00:32:21.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.810+0000 7fc581ffb640 20 handle_completion(): completion ok for obj=e[IVkchtpgmciCHMu7h5YZs0EDz8nhqbO] 2024-09-12T00:32:21.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.812+0000 7fc6a2735800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:32:21.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.814+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:e state=0x55758df53fb8 s->prefetch_data=0 2024-09-12T00:32:21.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.814+0000 7fc6a2735800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pilonzusskpczrnce8p3b5jj0bvbbzjy 2024-09-12T00:32:21.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.825+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.826+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.826+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.827+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:f state=0x55758df8fd58 s->prefetch_data=0 2024-09-12T00:32:21.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.827+0000 7fc6a2735800 20 get_obj_state: setting s->obj_tag to s822ks6ml1j8epkoffaq24w5r5t9oyfv 2024-09-12T00:32:21.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.827+0000 7fc6a2735800 20 get_obj_state_impl: setting s->olh_tag to yhlmugfium9fjz2jw2eb57d2znvloz6e 2024-09-12T00:32:21.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.827+0000 7fc6a2735800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yhlmugfium9fjz2jw2eb57d2znvloz6e 2024-09-12T00:32:21.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.833+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.834+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.834+0000 7fc6a2735800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:32:21.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.834+0000 7fc6a2735800 20 olh_log_entry: epoch=2 op=3 key=f[wtXAFbvOIrWcP0wz9HouNdFXvaTlFhE] 2024-09-12T00:32:21.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.834+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:_:wtXAFbvOIrWcP0wz9HouNdFXvaTlFhE_f state=0x55758df525b8 s->prefetch_data=0 2024-09-12T00:32:21.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.835+0000 7fc6a2735800 10 manifest: total_size = 9 2024-09-12T00:32:21.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.835+0000 7fc6a2735800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.16150759604490037102 2024-09-12T00:32:21.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.835+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:_:wtXAFbvOIrWcP0wz9HouNdFXvaTlFhE_f state=0x55758df525b8 s->prefetch_data=0 2024-09-12T00:32:21.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.835+0000 7fc6a2735800 20 prepare_atomic_modification: state is not atomic. state=0x55758df525b8 2024-09-12T00:32:21.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.835+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.839+0000 7fc6a2735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:21.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.839+0000 7fc6a2735800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:32:21.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.839+0000 7fc6a2735800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:32:21.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.839+0000 7fc6a2735800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.2__shadow:wtXAFbvOIrWcP0wz9HouNdFXvaTlFhE_.uaKWySfnafn26JObc9jaXmHTGEahGSN_0 2024-09-12T00:32:21.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.845+0000 7fc581ffb640 20 handle_completion(): completion ok for obj=f[wtXAFbvOIrWcP0wz9HouNdFXvaTlFhE] 2024-09-12T00:32:21.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.845+0000 7fc6a2735800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:32:21.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.848+0000 7fc6a2735800 20 get_obj_state: octx=0x55758dcb5bf0 obj=check-bucket:f state=0x55758df8fd58 s->prefetch_data=0 2024-09-12T00:32:21.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.848+0000 7fc6a2735800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yhlmugfium9fjz2jw2eb57d2znvloz6e 2024-09-12T00:32:21.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.857+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.859+0000 7fc6a2735800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:21.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.859+0000 7fc6a2735800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:32:21.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.859+0000 7fc6a2735800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:32:21.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.860+0000 7fc554fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:21.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.862+0000 7fc6a2735800 20 remove_watcher() i=0 2024-09-12T00:32:21.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.862+0000 7fc6a2735800 2 removed watcher, disabling cache 2024-09-12T00:32:21.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.863+0000 7fc6a2735800 20 remove_watcher() i=1 2024-09-12T00:32:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.865+0000 7fc6a2735800 20 remove_watcher() i=2 2024-09-12T00:32:21.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.866+0000 7fc6a2735800 20 remove_watcher() i=3 2024-09-12T00:32:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.867+0000 7fc6a2735800 20 remove_watcher() i=4 2024-09-12T00:32:21.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.868+0000 7fc6a2735800 20 remove_watcher() i=5 2024-09-12T00:32:21.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.869+0000 7fc6a2735800 20 remove_watcher() i=6 2024-09-12T00:32:21.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:21.870+0000 7fc6a2735800 20 remove_watcher() i=7 2024-09-12T00:32:21.882 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.882 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.885 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.885 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.888 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.888 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.890 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.890 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.891 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:32:21.891 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:21.892 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.892 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.937 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.937 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.939 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.940 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.942 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.942 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.945 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:21.945 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:21.946 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:32:21.947 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:21.948 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:32:21.982 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:21.982 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:22.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.021+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.023+0000 7ff20b340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.023+0000 7ff20b340800 20 realm 2024-09-12T00:32:22.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.023+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.023+0000 7ff20b340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.023+0000 7ff20b340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:22.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.023+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.023+0000 7ff20b340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.023+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.024+0000 7ff20b340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:22.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.024+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.024+0000 7ff20b340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:22.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.024+0000 7ff20b340800 20 searching for the correct realm 2024-09-12T00:32:22.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.026+0000 7ff2070c0640 0 -- 172.21.15.83:0/3888081503 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7ff1f80e22d0 msgr2=0x7ff1f80c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:22.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.231+0000 7ff2070c0640 0 -- 172.21.15.83:0/3888081503 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff20001f060 msgr2=0x7ff20005f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:22.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:22.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.438+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 20 zone default found 2024-09-12T00:32:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 4 Realm: () 2024-09-12T00:32:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:22.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 20 zonegroup default 2024-09-12T00:32:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.439+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.440+0000 7ff20b340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.440+0000 7ff20b340800 20 started sync module instance, tier type = 2024-09-12T00:32:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.440+0000 7ff20b340800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:22.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.449+0000 7ff20b340800 20 add_watcher() i=0 2024-09-12T00:32:22.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.449+0000 7ff20b340800 20 add_watcher() i=1 2024-09-12T00:32:22.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.449+0000 7ff20b340800 20 add_watcher() i=2 2024-09-12T00:32:22.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.449+0000 7ff20b340800 20 add_watcher() i=3 2024-09-12T00:32:22.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.449+0000 7ff20b340800 20 add_watcher() i=4 2024-09-12T00:32:22.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.449+0000 7ff20b340800 20 add_watcher() i=5 2024-09-12T00:32:22.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.449+0000 7ff20b340800 20 add_watcher() i=6 2024-09-12T00:32:22.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.450+0000 7ff20b340800 20 add_watcher() i=7 2024-09-12T00:32:22.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.450+0000 7ff20b340800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:22.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.452+0000 7ff0bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:22.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.452+0000 7ff20b340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:22.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.452+0000 7ff20b340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:22.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.452+0000 7ff20b340800 5 note: GC not initialized 2024-09-12T00:32:22.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.452+0000 7ff0bcfe1640 20 reqs_thread_entry: start 2024-09-12T00:32:22.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.452+0000 7ff20b340800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:22.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.452+0000 7ff20b340800 20 Filter name: none 2024-09-12T00:32:22.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.453+0000 7ff0367fc640 20 reqs_thread_entry: start 2024-09-12T00:32:22.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.453+0000 7ff20b340800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:22.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.453+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.453+0000 7ff20b340800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:22.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.453+0000 7ff20b340800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:22.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.453+0000 7ff20b340800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:22.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.453+0000 7ff20b340800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:22.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.453+0000 7ff20b340800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.454+0000 7ff20b340800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.454+0000 7ff20b340800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.454+0000 7ff20b340800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.454+0000 7ff20b340800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.454+0000 7ff20b340800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.454+0000 7ff20b340800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.454+0000 7ff20b340800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.454+0000 7ff20b340800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.454+0000 7ff20b340800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:32:22.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.455+0000 7ff0bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:22.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.457+0000 7ff20b340800 20 remove_watcher() i=0 2024-09-12T00:32:22.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.457+0000 7ff20b340800 2 removed watcher, disabling cache 2024-09-12T00:32:22.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.458+0000 7ff20b340800 20 remove_watcher() i=1 2024-09-12T00:32:22.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.459+0000 7ff20b340800 20 remove_watcher() i=2 2024-09-12T00:32:22.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.460+0000 7ff20b340800 20 remove_watcher() i=3 2024-09-12T00:32:22.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.463+0000 7ff20b340800 20 remove_watcher() i=4 2024-09-12T00:32:22.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.464+0000 7ff20b340800 20 remove_watcher() i=5 2024-09-12T00:32:22.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.465+0000 7ff20b340800 20 remove_watcher() i=6 2024-09-12T00:32:22.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.466+0000 7ff20b340800 20 remove_watcher() i=7 2024-09-12T00:32:22.478 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:22.478 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:22.503 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:22.503 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:22.526 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:32:22.557 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:22.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.595+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.597+0000 7fd243b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.597+0000 7fd243b46800 20 realm 2024-09-12T00:32:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.597+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.597+0000 7fd243b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.597+0000 7fd243b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.597+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.597+0000 7fd243b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.597+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.598+0000 7fd243b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:22.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.598+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.598+0000 7fd243b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:22.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.598+0000 7fd243b46800 20 searching for the correct realm 2024-09-12T00:32:22.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.601+0000 7fd240e36640 0 -- 172.21.15.83:0/1002818109 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fd2380d2200 msgr2=0x7fd2380aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:22.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.807+0000 7fd241e38640 0 -- 172.21.15.83:0/1002818109 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x559f7967b6e0 msgr2=0x559f7967dba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:22.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.810+0000 7fd243b46800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:22.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.810+0000 7fd243b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:22.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.810+0000 7fd243b46800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:22.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.810+0000 7fd243b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:22.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.810+0000 7fd243b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:22.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.810+0000 7fd243b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.810+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.810+0000 7fd243b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.810+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 zone default found 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 4 Realm: () 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 zonegroup default 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.811+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.812+0000 7fd243b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.812+0000 7fd243b46800 20 started sync module instance, tier type = 2024-09-12T00:32:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.812+0000 7fd243b46800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:22.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.825+0000 7fd243b46800 20 add_watcher() i=0 2024-09-12T00:32:22.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.825+0000 7fd243b46800 20 add_watcher() i=1 2024-09-12T00:32:22.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.825+0000 7fd243b46800 20 add_watcher() i=2 2024-09-12T00:32:22.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.825+0000 7fd243b46800 20 add_watcher() i=3 2024-09-12T00:32:22.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.825+0000 7fd243b46800 20 add_watcher() i=4 2024-09-12T00:32:22.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.825+0000 7fd243b46800 20 add_watcher() i=5 2024-09-12T00:32:22.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.825+0000 7fd243b46800 20 add_watcher() i=6 2024-09-12T00:32:22.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.826+0000 7fd243b46800 20 add_watcher() i=7 2024-09-12T00:32:22.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.826+0000 7fd243b46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:22.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.828+0000 7fd0f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:22.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.828+0000 7fd243b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:22.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.828+0000 7fd243b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:22.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.828+0000 7fd243b46800 5 note: GC not initialized 2024-09-12T00:32:22.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.829+0000 7fd0f67e4640 20 reqs_thread_entry: start 2024-09-12T00:32:22.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.829+0000 7fd243b46800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:22.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.829+0000 7fd243b46800 20 Filter name: none 2024-09-12T00:32:22.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.829+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.829+0000 7fd067fff640 20 reqs_thread_entry: start 2024-09-12T00:32:22.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.829+0000 7fd243b46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:22.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.829+0000 7fd243b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.830+0000 7fd243b46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:22.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.830+0000 7fd243b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:22.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.830+0000 7fd243b46800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:22.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.830+0000 7fd243b46800 20 INFO: main: starting shard=0 2024-09-12T00:32:22.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.830+0000 7fd243b46800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:22.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.830+0000 7fd243b46800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:32:22.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.830+0000 7fd243b46800 20 INFO: main: done 2024-09-12T00:32:22.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.831+0000 7fd0f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:22.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.833+0000 7fd243b46800 20 remove_watcher() i=0 2024-09-12T00:32:22.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.833+0000 7fd243b46800 2 removed watcher, disabling cache 2024-09-12T00:32:22.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.834+0000 7fd243b46800 20 remove_watcher() i=1 2024-09-12T00:32:22.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.835+0000 7fd243b46800 20 remove_watcher() i=2 2024-09-12T00:32:22.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.836+0000 7fd243b46800 20 remove_watcher() i=3 2024-09-12T00:32:22.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.837+0000 7fd243b46800 20 remove_watcher() i=4 2024-09-12T00:32:22.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.838+0000 7fd243b46800 20 remove_watcher() i=5 2024-09-12T00:32:22.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.839+0000 7fd243b46800 20 remove_watcher() i=6 2024-09-12T00:32:22.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.840+0000 7fd243b46800 20 remove_watcher() i=7 2024-09-12T00:32:22.850 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:32:22.880 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:22.880 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:22.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.918+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.920+0000 7feafed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.920+0000 7feafed39800 20 realm 2024-09-12T00:32:22.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.920+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.921+0000 7feafed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.921+0000 7feafed39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:22.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.921+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.921+0000 7feafed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:22.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.921+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.921+0000 7feafed39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:22.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.921+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:22.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.922+0000 7feafed39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:22.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.922+0000 7feafed39800 20 searching for the correct realm 2024-09-12T00:32:22.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.924+0000 7feafa9c7640 0 -- 172.21.15.83:0/4127958836 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7feaec069c20 msgr2=0x7feaec061a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:22.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:22.927+0000 7feafa9c7640 0 -- 172.21.15.83:0/4127958836 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7feaf4022020 msgr2=0x7feaf4046950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:23.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.133+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 20 zone default found 2024-09-12T00:32:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 4 Realm: () 2024-09-12T00:32:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 20 zonegroup default 2024-09-12T00:32:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.134+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.135+0000 7feafed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.135+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.135+0000 7feafed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.135+0000 7feafed39800 20 started sync module instance, tier type = 2024-09-12T00:32:23.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.135+0000 7feafed39800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:23.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.143+0000 7feafed39800 20 add_watcher() i=0 2024-09-12T00:32:23.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.143+0000 7feafed39800 20 add_watcher() i=1 2024-09-12T00:32:23.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.143+0000 7feafed39800 20 add_watcher() i=2 2024-09-12T00:32:23.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.143+0000 7feafed39800 20 add_watcher() i=3 2024-09-12T00:32:23.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.143+0000 7feafed39800 20 add_watcher() i=4 2024-09-12T00:32:23.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.143+0000 7feafed39800 20 add_watcher() i=5 2024-09-12T00:32:23.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.144+0000 7feafed39800 20 add_watcher() i=6 2024-09-12T00:32:23.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.144+0000 7feafed39800 20 add_watcher() i=7 2024-09-12T00:32:23.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.144+0000 7feafed39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:23.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.146+0000 7fe9b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:23.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.147+0000 7feafed39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:23.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.147+0000 7feafed39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:23.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.147+0000 7feafed39800 5 note: GC not initialized 2024-09-12T00:32:23.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.147+0000 7fe92bfff640 20 reqs_thread_entry: start 2024-09-12T00:32:23.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.147+0000 7feafed39800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:23.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.147+0000 7feafed39800 20 Filter name: none 2024-09-12T00:32:23.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.147+0000 7fe929ffb640 20 reqs_thread_entry: start 2024-09-12T00:32:23.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.147+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.148+0000 7feafed39800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:23.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.148+0000 7feafed39800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.148+0000 7feafed39800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:23.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.148+0000 7feafed39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:23.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.148+0000 7feafed39800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:23.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.148+0000 7feafed39800 20 INFO: main: starting shard=0 2024-09-12T00:32:23.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.148+0000 7feafed39800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:23.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.148+0000 7feafed39800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:32:23.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.148+0000 7feafed39800 20 INFO: main: done 2024-09-12T00:32:23.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.149+0000 7fe9b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:23.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.151+0000 7feafed39800 20 remove_watcher() i=0 2024-09-12T00:32:23.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.151+0000 7feafed39800 2 removed watcher, disabling cache 2024-09-12T00:32:23.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.152+0000 7feafed39800 20 remove_watcher() i=1 2024-09-12T00:32:23.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.153+0000 7feafed39800 20 remove_watcher() i=2 2024-09-12T00:32:23.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.154+0000 7feafed39800 20 remove_watcher() i=3 2024-09-12T00:32:23.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.155+0000 7feafed39800 20 remove_watcher() i=4 2024-09-12T00:32:23.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.157+0000 7feafed39800 20 remove_watcher() i=5 2024-09-12T00:32:23.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.158+0000 7feafed39800 20 remove_watcher() i=6 2024-09-12T00:32:23.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.159+0000 7feafed39800 20 remove_watcher() i=7 2024-09-12T00:32:23.168 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:32:23.168 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:23.169 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:32:23.200 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:23.200 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:23.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.237+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.239+0000 7fc013721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.239+0000 7fc013721800 20 realm 2024-09-12T00:32:23.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.239+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.239+0000 7fc013721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.239+0000 7fc013721800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:23.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.239+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.239+0000 7fc013721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.239+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.240+0000 7fc013721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:23.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.240+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.240+0000 7fc013721800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:23.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.240+0000 7fc013721800 20 searching for the correct realm 2024-09-12T00:32:23.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.243+0000 7fc00ec0b640 0 -- 172.21.15.83:0/727619714 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fc00406bdf0 msgr2=0x7fc004074040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:23.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.246+0000 7fc00fc0d640 0 -- 172.21.15.83:0/727619714 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x559d982fc5a0 msgr2=0x559d982fe990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:23.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:23.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:23.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:23.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:23.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:23.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:23.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 zone default found 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 4 Realm: () 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 zonegroup default 2024-09-12T00:32:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.250+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.251+0000 7fc013721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.251+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.251+0000 7fc013721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.251+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.251+0000 7fc013721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.251+0000 7fc013721800 20 started sync module instance, tier type = 2024-09-12T00:32:23.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.251+0000 7fc013721800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:23.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.261+0000 7fc013721800 20 add_watcher() i=0 2024-09-12T00:32:23.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.261+0000 7fc013721800 20 add_watcher() i=1 2024-09-12T00:32:23.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.261+0000 7fc013721800 20 add_watcher() i=2 2024-09-12T00:32:23.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.261+0000 7fc013721800 20 add_watcher() i=3 2024-09-12T00:32:23.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.261+0000 7fc013721800 20 add_watcher() i=4 2024-09-12T00:32:23.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.261+0000 7fc013721800 20 add_watcher() i=5 2024-09-12T00:32:23.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.261+0000 7fc013721800 20 add_watcher() i=6 2024-09-12T00:32:23.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.262+0000 7fc013721800 20 add_watcher() i=7 2024-09-12T00:32:23.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.262+0000 7fc013721800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:23.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.263+0000 7fbec5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:23.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.264+0000 7fc013721800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:23.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.264+0000 7fc013721800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:23.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.264+0000 7fc013721800 5 note: GC not initialized 2024-09-12T00:32:23.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.264+0000 7fbec4fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:23.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.264+0000 7fc013721800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:23.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.264+0000 7fc013721800 20 Filter name: none 2024-09-12T00:32:23.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.264+0000 7fbe3e7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:23.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.264+0000 7fc013721800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:23.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.264+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:23.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:23.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:23.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:23.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:23.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:23.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:23.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:23.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:23.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:23.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.265+0000 7fc013721800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:23.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.266+0000 7fc013721800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T00:32:23.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.266+0000 7fc013721800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:32:23.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.267+0000 7fbec5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.269+0000 7fc013721800 20 remove_watcher() i=0 2024-09-12T00:32:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.269+0000 7fc013721800 2 removed watcher, disabling cache 2024-09-12T00:32:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.270+0000 7fc013721800 20 remove_watcher() i=1 2024-09-12T00:32:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.271+0000 7fc013721800 20 remove_watcher() i=2 2024-09-12T00:32:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.272+0000 7fc013721800 20 remove_watcher() i=3 2024-09-12T00:32:23.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.273+0000 7fc013721800 20 remove_watcher() i=4 2024-09-12T00:32:23.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.274+0000 7fc013721800 20 remove_watcher() i=5 2024-09-12T00:32:23.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.275+0000 7fc013721800 20 remove_watcher() i=6 2024-09-12T00:32:23.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.277+0000 7fc013721800 20 remove_watcher() i=7 2024-09-12T00:32:23.286 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:32:23.287 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:23.288 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:32:23.321 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:23.321 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:23.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.361+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.362+0000 7f55e7c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.362+0000 7f55e7c10800 20 realm 2024-09-12T00:32:23.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.362+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.362+0000 7f55e7c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.362+0000 7f55e7c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:23.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.362+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.363+0000 7f55e7c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.363+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.363+0000 7f55e7c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:23.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.363+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.364+0000 7f55e7c10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:23.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.364+0000 7f55e7c10800 20 searching for the correct realm 2024-09-12T00:32:23.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.366+0000 7f55e337a640 0 -- 172.21.15.83:0/1855413031 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f55d408f070 msgr2=0x7f55d404da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:23.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.572+0000 7f55e337a640 0 -- 172.21.15.83:0/1855413031 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f55dc071030 msgr2=0x7f55dc0a7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:23.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:23.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:23.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:23.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:23.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:23.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:23.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:23.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.779+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:23.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 20 zone default found 2024-09-12T00:32:23.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 4 Realm: () 2024-09-12T00:32:23.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:23.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:23.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:23.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 20 zonegroup default 2024-09-12T00:32:23.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.780+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.781+0000 7f55e7c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.781+0000 7f55e7c10800 20 started sync module instance, tier type = 2024-09-12T00:32:23.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.781+0000 7f55e7c10800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:23.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.795+0000 7f55e7c10800 20 add_watcher() i=0 2024-09-12T00:32:23.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.795+0000 7f55e7c10800 20 add_watcher() i=1 2024-09-12T00:32:23.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.795+0000 7f55e7c10800 20 add_watcher() i=2 2024-09-12T00:32:23.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.795+0000 7f55e7c10800 20 add_watcher() i=3 2024-09-12T00:32:23.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.795+0000 7f55e7c10800 20 add_watcher() i=4 2024-09-12T00:32:23.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.795+0000 7f55e7c10800 20 add_watcher() i=5 2024-09-12T00:32:23.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.798+0000 7f55e7c10800 20 add_watcher() i=6 2024-09-12T00:32:23.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.801+0000 7f55e7c10800 20 add_watcher() i=7 2024-09-12T00:32:23.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.801+0000 7f55e7c10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:23.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.803+0000 7f5499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:23.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.803+0000 7f55e7c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:23.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.803+0000 7f55e7c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:23.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.803+0000 7f55e7c10800 5 note: GC not initialized 2024-09-12T00:32:23.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.804+0000 7f5498fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:23.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.804+0000 7f55e7c10800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:23.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.804+0000 7f55e7c10800 20 Filter name: none 2024-09-12T00:32:23.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.804+0000 7f54127fc640 20 reqs_thread_entry: start 2024-09-12T00:32:23.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.804+0000 7f55e7c10800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:23.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.804+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:23.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:23.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:23.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:23.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.805+0000 7f55e7c10800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.806+0000 7f55e7c10800 20 get_obj_state: octx=0x560abeee0be0 obj=check-bucket:c state=0x560abf185f88 s->prefetch_data=0 2024-09-12T00:32:23.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.806+0000 7f55e7c10800 20 get_obj_state: setting s->obj_tag to s0u0cw3b9ywe0v2zgqzuiy8s5t6kvq8u 2024-09-12T00:32:23.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.806+0000 7f55e7c10800 20 get_obj_state_impl: setting s->olh_tag to u2qqt4vqjzuo50l4ew89ez546e84fprg 2024-09-12T00:32:23.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.806+0000 7f55e7c10800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:23.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.806+0000 7f55e7c10800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:32:23.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.806+0000 7f55e7c10800 20 olh_log_entry: epoch=4 op=3 key=c[L4h3T9jGm5SPbay61wNSSMbNY4s5Lm0] 2024-09-12T00:32:23.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.806+0000 7f55e7c10800 20 get_obj_state: octx=0x560abf1babb0 obj=check-bucket:_:L4h3T9jGm5SPbay61wNSSMbNY4s5Lm0_c state=0x560abf17fe78 s->prefetch_data=0 2024-09-12T00:32:23.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.808+0000 7f55e7c10800 20 get_obj_state: octx=0x560abf1babb0 obj=check-bucket:c state=0x560abf1bb5f8 s->prefetch_data=0 2024-09-12T00:32:23.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.809+0000 7f55e7c10800 20 get_obj_state: setting s->obj_tag to s0u0cw3b9ywe0v2zgqzuiy8s5t6kvq8u 2024-09-12T00:32:23.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.809+0000 7f55e7c10800 20 get_obj_state_impl: setting s->olh_tag to u2qqt4vqjzuo50l4ew89ez546e84fprg 2024-09-12T00:32:23.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.809+0000 7f55e7c10800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u2qqt4vqjzuo50l4ew89ez546e84fprg 2024-09-12T00:32:23.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.819+0000 7f55e7c10800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:23.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.820+0000 7f55e7c10800 20 get_obj_state: octx=0x560abeee0be0 obj=check-bucket:d state=0x560abf185f88 s->prefetch_data=0 2024-09-12T00:32:23.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.821+0000 7f55e7c10800 20 get_obj_state: setting s->obj_tag to l4ganzb9zj4jcwft39wdlx3o5lwz66di 2024-09-12T00:32:23.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.821+0000 7f55e7c10800 20 get_obj_state_impl: setting s->olh_tag to y68yrad02e801b0ldytthzwsjk5d8qz5 2024-09-12T00:32:23.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.821+0000 7f55e7c10800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:23.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.821+0000 7f55e7c10800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:32:23.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.821+0000 7f55e7c10800 20 olh_log_entry: epoch=4 op=3 key=d[hK3slRp7zhl7qReC4.nP6rbxUoTSD.d] 2024-09-12T00:32:23.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.821+0000 7f55e7c10800 20 get_obj_state: octx=0x560abf1babb0 obj=check-bucket:_:hK3slRp7zhl7qReC4.nP6rbxUoTSD.d_d state=0x560abf17fe78 s->prefetch_data=0 2024-09-12T00:32:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.825+0000 7f55e7c10800 20 get_obj_state: octx=0x560abf1babb0 obj=check-bucket:d state=0x560abf181f18 s->prefetch_data=0 2024-09-12T00:32:23.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.825+0000 7f55e7c10800 20 get_obj_state: setting s->obj_tag to l4ganzb9zj4jcwft39wdlx3o5lwz66di 2024-09-12T00:32:23.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.825+0000 7f55e7c10800 20 get_obj_state_impl: setting s->olh_tag to y68yrad02e801b0ldytthzwsjk5d8qz5 2024-09-12T00:32:23.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.825+0000 7f55e7c10800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y68yrad02e801b0ldytthzwsjk5d8qz5 2024-09-12T00:32:23.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.836+0000 7f55e7c10800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:23.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.839+0000 7f55e7c10800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T00:32:23.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.839+0000 7f55e7c10800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:32:23.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.840+0000 7f5499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:23.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.842+0000 7f55e7c10800 20 remove_watcher() i=0 2024-09-12T00:32:23.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.842+0000 7f55e7c10800 2 removed watcher, disabling cache 2024-09-12T00:32:23.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.843+0000 7f55e7c10800 20 remove_watcher() i=1 2024-09-12T00:32:23.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.844+0000 7f55e7c10800 20 remove_watcher() i=2 2024-09-12T00:32:23.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.845+0000 7f55e7c10800 20 remove_watcher() i=3 2024-09-12T00:32:23.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.846+0000 7f55e7c10800 20 remove_watcher() i=4 2024-09-12T00:32:23.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.848+0000 7f55e7c10800 20 remove_watcher() i=5 2024-09-12T00:32:23.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.849+0000 7f55e7c10800 20 remove_watcher() i=6 2024-09-12T00:32:23.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.850+0000 7f55e7c10800 20 remove_watcher() i=7 2024-09-12T00:32:23.861 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:32:23.892 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:23.892 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.930+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.932+0000 7f2762b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.932+0000 7f2762b46800 20 realm 2024-09-12T00:32:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.932+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.932+0000 7f2762b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.932+0000 7f2762b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.932+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.933+0000 7f2762b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.933+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.933+0000 7f2762b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.933+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.934+0000 7f2762b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:23.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.934+0000 7f2762b46800 20 searching for the correct realm 2024-09-12T00:32:23.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:23.937+0000 7f2757e2f640 0 -- 172.21.15.83:0/3413630746 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f2748009d70 msgr2=0x7f2748068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:24.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.143+0000 7f2760e31640 0 -- 172.21.15.83:0/3413630746 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x563bd9425880 msgr2=0x563bd9427d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:24.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:24.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:24.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:24.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:24.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:24.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:24.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:24.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.147+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:24.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 zone default found 2024-09-12T00:32:24.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 4 Realm: () 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 zonegroup default 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 started sync module instance, tier type = 2024-09-12T00:32:24.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.148+0000 7f2762b46800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:24.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.161+0000 7f2762b46800 20 add_watcher() i=0 2024-09-12T00:32:24.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.161+0000 7f2762b46800 20 add_watcher() i=1 2024-09-12T00:32:24.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.161+0000 7f2762b46800 20 add_watcher() i=2 2024-09-12T00:32:24.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.161+0000 7f2762b46800 20 add_watcher() i=3 2024-09-12T00:32:24.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.161+0000 7f2762b46800 20 add_watcher() i=4 2024-09-12T00:32:24.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.161+0000 7f2762b46800 20 add_watcher() i=5 2024-09-12T00:32:24.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.161+0000 7f2762b46800 20 add_watcher() i=6 2024-09-12T00:32:24.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.162+0000 7f2762b46800 20 add_watcher() i=7 2024-09-12T00:32:24.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.162+0000 7f2762b46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:24.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.165+0000 7f2616fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:24.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.165+0000 7f2762b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:24.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.165+0000 7f2762b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:24.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.165+0000 7f2762b46800 5 note: GC not initialized 2024-09-12T00:32:24.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.165+0000 7f2615fdb640 20 reqs_thread_entry: start 2024-09-12T00:32:24.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.165+0000 7f2762b46800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:24.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.165+0000 7f2762b46800 20 Filter name: none 2024-09-12T00:32:24.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.165+0000 7f25877fe640 20 reqs_thread_entry: start 2024-09-12T00:32:24.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.165+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.166+0000 7f2762b46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:24.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.166+0000 7f2762b46800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.166+0000 7f2762b46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:24.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.166+0000 7f2762b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:24.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.166+0000 7f2762b46800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:24.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.166+0000 7f2762b46800 20 INFO: main: starting shard=0 2024-09-12T00:32:24.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.166+0000 7f2762b46800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:24.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.167+0000 7f2762b46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:32:24.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.167+0000 7f2762b46800 20 INFO: main: done 2024-09-12T00:32:24.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.168+0000 7f2616fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:24.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.170+0000 7f2762b46800 20 remove_watcher() i=0 2024-09-12T00:32:24.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.170+0000 7f2762b46800 2 removed watcher, disabling cache 2024-09-12T00:32:24.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.171+0000 7f2762b46800 20 remove_watcher() i=1 2024-09-12T00:32:24.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.171+0000 7f2762b46800 20 remove_watcher() i=2 2024-09-12T00:32:24.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.172+0000 7f2762b46800 20 remove_watcher() i=3 2024-09-12T00:32:24.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.174+0000 7f2762b46800 20 remove_watcher() i=4 2024-09-12T00:32:24.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.174+0000 7f2762b46800 20 remove_watcher() i=5 2024-09-12T00:32:24.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.176+0000 7f2762b46800 20 remove_watcher() i=6 2024-09-12T00:32:24.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.177+0000 7f2762b46800 20 remove_watcher() i=7 2024-09-12T00:32:24.187 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:32:24.218 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:24.218 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:24.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.255+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.257+0000 7f9934830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.257+0000 7f9934830800 20 realm 2024-09-12T00:32:24.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.257+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.257+0000 7f9934830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.257+0000 7f9934830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:24.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.257+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.257+0000 7f9934830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.257+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.258+0000 7f9934830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:24.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.258+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.258+0000 7f9934830800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:24.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.258+0000 7f9934830800 20 searching for the correct realm 2024-09-12T00:32:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.261+0000 7f992f3cb640 0 -- 172.21.15.83:0/517165455 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f9924032070 msgr2=0x7f99240a2640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:24.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.467+0000 7f99303cd640 0 -- 172.21.15.83:0/517165455 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55a474b86d60 msgr2=0x55a474b89150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:24.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.471+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 zone default found 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 4 Realm: () 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 zonegroup default 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 started sync module instance, tier type = 2024-09-12T00:32:24.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.472+0000 7f9934830800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:24.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.487+0000 7f9934830800 20 add_watcher() i=0 2024-09-12T00:32:24.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.487+0000 7f9934830800 20 add_watcher() i=1 2024-09-12T00:32:24.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.487+0000 7f9934830800 20 add_watcher() i=2 2024-09-12T00:32:24.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.487+0000 7f9934830800 20 add_watcher() i=3 2024-09-12T00:32:24.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.487+0000 7f9934830800 20 add_watcher() i=4 2024-09-12T00:32:24.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.487+0000 7f9934830800 20 add_watcher() i=5 2024-09-12T00:32:24.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.487+0000 7f9934830800 20 add_watcher() i=6 2024-09-12T00:32:24.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.488+0000 7f9934830800 20 add_watcher() i=7 2024-09-12T00:32:24.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.488+0000 7f9934830800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:24.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.489+0000 7f97e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:24.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.490+0000 7f9934830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:24.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.490+0000 7f9934830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:24.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.490+0000 7f9934830800 5 note: GC not initialized 2024-09-12T00:32:24.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.490+0000 7f97e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:24.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.490+0000 7f9934830800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:24.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.490+0000 7f9934830800 20 Filter name: none 2024-09-12T00:32:24.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.490+0000 7f975e7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:24.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.490+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.491+0000 7f9934830800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:24.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.491+0000 7f9934830800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.491+0000 7f9934830800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:24.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.491+0000 7f9934830800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:24.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.491+0000 7f9934830800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:24.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.491+0000 7f9934830800 20 INFO: main: starting shard=0 2024-09-12T00:32:24.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.491+0000 7f9934830800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:24.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.491+0000 7f9934830800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:32:24.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.491+0000 7f9934830800 20 INFO: main: done 2024-09-12T00:32:24.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.492+0000 7f97e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:24.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.494+0000 7f9934830800 20 remove_watcher() i=0 2024-09-12T00:32:24.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.494+0000 7f9934830800 2 removed watcher, disabling cache 2024-09-12T00:32:24.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.495+0000 7f9934830800 20 remove_watcher() i=1 2024-09-12T00:32:24.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.496+0000 7f9934830800 20 remove_watcher() i=2 2024-09-12T00:32:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.497+0000 7f9934830800 20 remove_watcher() i=3 2024-09-12T00:32:24.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.498+0000 7f9934830800 20 remove_watcher() i=4 2024-09-12T00:32:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.499+0000 7f9934830800 20 remove_watcher() i=5 2024-09-12T00:32:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.500+0000 7f9934830800 20 remove_watcher() i=6 2024-09-12T00:32:24.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.501+0000 7f9934830800 20 remove_watcher() i=7 2024-09-12T00:32:24.510 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:32:24.510 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:24.512 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:32:24.543 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:24.543 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:24.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.581+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.582+0000 7f6d5ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.582+0000 7f6d5ae0e800 20 realm 2024-09-12T00:32:24.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.582+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.583+0000 7f6d5ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.583+0000 7f6d5ae0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:24.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.583+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.583+0000 7f6d5ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.583+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.584+0000 7f6d5ae0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:24.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.584+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.584+0000 7f6d5ae0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:24.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.584+0000 7f6d5ae0e800 20 searching for the correct realm 2024-09-12T00:32:24.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.587+0000 7f6d4dc58640 0 -- 172.21.15.83:0/118695193 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f6d4001c040 msgr2=0x7f6d40033400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:24.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.591+0000 7f6d56c5a640 0 -- 172.21.15.83:0/118695193 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56459dfd5810 msgr2=0x56459dfd7c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.594+0000 7f6d5ae0e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.594+0000 7f6d5ae0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.594+0000 7f6d5ae0e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.594+0000 7f6d5ae0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.594+0000 7f6d5ae0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.594+0000 7f6d5ae0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:24.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.594+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.594+0000 7f6d5ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.594+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:24.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:24.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 20 zone default found 2024-09-12T00:32:24.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 4 Realm: () 2024-09-12T00:32:24.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:24.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 20 zonegroup default 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.595+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.596+0000 7f6d5ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.596+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.596+0000 7f6d5ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.596+0000 7f6d5ae0e800 20 started sync module instance, tier type = 2024-09-12T00:32:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.596+0000 7f6d5ae0e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:24.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.608+0000 7f6d5ae0e800 20 add_watcher() i=0 2024-09-12T00:32:24.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.608+0000 7f6d5ae0e800 20 add_watcher() i=1 2024-09-12T00:32:24.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.608+0000 7f6d5ae0e800 20 add_watcher() i=2 2024-09-12T00:32:24.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.608+0000 7f6d5ae0e800 20 add_watcher() i=3 2024-09-12T00:32:24.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.608+0000 7f6d5ae0e800 20 add_watcher() i=4 2024-09-12T00:32:24.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.608+0000 7f6d5ae0e800 20 add_watcher() i=5 2024-09-12T00:32:24.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.608+0000 7f6d5ae0e800 20 add_watcher() i=6 2024-09-12T00:32:24.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.609+0000 7f6d5ae0e800 20 add_watcher() i=7 2024-09-12T00:32:24.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.609+0000 7f6d5ae0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:24.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.610+0000 7f6c0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:24.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.610+0000 7f6d5ae0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:24.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.610+0000 7f6d5ae0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:24.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.610+0000 7f6d5ae0e800 5 note: GC not initialized 2024-09-12T00:32:24.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6b877fe640 20 reqs_thread_entry: start 2024-09-12T00:32:24.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6d5ae0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:24.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6d5ae0e800 20 Filter name: none 2024-09-12T00:32:24.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6b857fa640 20 reqs_thread_entry: start 2024-09-12T00:32:24.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6d5ae0e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:24.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6d5ae0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6d5ae0e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6d5ae0e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6d5ae0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.611+0000 7f6d5ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.612+0000 7f6d5ae0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.612+0000 7f6d5ae0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.612+0000 7f6d5ae0e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.612+0000 7f6d5ae0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.612+0000 7f6d5ae0e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.612+0000 7f6d5ae0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.612+0000 7f6d5ae0e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:24.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.612+0000 7f6d5ae0e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:32:24.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.612+0000 7f6d5ae0e800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:32:24.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.613+0000 7f6c0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:24.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.615+0000 7f6d5ae0e800 20 remove_watcher() i=0 2024-09-12T00:32:24.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.615+0000 7f6d5ae0e800 2 removed watcher, disabling cache 2024-09-12T00:32:24.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.616+0000 7f6d5ae0e800 20 remove_watcher() i=1 2024-09-12T00:32:24.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.617+0000 7f6d5ae0e800 20 remove_watcher() i=2 2024-09-12T00:32:24.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.618+0000 7f6d5ae0e800 20 remove_watcher() i=3 2024-09-12T00:32:24.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.619+0000 7f6d5ae0e800 20 remove_watcher() i=4 2024-09-12T00:32:24.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.620+0000 7f6d5ae0e800 20 remove_watcher() i=5 2024-09-12T00:32:24.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.621+0000 7f6d5ae0e800 20 remove_watcher() i=6 2024-09-12T00:32:24.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:24.622+0000 7f6d5ae0e800 20 remove_watcher() i=7 2024-09-12T00:32:24.631 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:32:24.631 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:24.633 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.633 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.636 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.637 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.639 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.639 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.683 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:32:24.683 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:32:24.683 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.684 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.728 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.728 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.792 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.792 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.813 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.813 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.815 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.816 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.831 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.832 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.834 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.834 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.857 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.857 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.860 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.860 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.879 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.879 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.882 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.882 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.900 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.901 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.903 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.903 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.918 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:24.918 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:24.922 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:32:25.311 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:32:26.698 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:26.698 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:26.755 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:32:26.757 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:32:26.791 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:26.791 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:26.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.831+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.833+0000 7fe9e17af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.834+0000 7fe9e17af800 20 realm 2024-09-12T00:32:26.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.834+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.834+0000 7fe9e17af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.834+0000 7fe9e17af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:26.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.834+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.834+0000 7fe9e17af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.834+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.835+0000 7fe9e17af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:26.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.835+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.835+0000 7fe9e17af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:26.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.835+0000 7fe9e17af800 20 searching for the correct realm 2024-09-12T00:32:26.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:26.838+0000 7fe9dea98640 0 -- 172.21.15.83:0/2048704469 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fe9d40473b0 msgr2=0x7fe9d4067a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:27.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.043+0000 7fe9dfa9a640 0 -- 172.21.15.83:0/2048704469 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55c620f71af0 msgr2=0x55c620f73ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:27.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.047+0000 7fe9e17af800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:27.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.047+0000 7fe9e17af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.047+0000 7fe9e17af800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.047+0000 7fe9e17af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.047+0000 7fe9e17af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.047+0000 7fe9e17af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.047+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 20 zone default found 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 4 Realm: () 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 20 zonegroup default 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.048+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.049+0000 7fe9e17af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.049+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.049+0000 7fe9e17af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.049+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.049+0000 7fe9e17af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.049+0000 7fe9e17af800 20 started sync module instance, tier type = 2024-09-12T00:32:27.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.049+0000 7fe9e17af800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:27.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.059+0000 7fe9e17af800 20 add_watcher() i=0 2024-09-12T00:32:27.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.059+0000 7fe9e17af800 20 add_watcher() i=1 2024-09-12T00:32:27.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.059+0000 7fe9e17af800 20 add_watcher() i=2 2024-09-12T00:32:27.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.059+0000 7fe9e17af800 20 add_watcher() i=3 2024-09-12T00:32:27.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.059+0000 7fe9e17af800 20 add_watcher() i=4 2024-09-12T00:32:27.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.059+0000 7fe9e17af800 20 add_watcher() i=5 2024-09-12T00:32:27.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.059+0000 7fe9e17af800 20 add_watcher() i=6 2024-09-12T00:32:27.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.061+0000 7fe9e17af800 20 add_watcher() i=7 2024-09-12T00:32:27.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.061+0000 7fe9e17af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.062+0000 7fe895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.063+0000 7fe9e17af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.063+0000 7fe9e17af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.063+0000 7fe9e17af800 5 note: GC not initialized 2024-09-12T00:32:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.063+0000 7fe894fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.063+0000 7fe9e17af800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.063+0000 7fe9e17af800 20 Filter name: none 2024-09-12T00:32:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.063+0000 7fe80e7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.063+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.064+0000 7fe9e17af800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:27.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.064+0000 7fe9e17af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.064+0000 7fe9e17af800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:27.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.064+0000 7fe9e17af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:27.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.064+0000 7fe9e17af800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:27.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.064+0000 7fe9e17af800 20 INFO: main: starting shard=0 2024-09-12T00:32:27.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.064+0000 7fe9e17af800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:27.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.065+0000 7fe9e17af800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:32:27.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.065+0000 7fe9e17af800 20 INFO: main: done 2024-09-12T00:32:27.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.066+0000 7fe895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.068+0000 7fe9e17af800 20 remove_watcher() i=0 2024-09-12T00:32:27.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.068+0000 7fe9e17af800 2 removed watcher, disabling cache 2024-09-12T00:32:27.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.069+0000 7fe9e17af800 20 remove_watcher() i=1 2024-09-12T00:32:27.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.070+0000 7fe9e17af800 20 remove_watcher() i=2 2024-09-12T00:32:27.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.071+0000 7fe9e17af800 20 remove_watcher() i=3 2024-09-12T00:32:27.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.072+0000 7fe9e17af800 20 remove_watcher() i=4 2024-09-12T00:32:27.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.073+0000 7fe9e17af800 20 remove_watcher() i=5 2024-09-12T00:32:27.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.075+0000 7fe9e17af800 20 remove_watcher() i=6 2024-09-12T00:32:27.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.076+0000 7fe9e17af800 20 remove_watcher() i=7 2024-09-12T00:32:27.089 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:27.089 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:27.092 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:27.092 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:27.151 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:32:27.152 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:32:27.183 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:27.183 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:27.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.221+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.223+0000 7fef2062f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.223+0000 7fef2062f800 20 realm 2024-09-12T00:32:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.223+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.223+0000 7fef2062f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.223+0000 7fef2062f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.223+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.224+0000 7fef2062f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.224+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.224+0000 7fef2062f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.224+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.225+0000 7fef2062f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:27.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.225+0000 7fef2062f800 20 searching for the correct realm 2024-09-12T00:32:27.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.228+0000 7fef1d918640 0 -- 172.21.15.83:0/3917155764 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fef14072530 msgr2=0x7fef14067b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:27.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.434+0000 7fef1e91a640 0 -- 172.21.15.83:0/3917155764 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55c91266f4a0 msgr2=0x55c912671890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.438+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 zone default found 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 4 Realm: () 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 zonegroup default 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 started sync module instance, tier type = 2024-09-12T00:32:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.439+0000 7fef2062f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:27.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.452+0000 7fef2062f800 20 add_watcher() i=0 2024-09-12T00:32:27.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.452+0000 7fef2062f800 20 add_watcher() i=1 2024-09-12T00:32:27.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.452+0000 7fef2062f800 20 add_watcher() i=2 2024-09-12T00:32:27.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.452+0000 7fef2062f800 20 add_watcher() i=3 2024-09-12T00:32:27.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.452+0000 7fef2062f800 20 add_watcher() i=4 2024-09-12T00:32:27.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.452+0000 7fef2062f800 20 add_watcher() i=5 2024-09-12T00:32:27.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.452+0000 7fef2062f800 20 add_watcher() i=6 2024-09-12T00:32:27.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.453+0000 7fef2062f800 20 add_watcher() i=7 2024-09-12T00:32:27.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.453+0000 7fef2062f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:27.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.455+0000 7fedd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.455+0000 7fef2062f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:27.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.455+0000 7fef2062f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:27.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.455+0000 7fef2062f800 5 note: GC not initialized 2024-09-12T00:32:27.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.455+0000 7fed4f7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:27.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.455+0000 7fef2062f800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:27.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.455+0000 7fef2062f800 20 Filter name: none 2024-09-12T00:32:27.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.455+0000 7fed4d7fa640 20 reqs_thread_entry: start 2024-09-12T00:32:27.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.455+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.456+0000 7fef2062f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.456+0000 7fef2062f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.456+0000 7fef2062f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.456+0000 7fef2062f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.456+0000 7fef2062f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.456+0000 7fef2062f800 20 INFO: main: starting shard=0 2024-09-12T00:32:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.456+0000 7fef2062f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.457+0000 7fef2062f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:32:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.457+0000 7fef2062f800 20 INFO: main: done 2024-09-12T00:32:27.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.458+0000 7fedd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.460+0000 7fef2062f800 20 remove_watcher() i=0 2024-09-12T00:32:27.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.460+0000 7fef2062f800 2 removed watcher, disabling cache 2024-09-12T00:32:27.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.462+0000 7fef2062f800 20 remove_watcher() i=1 2024-09-12T00:32:27.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.463+0000 7fef2062f800 20 remove_watcher() i=2 2024-09-12T00:32:27.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.464+0000 7fef2062f800 20 remove_watcher() i=3 2024-09-12T00:32:27.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.465+0000 7fef2062f800 20 remove_watcher() i=4 2024-09-12T00:32:27.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.466+0000 7fef2062f800 20 remove_watcher() i=5 2024-09-12T00:32:27.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.467+0000 7fef2062f800 20 remove_watcher() i=6 2024-09-12T00:32:27.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.468+0000 7fef2062f800 20 remove_watcher() i=7 2024-09-12T00:32:27.480 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:27.480 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:27.483 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:27.483 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:27.486 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:27.540 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:32:27.541 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:32:27.571 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:27.571 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:27.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.608+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.610+0000 7f377b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.610+0000 7f377b70c800 20 realm 2024-09-12T00:32:27.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.610+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.610+0000 7f377b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.610+0000 7f377b70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:27.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.610+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.610+0000 7f377b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.610+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.611+0000 7f377b70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.611+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.611+0000 7f377b70c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:27.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.611+0000 7f377b70c800 20 searching for the correct realm 2024-09-12T00:32:27.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.615+0000 7f37791f6640 0 -- 172.21.15.83:0/3521192992 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f376c023040 msgr2=0x7f376c03a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:27.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.618+0000 7f37791f6640 0 -- 172.21.15.83:0/3521192992 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x5622a8db02d0 msgr2=0x5622a8db26c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.622+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 20 zone default found 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 4 Realm: () 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 20 zonegroup default 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.623+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.624+0000 7f377b70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.624+0000 7f377b70c800 20 started sync module instance, tier type = 2024-09-12T00:32:27.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.624+0000 7f377b70c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:27.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.634+0000 7f377b70c800 20 add_watcher() i=0 2024-09-12T00:32:27.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.634+0000 7f377b70c800 20 add_watcher() i=1 2024-09-12T00:32:27.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.634+0000 7f377b70c800 20 add_watcher() i=2 2024-09-12T00:32:27.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.634+0000 7f377b70c800 20 add_watcher() i=3 2024-09-12T00:32:27.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.634+0000 7f377b70c800 20 add_watcher() i=4 2024-09-12T00:32:27.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.634+0000 7f377b70c800 20 add_watcher() i=5 2024-09-12T00:32:27.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.634+0000 7f377b70c800 20 add_watcher() i=6 2024-09-12T00:32:27.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.635+0000 7f377b70c800 20 add_watcher() i=7 2024-09-12T00:32:27.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.635+0000 7f377b70c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:27.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.636+0000 7f362f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.636+0000 7f377b70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:27.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.636+0000 7f377b70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:27.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.636+0000 7f377b70c800 5 note: GC not initialized 2024-09-12T00:32:27.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.637+0000 7f362e7e4640 20 reqs_thread_entry: start 2024-09-12T00:32:27.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.637+0000 7f377b70c800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:27.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.637+0000 7f377b70c800 20 Filter name: none 2024-09-12T00:32:27.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.637+0000 7f359ffff640 20 reqs_thread_entry: start 2024-09-12T00:32:27.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.637+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.638+0000 7f377b70c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:27.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.638+0000 7f377b70c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.638+0000 7f377b70c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:27.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.638+0000 7f377b70c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:27.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.638+0000 7f377b70c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:27.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.638+0000 7f377b70c800 20 INFO: main: starting shard=0 2024-09-12T00:32:27.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.638+0000 7f377b70c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:27.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.639+0000 7f377b70c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:32:27.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.639+0000 7f377b70c800 20 INFO: main: done 2024-09-12T00:32:27.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.639+0000 7f362f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.641+0000 7f377b70c800 20 remove_watcher() i=0 2024-09-12T00:32:27.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.641+0000 7f377b70c800 2 removed watcher, disabling cache 2024-09-12T00:32:27.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.642+0000 7f377b70c800 20 remove_watcher() i=1 2024-09-12T00:32:27.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.644+0000 7f377b70c800 20 remove_watcher() i=2 2024-09-12T00:32:27.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.645+0000 7f377b70c800 20 remove_watcher() i=3 2024-09-12T00:32:27.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.646+0000 7f377b70c800 20 remove_watcher() i=4 2024-09-12T00:32:27.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.646+0000 7f377b70c800 20 remove_watcher() i=5 2024-09-12T00:32:27.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.647+0000 7f377b70c800 20 remove_watcher() i=6 2024-09-12T00:32:27.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.648+0000 7f377b70c800 20 remove_watcher() i=7 2024-09-12T00:32:27.659 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:27.659 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:27.662 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:27.662 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:32:27.716 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:32:27.747 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:27.747 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:27.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.784+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.786+0000 7f1b7d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.786+0000 7f1b7d230800 20 realm 2024-09-12T00:32:27.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.786+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.786+0000 7f1b7d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.786+0000 7f1b7d230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:27.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.786+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.786+0000 7f1b7d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.786+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.787+0000 7f1b7d230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.787+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.787+0000 7f1b7d230800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:27.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.788+0000 7f1b7d230800 20 searching for the correct realm 2024-09-12T00:32:27.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.791+0000 7f1b6ffff640 0 -- 172.21.15.83:0/2148412600 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f1b60013030 msgr2=0x7f1b600219a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:27.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.794+0000 7f1b78dcd640 0 -- 172.21.15.83:0/2148412600 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55d31268f780 msgr2=0x55d312691bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:27.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:27.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:27.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:27.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:27.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.798+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 zone default found 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 4 Realm: () 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 zonegroup default 2024-09-12T00:32:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 started sync module instance, tier type = 2024-09-12T00:32:27.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.799+0000 7f1b7d230800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:27.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.810+0000 7f1b7d230800 20 add_watcher() i=0 2024-09-12T00:32:27.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.810+0000 7f1b7d230800 20 add_watcher() i=1 2024-09-12T00:32:27.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.810+0000 7f1b7d230800 20 add_watcher() i=2 2024-09-12T00:32:27.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.810+0000 7f1b7d230800 20 add_watcher() i=3 2024-09-12T00:32:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.810+0000 7f1b7d230800 20 add_watcher() i=4 2024-09-12T00:32:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.810+0000 7f1b7d230800 20 add_watcher() i=5 2024-09-12T00:32:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.810+0000 7f1b7d230800 20 add_watcher() i=6 2024-09-12T00:32:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.810+0000 7f1b7d230800 20 add_watcher() i=7 2024-09-12T00:32:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.810+0000 7f1b7d230800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.812+0000 7f1a2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.813+0000 7f1b7d230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.813+0000 7f1b7d230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.813+0000 7f1b7d230800 5 note: GC not initialized 2024-09-12T00:32:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.813+0000 7f1a2dfdb640 20 reqs_thread_entry: start 2024-09-12T00:32:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.813+0000 7f1b7d230800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.813+0000 7f1b7d230800 20 Filter name: none 2024-09-12T00:32:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.813+0000 7f199f7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.813+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.814+0000 7f1b7d230800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:27.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.814+0000 7f1b7d230800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.814+0000 7f1b7d230800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:27.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.814+0000 7f1b7d230800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:27.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.814+0000 7f1b7d230800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:32:27.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.814+0000 7f1b7d230800 20 INFO: main: starting shard=0 2024-09-12T00:32:27.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.814+0000 7f1b7d230800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:27.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.815+0000 7f1b7d230800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:32:27.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.815+0000 7f1b7d230800 20 INFO: main: done 2024-09-12T00:32:27.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.816+0000 7f1a2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.818+0000 7f1b7d230800 20 remove_watcher() i=0 2024-09-12T00:32:27.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.818+0000 7f1b7d230800 2 removed watcher, disabling cache 2024-09-12T00:32:27.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.819+0000 7f1b7d230800 20 remove_watcher() i=1 2024-09-12T00:32:27.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.819+0000 7f1b7d230800 20 remove_watcher() i=2 2024-09-12T00:32:27.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.820+0000 7f1b7d230800 20 remove_watcher() i=3 2024-09-12T00:32:27.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.821+0000 7f1b7d230800 20 remove_watcher() i=4 2024-09-12T00:32:27.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.822+0000 7f1b7d230800 20 remove_watcher() i=5 2024-09-12T00:32:27.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.823+0000 7f1b7d230800 20 remove_watcher() i=6 2024-09-12T00:32:27.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:27.825+0000 7f1b7d230800 20 remove_watcher() i=7 2024-09-12T00:32:27.836 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:27.836 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:32:28.229 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:32:28.625 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:32:28.654 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:28.654 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:28.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.692+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.694+0000 7fe94300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.694+0000 7fe94300f800 20 realm 2024-09-12T00:32:28.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.694+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.694+0000 7fe94300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.694+0000 7fe94300f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:28.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.694+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.694+0000 7fe94300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.694+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.695+0000 7fe94300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:28.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.695+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.695+0000 7fe94300f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:28.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.695+0000 7fe94300f800 20 searching for the correct realm 2024-09-12T00:32:28.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.699+0000 7fe93bfff640 0 -- 172.21.15.83:0/3286677405 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fe92c09a400 msgr2=0x7fe92c09a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:28.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.702+0000 7fe93bfff640 0 -- 172.21.15.83:0/3286677405 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x562a09e88130 msgr2=0x562a09e8a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.706+0000 7fe94300f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.706+0000 7fe94300f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.706+0000 7fe94300f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.706+0000 7fe94300f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.706+0000 7fe94300f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.706+0000 7fe94300f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.706+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.706+0000 7fe94300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.706+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:28.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:28.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 20 zone default found 2024-09-12T00:32:28.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 4 Realm: () 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 20 zonegroup default 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.707+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.708+0000 7fe94300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.708+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.708+0000 7fe94300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.708+0000 7fe94300f800 20 started sync module instance, tier type = 2024-09-12T00:32:28.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.708+0000 7fe94300f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.723+0000 7fe94300f800 20 add_watcher() i=0 2024-09-12T00:32:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.723+0000 7fe94300f800 20 add_watcher() i=1 2024-09-12T00:32:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.723+0000 7fe94300f800 20 add_watcher() i=2 2024-09-12T00:32:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.723+0000 7fe94300f800 20 add_watcher() i=3 2024-09-12T00:32:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.723+0000 7fe94300f800 20 add_watcher() i=4 2024-09-12T00:32:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.723+0000 7fe94300f800 20 add_watcher() i=5 2024-09-12T00:32:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.723+0000 7fe94300f800 20 add_watcher() i=6 2024-09-12T00:32:28.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.726+0000 7fe94300f800 20 add_watcher() i=7 2024-09-12T00:32:28.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.726+0000 7fe94300f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.728+0000 7fe7f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.729+0000 7fe94300f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:28.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.729+0000 7fe94300f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:28.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.729+0000 7fe94300f800 5 note: GC not initialized 2024-09-12T00:32:28.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.729+0000 7fe7f5fe3640 20 reqs_thread_entry: start 2024-09-12T00:32:28.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.729+0000 7fe94300f800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:28.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.729+0000 7fe94300f800 20 Filter name: none 2024-09-12T00:32:28.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.729+0000 7fe7677fe640 20 reqs_thread_entry: start 2024-09-12T00:32:28.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.729+0000 7fe94300f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:28.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.729+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:28.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:28.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:28.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:28.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:28.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:28.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:28.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:28.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:28.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:28.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.730+0000 7fe94300f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.735+0000 7fe7f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:28.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.737+0000 7fe94300f800 20 remove_watcher() i=0 2024-09-12T00:32:28.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.737+0000 7fe94300f800 2 removed watcher, disabling cache 2024-09-12T00:32:28.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.738+0000 7fe94300f800 20 remove_watcher() i=1 2024-09-12T00:32:28.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.740+0000 7fe94300f800 20 remove_watcher() i=2 2024-09-12T00:32:28.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.741+0000 7fe94300f800 20 remove_watcher() i=3 2024-09-12T00:32:28.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.742+0000 7fe94300f800 20 remove_watcher() i=4 2024-09-12T00:32:28.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.743+0000 7fe94300f800 20 remove_watcher() i=5 2024-09-12T00:32:28.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.744+0000 7fe94300f800 20 remove_watcher() i=6 2024-09-12T00:32:28.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.745+0000 7fe94300f800 20 remove_watcher() i=7 2024-09-12T00:32:28.755 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:32:28.790 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:28.790 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:28.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.828+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.830+0000 7f1f45d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.830+0000 7f1f45d2c800 20 realm 2024-09-12T00:32:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.830+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.830+0000 7f1f45d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.830+0000 7f1f45d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.830+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.830+0000 7f1f45d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.830+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.831+0000 7f1f45d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.831+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.831+0000 7f1f45d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:28.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.831+0000 7f1f45d2c800 20 searching for the correct realm 2024-09-12T00:32:28.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.835+0000 7f1f4193e640 0 -- 172.21.15.83:0/1150385753 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f1f34082040 msgr2=0x7f1f3408e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:28.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.838+0000 7f1f4193e640 0 -- 172.21.15.83:0/1150385753 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x564ab3d793e0 msgr2=0x564ab3d7b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 zone default found 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 4 Realm: () 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 zonegroup default 2024-09-12T00:32:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.841+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.842+0000 7f1f45d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.842+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.842+0000 7f1f45d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.842+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.842+0000 7f1f45d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.842+0000 7f1f45d2c800 20 started sync module instance, tier type = 2024-09-12T00:32:28.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.842+0000 7f1f45d2c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:28.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.851+0000 7f1f45d2c800 20 add_watcher() i=0 2024-09-12T00:32:28.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.851+0000 7f1f45d2c800 20 add_watcher() i=1 2024-09-12T00:32:28.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.851+0000 7f1f45d2c800 20 add_watcher() i=2 2024-09-12T00:32:28.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.851+0000 7f1f45d2c800 20 add_watcher() i=3 2024-09-12T00:32:28.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.851+0000 7f1f45d2c800 20 add_watcher() i=4 2024-09-12T00:32:28.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.851+0000 7f1f45d2c800 20 add_watcher() i=5 2024-09-12T00:32:28.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.851+0000 7f1f45d2c800 20 add_watcher() i=6 2024-09-12T00:32:28.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.852+0000 7f1f45d2c800 20 add_watcher() i=7 2024-09-12T00:32:28.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.852+0000 7f1f45d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:28.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.854+0000 7f1df37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.854+0000 7f1f45d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.854+0000 7f1f45d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.854+0000 7f1f45d2c800 5 note: GC not initialized 2024-09-12T00:32:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1df27fc640 20 reqs_thread_entry: start 2024-09-12T00:32:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1f45d2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1f45d2c800 20 Filter name: none 2024-09-12T00:32:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1d67fff640 20 reqs_thread_entry: start 2024-09-12T00:32:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1f45d2c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:32:28.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1f45d2c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:28.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1f45d2c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:32:28.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1f45d2c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1f45d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 : miss 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.855+0000 7f1f45d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.856+0000 7f1f45d2c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.856+0000 7f1f45d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 info.flags=0x17 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.856+0000 7f1f45d2c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 to cache LRU end 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.856+0000 7f1f45d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.856+0000 7f1f45d2c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.856+0000 7f1f45d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.2 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.856+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.857+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.857+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:c state=0x564ab3db00c8 s->prefetch_data=0 2024-09-12T00:32:28.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.858+0000 7f1f45d2c800 20 get_obj_state: setting s->obj_tag to r8apigiseprjmzujqtkmyaixmpw79igo 2024-09-12T00:32:28.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.858+0000 7f1f45d2c800 20 get_obj_state_impl: setting s->olh_tag to vz4zs687vx2lf0meu2l62ypah8hdscwv 2024-09-12T00:32:28.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.858+0000 7f1f45d2c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vz4zs687vx2lf0meu2l62ypah8hdscwv 2024-09-12T00:32:28.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.859+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.861+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.861+0000 7f1f45d2c800 20 olh_log_entry: epoch=3 op=3 key=c[EHMf98..-Uy1r.enKryObGA87AlV.jn] 2024-09-12T00:32:28.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.861+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:_:EHMf98..-Uy1r.enKryObGA87AlV.jn_c state=0x564ab3daf398 s->prefetch_data=0 2024-09-12T00:32:28.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.862+0000 7f1f45d2c800 10 manifest: total_size = 9 2024-09-12T00:32:28.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.862+0000 7f1f45d2c800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.12210960182360955305 2024-09-12T00:32:28.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.862+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:_:EHMf98..-Uy1r.enKryObGA87AlV.jn_c state=0x564ab3daf398 s->prefetch_data=0 2024-09-12T00:32:28.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.862+0000 7f1f45d2c800 20 prepare_atomic_modification: state is not atomic. state=0x564ab3daf398 2024-09-12T00:32:28.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.862+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.864+0000 7f1f45d2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:28.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.864+0000 7f1f45d2c800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:32:28.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.864+0000 7f1f45d2c800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:32:28.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.864+0000 7f1f45d2c800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.2__shadow:EHMf98..-Uy1r.enKryObGA87AlV.jn_.hWqh9T7xgwbpYzZC8LKW7FFmKdV6hxi_0 2024-09-12T00:32:28.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.866+0000 7f1f45d2c800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:32:28.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.866+0000 7f1e24ff9640 20 handle_completion(): completion ok for obj=c[EHMf98..-Uy1r.enKryObGA87AlV.jn] 2024-09-12T00:32:28.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.867+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.867+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.869+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.869+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.870+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:d state=0x564ab3daf398 s->prefetch_data=0 2024-09-12T00:32:28.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.870+0000 7f1f45d2c800 20 get_obj_state: setting s->obj_tag to 53sdmhncchwllsi22wl9zbteyggbvswp 2024-09-12T00:32:28.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.870+0000 7f1f45d2c800 20 get_obj_state_impl: setting s->olh_tag to vfxviw88i6k30mq3aittdyn9such10ud 2024-09-12T00:32:28.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.870+0000 7f1f45d2c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vfxviw88i6k30mq3aittdyn9such10ud 2024-09-12T00:32:28.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.871+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.877+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.878+0000 7f1f45d2c800 20 olh_log_entry: epoch=3 op=3 key=d[PXuFbohpSRnwVFXQ.fPTvL-a6LqWtz4] 2024-09-12T00:32:28.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.878+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:_:PXuFbohpSRnwVFXQ.fPTvL-a6LqWtz4_d state=0x564ab3df4b98 s->prefetch_data=0 2024-09-12T00:32:28.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.878+0000 7f1f45d2c800 10 manifest: total_size = 22 2024-09-12T00:32:28.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.878+0000 7f1f45d2c800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.13578393433282552088 2024-09-12T00:32:28.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.878+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:_:PXuFbohpSRnwVFXQ.fPTvL-a6LqWtz4_d state=0x564ab3df4b98 s->prefetch_data=0 2024-09-12T00:32:28.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.878+0000 7f1f45d2c800 20 prepare_atomic_modification: state is not atomic. state=0x564ab3df4b98 2024-09-12T00:32:28.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.878+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.882+0000 7f1f45d2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:28.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.882+0000 7f1f45d2c800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:32:28.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.882+0000 7f1f45d2c800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:32:28.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.882+0000 7f1f45d2c800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.2__shadow:PXuFbohpSRnwVFXQ.fPTvL-a6LqWtz4_.j0_2n4xDv669PIe4j40XG1BVlAoFX60_0 2024-09-12T00:32:28.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.886+0000 7f1e257fa640 20 handle_completion(): completion ok for obj=d[PXuFbohpSRnwVFXQ.fPTvL-a6LqWtz4] 2024-09-12T00:32:28.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.889+0000 7f1f45d2c800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:32:28.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.890+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.890+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.896+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.896+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.896+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:e state=0x564ab3db1f88 s->prefetch_data=0 2024-09-12T00:32:28.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.897+0000 7f1f45d2c800 20 get_obj_state: setting s->obj_tag to koe2yr8orj846pjb3k1l2361vdul6f5l 2024-09-12T00:32:28.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.897+0000 7f1f45d2c800 20 get_obj_state_impl: setting s->olh_tag to 7aq9nbr09cwpi3moes364vc2dinkjtj6 2024-09-12T00:32:28.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.897+0000 7f1f45d2c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7aq9nbr09cwpi3moes364vc2dinkjtj6 2024-09-12T00:32:28.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.898+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.900+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.900+0000 7f1f45d2c800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:32:28.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.900+0000 7f1f45d2c800 20 olh_log_entry: epoch=2 op=3 key=e[6AmsceUkwjtN-3QhyevpWDSsRA6Tf3p] 2024-09-12T00:32:28.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.900+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:_:6AmsceUkwjtN-3QhyevpWDSsRA6Tf3p_e state=0x564ab3df4b98 s->prefetch_data=0 2024-09-12T00:32:28.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.900+0000 7f1f45d2c800 10 manifest: total_size = 22 2024-09-12T00:32:28.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.900+0000 7f1f45d2c800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.13511819538392676951 2024-09-12T00:32:28.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.900+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:_:6AmsceUkwjtN-3QhyevpWDSsRA6Tf3p_e state=0x564ab3df4b98 s->prefetch_data=0 2024-09-12T00:32:28.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.900+0000 7f1f45d2c800 20 prepare_atomic_modification: state is not atomic. state=0x564ab3df4b98 2024-09-12T00:32:28.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.900+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.903+0000 7f1f45d2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:28.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.903+0000 7f1f45d2c800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:32:28.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.903+0000 7f1f45d2c800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:32:28.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.903+0000 7f1f45d2c800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.2__shadow:6AmsceUkwjtN-3QhyevpWDSsRA6Tf3p_.hT85MiJE5yVAmYlEF54d6aNHGQ2aw0J_0 2024-09-12T00:32:28.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.904+0000 7f1e257fa640 20 handle_completion(): completion ok for obj=e[6AmsceUkwjtN-3QhyevpWDSsRA6Tf3p] 2024-09-12T00:32:28.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.904+0000 7f1f45d2c800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:32:28.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.905+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:e state=0x564ab3db1f88 s->prefetch_data=0 2024-09-12T00:32:28.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.905+0000 7f1f45d2c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7aq9nbr09cwpi3moes364vc2dinkjtj6 2024-09-12T00:32:28.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.910+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.911+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.911+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.911+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:f state=0x564ab3db1f88 s->prefetch_data=0 2024-09-12T00:32:28.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.912+0000 7f1f45d2c800 20 get_obj_state: setting s->obj_tag to rcru36qvskc353vznskrady5uisphqrm 2024-09-12T00:32:28.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.912+0000 7f1f45d2c800 20 get_obj_state_impl: setting s->olh_tag to sgt2v1j0x1vzgm1slazqhx8urzpeah2t 2024-09-12T00:32:28.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.912+0000 7f1f45d2c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=sgt2v1j0x1vzgm1slazqhx8urzpeah2t 2024-09-12T00:32:28.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.913+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.915+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.916+0000 7f1f45d2c800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:32:28.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.916+0000 7f1f45d2c800 20 olh_log_entry: epoch=2 op=3 key=f[8bTYY2AxDWFw1MWQQsKaQiYxhLXJxSO] 2024-09-12T00:32:28.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.916+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:_:8bTYY2AxDWFw1MWQQsKaQiYxhLXJxSO_f state=0x564ab3df4b98 s->prefetch_data=0 2024-09-12T00:32:28.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.916+0000 7f1f45d2c800 10 manifest: total_size = 22 2024-09-12T00:32:28.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.916+0000 7f1f45d2c800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.4910255770259429873 2024-09-12T00:32:28.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.916+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:_:8bTYY2AxDWFw1MWQQsKaQiYxhLXJxSO_f state=0x564ab3df4b98 s->prefetch_data=0 2024-09-12T00:32:28.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.916+0000 7f1f45d2c800 20 prepare_atomic_modification: state is not atomic. state=0x564ab3df4b98 2024-09-12T00:32:28.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.916+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.919+0000 7f1f45d2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:28.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.919+0000 7f1f45d2c800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:32:28.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.919+0000 7f1f45d2c800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:32:28.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.919+0000 7f1f45d2c800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.2__shadow:8bTYY2AxDWFw1MWQQsKaQiYxhLXJxSO_.ce0W3vjZAwT2NRKwIkEbAlHiuh1sqLU_0 2024-09-12T00:32:28.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.921+0000 7f1f45d2c800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:32:28.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.921+0000 7f1e24ff9640 20 handle_completion(): completion ok for obj=f[8bTYY2AxDWFw1MWQQsKaQiYxhLXJxSO] 2024-09-12T00:32:28.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.923+0000 7f1f45d2c800 20 get_obj_state: octx=0x564ab3b12bf0 obj=check-bucket:f state=0x564ab3db1f88 s->prefetch_data=0 2024-09-12T00:32:28.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.923+0000 7f1f45d2c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=sgt2v1j0x1vzgm1slazqhx8urzpeah2t 2024-09-12T00:32:28.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.926+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.927+0000 7f1f45d2c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.2.0 2024-09-12T00:32:28.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.927+0000 7f1f45d2c800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:32:28.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.927+0000 7f1f45d2c800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:32:28.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.928+0000 7f1df37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:28.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.930+0000 7f1f45d2c800 20 remove_watcher() i=0 2024-09-12T00:32:28.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.930+0000 7f1f45d2c800 2 removed watcher, disabling cache 2024-09-12T00:32:28.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.931+0000 7f1f45d2c800 20 remove_watcher() i=1 2024-09-12T00:32:28.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.932+0000 7f1f45d2c800 20 remove_watcher() i=2 2024-09-12T00:32:28.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.933+0000 7f1f45d2c800 20 remove_watcher() i=3 2024-09-12T00:32:28.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.934+0000 7f1f45d2c800 20 remove_watcher() i=4 2024-09-12T00:32:28.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.935+0000 7f1f45d2c800 20 remove_watcher() i=5 2024-09-12T00:32:28.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.936+0000 7f1f45d2c800 20 remove_watcher() i=6 2024-09-12T00:32:28.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:28.937+0000 7f1f45d2c800 20 remove_watcher() i=7 2024-09-12T00:32:28.948 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:28.948 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:28.955 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:28.955 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:29.013 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:32:29.041 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:29.042 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:29.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.079+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.081+0000 7f06acb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.081+0000 7f06acb23800 20 realm 2024-09-12T00:32:29.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.081+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.081+0000 7f06acb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.081+0000 7f06acb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:29.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.081+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.081+0000 7f06acb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.081+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.082+0000 7f06acb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:29.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.082+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.082+0000 7f06acb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:29.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.082+0000 7f06acb23800 20 searching for the correct realm 2024-09-12T00:32:29.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.085+0000 7f06a3fff640 0 -- 172.21.15.83:0/2898815851 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f0694028060 msgr2=0x7f0694090eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:29.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.290+0000 7f06a3fff640 0 -- 172.21.15.83:0/2898815851 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x562dcd4af0d0 msgr2=0x562dcd4b1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:29.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.293+0000 7f06acb23800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:32:29.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.293+0000 7f06acb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:29.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.293+0000 7f06acb23800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:32:29.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.293+0000 7f06acb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:29.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.293+0000 7f06acb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:29.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.293+0000 7f06acb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:29.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.293+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:29.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:29.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 zone default found 2024-09-12T00:32:29.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 4 Realm: () 2024-09-12T00:32:29.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:32:29.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:32:29.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:29.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 zonegroup default 2024-09-12T00:32:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.294+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.295+0000 7f06acb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.295+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.295+0000 7f06acb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.295+0000 7f06acb23800 20 started sync module instance, tier type = 2024-09-12T00:32:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.295+0000 7f06acb23800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:32:29.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.308+0000 7f06acb23800 20 add_watcher() i=0 2024-09-12T00:32:29.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.308+0000 7f06acb23800 20 add_watcher() i=1 2024-09-12T00:32:29.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.308+0000 7f06acb23800 20 add_watcher() i=2 2024-09-12T00:32:29.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.308+0000 7f06acb23800 20 add_watcher() i=3 2024-09-12T00:32:29.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.308+0000 7f06acb23800 20 add_watcher() i=4 2024-09-12T00:32:29.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.308+0000 7f06acb23800 20 add_watcher() i=5 2024-09-12T00:32:29.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.308+0000 7f06acb23800 20 add_watcher() i=6 2024-09-12T00:32:29.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.309+0000 7f06acb23800 20 add_watcher() i=7 2024-09-12T00:32:29.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.309+0000 7f06acb23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:29.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.311+0000 7f055f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.311+0000 7f06acb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.311+0000 7f06acb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.311+0000 7f06acb23800 5 note: GC not initialized 2024-09-12T00:32:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.311+0000 7f055e7e4640 20 reqs_thread_entry: start 2024-09-12T00:32:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.311+0000 7f06acb23800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.311+0000 7f06acb23800 20 Filter name: none 2024-09-12T00:32:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.312+0000 7f05577fe640 20 reqs_thread_entry: start 2024-09-12T00:32:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.312+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.312+0000 7f06acb23800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.312+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.312+0000 7f06acb23800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.312+0000 7f06acb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.312+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.313+0000 7f06acb23800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.313+0000 7f06acb23800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.313+0000 7f06acb23800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.313+0000 7f06acb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.314+0000 7f055f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:29.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.316+0000 7f06acb23800 20 remove_watcher() i=0 2024-09-12T00:32:29.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.316+0000 7f06acb23800 2 removed watcher, disabling cache 2024-09-12T00:32:29.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.317+0000 7f06acb23800 20 remove_watcher() i=1 2024-09-12T00:32:29.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.318+0000 7f06acb23800 20 remove_watcher() i=2 2024-09-12T00:32:29.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.319+0000 7f06acb23800 20 remove_watcher() i=3 2024-09-12T00:32:29.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.320+0000 7f06acb23800 20 remove_watcher() i=4 2024-09-12T00:32:29.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.321+0000 7f06acb23800 20 remove_watcher() i=5 2024-09-12T00:32:29.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.322+0000 7f06acb23800 20 remove_watcher() i=6 2024-09-12T00:32:29.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:32:29.323+0000 7f06acb23800 20 remove_watcher() i=7 2024-09-12T00:32:29.333 INFO:tasks.workunit.client.0.smithi083.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:32:29.333 INFO:tasks.workunit.client.0.smithi083.stderr:Deleting bucket check-bucket 2024-09-12T00:32:29.334 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:29.334 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:29.338 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:32:29.338 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:32:29.351 INFO:tasks.workunit.client.0.smithi083.stderr:Completed bucket check tests 2024-09-12T00:32:29.351 INFO:tasks.workunit.client.0.smithi083.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:32:29.351 INFO:tasks.workunit.client.0.smithi083.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:32:29.352 INFO:tasks.workunit.client.0.smithi083.stdout:connected to https://localhost:443 2024-09-12T00:32:29.415 INFO:tasks.workunit.client.0.smithi083.stderr:+ deactivate 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ export PATH 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ hash -r 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset -f deactivate 2024-09-12T00:32:29.416 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo OK. 2024-09-12T00:32:29.417 INFO:tasks.workunit.client.0.smithi083.stdout:OK. 2024-09-12T00:32:29.418 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:32:29.418 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:32:29.496 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:32:29.496 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:32:29.864 DEBUG:teuthology.parallel:result is None 2024-09-12T00:32:29.865 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:32:29.903 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:32:29.903 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:29.972 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:32:29.972 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:32:29.985 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:32:29.985 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:32:29.985 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:30.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:32:30.042 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:32:30.042 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:30.110 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:30.111 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:32:30.180 INFO:tasks.workunit:timeout=3h 2024-09-12T00:32:30.180 INFO:tasks.workunit:cleanup=True 2024-09-12T00:32:30.181 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:32:30.249 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:33:14.625 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:33:14.625 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:33:14.625 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:33:14.625 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:33:14.625 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:33:14.626 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:33:14.629 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:33:14.699 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:33:14.701 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:33:14.701 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:33:14.748 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:33:14.797 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:33:14.835 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:33:14.837 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:33:14.837 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:33:14.875 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:33:14.878 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:33:14.878 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:33:14.947 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:33:14.952 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:33:14.953 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:33:15.033 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-09-12T00:33:15.033 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:33:15.033 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:33:15.033 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:33:15.033 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:33:16.624 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-09-12T00:33:16.624 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: exclusive 2024-09-12T00:33:16.625 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-09-12T00:33:16.625 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-09-12T00:33:16.625 INFO:tasks.workunit.client.0.smithi083.stdout: client.5157 expiration=2024-09-12T00:35:16.622983+0000 addr=v1:172.21.15.83:0/415329876 cookie= 2024-09-12T00:33:16.628 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-09-12T00:33:16.628 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: shared 2024-09-12T00:33:16.628 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-09-12T00:33:16.628 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-09-12T00:33:16.629 INFO:tasks.workunit.client.0.smithi083.stdout: client.5018 expiration=0.000000 addr=v1:172.21.15.83:0/4056697233 cookie= 2024-09-12T00:33:16.629 INFO:tasks.workunit.client.0.smithi083.stdout: client.5157 expiration=2024-09-12T00:35:16.629424+0000 addr=v1:172.21.15.83:0/415329876 cookie= 2024-09-12T00:33:16.630 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-09-12T00:33:16.630 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: shared 2024-09-12T00:33:16.630 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-09-12T00:33:16.630 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-09-12T00:33:16.630 INFO:tasks.workunit.client.0.smithi083.stdout: client.5018 expiration=0.000000 addr=v1:172.21.15.83:0/4056697233 cookie= 2024-09-12T00:33:17.600 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestMultiLocking (2567 ms) 2024-09-12T00:33:17.600 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:33:19.849 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-09-12T00:33:19.849 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: shared 2024-09-12T00:33:19.849 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-09-12T00:33:19.849 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-09-12T00:33:19.849 INFO:tasks.workunit.client.0.smithi083.stdout: client.5030 expiration=0.000000 addr=v1:172.21.15.83:0/1259301059 cookie= 2024-09-12T00:33:19.851 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-09-12T00:33:19.851 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: exclusive 2024-09-12T00:33:19.851 INFO:tasks.workunit.client.0.smithi083.stdout: tag: new_tag 2024-09-12T00:33:19.851 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-09-12T00:33:19.852 INFO:tasks.workunit.client.0.smithi083.stdout: client.5024 expiration=0.000000 addr=v1:172.21.15.83:0/70239375 cookie= 2024-09-12T00:33:20.625 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestMeta (3024 ms) 2024-09-12T00:33:20.625 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:33:22.648 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-09-12T00:33:22.648 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: exclusive 2024-09-12T00:33:22.648 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-09-12T00:33:22.648 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-09-12T00:33:22.651 INFO:tasks.workunit.client.0.smithi083.stdout:lock: mylock 2024-09-12T00:33:22.651 INFO:tasks.workunit.client.0.smithi083.stdout: lock_type: shared 2024-09-12T00:33:22.651 INFO:tasks.workunit.client.0.smithi083.stdout: tag: 2024-09-12T00:33:22.651 INFO:tasks.workunit.client.0.smithi083.stdout: lockers: 2024-09-12T00:33:22.651 INFO:tasks.workunit.client.0.smithi083.stdout: client.5033 expiration=0.000000 addr=v1:172.21.15.83:0/1477529295 cookie= 2024-09-12T00:33:22.651 INFO:tasks.workunit.client.0.smithi083.stdout: client.5033 expiration=0.000000 addr=v1:172.21.15.83:0/1477529295 cookie=new cookie 2024-09-12T00:33:23.653 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestCookie (3029 ms) 2024-09-12T00:33:23.653 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:33:26.678 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestMultipleLocks (3022 ms) 2024-09-12T00:33:26.678 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:33:34.708 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestLockDuration (8033 ms) 2024-09-12T00:33:34.708 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:33:37.747 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestAssertLocked (3038 ms) 2024-09-12T00:33:37.747 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:33:40.777 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestSetCookie (3026 ms) 2024-09-12T00:33:40.778 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:34:01.827 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestRenew (21055 ms) 2024-09-12T00:34:01.827 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:34:08.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7038 ms) 2024-09-12T00:34:08.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:34:16.905 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8039 ms) 2024-09-12T00:34:16.905 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:34:24.937 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8032 ms) 2024-09-12T00:34:24.938 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from ClsLock (69904 ms total) 2024-09-12T00:34:24.938 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:34:24.938 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:24.938 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 11 tests from 1 test suite ran. (69904 ms total) 2024-09-12T00:34:24.938 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 11 tests. 2024-09-12T00:34:24.941 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:34:24.941 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:34:25.024 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:34:25.026 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:34:25.026 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:34:25.112 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-09-12T00:34:25.112 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:34:25.112 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:25.112 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from cls_log 2024-09-12T00:34:25.112 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:34:27.956 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_log.test_log_add_same_time (2844 ms) 2024-09-12T00:34:27.956 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:34:30.973 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_log.test_log_add_different_time (3016 ms) 2024-09-12T00:34:30.973 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:34:33.998 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_log.trim_by_time (3025 ms) 2024-09-12T00:34:33.998 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:34:37.015 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_log.trim_by_marker (3018 ms) 2024-09-12T00:34:37.015 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from cls_log (11903 ms total) 2024-09-12T00:34:37.015 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:34:37.015 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:37.015 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 4 tests from 1 test suite ran. (11903 ms total) 2024-09-12T00:34:37.015 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 4 tests. 2024-09-12T00:34:37.018 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:34:37.018 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:34:37.063 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:34:37.065 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:34:37.065 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:34:37.111 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-09-12T00:34:37.111 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:34:37.111 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:37.111 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:34:37.111 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:34:40.048 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_implicit (2933 ms) 2024-09-12T00:34:40.048 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:34:43.064 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3020 ms) 2024-09-12T00:34:43.065 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:34:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_put_snap (9047 ms) 2024-09-12T00:34:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:34:55.129 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_explicit (3016 ms) 2024-09-12T00:34:55.129 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:34:58.144 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.set (3017 ms) 2024-09-12T00:34:58.144 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:35:05.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_implicit_ec (7016 ms) 2024-09-12T00:35:05.160 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:35:12.235 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7075 ms) 2024-09-12T00:35:12.235 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:35:24.320 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_put_snap_ec (12084 ms) 2024-09-12T00:35:24.320 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:35:31.367 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.test_explicit_ec (7048 ms) 2024-09-12T00:35:31.367 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:35:38.407 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_refcount.set_ec (7040 ms) 2024-09-12T00:35:38.407 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 10 tests from cls_refcount (61296 ms total) 2024-09-12T00:35:38.407 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:35:38.407 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:35:38.407 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 10 tests from 1 test suite ran. (61296 ms total) 2024-09-12T00:35:38.407 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 10 tests. 2024-09-12T00:35:38.410 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:35:38.410 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:35:38.452 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:35:38.453 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:35:38.454 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:35:40.419 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:35:40.469 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_basic (51 ms) 2024-09-12T00:35:40.469 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:35:40.500 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (31 ms) 2024-09-12T00:35:40.500 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:35:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_remove_object (36 ms) 2024-09-12T00:35:40.537 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:35:42.000 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_suggest (1464 ms) 2024-09-12T00:35:42.000 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:35:42.005 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_suggest_complete (6 ms) 2024-09-12T00:35:42.006 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:35:42.027 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_list (21 ms) 2024-09-12T00:35:42.027 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:36:05.121 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_list_delimited (23094 ms) 2024-09-12T00:36:05.122 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:36:05.204 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.bi_list (82 ms) 2024-09-12T00:36:05.204 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:36:05.216 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.gc_set (12 ms) 2024-09-12T00:36:05.216 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:36:05.429 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.gc_list (213 ms) 2024-09-12T00:36:05.429 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:36:12.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.gc_defer (7073 ms) 2024-09-12T00:36:12.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:36:12.608 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.usage_basic (106 ms) 2024-09-12T00:36:12.608 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:36:12.609 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-12T00:36:12.609 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:36:12.706 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.usage_clear (97 ms) 2024-09-12T00:36:12.706 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:36:12.760 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.bi_log_trim (54 ms) 2024-09-12T00:36:12.760 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:36:12.776 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.index_racing_removes (17 ms) 2024-09-12T00:36:12.776 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.reshardlog_list (216 ms) 2024-09-12T00:36:12.993 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.reshardlog_num (11 ms) 2024-09-12T00:36:13.004 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:36:13.032 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw.bi_put_entries (28 ms) 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from cls_rgw (32614 ms total) 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 19 tests from 1 test suite ran. (34977 ms total) 2024-09-12T00:36:13.516 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 19 tests. 2024-09-12T00:36:13.519 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:13.520 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:13.562 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:36:13.563 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:36:13.563 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:36:13.649 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-09-12T00:36:13.649 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:36:13.649 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:13.649 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:36:13.649 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:36:15.539 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.init (1890 ms) 2024-09-12T00:36:15.539 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:36:15.567 INFO:tasks.workunit.client.0.smithi083.stderr:[ ] list info tag = chain-0 2024-09-12T00:36:15.567 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (28 ms) 2024-09-12T00:36:15.568 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:36:15.574 INFO:tasks.workunit.client.0.smithi083.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:36:15.574 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-09-12T00:36:15.574 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:36:15.583 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2024-09-12T00:36:15.583 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:36:15.592 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (9 ms) 2024-09-12T00:36:15.592 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:36:15.599 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (8 ms) 2024-09-12T00:36:15.600 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:36:15.607 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (7 ms) 2024-09-12T00:36:15.607 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:36:15.613 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (6 ms) 2024-09-12T00:36:15.613 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:36:16.543 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_gc.finalize (928 ms) 2024-09-12T00:36:16.543 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from cls_rgw_gc (2892 ms total) 2024-09-12T00:36:16.543 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:36:16.543 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:16.543 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 9 tests from 1 test suite ran. (2892 ms total) 2024-09-12T00:36:16.543 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 9 tests. 2024-09-12T00:36:16.545 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:16.545 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:16.588 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:36:16.590 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:36:16.590 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:36:16.685 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:16.685 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:16.686 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:36:16.686 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:18.550 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:36:18.550 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:36:18.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.566+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~YXCH24FTI598.0 size=1048576 2024-09-12T00:36:18.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.568+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~YXCH24FTI598.1 size=1048576 2024-09-12T00:36:18.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.569+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~YXCH24FTI598.2 size=1004110 2024-09-12T00:36:18.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.569+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=YXCH24FTI598 tag=TTQHONKIGRSO type=write size=4149838 2024-09-12T00:36:18.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.572+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~UKCCL76S120N.0 size=420802 2024-09-12T00:36:18.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.572+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=UKCCL76S120N tag=ULCVRDU8T9IR type=write size=1469378 2024-09-12T00:36:18.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.573+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=P98VQCRCJZ08 type=del size=469546 2024-09-12T00:36:18.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.576+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~D1HWKJLMGPM7.0 size=896256 2024-09-12T00:36:18.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.576+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=D1HWKJLMGPM7 tag=6BNB60BFNZVH type=write size=1944832 2024-09-12T00:36:18.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.578+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=1UBN9VUG7NIR type=del size=1298595 2024-09-12T00:36:18.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.581+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~LXLHORD3YG9B.0 size=1048576 2024-09-12T00:36:18.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.583+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~LXLHORD3YG9B.1 size=1048576 2024-09-12T00:36:18.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.584+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~LXLHORD3YG9B.2 size=501977 2024-09-12T00:36:18.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.584+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=LXLHORD3YG9B tag=3DFFGPUWEXKU type=write size=3647705 2024-09-12T00:36:18.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.586+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=WOX2AJYN2QIY type=del size=127309 2024-09-12T00:36:18.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.587+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=ZGD7C45ZQXT5 type=write size=603059 2024-09-12T00:36:18.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.589+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=CTEY1JDEZ7FE type=del size=3590066 2024-09-12T00:36:18.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.591+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=DG2TKIV1PZOA type=del size=1170077 2024-09-12T00:36:18.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.594+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~78J5FH2Z3KVQ.0 size=1048576 2024-09-12T00:36:18.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.595+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~78J5FH2Z3KVQ.1 size=1015986 2024-09-12T00:36:18.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.595+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=78J5FH2Z3KVQ tag=KCKFTT3QQZEG type=write size=3113138 2024-09-12T00:36:18.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.599+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~CWOQWPVYAYB8.0 size=1048576 2024-09-12T00:36:18.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.601+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~CWOQWPVYAYB8.1 size=267907 2024-09-12T00:36:18.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.601+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=CWOQWPVYAYB8 tag=83C5XPV397ZQ type=write size=2365059 2024-09-12T00:36:18.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.602+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=NUPDNBDWOGLG type=del size=2525650 2024-09-12T00:36:18.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.603+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=H3MP0Z9NK57M type=del size=1693460 2024-09-12T00:36:18.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.605+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=Y1DV2B4997LC type=del size=1820594 2024-09-12T00:36:18.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.607+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~P3REB3YM5HGR.0 size=388824 2024-09-12T00:36:18.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.607+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=P3REB3YM5HGR tag=OC33HR9OI36O type=write size=1437400 2024-09-12T00:36:18.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.609+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~YXCH24FTI598.0 size=1048576 2024-09-12T00:36:18.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.611+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~YXCH24FTI598.1 size=1048576 2024-09-12T00:36:18.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.612+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~YXCH24FTI598.2 size=1004110 2024-09-12T00:36:18.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.614+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=YXCH24FTI598 tag=TTQHONKIGRSO type=write size=4149838 2024-09-12T00:36:18.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.617+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~IJXQIR54W3X0.0 size=796978 2024-09-12T00:36:18.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.617+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=IJXQIR54W3X0 tag=RM8NRN50ILDU type=write size=1845554 2024-09-12T00:36:18.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.618+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~UKCCL76S120N.0 size=420802 2024-09-12T00:36:18.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.620+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=UKCCL76S120N tag=ULCVRDU8T9IR type=write size=1469378 2024-09-12T00:36:18.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.623+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~F3CW9HAQH647.0 size=154058 2024-09-12T00:36:18.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.623+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=F3CW9HAQH647 tag=Z5LMZ56P6JWN type=write size=1202634 2024-09-12T00:36:18.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.625+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=P98VQCRCJZ08 type=del 2024-09-12T00:36:18.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.626+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=I6ULSXO49SZ1 type=del size=1908026 2024-09-12T00:36:18.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.628+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~D1HWKJLMGPM7.0 size=896256 2024-09-12T00:36:18.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.630+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=D1HWKJLMGPM7 tag=6BNB60BFNZVH type=write size=1944832 2024-09-12T00:36:18.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.632+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=6WBNODK65T4Z type=del size=2356244 2024-09-12T00:36:18.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.636+0000 7f030cb87780 1 < suggested remove operation key=327RDLIWLVRO tag=1UBN9VUG7NIR type=del 2024-09-12T00:36:18.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.637+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=UIQWBE23UVYT type=del size=2621909 2024-09-12T00:36:18.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.639+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~LXLHORD3YG9B.0 size=1048576 2024-09-12T00:36:18.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.641+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~LXLHORD3YG9B.1 size=1048576 2024-09-12T00:36:18.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.642+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~LXLHORD3YG9B.2 size=501977 2024-09-12T00:36:18.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.645+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=LXLHORD3YG9B tag=3DFFGPUWEXKU type=write size=3647705 2024-09-12T00:36:18.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.647+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=XRNA3XWX0015 type=write size=342189 2024-09-12T00:36:18.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.649+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=WOX2AJYN2QIY type=del 2024-09-12T00:36:18.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.650+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=9UR7TXN64OZG type=del size=352720 2024-09-12T00:36:18.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.652+0000 7f030cb87780 1 < completed write operation key=9MCRD2G3MZIT tag=ZGD7C45ZQXT5 type=write size=603059 2024-09-12T00:36:18.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.655+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~JK0H438P8960.0 size=1048576 2024-09-12T00:36:18.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.656+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~JK0H438P8960.1 size=1048576 2024-09-12T00:36:18.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.657+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~JK0H438P8960.2 size=782544 2024-09-12T00:36:18.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.657+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=JK0H438P8960 tag=7WRO0U9UU4R7 type=write size=3928272 2024-09-12T00:36:18.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.660+0000 7f030cb87780 1 < suggested remove operation key=CY2NS03IIUJJ tag=CTEY1JDEZ7FE type=del 2024-09-12T00:36:18.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.661+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=XBNLFDV1YVV8 type=del size=4127368 2024-09-12T00:36:18.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.664+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=DG2TKIV1PZOA type=del 2024-09-12T00:36:18.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.665+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=09JDGTJNRH92 type=del size=811568 2024-09-12T00:36:18.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.666+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~78J5FH2Z3KVQ.0 size=1048576 2024-09-12T00:36:18.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.666+0000 7f030cb87780 1 < canceled part key=_multipart_UFYMVGL264T8.2~78J5FH2Z3KVQ.1 size=1015986 2024-09-12T00:36:18.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.668+0000 7f030cb87780 1 < canceled multipart upload key=UFYMVGL264T8 upload=78J5FH2Z3KVQ tag=KCKFTT3QQZEG type=write size=3113138 2024-09-12T00:36:18.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.673+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~84D8QFRCLAL4.0 size=1048576 2024-09-12T00:36:18.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.674+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~84D8QFRCLAL4.1 size=710813 2024-09-12T00:36:18.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.674+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=84D8QFRCLAL4 tag=E3FHSD6C3SS4 type=write size=2807965 2024-09-12T00:36:18.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.676+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~CWOQWPVYAYB8.0 size=1048576 2024-09-12T00:36:18.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.676+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~CWOQWPVYAYB8.1 size=267907 2024-09-12T00:36:18.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.679+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=CWOQWPVYAYB8 tag=83C5XPV397ZQ type=write size=2365059 2024-09-12T00:36:18.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.682+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~3HEGO4PXW97C.0 size=1048576 2024-09-12T00:36:18.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.683+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~3HEGO4PXW97C.1 size=1048576 2024-09-12T00:36:18.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.684+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~3HEGO4PXW97C.2 size=67843 2024-09-12T00:36:18.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.684+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=3HEGO4PXW97C tag=SG56Y4TVL66F type=write size=3213571 2024-09-12T00:36:18.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.685+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=NUPDNBDWOGLG type=del 2024-09-12T00:36:18.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.686+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=9U0H5MFTKNFE type=del size=4013696 2024-09-12T00:36:18.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.688+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=H3MP0Z9NK57M type=del 2024-09-12T00:36:18.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.689+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=NRB65U8HL74E type=del size=2490665 2024-09-12T00:36:18.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.690+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=Y1DV2B4997LC type=del 2024-09-12T00:36:18.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.693+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~0CLKUXJV76VU.0 size=1048576 2024-09-12T00:36:18.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.694+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~0CLKUXJV76VU.1 size=1048576 2024-09-12T00:36:18.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.695+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~0CLKUXJV76VU.2 size=1040399 2024-09-12T00:36:18.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.695+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=0CLKUXJV76VU tag=QGD7PUYAZTBL type=write size=4186127 2024-09-12T00:36:18.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.696+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~P3REB3YM5HGR.0 size=388824 2024-09-12T00:36:18.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.699+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=P3REB3YM5HGR tag=OC33HR9OI36O type=write size=1437400 2024-09-12T00:36:18.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.701+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~POD84G60VXFI.0 size=1048576 2024-09-12T00:36:18.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.702+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~POD84G60VXFI.1 size=437809 2024-09-12T00:36:18.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.702+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=POD84G60VXFI tag=CU1WBS5ZZCP4 type=write size=2534961 2024-09-12T00:36:18.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.703+0000 7f030cb87780 1 < canceled part key=_multipart_OR439FK5L43V.2~IJXQIR54W3X0.0 size=796978 2024-09-12T00:36:18.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.705+0000 7f030cb87780 1 < canceled multipart upload key=OR439FK5L43V upload=IJXQIR54W3X0 tag=RM8NRN50ILDU type=write size=1845554 2024-09-12T00:36:18.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.707+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~FTTSZP2N9BB7.0 size=1048576 2024-09-12T00:36:18.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.708+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~FTTSZP2N9BB7.1 size=917939 2024-09-12T00:36:18.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.708+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=FTTSZP2N9BB7 tag=CSSYQ2IUXRK0 type=write size=3015091 2024-09-12T00:36:18.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.711+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~F3CW9HAQH647.0 size=154058 2024-09-12T00:36:18.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.712+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=F3CW9HAQH647 tag=Z5LMZ56P6JWN type=write size=1202634 2024-09-12T00:36:18.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.714+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=OS9NF13LUR9Z type=write size=727105 2024-09-12T00:36:18.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.716+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=I6ULSXO49SZ1 type=del 2024-09-12T00:36:18.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.718+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~RSZM8D1BPRYF.0 size=840871 2024-09-12T00:36:18.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.718+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=RSZM8D1BPRYF tag=41FRDZL72O9M type=write size=1889447 2024-09-12T00:36:18.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.721+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=6WBNODK65T4Z type=del 2024-09-12T00:36:18.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.722+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=DAUVSHUS1ORR type=write size=309618 2024-09-12T00:36:18.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.725+0000 7f030cb87780 1 < suggested remove operation key=99OWKRGA8ZZN tag=UIQWBE23UVYT type=del 2024-09-12T00:36:18.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.726+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=PZFR1NBR5I5C type=write size=745619 2024-09-12T00:36:18.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.728+0000 7f030cb87780 1 < completed write operation key=JRPD5AAK84ZD tag=XRNA3XWX0015 type=write size=342189 2024-09-12T00:36:18.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.729+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=F28PS78PAYD9 type=write size=920102 2024-09-12T00:36:18.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.730+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=9UR7TXN64OZG type=del 2024-09-12T00:36:18.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.733+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~3O4HQSP5L8VE.0 size=935718 2024-09-12T00:36:18.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.733+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=3O4HQSP5L8VE tag=I650377VOLHK type=write size=1984294 2024-09-12T00:36:18.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.734+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~JK0H438P8960.0 size=1048576 2024-09-12T00:36:18.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.735+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~JK0H438P8960.1 size=1048576 2024-09-12T00:36:18.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.736+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~JK0H438P8960.2 size=782544 2024-09-12T00:36:18.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.739+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=JK0H438P8960 tag=7WRO0U9UU4R7 type=write size=3928272 2024-09-12T00:36:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.740+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=SYC33GX3T5MY type=del size=3452932 2024-09-12T00:36:18.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.741+0000 7f030cb87780 -1 < no bi entry to suggest for operation key=99OWKRGA8ZZN tag=XBNLFDV1YVV8 type=del size=4127368: (2) No such file or directory 2024-09-12T00:36:18.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.744+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~64H41ZLF19R6.0 size=1048576 2024-09-12T00:36:18.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.744+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~64H41ZLF19R6.1 size=1048576 2024-09-12T00:36:18.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.745+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~64H41ZLF19R6.2 size=813548 2024-09-12T00:36:18.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.745+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=64H41ZLF19R6 tag=7LO3304ILAE2 type=write size=3959276 2024-09-12T00:36:18.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.748+0000 7f030cb87780 1 < suggested remove operation key=92GDVW0Q8VKQ tag=09JDGTJNRH92 type=del 2024-09-12T00:36:18.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.749+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=RQSK3H0TFLH4 type=del size=281006 2024-09-12T00:36:18.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.751+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~84D8QFRCLAL4.0 size=1048576 2024-09-12T00:36:18.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.752+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~84D8QFRCLAL4.1 size=710813 2024-09-12T00:36:18.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.754+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=84D8QFRCLAL4 tag=E3FHSD6C3SS4 type=write size=2807965 2024-09-12T00:36:18.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.757+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~LX737BGSDUG6.0 size=1048576 2024-09-12T00:36:18.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.758+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~LX737BGSDUG6.1 size=1048576 2024-09-12T00:36:18.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.759+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~LX737BGSDUG6.2 size=60743 2024-09-12T00:36:18.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.759+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=LX737BGSDUG6 tag=GIHS98KEVYGL type=write size=3206471 2024-09-12T00:36:18.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.760+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~3HEGO4PXW97C.0 size=1048576 2024-09-12T00:36:18.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.760+0000 7f030cb87780 1 < canceled part key=_multipart_JRPD5AAK84ZD.2~3HEGO4PXW97C.1 size=1048576 2024-09-12T00:36:18.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.761+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~3HEGO4PXW97C.2 size=67843 2024-09-12T00:36:18.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.764+0000 7f030cb87780 1 < canceled multipart upload key=JRPD5AAK84ZD upload=3HEGO4PXW97C tag=SG56Y4TVL66F type=write size=3213571 2024-09-12T00:36:18.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.766+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=O2U95Q3WJA2P type=del size=1384946 2024-09-12T00:36:18.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.769+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=9U0H5MFTKNFE type=del 2024-09-12T00:36:18.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.772+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~Y2X0XOGVYW0E.0 size=328093 2024-09-12T00:36:18.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.772+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=Y2X0XOGVYW0E tag=QFD0UQPE36J9 type=write size=1376669 2024-09-12T00:36:18.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.774+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=NRB65U8HL74E type=del 2024-09-12T00:36:18.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.776+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~2YIUHB90A2RT.0 size=1048576 2024-09-12T00:36:18.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.778+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~2YIUHB90A2RT.1 size=1048576 2024-09-12T00:36:18.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.779+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~2YIUHB90A2RT.2 size=931108 2024-09-12T00:36:18.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.779+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=2YIUHB90A2RT tag=3M8Q4Q3IKPI4 type=write size=4076836 2024-09-12T00:36:18.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.780+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~0CLKUXJV76VU.0 size=1048576 2024-09-12T00:36:18.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.782+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~0CLKUXJV76VU.1 size=1048576 2024-09-12T00:36:18.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.783+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~0CLKUXJV76VU.2 size=1040399 2024-09-12T00:36:18.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.786+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=0CLKUXJV76VU tag=QGD7PUYAZTBL type=write size=4186127 2024-09-12T00:36:18.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.787+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=1W2V22NIJ1Q7 type=del size=1998373 2024-09-12T00:36:18.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.787+0000 7f030cb87780 1 < canceled part key=_multipart_56I20YIPY82N.2~POD84G60VXFI.0 size=1048576 2024-09-12T00:36:18.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.788+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~POD84G60VXFI.1 size=437809 2024-09-12T00:36:18.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.791+0000 7f030cb87780 1 < canceled multipart upload key=56I20YIPY82N upload=POD84G60VXFI tag=CU1WBS5ZZCP4 type=write size=2534961 2024-09-12T00:36:18.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.792+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=02SUVHEY4ZW3 type=write size=433704 2024-09-12T00:36:18.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.794+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~FTTSZP2N9BB7.0 size=1048576 2024-09-12T00:36:18.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.795+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~FTTSZP2N9BB7.1 size=917939 2024-09-12T00:36:18.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.797+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=FTTSZP2N9BB7 tag=CSSYQ2IUXRK0 type=write size=3015091 2024-09-12T00:36:18.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.798+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=2XXANK5SANFZ type=del size=2378982 2024-09-12T00:36:18.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.801+0000 7f030cb87780 1 < suggested update operation key=86TWUAZAHI4I tag=OS9NF13LUR9Z type=write size=727105 2024-09-12T00:36:18.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.803+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~TV18J7I6DHX3.0 size=863105 2024-09-12T00:36:18.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.803+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=TV18J7I6DHX3 tag=2W4YI939RBN0 type=write size=1911681 2024-09-12T00:36:18.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.805+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~RSZM8D1BPRYF.0 size=840871 2024-09-12T00:36:18.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.807+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=RSZM8D1BPRYF tag=41FRDZL72O9M type=write size=1889447 2024-09-12T00:36:18.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.808+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=Y1MMY8WGMAM5 type=write size=816892 2024-09-12T00:36:18.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.810+0000 7f030cb87780 1 < completed write operation key=U5CWO1EN8BFI tag=DAUVSHUS1ORR type=write size=309618 2024-09-12T00:36:18.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.811+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=4MEFL25B5FR2 type=del size=2100361 2024-09-12T00:36:18.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.814+0000 7f030cb87780 1 < completed write operation key=U5CWO1EN8BFI tag=PZFR1NBR5I5C type=write size=745619 2024-09-12T00:36:18.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.815+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=3ZVG1FROLVCE type=del size=714093 2024-09-12T00:36:18.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.817+0000 7f030cb87780 1 < completed write operation key=39WSAOA6P09M tag=F28PS78PAYD9 type=write size=920102 2024-09-12T00:36:18.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.819+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~WPASRDJ5BONO.0 size=1048576 2024-09-12T00:36:18.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.820+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~WPASRDJ5BONO.1 size=1048576 2024-09-12T00:36:18.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.821+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~WPASRDJ5BONO.2 size=82051 2024-09-12T00:36:18.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.821+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=WPASRDJ5BONO tag=S1NF1IQRYK37 type=write size=3227779 2024-09-12T00:36:18.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.823+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~3O4HQSP5L8VE.0 size=935718 2024-09-12T00:36:18.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.826+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=3O4HQSP5L8VE tag=I650377VOLHK type=write size=1984294 2024-09-12T00:36:18.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.828+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~MD1OCVC4JNHH.0 size=328740 2024-09-12T00:36:18.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.828+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=MD1OCVC4JNHH tag=BB1JK4WWBD8O type=write size=1377316 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.832+0000 7f030cb87780 1 < suggested remove operation key=V87B6SDB1HFZ tag=SYC33GX3T5MY type=del 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.832+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=U5NRQ9Z1QA2S type=del size=2166395 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.832+0000 7f030cb87780 1 < canceled part key=_multipart_1VOJGMWNKS0A.2~64H41ZLF19R6.0 size=1048576 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.834+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~64H41ZLF19R6.1 size=1048576 2024-09-12T00:36:18.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.835+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~64H41ZLF19R6.2 size=813548 2024-09-12T00:36:18.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.837+0000 7f030cb87780 1 < canceled multipart upload key=1VOJGMWNKS0A upload=64H41ZLF19R6 tag=7LO3304ILAE2 type=write size=3959276 2024-09-12T00:36:18.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.839+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~MUKGL1M8ZS9H.0 size=581157 2024-09-12T00:36:18.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.839+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=MUKGL1M8ZS9H tag=JMFLWWXEPMX4 type=write size=1629733 2024-09-12T00:36:18.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.841+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=RQSK3H0TFLH4 type=del 2024-09-12T00:36:18.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.842+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=HOJYZPNCU3CQ type=del size=1800798 2024-09-12T00:36:18.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.845+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~LX737BGSDUG6.0 size=1048576 2024-09-12T00:36:18.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.845+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~LX737BGSDUG6.1 size=1048576 2024-09-12T00:36:18.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.847+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~LX737BGSDUG6.2 size=60743 2024-09-12T00:36:18.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.849+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=LX737BGSDUG6 tag=GIHS98KEVYGL type=write size=3206471 2024-09-12T00:36:18.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.851+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=VTMQ1K2UI2DS type=del size=271218 2024-09-12T00:36:18.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.852+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=O2U95Q3WJA2P type=del 2024-09-12T00:36:18.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.856+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~V2HADJA69LX4.0 size=1012191 2024-09-12T00:36:18.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.856+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=V2HADJA69LX4 tag=P10XG0TCZ2IO type=write size=2060767 2024-09-12T00:36:18.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.857+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~Y2X0XOGVYW0E.0 size=328093 2024-09-12T00:36:18.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.860+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=Y2X0XOGVYW0E tag=QFD0UQPE36J9 type=write size=1376669 2024-09-12T00:36:18.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.862+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~ZB4NTXL7UT2K.0 size=366950 2024-09-12T00:36:18.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.862+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=ZB4NTXL7UT2K tag=OJ126OGIPV9A type=write size=1415526 2024-09-12T00:36:18.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.863+0000 7f030cb87780 1 < canceled part key=_multipart_327RDLIWLVRO.2~2YIUHB90A2RT.0 size=1048576 2024-09-12T00:36:18.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.864+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~2YIUHB90A2RT.1 size=1048576 2024-09-12T00:36:18.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.865+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~2YIUHB90A2RT.2 size=931108 2024-09-12T00:36:18.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.867+0000 7f030cb87780 1 < canceled multipart upload key=327RDLIWLVRO upload=2YIUHB90A2RT tag=3M8Q4Q3IKPI4 type=write size=4076836 2024-09-12T00:36:18.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.870+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~VYC9OU3A2HN4.0 size=1048576 2024-09-12T00:36:18.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.871+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~VYC9OU3A2HN4.1 size=1048576 2024-09-12T00:36:18.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.873+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~VYC9OU3A2HN4.2 size=901088 2024-09-12T00:36:18.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.873+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=VYC9OU3A2HN4 tag=23YW4F41H2HH type=write size=4046816 2024-09-12T00:36:18.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.874+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=1W2V22NIJ1Q7 type=del 2024-09-12T00:36:18.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.877+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~NA0VVTTT3MZ0.0 size=1048576 2024-09-12T00:36:18.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.878+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~NA0VVTTT3MZ0.1 size=1048576 2024-09-12T00:36:18.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.879+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~NA0VVTTT3MZ0.2 size=255595 2024-09-12T00:36:18.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.879+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=NA0VVTTT3MZ0 tag=9DSAL00KHVBU type=write size=3401323 2024-09-12T00:36:18.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.881+0000 7f030cb87780 1 < completed write operation key=INFFH9R3EFRY tag=02SUVHEY4ZW3 type=write size=433704 2024-09-12T00:36:18.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.883+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=V56ZE6MV6OI3 type=write size=347696 2024-09-12T00:36:18.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.884+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=2XXANK5SANFZ type=del 2024-09-12T00:36:18.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.887+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~AJPYHV2GMX47.0 size=593341 2024-09-12T00:36:18.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.887+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=AJPYHV2GMX47 tag=5STJHS1AI5HX type=write size=1641917 2024-09-12T00:36:18.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.888+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~TV18J7I6DHX3.0 size=863105 2024-09-12T00:36:18.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.891+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=TV18J7I6DHX3 tag=2W4YI939RBN0 type=write size=1911681 2024-09-12T00:36:18.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.893+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~K3W08JXKWN9R.0 size=1048576 2024-09-12T00:36:18.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.895+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~K3W08JXKWN9R.1 size=178445 2024-09-12T00:36:18.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.895+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=K3W08JXKWN9R tag=P9OWGF9YQ497 type=write size=2275597 2024-09-12T00:36:18.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.896+0000 7f030cb87780 1 < completed write operation key=N3KD1UVUVM95 tag=Y1MMY8WGMAM5 type=write size=816892 2024-09-12T00:36:18.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.899+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~LQ8XBFH1EPGU.0 size=1048576 2024-09-12T00:36:18.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.900+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~LQ8XBFH1EPGU.1 size=1048576 2024-09-12T00:36:18.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.902+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~LQ8XBFH1EPGU.2 size=617785 2024-09-12T00:36:18.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.902+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=LQ8XBFH1EPGU tag=589PVNU06P3R type=write size=3763513 2024-09-12T00:36:18.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.903+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=4MEFL25B5FR2 type=del 2024-09-12T00:36:18.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.906+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~C8DKXTH21HL1.0 size=1048576 2024-09-12T00:36:18.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.907+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~C8DKXTH21HL1.1 size=240337 2024-09-12T00:36:18.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.907+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=C8DKXTH21HL1 tag=30L28AGF7QC7 type=write size=2337489 2024-09-12T00:36:18.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.910+0000 7f030cb87780 1 < suggested remove operation key=56I20YIPY82N tag=3ZVG1FROLVCE type=del 2024-09-12T00:36:18.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.911+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=4IKUDH27VYW9 type=del size=918897 2024-09-12T00:36:18.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.914+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~WPASRDJ5BONO.0 size=1048576 2024-09-12T00:36:18.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.915+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~WPASRDJ5BONO.1 size=1048576 2024-09-12T00:36:18.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.916+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~WPASRDJ5BONO.2 size=82051 2024-09-12T00:36:18.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.918+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=WPASRDJ5BONO tag=S1NF1IQRYK37 type=write size=3227779 2024-09-12T00:36:18.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.922+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~2CL1CNB3GRRL.0 size=1048576 2024-09-12T00:36:18.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.923+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~2CL1CNB3GRRL.1 size=489813 2024-09-12T00:36:18.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.923+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=2CL1CNB3GRRL tag=DXP5P708GY2A type=write size=2586965 2024-09-12T00:36:18.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.924+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~MD1OCVC4JNHH.0 size=328740 2024-09-12T00:36:18.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.927+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=MD1OCVC4JNHH tag=BB1JK4WWBD8O type=write size=1377316 2024-09-12T00:36:18.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.930+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~9BACJHPXKSKY.0 size=1048576 2024-09-12T00:36:18.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.931+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~9BACJHPXKSKY.1 size=463432 2024-09-12T00:36:18.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.931+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=9BACJHPXKSKY tag=2PLM2P9C1CGC type=write size=2560584 2024-09-12T00:36:18.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.932+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=U5NRQ9Z1QA2S type=del 2024-09-12T00:36:18.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.935+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~JKX5G8R363BU.0 size=1048576 2024-09-12T00:36:18.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.936+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~JKX5G8R363BU.1 size=212772 2024-09-12T00:36:18.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.936+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=JKX5G8R363BU tag=Q25BF827NWSU type=write size=2309924 2024-09-12T00:36:18.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.936+0000 7f030cb87780 1 < canceled part key=_multipart_327RDLIWLVRO.2~MUKGL1M8ZS9H.0 size=581157 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.938+0000 7f030cb87780 1 < canceled multipart upload key=327RDLIWLVRO upload=MUKGL1M8ZS9H tag=JMFLWWXEPMX4 type=write size=1629733 2024-09-12T00:36:18.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.941+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~SM5N265LOW8T.0 size=356742 2024-09-12T00:36:18.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.941+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=SM5N265LOW8T tag=6CJX4YEGRJIR type=write size=1405318 2024-09-12T00:36:18.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.944+0000 7f030cb87780 1 < suggested remove operation key=POC8YA58U55N tag=HOJYZPNCU3CQ type=del 2024-09-12T00:36:18.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.945+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=LPS2GL2S1UPH type=del size=1669176 2024-09-12T00:36:18.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.946+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=VTMQ1K2UI2DS type=del 2024-09-12T00:36:18.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.949+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~12VT2YJB8PRA.0 size=704945 2024-09-12T00:36:18.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.949+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=12VT2YJB8PRA tag=DE0GHJYAS87Y type=write size=1753521 2024-09-12T00:36:18.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.950+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~V2HADJA69LX4.0 size=1012191 2024-09-12T00:36:18.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.952+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=V2HADJA69LX4 tag=P10XG0TCZ2IO type=write size=2060767 2024-09-12T00:36:18.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.953+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=FOUN1356VY0Q type=del size=2940071 2024-09-12T00:36:18.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.955+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~ZB4NTXL7UT2K.0 size=366950 2024-09-12T00:36:18.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.957+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=ZB4NTXL7UT2K tag=OJ126OGIPV9A type=write size=1415526 2024-09-12T00:36:18.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.958+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=OVQ7V84A5UBG type=del size=2198166 2024-09-12T00:36:18.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.959+0000 7f030cb87780 1 < canceled part key=_multipart_HUDEU16YTO0Y.2~VYC9OU3A2HN4.0 size=1048576 2024-09-12T00:36:18.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.959+0000 7f030cb87780 1 < canceled part key=_multipart_HUDEU16YTO0Y.2~VYC9OU3A2HN4.1 size=1048576 2024-09-12T00:36:18.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.960+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~VYC9OU3A2HN4.2 size=901088 2024-09-12T00:36:18.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.962+0000 7f030cb87780 1 < canceled multipart upload key=HUDEU16YTO0Y upload=VYC9OU3A2HN4 tag=23YW4F41H2HH type=write size=4046816 2024-09-12T00:36:18.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.963+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=EJRXBPAR1S89 type=write size=923952 2024-09-12T00:36:18.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.964+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~NA0VVTTT3MZ0.0 size=1048576 2024-09-12T00:36:18.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.965+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~NA0VVTTT3MZ0.1 size=1048576 2024-09-12T00:36:18.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.967+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~NA0VVTTT3MZ0.2 size=255595 2024-09-12T00:36:18.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.969+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=NA0VVTTT3MZ0 tag=9DSAL00KHVBU type=write size=3401323 2024-09-12T00:36:18.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.970+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=TCBIG48TMXKP type=del size=4136060 2024-09-12T00:36:18.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.973+0000 7f030cb87780 1 < suggested remove operation key=DLR6A7XOERHW tag=V56ZE6MV6OI3 type=write 2024-09-12T00:36:18.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.974+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=SRRGM2407U2J type=del size=1185388 2024-09-12T00:36:18.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.976+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~AJPYHV2GMX47.0 size=593341 2024-09-12T00:36:18.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.978+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=AJPYHV2GMX47 tag=5STJHS1AI5HX type=write size=1641917 2024-09-12T00:36:18.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.979+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=GEX2D2BIO4BW type=del size=2716932 2024-09-12T00:36:18.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.981+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~K3W08JXKWN9R.0 size=1048576 2024-09-12T00:36:18.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.982+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~K3W08JXKWN9R.1 size=178445 2024-09-12T00:36:18.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.984+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=K3W08JXKWN9R tag=P9OWGF9YQ497 type=write size=2275597 2024-09-12T00:36:18.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.985+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=M2A34P1KG254 type=del size=993554 2024-09-12T00:36:18.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.987+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~LQ8XBFH1EPGU.0 size=1048576 2024-09-12T00:36:18.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.988+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~LQ8XBFH1EPGU.1 size=1048576 2024-09-12T00:36:18.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.989+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~LQ8XBFH1EPGU.2 size=617785 2024-09-12T00:36:18.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.991+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=LQ8XBFH1EPGU tag=589PVNU06P3R type=write size=3763513 2024-09-12T00:36:18.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.994+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~2QI06M49JF3S.0 size=1048576 2024-09-12T00:36:18.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.995+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~2QI06M49JF3S.1 size=739762 2024-09-12T00:36:18.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.995+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=2QI06M49JF3S tag=OQSD93633HAP type=write size=2836914 2024-09-12T00:36:18.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.997+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~C8DKXTH21HL1.0 size=1048576 2024-09-12T00:36:18.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:18.999+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~C8DKXTH21HL1.1 size=240337 2024-09-12T00:36:18.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.001+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=C8DKXTH21HL1 tag=30L28AGF7QC7 type=write size=2337489 2024-09-12T00:36:19.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.003+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~5PRYZP5MEZYW.0 size=1048576 2024-09-12T00:36:19.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.004+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~5PRYZP5MEZYW.1 size=755706 2024-09-12T00:36:19.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.004+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=5PRYZP5MEZYW tag=41WOC6VFQ77V type=write size=2852858 2024-09-12T00:36:19.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.006+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=4IKUDH27VYW9 type=del 2024-09-12T00:36:19.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.007+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=C8XTYZQMOXQ8 type=del size=1389890 2024-09-12T00:36:19.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.009+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~2CL1CNB3GRRL.0 size=1048576 2024-09-12T00:36:19.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.010+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~2CL1CNB3GRRL.1 size=489813 2024-09-12T00:36:19.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.012+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=2CL1CNB3GRRL tag=DXP5P708GY2A type=write size=2586965 2024-09-12T00:36:19.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.015+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~X9NTAJ8OTS9C.0 size=1048576 2024-09-12T00:36:19.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.016+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~X9NTAJ8OTS9C.1 size=1048576 2024-09-12T00:36:19.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.017+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~X9NTAJ8OTS9C.2 size=415238 2024-09-12T00:36:19.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.017+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=X9NTAJ8OTS9C tag=75RXZRWA212Q type=write size=3560966 2024-09-12T00:36:19.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.018+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~9BACJHPXKSKY.0 size=1048576 2024-09-12T00:36:19.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.020+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~9BACJHPXKSKY.1 size=463432 2024-09-12T00:36:19.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.023+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=9BACJHPXKSKY tag=2PLM2P9C1CGC type=write size=2560584 2024-09-12T00:36:19.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.024+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~DGES69LKY7KH.0 size=1048576 2024-09-12T00:36:19.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.026+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~DGES69LKY7KH.1 size=813654 2024-09-12T00:36:19.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.026+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=DGES69LKY7KH tag=1LBO5OMFGIKU type=write size=2910806 2024-09-12T00:36:19.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.027+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~JKX5G8R363BU.0 size=1048576 2024-09-12T00:36:19.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.028+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~JKX5G8R363BU.1 size=212772 2024-09-12T00:36:19.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.031+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=JKX5G8R363BU tag=Q25BF827NWSU type=write size=2309924 2024-09-12T00:36:19.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.033+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~FYNLUR89S62J.0 size=1048576 2024-09-12T00:36:19.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.035+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~FYNLUR89S62J.1 size=550249 2024-09-12T00:36:19.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.035+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=FYNLUR89S62J tag=EJLWHAUBE3TW type=write size=2647401 2024-09-12T00:36:19.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.035+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~SM5N265LOW8T.0 size=356742 2024-09-12T00:36:19.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.038+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=SM5N265LOW8T tag=6CJX4YEGRJIR type=write size=1405318 2024-09-12T00:36:19.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.039+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=B8ZKAAPTCAC9 type=del size=3892675 2024-09-12T00:36:19.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.040+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=LPS2GL2S1UPH type=del 2024-09-12T00:36:19.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.043+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~TYXN5A1TRB56.0 size=1048576 2024-09-12T00:36:19.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.044+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~TYXN5A1TRB56.1 size=869879 2024-09-12T00:36:19.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.044+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=TYXN5A1TRB56 tag=OXYPQT8CR4V4 type=write size=2967031 2024-09-12T00:36:19.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.046+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~12VT2YJB8PRA.0 size=704945 2024-09-12T00:36:19.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.048+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=12VT2YJB8PRA tag=DE0GHJYAS87Y type=write size=1753521 2024-09-12T00:36:19.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.049+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=J2REKWR3HPOD type=del size=2805928 2024-09-12T00:36:19.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.051+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=FOUN1356VY0Q type=del 2024-09-12T00:36:19.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.054+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~4AZUWL1QKCK5.0 size=1048576 2024-09-12T00:36:19.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.054+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~4AZUWL1QKCK5.1 size=703109 2024-09-12T00:36:19.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.054+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=4AZUWL1QKCK5 tag=RBQSG8HPJPSR type=write size=2800261 2024-09-12T00:36:19.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.056+0000 7f030cb87780 1 < canceled operation key=327RDLIWLVRO tag=OVQ7V84A5UBG type=del size=2198166 2024-09-12T00:36:19.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.057+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=6WA0PFF7LGA7 type=del size=2869201 2024-09-12T00:36:19.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.058+0000 7f030cb87780 1 < completed write operation key=JRPD5AAK84ZD tag=EJRXBPAR1S89 type=write size=923952 2024-09-12T00:36:19.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.062+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~9D4DY1WBKN9Y.0 size=1048576 2024-09-12T00:36:19.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.063+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~9D4DY1WBKN9Y.1 size=1048576 2024-09-12T00:36:19.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.064+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~9D4DY1WBKN9Y.2 size=512165 2024-09-12T00:36:19.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.064+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=9D4DY1WBKN9Y tag=VWVZIRKUY8AG type=write size=3657893 2024-09-12T00:36:19.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.065+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=TCBIG48TMXKP type=del 2024-09-12T00:36:19.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.067+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=UFDE494XY4XM type=del size=563592 2024-09-12T00:36:19.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.068+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=SRRGM2407U2J type=del 2024-09-12T00:36:19.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.070+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=JDKRWXTRRK3G type=del size=3065691 2024-09-12T00:36:19.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.071+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=GEX2D2BIO4BW type=del 2024-09-12T00:36:19.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.072+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=4HQRZHFYKXR0 type=del size=1748275 2024-09-12T00:36:19.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.074+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=M2A34P1KG254 type=del 2024-09-12T00:36:19.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.076+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~5OQANBBNYL69.0 size=585601 2024-09-12T00:36:19.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.076+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=5OQANBBNYL69 tag=O6O53D3BH8II type=write size=1634177 2024-09-12T00:36:19.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.078+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~2QI06M49JF3S.0 size=1048576 2024-09-12T00:36:19.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.079+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~2QI06M49JF3S.1 size=739762 2024-09-12T00:36:19.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.081+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=2QI06M49JF3S tag=OQSD93633HAP type=write size=2836914 2024-09-12T00:36:19.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.083+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~5917O8M2MUMK.0 size=803720 2024-09-12T00:36:19.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.083+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=5917O8M2MUMK tag=1J3J8PEPRV2Q type=write size=1852296 2024-09-12T00:36:19.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.085+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~5PRYZP5MEZYW.0 size=1048576 2024-09-12T00:36:19.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.086+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~5PRYZP5MEZYW.1 size=755706 2024-09-12T00:36:19.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.088+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=5PRYZP5MEZYW tag=41WOC6VFQ77V type=write size=2852858 2024-09-12T00:36:19.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.090+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=79TEFAHTFFRV type=del size=1485517 2024-09-12T00:36:19.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.092+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=C8XTYZQMOXQ8 type=del 2024-09-12T00:36:19.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.093+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=VOO6QAW7LIED type=del size=1062942 2024-09-12T00:36:19.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.094+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~X9NTAJ8OTS9C.0 size=1048576 2024-09-12T00:36:19.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.094+0000 7f030cb87780 1 < canceled part key=_multipart_QGSJ51GMQXVK.2~X9NTAJ8OTS9C.1 size=1048576 2024-09-12T00:36:19.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.096+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~X9NTAJ8OTS9C.2 size=415238 2024-09-12T00:36:19.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.098+0000 7f030cb87780 1 < canceled multipart upload key=QGSJ51GMQXVK upload=X9NTAJ8OTS9C tag=75RXZRWA212Q type=write size=3560966 2024-09-12T00:36:19.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.101+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~D2UA65A807KC.0 size=1048576 2024-09-12T00:36:19.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.102+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~D2UA65A807KC.1 size=1048576 2024-09-12T00:36:19.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.103+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~D2UA65A807KC.2 size=933770 2024-09-12T00:36:19.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.103+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=D2UA65A807KC tag=44PB8AJQZMRK type=write size=4079498 2024-09-12T00:36:19.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.104+0000 7f030cb87780 1 < canceled part key=_multipart_1VOJGMWNKS0A.2~DGES69LKY7KH.0 size=1048576 2024-09-12T00:36:19.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.105+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~DGES69LKY7KH.1 size=813654 2024-09-12T00:36:19.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.107+0000 7f030cb87780 1 < canceled multipart upload key=1VOJGMWNKS0A upload=DGES69LKY7KH tag=1LBO5OMFGIKU type=write size=2910806 2024-09-12T00:36:19.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.109+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~TNBNDCFTSKVM.0 size=695091 2024-09-12T00:36:19.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.109+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=TNBNDCFTSKVM tag=628ZRF3MI6W2 type=write size=1743667 2024-09-12T00:36:19.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.111+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~FYNLUR89S62J.0 size=1048576 2024-09-12T00:36:19.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.112+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~FYNLUR89S62J.1 size=550249 2024-09-12T00:36:19.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.115+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=FYNLUR89S62J tag=EJLWHAUBE3TW type=write size=2647401 2024-09-12T00:36:19.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.117+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=FOI6YTV2EW3K type=del size=2325616 2024-09-12T00:36:19.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.119+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=B8ZKAAPTCAC9 type=del 2024-09-12T00:36:19.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.121+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=M8FW6E8D8XPI type=del size=1565620 2024-09-12T00:36:19.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.122+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~TYXN5A1TRB56.0 size=1048576 2024-09-12T00:36:19.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.122+0000 7f030cb87780 1 < canceled part key=_multipart_OR439FK5L43V.2~TYXN5A1TRB56.1 size=869879 2024-09-12T00:36:19.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.124+0000 7f030cb87780 1 < canceled multipart upload key=OR439FK5L43V upload=TYXN5A1TRB56 tag=OXYPQT8CR4V4 type=write size=2967031 2024-09-12T00:36:19.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.125+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=58KZJ30TA0WK type=del size=2496790 2024-09-12T00:36:19.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.127+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=J2REKWR3HPOD type=del 2024-09-12T00:36:19.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.128+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=L5DJV97I94FH type=del size=3434780 2024-09-12T00:36:19.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.129+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~4AZUWL1QKCK5.0 size=1048576 2024-09-12T00:36:19.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.131+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~4AZUWL1QKCK5.1 size=703109 2024-09-12T00:36:19.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.133+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=4AZUWL1QKCK5 tag=RBQSG8HPJPSR type=write size=2800261 2024-09-12T00:36:19.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.135+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~KEJCYYRPMELE.0 size=1048576 2024-09-12T00:36:19.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.136+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~KEJCYYRPMELE.1 size=1048576 2024-09-12T00:36:19.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.138+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~KEJCYYRPMELE.2 size=90825 2024-09-12T00:36:19.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.138+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=KEJCYYRPMELE tag=Y9RJ0S6LGJJM type=write size=3236553 2024-09-12T00:36:19.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.139+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=6WA0PFF7LGA7 type=del 2024-09-12T00:36:19.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.141+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~7FLJNGJR7DJI.0 size=1048576 2024-09-12T00:36:19.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.143+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~7FLJNGJR7DJI.1 size=1048576 2024-09-12T00:36:19.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.144+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~7FLJNGJR7DJI.2 size=512776 2024-09-12T00:36:19.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.144+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=7FLJNGJR7DJI tag=CNX6CZIKX5WU type=write size=3658504 2024-09-12T00:36:19.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.146+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~9D4DY1WBKN9Y.0 size=1048576 2024-09-12T00:36:19.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.146+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~9D4DY1WBKN9Y.1 size=1048576 2024-09-12T00:36:19.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.148+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~9D4DY1WBKN9Y.2 size=512165 2024-09-12T00:36:19.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.150+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=9D4DY1WBKN9Y tag=VWVZIRKUY8AG type=write size=3657893 2024-09-12T00:36:19.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.151+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=J3T94N2HHDHX type=del size=3369240 2024-09-12T00:36:19.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.153+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=UFDE494XY4XM type=del 2024-09-12T00:36:19.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.155+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~WOTND0G2TBAS.0 size=1048576 2024-09-12T00:36:19.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.156+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~WOTND0G2TBAS.1 size=1048576 2024-09-12T00:36:19.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.157+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~WOTND0G2TBAS.2 size=861646 2024-09-12T00:36:19.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.157+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=WOTND0G2TBAS tag=FT4WZMRS5LWZ type=write size=4007374 2024-09-12T00:36:19.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.158+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=JDKRWXTRRK3G type=del 2024-09-12T00:36:19.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.161+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~241S8MGBPY3I.0 size=921839 2024-09-12T00:36:19.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.161+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=241S8MGBPY3I tag=VKP7MX62GT3Y type=write size=1970415 2024-09-12T00:36:19.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.164+0000 7f030cb87780 1 < suggested remove operation key=IY156CJWG2TB tag=4HQRZHFYKXR0 type=del 2024-09-12T00:36:19.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.165+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=Y8BLWO3T4H8Q type=del size=1466816 2024-09-12T00:36:19.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.167+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~5OQANBBNYL69.0 size=585601 2024-09-12T00:36:19.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.169+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=5OQANBBNYL69 tag=O6O53D3BH8II type=write size=1634177 2024-09-12T00:36:19.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.172+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~P3QRP1RDCKN9.0 size=1048576 2024-09-12T00:36:19.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.173+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~P3QRP1RDCKN9.1 size=447913 2024-09-12T00:36:19.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.173+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=P3QRP1RDCKN9 tag=OTA7AFA9NAAQ type=write size=2545065 2024-09-12T00:36:19.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.175+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~5917O8M2MUMK.0 size=803720 2024-09-12T00:36:19.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.177+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=5917O8M2MUMK tag=1J3J8PEPRV2Q type=write size=1852296 2024-09-12T00:36:19.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.178+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=K23PFMH1X9BK type=del size=2353644 2024-09-12T00:36:19.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.180+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=79TEFAHTFFRV type=del 2024-09-12T00:36:19.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.181+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=MD3H0X1IR4DL type=del size=152448 2024-09-12T00:36:19.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.183+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=VOO6QAW7LIED type=del 2024-09-12T00:36:19.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.185+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~HLT5NOLZY8XQ.0 size=1048576 2024-09-12T00:36:19.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.186+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~HLT5NOLZY8XQ.1 size=1048576 2024-09-12T00:36:19.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.187+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~HLT5NOLZY8XQ.2 size=969606 2024-09-12T00:36:19.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.187+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=HLT5NOLZY8XQ tag=YJONQCOXSDGQ type=write size=4115334 2024-09-12T00:36:19.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.189+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~D2UA65A807KC.0 size=1048576 2024-09-12T00:36:19.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.190+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~D2UA65A807KC.1 size=1048576 2024-09-12T00:36:19.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.190+0000 7f030cb87780 1 < canceled part key=_multipart_99OWKRGA8ZZN.2~D2UA65A807KC.2 size=933770 2024-09-12T00:36:19.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.192+0000 7f030cb87780 1 < canceled multipart upload key=99OWKRGA8ZZN upload=D2UA65A807KC tag=44PB8AJQZMRK type=write size=4079498 2024-09-12T00:36:19.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.196+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=5EM0HW8SBL31 type=del size=2886213 2024-09-12T00:36:19.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.197+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~TNBNDCFTSKVM.0 size=695091 2024-09-12T00:36:19.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.199+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=TNBNDCFTSKVM tag=628ZRF3MI6W2 type=write size=1743667 2024-09-12T00:36:19.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.201+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=KBB6QLML9CUJ type=del size=2496851 2024-09-12T00:36:19.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.202+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=FOI6YTV2EW3K type=del 2024-09-12T00:36:19.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.205+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~WA6LBU6XAEFR.0 size=1048576 2024-09-12T00:36:19.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.206+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~WA6LBU6XAEFR.1 size=632852 2024-09-12T00:36:19.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.206+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=WA6LBU6XAEFR tag=5UYXXTEGRTA3 type=write size=2730004 2024-09-12T00:36:19.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.208+0000 7f030cb87780 1 < canceled operation key=OR439FK5L43V tag=M8FW6E8D8XPI type=del size=1565620 2024-09-12T00:36:19.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.209+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=9U5R0PW0XKM9 type=del size=3201765 2024-09-12T00:36:19.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.210+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=58KZJ30TA0WK type=del 2024-09-12T00:36:19.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.211+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=2J8IVVQ4W91D type=write size=267785 2024-09-12T00:36:19.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.213+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=L5DJV97I94FH type=del 2024-09-12T00:36:19.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.215+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~CUQ3JK1HDAEG.0 size=1048576 2024-09-12T00:36:19.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.216+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~CUQ3JK1HDAEG.1 size=1048576 2024-09-12T00:36:19.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.217+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~CUQ3JK1HDAEG.2 size=137069 2024-09-12T00:36:19.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.218+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=CUQ3JK1HDAEG tag=FPWR135JPQ3W type=write size=3282797 2024-09-12T00:36:19.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.219+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~KEJCYYRPMELE.0 size=1048576 2024-09-12T00:36:19.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.220+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~KEJCYYRPMELE.1 size=1048576 2024-09-12T00:36:19.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.221+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~KEJCYYRPMELE.2 size=90825 2024-09-12T00:36:19.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.223+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=KEJCYYRPMELE tag=Y9RJ0S6LGJJM type=write size=3236553 2024-09-12T00:36:19.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.225+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=ZOWIMQHEVM6E type=del size=1188486 2024-09-12T00:36:19.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.225+0000 7f030cb87780 1 < canceled part key=_multipart_CUDFTXFBC862.2~7FLJNGJR7DJI.0 size=1048576 2024-09-12T00:36:19.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.226+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~7FLJNGJR7DJI.1 size=1048576 2024-09-12T00:36:19.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.227+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~7FLJNGJR7DJI.2 size=512776 2024-09-12T00:36:19.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.229+0000 7f030cb87780 1 < canceled multipart upload key=CUDFTXFBC862 upload=7FLJNGJR7DJI tag=CNX6CZIKX5WU type=write size=3658504 2024-09-12T00:36:19.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.231+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~OQTFZB778CYR.0 size=1048576 2024-09-12T00:36:19.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.232+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~OQTFZB778CYR.1 size=241288 2024-09-12T00:36:19.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.232+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=OQTFZB778CYR tag=DVZZQAXLQJEO type=write size=2338440 2024-09-12T00:36:19.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.233+0000 7f030cb87780 1 < canceled operation key=327RDLIWLVRO tag=J3T94N2HHDHX type=del size=3369240 2024-09-12T00:36:19.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.234+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=Z781PCFCNNFB type=del size=3548463 2024-09-12T00:36:19.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.235+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~WOTND0G2TBAS.0 size=1048576 2024-09-12T00:36:19.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.236+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~WOTND0G2TBAS.1 size=1048576 2024-09-12T00:36:19.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.237+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~WOTND0G2TBAS.2 size=861646 2024-09-12T00:36:19.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.240+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=WOTND0G2TBAS tag=FT4WZMRS5LWZ type=write size=4007374 2024-09-12T00:36:19.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.241+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=51VEWUWWWMOA type=del size=1714275 2024-09-12T00:36:19.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.243+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~241S8MGBPY3I.0 size=921839 2024-09-12T00:36:19.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.246+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=241S8MGBPY3I tag=VKP7MX62GT3Y type=write size=1970415 2024-09-12T00:36:19.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.248+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=0CKPDT1AFQ1I type=del size=428072 2024-09-12T00:36:19.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.249+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=Y8BLWO3T4H8Q type=del 2024-09-12T00:36:19.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.253+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~3MBY06NA0J62.0 size=1048576 2024-09-12T00:36:19.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.254+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~3MBY06NA0J62.1 size=1033639 2024-09-12T00:36:19.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.254+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=3MBY06NA0J62 tag=V4VCI5E6LEN6 type=write size=3130791 2024-09-12T00:36:19.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.255+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~P3QRP1RDCKN9.0 size=1048576 2024-09-12T00:36:19.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.256+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~P3QRP1RDCKN9.1 size=447913 2024-09-12T00:36:19.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.259+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=P3QRP1RDCKN9 tag=OTA7AFA9NAAQ type=write size=2545065 2024-09-12T00:36:19.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.260+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=3Q1G2W7PEUK1 type=del size=2006196 2024-09-12T00:36:19.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.262+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=K23PFMH1X9BK type=del 2024-09-12T00:36:19.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.264+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~NNIM2LMWGKH0.0 size=1048576 2024-09-12T00:36:19.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.266+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~NNIM2LMWGKH0.1 size=1048576 2024-09-12T00:36:19.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.267+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~NNIM2LMWGKH0.2 size=868621 2024-09-12T00:36:19.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.267+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=NNIM2LMWGKH0 tag=RDNQN97Y0DYR type=write size=4014349 2024-09-12T00:36:19.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.268+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=MD3H0X1IR4DL type=del 2024-09-12T00:36:19.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.270+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=GZ3YDYVSIXMZ type=del size=715379 2024-09-12T00:36:19.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.271+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~HLT5NOLZY8XQ.0 size=1048576 2024-09-12T00:36:19.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.273+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~HLT5NOLZY8XQ.1 size=1048576 2024-09-12T00:36:19.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.274+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~HLT5NOLZY8XQ.2 size=969606 2024-09-12T00:36:19.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.277+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=HLT5NOLZY8XQ tag=YJONQCOXSDGQ type=write size=4115334 2024-09-12T00:36:19.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.278+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=B8YED08RRGE9 type=del size=3824673 2024-09-12T00:36:19.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.280+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=5EM0HW8SBL31 type=del 2024-09-12T00:36:19.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.281+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=9NXIKY3A70V2 type=del size=1016422 2024-09-12T00:36:19.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.283+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=KBB6QLML9CUJ type=del 2024-09-12T00:36:19.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.285+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~YXFY6JTEOLIN.0 size=1048576 2024-09-12T00:36:19.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.286+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~YXFY6JTEOLIN.1 size=1009412 2024-09-12T00:36:19.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.286+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=YXFY6JTEOLIN tag=71Z2BAZTXM21 type=write size=3106564 2024-09-12T00:36:19.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.287+0000 7f030cb87780 1 < canceled part key=_multipart_U5CWO1EN8BFI.2~WA6LBU6XAEFR.0 size=1048576 2024-09-12T00:36:19.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.288+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~WA6LBU6XAEFR.1 size=632852 2024-09-12T00:36:19.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.290+0000 7f030cb87780 1 < canceled multipart upload key=U5CWO1EN8BFI upload=WA6LBU6XAEFR tag=5UYXXTEGRTA3 type=write size=2730004 2024-09-12T00:36:19.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.293+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~VAHV2Y89Z9M0.0 size=1048576 2024-09-12T00:36:19.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.294+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~VAHV2Y89Z9M0.1 size=1048576 2024-09-12T00:36:19.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.295+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~VAHV2Y89Z9M0.2 size=824602 2024-09-12T00:36:19.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.295+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=VAHV2Y89Z9M0 tag=WTDQO11E9NKF type=write size=3970330 2024-09-12T00:36:19.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.297+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=9U5R0PW0XKM9 type=del 2024-09-12T00:36:19.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.299+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~2WOBW6P8BANX.0 size=1048576 2024-09-12T00:36:19.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.300+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~2WOBW6P8BANX.1 size=457742 2024-09-12T00:36:19.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.300+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=2WOBW6P8BANX tag=2E9ZJ3PHLADR type=write size=2554894 2024-09-12T00:36:19.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.301+0000 7f030cb87780 1 < completed write operation key=86TWUAZAHI4I tag=2J8IVVQ4W91D type=write size=267785 2024-09-12T00:36:19.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.303+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=8XNMZ97XTCL7 type=write size=1005519 2024-09-12T00:36:19.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.304+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~CUQ3JK1HDAEG.0 size=1048576 2024-09-12T00:36:19.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.304+0000 7f030cb87780 1 < canceled part key=_multipart_INFFH9R3EFRY.2~CUQ3JK1HDAEG.1 size=1048576 2024-09-12T00:36:19.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.305+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~CUQ3JK1HDAEG.2 size=137069 2024-09-12T00:36:19.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.307+0000 7f030cb87780 1 < canceled multipart upload key=INFFH9R3EFRY upload=CUQ3JK1HDAEG tag=FPWR135JPQ3W type=write size=3282797 2024-09-12T00:36:19.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.309+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=3Z5YWW2H8RWD type=del size=1667529 2024-09-12T00:36:19.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.310+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=ZOWIMQHEVM6E type=del 2024-09-12T00:36:19.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.311+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=Y7TZ1641578P type=del size=3792922 2024-09-12T00:36:19.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.313+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~OQTFZB778CYR.0 size=1048576 2024-09-12T00:36:19.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.314+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~OQTFZB778CYR.1 size=241288 2024-09-12T00:36:19.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.316+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=OQTFZB778CYR tag=DVZZQAXLQJEO type=write size=2338440 2024-09-12T00:36:19.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.318+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~Q78QUIZLIZKD.0 size=673320 2024-09-12T00:36:19.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.318+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=Q78QUIZLIZKD tag=ZWFRT6W9D6OC type=write size=1721896 2024-09-12T00:36:19.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.319+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=Z781PCFCNNFB type=del 2024-09-12T00:36:19.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.321+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=L2F1DMV9KV8J type=del size=642203 2024-09-12T00:36:19.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.323+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=51VEWUWWWMOA type=del 2024-09-12T00:36:19.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.325+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~JKYP0RWIANIR.0 size=1048576 2024-09-12T00:36:19.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.326+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~JKYP0RWIANIR.1 size=508797 2024-09-12T00:36:19.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.326+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=JKYP0RWIANIR tag=IYAJ7ZZJSN7M type=write size=2605949 2024-09-12T00:36:19.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.328+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=0CKPDT1AFQ1I type=del 2024-09-12T00:36:19.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.329+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=8X6YT4MQR4KY type=del size=2545235 2024-09-12T00:36:19.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.329+0000 7f030cb87780 1 < canceled part key=_multipart_56I20YIPY82N.2~3MBY06NA0J62.0 size=1048576 2024-09-12T00:36:19.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.330+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~3MBY06NA0J62.1 size=1033639 2024-09-12T00:36:19.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.333+0000 7f030cb87780 1 < canceled multipart upload key=56I20YIPY82N upload=3MBY06NA0J62 tag=V4VCI5E6LEN6 type=write size=3130791 2024-09-12T00:36:19.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.334+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=D98T47YVZT6L type=del size=3336041 2024-09-12T00:36:19.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.336+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=3Q1G2W7PEUK1 type=del 2024-09-12T00:36:19.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.338+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~UWQIRJD70U3Z.0 size=1011347 2024-09-12T00:36:19.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.338+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=UWQIRJD70U3Z tag=11ZGWYHT26BQ type=write size=2059923 2024-09-12T00:36:19.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.340+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~NNIM2LMWGKH0.0 size=1048576 2024-09-12T00:36:19.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.340+0000 7f030cb87780 1 < canceled part key=_multipart_CUDFTXFBC862.2~NNIM2LMWGKH0.1 size=1048576 2024-09-12T00:36:19.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.341+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~NNIM2LMWGKH0.2 size=868621 2024-09-12T00:36:19.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.343+0000 7f030cb87780 1 < canceled multipart upload key=CUDFTXFBC862 upload=NNIM2LMWGKH0 tag=RDNQN97Y0DYR type=write size=4014349 2024-09-12T00:36:19.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.344+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=0G8LZZ7I60C8 type=del size=1509485 2024-09-12T00:36:19.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.346+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=GZ3YDYVSIXMZ type=del 2024-09-12T00:36:19.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.347+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=ECHVD6O6MV11 type=write size=592637 2024-09-12T00:36:19.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.350+0000 7f030cb87780 1 < suggested update operation key=CUDFTXFBC862 tag=B8YED08RRGE9 type=del size=3824673 2024-09-12T00:36:19.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.351+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=Q36TYR6114SU type=write size=137210 2024-09-12T00:36:19.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.353+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=9NXIKY3A70V2 type=del 2024-09-12T00:36:19.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.354+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=YMFDGD8Z88WI type=write size=47399 2024-09-12T00:36:19.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.357+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~YXFY6JTEOLIN.0 size=1048576 2024-09-12T00:36:19.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.358+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~YXFY6JTEOLIN.1 size=1009412 2024-09-12T00:36:19.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.360+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=YXFY6JTEOLIN tag=71Z2BAZTXM21 type=write size=3106564 2024-09-12T00:36:19.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.362+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=TW6IF360H49R type=del size=1387190 2024-09-12T00:36:19.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.364+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~VAHV2Y89Z9M0.0 size=1048576 2024-09-12T00:36:19.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.365+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~VAHV2Y89Z9M0.1 size=1048576 2024-09-12T00:36:19.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.367+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~VAHV2Y89Z9M0.2 size=824602 2024-09-12T00:36:19.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.369+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=VAHV2Y89Z9M0 tag=WTDQO11E9NKF type=write size=3970330 2024-09-12T00:36:19.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.370+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=0NL1ISO9A52U type=write size=941891 2024-09-12T00:36:19.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.371+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~2WOBW6P8BANX.0 size=1048576 2024-09-12T00:36:19.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.373+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~2WOBW6P8BANX.1 size=457742 2024-09-12T00:36:19.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.375+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=2WOBW6P8BANX tag=2E9ZJ3PHLADR type=write size=2554894 2024-09-12T00:36:19.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.377+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=FAD7AP6CC3NX type=del size=2403420 2024-09-12T00:36:19.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.380+0000 7f030cb87780 1 < completed write operation key=U5CWO1EN8BFI tag=8XNMZ97XTCL7 type=write size=1005519 2024-09-12T00:36:19.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.382+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=SOCGVUAJJVTQ type=del size=2119590 2024-09-12T00:36:19.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.385+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=3Z5YWW2H8RWD type=del 2024-09-12T00:36:19.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.386+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=Z0XU5YVIQK9K type=del size=2773316 2024-09-12T00:36:19.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.389+0000 7f030cb87780 1 < suggested remove operation key=IHTFI7W4A6JT tag=Y7TZ1641578P type=del 2024-09-12T00:36:19.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.390+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=JL275LT8B2A4 type=write size=669622 2024-09-12T00:36:19.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.392+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~Q78QUIZLIZKD.0 size=673320 2024-09-12T00:36:19.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.394+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=Q78QUIZLIZKD tag=ZWFRT6W9D6OC type=write size=1721896 2024-09-12T00:36:19.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.397+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~D4RG4TOUB8RX.0 size=124494 2024-09-12T00:36:19.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.397+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=D4RG4TOUB8RX tag=360GD5FZ5Y7U type=write size=1173070 2024-09-12T00:36:19.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.398+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=L2F1DMV9KV8J type=del 2024-09-12T00:36:19.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.400+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~A0SFB27X07BX.0 size=1048576 2024-09-12T00:36:19.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.401+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~A0SFB27X07BX.1 size=902761 2024-09-12T00:36:19.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.401+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=A0SFB27X07BX tag=9H0LXD2O8DF1 type=write size=2999913 2024-09-12T00:36:19.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.403+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~JKYP0RWIANIR.0 size=1048576 2024-09-12T00:36:19.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.403+0000 7f030cb87780 1 < canceled part key=_multipart_800OHA7UURC4.2~JKYP0RWIANIR.1 size=508797 2024-09-12T00:36:19.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.405+0000 7f030cb87780 1 < canceled multipart upload key=800OHA7UURC4 upload=JKYP0RWIANIR tag=IYAJ7ZZJSN7M type=write size=2605949 2024-09-12T00:36:19.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.406+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=L5CZ0CJHLJA6 type=del size=3891415 2024-09-12T00:36:19.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.408+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=8X6YT4MQR4KY type=del 2024-09-12T00:36:19.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.409+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=AJL0L2GT4ZYD type=write size=1035267 2024-09-12T00:36:19.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.411+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=D98T47YVZT6L type=del 2024-09-12T00:36:19.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.414+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~90GC3S7HE7U2.0 size=1048576 2024-09-12T00:36:19.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.414+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~90GC3S7HE7U2.1 size=1048576 2024-09-12T00:36:19.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.415+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~90GC3S7HE7U2.2 size=378362 2024-09-12T00:36:19.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.415+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=90GC3S7HE7U2 tag=5D0XQ8RBKYBA type=write size=3524090 2024-09-12T00:36:19.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.417+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~UWQIRJD70U3Z.0 size=1011347 2024-09-12T00:36:19.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.420+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=UWQIRJD70U3Z tag=11ZGWYHT26BQ type=write size=2059923 2024-09-12T00:36:19.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.421+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=7LY47NXAMMZJ type=write size=34635 2024-09-12T00:36:19.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.422+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=0G8LZZ7I60C8 type=del 2024-09-12T00:36:19.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.425+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~X45YACEYQ3EO.0 size=807303 2024-09-12T00:36:19.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.425+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=X45YACEYQ3EO tag=R49LNRN28LHI type=write size=1855879 2024-09-12T00:36:19.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.428+0000 7f030cb87780 1 < suggested update operation key=HUDEU16YTO0Y tag=ECHVD6O6MV11 type=write size=592637 2024-09-12T00:36:19.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.430+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=RPBU6VY0O2W6 type=del size=1074792 2024-09-12T00:36:19.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.431+0000 7f030cb87780 1 < completed write operation key=92GDVW0Q8VKQ tag=Q36TYR6114SU type=write size=137210 2024-09-12T00:36:19.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.432+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=D2B82AECX9WG type=del size=1922469 2024-09-12T00:36:19.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.434+0000 7f030cb87780 1 < completed write operation key=99OWKRGA8ZZN tag=YMFDGD8Z88WI type=write size=47399 2024-09-12T00:36:19.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.437+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~0IM3HGHUWWTJ.0 size=1048576 2024-09-12T00:36:19.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.438+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~0IM3HGHUWWTJ.1 size=1048576 2024-09-12T00:36:19.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.439+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~0IM3HGHUWWTJ.2 size=687344 2024-09-12T00:36:19.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.439+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=0IM3HGHUWWTJ tag=219GLSE7UWZ3 type=write size=3833072 2024-09-12T00:36:19.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.441+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=TW6IF360H49R type=del 2024-09-12T00:36:19.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.443+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~B4OTVM0DM2QW.0 size=745908 2024-09-12T00:36:19.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.443+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=B4OTVM0DM2QW tag=BTMHW1WXVSRX type=write size=1794484 2024-09-12T00:36:19.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.444+0000 7f030cb87780 1 < completed write operation key=INFFH9R3EFRY tag=0NL1ISO9A52U type=write size=941891 2024-09-12T00:36:19.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.447+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~1113O5W0MN93.0 size=1048576 2024-09-12T00:36:19.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.449+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~1113O5W0MN93.1 size=1048576 2024-09-12T00:36:19.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.449+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~1113O5W0MN93.2 size=825477 2024-09-12T00:36:19.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.449+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=1113O5W0MN93 tag=4FCU9ZR0151O type=write size=3971205 2024-09-12T00:36:19.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.450+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=FAD7AP6CC3NX type=del 2024-09-12T00:36:19.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.452+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=W2XXBE6O5EKK type=del size=2117917 2024-09-12T00:36:19.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.454+0000 7f030cb87780 1 < suggested update operation key=JPEIGLC162K3 tag=SOCGVUAJJVTQ type=del size=2119590 2024-09-12T00:36:19.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.457+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~250B8BSW3DWS.0 size=1048576 2024-09-12T00:36:19.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.458+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~250B8BSW3DWS.1 size=997152 2024-09-12T00:36:19.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.458+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=250B8BSW3DWS tag=PPW8FLOW80EC type=write size=3094304 2024-09-12T00:36:19.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.459+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=Z0XU5YVIQK9K type=del 2024-09-12T00:36:19.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.461+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=S7P4IKKZ0WK8 type=del size=2035656 2024-09-12T00:36:19.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.463+0000 7f030cb87780 1 < suggested update operation key=OR439FK5L43V tag=JL275LT8B2A4 type=write size=669622 2024-09-12T00:36:19.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.465+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=2BFS89ND4341 type=del size=2324300 2024-09-12T00:36:19.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.466+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~D4RG4TOUB8RX.0 size=124494 2024-09-12T00:36:19.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.468+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=D4RG4TOUB8RX tag=360GD5FZ5Y7U type=write size=1173070 2024-09-12T00:36:19.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.470+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~XAGT225322ZT.0 size=405910 2024-09-12T00:36:19.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.470+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=XAGT225322ZT tag=7UBCSQLSI1EY type=write size=1454486 2024-09-12T00:36:19.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.472+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~A0SFB27X07BX.0 size=1048576 2024-09-12T00:36:19.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.473+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~A0SFB27X07BX.1 size=902761 2024-09-12T00:36:19.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.475+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=A0SFB27X07BX tag=9H0LXD2O8DF1 type=write size=2999913 2024-09-12T00:36:19.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.479+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~0YRZBW8HMSZ6.0 size=46199 2024-09-12T00:36:19.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.479+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=0YRZBW8HMSZ6 tag=JJO6H75KVQSU type=write size=1094775 2024-09-12T00:36:19.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.480+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=L5CZ0CJHLJA6 type=del 2024-09-12T00:36:19.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.481+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=GVMWIQN2183K type=del size=382079 2024-09-12T00:36:19.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.483+0000 7f030cb87780 1 < canceled operation key=N3KD1UVUVM95 tag=AJL0L2GT4ZYD type=write size=1035267 2024-09-12T00:36:19.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.485+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~PX7YRZ6PRSH4.0 size=1048576 2024-09-12T00:36:19.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.486+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~PX7YRZ6PRSH4.1 size=73796 2024-09-12T00:36:19.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.486+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=PX7YRZ6PRSH4 tag=V33TDI2AGX3Y type=write size=2170948 2024-09-12T00:36:19.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.487+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~90GC3S7HE7U2.0 size=1048576 2024-09-12T00:36:19.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.488+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~90GC3S7HE7U2.1 size=1048576 2024-09-12T00:36:19.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.489+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~90GC3S7HE7U2.2 size=378362 2024-09-12T00:36:19.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.492+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=90GC3S7HE7U2 tag=5D0XQ8RBKYBA type=write size=3524090 2024-09-12T00:36:19.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.494+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~V079KMZRNWPW.0 size=1048576 2024-09-12T00:36:19.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.496+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~V079KMZRNWPW.1 size=1048576 2024-09-12T00:36:19.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.497+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~V079KMZRNWPW.2 size=856250 2024-09-12T00:36:19.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.497+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=V079KMZRNWPW tag=12K5Q15B692J type=write size=4001978 2024-09-12T00:36:19.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.498+0000 7f030cb87780 1 < canceled operation key=3W7ANGL92ZF0 tag=7LY47NXAMMZJ type=write size=34635 2024-09-12T00:36:19.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.500+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=JV8RVBCNU117 type=del size=984885 2024-09-12T00:36:19.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.501+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~X45YACEYQ3EO.0 size=807303 2024-09-12T00:36:19.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.504+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=X45YACEYQ3EO tag=R49LNRN28LHI type=write size=1855879 2024-09-12T00:36:19.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.506+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~412Y68W6DK8Q.0 size=328388 2024-09-12T00:36:19.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.506+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=412Y68W6DK8Q tag=U2KYD9JPCL4J type=write size=1376964 2024-09-12T00:36:19.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.507+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=RPBU6VY0O2W6 type=del 2024-09-12T00:36:19.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.510+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~M9L924HZL26H.0 size=107124 2024-09-12T00:36:19.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.510+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=M9L924HZL26H tag=8DG2HW7MCO7L type=write size=1155700 2024-09-12T00:36:19.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.513+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=D2B82AECX9WG type=del 2024-09-12T00:36:19.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.513+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=IV6O1XOI7Z6V type=del size=350753 2024-09-12T00:36:19.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.515+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~0IM3HGHUWWTJ.0 size=1048576 2024-09-12T00:36:19.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.516+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~0IM3HGHUWWTJ.1 size=1048576 2024-09-12T00:36:19.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.517+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~0IM3HGHUWWTJ.2 size=687344 2024-09-12T00:36:19.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.520+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=0IM3HGHUWWTJ tag=219GLSE7UWZ3 type=write size=3833072 2024-09-12T00:36:19.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.521+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=ZRYVDUWCFSHG type=del size=719247 2024-09-12T00:36:19.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.523+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~B4OTVM0DM2QW.0 size=745908 2024-09-12T00:36:19.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.525+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=B4OTVM0DM2QW tag=BTMHW1WXVSRX type=write size=1794484 2024-09-12T00:36:19.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.526+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=L53PIHKGCXEW type=del size=1750864 2024-09-12T00:36:19.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.528+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~1113O5W0MN93.0 size=1048576 2024-09-12T00:36:19.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.528+0000 7f030cb87780 1 < canceled part key=_multipart_CY2NS03IIUJJ.2~1113O5W0MN93.1 size=1048576 2024-09-12T00:36:19.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.529+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~1113O5W0MN93.2 size=825477 2024-09-12T00:36:19.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.531+0000 7f030cb87780 1 < canceled multipart upload key=CY2NS03IIUJJ upload=1113O5W0MN93 tag=4FCU9ZR0151O type=write size=3971205 2024-09-12T00:36:19.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.534+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~F8HQX7PF8AL0.0 size=304399 2024-09-12T00:36:19.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.534+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=F8HQX7PF8AL0 tag=I88CL8GOYMTT type=write size=1352975 2024-09-12T00:36:19.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.536+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=W2XXBE6O5EKK type=del 2024-09-12T00:36:19.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.536+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=H3WFT50XLMUX type=del size=2377751 2024-09-12T00:36:19.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.538+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~250B8BSW3DWS.0 size=1048576 2024-09-12T00:36:19.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.539+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~250B8BSW3DWS.1 size=997152 2024-09-12T00:36:19.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.541+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=250B8BSW3DWS tag=PPW8FLOW80EC type=write size=3094304 2024-09-12T00:36:19.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.542+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=9QEBGD8VVEDB type=write size=320263 2024-09-12T00:36:19.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.544+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=S7P4IKKZ0WK8 type=del 2024-09-12T00:36:19.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.545+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=0JBJ54LW07HD type=del size=56581 2024-09-12T00:36:19.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.548+0000 7f030cb87780 1 < suggested remove operation key=IHTFI7W4A6JT tag=2BFS89ND4341 type=del 2024-09-12T00:36:19.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.550+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~220ZH2331GPJ.0 size=1048576 2024-09-12T00:36:19.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.551+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~220ZH2331GPJ.1 size=1048576 2024-09-12T00:36:19.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.553+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~220ZH2331GPJ.2 size=803391 2024-09-12T00:36:19.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.553+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=220ZH2331GPJ tag=4YSLVDS9KP1E type=write size=3949119 2024-09-12T00:36:19.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.554+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~XAGT225322ZT.0 size=405910 2024-09-12T00:36:19.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.556+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=XAGT225322ZT tag=7UBCSQLSI1EY type=write size=1454486 2024-09-12T00:36:19.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.558+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=R73B4U1F070T type=del size=1745987 2024-09-12T00:36:19.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.559+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~0YRZBW8HMSZ6.0 size=46199 2024-09-12T00:36:19.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.561+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=0YRZBW8HMSZ6 tag=JJO6H75KVQSU type=write size=1094775 2024-09-12T00:36:19.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.563+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=H9C43J09RWXQ type=del size=3949489 2024-09-12T00:36:19.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.571+0000 7f030cb87780 1 < canceled operation key=ATTMOL2TGUN7 tag=GVMWIQN2183K type=del size=382079 2024-09-12T00:36:19.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.573+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=7NGKO4MGLTD0 type=del size=1218429 2024-09-12T00:36:19.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.575+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~PX7YRZ6PRSH4.0 size=1048576 2024-09-12T00:36:19.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.576+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~PX7YRZ6PRSH4.1 size=73796 2024-09-12T00:36:19.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.578+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=PX7YRZ6PRSH4 tag=V33TDI2AGX3Y type=write size=2170948 2024-09-12T00:36:19.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.581+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~VC0ZF1PAHVAF.0 size=1048576 2024-09-12T00:36:19.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.581+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~VC0ZF1PAHVAF.1 size=1048576 2024-09-12T00:36:19.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.583+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~VC0ZF1PAHVAF.2 size=57200 2024-09-12T00:36:19.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.583+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=VC0ZF1PAHVAF tag=VM0ZP9YY2NKM type=write size=3202928 2024-09-12T00:36:19.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.584+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~V079KMZRNWPW.0 size=1048576 2024-09-12T00:36:19.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.585+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~V079KMZRNWPW.1 size=1048576 2024-09-12T00:36:19.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.587+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~V079KMZRNWPW.2 size=856250 2024-09-12T00:36:19.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.589+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=V079KMZRNWPW tag=12K5Q15B692J type=write size=4001978 2024-09-12T00:36:19.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.590+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=02WS4N9RHZ5X type=write size=568846 2024-09-12T00:36:19.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.592+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=JV8RVBCNU117 type=del 2024-09-12T00:36:19.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.594+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=LNW5T6HH0VLT type=write size=353863 2024-09-12T00:36:19.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.595+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~412Y68W6DK8Q.0 size=328388 2024-09-12T00:36:19.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.597+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=412Y68W6DK8Q tag=U2KYD9JPCL4J type=write size=1376964 2024-09-12T00:36:19.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.600+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~ZTW6XRKR5Z8J.0 size=577649 2024-09-12T00:36:19.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.600+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=ZTW6XRKR5Z8J tag=2C0OP1JV4N4V type=write size=1626225 2024-09-12T00:36:19.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.601+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~M9L924HZL26H.0 size=107124 2024-09-12T00:36:19.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.604+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=M9L924HZL26H tag=8DG2HW7MCO7L type=write size=1155700 2024-09-12T00:36:19.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.605+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=7JTD423TUSAU type=del size=912893 2024-09-12T00:36:19.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.606+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=IV6O1XOI7Z6V type=del 2024-09-12T00:36:19.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.608+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=YAIR0HXBC7I9 type=del size=3997669 2024-09-12T00:36:19.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.609+0000 7f030cb87780 -1 < failed to complete operation key=IHTFI7W4A6JT tag=ZRYVDUWCFSHG type=del size=719247: (22) Invalid argument 2024-09-12T00:36:19.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.612+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~XL80FL7OI2BO.0 size=1048576 2024-09-12T00:36:19.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.613+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~XL80FL7OI2BO.1 size=1048576 2024-09-12T00:36:19.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.614+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~XL80FL7OI2BO.2 size=193258 2024-09-12T00:36:19.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.614+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=XL80FL7OI2BO tag=4GIRRD0FEZRM type=write size=3338986 2024-09-12T00:36:19.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.615+0000 7f030cb87780 -1 < failed to complete operation key=IHTFI7W4A6JT tag=L53PIHKGCXEW type=del size=1750864: (22) Invalid argument 2024-09-12T00:36:19.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.616+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=2634DFYOQOBD type=del size=878958 2024-09-12T00:36:19.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.618+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~F8HQX7PF8AL0.0 size=304399 2024-09-12T00:36:19.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.620+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=F8HQX7PF8AL0 tag=I88CL8GOYMTT type=write size=1352975 2024-09-12T00:36:19.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.621+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=R24W75OXVZAE type=del size=2086273 2024-09-12T00:36:19.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.623+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=H3WFT50XLMUX type=del 2024-09-12T00:36:19.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.624+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=SMB4W8CM8OKL type=del size=686919 2024-09-12T00:36:19.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.627+0000 7f030cb87780 1 < suggested update operation key=9MCRD2G3MZIT tag=9QEBGD8VVEDB type=write size=320263 2024-09-12T00:36:19.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.628+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=2G1IFCR36FHG type=write size=275886 2024-09-12T00:36:19.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.629+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=0JBJ54LW07HD type=del 2024-09-12T00:36:19.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.631+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=RD8PO211KDBA type=del size=1942825 2024-09-12T00:36:19.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.632+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~220ZH2331GPJ.0 size=1048576 2024-09-12T00:36:19.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.633+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~220ZH2331GPJ.1 size=1048576 2024-09-12T00:36:19.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.634+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~220ZH2331GPJ.2 size=803391 2024-09-12T00:36:19.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.636+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=220ZH2331GPJ tag=4YSLVDS9KP1E type=write size=3949119 2024-09-12T00:36:19.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.638+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=MKPGPX40W0AB type=del size=1692390 2024-09-12T00:36:19.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.639+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=R73B4U1F070T type=del 2024-09-12T00:36:19.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.640+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=JPIFCLTXLSMD type=del size=274760 2024-09-12T00:36:19.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.642+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=H9C43J09RWXQ type=del 2024-09-12T00:36:19.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.645+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~3S85612VF9TG.0 size=1048576 2024-09-12T00:36:19.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.646+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~3S85612VF9TG.1 size=1048576 2024-09-12T00:36:19.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.648+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~3S85612VF9TG.2 size=188151 2024-09-12T00:36:19.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.648+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=3S85612VF9TG tag=HT5TR0MJAD4N type=write size=3333879 2024-09-12T00:36:19.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.651+0000 7f030cb87780 1 < canceled operation key=IY156CJWG2TB tag=7NGKO4MGLTD0 type=del size=1218429 2024-09-12T00:36:19.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.653+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~3J3JIASVC6GQ.0 size=1048576 2024-09-12T00:36:19.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.654+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~3J3JIASVC6GQ.1 size=734312 2024-09-12T00:36:19.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.654+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=3J3JIASVC6GQ tag=EC0VNSLGT1SC type=write size=2831464 2024-09-12T00:36:19.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.656+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~VC0ZF1PAHVAF.0 size=1048576 2024-09-12T00:36:19.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.658+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~VC0ZF1PAHVAF.1 size=1048576 2024-09-12T00:36:19.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.658+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~VC0ZF1PAHVAF.2 size=57200 2024-09-12T00:36:19.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.660+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=VC0ZF1PAHVAF tag=VM0ZP9YY2NKM type=write size=3202928 2024-09-12T00:36:19.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.663+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~0AZWS6D1ZGBD.0 size=1048576 2024-09-12T00:36:19.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.664+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~0AZWS6D1ZGBD.1 size=1048576 2024-09-12T00:36:19.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.665+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~0AZWS6D1ZGBD.2 size=794658 2024-09-12T00:36:19.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.665+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=0AZWS6D1ZGBD tag=S168K10W1BY3 type=write size=3940386 2024-09-12T00:36:19.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.666+0000 7f030cb87780 1 < completed write operation key=92GDVW0Q8VKQ tag=02WS4N9RHZ5X type=write size=568846 2024-09-12T00:36:19.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.668+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=J8CUXQ3IM1UZ type=write size=306649 2024-09-12T00:36:19.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.669+0000 7f030cb87780 1 < completed write operation key=IY156CJWG2TB tag=LNW5T6HH0VLT type=write size=353863 2024-09-12T00:36:19.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.672+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~V2M171O1WH44.0 size=855037 2024-09-12T00:36:19.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.672+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=V2M171O1WH44 tag=ZWI884298S1G type=write size=1903613 2024-09-12T00:36:19.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.672+0000 7f030cb87780 1 < canceled part key=_multipart_1VOJGMWNKS0A.2~ZTW6XRKR5Z8J.0 size=577649 2024-09-12T00:36:19.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.674+0000 7f030cb87780 1 < canceled multipart upload key=1VOJGMWNKS0A upload=ZTW6XRKR5Z8J tag=2C0OP1JV4N4V type=write size=1626225 2024-09-12T00:36:19.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.677+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~G81EMX2M97QB.0 size=1048576 2024-09-12T00:36:19.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.678+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~G81EMX2M97QB.1 size=1048576 2024-09-12T00:36:19.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.680+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~G81EMX2M97QB.2 size=594815 2024-09-12T00:36:19.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.680+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=G81EMX2M97QB tag=WHF0KLZC5D1N type=write size=3740543 2024-09-12T00:36:19.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.681+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=7JTD423TUSAU type=del 2024-09-12T00:36:19.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.683+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=QRWEJSWMF788 type=del size=1268998 2024-09-12T00:36:19.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.684+0000 7f030cb87780 1 < canceled operation key=V87B6SDB1HFZ tag=YAIR0HXBC7I9 type=del size=3997669 2024-09-12T00:36:19.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.685+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=H8NLP823YXD4 type=del size=148476 2024-09-12T00:36:19.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.687+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~XL80FL7OI2BO.0 size=1048576 2024-09-12T00:36:19.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.688+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~XL80FL7OI2BO.1 size=1048576 2024-09-12T00:36:19.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.689+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~XL80FL7OI2BO.2 size=193258 2024-09-12T00:36:19.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.691+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=XL80FL7OI2BO tag=4GIRRD0FEZRM type=write size=3338986 2024-09-12T00:36:19.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.694+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~P920TE3T7NOO.0 size=1048576 2024-09-12T00:36:19.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.694+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~P920TE3T7NOO.1 size=1033033 2024-09-12T00:36:19.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.694+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=P920TE3T7NOO tag=HT16DKE5UMEH type=write size=3130185 2024-09-12T00:36:19.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.696+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=2634DFYOQOBD type=del 2024-09-12T00:36:19.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.697+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=WHZMDIRIQZYB type=del size=883496 2024-09-12T00:36:19.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.698+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=R24W75OXVZAE type=del 2024-09-12T00:36:19.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.701+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~TP6TUGVFB9O7.0 size=348774 2024-09-12T00:36:19.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.701+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=TP6TUGVFB9O7 tag=6V97HLCUO1Z7 type=write size=1397350 2024-09-12T00:36:19.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.702+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=SMB4W8CM8OKL type=del 2024-09-12T00:36:19.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.704+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=4EH08T5ZQ9G6 type=write size=96289 2024-09-12T00:36:19.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.705+0000 7f030cb87780 1 < canceled operation key=U5CWO1EN8BFI tag=2G1IFCR36FHG type=write size=275886 2024-09-12T00:36:19.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.709+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~PO08FHX1BQA2.0 size=650989 2024-09-12T00:36:19.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.709+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=PO08FHX1BQA2 tag=WE1QUG6NGTVG type=write size=1699565 2024-09-12T00:36:19.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.710+0000 7f030cb87780 1 < canceled operation key=800OHA7UURC4 tag=RD8PO211KDBA type=del size=1942825 2024-09-12T00:36:19.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.712+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=3GNOTKMMOVTY type=write size=282947 2024-09-12T00:36:19.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.713+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=MKPGPX40W0AB type=del 2024-09-12T00:36:19.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.715+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=F40ZS6RQTFKX type=del size=2824204 2024-09-12T00:36:19.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.716+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=JPIFCLTXLSMD type=del 2024-09-12T00:36:19.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.717+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=QG06DMLND8CD type=del size=1676903 2024-09-12T00:36:19.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.719+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~3S85612VF9TG.0 size=1048576 2024-09-12T00:36:19.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.719+0000 7f030cb87780 1 < canceled part key=_multipart_ATTMOL2TGUN7.2~3S85612VF9TG.1 size=1048576 2024-09-12T00:36:19.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.720+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~3S85612VF9TG.2 size=188151 2024-09-12T00:36:19.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.722+0000 7f030cb87780 1 < canceled multipart upload key=ATTMOL2TGUN7 upload=3S85612VF9TG tag=HT5TR0MJAD4N type=write size=3333879 2024-09-12T00:36:19.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.723+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=WYQLEKR4XD8R type=del size=1579558 2024-09-12T00:36:19.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.724+0000 7f030cb87780 1 < canceled part key=_multipart_3W7ANGL92ZF0.2~3J3JIASVC6GQ.0 size=1048576 2024-09-12T00:36:19.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.725+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~3J3JIASVC6GQ.1 size=734312 2024-09-12T00:36:19.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.727+0000 7f030cb87780 1 < canceled multipart upload key=3W7ANGL92ZF0 upload=3J3JIASVC6GQ tag=EC0VNSLGT1SC type=write size=2831464 2024-09-12T00:36:19.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.728+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=16ZEBT6E17B5 type=del size=748673 2024-09-12T00:36:19.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.730+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~0AZWS6D1ZGBD.0 size=1048576 2024-09-12T00:36:19.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.731+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~0AZWS6D1ZGBD.1 size=1048576 2024-09-12T00:36:19.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.732+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~0AZWS6D1ZGBD.2 size=794658 2024-09-12T00:36:19.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.734+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=0AZWS6D1ZGBD tag=S168K10W1BY3 type=write size=3940386 2024-09-12T00:36:19.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.735+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=7AUUHNP5B882 type=del size=3663092 2024-09-12T00:36:19.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.737+0000 7f030cb87780 1 < completed write operation key=POC8YA58U55N tag=J8CUXQ3IM1UZ type=write size=306649 2024-09-12T00:36:19.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.739+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~GF90IJTYUA27.0 size=1048576 2024-09-12T00:36:19.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.740+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~GF90IJTYUA27.1 size=1048576 2024-09-12T00:36:19.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.741+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~GF90IJTYUA27.2 size=896800 2024-09-12T00:36:19.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.741+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=GF90IJTYUA27 tag=LP93O9BZB8Y9 type=write size=4042528 2024-09-12T00:36:19.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.743+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~V2M171O1WH44.0 size=855037 2024-09-12T00:36:19.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.745+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=V2M171O1WH44 tag=ZWI884298S1G type=write size=1903613 2024-09-12T00:36:19.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.746+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=NRITT91OIGVT type=del size=891128 2024-09-12T00:36:19.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.747+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~G81EMX2M97QB.0 size=1048576 2024-09-12T00:36:19.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.749+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~G81EMX2M97QB.1 size=1048576 2024-09-12T00:36:19.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.750+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~G81EMX2M97QB.2 size=594815 2024-09-12T00:36:19.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.753+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=G81EMX2M97QB tag=WHF0KLZC5D1N type=write size=3740543 2024-09-12T00:36:19.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.753+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=0ELCBKARLPDV type=del size=1096119 2024-09-12T00:36:19.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.755+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=QRWEJSWMF788 type=del 2024-09-12T00:36:19.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.757+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~ZH8V7W23LEQA.0 size=665565 2024-09-12T00:36:19.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.757+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=ZH8V7W23LEQA tag=Q8PRFCKVJJI5 type=write size=1714141 2024-09-12T00:36:19.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.758+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=H8NLP823YXD4 type=del 2024-09-12T00:36:19.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.760+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=MCEO43L2ZNBS type=del size=49319 2024-09-12T00:36:19.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.761+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~P920TE3T7NOO.0 size=1048576 2024-09-12T00:36:19.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.762+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~P920TE3T7NOO.1 size=1033033 2024-09-12T00:36:19.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.765+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=P920TE3T7NOO tag=HT16DKE5UMEH type=write size=3130185 2024-09-12T00:36:19.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.766+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=1PS8S9QPAUTQ type=del size=2125511 2024-09-12T00:36:19.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.768+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=WHZMDIRIQZYB type=del 2024-09-12T00:36:19.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.769+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=SVB0FCKJP99I type=del size=3421649 2024-09-12T00:36:19.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.770+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~TP6TUGVFB9O7.0 size=348774 2024-09-12T00:36:19.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.773+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=TP6TUGVFB9O7 tag=6V97HLCUO1Z7 type=write size=1397350 2024-09-12T00:36:19.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.776+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~ZSXENOFQLWHX.0 size=1048576 2024-09-12T00:36:19.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.778+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~ZSXENOFQLWHX.1 size=1048576 2024-09-12T00:36:19.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.779+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~ZSXENOFQLWHX.2 size=809944 2024-09-12T00:36:19.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.779+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=ZSXENOFQLWHX tag=9J39LH4EXILF type=write size=3955672 2024-09-12T00:36:19.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.779+0000 7f030cb87780 1 < completed write operation key=56I20YIPY82N tag=4EH08T5ZQ9G6 type=write size=96289 2024-09-12T00:36:19.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.781+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=BU05NPNA00B3 type=del size=1196749 2024-09-12T00:36:19.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.782+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~PO08FHX1BQA2.0 size=650989 2024-09-12T00:36:19.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.784+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=PO08FHX1BQA2 tag=WE1QUG6NGTVG type=write size=1699565 2024-09-12T00:36:19.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.786+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=IO2HRQ7QQ5IO type=del size=2124186 2024-09-12T00:36:19.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.788+0000 7f030cb87780 1 < suggested remove operation key=327RDLIWLVRO tag=3GNOTKMMOVTY type=write 2024-09-12T00:36:19.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.790+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=VNE5YV881ZRB type=del size=844800 2024-09-12T00:36:19.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.791+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=F40ZS6RQTFKX type=del 2024-09-12T00:36:19.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.792+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=0MNV9GURPK2U type=del size=1107668 2024-09-12T00:36:19.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.793+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=QG06DMLND8CD type=del 2024-09-12T00:36:19.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.795+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~O2DOGDPWKMOA.0 size=1048576 2024-09-12T00:36:19.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.796+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~O2DOGDPWKMOA.1 size=1048576 2024-09-12T00:36:19.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.797+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~O2DOGDPWKMOA.2 size=844463 2024-09-12T00:36:19.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.797+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=O2DOGDPWKMOA tag=YBV645DRSSLV type=write size=3990191 2024-09-12T00:36:19.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.798+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=WYQLEKR4XD8R type=del 2024-09-12T00:36:19.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.800+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=6N6803B8X2GT type=del size=2182192 2024-09-12T00:36:19.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.802+0000 7f030cb87780 1 < suggested update operation key=1PLGUJCB6J0V tag=16ZEBT6E17B5 type=del size=748673 2024-09-12T00:36:19.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.804+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=YPDID54M03T5 type=del size=3071838 2024-09-12T00:36:19.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.807+0000 7f030cb87780 1 < suggested update operation key=CY2NS03IIUJJ tag=7AUUHNP5B882 type=del size=3663092 2024-09-12T00:36:19.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.809+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=71VIQFSA3LBP type=del size=694481 2024-09-12T00:36:19.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.810+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~GF90IJTYUA27.0 size=1048576 2024-09-12T00:36:19.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.811+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~GF90IJTYUA27.1 size=1048576 2024-09-12T00:36:19.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.812+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~GF90IJTYUA27.2 size=896800 2024-09-12T00:36:19.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.815+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=GF90IJTYUA27 tag=LP93O9BZB8Y9 type=write size=4042528 2024-09-12T00:36:19.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.816+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=2SA53F3HPM71 type=del size=627328 2024-09-12T00:36:19.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.817+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=NRITT91OIGVT type=del 2024-09-12T00:36:19.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.819+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=Q4R9U7KB4O0U type=del size=1568539 2024-09-12T00:36:19.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.820+0000 7f030cb87780 1 < canceled operation key=86TWUAZAHI4I tag=0ELCBKARLPDV type=del size=1096119 2024-09-12T00:36:19.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.821+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=9JS8NNL1S4PH type=del size=3409622 2024-09-12T00:36:19.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.822+0000 7f030cb87780 1 < canceled part key=_multipart_39WSAOA6P09M.2~ZH8V7W23LEQA.0 size=665565 2024-09-12T00:36:19.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.825+0000 7f030cb87780 1 < canceled multipart upload key=39WSAOA6P09M upload=ZH8V7W23LEQA tag=Q8PRFCKVJJI5 type=write size=1714141 2024-09-12T00:36:19.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.826+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=3T8XBAOH84N3 type=del size=598845 2024-09-12T00:36:19.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.827+0000 7f030cb87780 -1 < failed to complete operation key=CY2NS03IIUJJ tag=MCEO43L2ZNBS type=del size=49319: (22) Invalid argument 2024-09-12T00:36:19.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.828+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=SD10O7DI2XXN type=del size=1029238 2024-09-12T00:36:19.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.831+0000 7f030cb87780 1 < suggested remove operation key=ZQD0491BHJPM tag=1PS8S9QPAUTQ type=del 2024-09-12T00:36:19.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.832+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=PFXQIM5UQE0T type=del size=1964480 2024-09-12T00:36:19.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.834+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=SVB0FCKJP99I type=del 2024-09-12T00:36:19.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.835+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=16SN5AW2OFEI type=del size=1723068 2024-09-12T00:36:19.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.835+0000 7f030cb87780 1 < canceled part key=_multipart_V87B6SDB1HFZ.2~ZSXENOFQLWHX.0 size=1048576 2024-09-12T00:36:19.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.836+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~ZSXENOFQLWHX.1 size=1048576 2024-09-12T00:36:19.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.837+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~ZSXENOFQLWHX.2 size=809944 2024-09-12T00:36:19.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.840+0000 7f030cb87780 1 < canceled multipart upload key=V87B6SDB1HFZ upload=ZSXENOFQLWHX tag=9J39LH4EXILF type=write size=3955672 2024-09-12T00:36:19.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.842+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=80XTFH41OMH5 type=del size=3941327 2024-09-12T00:36:19.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.843+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=BU05NPNA00B3 type=del 2024-09-12T00:36:19.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.844+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=9OU00GQB11XV type=write size=370713 2024-09-12T00:36:19.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.846+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=IO2HRQ7QQ5IO type=del 2024-09-12T00:36:19.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.847+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=BRF7FHLT582F type=del size=2718502 2024-09-12T00:36:19.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.849+0000 7f030cb87780 1 < canceled operation key=JRPD5AAK84ZD tag=VNE5YV881ZRB type=del size=844800 2024-09-12T00:36:19.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.850+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=31GEMY12QUUA type=del size=1651031 2024-09-12T00:36:19.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.852+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=0MNV9GURPK2U type=del 2024-09-12T00:36:19.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.854+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=KLFN1YTYQ64A type=del size=1498250 2024-09-12T00:36:19.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.856+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~O2DOGDPWKMOA.0 size=1048576 2024-09-12T00:36:19.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.856+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~O2DOGDPWKMOA.1 size=1048576 2024-09-12T00:36:19.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.857+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~O2DOGDPWKMOA.2 size=844463 2024-09-12T00:36:19.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.860+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=O2DOGDPWKMOA tag=YBV645DRSSLV type=write size=3990191 2024-09-12T00:36:19.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.861+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=YREZBMG5AV8P type=del size=2289018 2024-09-12T00:36:19.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.863+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=6N6803B8X2GT type=del 2024-09-12T00:36:19.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.865+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~HTZPPDSX8IMF.0 size=1048576 2024-09-12T00:36:19.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.866+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~HTZPPDSX8IMF.1 size=1048576 2024-09-12T00:36:19.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.867+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~HTZPPDSX8IMF.2 size=766160 2024-09-12T00:36:19.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.867+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=HTZPPDSX8IMF tag=5WENH9XQHJ6R type=write size=3911888 2024-09-12T00:36:19.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.869+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=YPDID54M03T5 type=del 2024-09-12T00:36:19.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.870+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=7LB33T1TSYMY type=del size=3098864 2024-09-12T00:36:19.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.873+0000 7f030cb87780 1 < suggested remove operation key=92GDVW0Q8VKQ tag=71VIQFSA3LBP type=del 2024-09-12T00:36:19.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.875+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~WQN6MRYF9HCC.0 size=1048576 2024-09-12T00:36:19.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.876+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~WQN6MRYF9HCC.1 size=1048576 2024-09-12T00:36:19.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.877+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~WQN6MRYF9HCC.2 size=71835 2024-09-12T00:36:19.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.877+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=WQN6MRYF9HCC tag=VGFJ4MIKDNF0 type=write size=3217563 2024-09-12T00:36:19.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.878+0000 7f030cb87780 -1 < failed to complete operation key=92GDVW0Q8VKQ tag=2SA53F3HPM71 type=del size=627328: (22) Invalid argument 2024-09-12T00:36:19.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.880+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=ECWTSEOLGZG8 type=del size=2554069 2024-09-12T00:36:19.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.881+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=Q4R9U7KB4O0U type=del 2024-09-12T00:36:19.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.884+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~5LURQZEPY6PV.0 size=1048576 2024-09-12T00:36:19.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.885+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~5LURQZEPY6PV.1 size=1048576 2024-09-12T00:36:19.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.886+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~5LURQZEPY6PV.2 size=823208 2024-09-12T00:36:19.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.886+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=5LURQZEPY6PV tag=RRZG3AAAIGG1 type=write size=3968936 2024-09-12T00:36:19.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.887+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=9JS8NNL1S4PH type=del 2024-09-12T00:36:19.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.889+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~3TDGDYMDHLOB.0 size=713797 2024-09-12T00:36:19.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.889+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=3TDGDYMDHLOB tag=0R0NON2OIL43 type=write size=1762373 2024-09-12T00:36:19.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.892+0000 7f030cb87780 1 < suggested remove operation key=INFFH9R3EFRY tag=3T8XBAOH84N3 type=del 2024-09-12T00:36:19.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.893+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=GUYE6HYD08GD type=del size=1258696 2024-09-12T00:36:19.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.895+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=SD10O7DI2XXN type=del 2024-09-12T00:36:19.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.897+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~JYV6D4LNHRQB.0 size=1048576 2024-09-12T00:36:19.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.899+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~JYV6D4LNHRQB.1 size=788830 2024-09-12T00:36:19.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.899+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=JYV6D4LNHRQB tag=OCFNAN0O4MLQ type=write size=2885982 2024-09-12T00:36:19.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.901+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=PFXQIM5UQE0T type=del 2024-09-12T00:36:19.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.902+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=27943QSVQ93B type=del size=3126866 2024-09-12T00:36:19.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.905+0000 7f030cb87780 1 < suggested update operation key=IHTFI7W4A6JT tag=16SN5AW2OFEI type=del size=1723068 2024-09-12T00:36:19.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.908+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~EDE3HB6XRBEB.0 size=1048576 2024-09-12T00:36:19.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.909+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~EDE3HB6XRBEB.1 size=1048576 2024-09-12T00:36:19.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.910+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~EDE3HB6XRBEB.2 size=167957 2024-09-12T00:36:19.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.910+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=EDE3HB6XRBEB tag=C0YTHSG3CKQ7 type=write size=3313685 2024-09-12T00:36:19.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.912+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=80XTFH41OMH5 type=del 2024-09-12T00:36:19.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.914+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~BU8H35W2CWD6.0 size=1048576 2024-09-12T00:36:19.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.916+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~BU8H35W2CWD6.1 size=651207 2024-09-12T00:36:19.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.916+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=BU8H35W2CWD6 tag=BYYLZT1GB4K3 type=write size=2748359 2024-09-12T00:36:19.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.917+0000 7f030cb87780 1 < completed write operation key=N3KD1UVUVM95 tag=9OU00GQB11XV type=write size=370713 2024-09-12T00:36:19.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.918+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=00T3QRFKHOW1 type=del size=3618580 2024-09-12T00:36:19.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.920+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=BRF7FHLT582F type=del 2024-09-12T00:36:19.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.923+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~WLE3H94PF0LA.0 size=1048576 2024-09-12T00:36:19.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.923+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~WLE3H94PF0LA.1 size=1048576 2024-09-12T00:36:19.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.924+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~WLE3H94PF0LA.2 size=936446 2024-09-12T00:36:19.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.924+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=WLE3H94PF0LA tag=WCTFONVR8IM7 type=write size=4082174 2024-09-12T00:36:19.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.926+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=31GEMY12QUUA type=del 2024-09-12T00:36:19.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.927+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=I8YQ0W33C6E0 type=del size=3009601 2024-09-12T00:36:19.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.931+0000 7f030cb87780 1 < suggested remove operation key=QGSJ51GMQXVK tag=KLFN1YTYQ64A type=del 2024-09-12T00:36:19.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.931+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=E932BLPMVG06 type=del size=266612 2024-09-12T00:36:19.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.934+0000 7f030cb87780 1 < suggested remove operation key=U5CWO1EN8BFI tag=YREZBMG5AV8P type=del 2024-09-12T00:36:19.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.937+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~A4C4S7TMQD01.0 size=1048576 2024-09-12T00:36:19.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.937+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~A4C4S7TMQD01.1 size=1048576 2024-09-12T00:36:19.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.938+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~A4C4S7TMQD01.2 size=131806 2024-09-12T00:36:19.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.938+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=A4C4S7TMQD01 tag=ADTW4WQS1FKY type=write size=3277534 2024-09-12T00:36:19.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.940+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~HTZPPDSX8IMF.0 size=1048576 2024-09-12T00:36:19.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.941+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~HTZPPDSX8IMF.1 size=1048576 2024-09-12T00:36:19.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.942+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~HTZPPDSX8IMF.2 size=766160 2024-09-12T00:36:19.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.944+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=HTZPPDSX8IMF tag=5WENH9XQHJ6R type=write size=3911888 2024-09-12T00:36:19.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.945+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=AE33KZ24G37Z type=write size=538572 2024-09-12T00:36:19.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.947+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=7LB33T1TSYMY type=del 2024-09-12T00:36:19.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.948+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=CFNRBP2AE3R4 type=del size=1716139 2024-09-12T00:36:19.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.950+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~WQN6MRYF9HCC.0 size=1048576 2024-09-12T00:36:19.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.951+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~WQN6MRYF9HCC.1 size=1048576 2024-09-12T00:36:19.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.952+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~WQN6MRYF9HCC.2 size=71835 2024-09-12T00:36:19.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.954+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=WQN6MRYF9HCC tag=VGFJ4MIKDNF0 type=write size=3217563 2024-09-12T00:36:19.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.956+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=2MV135KTZIZ2 type=write size=437327 2024-09-12T00:36:19.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.957+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=ECWTSEOLGZG8 type=del 2024-09-12T00:36:19.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.960+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~VMG0C1PF7L34.0 size=1048576 2024-09-12T00:36:19.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.960+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~VMG0C1PF7L34.1 size=186683 2024-09-12T00:36:19.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.960+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=VMG0C1PF7L34 tag=9ZIDYL529F11 type=write size=2283835 2024-09-12T00:36:19.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.962+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~5LURQZEPY6PV.0 size=1048576 2024-09-12T00:36:19.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.963+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~5LURQZEPY6PV.1 size=1048576 2024-09-12T00:36:19.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.964+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~5LURQZEPY6PV.2 size=823208 2024-09-12T00:36:19.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.966+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=5LURQZEPY6PV tag=RRZG3AAAIGG1 type=write size=3968936 2024-09-12T00:36:19.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.968+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=EPEYBHR5I0BH type=write size=270361 2024-09-12T00:36:19.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.969+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~3TDGDYMDHLOB.0 size=713797 2024-09-12T00:36:19.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.971+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=3TDGDYMDHLOB tag=0R0NON2OIL43 type=write size=1762373 2024-09-12T00:36:19.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.974+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~DAH7NQFRK06J.0 size=1048576 2024-09-12T00:36:19.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.975+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~DAH7NQFRK06J.1 size=757870 2024-09-12T00:36:19.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.975+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=DAH7NQFRK06J tag=1DL7YZMH6IAG type=write size=2855022 2024-09-12T00:36:19.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.976+0000 7f030cb87780 1 < canceled operation key=UFYMVGL264T8 tag=GUYE6HYD08GD type=del size=1258696 2024-09-12T00:36:19.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.977+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=OEEV73197BB5 type=del size=2275945 2024-09-12T00:36:19.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.979+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~JYV6D4LNHRQB.0 size=1048576 2024-09-12T00:36:19.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.980+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~JYV6D4LNHRQB.1 size=788830 2024-09-12T00:36:19.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.982+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=JYV6D4LNHRQB tag=OCFNAN0O4MLQ type=write size=2885982 2024-09-12T00:36:19.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.983+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=ZOW3K1MC4LDC type=del size=2557607 2024-09-12T00:36:19.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.984+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=27943QSVQ93B type=del 2024-09-12T00:36:19.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.987+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~1PDINTLMRXZU.0 size=1048576 2024-09-12T00:36:19.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.988+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~1PDINTLMRXZU.1 size=1048576 2024-09-12T00:36:19.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.989+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~1PDINTLMRXZU.2 size=894433 2024-09-12T00:36:19.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.989+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=1PDINTLMRXZU tag=Y9YRYEV11HZG type=write size=4040161 2024-09-12T00:36:19.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.990+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~EDE3HB6XRBEB.0 size=1048576 2024-09-12T00:36:19.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.991+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~EDE3HB6XRBEB.1 size=1048576 2024-09-12T00:36:19.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.993+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~EDE3HB6XRBEB.2 size=167957 2024-09-12T00:36:19.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.995+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=EDE3HB6XRBEB tag=C0YTHSG3CKQ7 type=write size=3313685 2024-09-12T00:36:19.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.998+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~K2RGHV9O4X9U.0 size=1048576 2024-09-12T00:36:19.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.998+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~K2RGHV9O4X9U.1 size=1048576 2024-09-12T00:36:19.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.999+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~K2RGHV9O4X9U.2 size=265651 2024-09-12T00:36:19.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:19.999+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=K2RGHV9O4X9U tag=AHZCTGXK16NB type=write size=3411379 2024-09-12T00:36:19.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.000+0000 7f030cb87780 1 < canceled part key=_multipart_1PLGUJCB6J0V.2~BU8H35W2CWD6.0 size=1048576 2024-09-12T00:36:20.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.001+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~BU8H35W2CWD6.1 size=651207 2024-09-12T00:36:20.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.003+0000 7f030cb87780 1 < canceled multipart upload key=1PLGUJCB6J0V upload=BU8H35W2CWD6 tag=BYYLZT1GB4K3 type=write size=2748359 2024-09-12T00:36:20.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.004+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=SYHWHF738LV1 type=write size=707071 2024-09-12T00:36:20.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.006+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=00T3QRFKHOW1 type=del 2024-09-12T00:36:20.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.008+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~9NPKCQF4X7CP.0 size=1048576 2024-09-12T00:36:20.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.009+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~9NPKCQF4X7CP.1 size=1048576 2024-09-12T00:36:20.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.010+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~9NPKCQF4X7CP.2 size=28769 2024-09-12T00:36:20.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.010+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=9NPKCQF4X7CP tag=208MG0F43X1Q type=write size=3174497 2024-09-12T00:36:20.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.012+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~WLE3H94PF0LA.0 size=1048576 2024-09-12T00:36:20.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.014+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~WLE3H94PF0LA.1 size=1048576 2024-09-12T00:36:20.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.014+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~WLE3H94PF0LA.2 size=936446 2024-09-12T00:36:20.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.017+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=WLE3H94PF0LA tag=WCTFONVR8IM7 type=write size=4082174 2024-09-12T00:36:20.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.019+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~P12P42BU25Q3.0 size=1048576 2024-09-12T00:36:20.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.020+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~P12P42BU25Q3.1 size=787468 2024-09-12T00:36:20.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.020+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=P12P42BU25Q3 tag=V6K0AN7SZU6T type=write size=2884620 2024-09-12T00:36:20.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.022+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=I8YQ0W33C6E0 type=del 2024-09-12T00:36:20.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.023+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=ZN4HSK3QQGEN type=write size=524660 2024-09-12T00:36:20.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.027+0000 7f030cb87780 1 < suggested remove operation key=UFYMVGL264T8 tag=E932BLPMVG06 type=del 2024-09-12T00:36:20.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.028+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=KEM8822G1SYF type=del size=524413 2024-09-12T00:36:20.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.030+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~A4C4S7TMQD01.0 size=1048576 2024-09-12T00:36:20.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.032+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~A4C4S7TMQD01.1 size=1048576 2024-09-12T00:36:20.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.033+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~A4C4S7TMQD01.2 size=131806 2024-09-12T00:36:20.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.036+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=A4C4S7TMQD01 tag=ADTW4WQS1FKY type=write size=3277534 2024-09-12T00:36:20.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.037+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=QWOQHR6UUHLN type=del size=3518721 2024-09-12T00:36:20.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.039+0000 7f030cb87780 1 < completed write operation key=QGSJ51GMQXVK tag=AE33KZ24G37Z type=write size=538572 2024-09-12T00:36:20.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.040+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=CLAVYX4OSRTA type=del size=1776240 2024-09-12T00:36:20.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.042+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=CFNRBP2AE3R4 type=del 2024-09-12T00:36:20.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.044+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~2JDCGYBMMRTM.0 size=1048576 2024-09-12T00:36:20.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.046+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~2JDCGYBMMRTM.1 size=1048576 2024-09-12T00:36:20.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.047+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~2JDCGYBMMRTM.2 size=990077 2024-09-12T00:36:20.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.047+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=2JDCGYBMMRTM tag=HGWN8N0E2NNT type=write size=4135805 2024-09-12T00:36:20.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.050+0000 7f030cb87780 1 < suggested remove operation key=OR439FK5L43V tag=2MV135KTZIZ2 type=write 2024-09-12T00:36:20.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.051+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=GR9LNK8YTDT6 type=del size=1560906 2024-09-12T00:36:20.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.053+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~VMG0C1PF7L34.0 size=1048576 2024-09-12T00:36:20.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.054+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~VMG0C1PF7L34.1 size=186683 2024-09-12T00:36:20.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.059+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=VMG0C1PF7L34 tag=9ZIDYL529F11 type=write size=2283835 2024-09-12T00:36:20.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.061+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~S80G6I8HFRIS.0 size=1048576 2024-09-12T00:36:20.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.063+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~S80G6I8HFRIS.1 size=1048576 2024-09-12T00:36:20.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.064+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~S80G6I8HFRIS.2 size=409031 2024-09-12T00:36:20.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.064+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=S80G6I8HFRIS tag=ZKO9SNGUA3DV type=write size=3554759 2024-09-12T00:36:20.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.065+0000 7f030cb87780 1 < completed write operation key=IHTFI7W4A6JT tag=EPEYBHR5I0BH type=write size=270361 2024-09-12T00:36:20.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.067+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=IQRDNGKSXT1O type=del size=3236928 2024-09-12T00:36:20.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.068+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~DAH7NQFRK06J.0 size=1048576 2024-09-12T00:36:20.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.069+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~DAH7NQFRK06J.1 size=757870 2024-09-12T00:36:20.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.072+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=DAH7NQFRK06J tag=1DL7YZMH6IAG type=write size=2855022 2024-09-12T00:36:20.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.073+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=5P26PZ5GM6SB type=del size=3745458 2024-09-12T00:36:20.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.074+0000 7f030cb87780 -1 < no bi entry to suggest for operation key=UFYMVGL264T8 tag=OEEV73197BB5 type=del size=2275945: (2) No such file or directory 2024-09-12T00:36:20.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.076+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=0Y3XL20LV8O1 type=write size=520949 2024-09-12T00:36:20.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.078+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=ZOW3K1MC4LDC type=del 2024-09-12T00:36:20.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.079+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=PYZH7KLGG1V8 type=del size=2715910 2024-09-12T00:36:20.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.080+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~1PDINTLMRXZU.0 size=1048576 2024-09-12T00:36:20.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.081+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~1PDINTLMRXZU.1 size=1048576 2024-09-12T00:36:20.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.083+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~1PDINTLMRXZU.2 size=894433 2024-09-12T00:36:20.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.085+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=1PDINTLMRXZU tag=Y9YRYEV11HZG type=write size=4040161 2024-09-12T00:36:20.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.089+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~JUPUUTHLDVL8.0 size=1048576 2024-09-12T00:36:20.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.089+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~JUPUUTHLDVL8.1 size=1048576 2024-09-12T00:36:20.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.090+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~JUPUUTHLDVL8.2 size=459937 2024-09-12T00:36:20.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.090+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=JUPUUTHLDVL8 tag=J1KCA333SH6N type=write size=3605665 2024-09-12T00:36:20.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.091+0000 7f030cb87780 1 < canceled part key=_multipart_POC8YA58U55N.2~K2RGHV9O4X9U.0 size=1048576 2024-09-12T00:36:20.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.092+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~K2RGHV9O4X9U.1 size=1048576 2024-09-12T00:36:20.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.093+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~K2RGHV9O4X9U.2 size=265651 2024-09-12T00:36:20.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.096+0000 7f030cb87780 1 < canceled multipart upload key=POC8YA58U55N upload=K2RGHV9O4X9U tag=AHZCTGXK16NB type=write size=3411379 2024-09-12T00:36:20.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.098+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~FTFI6099LLR4.0 size=1048576 2024-09-12T00:36:20.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.099+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~FTFI6099LLR4.1 size=1010829 2024-09-12T00:36:20.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.099+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=FTFI6099LLR4 tag=N7UFSYNYX5S1 type=write size=3107981 2024-09-12T00:36:20.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.101+0000 7f030cb87780 1 < completed write operation key=POC8YA58U55N tag=SYHWHF738LV1 type=write size=707071 2024-09-12T00:36:20.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.102+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=6LQ9FY9VN20I type=del size=312645 2024-09-12T00:36:20.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.104+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~9NPKCQF4X7CP.0 size=1048576 2024-09-12T00:36:20.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.104+0000 7f030cb87780 1 < canceled part key=_multipart_IHTFI7W4A6JT.2~9NPKCQF4X7CP.1 size=1048576 2024-09-12T00:36:20.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.105+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~9NPKCQF4X7CP.2 size=28769 2024-09-12T00:36:20.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.107+0000 7f030cb87780 1 < canceled multipart upload key=IHTFI7W4A6JT upload=9NPKCQF4X7CP tag=208MG0F43X1Q type=write size=3174497 2024-09-12T00:36:20.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.110+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~9FGRUR52TUSF.0 size=1043693 2024-09-12T00:36:20.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.110+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=9FGRUR52TUSF tag=CA3TB1G6921L type=write size=2092269 2024-09-12T00:36:20.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.111+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~P12P42BU25Q3.0 size=1048576 2024-09-12T00:36:20.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.112+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~P12P42BU25Q3.1 size=787468 2024-09-12T00:36:20.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.115+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=P12P42BU25Q3 tag=V6K0AN7SZU6T type=write size=2884620 2024-09-12T00:36:20.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.116+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=LBYHRDC1SE0S type=del size=1950106 2024-09-12T00:36:20.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.118+0000 7f030cb87780 -1 < failed to complete operation key=OR439FK5L43V tag=ZN4HSK3QQGEN type=write size=524660: (22) Invalid argument 2024-09-12T00:36:20.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.120+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=OWIJI1YKMEXX type=del size=2251008 2024-09-12T00:36:20.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.121+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=KEM8822G1SYF type=del 2024-09-12T00:36:20.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.124+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~HYBXF1DT9QLY.0 size=1048576 2024-09-12T00:36:20.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.125+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~HYBXF1DT9QLY.1 size=1048576 2024-09-12T00:36:20.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.126+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~HYBXF1DT9QLY.2 size=189012 2024-09-12T00:36:20.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.126+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=HYBXF1DT9QLY tag=18K8JCLVXMRJ type=write size=3334740 2024-09-12T00:36:20.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.127+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=QWOQHR6UUHLN type=del 2024-09-12T00:36:20.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.130+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~11EJOZVBOYKH.0 size=1048576 2024-09-12T00:36:20.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.131+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~11EJOZVBOYKH.1 size=1048576 2024-09-12T00:36:20.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.133+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~11EJOZVBOYKH.2 size=217248 2024-09-12T00:36:20.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.133+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=11EJOZVBOYKH tag=IU00AWC6RSZK type=write size=3362976 2024-09-12T00:36:20.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.134+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=CLAVYX4OSRTA type=del 2024-09-12T00:36:20.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.136+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=6I76U2HJFHQR type=del size=4053099 2024-09-12T00:36:20.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.137+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~2JDCGYBMMRTM.0 size=1048576 2024-09-12T00:36:20.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.138+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~2JDCGYBMMRTM.1 size=1048576 2024-09-12T00:36:20.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.139+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~2JDCGYBMMRTM.2 size=990077 2024-09-12T00:36:20.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.142+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=2JDCGYBMMRTM tag=HGWN8N0E2NNT type=write size=4135805 2024-09-12T00:36:20.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.145+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~OJKXBWM3M8ZX.0 size=82639 2024-09-12T00:36:20.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.145+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=OJKXBWM3M8ZX tag=KOM3P8HLRDZ1 type=write size=1131215 2024-09-12T00:36:20.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.146+0000 7f030cb87780 1 < canceled operation key=800OHA7UURC4 tag=GR9LNK8YTDT6 type=del size=1560906 2024-09-12T00:36:20.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.148+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=NAAFQDH5781R type=del size=1335186 2024-09-12T00:36:20.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.149+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~S80G6I8HFRIS.0 size=1048576 2024-09-12T00:36:20.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.151+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~S80G6I8HFRIS.1 size=1048576 2024-09-12T00:36:20.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.152+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~S80G6I8HFRIS.2 size=409031 2024-09-12T00:36:20.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.154+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=S80G6I8HFRIS tag=ZKO9SNGUA3DV type=write size=3554759 2024-09-12T00:36:20.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.159+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~LT56R9Q4QW8E.0 size=271402 2024-09-12T00:36:20.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.159+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=LT56R9Q4QW8E tag=250IMMRPIC8M type=write size=1319978 2024-09-12T00:36:20.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.161+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=IQRDNGKSXT1O type=del 2024-09-12T00:36:20.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.164+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~55KAFI33ZEKU.0 size=1048576 2024-09-12T00:36:20.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.165+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~55KAFI33ZEKU.1 size=860713 2024-09-12T00:36:20.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.165+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=55KAFI33ZEKU tag=GDZT8Z6ID8NI type=write size=2957865 2024-09-12T00:36:20.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.166+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=5P26PZ5GM6SB type=del 2024-09-12T00:36:20.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.168+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=VT5KH0AI4BIG type=del size=186261 2024-09-12T00:36:20.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.169+0000 7f030cb87780 1 < completed write operation key=JRPD5AAK84ZD tag=0Y3XL20LV8O1 type=write size=520949 2024-09-12T00:36:20.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.172+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~T669ZSPAT62A.0 size=1048576 2024-09-12T00:36:20.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.174+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~T669ZSPAT62A.1 size=856906 2024-09-12T00:36:20.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.174+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=T669ZSPAT62A tag=E1RQSH1PLBH5 type=write size=2954058 2024-09-12T00:36:20.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.176+0000 7f030cb87780 1 < canceled operation key=IY156CJWG2TB tag=PYZH7KLGG1V8 type=del size=2715910 2024-09-12T00:36:20.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.177+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=H76UBDRR0DIB type=write size=582059 2024-09-12T00:36:20.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.178+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~JUPUUTHLDVL8.0 size=1048576 2024-09-12T00:36:20.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.179+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~JUPUUTHLDVL8.1 size=1048576 2024-09-12T00:36:20.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.181+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~JUPUUTHLDVL8.2 size=459937 2024-09-12T00:36:20.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.183+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=JUPUUTHLDVL8 tag=J1KCA333SH6N type=write size=3605665 2024-09-12T00:36:20.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.186+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~0WEZA07BFPG2.0 size=1048576 2024-09-12T00:36:20.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.187+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~0WEZA07BFPG2.1 size=1048576 2024-09-12T00:36:20.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.188+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~0WEZA07BFPG2.2 size=626147 2024-09-12T00:36:20.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.188+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=0WEZA07BFPG2 tag=3NY4N3ML6PYL type=write size=3771875 2024-09-12T00:36:20.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.189+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~FTFI6099LLR4.0 size=1048576 2024-09-12T00:36:20.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.191+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~FTFI6099LLR4.1 size=1010829 2024-09-12T00:36:20.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.193+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=FTFI6099LLR4 tag=N7UFSYNYX5S1 type=write size=3107981 2024-09-12T00:36:20.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.194+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=ZXQ7NE4MNAM7 type=del size=3139212 2024-09-12T00:36:20.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.196+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=6LQ9FY9VN20I type=del 2024-09-12T00:36:20.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.198+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~JZU9YUYSCHJP.0 size=1048576 2024-09-12T00:36:20.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.199+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~JZU9YUYSCHJP.1 size=294832 2024-09-12T00:36:20.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.199+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=JZU9YUYSCHJP tag=RP4JUF2CIXXI type=write size=2391984 2024-09-12T00:36:20.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.201+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~9FGRUR52TUSF.0 size=1043693 2024-09-12T00:36:20.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.203+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=9FGRUR52TUSF tag=CA3TB1G6921L type=write size=2092269 2024-09-12T00:36:20.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.204+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=9P4FJBY2O11R type=del size=2813525 2024-09-12T00:36:20.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.205+0000 7f030cb87780 1 < canceled operation key=39WSAOA6P09M tag=LBYHRDC1SE0S type=del size=1950106 2024-09-12T00:36:20.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.208+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~XFM3UQV2RCSA.0 size=1048576 2024-09-12T00:36:20.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.209+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~XFM3UQV2RCSA.1 size=962104 2024-09-12T00:36:20.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.209+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=XFM3UQV2RCSA tag=H2EVWO533D65 type=write size=3059256 2024-09-12T00:36:20.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.210+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=OWIJI1YKMEXX type=del 2024-09-12T00:36:20.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.213+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~CW9JBAIT0ZMI.0 size=243492 2024-09-12T00:36:20.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.213+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=CW9JBAIT0ZMI tag=LBDJT9IMAEAO type=write size=1292068 2024-09-12T00:36:20.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.214+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~HYBXF1DT9QLY.0 size=1048576 2024-09-12T00:36:20.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.215+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~HYBXF1DT9QLY.1 size=1048576 2024-09-12T00:36:20.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.216+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~HYBXF1DT9QLY.2 size=189012 2024-09-12T00:36:20.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.219+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=HYBXF1DT9QLY tag=18K8JCLVXMRJ type=write size=3334740 2024-09-12T00:36:20.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.220+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=LVJ9RK53JZ4S type=del size=1832512 2024-09-12T00:36:20.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.221+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~11EJOZVBOYKH.0 size=1048576 2024-09-12T00:36:20.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.222+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~11EJOZVBOYKH.1 size=1048576 2024-09-12T00:36:20.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.224+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~11EJOZVBOYKH.2 size=217248 2024-09-12T00:36:20.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.227+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=11EJOZVBOYKH tag=IU00AWC6RSZK type=write size=3362976 2024-09-12T00:36:20.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.230+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~2SSLEH2QZOFA.0 size=1048576 2024-09-12T00:36:20.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.231+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~2SSLEH2QZOFA.1 size=275320 2024-09-12T00:36:20.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.231+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=2SSLEH2QZOFA tag=XIE88YFGOLKB type=write size=2372472 2024-09-12T00:36:20.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.234+0000 7f030cb87780 1 < suggested update operation key=N3KD1UVUVM95 tag=6I76U2HJFHQR type=del size=4053099 2024-09-12T00:36:20.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.235+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=YHL0JZ4XO2IW type=del size=2311731 2024-09-12T00:36:20.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.237+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~OJKXBWM3M8ZX.0 size=82639 2024-09-12T00:36:20.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.239+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=OJKXBWM3M8ZX tag=KOM3P8HLRDZ1 type=write size=1131215 2024-09-12T00:36:20.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.241+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~ZPXU8F2LTCDM.0 size=1048576 2024-09-12T00:36:20.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.243+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~ZPXU8F2LTCDM.1 size=1048576 2024-09-12T00:36:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.244+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~ZPXU8F2LTCDM.2 size=177003 2024-09-12T00:36:20.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.244+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=ZPXU8F2LTCDM tag=NRE4YA9N8FIK type=write size=3322731 2024-09-12T00:36:20.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.246+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=NAAFQDH5781R type=del 2024-09-12T00:36:20.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.247+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=GG8689EJC6MW type=del size=1841611 2024-09-12T00:36:20.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.248+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~LT56R9Q4QW8E.0 size=271402 2024-09-12T00:36:20.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.252+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=LT56R9Q4QW8E tag=250IMMRPIC8M type=write size=1319978 2024-09-12T00:36:20.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.254+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~A8HTG3UQ6963.0 size=1048576 2024-09-12T00:36:20.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.255+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~A8HTG3UQ6963.1 size=1048576 2024-09-12T00:36:20.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.257+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~A8HTG3UQ6963.2 size=710797 2024-09-12T00:36:20.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.257+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=A8HTG3UQ6963 tag=TRZAV8B6KICZ type=write size=3856525 2024-09-12T00:36:20.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.258+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~55KAFI33ZEKU.0 size=1048576 2024-09-12T00:36:20.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.259+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~55KAFI33ZEKU.1 size=860713 2024-09-12T00:36:20.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.261+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=55KAFI33ZEKU tag=GDZT8Z6ID8NI type=write size=2957865 2024-09-12T00:36:20.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.264+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~PT0Q23IEX508.0 size=1048576 2024-09-12T00:36:20.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.265+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~PT0Q23IEX508.1 size=747016 2024-09-12T00:36:20.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.265+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=PT0Q23IEX508 tag=1IXDOO2RI3XI type=write size=2844168 2024-09-12T00:36:20.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.266+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=VT5KH0AI4BIG type=del 2024-09-12T00:36:20.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.269+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~2PG1KK3GG7AY.0 size=1048576 2024-09-12T00:36:20.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.270+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~2PG1KK3GG7AY.1 size=1048576 2024-09-12T00:36:20.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.271+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~2PG1KK3GG7AY.2 size=830125 2024-09-12T00:36:20.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.271+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=2PG1KK3GG7AY tag=WJZZJWL4N1AK type=write size=3975853 2024-09-12T00:36:20.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.272+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~T669ZSPAT62A.0 size=1048576 2024-09-12T00:36:20.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.273+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~T669ZSPAT62A.1 size=856906 2024-09-12T00:36:20.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.276+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=T669ZSPAT62A tag=E1RQSH1PLBH5 type=write size=2954058 2024-09-12T00:36:20.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.278+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~4DVW7QC19ZBT.0 size=1048576 2024-09-12T00:36:20.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.279+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~4DVW7QC19ZBT.1 size=1048576 2024-09-12T00:36:20.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.281+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~4DVW7QC19ZBT.2 size=517606 2024-09-12T00:36:20.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.281+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=4DVW7QC19ZBT tag=PN0SV321Q5ED type=write size=3663334 2024-09-12T00:36:20.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.282+0000 7f030cb87780 1 < completed write operation key=INFFH9R3EFRY tag=H76UBDRR0DIB type=write size=582059 2024-09-12T00:36:20.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.285+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~63JDPXE91FT6.0 size=1048576 2024-09-12T00:36:20.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.286+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~63JDPXE91FT6.1 size=1048576 2024-09-12T00:36:20.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.287+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~63JDPXE91FT6.2 size=191513 2024-09-12T00:36:20.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.287+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=63JDPXE91FT6 tag=XHBRL0H09NDC type=write size=3337241 2024-09-12T00:36:20.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.288+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~0WEZA07BFPG2.0 size=1048576 2024-09-12T00:36:20.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.288+0000 7f030cb87780 1 < canceled part key=_multipart_1PLGUJCB6J0V.2~0WEZA07BFPG2.1 size=1048576 2024-09-12T00:36:20.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.289+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~0WEZA07BFPG2.2 size=626147 2024-09-12T00:36:20.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.292+0000 7f030cb87780 1 < canceled multipart upload key=1PLGUJCB6J0V upload=0WEZA07BFPG2 tag=3NY4N3ML6PYL type=write size=3771875 2024-09-12T00:36:20.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.293+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=3G41IILP1X1G type=del size=2712355 2024-09-12T00:36:20.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.295+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=ZXQ7NE4MNAM7 type=del 2024-09-12T00:36:20.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.296+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=3GRQMDAW1NTU type=del size=1192724 2024-09-12T00:36:20.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.297+0000 7f030cb87780 1 < canceled part key=_multipart_9MCRD2G3MZIT.2~JZU9YUYSCHJP.0 size=1048576 2024-09-12T00:36:20.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.298+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~JZU9YUYSCHJP.1 size=294832 2024-09-12T00:36:20.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.301+0000 7f030cb87780 1 < canceled multipart upload key=9MCRD2G3MZIT upload=JZU9YUYSCHJP tag=RP4JUF2CIXXI type=write size=2391984 2024-09-12T00:36:20.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.304+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~34I5X7UIXEO3.0 size=1048576 2024-09-12T00:36:20.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.305+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~34I5X7UIXEO3.1 size=1048576 2024-09-12T00:36:20.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.306+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~34I5X7UIXEO3.2 size=114828 2024-09-12T00:36:20.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.306+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=34I5X7UIXEO3 tag=93PFQAUCFEOD type=write size=3260556 2024-09-12T00:36:20.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.307+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=9P4FJBY2O11R type=del 2024-09-12T00:36:20.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.310+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~NC0AJRXC3LVD.0 size=1048576 2024-09-12T00:36:20.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.311+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~NC0AJRXC3LVD.1 size=1048576 2024-09-12T00:36:20.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.312+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~NC0AJRXC3LVD.2 size=762922 2024-09-12T00:36:20.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.312+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=NC0AJRXC3LVD tag=ZDRNCH34HQDG type=write size=3908650 2024-09-12T00:36:20.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.313+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~XFM3UQV2RCSA.0 size=1048576 2024-09-12T00:36:20.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.314+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~XFM3UQV2RCSA.1 size=962104 2024-09-12T00:36:20.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.317+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=XFM3UQV2RCSA tag=H2EVWO533D65 type=write size=3059256 2024-09-12T00:36:20.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.318+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=FACCZPZL6NKR type=del size=3644143 2024-09-12T00:36:20.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.319+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~CW9JBAIT0ZMI.0 size=243492 2024-09-12T00:36:20.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.321+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=CW9JBAIT0ZMI tag=LBDJT9IMAEAO type=write size=1292068 2024-09-12T00:36:20.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.324+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~7RFCTUMLZWP6.0 size=775862 2024-09-12T00:36:20.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.324+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=7RFCTUMLZWP6 tag=X6UE1II648OI type=write size=1824438 2024-09-12T00:36:20.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.325+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=LVJ9RK53JZ4S type=del 2024-09-12T00:36:20.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.328+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~5Y0N9OUHEMJM.0 size=1048576 2024-09-12T00:36:20.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.329+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~5Y0N9OUHEMJM.1 size=1048576 2024-09-12T00:36:20.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.330+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~5Y0N9OUHEMJM.2 size=50455 2024-09-12T00:36:20.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.330+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=5Y0N9OUHEMJM tag=EEDY8LXVAAX1 type=write size=3196183 2024-09-12T00:36:20.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.332+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~2SSLEH2QZOFA.0 size=1048576 2024-09-12T00:36:20.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.333+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~2SSLEH2QZOFA.1 size=275320 2024-09-12T00:36:20.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.335+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=2SSLEH2QZOFA tag=XIE88YFGOLKB type=write size=2372472 2024-09-12T00:36:20.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.337+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~5G3BXDC2BZ73.0 size=1048576 2024-09-12T00:36:20.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.338+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~5G3BXDC2BZ73.1 size=1048576 2024-09-12T00:36:20.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.340+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~5G3BXDC2BZ73.2 size=14873 2024-09-12T00:36:20.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.340+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=5G3BXDC2BZ73 tag=X4NAEA2CGG56 type=write size=3160601 2024-09-12T00:36:20.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.343+0000 7f030cb87780 1 < suggested update operation key=800OHA7UURC4 tag=YHL0JZ4XO2IW type=del size=2311731 2024-09-12T00:36:20.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.344+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=FNJI0E4XPSDP type=del size=1952272 2024-09-12T00:36:20.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.345+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~ZPXU8F2LTCDM.0 size=1048576 2024-09-12T00:36:20.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.346+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~ZPXU8F2LTCDM.1 size=1048576 2024-09-12T00:36:20.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.348+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~ZPXU8F2LTCDM.2 size=177003 2024-09-12T00:36:20.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.350+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=ZPXU8F2LTCDM tag=NRE4YA9N8FIK type=write size=3322731 2024-09-12T00:36:20.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.352+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~PEXXQR02ELT0.0 size=1048576 2024-09-12T00:36:20.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.353+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~PEXXQR02ELT0.1 size=669531 2024-09-12T00:36:20.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.353+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=PEXXQR02ELT0 tag=HQU0JPIZ5SBI type=write size=2766683 2024-09-12T00:36:20.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.355+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=GG8689EJC6MW type=del 2024-09-12T00:36:20.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.356+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=THVRSPHV1BKF type=write size=138325 2024-09-12T00:36:20.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.358+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~A8HTG3UQ6963.0 size=1048576 2024-09-12T00:36:20.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.359+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~A8HTG3UQ6963.1 size=1048576 2024-09-12T00:36:20.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.360+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~A8HTG3UQ6963.2 size=710797 2024-09-12T00:36:20.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.363+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=A8HTG3UQ6963 tag=TRZAV8B6KICZ type=write size=3856525 2024-09-12T00:36:20.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.364+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=WCH2I2DYV5QC type=del size=2555837 2024-09-12T00:36:20.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.365+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~PT0Q23IEX508.0 size=1048576 2024-09-12T00:36:20.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.366+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~PT0Q23IEX508.1 size=747016 2024-09-12T00:36:20.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.368+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=PT0Q23IEX508 tag=1IXDOO2RI3XI type=write size=2844168 2024-09-12T00:36:20.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.370+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=PHKZDKBBOGW6 type=del size=3418708 2024-09-12T00:36:20.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.371+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~2PG1KK3GG7AY.0 size=1048576 2024-09-12T00:36:20.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.372+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~2PG1KK3GG7AY.1 size=1048576 2024-09-12T00:36:20.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.374+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~2PG1KK3GG7AY.2 size=830125 2024-09-12T00:36:20.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.376+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=2PG1KK3GG7AY tag=WJZZJWL4N1AK type=write size=3975853 2024-09-12T00:36:20.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.377+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=B8SN7QAFAFLM type=write size=1907 2024-09-12T00:36:20.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.379+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~4DVW7QC19ZBT.0 size=1048576 2024-09-12T00:36:20.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.380+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~4DVW7QC19ZBT.1 size=1048576 2024-09-12T00:36:20.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.381+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~4DVW7QC19ZBT.2 size=517606 2024-09-12T00:36:20.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.384+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=4DVW7QC19ZBT tag=PN0SV321Q5ED type=write size=3663334 2024-09-12T00:36:20.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.386+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~4LMW313OZPR9.0 size=1048576 2024-09-12T00:36:20.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.387+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~4LMW313OZPR9.1 size=755127 2024-09-12T00:36:20.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.387+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=4LMW313OZPR9 tag=D82P7NKNC0JI type=write size=2852279 2024-09-12T00:36:20.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.387+0000 7f030cb87780 1 < canceled part key=_multipart_1PLGUJCB6J0V.2~63JDPXE91FT6.0 size=1048576 2024-09-12T00:36:20.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.388+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~63JDPXE91FT6.1 size=1048576 2024-09-12T00:36:20.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.390+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~63JDPXE91FT6.2 size=191513 2024-09-12T00:36:20.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.392+0000 7f030cb87780 1 < canceled multipart upload key=1PLGUJCB6J0V upload=63JDPXE91FT6 tag=XHBRL0H09NDC type=write size=3337241 2024-09-12T00:36:20.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.393+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=N07AEDUMX4JZ type=del size=4050815 2024-09-12T00:36:20.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.394+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=3G41IILP1X1G type=del 2024-09-12T00:36:20.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.396+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=4HT3W87EC2JQ type=write size=408916 2024-09-12T00:36:20.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.397+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=3GRQMDAW1NTU type=del 2024-09-12T00:36:20.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.399+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~KEJNPTYMDQ65.0 size=355383 2024-09-12T00:36:20.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.399+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=KEJNPTYMDQ65 tag=AAATO621U141 type=write size=1403959 2024-09-12T00:36:20.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.401+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~34I5X7UIXEO3.0 size=1048576 2024-09-12T00:36:20.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.401+0000 7f030cb87780 1 < canceled part key=_multipart_CUDFTXFBC862.2~34I5X7UIXEO3.1 size=1048576 2024-09-12T00:36:20.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.402+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~34I5X7UIXEO3.2 size=114828 2024-09-12T00:36:20.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.405+0000 7f030cb87780 1 < canceled multipart upload key=CUDFTXFBC862 upload=34I5X7UIXEO3 tag=93PFQAUCFEOD type=write size=3260556 2024-09-12T00:36:20.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.407+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~JXRDUQ7WV2SG.0 size=1048576 2024-09-12T00:36:20.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.408+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~JXRDUQ7WV2SG.1 size=1048576 2024-09-12T00:36:20.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.409+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~JXRDUQ7WV2SG.2 size=306660 2024-09-12T00:36:20.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.409+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=JXRDUQ7WV2SG tag=3ABT2LTFLA53 type=write size=3452388 2024-09-12T00:36:20.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.409+0000 7f030cb87780 1 < canceled part key=_multipart_ELX0797T1L4C.2~NC0AJRXC3LVD.0 size=1048576 2024-09-12T00:36:20.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.410+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~NC0AJRXC3LVD.1 size=1048576 2024-09-12T00:36:20.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.411+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~NC0AJRXC3LVD.2 size=762922 2024-09-12T00:36:20.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.414+0000 7f030cb87780 1 < canceled multipart upload key=ELX0797T1L4C upload=NC0AJRXC3LVD tag=ZDRNCH34HQDG type=write size=3908650 2024-09-12T00:36:20.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.415+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=8OVXNBSVB0HK type=write size=103855 2024-09-12T00:36:20.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.417+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=FACCZPZL6NKR type=del 2024-09-12T00:36:20.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.418+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=XOVLX3RWQDZU type=del size=1215467 2024-09-12T00:36:20.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.420+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~7RFCTUMLZWP6.0 size=775862 2024-09-12T00:36:20.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.422+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=7RFCTUMLZWP6 tag=X6UE1II648OI type=write size=1824438 2024-09-12T00:36:20.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.424+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=EP968A2LP1BZ type=del size=3803806 2024-09-12T00:36:20.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.426+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~5Y0N9OUHEMJM.0 size=1048576 2024-09-12T00:36:20.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.427+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~5Y0N9OUHEMJM.1 size=1048576 2024-09-12T00:36:20.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.428+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~5Y0N9OUHEMJM.2 size=50455 2024-09-12T00:36:20.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.430+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=5Y0N9OUHEMJM tag=EEDY8LXVAAX1 type=write size=3196183 2024-09-12T00:36:20.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.432+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=RLAK05XARCOT type=del size=3653730 2024-09-12T00:36:20.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.433+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~5G3BXDC2BZ73.0 size=1048576 2024-09-12T00:36:20.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.434+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~5G3BXDC2BZ73.1 size=1048576 2024-09-12T00:36:20.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.435+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~5G3BXDC2BZ73.2 size=14873 2024-09-12T00:36:20.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.437+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=5G3BXDC2BZ73 tag=X4NAEA2CGG56 type=write size=3160601 2024-09-12T00:36:20.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.439+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=E2PFYVMV51WP type=del size=1711102 2024-09-12T00:36:20.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.442+0000 7f030cb87780 1 < suggested update operation key=JRPD5AAK84ZD tag=FNJI0E4XPSDP type=del size=1952272 2024-09-12T00:36:20.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.443+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=SSX1EHNSUF5S type=write size=75598 2024-09-12T00:36:20.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.445+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~PEXXQR02ELT0.0 size=1048576 2024-09-12T00:36:20.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.446+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~PEXXQR02ELT0.1 size=669531 2024-09-12T00:36:20.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.448+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=PEXXQR02ELT0 tag=HQU0JPIZ5SBI type=write size=2766683 2024-09-12T00:36:20.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.450+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=3942ZIHFFE1L type=del size=4086282 2024-09-12T00:36:20.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.453+0000 7f030cb87780 1 < suggested update operation key=ZQD0491BHJPM tag=THVRSPHV1BKF type=write size=138325 2024-09-12T00:36:20.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.455+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=2NPJ3G0ANOVJ type=del size=3436992 2024-09-12T00:36:20.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.456+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=WCH2I2DYV5QC type=del 2024-09-12T00:36:20.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.459+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~GE505AAOATTM.0 size=1048576 2024-09-12T00:36:20.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.460+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~GE505AAOATTM.1 size=1048576 2024-09-12T00:36:20.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.461+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~GE505AAOATTM.2 size=832090 2024-09-12T00:36:20.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.461+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=GE505AAOATTM tag=BBSTFBTH3TYT type=write size=3977818 2024-09-12T00:36:20.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.462+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=PHKZDKBBOGW6 type=del 2024-09-12T00:36:20.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.464+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=6SA721HNT3XK type=del size=1517219 2024-09-12T00:36:20.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.465+0000 7f030cb87780 1 < completed write operation key=39WSAOA6P09M tag=B8SN7QAFAFLM type=write size=1907 2024-09-12T00:36:20.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.467+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=YRG24DXYNIJJ type=write size=1032262 2024-09-12T00:36:20.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.468+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~4LMW313OZPR9.0 size=1048576 2024-09-12T00:36:20.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.468+0000 7f030cb87780 1 < canceled part key=_multipart_6WHZRKLM3OLP.2~4LMW313OZPR9.1 size=755127 2024-09-12T00:36:20.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.471+0000 7f030cb87780 1 < canceled multipart upload key=6WHZRKLM3OLP upload=4LMW313OZPR9 tag=D82P7NKNC0JI type=write size=2852279 2024-09-12T00:36:20.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.472+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=FGRWT925YJ9E type=write size=482754 2024-09-12T00:36:20.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.474+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=N07AEDUMX4JZ type=del 2024-09-12T00:36:20.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.475+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=RQ3WPA01HCHC type=del size=1692455 2024-09-12T00:36:20.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.476+0000 7f030cb87780 1 < completed write operation key=86TWUAZAHI4I tag=4HT3W87EC2JQ type=write size=408916 2024-09-12T00:36:20.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.478+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=SQ2NICFC223K type=del size=2853222 2024-09-12T00:36:20.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.479+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~KEJNPTYMDQ65.0 size=355383 2024-09-12T00:36:20.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.482+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=KEJNPTYMDQ65 tag=AAATO621U141 type=write size=1403959 2024-09-12T00:36:20.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.484+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=DH6U7ONO5CGD type=write size=789118 2024-09-12T00:36:20.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.485+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~JXRDUQ7WV2SG.0 size=1048576 2024-09-12T00:36:20.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.486+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~JXRDUQ7WV2SG.1 size=1048576 2024-09-12T00:36:20.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.487+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~JXRDUQ7WV2SG.2 size=306660 2024-09-12T00:36:20.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.489+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=JXRDUQ7WV2SG tag=3ABT2LTFLA53 type=write size=3452388 2024-09-12T00:36:20.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.490+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=H0RLN8EIY7TL type=del size=3755920 2024-09-12T00:36:20.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.492+0000 7f030cb87780 1 < completed write operation key=1PLGUJCB6J0V tag=8OVXNBSVB0HK type=write size=103855 2024-09-12T00:36:20.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.494+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~HJXDM9IJLTZW.0 size=1048576 2024-09-12T00:36:20.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.495+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~HJXDM9IJLTZW.1 size=1048576 2024-09-12T00:36:20.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.497+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~HJXDM9IJLTZW.2 size=358319 2024-09-12T00:36:20.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.497+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=HJXDM9IJLTZW tag=7L94CEARV97R type=write size=3504047 2024-09-12T00:36:20.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.499+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=XOVLX3RWQDZU type=del 2024-09-12T00:36:20.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.502+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~NM66J3K3CMI6.0 size=485981 2024-09-12T00:36:20.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.502+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=NM66J3K3CMI6 tag=13G8UYHFQJ0Z type=write size=1534557 2024-09-12T00:36:20.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.505+0000 7f030cb87780 1 < suggested update operation key=OR439FK5L43V tag=EP968A2LP1BZ type=del size=3803806 2024-09-12T00:36:20.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.506+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=BCPS3NKVH1HR type=del size=2492960 2024-09-12T00:36:20.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.508+0000 7f030cb87780 1 < canceled operation key=INFFH9R3EFRY tag=RLAK05XARCOT type=del size=3653730 2024-09-12T00:36:20.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.510+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~HRF2U1S6ACMJ.0 size=302113 2024-09-12T00:36:20.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.510+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=HRF2U1S6ACMJ tag=10L91CLZ16CF type=write size=1350689 2024-09-12T00:36:20.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.512+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=E2PFYVMV51WP type=del 2024-09-12T00:36:20.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.513+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=MDU0VBYOLYOL type=write size=1009648 2024-09-12T00:36:20.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.514+0000 7f030cb87780 1 < completed write operation key=3W7ANGL92ZF0 tag=SSX1EHNSUF5S type=write size=75598 2024-09-12T00:36:20.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.516+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=TWJL4W2I193I type=del size=881086 2024-09-12T00:36:20.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.517+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=3942ZIHFFE1L type=del 2024-09-12T00:36:20.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.519+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=0HMDUYJU297E type=del size=3893754 2024-09-12T00:36:20.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.522+0000 7f030cb87780 1 < suggested update operation key=DLR6A7XOERHW tag=2NPJ3G0ANOVJ type=del size=3436992 2024-09-12T00:36:20.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.524+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~420VSUIU2CZ0.0 size=1048576 2024-09-12T00:36:20.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.525+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~420VSUIU2CZ0.1 size=417514 2024-09-12T00:36:20.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.525+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=420VSUIU2CZ0 tag=H8GUD1HQVJ67 type=write size=2514666 2024-09-12T00:36:20.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.528+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~GE505AAOATTM.0 size=1048576 2024-09-12T00:36:20.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.529+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~GE505AAOATTM.1 size=1048576 2024-09-12T00:36:20.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.529+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~GE505AAOATTM.2 size=832090 2024-09-12T00:36:20.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.532+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=GE505AAOATTM tag=BBSTFBTH3TYT type=write size=3977818 2024-09-12T00:36:20.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.534+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=QTR0DLL2JLE8 type=del size=3022587 2024-09-12T00:36:20.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.537+0000 7f030cb87780 1 < suggested update operation key=ZQD0491BHJPM tag=6SA721HNT3XK type=del size=1517219 2024-09-12T00:36:20.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.539+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~JG6NQ3GAI1O0.0 size=1048576 2024-09-12T00:36:20.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.540+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~JG6NQ3GAI1O0.1 size=149920 2024-09-12T00:36:20.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.540+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=JG6NQ3GAI1O0 tag=Z8H4TD48OI63 type=write size=2247072 2024-09-12T00:36:20.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.541+0000 7f030cb87780 1 < completed write operation key=1VOJGMWNKS0A tag=YRG24DXYNIJJ type=write size=1032262 2024-09-12T00:36:20.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.543+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=V7K0KPOW4I78 type=del size=2086930 2024-09-12T00:36:20.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.546+0000 7f030cb87780 1 < suggested remove operation key=OR439FK5L43V tag=FGRWT925YJ9E type=write 2024-09-12T00:36:20.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.547+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=SKHB0XZIMDJ6 type=del size=2166847 2024-09-12T00:36:20.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.549+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=RQ3WPA01HCHC type=del 2024-09-12T00:36:20.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.551+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~4P3IQ571GZIF.0 size=1048576 2024-09-12T00:36:20.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.552+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~4P3IQ571GZIF.1 size=85896 2024-09-12T00:36:20.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.552+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=4P3IQ571GZIF tag=Q2WYJE72AF1K type=write size=2183048 2024-09-12T00:36:20.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.554+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=SQ2NICFC223K type=del 2024-09-12T00:36:20.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.555+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=KHGX95RF61FJ type=del size=2549436 2024-09-12T00:36:20.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.557+0000 7f030cb87780 1 < completed write operation key=IHTFI7W4A6JT tag=DH6U7ONO5CGD type=write size=789118 2024-09-12T00:36:20.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.559+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~95BLRBP68KO2.0 size=141721 2024-09-12T00:36:20.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.559+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=95BLRBP68KO2 tag=XPRQBK0ZA3SY type=write size=1190297 2024-09-12T00:36:20.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.564+0000 7f030cb87780 -1 < failed to complete operation key=OR439FK5L43V tag=H0RLN8EIY7TL type=del size=3755920: (22) Invalid argument 2024-09-12T00:36:20.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.565+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=9R7LCPJ48PHM type=del size=3941136 2024-09-12T00:36:20.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.567+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~HJXDM9IJLTZW.0 size=1048576 2024-09-12T00:36:20.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.568+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~HJXDM9IJLTZW.1 size=1048576 2024-09-12T00:36:20.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.570+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~HJXDM9IJLTZW.2 size=358319 2024-09-12T00:36:20.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.572+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=HJXDM9IJLTZW tag=7L94CEARV97R type=write size=3504047 2024-09-12T00:36:20.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.573+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=3D3RSR6A9FVM type=del size=3967307 2024-09-12T00:36:20.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.575+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~NM66J3K3CMI6.0 size=485981 2024-09-12T00:36:20.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.577+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=NM66J3K3CMI6 tag=13G8UYHFQJ0Z type=write size=1534557 2024-09-12T00:36:20.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.578+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=DIHYGJRCIT4J type=del size=1067014 2024-09-12T00:36:20.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.582+0000 7f030cb87780 1 < suggested remove operation key=QGSJ51GMQXVK tag=BCPS3NKVH1HR type=del 2024-09-12T00:36:20.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.582+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=EOCMQGF76P22 type=del size=2670743 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.583+0000 7f030cb87780 1 < canceled part key=_multipart_39WSAOA6P09M.2~HRF2U1S6ACMJ.0 size=302113 2024-09-12T00:36:20.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.585+0000 7f030cb87780 1 < canceled multipart upload key=39WSAOA6P09M upload=HRF2U1S6ACMJ tag=10L91CLZ16CF type=write size=1350689 2024-09-12T00:36:20.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.586+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=IAJIBKSBVOP9 type=del size=3848125 2024-09-12T00:36:20.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.589+0000 7f030cb87780 1 < completed write operation key=39WSAOA6P09M tag=MDU0VBYOLYOL type=write size=1009648 2024-09-12T00:36:20.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.589+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=5OVV1IHUX8LP type=del size=2725701 2024-09-12T00:36:20.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.591+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=TWJL4W2I193I type=del 2024-09-12T00:36:20.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.594+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~WBU3EK97SIKH.0 size=1048576 2024-09-12T00:36:20.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.594+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~WBU3EK97SIKH.1 size=1048576 2024-09-12T00:36:20.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.595+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~WBU3EK97SIKH.2 size=400038 2024-09-12T00:36:20.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.595+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=WBU3EK97SIKH tag=OSBAVPBDCCWU type=write size=3545766 2024-09-12T00:36:20.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.597+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=0HMDUYJU297E type=del 2024-09-12T00:36:20.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.598+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=MAXNBWWJAWQJ type=del size=3120405 2024-09-12T00:36:20.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.600+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~420VSUIU2CZ0.0 size=1048576 2024-09-12T00:36:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.601+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~420VSUIU2CZ0.1 size=417514 2024-09-12T00:36:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.603+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=420VSUIU2CZ0 tag=H8GUD1HQVJ67 type=write size=2514666 2024-09-12T00:36:20.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.604+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=LZNKU3ANOUN2 type=del size=3109617 2024-09-12T00:36:20.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.607+0000 7f030cb87780 1 < suggested remove operation key=U5CWO1EN8BFI tag=QTR0DLL2JLE8 type=del 2024-09-12T00:36:20.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.608+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=QE4R0MPCYSL6 type=write size=499667 2024-09-12T00:36:20.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.610+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~JG6NQ3GAI1O0.0 size=1048576 2024-09-12T00:36:20.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.611+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~JG6NQ3GAI1O0.1 size=149920 2024-09-12T00:36:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.613+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=JG6NQ3GAI1O0 tag=Z8H4TD48OI63 type=write size=2247072 2024-09-12T00:36:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.615+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=0I0ZDTFLWGQP type=del size=1352172 2024-09-12T00:36:20.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.616+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=V7K0KPOW4I78 type=del 2024-09-12T00:36:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.619+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~F9XP3J3179GR.0 size=414891 2024-09-12T00:36:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.619+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=F9XP3J3179GR tag=H6WIK5V97A38 type=write size=1463467 2024-09-12T00:36:20.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.620+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=SKHB0XZIMDJ6 type=del 2024-09-12T00:36:20.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.622+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=QUFVH4VSS6KT type=del size=1495530 2024-09-12T00:36:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.622+0000 7f030cb87780 1 < canceled part key=_multipart_V0OLIRP3KH40.2~4P3IQ571GZIF.0 size=1048576 2024-09-12T00:36:20.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.623+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~4P3IQ571GZIF.1 size=85896 2024-09-12T00:36:20.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.625+0000 7f030cb87780 1 < canceled multipart upload key=V0OLIRP3KH40 upload=4P3IQ571GZIF tag=Q2WYJE72AF1K type=write size=2183048 2024-09-12T00:36:20.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.627+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=MPZCBVQOLE7J type=del size=1863558 2024-09-12T00:36:20.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.628+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=KHGX95RF61FJ type=del 2024-09-12T00:36:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.630+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=G7652KFQDZJ2 type=del size=1593385 2024-09-12T00:36:20.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.632+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~95BLRBP68KO2.0 size=141721 2024-09-12T00:36:20.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.633+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=95BLRBP68KO2 tag=XPRQBK0ZA3SY type=write size=1190297 2024-09-12T00:36:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.635+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=8APNXL50IWID type=del size=3123190 2024-09-12T00:36:20.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.636+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=9R7LCPJ48PHM type=del 2024-09-12T00:36:20.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.638+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=TPT0I2NHWSHJ type=del size=3751029 2024-09-12T00:36:20.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.639+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=3D3RSR6A9FVM type=del 2024-09-12T00:36:20.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.641+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~ETGH1I9CE15Q.0 size=1048576 2024-09-12T00:36:20.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.642+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~ETGH1I9CE15Q.1 size=1048576 2024-09-12T00:36:20.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.644+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~ETGH1I9CE15Q.2 size=627925 2024-09-12T00:36:20.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.644+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=ETGH1I9CE15Q tag=3OL4PKRP2A6G type=write size=3773653 2024-09-12T00:36:20.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.645+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=DIHYGJRCIT4J type=del 2024-09-12T00:36:20.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.647+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=M8QI3XE2G4KU type=del size=3904663 2024-09-12T00:36:20.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.648+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=EOCMQGF76P22 type=del 2024-09-12T00:36:20.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.650+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~P10X67UIW8XO.0 size=1048576 2024-09-12T00:36:20.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.651+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~P10X67UIW8XO.1 size=624131 2024-09-12T00:36:20.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.651+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=P10X67UIW8XO tag=Q5EAUEPDOYRI type=write size=2721283 2024-09-12T00:36:20.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.654+0000 7f030cb87780 1 < suggested update operation key=CY2NS03IIUJJ tag=IAJIBKSBVOP9 type=del size=3848125 2024-09-12T00:36:20.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.657+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=YMQWTQB9LYIS type=del size=2326202 2024-09-12T00:36:20.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.659+0000 7f030cb87780 1 < suggested update operation key=UFYMVGL264T8 tag=5OVV1IHUX8LP type=del size=2725701 2024-09-12T00:36:20.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.662+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~8190DCVZ5ZAF.0 size=613568 2024-09-12T00:36:20.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.662+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=8190DCVZ5ZAF tag=SGPBSP21SHSR type=write size=1662144 2024-09-12T00:36:20.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.663+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~WBU3EK97SIKH.0 size=1048576 2024-09-12T00:36:20.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.664+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~WBU3EK97SIKH.1 size=1048576 2024-09-12T00:36:20.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.666+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~WBU3EK97SIKH.2 size=400038 2024-09-12T00:36:20.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.667+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=WBU3EK97SIKH tag=OSBAVPBDCCWU type=write size=3545766 2024-09-12T00:36:20.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.669+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=LEV8ELT012NH type=del size=1712232 2024-09-12T00:36:20.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.670+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=MAXNBWWJAWQJ type=del 2024-09-12T00:36:20.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.672+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=GGHW4KR489DX type=del size=3391886 2024-09-12T00:36:20.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.673+0000 7f030cb87780 1 < canceled operation key=ELX0797T1L4C tag=LZNKU3ANOUN2 type=del size=3109617 2024-09-12T00:36:20.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.676+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~8MYKRSXOHBF1.0 size=1048576 2024-09-12T00:36:20.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.677+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~8MYKRSXOHBF1.1 size=1048576 2024-09-12T00:36:20.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.678+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~8MYKRSXOHBF1.2 size=152913 2024-09-12T00:36:20.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.678+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=8MYKRSXOHBF1 tag=5TIH8RXN7EI2 type=write size=3298641 2024-09-12T00:36:20.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.681+0000 7f030cb87780 1 < suggested update operation key=OR439FK5L43V tag=QE4R0MPCYSL6 type=write size=499667 2024-09-12T00:36:20.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.684+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~8KR85SL1XKYN.0 size=1048576 2024-09-12T00:36:20.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.684+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~8KR85SL1XKYN.1 size=831400 2024-09-12T00:36:20.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.685+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=8KR85SL1XKYN tag=9M6TALB0Z0T0 type=write size=2928552 2024-09-12T00:36:20.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.686+0000 7f030cb87780 1 < canceled operation key=327RDLIWLVRO tag=0I0ZDTFLWGQP type=del size=1352172 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.687+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=DODTO1ART2T6 type=del size=18302 2024-09-12T00:36:20.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.689+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~F9XP3J3179GR.0 size=414891 2024-09-12T00:36:20.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.692+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=F9XP3J3179GR tag=H6WIK5V97A38 type=write size=1463467 2024-09-12T00:36:20.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.694+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~XJLNOXBSYNEX.0 size=1048576 2024-09-12T00:36:20.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.696+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~XJLNOXBSYNEX.1 size=2146 2024-09-12T00:36:20.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.696+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=XJLNOXBSYNEX tag=6F7TR9L617HW type=write size=2099298 2024-09-12T00:36:20.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.697+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=QUFVH4VSS6KT type=del 2024-09-12T00:36:20.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.700+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~QW8D40PMRNHP.0 size=1048576 2024-09-12T00:36:20.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.701+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~QW8D40PMRNHP.1 size=66147 2024-09-12T00:36:20.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.701+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=QW8D40PMRNHP tag=I040NPM7MU95 type=write size=2163299 2024-09-12T00:36:20.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.702+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=MPZCBVQOLE7J type=del 2024-09-12T00:36:20.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.705+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~NBGQS09F5639.0 size=1048576 2024-09-12T00:36:20.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.706+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~NBGQS09F5639.1 size=1048576 2024-09-12T00:36:20.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.707+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~NBGQS09F5639.2 size=277686 2024-09-12T00:36:20.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.707+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=NBGQS09F5639 tag=KMP1E05AIVUN type=write size=3423414 2024-09-12T00:36:20.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.710+0000 7f030cb87780 1 < suggested update operation key=JPEIGLC162K3 tag=G7652KFQDZJ2 type=del size=1593385 2024-09-12T00:36:20.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.712+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=EA66NEVN22AG type=write size=1890 2024-09-12T00:36:20.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.712+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=8APNXL50IWID type=del 2024-09-12T00:36:20.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.714+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=FEFMOGJEH2JC type=del size=1623481 2024-09-12T00:36:20.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.715+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=TPT0I2NHWSHJ type=del 2024-09-12T00:36:20.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.716+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=9W0PIUZKTROO type=del size=2570060 2024-09-12T00:36:20.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.718+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~ETGH1I9CE15Q.0 size=1048576 2024-09-12T00:36:20.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.718+0000 7f030cb87780 1 < canceled part key=_multipart_QGSJ51GMQXVK.2~ETGH1I9CE15Q.1 size=1048576 2024-09-12T00:36:20.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.719+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~ETGH1I9CE15Q.2 size=627925 2024-09-12T00:36:20.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.721+0000 7f030cb87780 1 < canceled multipart upload key=QGSJ51GMQXVK upload=ETGH1I9CE15Q tag=3OL4PKRP2A6G type=write size=3773653 2024-09-12T00:36:20.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.723+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~LE9EBF6U2MUG.0 size=1048576 2024-09-12T00:36:20.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.724+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~LE9EBF6U2MUG.1 size=889413 2024-09-12T00:36:20.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.724+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=LE9EBF6U2MUG tag=PRZDYY52Q8KV type=write size=2986565 2024-09-12T00:36:20.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.726+0000 7f030cb87780 1 < canceled operation key=39WSAOA6P09M tag=M8QI3XE2G4KU type=del size=3904663 2024-09-12T00:36:20.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.728+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=5VO8DGCYW4H3 type=write size=25327 2024-09-12T00:36:20.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.729+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~P10X67UIW8XO.0 size=1048576 2024-09-12T00:36:20.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.729+0000 7f030cb87780 1 < canceled part key=_multipart_INFFH9R3EFRY.2~P10X67UIW8XO.1 size=624131 2024-09-12T00:36:20.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.731+0000 7f030cb87780 1 < canceled multipart upload key=INFFH9R3EFRY upload=P10X67UIW8XO tag=Q5EAUEPDOYRI type=write size=2721283 2024-09-12T00:36:20.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.734+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~48UDZOS7MIN3.0 size=1048576 2024-09-12T00:36:20.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.734+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~48UDZOS7MIN3.1 size=413752 2024-09-12T00:36:20.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.734+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=48UDZOS7MIN3 tag=JJVE1PA7B447 type=write size=2510904 2024-09-12T00:36:20.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.736+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=YMQWTQB9LYIS type=del 2024-09-12T00:36:20.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.737+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=0QRK7IDQ02E3 type=write size=87118 2024-09-12T00:36:20.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.739+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~8190DCVZ5ZAF.0 size=613568 2024-09-12T00:36:20.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.741+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=8190DCVZ5ZAF tag=SGPBSP21SHSR type=write size=1662144 2024-09-12T00:36:20.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.743+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=ZNESUZCKLJOJ type=del size=2803638 2024-09-12T00:36:20.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.744+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=LEV8ELT012NH type=del 2024-09-12T00:36:20.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.748+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~PYGI1TAYE8NI.0 size=553683 2024-09-12T00:36:20.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.748+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=PYGI1TAYE8NI tag=O7V44TY7PIXI type=write size=1602259 2024-09-12T00:36:20.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.748+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=GGHW4KR489DX type=del 2024-09-12T00:36:20.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.751+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~2EA1WHEAVAGT.0 size=152731 2024-09-12T00:36:20.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.751+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=2EA1WHEAVAGT tag=SIPOTV9DNPBI type=write size=1201307 2024-09-12T00:36:20.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.752+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~8MYKRSXOHBF1.0 size=1048576 2024-09-12T00:36:20.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.752+0000 7f030cb87780 1 < canceled part key=_multipart_1PLGUJCB6J0V.2~8MYKRSXOHBF1.1 size=1048576 2024-09-12T00:36:20.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.753+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~8MYKRSXOHBF1.2 size=152913 2024-09-12T00:36:20.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.756+0000 7f030cb87780 1 < canceled multipart upload key=1PLGUJCB6J0V upload=8MYKRSXOHBF1 tag=5TIH8RXN7EI2 type=write size=3298641 2024-09-12T00:36:20.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.757+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=ODEEXAK0E7G1 type=write size=71419 2024-09-12T00:36:20.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.758+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~8KR85SL1XKYN.0 size=1048576 2024-09-12T00:36:20.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.760+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~8KR85SL1XKYN.1 size=831400 2024-09-12T00:36:20.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.762+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=8KR85SL1XKYN tag=9M6TALB0Z0T0 type=write size=2928552 2024-09-12T00:36:20.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.764+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~7LDNNNW14J3G.0 size=1048576 2024-09-12T00:36:20.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.765+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~7LDNNNW14J3G.1 size=459984 2024-09-12T00:36:20.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.765+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=7LDNNNW14J3G tag=MIGZGOV86C3S type=write size=2557136 2024-09-12T00:36:20.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.767+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=DODTO1ART2T6 type=del 2024-09-12T00:36:20.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.768+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=IHWBG9M4VVUB type=del size=1624214 2024-09-12T00:36:20.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.770+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~XJLNOXBSYNEX.0 size=1048576 2024-09-12T00:36:20.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.771+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~XJLNOXBSYNEX.1 size=2146 2024-09-12T00:36:20.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.773+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=XJLNOXBSYNEX tag=6F7TR9L617HW type=write size=2099298 2024-09-12T00:36:20.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.776+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~QDI2AXQU19CL.0 size=687538 2024-09-12T00:36:20.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.776+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=QDI2AXQU19CL tag=KLJ304U5I23U type=write size=1736114 2024-09-12T00:36:20.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.778+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~QW8D40PMRNHP.0 size=1048576 2024-09-12T00:36:20.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.779+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~QW8D40PMRNHP.1 size=66147 2024-09-12T00:36:20.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.780+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=QW8D40PMRNHP tag=I040NPM7MU95 type=write size=2163299 2024-09-12T00:36:20.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.783+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~Q4BJH5V6U9Q3.0 size=1048576 2024-09-12T00:36:20.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.784+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~Q4BJH5V6U9Q3.1 size=1009159 2024-09-12T00:36:20.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.784+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=Q4BJH5V6U9Q3 tag=R67O6GHRDLS6 type=write size=3106311 2024-09-12T00:36:20.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.786+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~NBGQS09F5639.0 size=1048576 2024-09-12T00:36:20.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.787+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~NBGQS09F5639.1 size=1048576 2024-09-12T00:36:20.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.787+0000 7f030cb87780 1 < canceled part key=_multipart_3W7ANGL92ZF0.2~NBGQS09F5639.2 size=277686 2024-09-12T00:36:20.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.790+0000 7f030cb87780 1 < canceled multipart upload key=3W7ANGL92ZF0 upload=NBGQS09F5639 tag=KMP1E05AIVUN type=write size=3423414 2024-09-12T00:36:20.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.790+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=012XG6Z003VD type=write size=224578 2024-09-12T00:36:20.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.793+0000 7f030cb87780 1 < suggested update operation key=V87B6SDB1HFZ tag=EA66NEVN22AG type=write size=1890 2024-09-12T00:36:20.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.796+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~IEBM9Z6IPLDO.0 size=532791 2024-09-12T00:36:20.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.796+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=IEBM9Z6IPLDO tag=RHKGAH8E7S5Y type=write size=1581367 2024-09-12T00:36:20.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.797+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=FEFMOGJEH2JC type=del 2024-09-12T00:36:20.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.798+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=LTISHSUFGEVT type=del size=965772 2024-09-12T00:36:20.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.800+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=9W0PIUZKTROO type=del 2024-09-12T00:36:20.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.801+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=KER3CRS43JRX type=del size=2592982 2024-09-12T00:36:20.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.801+0000 7f030cb87780 1 < canceled part key=_multipart_N3KD1UVUVM95.2~LE9EBF6U2MUG.0 size=1048576 2024-09-12T00:36:20.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.803+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~LE9EBF6U2MUG.1 size=889413 2024-09-12T00:36:20.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.804+0000 7f030cb87780 1 < canceled multipart upload key=N3KD1UVUVM95 upload=LE9EBF6U2MUG tag=PRZDYY52Q8KV type=write size=2986565 2024-09-12T00:36:20.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.806+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=RXLYXTJGGOIC type=del size=333168 2024-09-12T00:36:20.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.807+0000 7f030cb87780 1 < completed write operation key=IY156CJWG2TB tag=5VO8DGCYW4H3 type=write size=25327 2024-09-12T00:36:20.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.810+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~94AQEARKW1OE.0 size=1048576 2024-09-12T00:36:20.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.811+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~94AQEARKW1OE.1 size=840917 2024-09-12T00:36:20.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.811+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=94AQEARKW1OE tag=0STXSEJ0N5TB type=write size=2938069 2024-09-12T00:36:20.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.812+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~48UDZOS7MIN3.0 size=1048576 2024-09-12T00:36:20.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.813+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~48UDZOS7MIN3.1 size=413752 2024-09-12T00:36:20.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.816+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=48UDZOS7MIN3 tag=JJVE1PA7B447 type=write size=2510904 2024-09-12T00:36:20.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.817+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=UTHJX1NBZP21 type=del size=234106 2024-09-12T00:36:20.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.820+0000 7f030cb87780 1 < suggested remove operation key=INFFH9R3EFRY tag=0QRK7IDQ02E3 type=write 2024-09-12T00:36:20.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.823+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~LADQXCNRH8SI.0 size=1048576 2024-09-12T00:36:20.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.825+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~LADQXCNRH8SI.1 size=71146 2024-09-12T00:36:20.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.825+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=LADQXCNRH8SI tag=PQ9JW6EKGTCQ type=write size=2168298 2024-09-12T00:36:20.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.826+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=ZNESUZCKLJOJ type=del 2024-09-12T00:36:20.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.828+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~DFQKJBN18B0A.0 size=1048576 2024-09-12T00:36:20.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.829+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~DFQKJBN18B0A.1 size=705557 2024-09-12T00:36:20.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.829+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=DFQKJBN18B0A tag=VQQBWGE3HPPH type=write size=2802709 2024-09-12T00:36:20.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.832+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~PYGI1TAYE8NI.0 size=553683 2024-09-12T00:36:20.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.834+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=PYGI1TAYE8NI tag=O7V44TY7PIXI type=write size=1602259 2024-09-12T00:36:20.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.835+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=B70JME51JAQ0 type=del size=3591944 2024-09-12T00:36:20.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.836+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~2EA1WHEAVAGT.0 size=152731 2024-09-12T00:36:20.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.839+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=2EA1WHEAVAGT tag=SIPOTV9DNPBI type=write size=1201307 2024-09-12T00:36:20.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.842+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~9S3ADP7YI2Y4.0 size=1048576 2024-09-12T00:36:20.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.843+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~9S3ADP7YI2Y4.1 size=1048576 2024-09-12T00:36:20.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.843+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~9S3ADP7YI2Y4.2 size=787486 2024-09-12T00:36:20.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.843+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=9S3ADP7YI2Y4 tag=YAAWOVARO2HP type=write size=3933214 2024-09-12T00:36:20.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.845+0000 7f030cb87780 -1 < failed to complete operation key=INFFH9R3EFRY tag=ODEEXAK0E7G1 type=write size=71419: (22) Invalid argument 2024-09-12T00:36:20.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.847+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=KZYY3VYS2HJI type=del size=1718122 2024-09-12T00:36:20.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.848+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~7LDNNNW14J3G.0 size=1048576 2024-09-12T00:36:20.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.849+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~7LDNNNW14J3G.1 size=459984 2024-09-12T00:36:20.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.852+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=7LDNNNW14J3G tag=MIGZGOV86C3S type=write size=2557136 2024-09-12T00:36:20.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.853+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=YI3XXV43E7FM type=write size=688304 2024-09-12T00:36:20.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.855+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=IHWBG9M4VVUB type=del 2024-09-12T00:36:20.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.858+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~BICO1AL6NW4L.0 size=1048576 2024-09-12T00:36:20.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.859+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~BICO1AL6NW4L.1 size=1048576 2024-09-12T00:36:20.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.860+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~BICO1AL6NW4L.2 size=1011817 2024-09-12T00:36:20.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.860+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=BICO1AL6NW4L tag=JDQUPKS7A5HC type=write size=4157545 2024-09-12T00:36:20.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.862+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~QDI2AXQU19CL.0 size=687538 2024-09-12T00:36:20.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.865+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=QDI2AXQU19CL tag=KLJ304U5I23U type=write size=1736114 2024-09-12T00:36:20.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.866+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=WUZAUFFRJQ4B type=write size=298298 2024-09-12T00:36:20.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.868+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~Q4BJH5V6U9Q3.0 size=1048576 2024-09-12T00:36:20.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.869+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~Q4BJH5V6U9Q3.1 size=1009159 2024-09-12T00:36:20.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.872+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=Q4BJH5V6U9Q3 tag=R67O6GHRDLS6 type=write size=3106311 2024-09-12T00:36:20.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.873+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=ZH3X4NCVYFB0 type=del size=1284831 2024-09-12T00:36:20.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.875+0000 7f030cb87780 1 < completed write operation key=1PLGUJCB6J0V tag=012XG6Z003VD type=write size=224578 2024-09-12T00:36:20.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.878+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~RA9P4ABAP5KK.0 size=1048576 2024-09-12T00:36:20.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.879+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~RA9P4ABAP5KK.1 size=1048576 2024-09-12T00:36:20.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.881+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~RA9P4ABAP5KK.2 size=25715 2024-09-12T00:36:20.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.881+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=RA9P4ABAP5KK tag=F2MDDE7WKDCQ type=write size=3171443 2024-09-12T00:36:20.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.882+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~IEBM9Z6IPLDO.0 size=532791 2024-09-12T00:36:20.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.885+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=IEBM9Z6IPLDO tag=RHKGAH8E7S5Y type=write size=1581367 2024-09-12T00:36:20.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.887+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~Z9MDZEFGPP5L.0 size=1048576 2024-09-12T00:36:20.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.889+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~Z9MDZEFGPP5L.1 size=657416 2024-09-12T00:36:20.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.889+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=Z9MDZEFGPP5L tag=D4W8JATRRAZT type=write size=2754568 2024-09-12T00:36:20.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.891+0000 7f030cb87780 1 < suggested remove operation key=QGSJ51GMQXVK tag=LTISHSUFGEVT type=del 2024-09-12T00:36:20.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.894+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~TZUTHR5C362F.0 size=1048576 2024-09-12T00:36:20.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.895+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~TZUTHR5C362F.1 size=1048576 2024-09-12T00:36:20.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.896+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~TZUTHR5C362F.2 size=80375 2024-09-12T00:36:20.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.896+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=TZUTHR5C362F tag=A2RU1JK4XISJ type=write size=3226103 2024-09-12T00:36:20.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.897+0000 7f030cb87780 1 < canceled operation key=CUDFTXFBC862 tag=KER3CRS43JRX type=del size=2592982 2024-09-12T00:36:20.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.899+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=L85NWPQLV3AG type=del size=763825 2024-09-12T00:36:20.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.901+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=RXLYXTJGGOIC type=del 2024-09-12T00:36:20.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.902+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=POSHJ95G6WOJ type=write size=818143 2024-09-12T00:36:20.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.903+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~94AQEARKW1OE.0 size=1048576 2024-09-12T00:36:20.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.905+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~94AQEARKW1OE.1 size=840917 2024-09-12T00:36:20.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.909+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=94AQEARKW1OE tag=0STXSEJ0N5TB type=write size=2938069 2024-09-12T00:36:20.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.911+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~CNCMPGV4OIY4.0 size=1048576 2024-09-12T00:36:20.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.913+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~CNCMPGV4OIY4.1 size=1048576 2024-09-12T00:36:20.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.914+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~CNCMPGV4OIY4.2 size=158157 2024-09-12T00:36:20.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.914+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=CNCMPGV4OIY4 tag=FES1QGJGWZSL type=write size=3303885 2024-09-12T00:36:20.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.918+0000 7f030cb87780 1 < suggested update operation key=JRPD5AAK84ZD tag=UTHJX1NBZP21 type=del size=234106 2024-09-12T00:36:20.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.920+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~9I3YZWW4CE0U.0 size=1048576 2024-09-12T00:36:20.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.921+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~9I3YZWW4CE0U.1 size=1048576 2024-09-12T00:36:20.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.922+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~9I3YZWW4CE0U.2 size=441810 2024-09-12T00:36:20.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.922+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=9I3YZWW4CE0U tag=5FIMR174LLEL type=write size=3587538 2024-09-12T00:36:20.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.923+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~LADQXCNRH8SI.0 size=1048576 2024-09-12T00:36:20.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.923+0000 7f030cb87780 1 < canceled part key=_multipart_IY156CJWG2TB.2~LADQXCNRH8SI.1 size=71146 2024-09-12T00:36:20.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.926+0000 7f030cb87780 1 < canceled multipart upload key=IY156CJWG2TB upload=LADQXCNRH8SI tag=PQ9JW6EKGTCQ type=write size=2168298 2024-09-12T00:36:20.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.929+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~WCZSX94TLBZ0.0 size=510090 2024-09-12T00:36:20.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.929+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=WCZSX94TLBZ0 tag=KA4QC4JOSASL type=write size=1558666 2024-09-12T00:36:20.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.930+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~DFQKJBN18B0A.0 size=1048576 2024-09-12T00:36:20.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.931+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~DFQKJBN18B0A.1 size=705557 2024-09-12T00:36:20.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.934+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=DFQKJBN18B0A tag=VQQBWGE3HPPH type=write size=2802709 2024-09-12T00:36:20.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.936+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~073P5HLWX02R.0 size=1048576 2024-09-12T00:36:20.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.938+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~073P5HLWX02R.1 size=182065 2024-09-12T00:36:20.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.938+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=073P5HLWX02R tag=H1RA0RASXGJD type=write size=2279217 2024-09-12T00:36:20.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.940+0000 7f030cb87780 1 < suggested remove operation key=ZQD0491BHJPM tag=B70JME51JAQ0 type=del 2024-09-12T00:36:20.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.942+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=MF357C0V99CN type=del size=1677228 2024-09-12T00:36:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.943+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~9S3ADP7YI2Y4.0 size=1048576 2024-09-12T00:36:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.943+0000 7f030cb87780 1 < canceled part key=_multipart_CUDFTXFBC862.2~9S3ADP7YI2Y4.1 size=1048576 2024-09-12T00:36:20.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.945+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~9S3ADP7YI2Y4.2 size=787486 2024-09-12T00:36:20.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.948+0000 7f030cb87780 1 < canceled multipart upload key=CUDFTXFBC862 upload=9S3ADP7YI2Y4 tag=YAAWOVARO2HP type=write size=3933214 2024-09-12T00:36:20.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.949+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=HGON14ORQPHU type=del size=2984015 2024-09-12T00:36:20.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.950+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=KZYY3VYS2HJI type=del 2024-09-12T00:36:20.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.952+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=0OGK82MVMVPP type=del size=429852 2024-09-12T00:36:20.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.954+0000 7f030cb87780 1 < canceled operation key=UFYMVGL264T8 tag=YI3XXV43E7FM type=write size=688304 2024-09-12T00:36:20.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.955+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=LCOSJ9W21RP7 type=del size=2063484 2024-09-12T00:36:20.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.956+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~BICO1AL6NW4L.0 size=1048576 2024-09-12T00:36:20.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.958+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~BICO1AL6NW4L.1 size=1048576 2024-09-12T00:36:20.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.960+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~BICO1AL6NW4L.2 size=1011817 2024-09-12T00:36:20.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.963+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=BICO1AL6NW4L tag=JDQUPKS7A5HC type=write size=4157545 2024-09-12T00:36:20.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.964+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=KCIZC6W74WM2 type=del size=75888 2024-09-12T00:36:20.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.965+0000 7f030cb87780 1 < completed write operation key=1PLGUJCB6J0V tag=WUZAUFFRJQ4B type=write size=298298 2024-09-12T00:36:20.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.967+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=RU22QJ5OPGA9 type=del size=84378 2024-09-12T00:36:20.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.968+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=ZH3X4NCVYFB0 type=del 2024-09-12T00:36:20.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.971+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~NT5HBH8W6FOM.0 size=283795 2024-09-12T00:36:20.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.971+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=NT5HBH8W6FOM tag=QCQXLFSNE5Z2 type=write size=1332371 2024-09-12T00:36:20.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.972+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~RA9P4ABAP5KK.0 size=1048576 2024-09-12T00:36:20.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.973+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~RA9P4ABAP5KK.1 size=1048576 2024-09-12T00:36:20.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.973+0000 7f030cb87780 1 < canceled part key=_multipart_JPEIGLC162K3.2~RA9P4ABAP5KK.2 size=25715 2024-09-12T00:36:20.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.977+0000 7f030cb87780 1 < canceled multipart upload key=JPEIGLC162K3 upload=RA9P4ABAP5KK tag=F2MDDE7WKDCQ type=write size=3171443 2024-09-12T00:36:20.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.977+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=CPRGLJOI3DFX type=del size=2137315 2024-09-12T00:36:20.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.979+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~Z9MDZEFGPP5L.0 size=1048576 2024-09-12T00:36:20.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.981+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~Z9MDZEFGPP5L.1 size=657416 2024-09-12T00:36:20.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.982+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=Z9MDZEFGPP5L tag=D4W8JATRRAZT type=write size=2754568 2024-09-12T00:36:20.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.986+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~FQ4VMJEGE46N.0 size=1048576 2024-09-12T00:36:20.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.986+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~FQ4VMJEGE46N.1 size=297238 2024-09-12T00:36:20.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.986+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=FQ4VMJEGE46N tag=CI5OI8FPB26B type=write size=2394390 2024-09-12T00:36:20.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.988+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~TZUTHR5C362F.0 size=1048576 2024-09-12T00:36:20.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.989+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~TZUTHR5C362F.1 size=1048576 2024-09-12T00:36:20.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.990+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~TZUTHR5C362F.2 size=80375 2024-09-12T00:36:20.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.993+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=TZUTHR5C362F tag=A2RU1JK4XISJ type=write size=3226103 2024-09-12T00:36:20.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.994+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=NISE0LCJMPCC type=del size=3849054 2024-09-12T00:36:20.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.996+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=L85NWPQLV3AG type=del 2024-09-12T00:36:20.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.999+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~CPGFBTB3VMTJ.0 size=1048576 2024-09-12T00:36:20.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:20.999+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~CPGFBTB3VMTJ.1 size=1048576 2024-09-12T00:36:21.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.000+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~CPGFBTB3VMTJ.2 size=937945 2024-09-12T00:36:21.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.000+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=CPGFBTB3VMTJ tag=4WNFW3STCYJD type=write size=4083673 2024-09-12T00:36:21.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.002+0000 7f030cb87780 1 < completed write operation key=99OWKRGA8ZZN tag=POSHJ95G6WOJ type=write size=818143 2024-09-12T00:36:21.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.003+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=Z0OCS9WAORX4 type=del size=1871601 2024-09-12T00:36:21.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.004+0000 7f030cb87780 1 < canceled part key=_multipart_V0OLIRP3KH40.2~CNCMPGV4OIY4.0 size=1048576 2024-09-12T00:36:21.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.005+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~CNCMPGV4OIY4.1 size=1048576 2024-09-12T00:36:21.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.006+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~CNCMPGV4OIY4.2 size=158157 2024-09-12T00:36:21.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.009+0000 7f030cb87780 1 < canceled multipart upload key=V0OLIRP3KH40 upload=CNCMPGV4OIY4 tag=FES1QGJGWZSL type=write size=3303885 2024-09-12T00:36:21.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.010+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=YHE8OMIIZ3V5 type=del size=1313372 2024-09-12T00:36:21.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.011+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~9I3YZWW4CE0U.0 size=1048576 2024-09-12T00:36:21.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.013+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~9I3YZWW4CE0U.1 size=1048576 2024-09-12T00:36:21.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.014+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~9I3YZWW4CE0U.2 size=441810 2024-09-12T00:36:21.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.016+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=9I3YZWW4CE0U tag=5FIMR174LLEL type=write size=3587538 2024-09-12T00:36:21.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.017+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=Z7MMCVTOS4U2 type=write size=722365 2024-09-12T00:36:21.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.019+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~WCZSX94TLBZ0.0 size=510090 2024-09-12T00:36:21.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.021+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=WCZSX94TLBZ0 tag=KA4QC4JOSASL type=write size=1558666 2024-09-12T00:36:21.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.022+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=D0CALC43VWBP type=del size=1119503 2024-09-12T00:36:21.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.024+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~073P5HLWX02R.0 size=1048576 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.025+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~073P5HLWX02R.1 size=182065 2024-09-12T00:36:21.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.027+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=073P5HLWX02R tag=H1RA0RASXGJD type=write size=2279217 2024-09-12T00:36:21.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.028+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=9SCSHHEXWQB1 type=del size=1965509 2024-09-12T00:36:21.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.029+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=MF357C0V99CN type=del 2024-09-12T00:36:21.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.031+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=73E80D12WSCH type=del size=1616564 2024-09-12T00:36:21.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.032+0000 7f030cb87780 1 < canceled operation key=V87B6SDB1HFZ tag=HGON14ORQPHU type=del size=2984015 2024-09-12T00:36:21.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.035+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~55OZGKU8EIL1.0 size=1048576 2024-09-12T00:36:21.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.036+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~55OZGKU8EIL1.1 size=172758 2024-09-12T00:36:21.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.036+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=55OZGKU8EIL1 tag=OJWEI65067W1 type=write size=2269910 2024-09-12T00:36:21.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.037+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=0OGK82MVMVPP type=del 2024-09-12T00:36:21.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.039+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=JC362N7FJV9R type=del size=2476792 2024-09-12T00:36:21.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.040+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=LCOSJ9W21RP7 type=del 2024-09-12T00:36:21.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.044+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~IEUUSPN1FCM7.0 size=1048576 2024-09-12T00:36:21.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.044+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~IEUUSPN1FCM7.1 size=1048576 2024-09-12T00:36:21.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.045+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~IEUUSPN1FCM7.2 size=261388 2024-09-12T00:36:21.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.045+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=IEUUSPN1FCM7 tag=VDZY25ZIMPCT type=write size=3407116 2024-09-12T00:36:21.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.047+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=KCIZC6W74WM2 type=del 2024-09-12T00:36:21.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.049+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=KEFJ0MDM71KL type=del size=3544592 2024-09-12T00:36:21.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.050+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=RU22QJ5OPGA9 type=del 2024-09-12T00:36:21.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.052+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~8C9NRFA2HHLZ.0 size=1048576 2024-09-12T00:36:21.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.053+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~8C9NRFA2HHLZ.1 size=1048576 2024-09-12T00:36:21.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.054+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~8C9NRFA2HHLZ.2 size=436911 2024-09-12T00:36:21.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.054+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=8C9NRFA2HHLZ tag=M0G0Z2UGSUVY type=write size=3582639 2024-09-12T00:36:21.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.056+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~NT5HBH8W6FOM.0 size=283795 2024-09-12T00:36:21.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.059+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=NT5HBH8W6FOM tag=QCQXLFSNE5Z2 type=write size=1332371 2024-09-12T00:36:21.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.060+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~LKIMZV3PSER6.0 size=735693 2024-09-12T00:36:21.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.060+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=LKIMZV3PSER6 tag=WBBSF4RUL30Y type=write size=1784269 2024-09-12T00:36:21.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.062+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=CPRGLJOI3DFX type=del 2024-09-12T00:36:21.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.063+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=LXNWVEZQZ40X type=del size=607724 2024-09-12T00:36:21.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.065+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~FQ4VMJEGE46N.0 size=1048576 2024-09-12T00:36:21.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.066+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~FQ4VMJEGE46N.1 size=297238 2024-09-12T00:36:21.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.068+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=FQ4VMJEGE46N tag=CI5OI8FPB26B type=write size=2394390 2024-09-12T00:36:21.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.069+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=1QZ8CEHUZSOV type=del size=320804 2024-09-12T00:36:21.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.071+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=NISE0LCJMPCC type=del 2024-09-12T00:36:21.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.072+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=EZHPH0D87VX7 type=del size=1297261 2024-09-12T00:36:21.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.074+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~CPGFBTB3VMTJ.0 size=1048576 2024-09-12T00:36:21.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.075+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~CPGFBTB3VMTJ.1 size=1048576 2024-09-12T00:36:21.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.075+0000 7f030cb87780 1 < canceled part key=_multipart_QGSJ51GMQXVK.2~CPGFBTB3VMTJ.2 size=937945 2024-09-12T00:36:21.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.078+0000 7f030cb87780 1 < canceled multipart upload key=QGSJ51GMQXVK upload=CPGFBTB3VMTJ tag=4WNFW3STCYJD type=write size=4083673 2024-09-12T00:36:21.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.080+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~8I2M8FDJBIDE.0 size=1048576 2024-09-12T00:36:21.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.081+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~8I2M8FDJBIDE.1 size=1048576 2024-09-12T00:36:21.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.082+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~8I2M8FDJBIDE.2 size=278008 2024-09-12T00:36:21.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.082+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=8I2M8FDJBIDE tag=0GTCDW90MYNR type=write size=3423736 2024-09-12T00:36:21.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.084+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=Z0OCS9WAORX4 type=del 2024-09-12T00:36:21.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.086+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=PA03274M13Z4 type=del size=4170163 2024-09-12T00:36:21.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.088+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=YHE8OMIIZ3V5 type=del 2024-09-12T00:36:21.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.090+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=OD3ECM5CDOBF type=write size=419195 2024-09-12T00:36:21.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.091+0000 7f030cb87780 1 < completed write operation key=1VOJGMWNKS0A tag=Z7MMCVTOS4U2 type=write size=722365 2024-09-12T00:36:21.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.095+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~KZV5ODYA4WPT.0 size=289246 2024-09-12T00:36:21.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.095+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=KZV5ODYA4WPT tag=KJAPAPL7EWZO type=write size=1337822 2024-09-12T00:36:21.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.096+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=D0CALC43VWBP type=del 2024-09-12T00:36:21.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.098+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=KSVAPP71CIAV type=del size=86895 2024-09-12T00:36:21.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.100+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=9SCSHHEXWQB1 type=del 2024-09-12T00:36:21.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.100+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=ZB6Q3V54VRVT type=write size=139047 2024-09-12T00:36:21.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.102+0000 7f030cb87780 1 < canceled operation key=V0OLIRP3KH40 tag=73E80D12WSCH type=del size=1616564 2024-09-12T00:36:21.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.104+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=YX9ETN5RWP0A type=write size=301136 2024-09-12T00:36:21.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.105+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~55OZGKU8EIL1.0 size=1048576 2024-09-12T00:36:21.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.107+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~55OZGKU8EIL1.1 size=172758 2024-09-12T00:36:21.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.109+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=55OZGKU8EIL1 tag=OJWEI65067W1 type=write size=2269910 2024-09-12T00:36:21.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.110+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=LNAXX5T6S508 type=del size=1883274 2024-09-12T00:36:21.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.112+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=JC362N7FJV9R type=del 2024-09-12T00:36:21.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.116+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~50DIHJOE0KHZ.0 size=1048576 2024-09-12T00:36:21.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.117+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~50DIHJOE0KHZ.1 size=1048576 2024-09-12T00:36:21.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.118+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~50DIHJOE0KHZ.2 size=12586 2024-09-12T00:36:21.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.118+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=50DIHJOE0KHZ tag=XSBHWFUE5JRA type=write size=3158314 2024-09-12T00:36:21.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.119+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~IEUUSPN1FCM7.0 size=1048576 2024-09-12T00:36:21.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.120+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~IEUUSPN1FCM7.1 size=1048576 2024-09-12T00:36:21.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.121+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~IEUUSPN1FCM7.2 size=261388 2024-09-12T00:36:21.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.123+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=IEUUSPN1FCM7 tag=VDZY25ZIMPCT type=write size=3407116 2024-09-12T00:36:21.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.126+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~XJRQOE8CQC9S.0 size=1048576 2024-09-12T00:36:21.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.127+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~XJRQOE8CQC9S.1 size=1048576 2024-09-12T00:36:21.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.129+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~XJRQOE8CQC9S.2 size=773509 2024-09-12T00:36:21.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.129+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=XJRQOE8CQC9S tag=PG21E0N178I9 type=write size=3919237 2024-09-12T00:36:21.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.132+0000 7f030cb87780 1 < suggested update operation key=JPEIGLC162K3 tag=KEFJ0MDM71KL type=del size=3544592 2024-09-12T00:36:21.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.134+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~XHKF7AD07DHD.0 size=1048576 2024-09-12T00:36:21.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.135+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~XHKF7AD07DHD.1 size=1048576 2024-09-12T00:36:21.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.136+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~XHKF7AD07DHD.2 size=514856 2024-09-12T00:36:21.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.136+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=XHKF7AD07DHD tag=GJHJHB3OLCK7 type=write size=3660584 2024-09-12T00:36:21.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.138+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~8C9NRFA2HHLZ.0 size=1048576 2024-09-12T00:36:21.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.139+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~8C9NRFA2HHLZ.1 size=1048576 2024-09-12T00:36:21.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.140+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~8C9NRFA2HHLZ.2 size=436911 2024-09-12T00:36:21.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.143+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=8C9NRFA2HHLZ tag=M0G0Z2UGSUVY type=write size=3582639 2024-09-12T00:36:21.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.145+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~5C93RSJ9PUTW.0 size=1048576 2024-09-12T00:36:21.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.146+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~5C93RSJ9PUTW.1 size=1048576 2024-09-12T00:36:21.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.148+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~5C93RSJ9PUTW.2 size=242912 2024-09-12T00:36:21.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.148+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=5C93RSJ9PUTW tag=ROMAMGKSYSU6 type=write size=3388640 2024-09-12T00:36:21.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.148+0000 7f030cb87780 1 < canceled part key=_multipart_9MCRD2G3MZIT.2~LKIMZV3PSER6.0 size=735693 2024-09-12T00:36:21.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.150+0000 7f030cb87780 1 < canceled multipart upload key=9MCRD2G3MZIT upload=LKIMZV3PSER6 tag=WBBSF4RUL30Y type=write size=1784269 2024-09-12T00:36:21.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.152+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=9196BDP0X6EM type=del size=4135702 2024-09-12T00:36:21.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.153+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=LXNWVEZQZ40X type=del 2024-09-12T00:36:21.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.155+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~9M3D7GS1CFR4.0 size=499135 2024-09-12T00:36:21.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.155+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=9M3D7GS1CFR4 tag=K7W8FU5JEQ8S type=write size=1547711 2024-09-12T00:36:21.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.157+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=1QZ8CEHUZSOV type=del 2024-09-12T00:36:21.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.159+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~HJYG7MB4T3IX.0 size=869170 2024-09-12T00:36:21.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.159+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=HJYG7MB4T3IX tag=60L6JF5074PJ type=write size=1917746 2024-09-12T00:36:21.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.160+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=EZHPH0D87VX7 type=del 2024-09-12T00:36:21.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.162+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=25PLZXCY28Y8 type=del size=1608944 2024-09-12T00:36:21.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.163+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~8I2M8FDJBIDE.0 size=1048576 2024-09-12T00:36:21.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.165+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~8I2M8FDJBIDE.1 size=1048576 2024-09-12T00:36:21.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.166+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~8I2M8FDJBIDE.2 size=278008 2024-09-12T00:36:21.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.169+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=8I2M8FDJBIDE tag=0GTCDW90MYNR type=write size=3423736 2024-09-12T00:36:21.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.170+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=VFU7TDKCCGST type=del size=3586709 2024-09-12T00:36:21.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.173+0000 7f030cb87780 1 < suggested remove operation key=POC8YA58U55N tag=PA03274M13Z4 type=del 2024-09-12T00:36:21.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.176+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~CFDNDQLFTIRZ.0 size=712522 2024-09-12T00:36:21.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.176+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=CFDNDQLFTIRZ tag=HR31X4KCACGH type=write size=1761098 2024-09-12T00:36:21.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.181+0000 7f030cb87780 1 < suggested update operation key=CY2NS03IIUJJ tag=OD3ECM5CDOBF type=write size=419195 2024-09-12T00:36:21.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.182+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=ISVHPQFU2NNV type=del size=3323554 2024-09-12T00:36:21.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.184+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~KZV5ODYA4WPT.0 size=289246 2024-09-12T00:36:21.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.185+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=KZV5ODYA4WPT tag=KJAPAPL7EWZO type=write size=1337822 2024-09-12T00:36:21.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.188+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~BA90RQJPD44U.0 size=1048576 2024-09-12T00:36:21.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.189+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~BA90RQJPD44U.1 size=1048576 2024-09-12T00:36:21.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.190+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~BA90RQJPD44U.2 size=195042 2024-09-12T00:36:21.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.190+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=BA90RQJPD44U tag=5I62RRI3EO85 type=write size=3340770 2024-09-12T00:36:21.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.192+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=KSVAPP71CIAV type=del 2024-09-12T00:36:21.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.193+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=SIUFM9E5EUE4 type=write size=314516 2024-09-12T00:36:21.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.194+0000 7f030cb87780 1 < completed write operation key=9MCRD2G3MZIT tag=ZB6Q3V54VRVT type=write size=139047 2024-09-12T00:36:21.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.196+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=2NCM9EMNVQC0 type=del size=848589 2024-09-12T00:36:21.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.197+0000 7f030cb87780 1 < completed write operation key=QGSJ51GMQXVK tag=YX9ETN5RWP0A type=write size=301136 2024-09-12T00:36:21.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.200+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~Z82T2DS47NUN.0 size=572322 2024-09-12T00:36:21.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.200+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=Z82T2DS47NUN tag=MZMBXANLIXGS type=write size=1620898 2024-09-12T00:36:21.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.202+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=LNAXX5T6S508 type=del 2024-09-12T00:36:21.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.202+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=PKAYPY5TMHOH type=del size=1268990 2024-09-12T00:36:21.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.203+0000 7f030cb87780 1 < canceled part key=_multipart_CY2NS03IIUJJ.2~50DIHJOE0KHZ.0 size=1048576 2024-09-12T00:36:21.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.204+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~50DIHJOE0KHZ.1 size=1048576 2024-09-12T00:36:21.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.205+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~50DIHJOE0KHZ.2 size=12586 2024-09-12T00:36:21.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.208+0000 7f030cb87780 1 < canceled multipart upload key=CY2NS03IIUJJ upload=50DIHJOE0KHZ tag=XSBHWFUE5JRA type=write size=3158314 2024-09-12T00:36:21.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.209+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=2MV869HC9TUV type=write size=1021859 2024-09-12T00:36:21.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.211+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~XJRQOE8CQC9S.0 size=1048576 2024-09-12T00:36:21.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.212+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~XJRQOE8CQC9S.1 size=1048576 2024-09-12T00:36:21.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.213+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~XJRQOE8CQC9S.2 size=773509 2024-09-12T00:36:21.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.215+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=XJRQOE8CQC9S tag=PG21E0N178I9 type=write size=3919237 2024-09-12T00:36:21.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.218+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~RC56B1DUWFSZ.0 size=204458 2024-09-12T00:36:21.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.218+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=RC56B1DUWFSZ tag=6DL888HJ6IEZ type=write size=1253034 2024-09-12T00:36:21.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.219+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~XHKF7AD07DHD.0 size=1048576 2024-09-12T00:36:21.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.221+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~XHKF7AD07DHD.1 size=1048576 2024-09-12T00:36:21.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.222+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~XHKF7AD07DHD.2 size=514856 2024-09-12T00:36:21.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.224+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=XHKF7AD07DHD tag=GJHJHB3OLCK7 type=write size=3660584 2024-09-12T00:36:21.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.225+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=33D60MCF68I4 type=del size=2174499 2024-09-12T00:36:21.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.227+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~5C93RSJ9PUTW.0 size=1048576 2024-09-12T00:36:21.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.228+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~5C93RSJ9PUTW.1 size=1048576 2024-09-12T00:36:21.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.229+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~5C93RSJ9PUTW.2 size=242912 2024-09-12T00:36:21.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.232+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=5C93RSJ9PUTW tag=ROMAMGKSYSU6 type=write size=3388640 2024-09-12T00:36:21.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.233+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=RECMZ9S9CV9V type=del size=3818012 2024-09-12T00:36:21.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.235+0000 7f030cb87780 1 < suggested remove operation key=N3KD1UVUVM95 tag=9196BDP0X6EM type=del 2024-09-12T00:36:21.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.237+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=OI44T4465OUW type=del size=1287537 2024-09-12T00:36:21.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.238+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~9M3D7GS1CFR4.0 size=499135 2024-09-12T00:36:21.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.241+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=9M3D7GS1CFR4 tag=K7W8FU5JEQ8S type=write size=1547711 2024-09-12T00:36:21.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.242+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=OIGZ4K2Z4XCQ type=del size=1451072 2024-09-12T00:36:21.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.243+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~HJYG7MB4T3IX.0 size=869170 2024-09-12T00:36:21.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.246+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=HJYG7MB4T3IX tag=60L6JF5074PJ type=write size=1917746 2024-09-12T00:36:21.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.248+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=UUF0CZGXLR4N type=del size=3987107 2024-09-12T00:36:21.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.249+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=25PLZXCY28Y8 type=del 2024-09-12T00:36:21.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.250+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=824A5U1W8E4X type=write size=198650 2024-09-12T00:36:21.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.252+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=VFU7TDKCCGST type=del 2024-09-12T00:36:21.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.254+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~B32LX8CTNKDV.0 size=1048576 2024-09-12T00:36:21.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.255+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~B32LX8CTNKDV.1 size=545015 2024-09-12T00:36:21.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.255+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=B32LX8CTNKDV tag=1PGZN2B1RUBR type=write size=2642167 2024-09-12T00:36:21.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.257+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~CFDNDQLFTIRZ.0 size=712522 2024-09-12T00:36:21.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.259+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=CFDNDQLFTIRZ tag=HR31X4KCACGH type=write size=1761098 2024-09-12T00:36:21.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.261+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=OP2YLVNC0TWA type=write size=781635 2024-09-12T00:36:21.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.263+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=ISVHPQFU2NNV type=del 2024-09-12T00:36:21.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.264+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=IC66UBPNJPCO type=del size=821625 2024-09-12T00:36:21.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.266+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~BA90RQJPD44U.0 size=1048576 2024-09-12T00:36:21.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.266+0000 7f030cb87780 1 < canceled part key=_multipart_IY156CJWG2TB.2~BA90RQJPD44U.1 size=1048576 2024-09-12T00:36:21.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.267+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~BA90RQJPD44U.2 size=195042 2024-09-12T00:36:21.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.269+0000 7f030cb87780 1 < canceled multipart upload key=IY156CJWG2TB upload=BA90RQJPD44U tag=5I62RRI3EO85 type=write size=3340770 2024-09-12T00:36:21.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.272+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~OZRCVE5T12EA.0 size=1048576 2024-09-12T00:36:21.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.272+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~OZRCVE5T12EA.1 size=352192 2024-09-12T00:36:21.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.272+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=OZRCVE5T12EA tag=O0OKDHJ4GNTL type=write size=2449344 2024-09-12T00:36:21.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.274+0000 7f030cb87780 1 < completed write operation key=1VOJGMWNKS0A tag=SIUFM9E5EUE4 type=write size=314516 2024-09-12T00:36:21.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.276+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~IW0XD5S3HR9Z.0 size=1048576 2024-09-12T00:36:21.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.277+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~IW0XD5S3HR9Z.1 size=121904 2024-09-12T00:36:21.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.277+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=IW0XD5S3HR9Z tag=PRU6YB4KODM2 type=write size=2219056 2024-09-12T00:36:21.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.279+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=2NCM9EMNVQC0 type=del 2024-09-12T00:36:21.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.281+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=TWLU3CUJ45ZI type=write size=686232 2024-09-12T00:36:21.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.282+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~Z82T2DS47NUN.0 size=572322 2024-09-12T00:36:21.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.285+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=Z82T2DS47NUN tag=MZMBXANLIXGS type=write size=1620898 2024-09-12T00:36:21.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.285+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=ENZFHQCDXUIV type=del size=211874 2024-09-12T00:36:21.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.287+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=PKAYPY5TMHOH type=del 2024-09-12T00:36:21.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.288+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=BQ2AHHB63IYB type=write size=444353 2024-09-12T00:36:21.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.290+0000 7f030cb87780 1 < canceled operation key=QGSJ51GMQXVK tag=2MV869HC9TUV type=write size=1021859 2024-09-12T00:36:21.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.291+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=R6KTFSKVQOYC type=del size=1102248 2024-09-12T00:36:21.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.294+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~RC56B1DUWFSZ.0 size=204458 2024-09-12T00:36:21.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.296+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=RC56B1DUWFSZ tag=6DL888HJ6IEZ type=write size=1253034 2024-09-12T00:36:21.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.297+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=GYYITG3V8VIB type=del size=4058248 2024-09-12T00:36:21.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.300+0000 7f030cb87780 1 < canceled operation key=V0OLIRP3KH40 tag=33D60MCF68I4 type=del size=2174499 2024-09-12T00:36:21.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.301+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=EAZ1GQ2YIDZM type=del size=2490130 2024-09-12T00:36:21.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.302+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=RECMZ9S9CV9V type=del 2024-09-12T00:36:21.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.304+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=XT4XEDBR02JH type=del size=2105796 2024-09-12T00:36:21.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.305+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=OI44T4465OUW type=del 2024-09-12T00:36:21.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.308+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~EIVWUA0YEUXT.0 size=530396 2024-09-12T00:36:21.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.308+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=EIVWUA0YEUXT tag=TMCZJSJY51PA type=write size=1578972 2024-09-12T00:36:21.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.309+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=OIGZ4K2Z4XCQ type=del 2024-09-12T00:36:21.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.311+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=YK1978NOO82Q type=del size=1406790 2024-09-12T00:36:21.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.314+0000 7f030cb87780 1 < suggested update operation key=V0OLIRP3KH40 tag=UUF0CZGXLR4N type=del size=3987107 2024-09-12T00:36:21.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.315+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=P8XM677C4Z4N type=del size=4022033 2024-09-12T00:36:21.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.318+0000 7f030cb87780 1 < suggested remove operation key=V0OLIRP3KH40 tag=824A5U1W8E4X type=write 2024-09-12T00:36:21.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.320+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=TA3DX78UJGPV type=del size=1027474 2024-09-12T00:36:21.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.321+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~B32LX8CTNKDV.0 size=1048576 2024-09-12T00:36:21.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.323+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~B32LX8CTNKDV.1 size=545015 2024-09-12T00:36:21.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.325+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=B32LX8CTNKDV tag=1PGZN2B1RUBR type=write size=2642167 2024-09-12T00:36:21.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.328+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~CNDIZFLZXQAU.0 size=1048576 2024-09-12T00:36:21.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.329+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~CNDIZFLZXQAU.1 size=1048576 2024-09-12T00:36:21.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.330+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~CNDIZFLZXQAU.2 size=33700 2024-09-12T00:36:21.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.330+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=CNDIZFLZXQAU tag=VH19ZZB5BWYP type=write size=3179428 2024-09-12T00:36:21.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.331+0000 7f030cb87780 1 < completed write operation key=327RDLIWLVRO tag=OP2YLVNC0TWA type=write size=781635 2024-09-12T00:36:21.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.333+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=9BUEWKGVGD2C type=del size=592347 2024-09-12T00:36:21.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.335+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=IC66UBPNJPCO type=del 2024-09-12T00:36:21.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.336+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=9HL38NBC196T type=del size=219448 2024-09-12T00:36:21.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.338+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~OZRCVE5T12EA.0 size=1048576 2024-09-12T00:36:21.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.339+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~OZRCVE5T12EA.1 size=352192 2024-09-12T00:36:21.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.341+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=OZRCVE5T12EA tag=O0OKDHJ4GNTL type=write size=2449344 2024-09-12T00:36:21.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.342+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=DIROSKJGJAR9 type=del size=1149048 2024-09-12T00:36:21.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.343+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~IW0XD5S3HR9Z.0 size=1048576 2024-09-12T00:36:21.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.345+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~IW0XD5S3HR9Z.1 size=121904 2024-09-12T00:36:21.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.347+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=IW0XD5S3HR9Z tag=PRU6YB4KODM2 type=write size=2219056 2024-09-12T00:36:21.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.349+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=5DE3USY1KM9Z type=del size=1038506 2024-09-12T00:36:21.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.352+0000 7f030cb87780 1 < suggested remove operation key=JRPD5AAK84ZD tag=TWLU3CUJ45ZI type=write 2024-09-12T00:36:21.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.353+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=9H3H0CXOYNFE type=del size=3237143 2024-09-12T00:36:21.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.356+0000 7f030cb87780 1 < suggested remove operation key=99OWKRGA8ZZN tag=ENZFHQCDXUIV type=del 2024-09-12T00:36:21.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.358+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~VUIKJ01TMB1Q.0 size=1048576 2024-09-12T00:36:21.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.359+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~VUIKJ01TMB1Q.1 size=79390 2024-09-12T00:36:21.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.359+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=VUIKJ01TMB1Q tag=7APH1URLCK0K type=write size=2176542 2024-09-12T00:36:21.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.361+0000 7f030cb87780 -1 < failed to complete operation key=99OWKRGA8ZZN tag=BQ2AHHB63IYB type=write size=444353: (22) Invalid argument 2024-09-12T00:36:21.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.365+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~1Z3B2A30P5K3.0 size=861685 2024-09-12T00:36:21.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.365+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=1Z3B2A30P5K3 tag=3S8B774BY63E type=write size=1910261 2024-09-12T00:36:21.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.366+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=R6KTFSKVQOYC type=del 2024-09-12T00:36:21.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.368+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~9GVGLZHZSH79.0 size=1048576 2024-09-12T00:36:21.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.370+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~9GVGLZHZSH79.1 size=1048576 2024-09-12T00:36:21.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.372+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~9GVGLZHZSH79.2 size=477147 2024-09-12T00:36:21.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.372+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=9GVGLZHZSH79 tag=98XR390WJTM5 type=write size=3622875 2024-09-12T00:36:21.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.372+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=GYYITG3V8VIB type=del 2024-09-12T00:36:21.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.373+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=N8NX5A5PHF0Q type=del size=40069 2024-09-12T00:36:21.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.376+0000 7f030cb87780 1 < suggested remove operation key=99OWKRGA8ZZN tag=EAZ1GQ2YIDZM type=del 2024-09-12T00:36:21.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.379+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~MA602MCZH3DK.0 size=1048576 2024-09-12T00:36:21.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.379+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~MA602MCZH3DK.1 size=1048576 2024-09-12T00:36:21.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.381+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~MA602MCZH3DK.2 size=647658 2024-09-12T00:36:21.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.381+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=MA602MCZH3DK tag=UQ9DX2HX8QRS type=write size=3793386 2024-09-12T00:36:21.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.383+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=XT4XEDBR02JH type=del 2024-09-12T00:36:21.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.383+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=8P7L06QK5XA4 type=del size=3164482 2024-09-12T00:36:21.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.385+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~EIVWUA0YEUXT.0 size=530396 2024-09-12T00:36:21.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.387+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=EIVWUA0YEUXT tag=TMCZJSJY51PA type=write size=1578972 2024-09-12T00:36:21.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.389+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~LJB61R68W2IF.0 size=438661 2024-09-12T00:36:21.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.389+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=LJB61R68W2IF tag=9LSIO48CFB13 type=write size=1487237 2024-09-12T00:36:21.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.390+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=YK1978NOO82Q type=del 2024-09-12T00:36:21.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.392+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=UZHI8XEYF52Z type=del size=3049170 2024-09-12T00:36:21.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.393+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=P8XM677C4Z4N type=del 2024-09-12T00:36:21.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.394+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=9V8D09QLDLME type=del size=696939 2024-09-12T00:36:21.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.397+0000 7f030cb87780 1 < suggested remove operation key=DLR6A7XOERHW tag=TA3DX78UJGPV type=del 2024-09-12T00:36:21.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.399+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=GPQJGSL75VKW type=del size=2427231 2024-09-12T00:36:21.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.400+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~CNDIZFLZXQAU.0 size=1048576 2024-09-12T00:36:21.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.402+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~CNDIZFLZXQAU.1 size=1048576 2024-09-12T00:36:21.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.403+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~CNDIZFLZXQAU.2 size=33700 2024-09-12T00:36:21.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.405+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=CNDIZFLZXQAU tag=VH19ZZB5BWYP type=write size=3179428 2024-09-12T00:36:21.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.406+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=AB6AY2SGZT1Z type=del size=2320706 2024-09-12T00:36:21.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.409+0000 7f030cb87780 1 < suggested update operation key=92GDVW0Q8VKQ tag=9BUEWKGVGD2C type=del size=592347 2024-09-12T00:36:21.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.411+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=JSXCUKPN959I type=del size=585246 2024-09-12T00:36:21.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.412+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=9HL38NBC196T type=del 2024-09-12T00:36:21.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.415+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~O7LR3N819KHZ.0 size=1048576 2024-09-12T00:36:21.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.416+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~O7LR3N819KHZ.1 size=1048576 2024-09-12T00:36:21.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.417+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~O7LR3N819KHZ.2 size=657583 2024-09-12T00:36:21.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.417+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=O7LR3N819KHZ tag=2YOA2R2I3HMN type=write size=3803311 2024-09-12T00:36:21.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.418+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=DIROSKJGJAR9 type=del 2024-09-12T00:36:21.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.419+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=MYW28XB3JXSH type=write size=801695 2024-09-12T00:36:21.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.422+0000 7f030cb87780 1 < suggested update operation key=UFYMVGL264T8 tag=5DE3USY1KM9Z type=del size=1038506 2024-09-12T00:36:21.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.424+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~LQHRY4VY8107.0 size=837600 2024-09-12T00:36:21.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.424+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=LQHRY4VY8107 tag=BFF702ET5SBW type=write size=1886176 2024-09-12T00:36:21.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.426+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=9H3H0CXOYNFE type=del 2024-09-12T00:36:21.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.427+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=9XFJNFLZUJ6T type=del size=2252382 2024-09-12T00:36:21.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.429+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~VUIKJ01TMB1Q.0 size=1048576 2024-09-12T00:36:21.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.431+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~VUIKJ01TMB1Q.1 size=79390 2024-09-12T00:36:21.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.432+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=VUIKJ01TMB1Q tag=7APH1URLCK0K type=write size=2176542 2024-09-12T00:36:21.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.434+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=GIB9JXWKMWBD type=del size=4078301 2024-09-12T00:36:21.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.435+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~1Z3B2A30P5K3.0 size=861685 2024-09-12T00:36:21.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.437+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=1Z3B2A30P5K3 tag=3S8B774BY63E type=write size=1910261 2024-09-12T00:36:21.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.441+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~LI5YYKSIED1F.0 size=1048576 2024-09-12T00:36:21.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.441+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~LI5YYKSIED1F.1 size=1048576 2024-09-12T00:36:21.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.443+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~LI5YYKSIED1F.2 size=611521 2024-09-12T00:36:21.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.443+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=LI5YYKSIED1F tag=0YMC1FER8INH type=write size=3757249 2024-09-12T00:36:21.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.444+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~9GVGLZHZSH79.0 size=1048576 2024-09-12T00:36:21.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.446+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~9GVGLZHZSH79.1 size=1048576 2024-09-12T00:36:21.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.446+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~9GVGLZHZSH79.2 size=477147 2024-09-12T00:36:21.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.449+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=9GVGLZHZSH79 tag=98XR390WJTM5 type=write size=3622875 2024-09-12T00:36:21.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.450+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=O0JN7NX9SBSS type=del size=3253581 2024-09-12T00:36:21.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.452+0000 7f030cb87780 -1 < failed to complete operation key=99OWKRGA8ZZN tag=N8NX5A5PHF0Q type=del size=40069: (22) Invalid argument 2024-09-12T00:36:21.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.454+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~AF9W5LM7SKKA.0 size=94489 2024-09-12T00:36:21.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.454+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=AF9W5LM7SKKA tag=B1657BBW4LV7 type=write size=1143065 2024-09-12T00:36:21.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.456+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~MA602MCZH3DK.0 size=1048576 2024-09-12T00:36:21.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.457+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~MA602MCZH3DK.1 size=1048576 2024-09-12T00:36:21.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.459+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~MA602MCZH3DK.2 size=647658 2024-09-12T00:36:21.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.460+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=MA602MCZH3DK tag=UQ9DX2HX8QRS type=write size=3793386 2024-09-12T00:36:21.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.462+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=1LKBGI34N2JK type=del size=664460 2024-09-12T00:36:21.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.463+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=8P7L06QK5XA4 type=del 2024-09-12T00:36:21.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.466+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~QEIX15L1A22X.0 size=148346 2024-09-12T00:36:21.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.466+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=QEIX15L1A22X tag=H7ZW2YVQQPIN type=write size=1196922 2024-09-12T00:36:21.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.468+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~LJB61R68W2IF.0 size=438661 2024-09-12T00:36:21.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.470+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=LJB61R68W2IF tag=9LSIO48CFB13 type=write size=1487237 2024-09-12T00:36:21.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.471+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=QB2RZX3Z615K type=del size=3904214 2024-09-12T00:36:21.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.473+0000 7f030cb87780 -1 < failed to complete operation key=92GDVW0Q8VKQ tag=UZHI8XEYF52Z type=del size=3049170: (22) Invalid argument 2024-09-12T00:36:21.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.474+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=0XML0BEYO6II type=del size=3846064 2024-09-12T00:36:21.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.476+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=9V8D09QLDLME type=del 2024-09-12T00:36:21.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.477+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=YS95K756D0N7 type=del size=3308897 2024-09-12T00:36:21.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.480+0000 7f030cb87780 1 < suggested update operation key=V0OLIRP3KH40 tag=GPQJGSL75VKW type=del size=2427231 2024-09-12T00:36:21.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.481+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=3FUWSIG9HOJD type=del size=2625602 2024-09-12T00:36:21.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.483+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=AB6AY2SGZT1Z type=del 2024-09-12T00:36:21.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.484+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=NJ9G110K0KE5 type=del size=3253202 2024-09-12T00:36:21.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.485+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=JSXCUKPN959I type=del 2024-09-12T00:36:21.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.487+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=KDB7EJ1DBK8V type=del size=3781025 2024-09-12T00:36:21.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.488+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~O7LR3N819KHZ.0 size=1048576 2024-09-12T00:36:21.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.489+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~O7LR3N819KHZ.1 size=1048576 2024-09-12T00:36:21.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.490+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~O7LR3N819KHZ.2 size=657583 2024-09-12T00:36:21.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.494+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=O7LR3N819KHZ tag=2YOA2R2I3HMN type=write size=3803311 2024-09-12T00:36:21.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.497+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~QAIYEX16T81D.0 size=157211 2024-09-12T00:36:21.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.497+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=QAIYEX16T81D tag=WTUOFDXD2EFT type=write size=1205787 2024-09-12T00:36:21.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.500+0000 7f030cb87780 1 < suggested remove operation key=6WHZRKLM3OLP tag=MYW28XB3JXSH type=write 2024-09-12T00:36:21.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.502+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~V32UJYEQ7MEG.0 size=199879 2024-09-12T00:36:21.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.502+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=V32UJYEQ7MEG tag=1PS4EKQ5K4MF type=write size=1248455 2024-09-12T00:36:21.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.504+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~LQHRY4VY8107.0 size=837600 2024-09-12T00:36:21.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.506+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=LQHRY4VY8107 tag=BFF702ET5SBW type=write size=1886176 2024-09-12T00:36:21.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.508+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=QRPHCTQ8Q32K type=del size=2515874 2024-09-12T00:36:21.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.509+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=9XFJNFLZUJ6T type=del 2024-09-12T00:36:21.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.511+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=XE5YRNFR623L type=del size=638499 2024-09-12T00:36:21.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.512+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=GIB9JXWKMWBD type=del 2024-09-12T00:36:21.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.514+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=9AQGMDYO1KZW type=write size=44820 2024-09-12T00:36:21.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.515+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~LI5YYKSIED1F.0 size=1048576 2024-09-12T00:36:21.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.516+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~LI5YYKSIED1F.1 size=1048576 2024-09-12T00:36:21.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.517+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~LI5YYKSIED1F.2 size=611521 2024-09-12T00:36:21.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.520+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=LI5YYKSIED1F tag=0YMC1FER8INH type=write size=3757249 2024-09-12T00:36:21.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.522+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=PXFBH1WQEJH8 type=del size=1581868 2024-09-12T00:36:21.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.523+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=O0JN7NX9SBSS type=del 2024-09-12T00:36:21.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.524+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=TT7KMPCJTZJB type=del size=2093612 2024-09-12T00:36:21.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.526+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~AF9W5LM7SKKA.0 size=94489 2024-09-12T00:36:21.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.529+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=AF9W5LM7SKKA tag=B1657BBW4LV7 type=write size=1143065 2024-09-12T00:36:21.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.532+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~GGVGFKJAH75H.0 size=1048576 2024-09-12T00:36:21.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.532+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~GGVGFKJAH75H.1 size=844542 2024-09-12T00:36:21.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.532+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=GGVGFKJAH75H tag=GI1F7QX429G9 type=write size=2941694 2024-09-12T00:36:21.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.534+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=1LKBGI34N2JK type=del 2024-09-12T00:36:21.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.535+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=TRYQTYN0ZGXY type=del size=1529911 2024-09-12T00:36:21.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.537+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~QEIX15L1A22X.0 size=148346 2024-09-12T00:36:21.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.540+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=QEIX15L1A22X tag=H7ZW2YVQQPIN type=write size=1196922 2024-09-12T00:36:21.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.543+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~GB4PUMPSL0VW.0 size=718651 2024-09-12T00:36:21.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.543+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=GB4PUMPSL0VW tag=XEETS1Z1CRGB type=write size=1767227 2024-09-12T00:36:21.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.544+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=QB2RZX3Z615K type=del 2024-09-12T00:36:21.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.545+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=WFFRH22PWDGR type=write size=494272 2024-09-12T00:36:21.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.547+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=0XML0BEYO6II type=del 2024-09-12T00:36:21.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.549+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=L5X39O6QZ75J type=del size=800445 2024-09-12T00:36:21.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.552+0000 7f030cb87780 1 < suggested update operation key=3W7ANGL92ZF0 tag=YS95K756D0N7 type=del size=3308897 2024-09-12T00:36:21.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.553+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=LJCQC26UWXDW type=del size=250778 2024-09-12T00:36:21.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.555+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=3FUWSIG9HOJD type=del 2024-09-12T00:36:21.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.556+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=18S0IAGA7GND type=del size=1888583 2024-09-12T00:36:21.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.558+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=NJ9G110K0KE5 type=del 2024-09-12T00:36:21.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.561+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~7WL4GMJ675JS.0 size=829079 2024-09-12T00:36:21.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.561+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=7WL4GMJ675JS tag=HGPLDYWJMVF4 type=write size=1877655 2024-09-12T00:36:21.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.564+0000 7f030cb87780 1 < suggested remove operation key=3W7ANGL92ZF0 tag=KDB7EJ1DBK8V type=del 2024-09-12T00:36:21.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.566+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=H78YT68NB23Y type=del size=2574172 2024-09-12T00:36:21.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.567+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~QAIYEX16T81D.0 size=157211 2024-09-12T00:36:21.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.569+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=QAIYEX16T81D tag=WTUOFDXD2EFT type=write size=1205787 2024-09-12T00:36:21.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.572+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~FMAK0Q65WY7H.0 size=266364 2024-09-12T00:36:21.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.572+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=FMAK0Q65WY7H tag=CFHZCSJXY901 type=write size=1314940 2024-09-12T00:36:21.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.573+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~V32UJYEQ7MEG.0 size=199879 2024-09-12T00:36:21.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.575+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=V32UJYEQ7MEG tag=1PS4EKQ5K4MF type=write size=1248455 2024-09-12T00:36:21.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.578+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~32Y5IHNRN4GZ.0 size=116067 2024-09-12T00:36:21.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.578+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=32Y5IHNRN4GZ tag=KQUJ8276FWTX type=write size=1164643 2024-09-12T00:36:21.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.579+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=QRPHCTQ8Q32K type=del 2024-09-12T00:36:21.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.581+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=WU3K5779UCMS type=del size=1696016 2024-09-12T00:36:21.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.582+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=XE5YRNFR623L type=del 2024-09-12T00:36:21.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.586+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~MVGOFRZ8QFVN.0 size=974187 2024-09-12T00:36:21.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.586+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=MVGOFRZ8QFVN tag=SGGIHM1LSZYL type=write size=2022763 2024-09-12T00:36:21.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.587+0000 7f030cb87780 1 < completed write operation key=CUDFTXFBC862 tag=9AQGMDYO1KZW type=write size=44820 2024-09-12T00:36:21.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.588+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=C4W6LK7LDK95 type=del size=66562 2024-09-12T00:36:21.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.591+0000 7f030cb87780 1 < suggested update operation key=V87B6SDB1HFZ tag=PXFBH1WQEJH8 type=del size=1581868 2024-09-12T00:36:21.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.594+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~X9FL1S22AE7F.0 size=900228 2024-09-12T00:36:21.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.594+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=X9FL1S22AE7F tag=SKVHNZXOO3TP type=write size=1948804 2024-09-12T00:36:21.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.596+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=TT7KMPCJTZJB type=del 2024-09-12T00:36:21.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.599+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~4VZK7AQP5X3D.0 size=1048576 2024-09-12T00:36:21.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.600+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~4VZK7AQP5X3D.1 size=590264 2024-09-12T00:36:21.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.600+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=4VZK7AQP5X3D tag=9VRNK743X406 type=write size=2687416 2024-09-12T00:36:21.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.601+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~GGVGFKJAH75H.0 size=1048576 2024-09-12T00:36:21.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.602+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~GGVGFKJAH75H.1 size=844542 2024-09-12T00:36:21.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.605+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=GGVGFKJAH75H tag=GI1F7QX429G9 type=write size=2941694 2024-09-12T00:36:21.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.606+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=4PSML0N4RAB4 type=del size=497616 2024-09-12T00:36:21.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.608+0000 7f030cb87780 1 < canceled operation key=ZQD0491BHJPM tag=TRYQTYN0ZGXY type=del size=1529911 2024-09-12T00:36:21.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.611+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~D4KGE5UYOYNY.0 size=536475 2024-09-12T00:36:21.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.611+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=D4KGE5UYOYNY tag=NF2U17MOF48X type=write size=1585051 2024-09-12T00:36:21.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.611+0000 7f030cb87780 1 < canceled part key=_multipart_3W7ANGL92ZF0.2~GB4PUMPSL0VW.0 size=718651 2024-09-12T00:36:21.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.613+0000 7f030cb87780 1 < canceled multipart upload key=3W7ANGL92ZF0 upload=GB4PUMPSL0VW tag=XEETS1Z1CRGB type=write size=1767227 2024-09-12T00:36:21.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.615+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=E3F7P3QXZRHC type=del size=2177134 2024-09-12T00:36:21.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.616+0000 7f030cb87780 1 < completed write operation key=327RDLIWLVRO tag=WFFRH22PWDGR type=write size=494272 2024-09-12T00:36:21.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.618+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=53O0QV1JOFO5 type=del size=2205844 2024-09-12T00:36:21.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.619+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=L5X39O6QZ75J type=del 2024-09-12T00:36:21.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.621+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=CDH3AEL6HXUX type=del size=287950 2024-09-12T00:36:21.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.622+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=LJCQC26UWXDW type=del 2024-09-12T00:36:21.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.624+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=5I1O6R4BVZUH type=del size=3023922 2024-09-12T00:36:21.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.625+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=18S0IAGA7GND type=del 2024-09-12T00:36:21.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.628+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~BV5D1L900E8B.0 size=1048576 2024-09-12T00:36:21.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.629+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~BV5D1L900E8B.1 size=1048576 2024-09-12T00:36:21.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.630+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~BV5D1L900E8B.2 size=11194 2024-09-12T00:36:21.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.630+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=BV5D1L900E8B tag=9Z7FQMN4GEWW type=write size=3156922 2024-09-12T00:36:21.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.632+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~7WL4GMJ675JS.0 size=829079 2024-09-12T00:36:21.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.634+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=7WL4GMJ675JS tag=HGPLDYWJMVF4 type=write size=1877655 2024-09-12T00:36:21.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.636+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=6ED7IVC17SE1 type=del size=1543135 2024-09-12T00:36:21.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.638+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=H78YT68NB23Y type=del 2024-09-12T00:36:21.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.640+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=1COKFYEA0Q5A type=write size=44769 2024-09-12T00:36:21.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.640+0000 7f030cb87780 1 < canceled part key=_multipart_86TWUAZAHI4I.2~FMAK0Q65WY7H.0 size=266364 2024-09-12T00:36:21.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.642+0000 7f030cb87780 1 < canceled multipart upload key=86TWUAZAHI4I upload=FMAK0Q65WY7H tag=CFHZCSJXY901 type=write size=1314940 2024-09-12T00:36:21.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.644+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=5KELLB7E2Y93 type=del size=30206 2024-09-12T00:36:21.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.645+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~32Y5IHNRN4GZ.0 size=116067 2024-09-12T00:36:21.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.647+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=32Y5IHNRN4GZ tag=KQUJ8276FWTX type=write size=1164643 2024-09-12T00:36:21.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.649+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=4YOYJ9E7FO60 type=del size=3302212 2024-09-12T00:36:21.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.650+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=WU3K5779UCMS type=del 2024-09-12T00:36:21.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.652+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~HED0QWO7Z0C0.0 size=1048576 2024-09-12T00:36:21.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.653+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~HED0QWO7Z0C0.1 size=490987 2024-09-12T00:36:21.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.653+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=HED0QWO7Z0C0 tag=VKEW01JUHAPO type=write size=2588139 2024-09-12T00:36:21.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.655+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~MVGOFRZ8QFVN.0 size=974187 2024-09-12T00:36:21.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.657+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=MVGOFRZ8QFVN tag=SGGIHM1LSZYL type=write size=2022763 2024-09-12T00:36:21.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.659+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=AWVIUYXSET9V type=del size=2607623 2024-09-12T00:36:21.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.660+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=C4W6LK7LDK95 type=del 2024-09-12T00:36:21.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.661+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=CGXNPYW4OSYL type=write size=142897 2024-09-12T00:36:21.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.662+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~X9FL1S22AE7F.0 size=900228 2024-09-12T00:36:21.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.664+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=X9FL1S22AE7F tag=SKVHNZXOO3TP type=write size=1948804 2024-09-12T00:36:21.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.667+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=R4BXOIFF5IJZ type=del size=193658 2024-09-12T00:36:21.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.667+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~4VZK7AQP5X3D.0 size=1048576 2024-09-12T00:36:21.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.668+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~4VZK7AQP5X3D.1 size=590264 2024-09-12T00:36:21.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.670+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=4VZK7AQP5X3D tag=9VRNK743X406 type=write size=2687416 2024-09-12T00:36:21.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.672+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=3XR5GYSRKT8Q type=del size=1743217 2024-09-12T00:36:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.673+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=4PSML0N4RAB4 type=del 2024-09-12T00:36:21.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.676+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~CQEL1VXDWSTH.0 size=1048576 2024-09-12T00:36:21.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.677+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~CQEL1VXDWSTH.1 size=1034058 2024-09-12T00:36:21.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.677+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=CQEL1VXDWSTH tag=08XH2D0A4J9Y type=write size=3131210 2024-09-12T00:36:21.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.679+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~D4KGE5UYOYNY.0 size=536475 2024-09-12T00:36:21.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.682+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=D4KGE5UYOYNY tag=NF2U17MOF48X type=write size=1585051 2024-09-12T00:36:21.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.683+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=70PWXAT8R4DZ type=write size=214153 2024-09-12T00:36:21.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.685+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=E3F7P3QXZRHC type=del 2024-09-12T00:36:21.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.686+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=BAZW6LX9DC4C type=del size=648930 2024-09-12T00:36:21.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.688+0000 7f030cb87780 1 < suggested remove operation key=3W7ANGL92ZF0 tag=53O0QV1JOFO5 type=del 2024-09-12T00:36:21.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.690+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=W0U6U3NV1R2C type=del size=1441759 2024-09-12T00:36:21.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.691+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=CDH3AEL6HXUX type=del 2024-09-12T00:36:21.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.694+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~GMX972JAU2E8.0 size=1048576 2024-09-12T00:36:21.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.695+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~GMX972JAU2E8.1 size=211501 2024-09-12T00:36:21.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.695+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=GMX972JAU2E8 tag=WVII6NHQHR5I type=write size=2308653 2024-09-12T00:36:21.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.697+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=5I1O6R4BVZUH type=del 2024-09-12T00:36:21.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.698+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=KLFSFKQ73FZL type=del size=279802 2024-09-12T00:36:21.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.698+0000 7f030cb87780 1 < canceled part key=_multipart_INFFH9R3EFRY.2~BV5D1L900E8B.0 size=1048576 2024-09-12T00:36:21.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.699+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~BV5D1L900E8B.1 size=1048576 2024-09-12T00:36:21.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.700+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~BV5D1L900E8B.2 size=11194 2024-09-12T00:36:21.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.703+0000 7f030cb87780 1 < canceled multipart upload key=INFFH9R3EFRY upload=BV5D1L900E8B tag=9Z7FQMN4GEWW type=write size=3156922 2024-09-12T00:36:21.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.704+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=P7I6WC1AN114 type=del size=728506 2024-09-12T00:36:21.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.706+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=6ED7IVC17SE1 type=del 2024-09-12T00:36:21.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.708+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=HO6P7MZRFP6F type=write size=521930 2024-09-12T00:36:21.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.709+0000 7f030cb87780 1 < completed write operation key=327RDLIWLVRO tag=1COKFYEA0Q5A type=write size=44769 2024-09-12T00:36:21.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.711+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=3MIXPRYPPWSZ type=del size=3328358 2024-09-12T00:36:21.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.713+0000 7f030cb87780 1 < canceled operation key=IY156CJWG2TB tag=5KELLB7E2Y93 type=del size=30206 2024-09-12T00:36:21.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.715+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=QHMHJZTQ4HW9 type=write size=301596 2024-09-12T00:36:21.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.717+0000 7f030cb87780 1 < suggested update operation key=IHTFI7W4A6JT tag=4YOYJ9E7FO60 type=del size=3302212 2024-09-12T00:36:21.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.719+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~1LLWY9Z4VLLW.0 size=691481 2024-09-12T00:36:21.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.719+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=1LLWY9Z4VLLW tag=6YVTCU9FF1VR type=write size=1740057 2024-09-12T00:36:21.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.721+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~HED0QWO7Z0C0.0 size=1048576 2024-09-12T00:36:21.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.723+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~HED0QWO7Z0C0.1 size=490987 2024-09-12T00:36:21.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.725+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=HED0QWO7Z0C0 tag=VKEW01JUHAPO type=write size=2588139 2024-09-12T00:36:21.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.727+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=YX11C2XDTF91 type=del size=2256019 2024-09-12T00:36:21.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.729+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=AWVIUYXSET9V type=del 2024-09-12T00:36:21.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.731+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~YD6O6U2C7UBP.0 size=1048576 2024-09-12T00:36:21.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.732+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~YD6O6U2C7UBP.1 size=1020896 2024-09-12T00:36:21.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.732+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=YD6O6U2C7UBP tag=B1UFL0W9QSNB type=write size=3118048 2024-09-12T00:36:21.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.734+0000 7f030cb87780 1 < completed write operation key=327RDLIWLVRO tag=CGXNPYW4OSYL type=write size=142897 2024-09-12T00:36:21.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.736+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=UPILLGMTX17C type=del size=39258 2024-09-12T00:36:21.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.737+0000 7f030cb87780 1 < canceled operation key=6WHZRKLM3OLP tag=R4BXOIFF5IJZ type=del size=193658 2024-09-12T00:36:21.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.740+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~YB0Q6J8IE5RM.0 size=1048576 2024-09-12T00:36:21.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.741+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~YB0Q6J8IE5RM.1 size=912753 2024-09-12T00:36:21.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.741+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=YB0Q6J8IE5RM tag=3YZUOLSV9DJ2 type=write size=3009905 2024-09-12T00:36:21.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.742+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=3XR5GYSRKT8Q type=del 2024-09-12T00:36:21.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.744+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=I6BD0F1M7PRF type=del size=3034968 2024-09-12T00:36:21.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.745+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~CQEL1VXDWSTH.0 size=1048576 2024-09-12T00:36:21.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.746+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~CQEL1VXDWSTH.1 size=1034058 2024-09-12T00:36:21.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.749+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=CQEL1VXDWSTH tag=08XH2D0A4J9Y type=write size=3131210 2024-09-12T00:36:21.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.752+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=OHV1VYZDJXJ6 type=del size=3726376 2024-09-12T00:36:21.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.753+0000 7f030cb87780 1 < completed write operation key=JPEIGLC162K3 tag=70PWXAT8R4DZ type=write size=214153 2024-09-12T00:36:21.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.755+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=ZS44IWT17RQI type=del size=1687144 2024-09-12T00:36:21.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.756+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=BAZW6LX9DC4C type=del 2024-09-12T00:36:21.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.760+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~1735P6D8K6WJ.0 size=638724 2024-09-12T00:36:21.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.760+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=1735P6D8K6WJ tag=ANET0NKE4C16 type=write size=1687300 2024-09-12T00:36:21.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.761+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=W0U6U3NV1R2C type=del 2024-09-12T00:36:21.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.762+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=ROC2OX9551PP type=write size=908750 2024-09-12T00:36:21.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.764+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~GMX972JAU2E8.0 size=1048576 2024-09-12T00:36:21.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.765+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~GMX972JAU2E8.1 size=211501 2024-09-12T00:36:21.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.767+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=GMX972JAU2E8 tag=WVII6NHQHR5I type=write size=2308653 2024-09-12T00:36:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.769+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=JFQEOPEISMTI type=del size=2339852 2024-09-12T00:36:21.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.770+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=KLFSFKQ73FZL type=del 2024-09-12T00:36:21.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.774+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~6NKLGGI144KS.0 size=362004 2024-09-12T00:36:21.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.774+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=6NKLGGI144KS tag=K2PTBBCW9590 type=write size=1410580 2024-09-12T00:36:21.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.777+0000 7f030cb87780 1 < suggested remove operation key=92GDVW0Q8VKQ tag=P7I6WC1AN114 type=del 2024-09-12T00:36:21.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.777+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=EP3OYEAE54XC type=del size=2272023 2024-09-12T00:36:21.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.779+0000 7f030cb87780 1 < completed write operation key=OR439FK5L43V tag=HO6P7MZRFP6F type=write size=521930 2024-09-12T00:36:21.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.781+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=BOCQ4X7D5SL1 type=del size=41527 2024-09-12T00:36:21.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.782+0000 7f030cb87780 1 < canceled operation key=CUDFTXFBC862 tag=3MIXPRYPPWSZ type=del size=3328358 2024-09-12T00:36:21.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.785+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~UY6JL4B7L10U.0 size=1048576 2024-09-12T00:36:21.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.786+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~UY6JL4B7L10U.1 size=61965 2024-09-12T00:36:21.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.786+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=UY6JL4B7L10U tag=J183R7R7XEBJ type=write size=2159117 2024-09-12T00:36:21.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.787+0000 7f030cb87780 -1 < failed to complete operation key=92GDVW0Q8VKQ tag=QHMHJZTQ4HW9 type=write size=301596: (22) Invalid argument 2024-09-12T00:36:21.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.789+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=7BZD4M5SLJF3 type=del size=800055 2024-09-12T00:36:21.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.791+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~1LLWY9Z4VLLW.0 size=691481 2024-09-12T00:36:21.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.794+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=1LLWY9Z4VLLW tag=6YVTCU9FF1VR type=write size=1740057 2024-09-12T00:36:21.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.796+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~TM65Y87CWS43.0 size=145749 2024-09-12T00:36:21.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.796+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=TM65Y87CWS43 tag=GW02XLPXS2C5 type=write size=1194325 2024-09-12T00:36:21.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.798+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=YX11C2XDTF91 type=del 2024-09-12T00:36:21.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.799+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=J6HTTS1WE09F type=del size=701298 2024-09-12T00:36:21.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.800+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~YD6O6U2C7UBP.0 size=1048576 2024-09-12T00:36:21.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.802+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~YD6O6U2C7UBP.1 size=1020896 2024-09-12T00:36:21.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.804+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=YD6O6U2C7UBP tag=B1UFL0W9QSNB type=write size=3118048 2024-09-12T00:36:21.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.805+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=V17N38FAUHD6 type=del size=1303738 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.808+0000 7f030cb87780 1 < canceled operation key=DLR6A7XOERHW tag=UPILLGMTX17C type=del size=39258 2024-09-12T00:36:21.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.810+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~0GE09W0NCG6G.0 size=1026469 2024-09-12T00:36:21.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.810+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=0GE09W0NCG6G tag=5QC7L90COFJB type=write size=2075045 2024-09-12T00:36:21.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.812+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~YB0Q6J8IE5RM.0 size=1048576 2024-09-12T00:36:21.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.813+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~YB0Q6J8IE5RM.1 size=912753 2024-09-12T00:36:21.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.815+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=YB0Q6J8IE5RM tag=3YZUOLSV9DJ2 type=write size=3009905 2024-09-12T00:36:21.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.817+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~6JT0PGCMFBIO.0 size=1048576 2024-09-12T00:36:21.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.818+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~6JT0PGCMFBIO.1 size=998990 2024-09-12T00:36:21.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.818+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=6JT0PGCMFBIO tag=AEZDKE3L8IG2 type=write size=3096142 2024-09-12T00:36:21.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.820+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=I6BD0F1M7PRF type=del 2024-09-12T00:36:21.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.821+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=6O38EFE64F9X type=del size=3709567 2024-09-12T00:36:21.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.822+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=OHV1VYZDJXJ6 type=del 2024-09-12T00:36:21.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.825+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~5XL34TEETD9X.0 size=1048576 2024-09-12T00:36:21.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.827+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~5XL34TEETD9X.1 size=1048576 2024-09-12T00:36:21.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.827+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~5XL34TEETD9X.2 size=567984 2024-09-12T00:36:21.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.827+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=5XL34TEETD9X tag=WZL9LWTL7UAU type=write size=3713712 2024-09-12T00:36:21.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.830+0000 7f030cb87780 1 < suggested update operation key=IHTFI7W4A6JT tag=ZS44IWT17RQI type=del size=1687144 2024-09-12T00:36:21.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.832+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=QSCXKTGFUR5W type=del size=3117925 2024-09-12T00:36:21.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.833+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~1735P6D8K6WJ.0 size=638724 2024-09-12T00:36:21.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.836+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=1735P6D8K6WJ tag=ANET0NKE4C16 type=write size=1687300 2024-09-12T00:36:21.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.837+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=AEB0E9ZLVWQV type=del size=3434303 2024-09-12T00:36:21.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.838+0000 7f030cb87780 1 < completed write operation key=QGSJ51GMQXVK tag=ROC2OX9551PP type=write size=908750 2024-09-12T00:36:21.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.839+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=A7IS01PYGCAI type=del size=1343682 2024-09-12T00:36:21.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.841+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=JFQEOPEISMTI type=del 2024-09-12T00:36:21.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.844+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~D4QUWQZ0HD4D.0 size=525132 2024-09-12T00:36:21.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.844+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=D4QUWQZ0HD4D tag=AE6BU8X23J5X type=write size=1573708 2024-09-12T00:36:21.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.845+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~6NKLGGI144KS.0 size=362004 2024-09-12T00:36:21.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.848+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=6NKLGGI144KS tag=K2PTBBCW9590 type=write size=1410580 2024-09-12T00:36:21.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.851+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~QZY0QZ7G7RNO.0 size=868320 2024-09-12T00:36:21.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.851+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=QZY0QZ7G7RNO tag=84AYRT47K0RS type=write size=1916896 2024-09-12T00:36:21.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.855+0000 7f030cb87780 1 < suggested update operation key=UFYMVGL264T8 tag=EP3OYEAE54XC type=del size=2272023 2024-09-12T00:36:21.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.856+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=T7XZYXPEA2IE type=del size=1733134 2024-09-12T00:36:21.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.859+0000 7f030cb87780 1 < suggested remove operation key=56I20YIPY82N tag=BOCQ4X7D5SL1 type=del 2024-09-12T00:36:21.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.861+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~QB10MVKTW23O.0 size=1048576 2024-09-12T00:36:21.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.863+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~QB10MVKTW23O.1 size=596212 2024-09-12T00:36:21.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.863+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=QB10MVKTW23O tag=6AMAZQCC7767 type=write size=2693364 2024-09-12T00:36:21.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.864+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~UY6JL4B7L10U.0 size=1048576 2024-09-12T00:36:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.865+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~UY6JL4B7L10U.1 size=61965 2024-09-12T00:36:21.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.868+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=UY6JL4B7L10U tag=J183R7R7XEBJ type=write size=2159117 2024-09-12T00:36:21.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.869+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=SYEX9KJ940R4 type=del size=272720 2024-09-12T00:36:21.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.870+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=7BZD4M5SLJF3 type=del 2024-09-12T00:36:21.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.873+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~EMYTNQ2FRV82.0 size=1048576 2024-09-12T00:36:21.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.874+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~EMYTNQ2FRV82.1 size=1048576 2024-09-12T00:36:21.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.875+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~EMYTNQ2FRV82.2 size=45659 2024-09-12T00:36:21.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.875+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=EMYTNQ2FRV82 tag=C8I8L0KBDAEE type=write size=3191387 2024-09-12T00:36:21.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.876+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~TM65Y87CWS43.0 size=145749 2024-09-12T00:36:21.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.879+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=TM65Y87CWS43 tag=GW02XLPXS2C5 type=write size=1194325 2024-09-12T00:36:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.880+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=7LL3IL19VJ8M type=write size=472115 2024-09-12T00:36:21.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.883+0000 7f030cb87780 1 < suggested update operation key=V0OLIRP3KH40 tag=J6HTTS1WE09F type=del size=701298 2024-09-12T00:36:21.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.885+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=Z7IBYDJC3TBO type=del size=3876846 2024-09-12T00:36:21.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.886+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=V17N38FAUHD6 type=del 2024-09-12T00:36:21.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.887+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=MQ4LE7YKLCU1 type=write size=764487 2024-09-12T00:36:21.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.889+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~0GE09W0NCG6G.0 size=1026469 2024-09-12T00:36:21.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.891+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=0GE09W0NCG6G tag=5QC7L90COFJB type=write size=2075045 2024-09-12T00:36:21.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.895+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~NYCZUTMO2042.0 size=1048576 2024-09-12T00:36:21.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.896+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~NYCZUTMO2042.1 size=1048576 2024-09-12T00:36:21.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.897+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~NYCZUTMO2042.2 size=10614 2024-09-12T00:36:21.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.897+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=NYCZUTMO2042 tag=DBQ3MFRELYNF type=write size=3156342 2024-09-12T00:36:21.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.898+0000 7f030cb87780 1 < canceled part key=_multipart_CY2NS03IIUJJ.2~6JT0PGCMFBIO.0 size=1048576 2024-09-12T00:36:21.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.899+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~6JT0PGCMFBIO.1 size=998990 2024-09-12T00:36:21.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.901+0000 7f030cb87780 1 < canceled multipart upload key=CY2NS03IIUJJ upload=6JT0PGCMFBIO tag=AEZDKE3L8IG2 type=write size=3096142 2024-09-12T00:36:21.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.904+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~T63V51PUER2A.0 size=1048576 2024-09-12T00:36:21.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.905+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~T63V51PUER2A.1 size=1048576 2024-09-12T00:36:21.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.906+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~T63V51PUER2A.2 size=128811 2024-09-12T00:36:21.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.906+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=T63V51PUER2A tag=40U6H5QVDYIY type=write size=3274539 2024-09-12T00:36:21.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.908+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=6O38EFE64F9X type=del 2024-09-12T00:36:21.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.910+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=IDDYHF875O7Z type=del size=2668627 2024-09-12T00:36:21.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.912+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~5XL34TEETD9X.0 size=1048576 2024-09-12T00:36:21.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.914+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~5XL34TEETD9X.1 size=1048576 2024-09-12T00:36:21.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.914+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~5XL34TEETD9X.2 size=567984 2024-09-12T00:36:21.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.917+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=5XL34TEETD9X tag=WZL9LWTL7UAU type=write size=3713712 2024-09-12T00:36:21.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.918+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=YYNCNGCWV9E3 type=del size=3981416 2024-09-12T00:36:21.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.919+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=QSCXKTGFUR5W type=del 2024-09-12T00:36:21.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.921+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=Z8S5MD3RYDKP type=del size=2509825 2024-09-12T00:36:21.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.922+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=AEB0E9ZLVWQV type=del 2024-09-12T00:36:21.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.924+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=5TVRQT5TWAH0 type=del size=1170671 2024-09-12T00:36:21.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.925+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=A7IS01PYGCAI type=del 2024-09-12T00:36:21.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.927+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=07QEB405R0T6 type=del size=786917 2024-09-12T00:36:21.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.927+0000 7f030cb87780 1 < canceled part key=_multipart_9MCRD2G3MZIT.2~D4QUWQZ0HD4D.0 size=525132 2024-09-12T00:36:21.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.930+0000 7f030cb87780 1 < canceled multipart upload key=9MCRD2G3MZIT upload=D4QUWQZ0HD4D tag=AE6BU8X23J5X type=write size=1573708 2024-09-12T00:36:21.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.931+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=3TT3976UYS93 type=del size=2995941 2024-09-12T00:36:21.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.933+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~QZY0QZ7G7RNO.0 size=868320 2024-09-12T00:36:21.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.935+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=QZY0QZ7G7RNO tag=84AYRT47K0RS type=write size=1916896 2024-09-12T00:36:21.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.936+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=FNML25Q47LIZ type=write size=1038817 2024-09-12T00:36:21.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.939+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=T7XZYXPEA2IE type=del 2024-09-12T00:36:21.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.939+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=EGPX8S6ZDC04 type=del size=2956713 2024-09-12T00:36:21.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.941+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~QB10MVKTW23O.0 size=1048576 2024-09-12T00:36:21.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.942+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~QB10MVKTW23O.1 size=596212 2024-09-12T00:36:21.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.945+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=QB10MVKTW23O tag=6AMAZQCC7767 type=write size=2693364 2024-09-12T00:36:21.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.946+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=8K97GGVQEHN6 type=write size=86317 2024-09-12T00:36:21.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.949+0000 7f030cb87780 1 < suggested remove operation key=ATTMOL2TGUN7 tag=SYEX9KJ940R4 type=del 2024-09-12T00:36:21.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.952+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~2Z5JY2T61MMC.0 size=1048576 2024-09-12T00:36:21.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.953+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~2Z5JY2T61MMC.1 size=255254 2024-09-12T00:36:21.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.953+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=2Z5JY2T61MMC tag=FJYUOS8H1EC6 type=write size=2352406 2024-09-12T00:36:21.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.955+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~EMYTNQ2FRV82.0 size=1048576 2024-09-12T00:36:21.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.955+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~EMYTNQ2FRV82.1 size=1048576 2024-09-12T00:36:21.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.957+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~EMYTNQ2FRV82.2 size=45659 2024-09-12T00:36:21.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.959+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=EMYTNQ2FRV82 tag=C8I8L0KBDAEE type=write size=3191387 2024-09-12T00:36:21.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.961+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=Z3SP9M2QAN66 type=del size=22316 2024-09-12T00:36:21.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.964+0000 7f030cb87780 1 < suggested remove operation key=6WHZRKLM3OLP tag=7LL3IL19VJ8M type=write 2024-09-12T00:36:21.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.965+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=COXWUITIM0HN type=write size=77673 2024-09-12T00:36:21.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.967+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=Z7IBYDJC3TBO type=del 2024-09-12T00:36:21.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.970+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~RXK9VYA145WQ.0 size=1048576 2024-09-12T00:36:21.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.971+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~RXK9VYA145WQ.1 size=280816 2024-09-12T00:36:21.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.971+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=RXK9VYA145WQ tag=3OCE8K83F2F8 type=write size=2377968 2024-09-12T00:36:21.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.974+0000 7f030cb87780 1 < suggested update operation key=V87B6SDB1HFZ tag=MQ4LE7YKLCU1 type=write size=764487 2024-09-12T00:36:21.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.976+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~Y5AQVWY0OS7Y.0 size=1048576 2024-09-12T00:36:21.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.977+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~Y5AQVWY0OS7Y.1 size=1048576 2024-09-12T00:36:21.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.979+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~Y5AQVWY0OS7Y.2 size=87069 2024-09-12T00:36:21.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.979+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=Y5AQVWY0OS7Y tag=6TR9WJLLRJOO type=write size=3232797 2024-09-12T00:36:21.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.981+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~NYCZUTMO2042.0 size=1048576 2024-09-12T00:36:21.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.982+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~NYCZUTMO2042.1 size=1048576 2024-09-12T00:36:21.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.983+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~NYCZUTMO2042.2 size=10614 2024-09-12T00:36:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.985+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=NYCZUTMO2042 tag=DBQ3MFRELYNF type=write size=3156342 2024-09-12T00:36:21.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.988+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~MBSUX0TOEI9I.0 size=1048576 2024-09-12T00:36:21.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.990+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~MBSUX0TOEI9I.1 size=1048576 2024-09-12T00:36:21.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.991+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~MBSUX0TOEI9I.2 size=905229 2024-09-12T00:36:21.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.991+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=MBSUX0TOEI9I tag=ML02TLICD734 type=write size=4050957 2024-09-12T00:36:21.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.992+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~T63V51PUER2A.0 size=1048576 2024-09-12T00:36:21.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.993+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~T63V51PUER2A.1 size=1048576 2024-09-12T00:36:21.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.994+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~T63V51PUER2A.2 size=128811 2024-09-12T00:36:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:21.996+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=T63V51PUER2A tag=40U6H5QVDYIY type=write size=3274539 2024-09-12T00:36:21.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.000+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~WR2XSEED2VRJ.0 size=676020 2024-09-12T00:36:21.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.000+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=WR2XSEED2VRJ tag=TWB02VVK55MT type=write size=1724596 2024-09-12T00:36:22.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.004+0000 7f030cb87780 1 < suggested update operation key=92GDVW0Q8VKQ tag=IDDYHF875O7Z type=del size=2668627 2024-09-12T00:36:22.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.006+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~I3JY8KHDINA5.0 size=444746 2024-09-12T00:36:22.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.006+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=I3JY8KHDINA5 tag=3BR6H6E2Q2CT type=write size=1493322 2024-09-12T00:36:22.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.010+0000 7f030cb87780 1 < suggested remove operation key=IHTFI7W4A6JT tag=YYNCNGCWV9E3 type=del 2024-09-12T00:36:22.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.012+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~P6PKLZ4A2YKH.0 size=475231 2024-09-12T00:36:22.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.012+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=P6PKLZ4A2YKH tag=5T3D2BK7A0LZ type=write size=1523807 2024-09-12T00:36:22.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.015+0000 7f030cb87780 1 < suggested update operation key=800OHA7UURC4 tag=Z8S5MD3RYDKP type=del size=2509825 2024-09-12T00:36:22.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.016+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=YVCNU0MOGRGD type=del size=778268 2024-09-12T00:36:22.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.018+0000 7f030cb87780 -1 < failed to complete operation key=IHTFI7W4A6JT tag=5TVRQT5TWAH0 type=del size=1170671: (22) Invalid argument 2024-09-12T00:36:22.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.020+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=1WQ1S6CQOPNU type=del size=3367599 2024-09-12T00:36:22.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.021+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=07QEB405R0T6 type=del 2024-09-12T00:36:22.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.023+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=ZX23IQZYR0T6 type=del size=313449 2024-09-12T00:36:22.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.024+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=3TT3976UYS93 type=del 2024-09-12T00:36:22.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.026+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=I3GO3KX7AT0D type=del size=846182 2024-09-12T00:36:22.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.029+0000 7f030cb87780 1 < suggested update operation key=327RDLIWLVRO tag=FNML25Q47LIZ type=write size=1038817 2024-09-12T00:36:22.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.031+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=AY2J1EB5JSW7 type=write size=988867 2024-09-12T00:36:22.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.033+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=EGPX8S6ZDC04 type=del 2024-09-12T00:36:22.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.036+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~FX0BRA7I9G7K.0 size=751566 2024-09-12T00:36:22.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.036+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=FX0BRA7I9G7K tag=6VNCCQ20NSJ5 type=write size=1800142 2024-09-12T00:36:22.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.039+0000 7f030cb87780 1 < suggested remove operation key=1PLGUJCB6J0V tag=8K97GGVQEHN6 type=write 2024-09-12T00:36:22.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.040+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=WWCDY1L0M8YS type=del size=1374610 2024-09-12T00:36:22.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.042+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~2Z5JY2T61MMC.0 size=1048576 2024-09-12T00:36:22.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.043+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~2Z5JY2T61MMC.1 size=255254 2024-09-12T00:36:22.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.046+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=2Z5JY2T61MMC tag=FJYUOS8H1EC6 type=write size=2352406 2024-09-12T00:36:22.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.047+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=WGJYMJQAZPIU type=write size=230845 2024-09-12T00:36:22.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.051+0000 7f030cb87780 1 < suggested remove operation key=JPEIGLC162K3 tag=Z3SP9M2QAN66 type=del 2024-09-12T00:36:22.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.054+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=MEFNJQYMMQF1 type=del size=141011 2024-09-12T00:36:22.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.055+0000 7f030cb87780 1 < completed write operation key=IY156CJWG2TB tag=COXWUITIM0HN type=write size=77673 2024-09-12T00:36:22.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.058+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~K7XJEHSY7NV9.0 size=806804 2024-09-12T00:36:22.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.058+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=K7XJEHSY7NV9 tag=1P5FYI2BUJH1 type=write size=1855380 2024-09-12T00:36:22.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.059+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~RXK9VYA145WQ.0 size=1048576 2024-09-12T00:36:22.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.061+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~RXK9VYA145WQ.1 size=280816 2024-09-12T00:36:22.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.063+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=RXK9VYA145WQ tag=3OCE8K83F2F8 type=write size=2377968 2024-09-12T00:36:22.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.065+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=MQ1IQA1K7MRD type=write size=933970 2024-09-12T00:36:22.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.066+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~Y5AQVWY0OS7Y.0 size=1048576 2024-09-12T00:36:22.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.068+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~Y5AQVWY0OS7Y.1 size=1048576 2024-09-12T00:36:22.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.069+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~Y5AQVWY0OS7Y.2 size=87069 2024-09-12T00:36:22.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.071+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=Y5AQVWY0OS7Y tag=6TR9WJLLRJOO type=write size=3232797 2024-09-12T00:36:22.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.073+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=NVCKPWULXNLP type=del size=2856941 2024-09-12T00:36:22.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.075+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~MBSUX0TOEI9I.0 size=1048576 2024-09-12T00:36:22.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.076+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~MBSUX0TOEI9I.1 size=1048576 2024-09-12T00:36:22.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.077+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~MBSUX0TOEI9I.2 size=905229 2024-09-12T00:36:22.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.080+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=MBSUX0TOEI9I tag=ML02TLICD734 type=write size=4050957 2024-09-12T00:36:22.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.081+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=12CZQ8JHO9B0 type=write size=171971 2024-09-12T00:36:22.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.083+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~WR2XSEED2VRJ.0 size=676020 2024-09-12T00:36:22.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.085+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=WR2XSEED2VRJ tag=TWB02VVK55MT type=write size=1724596 2024-09-12T00:36:22.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.086+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=7OR181A0MMJU type=del size=1971396 2024-09-12T00:36:22.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.088+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~I3JY8KHDINA5.0 size=444746 2024-09-12T00:36:22.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.091+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=I3JY8KHDINA5 tag=3BR6H6E2Q2CT type=write size=1493322 2024-09-12T00:36:22.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.093+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~3J3FGG9VVJJP.0 size=1048576 2024-09-12T00:36:22.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.095+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~3J3FGG9VVJJP.1 size=293776 2024-09-12T00:36:22.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.095+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=3J3FGG9VVJJP tag=HMW2MMMX6K7I type=write size=2390928 2024-09-12T00:36:22.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.096+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~P6PKLZ4A2YKH.0 size=475231 2024-09-12T00:36:22.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.099+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=P6PKLZ4A2YKH tag=5T3D2BK7A0LZ type=write size=1523807 2024-09-12T00:36:22.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.102+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~F3CUGS1MWG0H.0 size=1048576 2024-09-12T00:36:22.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.104+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~F3CUGS1MWG0H.1 size=1048576 2024-09-12T00:36:22.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.104+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~F3CUGS1MWG0H.2 size=952282 2024-09-12T00:36:22.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.104+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=F3CUGS1MWG0H tag=84HMLFG88OMS type=write size=4098010 2024-09-12T00:36:22.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.106+0000 7f030cb87780 1 < canceled operation key=JRPD5AAK84ZD tag=YVCNU0MOGRGD type=del size=778268 2024-09-12T00:36:22.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.109+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=3E7PGTINE91S type=del size=1661921 2024-09-12T00:36:22.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.110+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=1WQ1S6CQOPNU type=del 2024-09-12T00:36:22.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.112+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=8TMV4Z064CS5 type=write size=796539 2024-09-12T00:36:22.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.113+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=ZX23IQZYR0T6 type=del 2024-09-12T00:36:22.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.114+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=DRFY580S7CGA type=del size=3119775 2024-09-12T00:36:22.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.116+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=I3GO3KX7AT0D type=del 2024-09-12T00:36:22.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.120+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~X8X01W2X9OKA.0 size=1048576 2024-09-12T00:36:22.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.121+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~X8X01W2X9OKA.1 size=546704 2024-09-12T00:36:22.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.121+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=X8X01W2X9OKA tag=NHAVCTJNVVFT type=write size=2643856 2024-09-12T00:36:22.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.122+0000 7f030cb87780 1 < completed write operation key=JRPD5AAK84ZD tag=AY2J1EB5JSW7 type=write size=988867 2024-09-12T00:36:22.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.123+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=AGESK9S63JA4 type=write size=608527 2024-09-12T00:36:22.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.125+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~FX0BRA7I9G7K.0 size=751566 2024-09-12T00:36:22.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.127+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=FX0BRA7I9G7K tag=6VNCCQ20NSJ5 type=write size=1800142 2024-09-12T00:36:22.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.128+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=JALAFV1RQ708 type=write size=902038 2024-09-12T00:36:22.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.130+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=WWCDY1L0M8YS type=del 2024-09-12T00:36:22.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.132+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=OZRNJHNA35M5 type=del size=3700296 2024-09-12T00:36:22.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.134+0000 7f030cb87780 1 < completed write operation key=327RDLIWLVRO tag=WGJYMJQAZPIU type=write size=230845 2024-09-12T00:36:22.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.137+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~06XU4B0M0HSR.0 size=6731 2024-09-12T00:36:22.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.137+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=06XU4B0M0HSR tag=C6IH0IKZEVI1 type=write size=1055307 2024-09-12T00:36:22.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.137+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=MEFNJQYMMQF1 type=del 2024-09-12T00:36:22.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.140+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~NHSQSQERY5AR.0 size=260851 2024-09-12T00:36:22.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.140+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=NHSQSQERY5AR tag=XLL7NCQAYNQ5 type=write size=1309427 2024-09-12T00:36:22.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.142+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~K7XJEHSY7NV9.0 size=806804 2024-09-12T00:36:22.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.144+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=K7XJEHSY7NV9 tag=1P5FYI2BUJH1 type=write size=1855380 2024-09-12T00:36:22.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.147+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~35HJL09S1XPD.0 size=1048576 2024-09-12T00:36:22.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.148+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~35HJL09S1XPD.1 size=769094 2024-09-12T00:36:22.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.148+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=35HJL09S1XPD tag=JGT60WPTSE9S type=write size=2866246 2024-09-12T00:36:22.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.150+0000 7f030cb87780 1 < completed write operation key=ZQD0491BHJPM tag=MQ1IQA1K7MRD type=write size=933970 2024-09-12T00:36:22.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.151+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=YOWY7KE2NE2P type=del size=2646961 2024-09-12T00:36:22.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.153+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=NVCKPWULXNLP type=del 2024-09-12T00:36:22.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.154+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=HTCWSRR15RXM type=write size=380336 2024-09-12T00:36:22.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.156+0000 7f030cb87780 1 < canceled operation key=N3KD1UVUVM95 tag=12CZQ8JHO9B0 type=write size=171971 2024-09-12T00:36:22.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.158+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~WWDBGBCUNDI7.0 size=1048576 2024-09-12T00:36:22.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.159+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~WWDBGBCUNDI7.1 size=117925 2024-09-12T00:36:22.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.159+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=WWDBGBCUNDI7 tag=3H4SN28S12VH type=write size=2215077 2024-09-12T00:36:22.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.161+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=7OR181A0MMJU type=del 2024-09-12T00:36:22.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.162+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=9TZKX4M3IWXF type=del size=2747482 2024-09-12T00:36:22.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.164+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~3J3FGG9VVJJP.0 size=1048576 2024-09-12T00:36:22.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.166+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~3J3FGG9VVJJP.1 size=293776 2024-09-12T00:36:22.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.169+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=3J3FGG9VVJJP tag=HMW2MMMX6K7I type=write size=2390928 2024-09-12T00:36:22.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.169+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=C0DE7QHWI3XZ type=del size=498090 2024-09-12T00:36:22.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.171+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~F3CUGS1MWG0H.0 size=1048576 2024-09-12T00:36:22.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.172+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~F3CUGS1MWG0H.1 size=1048576 2024-09-12T00:36:22.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.173+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~F3CUGS1MWG0H.2 size=952282 2024-09-12T00:36:22.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.175+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=F3CUGS1MWG0H tag=84HMLFG88OMS type=write size=4098010 2024-09-12T00:36:22.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.177+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=3GD0FTVE4NFY type=del size=104939 2024-09-12T00:36:22.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.178+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=3E7PGTINE91S type=del 2024-09-12T00:36:22.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.181+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~0DQIY7RTMK79.0 size=828416 2024-09-12T00:36:22.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.181+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=0DQIY7RTMK79 tag=G2NU2CK8FGZT type=write size=1876992 2024-09-12T00:36:22.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.182+0000 7f030cb87780 1 < completed write operation key=800OHA7UURC4 tag=8TMV4Z064CS5 type=write size=796539 2024-09-12T00:36:22.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.184+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=5SIOCDZJ7GRW type=del size=351994 2024-09-12T00:36:22.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.185+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=DRFY580S7CGA type=del 2024-09-12T00:36:22.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.187+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~KQFCG2SITBGF.0 size=1048576 2024-09-12T00:36:22.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.189+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~KQFCG2SITBGF.1 size=585571 2024-09-12T00:36:22.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.189+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=KQFCG2SITBGF tag=4ST9M51B9YMM type=write size=2682723 2024-09-12T00:36:22.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.191+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~X8X01W2X9OKA.0 size=1048576 2024-09-12T00:36:22.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.192+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~X8X01W2X9OKA.1 size=546704 2024-09-12T00:36:22.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.195+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=X8X01W2X9OKA tag=NHAVCTJNVVFT type=write size=2643856 2024-09-12T00:36:22.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.197+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~4H7EAWBZZOGY.0 size=1048576 2024-09-12T00:36:22.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.198+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~4H7EAWBZZOGY.1 size=454066 2024-09-12T00:36:22.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.198+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=4H7EAWBZZOGY tag=23GOFW789ZJT type=write size=2551218 2024-09-12T00:36:22.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.200+0000 7f030cb87780 1 < canceled operation key=HUDEU16YTO0Y tag=AGESK9S63JA4 type=write size=608527 2024-09-12T00:36:22.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.201+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=CUGFWXN4WVY0 type=del size=3488331 2024-09-12T00:36:22.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.203+0000 7f030cb87780 1 < completed write operation key=6WHZRKLM3OLP tag=JALAFV1RQ708 type=write size=902038 2024-09-12T00:36:22.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.206+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~MD93FS1UZV0P.0 size=1048576 2024-09-12T00:36:22.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.207+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~MD93FS1UZV0P.1 size=578449 2024-09-12T00:36:22.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.207+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=MD93FS1UZV0P tag=UZOO2XF9P0PM type=write size=2675601 2024-09-12T00:36:22.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.208+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=OZRNJHNA35M5 type=del 2024-09-12T00:36:22.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.210+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=QD2DW92BELMF type=del size=1345454 2024-09-12T00:36:22.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.212+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~06XU4B0M0HSR.0 size=6731 2024-09-12T00:36:22.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.214+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=06XU4B0M0HSR tag=C6IH0IKZEVI1 type=write size=1055307 2024-09-12T00:36:22.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.217+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~MPD231JPUHP5.0 size=95937 2024-09-12T00:36:22.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.217+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=MPD231JPUHP5 tag=J8UIUOTO6YIK type=write size=1144513 2024-09-12T00:36:22.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.218+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~NHSQSQERY5AR.0 size=260851 2024-09-12T00:36:22.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.221+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=NHSQSQERY5AR tag=XLL7NCQAYNQ5 type=write size=1309427 2024-09-12T00:36:22.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.222+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=959RQZDH0TEG type=write size=863879 2024-09-12T00:36:22.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.223+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~35HJL09S1XPD.0 size=1048576 2024-09-12T00:36:22.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.223+0000 7f030cb87780 1 < canceled part key=_multipart_IHTFI7W4A6JT.2~35HJL09S1XPD.1 size=769094 2024-09-12T00:36:22.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.226+0000 7f030cb87780 1 < canceled multipart upload key=IHTFI7W4A6JT upload=35HJL09S1XPD tag=JGT60WPTSE9S type=write size=2866246 2024-09-12T00:36:22.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.228+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~BL3ZXX3RHIQO.0 size=1048576 2024-09-12T00:36:22.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.229+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~BL3ZXX3RHIQO.1 size=1048576 2024-09-12T00:36:22.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.230+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~BL3ZXX3RHIQO.2 size=178158 2024-09-12T00:36:22.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.230+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=BL3ZXX3RHIQO tag=41YZNUWZ3XGJ type=write size=3323886 2024-09-12T00:36:22.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.233+0000 7f030cb87780 1 < suggested update operation key=CY2NS03IIUJJ tag=YOWY7KE2NE2P type=del size=2646961 2024-09-12T00:36:22.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.234+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=YTZ608BFJHRY type=del size=506931 2024-09-12T00:36:22.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.236+0000 7f030cb87780 1 < completed write operation key=92GDVW0Q8VKQ tag=HTCWSRR15RXM type=write size=380336 2024-09-12T00:36:22.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.237+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=M9QYWOGHUNID type=write size=181292 2024-09-12T00:36:22.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.237+0000 7f030cb87780 1 < canceled part key=_multipart_9MCRD2G3MZIT.2~WWDBGBCUNDI7.0 size=1048576 2024-09-12T00:36:22.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.238+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~WWDBGBCUNDI7.1 size=117925 2024-09-12T00:36:22.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.241+0000 7f030cb87780 1 < canceled multipart upload key=9MCRD2G3MZIT upload=WWDBGBCUNDI7 tag=3H4SN28S12VH type=write size=2215077 2024-09-12T00:36:22.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.244+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~XOGE5IXYWD6I.0 size=471794 2024-09-12T00:36:22.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.244+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=XOGE5IXYWD6I tag=5CW6GTHNPMGD type=write size=1520370 2024-09-12T00:36:22.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.245+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=9TZKX4M3IWXF type=del 2024-09-12T00:36:22.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.247+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=RI6JU0VKVEH4 type=del size=2258397 2024-09-12T00:36:22.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.249+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=C0DE7QHWI3XZ type=del 2024-09-12T00:36:22.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.250+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=JBPEJ2Q5V7SP type=del size=819440 2024-09-12T00:36:22.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.254+0000 7f030cb87780 1 < suggested update operation key=800OHA7UURC4 tag=3GD0FTVE4NFY type=del size=104939 2024-09-12T00:36:22.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.254+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=GYQ6GL2CJNFB type=del size=3481756 2024-09-12T00:36:22.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.256+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~0DQIY7RTMK79.0 size=828416 2024-09-12T00:36:22.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.259+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=0DQIY7RTMK79 tag=G2NU2CK8FGZT type=write size=1876992 2024-09-12T00:36:22.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.262+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~R3KRQO40F662.0 size=363444 2024-09-12T00:36:22.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.262+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=R3KRQO40F662 tag=P6AXCVI662ZA type=write size=1412020 2024-09-12T00:36:22.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.262+0000 7f030cb87780 1 < canceled operation key=DLR6A7XOERHW tag=5SIOCDZJ7GRW type=del size=351994 2024-09-12T00:36:22.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.266+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~YKO8VE4DGIQY.0 size=118708 2024-09-12T00:36:22.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.266+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=YKO8VE4DGIQY tag=170KYE0PVKD1 type=write size=1167284 2024-09-12T00:36:22.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.266+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~KQFCG2SITBGF.0 size=1048576 2024-09-12T00:36:22.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.268+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~KQFCG2SITBGF.1 size=585571 2024-09-12T00:36:22.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.270+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=KQFCG2SITBGF tag=4ST9M51B9YMM type=write size=2682723 2024-09-12T00:36:22.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.272+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=EJQNXJ7HP30V type=del size=2122630 2024-09-12T00:36:22.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.273+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~4H7EAWBZZOGY.0 size=1048576 2024-09-12T00:36:22.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.276+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~4H7EAWBZZOGY.1 size=454066 2024-09-12T00:36:22.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.278+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=4H7EAWBZZOGY tag=23GOFW789ZJT type=write size=2551218 2024-09-12T00:36:22.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.279+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=YU83LXGQVCV7 type=del size=2236581 2024-09-12T00:36:22.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.281+0000 7f030cb87780 -1 < failed to complete operation key=CY2NS03IIUJJ tag=CUGFWXN4WVY0 type=del size=3488331: (22) Invalid argument 2024-09-12T00:36:22.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.283+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~5J8K5NB577VB.0 size=1048576 2024-09-12T00:36:22.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.284+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~5J8K5NB577VB.1 size=513770 2024-09-12T00:36:22.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.284+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=5J8K5NB577VB tag=RUHRSYSGNLDW type=write size=2610922 2024-09-12T00:36:22.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.286+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~MD93FS1UZV0P.0 size=1048576 2024-09-12T00:36:22.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.287+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~MD93FS1UZV0P.1 size=578449 2024-09-12T00:36:22.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.290+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=MD93FS1UZV0P tag=UZOO2XF9P0PM type=write size=2675601 2024-09-12T00:36:22.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.292+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=3ZKTNOS1FMQG type=del size=3014739 2024-09-12T00:36:22.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.293+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=QD2DW92BELMF type=del 2024-09-12T00:36:22.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.295+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~PFTUNW6SHJHG.0 size=1048576 2024-09-12T00:36:22.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.296+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~PFTUNW6SHJHG.1 size=269857 2024-09-12T00:36:22.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.296+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=PFTUNW6SHJHG tag=3WQH1Y12E030 type=write size=2367009 2024-09-12T00:36:22.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.297+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~MPD231JPUHP5.0 size=95937 2024-09-12T00:36:22.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.300+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=MPD231JPUHP5 tag=J8UIUOTO6YIK type=write size=1144513 2024-09-12T00:36:22.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.302+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=4329NS6RBNVQ type=del size=1264634 2024-09-12T00:36:22.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.303+0000 7f030cb87780 1 < completed write operation key=DLR6A7XOERHW tag=959RQZDH0TEG type=write size=863879 2024-09-12T00:36:22.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.304+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=J884JVIX5K35 type=del size=62685 2024-09-12T00:36:22.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.306+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~BL3ZXX3RHIQO.0 size=1048576 2024-09-12T00:36:22.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.307+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~BL3ZXX3RHIQO.1 size=1048576 2024-09-12T00:36:22.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.309+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~BL3ZXX3RHIQO.2 size=178158 2024-09-12T00:36:22.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.311+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=BL3ZXX3RHIQO tag=41YZNUWZ3XGJ type=write size=3323886 2024-09-12T00:36:22.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.313+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=F4UJWQTEJD11 type=del size=3633594 2024-09-12T00:36:22.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.314+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=YTZ608BFJHRY type=del 2024-09-12T00:36:22.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.316+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=TD6G2GI9S3CV type=del size=3799901 2024-09-12T00:36:22.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.318+0000 7f030cb87780 1 < completed write operation key=IY156CJWG2TB tag=M9QYWOGHUNID type=write size=181292 2024-09-12T00:36:22.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.319+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=GD10LZIYK3Q3 type=del size=3908310 2024-09-12T00:36:22.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.321+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~XOGE5IXYWD6I.0 size=471794 2024-09-12T00:36:22.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.323+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=XOGE5IXYWD6I tag=5CW6GTHNPMGD type=write size=1520370 2024-09-12T00:36:22.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.324+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=JA5CFAY3F9PH type=del size=3198441 2024-09-12T00:36:22.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.325+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=RI6JU0VKVEH4 type=del 2024-09-12T00:36:22.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.327+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=EDH4YU6UQJI3 type=write size=705136 2024-09-12T00:36:22.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.328+0000 7f030cb87780 1 < canceled operation key=ATTMOL2TGUN7 tag=JBPEJ2Q5V7SP type=del size=819440 2024-09-12T00:36:22.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.331+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=AVF904NYLTZC type=del size=915663 2024-09-12T00:36:22.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.332+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=GYQ6GL2CJNFB type=del 2024-09-12T00:36:22.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.335+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~1H5K5F34LKXR.0 size=1048576 2024-09-12T00:36:22.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.337+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~1H5K5F34LKXR.1 size=1048576 2024-09-12T00:36:22.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.338+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~1H5K5F34LKXR.2 size=565640 2024-09-12T00:36:22.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.338+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=1H5K5F34LKXR tag=U1ENZNKEKZHI type=write size=3711368 2024-09-12T00:36:22.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.339+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~R3KRQO40F662.0 size=363444 2024-09-12T00:36:22.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.341+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=R3KRQO40F662 tag=P6AXCVI662ZA type=write size=1412020 2024-09-12T00:36:22.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.342+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=K4FGXRIPQYNY type=del size=3404796 2024-09-12T00:36:22.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.344+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~YKO8VE4DGIQY.0 size=118708 2024-09-12T00:36:22.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.346+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=YKO8VE4DGIQY tag=170KYE0PVKD1 type=write size=1167284 2024-09-12T00:36:22.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.349+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~TH7X1YPYPG1Y.0 size=648814 2024-09-12T00:36:22.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.349+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=TH7X1YPYPG1Y tag=VCJPDOV73E2J type=write size=1697390 2024-09-12T00:36:22.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.350+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=EJQNXJ7HP30V type=del 2024-09-12T00:36:22.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.352+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~6U3GLJ0SVMC9.0 size=35477 2024-09-12T00:36:22.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.352+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=6U3GLJ0SVMC9 tag=N2QALL6KK6HN type=write size=1084053 2024-09-12T00:36:22.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.354+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=YU83LXGQVCV7 type=del 2024-09-12T00:36:22.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.355+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=CGK7OQ4T70Z7 type=del size=2796498 2024-09-12T00:36:22.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.357+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~5J8K5NB577VB.0 size=1048576 2024-09-12T00:36:22.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.358+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~5J8K5NB577VB.1 size=513770 2024-09-12T00:36:22.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.362+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=5J8K5NB577VB tag=RUHRSYSGNLDW type=write size=2610922 2024-09-12T00:36:22.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.363+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=G1XJQ0BNZOXQ type=del size=1790163 2024-09-12T00:36:22.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.364+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=3ZKTNOS1FMQG type=del 2024-09-12T00:36:22.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.365+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=V8FHEW8GJISA type=del size=4051821 2024-09-12T00:36:22.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.367+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~PFTUNW6SHJHG.0 size=1048576 2024-09-12T00:36:22.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.368+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~PFTUNW6SHJHG.1 size=269857 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.370+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=PFTUNW6SHJHG tag=3WQH1Y12E030 type=write size=2367009 2024-09-12T00:36:22.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.373+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~W5JSCIF5USH5.0 size=746481 2024-09-12T00:36:22.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.373+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=W5JSCIF5USH5 tag=BXF3BXFNFHKG type=write size=1795057 2024-09-12T00:36:22.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.374+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=4329NS6RBNVQ type=del 2024-09-12T00:36:22.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.376+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=12P36XSESRG9 type=del size=1532729 2024-09-12T00:36:22.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.377+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=J884JVIX5K35 type=del 2024-09-12T00:36:22.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.378+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=S9NA9BL1RIZJ type=del size=3959694 2024-09-12T00:36:22.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.381+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=F4UJWQTEJD11 type=del 2024-09-12T00:36:22.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.381+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=OPQ9U4B68F75 type=del size=1920551 2024-09-12T00:36:22.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.383+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=TD6G2GI9S3CV type=del 2024-09-12T00:36:22.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.385+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=JU35OSANVQL1 type=del size=3259763 2024-09-12T00:36:22.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.386+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=GD10LZIYK3Q3 type=del 2024-09-12T00:36:22.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.388+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=QAD9BRNLRK7Z type=del size=3051 2024-09-12T00:36:22.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.390+0000 7f030cb87780 1 < suggested update operation key=V87B6SDB1HFZ tag=JA5CFAY3F9PH type=del size=3198441 2024-09-12T00:36:22.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.394+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~IU543U2CYGGO.0 size=1048576 2024-09-12T00:36:22.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.394+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~IU543U2CYGGO.1 size=74361 2024-09-12T00:36:22.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.394+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=IU543U2CYGGO tag=EC96SH7MXLUI type=write size=2171513 2024-09-12T00:36:22.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.396+0000 7f030cb87780 1 < completed write operation key=CUDFTXFBC862 tag=EDH4YU6UQJI3 type=write size=705136 2024-09-12T00:36:22.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.397+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=DY5ICIO2VPRV type=write size=217762 2024-09-12T00:36:22.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.399+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=AVF904NYLTZC type=del 2024-09-12T00:36:22.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.400+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=XI2ACULLQIXC type=del size=2644786 2024-09-12T00:36:22.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.402+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~1H5K5F34LKXR.0 size=1048576 2024-09-12T00:36:22.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.403+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~1H5K5F34LKXR.1 size=1048576 2024-09-12T00:36:22.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.403+0000 7f030cb87780 1 < canceled part key=_multipart_56I20YIPY82N.2~1H5K5F34LKXR.2 size=565640 2024-09-12T00:36:22.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.405+0000 7f030cb87780 1 < canceled multipart upload key=56I20YIPY82N upload=1H5K5F34LKXR tag=U1ENZNKEKZHI type=write size=3711368 2024-09-12T00:36:22.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.407+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=0KW1G2BNHLXB type=del size=2104632 2024-09-12T00:36:22.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.408+0000 7f030cb87780 1 < canceled operation key=CUDFTXFBC862 tag=K4FGXRIPQYNY type=del size=3404796 2024-09-12T00:36:22.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.412+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~GGQC1SDFVN1K.0 size=1048576 2024-09-12T00:36:22.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.412+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~GGQC1SDFVN1K.1 size=274339 2024-09-12T00:36:22.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.412+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=GGQC1SDFVN1K tag=8OQVPCI6AY90 type=write size=2371491 2024-09-12T00:36:22.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.413+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~TH7X1YPYPG1Y.0 size=648814 2024-09-12T00:36:22.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.416+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=TH7X1YPYPG1Y tag=VCJPDOV73E2J type=write size=1697390 2024-09-12T00:36:22.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.417+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=4T8GZUFQFR9P type=del size=2394376 2024-09-12T00:36:22.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.420+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~6U3GLJ0SVMC9.0 size=35477 2024-09-12T00:36:22.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.421+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=6U3GLJ0SVMC9 tag=N2QALL6KK6HN type=write size=1084053 2024-09-12T00:36:22.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.423+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~ACWSLVCQ4U7X.0 size=956736 2024-09-12T00:36:22.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.423+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=ACWSLVCQ4U7X tag=BJ9BRP0XSOBG type=write size=2005312 2024-09-12T00:36:22.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.425+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=CGK7OQ4T70Z7 type=del 2024-09-12T00:36:22.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.426+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=GFIDI87K37WX type=del size=3595535 2024-09-12T00:36:22.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.428+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=G1XJQ0BNZOXQ type=del 2024-09-12T00:36:22.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.430+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~51SFJJZ3VFLW.0 size=1048576 2024-09-12T00:36:22.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.431+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~51SFJJZ3VFLW.1 size=1048576 2024-09-12T00:36:22.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.433+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~51SFJJZ3VFLW.2 size=943950 2024-09-12T00:36:22.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.433+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=51SFJJZ3VFLW tag=HFD9IUPVGVQT type=write size=4089678 2024-09-12T00:36:22.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.434+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=V8FHEW8GJISA type=del 2024-09-12T00:36:22.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.436+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~0WVZW4I9LGRK.0 size=1048576 2024-09-12T00:36:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.437+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~0WVZW4I9LGRK.1 size=557984 2024-09-12T00:36:22.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.437+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=0WVZW4I9LGRK tag=01QII1C45HH6 type=write size=2655136 2024-09-12T00:36:22.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.439+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~W5JSCIF5USH5.0 size=746481 2024-09-12T00:36:22.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.441+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=W5JSCIF5USH5 tag=BXF3BXFNFHKG type=write size=1795057 2024-09-12T00:36:22.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.442+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=31ULBOVFKKWO type=del size=986608 2024-09-12T00:36:22.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.444+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=12P36XSESRG9 type=del 2024-09-12T00:36:22.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.445+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=ZG51ZYWIMMFH type=del size=3894080 2024-09-12T00:36:22.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.447+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=S9NA9BL1RIZJ type=del 2024-09-12T00:36:22.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.448+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=72R02GK1U8MI type=del size=2731602 2024-09-12T00:36:22.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.449+0000 7f030cb87780 -1 < failed to complete operation key=V87B6SDB1HFZ tag=OPQ9U4B68F75 type=del size=1920551: (22) Invalid argument 2024-09-12T00:36:22.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.451+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=1ONQRD2I92YW type=del size=2754369 2024-09-12T00:36:22.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.453+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=JU35OSANVQL1 type=del 2024-09-12T00:36:22.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.454+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=Z64OLDJ6930V type=del size=1878812 2024-09-12T00:36:22.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.455+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=QAD9BRNLRK7Z type=del 2024-09-12T00:36:22.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.458+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~4QIALGPOUBQ2.0 size=1048576 2024-09-12T00:36:22.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.459+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~4QIALGPOUBQ2.1 size=1048576 2024-09-12T00:36:22.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.461+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~4QIALGPOUBQ2.2 size=959656 2024-09-12T00:36:22.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.461+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=4QIALGPOUBQ2 tag=OR5KBAVNRCKL type=write size=4105384 2024-09-12T00:36:22.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.462+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~IU543U2CYGGO.0 size=1048576 2024-09-12T00:36:22.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.464+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~IU543U2CYGGO.1 size=74361 2024-09-12T00:36:22.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.467+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=IU543U2CYGGO tag=EC96SH7MXLUI type=write size=2171513 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.467+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=NSFKWG2SJR3G type=write size=369150 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.470+0000 7f030cb87780 1 < completed write operation key=U5CWO1EN8BFI tag=DY5ICIO2VPRV type=write size=217762 2024-09-12T00:36:22.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.470+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=7EP8Z315I29B type=del size=2959728 2024-09-12T00:36:22.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.472+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=XI2ACULLQIXC type=del 2024-09-12T00:36:22.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.473+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=3X8V4II4ANJI type=del size=3321000 2024-09-12T00:36:22.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.475+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=0KW1G2BNHLXB type=del 2024-09-12T00:36:22.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.477+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~1WQH56674XTI.0 size=1048576 2024-09-12T00:36:22.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.478+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~1WQH56674XTI.1 size=514090 2024-09-12T00:36:22.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.478+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=1WQH56674XTI tag=RN6N8428H6RB type=write size=2611242 2024-09-12T00:36:22.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.478+0000 7f030cb87780 1 < canceled part key=_multipart_JRPD5AAK84ZD.2~GGQC1SDFVN1K.0 size=1048576 2024-09-12T00:36:22.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.479+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~GGQC1SDFVN1K.1 size=274339 2024-09-12T00:36:22.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.482+0000 7f030cb87780 1 < canceled multipart upload key=JRPD5AAK84ZD upload=GGQC1SDFVN1K tag=8OQVPCI6AY90 type=write size=2371491 2024-09-12T00:36:22.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.483+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=TRWQ2WK802V3 type=del size=1246237 2024-09-12T00:36:22.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.484+0000 7f030cb87780 1 < canceled operation key=99OWKRGA8ZZN tag=4T8GZUFQFR9P type=del size=2394376 2024-09-12T00:36:22.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.486+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=A2LP7EK72BW2 type=del size=2077947 2024-09-12T00:36:22.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.487+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~ACWSLVCQ4U7X.0 size=956736 2024-09-12T00:36:22.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.489+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=ACWSLVCQ4U7X tag=BJ9BRP0XSOBG type=write size=2005312 2024-09-12T00:36:22.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.491+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=59OTVZCG2APA type=del size=2955751 2024-09-12T00:36:22.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.492+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=GFIDI87K37WX type=del 2024-09-12T00:36:22.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.494+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=1GIIES81YDPY type=del size=3628283 2024-09-12T00:36:22.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.495+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~51SFJJZ3VFLW.0 size=1048576 2024-09-12T00:36:22.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.496+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~51SFJJZ3VFLW.1 size=1048576 2024-09-12T00:36:22.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.497+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~51SFJJZ3VFLW.2 size=943950 2024-09-12T00:36:22.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.500+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=51SFJJZ3VFLW tag=HFD9IUPVGVQT type=write size=4089678 2024-09-12T00:36:22.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.501+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=01H6ZXG3M0KA type=write size=804096 2024-09-12T00:36:22.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.503+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~0WVZW4I9LGRK.0 size=1048576 2024-09-12T00:36:22.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.503+0000 7f030cb87780 1 < canceled part key=_multipart_JPEIGLC162K3.2~0WVZW4I9LGRK.1 size=557984 2024-09-12T00:36:22.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.506+0000 7f030cb87780 1 < canceled multipart upload key=JPEIGLC162K3 upload=0WVZW4I9LGRK tag=01QII1C45HH6 type=write size=2655136 2024-09-12T00:36:22.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.508+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~I0AP5UYLEAXQ.0 size=1048576 2024-09-12T00:36:22.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.510+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~I0AP5UYLEAXQ.1 size=657698 2024-09-12T00:36:22.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.510+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=I0AP5UYLEAXQ tag=OOM9386LEMJB type=write size=2754850 2024-09-12T00:36:22.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.510+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=31ULBOVFKKWO type=del 2024-09-12T00:36:22.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.512+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=915ETC8AOEPR type=del size=3586333 2024-09-12T00:36:22.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.513+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=ZG51ZYWIMMFH type=del 2024-09-12T00:36:22.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.516+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~5XUX60UW42A4.0 size=1048576 2024-09-12T00:36:22.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.517+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~5XUX60UW42A4.1 size=1048576 2024-09-12T00:36:22.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.518+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~5XUX60UW42A4.2 size=895444 2024-09-12T00:36:22.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.518+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=5XUX60UW42A4 tag=XF62N1KPZN0Q type=write size=4041172 2024-09-12T00:36:22.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.519+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=72R02GK1U8MI type=del 2024-09-12T00:36:22.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.522+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=MLR6ZWHUPZK9 type=del size=924738 2024-09-12T00:36:22.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.525+0000 7f030cb87780 1 < suggested remove operation key=UFYMVGL264T8 tag=1ONQRD2I92YW type=del 2024-09-12T00:36:22.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.526+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=8BDZ92W7TBE8 type=del size=3619992 2024-09-12T00:36:22.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.527+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=Z64OLDJ6930V type=del 2024-09-12T00:36:22.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.529+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=V36I9FW0ZUIL type=del size=268498 2024-09-12T00:36:22.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.530+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~4QIALGPOUBQ2.0 size=1048576 2024-09-12T00:36:22.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.531+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~4QIALGPOUBQ2.1 size=1048576 2024-09-12T00:36:22.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.533+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~4QIALGPOUBQ2.2 size=959656 2024-09-12T00:36:22.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.535+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=4QIALGPOUBQ2 tag=OR5KBAVNRCKL type=write size=4105384 2024-09-12T00:36:22.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.537+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~ROC23EOT19GP.0 size=504707 2024-09-12T00:36:22.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.537+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=ROC23EOT19GP tag=8888B2DXAF4O type=write size=1553283 2024-09-12T00:36:22.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.539+0000 7f030cb87780 1 < canceled operation key=V87B6SDB1HFZ tag=NSFKWG2SJR3G type=write size=369150 2024-09-12T00:36:22.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.542+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~2YKGD3W3PAU5.0 size=1048576 2024-09-12T00:36:22.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.543+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~2YKGD3W3PAU5.1 size=176904 2024-09-12T00:36:22.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.543+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=2YKGD3W3PAU5 tag=1D0GFLZIOY96 type=write size=2274056 2024-09-12T00:36:22.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.544+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=7EP8Z315I29B type=del 2024-09-12T00:36:22.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.546+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=O2Y6H982F212 type=write size=380692 2024-09-12T00:36:22.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.548+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=3X8V4II4ANJI type=del 2024-09-12T00:36:22.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.549+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=XQMD1PC8XR3X type=del size=3139224 2024-09-12T00:36:22.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.550+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~1WQH56674XTI.0 size=1048576 2024-09-12T00:36:22.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.552+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~1WQH56674XTI.1 size=514090 2024-09-12T00:36:22.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.554+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=1WQH56674XTI tag=RN6N8428H6RB type=write size=2611242 2024-09-12T00:36:22.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.556+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~YLZHPM0YRTR1.0 size=495957 2024-09-12T00:36:22.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.556+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=YLZHPM0YRTR1 tag=VP2074W1XXPR type=write size=1544533 2024-09-12T00:36:22.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.558+0000 7f030cb87780 1 < canceled operation key=CUDFTXFBC862 tag=TRWQ2WK802V3 type=del size=1246237 2024-09-12T00:36:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.559+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=5J3IBG7DGN2C type=write size=836776 2024-09-12T00:36:22.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.561+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=A2LP7EK72BW2 type=del 2024-09-12T00:36:22.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.562+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=X6AE4UP5R1RI type=del size=1169591 2024-09-12T00:36:22.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.564+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=59OTVZCG2APA type=del 2024-09-12T00:36:22.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.565+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=G70A7YROFIPP type=del size=3945926 2024-09-12T00:36:22.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.566+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=1GIIES81YDPY type=del 2024-09-12T00:36:22.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.569+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~Q0A389EEQIML.0 size=1048576 2024-09-12T00:36:22.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.570+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~Q0A389EEQIML.1 size=599158 2024-09-12T00:36:22.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.570+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=Q0A389EEQIML tag=2HOYI8J3C5H3 type=write size=2696310 2024-09-12T00:36:22.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.572+0000 7f030cb87780 1 < suggested remove operation key=POC8YA58U55N tag=01H6ZXG3M0KA type=write 2024-09-12T00:36:22.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.575+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~XQUMUTKISKPT.0 size=1048576 2024-09-12T00:36:22.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.575+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~XQUMUTKISKPT.1 size=1048576 2024-09-12T00:36:22.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.576+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~XQUMUTKISKPT.2 size=779151 2024-09-12T00:36:22.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.576+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=XQUMUTKISKPT tag=3D6HEHVU2M92 type=write size=3924879 2024-09-12T00:36:22.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.578+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~I0AP5UYLEAXQ.0 size=1048576 2024-09-12T00:36:22.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.579+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~I0AP5UYLEAXQ.1 size=657698 2024-09-12T00:36:22.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.581+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=I0AP5UYLEAXQ tag=OOM9386LEMJB type=write size=2754850 2024-09-12T00:36:22.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.583+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~X6YYK216LO2S.0 size=1023127 2024-09-12T00:36:22.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.583+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=X6YYK216LO2S tag=D2UD2G4GMO0V type=write size=2071703 2024-09-12T00:36:22.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.585+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=915ETC8AOEPR type=del 2024-09-12T00:36:22.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.587+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~BBGUOXY9VHP9.0 size=458389 2024-09-12T00:36:22.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.587+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=BBGUOXY9VHP9 tag=OWB7WC0BU27V type=write size=1506965 2024-09-12T00:36:22.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.589+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~5XUX60UW42A4.0 size=1048576 2024-09-12T00:36:22.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.590+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~5XUX60UW42A4.1 size=1048576 2024-09-12T00:36:22.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.591+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~5XUX60UW42A4.2 size=895444 2024-09-12T00:36:22.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.593+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=5XUX60UW42A4 tag=XF62N1KPZN0Q type=write size=4041172 2024-09-12T00:36:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.596+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~QZN9FIS0630Q.0 size=13415 2024-09-12T00:36:22.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.596+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=QZN9FIS0630Q tag=7AW5QVLLNI4X type=write size=1061991 2024-09-12T00:36:22.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.599+0000 7f030cb87780 1 < suggested update operation key=V0OLIRP3KH40 tag=MLR6ZWHUPZK9 type=del size=924738 2024-09-12T00:36:22.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.600+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=CWX3RACTGG8F type=del size=362259 2024-09-12T00:36:22.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.601+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=8BDZ92W7TBE8 type=del 2024-09-12T00:36:22.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.604+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~9Q9HJ5NLYUSX.0 size=1048576 2024-09-12T00:36:22.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.605+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~9Q9HJ5NLYUSX.1 size=539176 2024-09-12T00:36:22.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.605+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=9Q9HJ5NLYUSX tag=FYJ8NQO23LM9 type=write size=2636328 2024-09-12T00:36:22.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.606+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=V36I9FW0ZUIL type=del 2024-09-12T00:36:22.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.607+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=LIU46KQAKHF3 type=del size=1247755 2024-09-12T00:36:22.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.609+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~ROC23EOT19GP.0 size=504707 2024-09-12T00:36:22.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.611+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=ROC23EOT19GP tag=8888B2DXAF4O type=write size=1553283 2024-09-12T00:36:22.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.613+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~QJQNSXYI6JKC.0 size=1048576 2024-09-12T00:36:22.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.614+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~QJQNSXYI6JKC.1 size=1048576 2024-09-12T00:36:22.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.616+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~QJQNSXYI6JKC.2 size=312471 2024-09-12T00:36:22.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.616+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=QJQNSXYI6JKC tag=DRHSB1PZOG68 type=write size=3458199 2024-09-12T00:36:22.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.617+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~2YKGD3W3PAU5.0 size=1048576 2024-09-12T00:36:22.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.618+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~2YKGD3W3PAU5.1 size=176904 2024-09-12T00:36:22.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.620+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=2YKGD3W3PAU5 tag=1D0GFLZIOY96 type=write size=2274056 2024-09-12T00:36:22.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.622+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=JY4BFJHPXZ87 type=del size=2480608 2024-09-12T00:36:22.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.623+0000 7f030cb87780 1 < completed write operation key=CUDFTXFBC862 tag=O2Y6H982F212 type=write size=380692 2024-09-12T00:36:22.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.626+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~D2OXQNUNB56Q.0 size=1048576 2024-09-12T00:36:22.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.627+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~D2OXQNUNB56Q.1 size=1048576 2024-09-12T00:36:22.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.628+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~D2OXQNUNB56Q.2 size=851155 2024-09-12T00:36:22.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.628+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=D2OXQNUNB56Q tag=M7R8KEHRKWB9 type=write size=3996883 2024-09-12T00:36:22.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.630+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=XQMD1PC8XR3X type=del 2024-09-12T00:36:22.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.632+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=TQHH2EGQUXSM type=del size=343258 2024-09-12T00:36:22.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.634+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~YLZHPM0YRTR1.0 size=495957 2024-09-12T00:36:22.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.637+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=YLZHPM0YRTR1 tag=VP2074W1XXPR type=write size=1544533 2024-09-12T00:36:22.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.638+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=KH1LVSW5EBJN type=del size=3025374 2024-09-12T00:36:22.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.639+0000 7f030cb87780 1 < completed write operation key=ZQD0491BHJPM tag=5J3IBG7DGN2C type=write size=836776 2024-09-12T00:36:22.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.642+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~GGZYCQHVV5VZ.0 size=1048576 2024-09-12T00:36:22.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.643+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~GGZYCQHVV5VZ.1 size=648581 2024-09-12T00:36:22.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.643+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=GGZYCQHVV5VZ tag=JJ2QL3RXUE9D type=write size=2745733 2024-09-12T00:36:22.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.644+0000 7f030cb87780 -1 < failed to complete operation key=V0OLIRP3KH40 tag=X6AE4UP5R1RI type=del size=1169591: (22) Invalid argument 2024-09-12T00:36:22.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.645+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=30YYO64DT3SG type=del size=1775535 2024-09-12T00:36:22.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.648+0000 7f030cb87780 -1 < failed to complete operation key=V0OLIRP3KH40 tag=G70A7YROFIPP type=del size=3945926: (22) Invalid argument 2024-09-12T00:36:22.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.649+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~29PGM4LLKO2Q.0 size=103338 2024-09-12T00:36:22.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.649+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=29PGM4LLKO2Q tag=I6R2L8ZXUY0A type=write size=1151914 2024-09-12T00:36:22.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.651+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~Q0A389EEQIML.0 size=1048576 2024-09-12T00:36:22.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.652+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~Q0A389EEQIML.1 size=599158 2024-09-12T00:36:22.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.654+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=Q0A389EEQIML tag=2HOYI8J3C5H3 type=write size=2696310 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.657+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~Y5O37QH70QCP.0 size=1048576 2024-09-12T00:36:22.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.658+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~Y5O37QH70QCP.1 size=1048576 2024-09-12T00:36:22.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.659+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~Y5O37QH70QCP.2 size=882862 2024-09-12T00:36:22.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.659+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=Y5O37QH70QCP tag=G2301T7CDGPY type=write size=4028590 2024-09-12T00:36:22.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.660+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~XQUMUTKISKPT.0 size=1048576 2024-09-12T00:36:22.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.661+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~XQUMUTKISKPT.1 size=1048576 2024-09-12T00:36:22.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.663+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~XQUMUTKISKPT.2 size=779151 2024-09-12T00:36:22.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.666+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=XQUMUTKISKPT tag=3D6HEHVU2M92 type=write size=3924879 2024-09-12T00:36:22.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.667+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=P8RJUBAT4YY6 type=del size=1953957 2024-09-12T00:36:22.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.668+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~X6YYK216LO2S.0 size=1023127 2024-09-12T00:36:22.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.670+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=X6YYK216LO2S tag=D2UD2G4GMO0V type=write size=2071703 2024-09-12T00:36:22.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.674+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~LTRMZ7NEMK0S.0 size=1048576 2024-09-12T00:36:22.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.674+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~LTRMZ7NEMK0S.1 size=1048576 2024-09-12T00:36:22.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.675+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~LTRMZ7NEMK0S.2 size=401743 2024-09-12T00:36:22.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.675+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=LTRMZ7NEMK0S tag=OSI9UQMBLPO0 type=write size=3547471 2024-09-12T00:36:22.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.676+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~BBGUOXY9VHP9.0 size=458389 2024-09-12T00:36:22.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.679+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=BBGUOXY9VHP9 tag=OWB7WC0BU27V type=write size=1506965 2024-09-12T00:36:22.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.682+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~NAYHTNG60IKO.0 size=125012 2024-09-12T00:36:22.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.682+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=NAYHTNG60IKO tag=P6FBAUSB7WGY type=write size=1173588 2024-09-12T00:36:22.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.683+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~QZN9FIS0630Q.0 size=13415 2024-09-12T00:36:22.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.685+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=QZN9FIS0630Q tag=7AW5QVLLNI4X type=write size=1061991 2024-09-12T00:36:22.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.688+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=0X2RISJB99JN type=write size=274659 2024-09-12T00:36:22.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.688+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=CWX3RACTGG8F type=del 2024-09-12T00:36:22.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.690+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=KVUORAKK9YJT type=del size=2475653 2024-09-12T00:36:22.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.691+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~9Q9HJ5NLYUSX.0 size=1048576 2024-09-12T00:36:22.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.691+0000 7f030cb87780 1 < canceled part key=_multipart_800OHA7UURC4.2~9Q9HJ5NLYUSX.1 size=539176 2024-09-12T00:36:22.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.694+0000 7f030cb87780 1 < canceled multipart upload key=800OHA7UURC4 upload=9Q9HJ5NLYUSX tag=FYJ8NQO23LM9 type=write size=2636328 2024-09-12T00:36:22.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.695+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=X5YUM2343M9Q type=del size=2008864 2024-09-12T00:36:22.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.698+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=LIU46KQAKHF3 type=del 2024-09-12T00:36:22.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.701+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~L2D6O1HD206G.0 size=389283 2024-09-12T00:36:22.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.701+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=L2D6O1HD206G tag=0WLEZZNFB7C7 type=write size=1437859 2024-09-12T00:36:22.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.701+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~QJQNSXYI6JKC.0 size=1048576 2024-09-12T00:36:22.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.702+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~QJQNSXYI6JKC.1 size=1048576 2024-09-12T00:36:22.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.704+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~QJQNSXYI6JKC.2 size=312471 2024-09-12T00:36:22.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.707+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=QJQNSXYI6JKC tag=DRHSB1PZOG68 type=write size=3458199 2024-09-12T00:36:22.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.708+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~8BW01OKW44BC.0 size=1048576 2024-09-12T00:36:22.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.710+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~8BW01OKW44BC.1 size=1048576 2024-09-12T00:36:22.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.712+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~8BW01OKW44BC.2 size=994010 2024-09-12T00:36:22.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.712+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=8BW01OKW44BC tag=1IJFWG8UL30C type=write size=4139738 2024-09-12T00:36:22.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.712+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=JY4BFJHPXZ87 type=del 2024-09-12T00:36:22.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.714+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=EQWHZFHIQQNP type=del size=476192 2024-09-12T00:36:22.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.715+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~D2OXQNUNB56Q.0 size=1048576 2024-09-12T00:36:22.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.717+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~D2OXQNUNB56Q.1 size=1048576 2024-09-12T00:36:22.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.717+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~D2OXQNUNB56Q.2 size=851155 2024-09-12T00:36:22.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.720+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=D2OXQNUNB56Q tag=M7R8KEHRKWB9 type=write size=3996883 2024-09-12T00:36:22.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.723+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~QACTBV1EYRI8.0 size=1048576 2024-09-12T00:36:22.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.725+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~QACTBV1EYRI8.1 size=279924 2024-09-12T00:36:22.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.725+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=QACTBV1EYRI8 tag=2E7EKU7L535W type=write size=2377076 2024-09-12T00:36:22.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.726+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=TQHH2EGQUXSM type=del 2024-09-12T00:36:22.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.728+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=F6A9JQWOIFGL type=del size=919482 2024-09-12T00:36:22.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.731+0000 7f030cb87780 1 < suggested remove operation key=ZQD0491BHJPM tag=KH1LVSW5EBJN type=del 2024-09-12T00:36:22.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.733+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~IXOT684N3E6R.0 size=1048576 2024-09-12T00:36:22.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.734+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~IXOT684N3E6R.1 size=707600 2024-09-12T00:36:22.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.734+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=IXOT684N3E6R tag=7OZCSZMD3FY7 type=write size=2804752 2024-09-12T00:36:22.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.736+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~GGZYCQHVV5VZ.0 size=1048576 2024-09-12T00:36:22.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.737+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~GGZYCQHVV5VZ.1 size=648581 2024-09-12T00:36:22.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.740+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=GGZYCQHVV5VZ tag=JJ2QL3RXUE9D type=write size=2745733 2024-09-12T00:36:22.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.742+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~8GM9H3IVYAVC.0 size=1048576 2024-09-12T00:36:22.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.743+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~8GM9H3IVYAVC.1 size=967243 2024-09-12T00:36:22.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.743+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=8GM9H3IVYAVC tag=78NWANAF3HQQ type=write size=3064395 2024-09-12T00:36:22.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.744+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=30YYO64DT3SG type=del 2024-09-12T00:36:22.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.746+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=KYAXCT5914D5 type=write size=1033368 2024-09-12T00:36:22.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.747+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~29PGM4LLKO2Q.0 size=103338 2024-09-12T00:36:22.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.749+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=29PGM4LLKO2Q tag=I6R2L8ZXUY0A type=write size=1151914 2024-09-12T00:36:22.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.751+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=XGXT3BY229VV type=del size=1735982 2024-09-12T00:36:22.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.752+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~Y5O37QH70QCP.0 size=1048576 2024-09-12T00:36:22.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.753+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~Y5O37QH70QCP.1 size=1048576 2024-09-12T00:36:22.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.755+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~Y5O37QH70QCP.2 size=882862 2024-09-12T00:36:22.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.757+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=Y5O37QH70QCP tag=G2301T7CDGPY type=write size=4028590 2024-09-12T00:36:22.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.760+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~Z9HF1LFRA20V.0 size=1048576 2024-09-12T00:36:22.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.761+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~Z9HF1LFRA20V.1 size=1048576 2024-09-12T00:36:22.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.763+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~Z9HF1LFRA20V.2 size=965706 2024-09-12T00:36:22.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.763+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=Z9HF1LFRA20V tag=RZUHO2YDRD2C type=write size=4111434 2024-09-12T00:36:22.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.764+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=P8RJUBAT4YY6 type=del 2024-09-12T00:36:22.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.766+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~0HZ31G8F7Y1O.0 size=401869 2024-09-12T00:36:22.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.766+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=0HZ31G8F7Y1O tag=YYX12O9X4ASI type=write size=1450445 2024-09-12T00:36:22.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.768+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~LTRMZ7NEMK0S.0 size=1048576 2024-09-12T00:36:22.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.769+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~LTRMZ7NEMK0S.1 size=1048576 2024-09-12T00:36:22.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.771+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~LTRMZ7NEMK0S.2 size=401743 2024-09-12T00:36:22.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.772+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=LTRMZ7NEMK0S tag=OSI9UQMBLPO0 type=write size=3547471 2024-09-12T00:36:22.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.775+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~1X08WJCKVM8C.0 size=887641 2024-09-12T00:36:22.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.775+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=1X08WJCKVM8C tag=9KNPQRFU4U9P type=write size=1936217 2024-09-12T00:36:22.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.777+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~NAYHTNG60IKO.0 size=125012 2024-09-12T00:36:22.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.779+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=NAYHTNG60IKO tag=P6FBAUSB7WGY type=write size=1173588 2024-09-12T00:36:22.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.780+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=KFYKYE65FPO8 type=del size=3978646 2024-09-12T00:36:22.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.782+0000 7f030cb87780 1 < completed write operation key=QGSJ51GMQXVK tag=0X2RISJB99JN type=write size=274659 2024-09-12T00:36:22.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.784+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~0ZLCI25N7I3G.0 size=1048576 2024-09-12T00:36:22.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.786+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~0ZLCI25N7I3G.1 size=1048576 2024-09-12T00:36:22.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.787+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~0ZLCI25N7I3G.2 size=828707 2024-09-12T00:36:22.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.787+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=0ZLCI25N7I3G tag=ZCXHBW816NYN type=write size=3974435 2024-09-12T00:36:22.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.788+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=KVUORAKK9YJT type=del 2024-09-12T00:36:22.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.790+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=4H2BGYMT1H1A type=del size=2171686 2024-09-12T00:36:22.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.793+0000 7f030cb87780 1 < suggested update operation key=ATTMOL2TGUN7 tag=X5YUM2343M9Q type=del size=2008864 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.795+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=MCR29QSWAWPR type=write size=292009 2024-09-12T00:36:22.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.796+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~L2D6O1HD206G.0 size=389283 2024-09-12T00:36:22.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.798+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=L2D6O1HD206G tag=0WLEZZNFB7C7 type=write size=1437859 2024-09-12T00:36:22.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.801+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~NCK2H6GNHLIC.0 size=737047 2024-09-12T00:36:22.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.801+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=NCK2H6GNHLIC tag=0CBY76WDYSZ3 type=write size=1785623 2024-09-12T00:36:22.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.803+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~8BW01OKW44BC.0 size=1048576 2024-09-12T00:36:22.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.804+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~8BW01OKW44BC.1 size=1048576 2024-09-12T00:36:22.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.805+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~8BW01OKW44BC.2 size=994010 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.808+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=8BW01OKW44BC tag=1IJFWG8UL30C type=write size=4139738 2024-09-12T00:36:22.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.809+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=4SLHE909CVIS type=write size=244832 2024-09-12T00:36:22.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.813+0000 7f030cb87780 1 < suggested update operation key=IHTFI7W4A6JT tag=EQWHZFHIQQNP type=del size=476192 2024-09-12T00:36:22.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.813+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=4AKI812P83N2 type=del size=1646929 2024-09-12T00:36:22.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.816+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~QACTBV1EYRI8.0 size=1048576 2024-09-12T00:36:22.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.816+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~QACTBV1EYRI8.1 size=279924 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.818+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=QACTBV1EYRI8 tag=2E7EKU7L535W type=write size=2377076 2024-09-12T00:36:22.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.820+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=76WB53H960FX type=del size=3616420 2024-09-12T00:36:22.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.821+0000 7f030cb87780 1 < canceled operation key=HUDEU16YTO0Y tag=F6A9JQWOIFGL type=del size=919482 2024-09-12T00:36:22.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.823+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=9LTWP67PZ907 type=write size=696909 2024-09-12T00:36:22.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.824+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~IXOT684N3E6R.0 size=1048576 2024-09-12T00:36:22.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.827+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~IXOT684N3E6R.1 size=707600 2024-09-12T00:36:22.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.828+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=IXOT684N3E6R tag=7OZCSZMD3FY7 type=write size=2804752 2024-09-12T00:36:22.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.832+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~V3N5IN7YUFGO.0 size=22037 2024-09-12T00:36:22.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.832+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=V3N5IN7YUFGO tag=DDEKNSCDNXBM type=write size=1070613 2024-09-12T00:36:22.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.833+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~8GM9H3IVYAVC.0 size=1048576 2024-09-12T00:36:22.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.834+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~8GM9H3IVYAVC.1 size=967243 2024-09-12T00:36:22.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.837+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=8GM9H3IVYAVC tag=78NWANAF3HQQ type=write size=3064395 2024-09-12T00:36:22.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.839+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~OTBUHTYBL5K8.0 size=1048576 2024-09-12T00:36:22.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.840+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~OTBUHTYBL5K8.1 size=1048576 2024-09-12T00:36:22.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.841+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~OTBUHTYBL5K8.2 size=302792 2024-09-12T00:36:22.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.841+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=OTBUHTYBL5K8 tag=GHVNC0STDGT3 type=write size=3448520 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.843+0000 7f030cb87780 1 < completed write operation key=CY2NS03IIUJJ tag=KYAXCT5914D5 type=write size=1033368 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.844+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=UONJPI1X5WUS type=del size=382065 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.846+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=XGXT3BY229VV type=del 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.847+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=HWEX492V0MIK type=del size=3676734 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.848+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~Z9HF1LFRA20V.0 size=1048576 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.850+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~Z9HF1LFRA20V.1 size=1048576 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.851+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~Z9HF1LFRA20V.2 size=965706 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.853+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=Z9HF1LFRA20V tag=RZUHO2YDRD2C type=write size=4111434 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.854+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=9PQQPLU8PWSQ type=del size=943934 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.855+0000 7f030cb87780 1 < canceled part key=_multipart_V87B6SDB1HFZ.2~0HZ31G8F7Y1O.0 size=401869 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.859+0000 7f030cb87780 1 < canceled multipart upload key=V87B6SDB1HFZ upload=0HZ31G8F7Y1O tag=YYX12O9X4ASI type=write size=1450445 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.860+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~HZYXGO891ZJ6.0 size=1048576 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.862+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~HZYXGO891ZJ6.1 size=1048576 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.863+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~HZYXGO891ZJ6.2 size=514263 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.863+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=HZYXGO891ZJ6 tag=J27P4INKMPRV type=write size=3659991 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.864+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~1X08WJCKVM8C.0 size=887641 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.867+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=1X08WJCKVM8C tag=9KNPQRFU4U9P type=write size=1936217 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.868+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=KH3ZCAFVJ919 type=write size=1038568 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.869+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=KFYKYE65FPO8 type=del 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.870+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=Z5GWCQ6OTIF0 type=del size=1749276 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.872+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~0ZLCI25N7I3G.0 size=1048576 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.874+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~0ZLCI25N7I3G.1 size=1048576 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.875+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~0ZLCI25N7I3G.2 size=828707 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.877+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=0ZLCI25N7I3G tag=ZCXHBW816NYN type=write size=3974435 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.879+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=AIQ2Q44LY51G type=del size=3544150 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.880+0000 7f030cb87780 1 < canceled operation key=IY156CJWG2TB tag=4H2BGYMT1H1A type=del size=2171686 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.883+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~JL7Q5LSC0SD5.0 size=1048576 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.884+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~JL7Q5LSC0SD5.1 size=609993 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.884+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=JL7Q5LSC0SD5 tag=7IZMOO5ZCE29 type=write size=2707145 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.885+0000 7f030cb87780 1 < completed write operation key=POC8YA58U55N tag=MCR29QSWAWPR type=write size=292009 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.888+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~OJLIX4S5Y88G.0 size=1048576 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.889+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~OJLIX4S5Y88G.1 size=1048576 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.891+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~OJLIX4S5Y88G.2 size=639623 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.891+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=OJLIX4S5Y88G tag=PI5CDY0BCZQG type=write size=3785351 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.892+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~NCK2H6GNHLIC.0 size=737047 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.894+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=NCK2H6GNHLIC tag=0CBY76WDYSZ3 type=write size=1785623 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.895+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=6W91D057A074 type=del size=1248351 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.896+0000 7f030cb87780 1 < completed write operation key=HUDEU16YTO0Y tag=4SLHE909CVIS type=write size=244832 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.899+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~UQG11A1JXZSS.0 size=1048576 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.900+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~UQG11A1JXZSS.1 size=1048576 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.901+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~UQG11A1JXZSS.2 size=295875 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.901+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=UQG11A1JXZSS tag=WJD344A3DWNA type=write size=3441603 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.903+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=4AKI812P83N2 type=del 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.905+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=VEMC2VHXD6K0 type=del size=1406232 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.906+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=76WB53H960FX type=del 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.907+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=2N57EBG6DVXJ type=del size=2717541 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.911+0000 7f030cb87780 1 < suggested update operation key=56I20YIPY82N tag=9LTWP67PZ907 type=write size=696909 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.912+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~LA6I7H0TFTD9.0 size=1048576 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.914+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~LA6I7H0TFTD9.1 size=1048576 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.915+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~LA6I7H0TFTD9.2 size=728666 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.915+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=LA6I7H0TFTD9 tag=JUE2674PYY4L type=write size=3874394 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.916+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~V3N5IN7YUFGO.0 size=22037 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.919+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=V3N5IN7YUFGO tag=DDEKNSCDNXBM type=write size=1070613 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.920+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=HMWWG47VUJIA type=del size=1142909 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.922+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~OTBUHTYBL5K8.0 size=1048576 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.923+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~OTBUHTYBL5K8.1 size=1048576 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.925+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~OTBUHTYBL5K8.2 size=302792 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.926+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=OTBUHTYBL5K8 tag=GHVNC0STDGT3 type=write size=3448520 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.929+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~1UC93TTRBKSD.0 size=708162 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.929+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=1UC93TTRBKSD tag=2RVM3TS2RVHZ type=write size=1756738 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.930+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=UONJPI1X5WUS type=del 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.933+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~VEXXR059F757.0 size=1048576 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.934+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~VEXXR059F757.1 size=1048576 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.935+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~VEXXR059F757.2 size=884436 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.935+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=VEXXR059F757 tag=MAGRRB32VWB9 type=write size=4030164 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.936+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=HWEX492V0MIK type=del 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.940+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~NPGG38GR13SP.0 size=1048576 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.941+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~NPGG38GR13SP.1 size=562766 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.941+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=NPGG38GR13SP tag=GAKK0WOMJK80 type=write size=2659918 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.943+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=9PQQPLU8PWSQ type=del 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.945+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=I9SGJ1H9XINQ type=del size=712697 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.946+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~HZYXGO891ZJ6.0 size=1048576 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.947+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~HZYXGO891ZJ6.1 size=1048576 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.948+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~HZYXGO891ZJ6.2 size=514263 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.951+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=HZYXGO891ZJ6 tag=J27P4INKMPRV type=write size=3659991 2024-09-12T00:36:22.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.954+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~4DIR34L9FOS0.0 size=1048576 2024-09-12T00:36:22.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.954+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~4DIR34L9FOS0.1 size=1048576 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.956+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~4DIR34L9FOS0.2 size=364162 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.956+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=4DIR34L9FOS0 tag=20IZ38PIPH1I type=write size=3509890 2024-09-12T00:36:22.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.957+0000 7f030cb87780 1 < canceled operation key=39WSAOA6P09M tag=KH3ZCAFVJ919 type=write size=1038568 2024-09-12T00:36:22.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.959+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=XPYCR8CWOJS5 type=del size=3205318 2024-09-12T00:36:22.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.960+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=Z5GWCQ6OTIF0 type=del 2024-09-12T00:36:22.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.961+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=O1NS0TETC8S8 type=write size=9568 2024-09-12T00:36:22.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.964+0000 7f030cb87780 1 < suggested remove operation key=327RDLIWLVRO tag=AIQ2Q44LY51G type=del 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.967+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~RNRZHGS428AB.0 size=1048576 2024-09-12T00:36:22.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.968+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~RNRZHGS428AB.1 size=584183 2024-09-12T00:36:22.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.968+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=RNRZHGS428AB tag=2FHKFJUUQW3C type=write size=2681335 2024-09-12T00:36:22.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.970+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~JL7Q5LSC0SD5.0 size=1048576 2024-09-12T00:36:22.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.971+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~JL7Q5LSC0SD5.1 size=609993 2024-09-12T00:36:22.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.974+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=JL7Q5LSC0SD5 tag=7IZMOO5ZCE29 type=write size=2707145 2024-09-12T00:36:22.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.977+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~WM00QVHMF5DN.0 size=1048576 2024-09-12T00:36:22.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.977+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~WM00QVHMF5DN.1 size=1048576 2024-09-12T00:36:22.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.979+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~WM00QVHMF5DN.2 size=418130 2024-09-12T00:36:22.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.979+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=WM00QVHMF5DN tag=7LC3JHRM8WOU type=write size=3563858 2024-09-12T00:36:22.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.980+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~OJLIX4S5Y88G.0 size=1048576 2024-09-12T00:36:22.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.981+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~OJLIX4S5Y88G.1 size=1048576 2024-09-12T00:36:22.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.983+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~OJLIX4S5Y88G.2 size=639623 2024-09-12T00:36:22.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.986+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=OJLIX4S5Y88G tag=PI5CDY0BCZQG type=write size=3785351 2024-09-12T00:36:22.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.988+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~97HDZFX90PAC.0 size=1048576 2024-09-12T00:36:22.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.990+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~97HDZFX90PAC.1 size=1048576 2024-09-12T00:36:22.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.991+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~97HDZFX90PAC.2 size=977130 2024-09-12T00:36:22.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.991+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=97HDZFX90PAC tag=RN83DG2JMMVP type=write size=4122858 2024-09-12T00:36:22.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.993+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=6W91D057A074 type=del 2024-09-12T00:36:22.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.994+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=2YZQHDELLG26 type=del size=4081618 2024-09-12T00:36:22.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.995+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~UQG11A1JXZSS.0 size=1048576 2024-09-12T00:36:22.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.996+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~UQG11A1JXZSS.1 size=1048576 2024-09-12T00:36:22.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:22.998+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~UQG11A1JXZSS.2 size=295875 2024-09-12T00:36:23.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.000+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=UQG11A1JXZSS tag=WJD344A3DWNA type=write size=3441603 2024-09-12T00:36:23.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.001+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=YCWDW73AC0XV type=write size=669079 2024-09-12T00:36:23.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.003+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=VEMC2VHXD6K0 type=del 2024-09-12T00:36:23.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.006+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~18D2L0C1KIAK.0 size=1048576 2024-09-12T00:36:23.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.008+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~18D2L0C1KIAK.1 size=288227 2024-09-12T00:36:23.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.008+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=18D2L0C1KIAK tag=076SBW9JGDU1 type=write size=2385379 2024-09-12T00:36:23.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.008+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=2N57EBG6DVXJ type=del 2024-09-12T00:36:23.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.010+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=WKA29UED03K2 type=del size=2714171 2024-09-12T00:36:23.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.011+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~LA6I7H0TFTD9.0 size=1048576 2024-09-12T00:36:23.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.012+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~LA6I7H0TFTD9.1 size=1048576 2024-09-12T00:36:23.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.014+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~LA6I7H0TFTD9.2 size=728666 2024-09-12T00:36:23.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.016+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=LA6I7H0TFTD9 tag=JUE2674PYY4L type=write size=3874394 2024-09-12T00:36:23.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.018+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=T6GCJTG7F3GM type=del size=1122100 2024-09-12T00:36:23.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.019+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=HMWWG47VUJIA type=del 2024-09-12T00:36:23.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.022+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~PPIFM8EGN6LS.0 size=1048576 2024-09-12T00:36:23.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.023+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~PPIFM8EGN6LS.1 size=1048576 2024-09-12T00:36:23.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.024+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~PPIFM8EGN6LS.2 size=598856 2024-09-12T00:36:23.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.024+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=PPIFM8EGN6LS tag=O7T8CY1M2NF3 type=write size=3744584 2024-09-12T00:36:23.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.025+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~1UC93TTRBKSD.0 size=708162 2024-09-12T00:36:23.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.028+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=1UC93TTRBKSD tag=2RVM3TS2RVHZ type=write size=1756738 2024-09-12T00:36:23.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.029+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=VB2H86BVQFO1 type=write size=588252 2024-09-12T00:36:23.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.031+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~VEXXR059F757.0 size=1048576 2024-09-12T00:36:23.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.032+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~VEXXR059F757.1 size=1048576 2024-09-12T00:36:23.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.033+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~VEXXR059F757.2 size=884436 2024-09-12T00:36:23.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.036+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=VEXXR059F757 tag=MAGRRB32VWB9 type=write size=4030164 2024-09-12T00:36:23.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.037+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=9VZSZU1KVACB type=del size=3191382 2024-09-12T00:36:23.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.038+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~NPGG38GR13SP.0 size=1048576 2024-09-12T00:36:23.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.039+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~NPGG38GR13SP.1 size=562766 2024-09-12T00:36:23.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.042+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=NPGG38GR13SP tag=GAKK0WOMJK80 type=write size=2659918 2024-09-12T00:36:23.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.045+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~4I4Z2T525IN6.0 size=1048576 2024-09-12T00:36:23.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.046+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~4I4Z2T525IN6.1 size=1048576 2024-09-12T00:36:23.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.047+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~4I4Z2T525IN6.2 size=11904 2024-09-12T00:36:23.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.047+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=4I4Z2T525IN6 tag=3TV9W1M05XQ6 type=write size=3157632 2024-09-12T00:36:23.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.051+0000 7f030cb87780 1 < suggested remove operation key=V87B6SDB1HFZ tag=I9SGJ1H9XINQ type=del 2024-09-12T00:36:23.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.052+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=5JTXOE6X3F0I type=del size=799355 2024-09-12T00:36:23.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.053+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~4DIR34L9FOS0.0 size=1048576 2024-09-12T00:36:23.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.054+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~4DIR34L9FOS0.1 size=1048576 2024-09-12T00:36:23.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.056+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~4DIR34L9FOS0.2 size=364162 2024-09-12T00:36:23.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.059+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=4DIR34L9FOS0 tag=20IZ38PIPH1I type=write size=3509890 2024-09-12T00:36:23.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.060+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=T71CNFIEY3FF type=del size=1239085 2024-09-12T00:36:23.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.061+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=XPYCR8CWOJS5 type=del 2024-09-12T00:36:23.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.062+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=MBXVDVLTEXQ1 type=del size=3604833 2024-09-12T00:36:23.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.064+0000 7f030cb87780 -1 < failed to complete operation key=V87B6SDB1HFZ tag=O1NS0TETC8S8 type=write size=9568: (22) Invalid argument 2024-09-12T00:36:23.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.065+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=EZBDJ355E8LU type=write size=468993 2024-09-12T00:36:23.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.067+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~RNRZHGS428AB.0 size=1048576 2024-09-12T00:36:23.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.068+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~RNRZHGS428AB.1 size=584183 2024-09-12T00:36:23.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.070+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=RNRZHGS428AB tag=2FHKFJUUQW3C type=write size=2681335 2024-09-12T00:36:23.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.071+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=K0I6WKSPFMVI type=del size=4061854 2024-09-12T00:36:23.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.074+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~WM00QVHMF5DN.0 size=1048576 2024-09-12T00:36:23.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.074+0000 7f030cb87780 1 < canceled part key=_multipart_CY2NS03IIUJJ.2~WM00QVHMF5DN.1 size=1048576 2024-09-12T00:36:23.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.075+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~WM00QVHMF5DN.2 size=418130 2024-09-12T00:36:23.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.076+0000 7f030cb87780 1 < canceled multipart upload key=CY2NS03IIUJJ upload=WM00QVHMF5DN tag=7LC3JHRM8WOU type=write size=3563858 2024-09-12T00:36:23.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.078+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=2FX5W1ME2YK1 type=del size=2585622 2024-09-12T00:36:23.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.079+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~97HDZFX90PAC.0 size=1048576 2024-09-12T00:36:23.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.081+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~97HDZFX90PAC.1 size=1048576 2024-09-12T00:36:23.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.081+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~97HDZFX90PAC.2 size=977130 2024-09-12T00:36:23.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.083+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=97HDZFX90PAC tag=RN83DG2JMMVP type=write size=4122858 2024-09-12T00:36:23.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.085+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=4B99GSV61IPN type=del size=2334521 2024-09-12T00:36:23.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.086+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=2YZQHDELLG26 type=del 2024-09-12T00:36:23.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.089+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~7M4NAP49HOK8.0 size=530831 2024-09-12T00:36:23.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.089+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=7M4NAP49HOK8 tag=3LYOHYWONXVK type=write size=1579407 2024-09-12T00:36:23.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.091+0000 7f030cb87780 1 < completed write operation key=ATTMOL2TGUN7 tag=YCWDW73AC0XV type=write size=669079 2024-09-12T00:36:23.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.092+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=ZJQSRPCIOO41 type=del size=3206003 2024-09-12T00:36:23.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.094+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~18D2L0C1KIAK.0 size=1048576 2024-09-12T00:36:23.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.095+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~18D2L0C1KIAK.1 size=288227 2024-09-12T00:36:23.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.098+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=18D2L0C1KIAK tag=076SBW9JGDU1 type=write size=2385379 2024-09-12T00:36:23.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.099+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=N42JRLUSK7R7 type=del size=4011312 2024-09-12T00:36:23.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.102+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=WKA29UED03K2 type=del 2024-09-12T00:36:23.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.103+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=EAMZ4Q6533JF type=del size=3006348 2024-09-12T00:36:23.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.106+0000 7f030cb87780 1 < suggested remove operation key=3W7ANGL92ZF0 tag=T6GCJTG7F3GM type=del 2024-09-12T00:36:23.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.109+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~RBMO55RTYBW7.0 size=289618 2024-09-12T00:36:23.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.109+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=RBMO55RTYBW7 tag=75NHAMUG188U type=write size=1338194 2024-09-12T00:36:23.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.110+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~PPIFM8EGN6LS.0 size=1048576 2024-09-12T00:36:23.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.111+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~PPIFM8EGN6LS.1 size=1048576 2024-09-12T00:36:23.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.112+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~PPIFM8EGN6LS.2 size=598856 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.115+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=PPIFM8EGN6LS tag=O7T8CY1M2NF3 type=write size=3744584 2024-09-12T00:36:23.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.116+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=VBQ1CJH829V5 type=del size=1334978 2024-09-12T00:36:23.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.117+0000 7f030cb87780 1 < completed write operation key=UFYMVGL264T8 tag=VB2H86BVQFO1 type=write size=588252 2024-09-12T00:36:23.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.120+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~8XI6A4L1AEMI.0 size=544143 2024-09-12T00:36:23.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.120+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=8XI6A4L1AEMI tag=YSX09NG1XVHI type=write size=1592719 2024-09-12T00:36:23.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.121+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=9VZSZU1KVACB type=del 2024-09-12T00:36:23.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.125+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~JD9VAMDMNA8D.0 size=1048576 2024-09-12T00:36:23.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.126+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~JD9VAMDMNA8D.1 size=422158 2024-09-12T00:36:23.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.126+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=JD9VAMDMNA8D tag=YG8UM62EVV7S type=write size=2519310 2024-09-12T00:36:23.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.127+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~4I4Z2T525IN6.0 size=1048576 2024-09-12T00:36:23.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.128+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~4I4Z2T525IN6.1 size=1048576 2024-09-12T00:36:23.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.130+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~4I4Z2T525IN6.2 size=11904 2024-09-12T00:36:23.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.132+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=4I4Z2T525IN6 tag=3TV9W1M05XQ6 type=write size=3157632 2024-09-12T00:36:23.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.134+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=D5X0ON84XQB9 type=del size=1999633 2024-09-12T00:36:23.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.135+0000 7f030cb87780 1 < canceled operation key=UFYMVGL264T8 tag=5JTXOE6X3F0I type=del size=799355 2024-09-12T00:36:23.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.137+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~WPVH1M9FW49V.0 size=54842 2024-09-12T00:36:23.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.137+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=WPVH1M9FW49V tag=O58WO4U9R5OO type=write size=1103418 2024-09-12T00:36:23.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.138+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=T71CNFIEY3FF type=del 2024-09-12T00:36:23.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.140+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=4O4FGZZ28SWM type=del size=885954 2024-09-12T00:36:23.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.142+0000 7f030cb87780 1 < suggested update operation key=56I20YIPY82N tag=MBXVDVLTEXQ1 type=del size=3604833 2024-09-12T00:36:23.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.144+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=WKAX48DKAHEB type=del size=2793994 2024-09-12T00:36:23.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.145+0000 7f030cb87780 1 < completed write operation key=ELX0797T1L4C tag=EZBDJ355E8LU type=write size=468993 2024-09-12T00:36:23.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.148+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~00Y6KATG7J4G.0 size=955964 2024-09-12T00:36:23.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.148+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=00Y6KATG7J4G tag=PJJ5CVWB5D2E type=write size=2004540 2024-09-12T00:36:23.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.149+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=K0I6WKSPFMVI type=del 2024-09-12T00:36:23.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.150+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=H3XQW96DINKG type=del size=1402968 2024-09-12T00:36:23.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.152+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=2FX5W1ME2YK1 type=del 2024-09-12T00:36:23.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.154+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=SAH5MUVN2OP9 type=del size=2789803 2024-09-12T00:36:23.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.156+0000 7f030cb87780 1 < suggested update operation key=POC8YA58U55N tag=4B99GSV61IPN type=del size=2334521 2024-09-12T00:36:23.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.158+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=2SKW1S2ITET4 type=write size=1016226 2024-09-12T00:36:23.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.159+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~7M4NAP49HOK8.0 size=530831 2024-09-12T00:36:23.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.161+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=7M4NAP49HOK8 tag=3LYOHYWONXVK type=write size=1579407 2024-09-12T00:36:23.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.163+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=KF8ADID7GYRF type=del size=554392 2024-09-12T00:36:23.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.166+0000 7f030cb87780 1 < suggested update operation key=6WHZRKLM3OLP tag=ZJQSRPCIOO41 type=del size=3206003 2024-09-12T00:36:23.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.167+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=SXKK0DZIXMG2 type=del size=3440426 2024-09-12T00:36:23.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.170+0000 7f030cb87780 1 < suggested remove operation key=800OHA7UURC4 tag=N42JRLUSK7R7 type=del 2024-09-12T00:36:23.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.172+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~BBA0B7MEAYCS.0 size=1048576 2024-09-12T00:36:23.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.174+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~BBA0B7MEAYCS.1 size=1048576 2024-09-12T00:36:23.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.175+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~BBA0B7MEAYCS.2 size=914214 2024-09-12T00:36:23.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.175+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=BBA0B7MEAYCS tag=R4QTEF0HIQLP type=write size=4059942 2024-09-12T00:36:23.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.176+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=EAMZ4Q6533JF type=del 2024-09-12T00:36:23.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.178+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=GIHFAZK7GEN4 type=del size=1693178 2024-09-12T00:36:23.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.179+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~RBMO55RTYBW7.0 size=289618 2024-09-12T00:36:23.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.182+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=RBMO55RTYBW7 tag=75NHAMUG188U type=write size=1338194 2024-09-12T00:36:23.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.184+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~3JL8AHONO54L.0 size=248209 2024-09-12T00:36:23.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.184+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=3JL8AHONO54L tag=B21VXGSXYRLT type=write size=1296785 2024-09-12T00:36:23.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.185+0000 7f030cb87780 -1 < no bi entry to suggest for operation key=800OHA7UURC4 tag=VBQ1CJH829V5 type=del size=1334978: (2) No such file or directory 2024-09-12T00:36:23.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.186+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=9L27327P0G3R type=del size=2602428 2024-09-12T00:36:23.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.188+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~8XI6A4L1AEMI.0 size=544143 2024-09-12T00:36:23.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.190+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=8XI6A4L1AEMI tag=YSX09NG1XVHI type=write size=1592719 2024-09-12T00:36:23.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.192+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~0PGZCV7BDZ6M.0 size=1048576 2024-09-12T00:36:23.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.194+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~0PGZCV7BDZ6M.1 size=1048576 2024-09-12T00:36:23.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.195+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~0PGZCV7BDZ6M.2 size=244984 2024-09-12T00:36:23.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.195+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=0PGZCV7BDZ6M tag=HQK9S0E5K7JR type=write size=3390712 2024-09-12T00:36:23.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.196+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~JD9VAMDMNA8D.0 size=1048576 2024-09-12T00:36:23.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.197+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~JD9VAMDMNA8D.1 size=422158 2024-09-12T00:36:23.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.199+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=JD9VAMDMNA8D tag=YG8UM62EVV7S type=write size=2519310 2024-09-12T00:36:23.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.201+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=41TFIOLDE1ZR type=del size=469849 2024-09-12T00:36:23.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.203+0000 7f030cb87780 1 < canceled operation key=1VOJGMWNKS0A tag=D5X0ON84XQB9 type=del size=1999633 2024-09-12T00:36:23.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.204+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=DRM6ONRU0GSK type=del size=4114130 2024-09-12T00:36:23.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.207+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~WPVH1M9FW49V.0 size=54842 2024-09-12T00:36:23.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.209+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=WPVH1M9FW49V tag=O58WO4U9R5OO type=write size=1103418 2024-09-12T00:36:23.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.212+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~YMYNI0F7MB80.0 size=1048576 2024-09-12T00:36:23.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.214+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~YMYNI0F7MB80.1 size=490533 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.214+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=YMYNI0F7MB80 tag=ZRL1C5LRWVZF type=write size=2587685 2024-09-12T00:36:23.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.214+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=4O4FGZZ28SWM type=del 2024-09-12T00:36:23.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.216+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=KQFIKW0CPBSB type=write size=347415 2024-09-12T00:36:23.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.217+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=WKAX48DKAHEB type=del 2024-09-12T00:36:23.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.218+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=V0ISSCUTNA3K type=del size=2206342 2024-09-12T00:36:23.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.220+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~00Y6KATG7J4G.0 size=955964 2024-09-12T00:36:23.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.222+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=00Y6KATG7J4G tag=PJJ5CVWB5D2E type=write size=2004540 2024-09-12T00:36:23.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.224+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~CRLTABXECYXL.0 size=1048576 2024-09-12T00:36:23.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.225+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~CRLTABXECYXL.1 size=1048576 2024-09-12T00:36:23.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.226+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~CRLTABXECYXL.2 size=899047 2024-09-12T00:36:23.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.226+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=CRLTABXECYXL tag=A24TV5YF6Q17 type=write size=4044775 2024-09-12T00:36:23.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.229+0000 7f030cb87780 1 < suggested update operation key=327RDLIWLVRO tag=H3XQW96DINKG type=del size=1402968 2024-09-12T00:36:23.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.231+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~1VPB3RJXMT38.0 size=218867 2024-09-12T00:36:23.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.231+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=1VPB3RJXMT38 tag=BC29I75EN8K7 type=write size=1267443 2024-09-12T00:36:23.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.233+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=SAH5MUVN2OP9 type=del 2024-09-12T00:36:23.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.235+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~XUJIDZAWCFTB.0 size=31261 2024-09-12T00:36:23.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.235+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=XUJIDZAWCFTB tag=107WAZ8PFM2F type=write size=1079837 2024-09-12T00:36:23.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.238+0000 7f030cb87780 1 < completed write operation key=V87B6SDB1HFZ tag=2SKW1S2ITET4 type=write size=1016226 2024-09-12T00:36:23.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.239+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=TMRZLG76VY8X type=del size=31762 2024-09-12T00:36:23.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.240+0000 7f030cb87780 -1 < failed to complete operation key=6WHZRKLM3OLP tag=KF8ADID7GYRF type=del size=554392: (22) Invalid argument 2024-09-12T00:36:23.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.242+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~ICC66EI3CFP1.0 size=1048576 2024-09-12T00:36:23.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.243+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~ICC66EI3CFP1.1 size=946664 2024-09-12T00:36:23.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.243+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=ICC66EI3CFP1 tag=N9XABESZCVTJ type=write size=3043816 2024-09-12T00:36:23.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.244+0000 7f030cb87780 -1 < failed to complete operation key=327RDLIWLVRO tag=SXKK0DZIXMG2 type=del size=3440426: (22) Invalid argument 2024-09-12T00:36:23.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.247+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~R18AZYOVI99G.0 size=153556 2024-09-12T00:36:23.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.247+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=R18AZYOVI99G tag=XFAQZDUCH5EC type=write size=1202132 2024-09-12T00:36:23.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.248+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~BBA0B7MEAYCS.0 size=1048576 2024-09-12T00:36:23.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.249+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~BBA0B7MEAYCS.1 size=1048576 2024-09-12T00:36:23.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.251+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~BBA0B7MEAYCS.2 size=914214 2024-09-12T00:36:23.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.254+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=BBA0B7MEAYCS tag=R4QTEF0HIQLP type=write size=4059942 2024-09-12T00:36:23.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.257+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~SONC85PRZ7Q3.0 size=1048576 2024-09-12T00:36:23.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.259+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~SONC85PRZ7Q3.1 size=1048576 2024-09-12T00:36:23.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.260+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~SONC85PRZ7Q3.2 size=564280 2024-09-12T00:36:23.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.260+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=SONC85PRZ7Q3 tag=2YHE3ITKSPS4 type=write size=3710008 2024-09-12T00:36:23.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.260+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=GIHFAZK7GEN4 type=del 2024-09-12T00:36:23.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.264+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~1GJ5F3EILRS0.0 size=1048576 2024-09-12T00:36:23.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.265+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~1GJ5F3EILRS0.1 size=301093 2024-09-12T00:36:23.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.265+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=1GJ5F3EILRS0 tag=X7DZTEBQ8G2F type=write size=2398245 2024-09-12T00:36:23.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.265+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~3JL8AHONO54L.0 size=248209 2024-09-12T00:36:23.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.268+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=3JL8AHONO54L tag=B21VXGSXYRLT type=write size=1296785 2024-09-12T00:36:23.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.269+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=EMXQXCA01R7N type=write size=373336 2024-09-12T00:36:23.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.271+0000 7f030cb87780 1 < canceled operation key=JRPD5AAK84ZD tag=9L27327P0G3R type=del size=2602428 2024-09-12T00:36:23.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.272+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=AROSUYO4K7KK type=write size=369374 2024-09-12T00:36:23.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.273+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~0PGZCV7BDZ6M.0 size=1048576 2024-09-12T00:36:23.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.275+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~0PGZCV7BDZ6M.1 size=1048576 2024-09-12T00:36:23.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.275+0000 7f030cb87780 1 < canceled part key=_multipart_DLR6A7XOERHW.2~0PGZCV7BDZ6M.2 size=244984 2024-09-12T00:36:23.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.277+0000 7f030cb87780 1 < canceled multipart upload key=DLR6A7XOERHW upload=0PGZCV7BDZ6M tag=HQK9S0E5K7JR type=write size=3390712 2024-09-12T00:36:23.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.279+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=BJDIEEVI336V type=write size=134642 2024-09-12T00:36:23.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.280+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=41TFIOLDE1ZR type=del 2024-09-12T00:36:23.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.283+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~VS0QZH1SMSXN.0 size=1005505 2024-09-12T00:36:23.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.283+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=VS0QZH1SMSXN tag=WML44UQOAFJW type=write size=2054081 2024-09-12T00:36:23.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.284+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=DRM6ONRU0GSK type=del 2024-09-12T00:36:23.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.285+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=O35JDSCS4PSJ type=del size=2039239 2024-09-12T00:36:23.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.287+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~YMYNI0F7MB80.0 size=1048576 2024-09-12T00:36:23.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.288+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~YMYNI0F7MB80.1 size=490533 2024-09-12T00:36:23.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.290+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=YMYNI0F7MB80 tag=ZRL1C5LRWVZF type=write size=2587685 2024-09-12T00:36:23.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.291+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=ZXZJU1JMETMF type=del size=3434224 2024-09-12T00:36:23.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.293+0000 7f030cb87780 -1 < failed to complete operation key=327RDLIWLVRO tag=KQFIKW0CPBSB type=write size=347415: (22) Invalid argument 2024-09-12T00:36:23.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.294+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=FKK78BGSCH3E type=del size=2040691 2024-09-12T00:36:23.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.296+0000 7f030cb87780 1 < suggested remove operation key=99OWKRGA8ZZN tag=V0ISSCUTNA3K type=del 2024-09-12T00:36:23.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.298+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=0AFXC331NU8R type=write size=870166 2024-09-12T00:36:23.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.298+0000 7f030cb87780 1 < canceled part key=_multipart_1VOJGMWNKS0A.2~CRLTABXECYXL.0 size=1048576 2024-09-12T00:36:23.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.300+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~CRLTABXECYXL.1 size=1048576 2024-09-12T00:36:23.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.301+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~CRLTABXECYXL.2 size=899047 2024-09-12T00:36:23.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.303+0000 7f030cb87780 1 < canceled multipart upload key=1VOJGMWNKS0A upload=CRLTABXECYXL tag=A24TV5YF6Q17 type=write size=4044775 2024-09-12T00:36:23.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.307+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~H17M2O5LCRJU.0 size=1048576 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.307+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~H17M2O5LCRJU.1 size=407295 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.307+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=H17M2O5LCRJU tag=AYXPSH8RFB55 type=write size=2504447 2024-09-12T00:36:23.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.308+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~1VPB3RJXMT38.0 size=218867 2024-09-12T00:36:23.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.311+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=1VPB3RJXMT38 tag=BC29I75EN8K7 type=write size=1267443 2024-09-12T00:36:23.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.312+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=ONSI4VKEE9ZI type=del size=858013 2024-09-12T00:36:23.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.314+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~XUJIDZAWCFTB.0 size=31261 2024-09-12T00:36:23.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.315+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=XUJIDZAWCFTB tag=107WAZ8PFM2F type=write size=1079837 2024-09-12T00:36:23.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.317+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=RJOZUO42EOAD type=write size=912608 2024-09-12T00:36:23.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.318+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=TMRZLG76VY8X type=del 2024-09-12T00:36:23.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.321+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~UGJW6O31BTHS.0 size=1048576 2024-09-12T00:36:23.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.322+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~UGJW6O31BTHS.1 size=1017259 2024-09-12T00:36:23.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.322+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=UGJW6O31BTHS tag=71GKEI8RWG8S type=write size=3114411 2024-09-12T00:36:23.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.323+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~ICC66EI3CFP1.0 size=1048576 2024-09-12T00:36:23.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.324+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~ICC66EI3CFP1.1 size=946664 2024-09-12T00:36:23.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.327+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=ICC66EI3CFP1 tag=N9XABESZCVTJ type=write size=3043816 2024-09-12T00:36:23.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.328+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=QVL6EIS35PRA type=del size=2443173 2024-09-12T00:36:23.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.329+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~R18AZYOVI99G.0 size=153556 2024-09-12T00:36:23.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.332+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=R18AZYOVI99G tag=XFAQZDUCH5EC type=write size=1202132 2024-09-12T00:36:23.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.334+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~TP0GEZA7835I.0 size=1048576 2024-09-12T00:36:23.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.335+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~TP0GEZA7835I.1 size=805182 2024-09-12T00:36:23.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.335+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=TP0GEZA7835I tag=DVJWA6NE5GQP type=write size=2902334 2024-09-12T00:36:23.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.337+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~SONC85PRZ7Q3.0 size=1048576 2024-09-12T00:36:23.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.338+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~SONC85PRZ7Q3.1 size=1048576 2024-09-12T00:36:23.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.339+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~SONC85PRZ7Q3.2 size=564280 2024-09-12T00:36:23.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.341+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=SONC85PRZ7Q3 tag=2YHE3ITKSPS4 type=write size=3710008 2024-09-12T00:36:23.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.343+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=CZILEKVPNDTQ type=del size=599187 2024-09-12T00:36:23.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.344+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~1GJ5F3EILRS0.0 size=1048576 2024-09-12T00:36:23.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.345+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~1GJ5F3EILRS0.1 size=301093 2024-09-12T00:36:23.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.347+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=1GJ5F3EILRS0 tag=X7DZTEBQ8G2F type=write size=2398245 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.350+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~2AN8PJXJG2Q9.0 size=739610 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.350+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=2AN8PJXJG2Q9 tag=IV088A1146RY type=write size=1788186 2024-09-12T00:36:23.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.351+0000 7f030cb87780 1 < completed write operation key=IHTFI7W4A6JT tag=EMXQXCA01R7N type=write size=373336 2024-09-12T00:36:23.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.354+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~QV2OA1QHNKQI.0 size=1048576 2024-09-12T00:36:23.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.355+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~QV2OA1QHNKQI.1 size=1048576 2024-09-12T00:36:23.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.356+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~QV2OA1QHNKQI.2 size=553829 2024-09-12T00:36:23.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.356+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=QV2OA1QHNKQI tag=07JTOL4J3FNJ type=write size=3699557 2024-09-12T00:36:23.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.358+0000 7f030cb87780 1 < completed write operation key=86TWUAZAHI4I tag=AROSUYO4K7KK type=write size=369374 2024-09-12T00:36:23.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.360+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=TI4Z3QDO1U2Y type=del size=2559722 2024-09-12T00:36:23.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.361+0000 7f030cb87780 1 < canceled operation key=86TWUAZAHI4I tag=BJDIEEVI336V type=write size=134642 2024-09-12T00:36:23.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.364+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~X46061VZP4TA.0 size=691989 2024-09-12T00:36:23.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.364+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=X46061VZP4TA tag=C0M2XR3N5HRM type=write size=1740565 2024-09-12T00:36:23.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.365+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~VS0QZH1SMSXN.0 size=1005505 2024-09-12T00:36:23.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.368+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=VS0QZH1SMSXN tag=WML44UQOAFJW type=write size=2054081 2024-09-12T00:36:23.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.369+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=FP5EGVKKB90A type=write size=270740 2024-09-12T00:36:23.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.370+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=O35JDSCS4PSJ type=del 2024-09-12T00:36:23.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.371+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=J0XVRK9UYWB0 type=del size=1203656 2024-09-12T00:36:23.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.373+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=ZXZJU1JMETMF type=del 2024-09-12T00:36:23.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.375+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~WYRLX7D59HET.0 size=1048576 2024-09-12T00:36:23.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.376+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~WYRLX7D59HET.1 size=1048576 2024-09-12T00:36:23.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.377+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~WYRLX7D59HET.2 size=442228 2024-09-12T00:36:23.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.377+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=WYRLX7D59HET tag=22YGQ68EXHTH type=write size=3587956 2024-09-12T00:36:23.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.380+0000 7f030cb87780 1 < suggested remove operation key=JRPD5AAK84ZD tag=FKK78BGSCH3E type=del 2024-09-12T00:36:23.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.381+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=1KVCXZ8EHLSL type=del size=1693194 2024-09-12T00:36:23.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.384+0000 7f030cb87780 1 < completed write operation key=V87B6SDB1HFZ tag=0AFXC331NU8R type=write size=870166 2024-09-12T00:36:23.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.386+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=616ZG8X0FP1V type=del size=3851433 2024-09-12T00:36:23.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.387+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~H17M2O5LCRJU.0 size=1048576 2024-09-12T00:36:23.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.388+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~H17M2O5LCRJU.1 size=407295 2024-09-12T00:36:23.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.390+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=H17M2O5LCRJU tag=AYXPSH8RFB55 type=write size=2504447 2024-09-12T00:36:23.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.393+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~A0TURJ0MC8CR.0 size=1048576 2024-09-12T00:36:23.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.394+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~A0TURJ0MC8CR.1 size=1048576 2024-09-12T00:36:23.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.395+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~A0TURJ0MC8CR.2 size=173699 2024-09-12T00:36:23.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.395+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=A0TURJ0MC8CR tag=KTTOSDMM1TNZ type=write size=3319427 2024-09-12T00:36:23.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.398+0000 7f030cb87780 1 < suggested remove operation key=86TWUAZAHI4I tag=ONSI4VKEE9ZI type=del 2024-09-12T00:36:23.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.399+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=A5IJDOBM9LOD type=del size=3752609 2024-09-12T00:36:23.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.400+0000 7f030cb87780 1 < completed write operation key=IY156CJWG2TB tag=RJOZUO42EOAD type=write size=912608 2024-09-12T00:36:23.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.402+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=T94WOE191FT2 type=write size=56867 2024-09-12T00:36:23.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.403+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~UGJW6O31BTHS.0 size=1048576 2024-09-12T00:36:23.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.404+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~UGJW6O31BTHS.1 size=1017259 2024-09-12T00:36:23.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.407+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=UGJW6O31BTHS tag=71GKEI8RWG8S type=write size=3114411 2024-09-12T00:36:23.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.408+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=4LXPVL3E5F3X type=del size=189388 2024-09-12T00:36:23.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.410+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=QVL6EIS35PRA type=del 2024-09-12T00:36:23.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.412+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~UXLBBTB35LS2.0 size=1048576 2024-09-12T00:36:23.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.414+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~UXLBBTB35LS2.1 size=166505 2024-09-12T00:36:23.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.414+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=UXLBBTB35LS2 tag=GYZXGGZRO4S0 type=write size=2263657 2024-09-12T00:36:23.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.415+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~TP0GEZA7835I.0 size=1048576 2024-09-12T00:36:23.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.417+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~TP0GEZA7835I.1 size=805182 2024-09-12T00:36:23.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.419+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=TP0GEZA7835I tag=DVJWA6NE5GQP type=write size=2902334 2024-09-12T00:36:23.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.420+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=7P7KW209UVVJ type=del size=550417 2024-09-12T00:36:23.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.424+0000 7f030cb87780 1 < suggested remove operation key=IY156CJWG2TB tag=CZILEKVPNDTQ type=del 2024-09-12T00:36:23.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.426+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~KRJEDITLATFH.0 size=1048576 2024-09-12T00:36:23.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.428+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~KRJEDITLATFH.1 size=62247 2024-09-12T00:36:23.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.428+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=KRJEDITLATFH tag=2D3DC9GTY4CU type=write size=2159399 2024-09-12T00:36:23.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.428+0000 7f030cb87780 1 < canceled part key=_multipart_800OHA7UURC4.2~2AN8PJXJG2Q9.0 size=739610 2024-09-12T00:36:23.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.430+0000 7f030cb87780 1 < canceled multipart upload key=800OHA7UURC4 upload=2AN8PJXJG2Q9 tag=IV088A1146RY type=write size=1788186 2024-09-12T00:36:23.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.433+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=FOM9SODWGSFF type=del size=2266830 2024-09-12T00:36:23.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.434+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~QV2OA1QHNKQI.0 size=1048576 2024-09-12T00:36:23.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.436+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~QV2OA1QHNKQI.1 size=1048576 2024-09-12T00:36:23.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.437+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~QV2OA1QHNKQI.2 size=553829 2024-09-12T00:36:23.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.439+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=QV2OA1QHNKQI tag=07JTOL4J3FNJ type=write size=3699557 2024-09-12T00:36:23.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.440+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=CKV5Q01A6945 type=del size=2344403 2024-09-12T00:36:23.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.441+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=TI4Z3QDO1U2Y type=del 2024-09-12T00:36:23.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.442+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=X2AMSXSZ8NIF type=del size=4017619 2024-09-12T00:36:23.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.444+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~X46061VZP4TA.0 size=691989 2024-09-12T00:36:23.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.447+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=X46061VZP4TA tag=C0M2XR3N5HRM type=write size=1740565 2024-09-12T00:36:23.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.448+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=3GGX06VR49CL type=write size=350586 2024-09-12T00:36:23.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.449+0000 7f030cb87780 1 < canceled operation key=99OWKRGA8ZZN tag=FP5EGVKKB90A type=write size=270740 2024-09-12T00:36:23.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.450+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=5742Y56MKITZ type=del size=1248767 2024-09-12T00:36:23.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.453+0000 7f030cb87780 1 < suggested update operation key=327RDLIWLVRO tag=J0XVRK9UYWB0 type=del size=1203656 2024-09-12T00:36:23.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.455+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=1YXJRFM153EN type=del size=3641325 2024-09-12T00:36:23.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.456+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~WYRLX7D59HET.0 size=1048576 2024-09-12T00:36:23.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.457+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~WYRLX7D59HET.1 size=1048576 2024-09-12T00:36:23.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.459+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~WYRLX7D59HET.2 size=442228 2024-09-12T00:36:23.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.461+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=WYRLX7D59HET tag=22YGQ68EXHTH type=write size=3587956 2024-09-12T00:36:23.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.462+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=YUZXD2J841VS type=del size=1984648 2024-09-12T00:36:23.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.465+0000 7f030cb87780 1 < suggested update operation key=V0OLIRP3KH40 tag=1KVCXZ8EHLSL type=del size=1693194 2024-09-12T00:36:23.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.467+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~YTXWVK0664V2.0 size=1048576 2024-09-12T00:36:23.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.469+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~YTXWVK0664V2.1 size=1048576 2024-09-12T00:36:23.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.470+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~YTXWVK0664V2.2 size=677048 2024-09-12T00:36:23.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.470+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=YTXWVK0664V2 tag=88IGYW7D7GD4 type=write size=3822776 2024-09-12T00:36:23.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.471+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=616ZG8X0FP1V type=del 2024-09-12T00:36:23.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.474+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~9ZKB30FVHONX.0 size=1048576 2024-09-12T00:36:23.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.475+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~9ZKB30FVHONX.1 size=1048576 2024-09-12T00:36:23.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.476+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~9ZKB30FVHONX.2 size=924146 2024-09-12T00:36:23.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.476+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=9ZKB30FVHONX tag=GY1DX1L4Z1Y3 type=write size=4069874 2024-09-12T00:36:23.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.477+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~A0TURJ0MC8CR.0 size=1048576 2024-09-12T00:36:23.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.478+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~A0TURJ0MC8CR.1 size=1048576 2024-09-12T00:36:23.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.479+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~A0TURJ0MC8CR.2 size=173699 2024-09-12T00:36:23.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.482+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=A0TURJ0MC8CR tag=KTTOSDMM1TNZ type=write size=3319427 2024-09-12T00:36:23.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.484+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=LQFF7ODF1UC3 type=del size=2622595 2024-09-12T00:36:23.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.485+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=A5IJDOBM9LOD type=del 2024-09-12T00:36:23.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.486+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=H247EIR0BT3O type=del size=3778744 2024-09-12T00:36:23.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.489+0000 7f030cb87780 1 < suggested remove operation key=800OHA7UURC4 tag=T94WOE191FT2 type=write 2024-09-12T00:36:23.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.491+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=2UQK8ARC4UV0 type=write size=94568 2024-09-12T00:36:23.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.493+0000 7f030cb87780 1 < suggested remove operation key=V0OLIRP3KH40 tag=4LXPVL3E5F3X type=del 2024-09-12T00:36:23.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.496+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=BVV6WF7JPP0N type=del size=1886614 2024-09-12T00:36:23.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.496+0000 7f030cb87780 1 < canceled part key=_multipart_QGSJ51GMQXVK.2~UXLBBTB35LS2.0 size=1048576 2024-09-12T00:36:23.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.497+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~UXLBBTB35LS2.1 size=166505 2024-09-12T00:36:23.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.500+0000 7f030cb87780 1 < canceled multipart upload key=QGSJ51GMQXVK upload=UXLBBTB35LS2 tag=GYZXGGZRO4S0 type=write size=2263657 2024-09-12T00:36:23.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.500+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=CTUUHOPGYS0Y type=del size=3366937 2024-09-12T00:36:23.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.502+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=7P7KW209UVVJ type=del 2024-09-12T00:36:23.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.503+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=HEH2S4E7CCGG type=write size=432170 2024-09-12T00:36:23.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.504+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~KRJEDITLATFH.0 size=1048576 2024-09-12T00:36:23.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.506+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~KRJEDITLATFH.1 size=62247 2024-09-12T00:36:23.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.508+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=KRJEDITLATFH tag=2D3DC9GTY4CU type=write size=2159399 2024-09-12T00:36:23.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.510+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=PUWS085EY37B type=del size=2217576 2024-09-12T00:36:23.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.511+0000 7f030cb87780 -1 < failed to complete operation key=V0OLIRP3KH40 tag=FOM9SODWGSFF type=del size=2266830: (22) Invalid argument 2024-09-12T00:36:23.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.512+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=A856DRJZ39NX type=del size=857193 2024-09-12T00:36:23.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.516+0000 7f030cb87780 1 < suggested update operation key=39WSAOA6P09M tag=CKV5Q01A6945 type=del size=2344403 2024-09-12T00:36:23.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.518+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=1S6KR8X80K7P type=write size=284024 2024-09-12T00:36:23.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.520+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=X2AMSXSZ8NIF type=del 2024-09-12T00:36:23.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.521+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~QKNS8NUP10Y5.0 size=1048576 2024-09-12T00:36:23.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.523+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~QKNS8NUP10Y5.1 size=610444 2024-09-12T00:36:23.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.523+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=QKNS8NUP10Y5 tag=M5CYEWLVM0NY type=write size=2707596 2024-09-12T00:36:23.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.524+0000 7f030cb87780 1 < completed write operation key=HUDEU16YTO0Y tag=3GGX06VR49CL type=write size=350586 2024-09-12T00:36:23.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.527+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~611FEBXPMHO6.0 size=994560 2024-09-12T00:36:23.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.527+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=611FEBXPMHO6 tag=G4MD9MFSINW1 type=write size=2043136 2024-09-12T00:36:23.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.528+0000 7f030cb87780 1 < canceled operation key=IY156CJWG2TB tag=5742Y56MKITZ type=del size=1248767 2024-09-12T00:36:23.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.531+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~NW3SRVXENBW5.0 size=578764 2024-09-12T00:36:23.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.531+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=NW3SRVXENBW5 tag=8K6SSPE5OUIL type=write size=1627340 2024-09-12T00:36:23.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.534+0000 7f030cb87780 1 < suggested update operation key=IY156CJWG2TB tag=1YXJRFM153EN type=del size=3641325 2024-09-12T00:36:23.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.535+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=8UTKHZXZN1VN type=write size=739539 2024-09-12T00:36:23.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.536+0000 7f030cb87780 -1 < failed to complete operation key=39WSAOA6P09M tag=YUZXD2J841VS type=del size=1984648: (22) Invalid argument 2024-09-12T00:36:23.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.537+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=F9DLNJIFE5TH type=del size=711146 2024-09-12T00:36:23.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.537+0000 7f030cb87780 1 < canceled part key=_multipart_IHTFI7W4A6JT.2~YTXWVK0664V2.0 size=1048576 2024-09-12T00:36:23.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.539+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~YTXWVK0664V2.1 size=1048576 2024-09-12T00:36:23.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.540+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~YTXWVK0664V2.2 size=677048 2024-09-12T00:36:23.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.542+0000 7f030cb87780 1 < canceled multipart upload key=IHTFI7W4A6JT upload=YTXWVK0664V2 tag=88IGYW7D7GD4 type=write size=3822776 2024-09-12T00:36:23.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.544+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=NH3V3HG18V5N type=write size=928515 2024-09-12T00:36:23.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.545+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~9ZKB30FVHONX.0 size=1048576 2024-09-12T00:36:23.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.546+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~9ZKB30FVHONX.1 size=1048576 2024-09-12T00:36:23.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.547+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~9ZKB30FVHONX.2 size=924146 2024-09-12T00:36:23.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.550+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=9ZKB30FVHONX tag=GY1DX1L4Z1Y3 type=write size=4069874 2024-09-12T00:36:23.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.551+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=1AVIQ0FB7M71 type=del size=1582501 2024-09-12T00:36:23.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.552+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=LQFF7ODF1UC3 type=del 2024-09-12T00:36:23.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.554+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=X956WADM8VN2 type=write size=366604 2024-09-12T00:36:23.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.556+0000 7f030cb87780 1 < suggested update operation key=DLR6A7XOERHW tag=H247EIR0BT3O type=del size=3778744 2024-09-12T00:36:23.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.558+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=FQZKA20XGVXY type=del size=2227206 2024-09-12T00:36:23.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.560+0000 7f030cb87780 1 < suggested remove operation key=DLR6A7XOERHW tag=2UQK8ARC4UV0 type=write 2024-09-12T00:36:23.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.563+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~MTLM9GF37XM5.0 size=1048576 2024-09-12T00:36:23.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.564+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~MTLM9GF37XM5.1 size=1048576 2024-09-12T00:36:23.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.565+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~MTLM9GF37XM5.2 size=738523 2024-09-12T00:36:23.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.565+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=MTLM9GF37XM5 tag=TPJRRSCBSPKU type=write size=3884251 2024-09-12T00:36:23.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.567+0000 7f030cb87780 1 < suggested update operation key=N3KD1UVUVM95 tag=BVV6WF7JPP0N type=del size=1886614 2024-09-12T00:36:23.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.570+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~6Q3ZU6A2RKIQ.0 size=1048576 2024-09-12T00:36:23.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.571+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~6Q3ZU6A2RKIQ.1 size=1048576 2024-09-12T00:36:23.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.572+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~6Q3ZU6A2RKIQ.2 size=398668 2024-09-12T00:36:23.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.572+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=6Q3ZU6A2RKIQ tag=TXSI80238UC9 type=write size=3544396 2024-09-12T00:36:23.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.574+0000 7f030cb87780 1 < canceled operation key=HUDEU16YTO0Y tag=CTUUHOPGYS0Y type=del size=3366937 2024-09-12T00:36:23.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.576+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~2Q0AI75XNFB2.0 size=1048576 2024-09-12T00:36:23.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.577+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~2Q0AI75XNFB2.1 size=1048576 2024-09-12T00:36:23.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.578+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~2Q0AI75XNFB2.2 size=565325 2024-09-12T00:36:23.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.578+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=2Q0AI75XNFB2 tag=B96104UOAQ8F type=write size=3711053 2024-09-12T00:36:23.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.579+0000 7f030cb87780 1 < completed write operation key=CUDFTXFBC862 tag=HEH2S4E7CCGG type=write size=432170 2024-09-12T00:36:23.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.581+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=D76HZ8GJW0N9 type=del size=2325566 2024-09-12T00:36:23.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.582+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=PUWS085EY37B type=del 2024-09-12T00:36:23.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.584+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=6YSR8LPAHSTT type=del size=4092619 2024-09-12T00:36:23.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.585+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=A856DRJZ39NX type=del 2024-09-12T00:36:23.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.587+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=60B2HFMVWMI4 type=del size=809580 2024-09-12T00:36:23.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.588+0000 7f030cb87780 1 < completed write operation key=92GDVW0Q8VKQ tag=1S6KR8X80K7P type=write size=284024 2024-09-12T00:36:23.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.591+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~J4HHGCN25KT2.0 size=1048576 2024-09-12T00:36:23.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.592+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~J4HHGCN25KT2.1 size=161940 2024-09-12T00:36:23.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.592+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=J4HHGCN25KT2 tag=SDEGQF7XD8CQ type=write size=2259092 2024-09-12T00:36:23.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.593+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~QKNS8NUP10Y5.0 size=1048576 2024-09-12T00:36:23.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.594+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~QKNS8NUP10Y5.1 size=610444 2024-09-12T00:36:23.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.597+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=QKNS8NUP10Y5 tag=M5CYEWLVM0NY type=write size=2707596 2024-09-12T00:36:23.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.598+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=I0MV7T4I3ELI type=write size=254236 2024-09-12T00:36:23.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.599+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~611FEBXPMHO6.0 size=994560 2024-09-12T00:36:23.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.602+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=611FEBXPMHO6 tag=G4MD9MFSINW1 type=write size=2043136 2024-09-12T00:36:23.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.603+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=IOUU07XFH21E type=del size=2998470 2024-09-12T00:36:23.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.604+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~NW3SRVXENBW5.0 size=578764 2024-09-12T00:36:23.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.606+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=NW3SRVXENBW5 tag=8K6SSPE5OUIL type=write size=1627340 2024-09-12T00:36:23.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.609+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~0XWK15BCRW3T.0 size=1048576 2024-09-12T00:36:23.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.610+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~0XWK15BCRW3T.1 size=716920 2024-09-12T00:36:23.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.610+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=0XWK15BCRW3T tag=NOEZ0AR4B6CG type=write size=2814072 2024-09-12T00:36:23.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.612+0000 7f030cb87780 1 < suggested remove operation key=V0OLIRP3KH40 tag=8UTKHZXZN1VN type=write 2024-09-12T00:36:23.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.614+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=BEDNS75E273M type=del size=743818 2024-09-12T00:36:23.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.615+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=F9DLNJIFE5TH type=del 2024-09-12T00:36:23.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.617+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=0ZVOM03J3XD4 type=del size=3246463 2024-09-12T00:36:23.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.618+0000 7f030cb87780 1 < completed write operation key=9MCRD2G3MZIT tag=NH3V3HG18V5N type=write size=928515 2024-09-12T00:36:23.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.619+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=YYWRHJ3W1ZD1 type=del size=2102480 2024-09-12T00:36:23.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.621+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=1AVIQ0FB7M71 type=del 2024-09-12T00:36:23.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.623+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~WCP5562J3V8J.0 size=1048576 2024-09-12T00:36:23.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.624+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~WCP5562J3V8J.1 size=1048576 2024-09-12T00:36:23.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.625+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~WCP5562J3V8J.2 size=483420 2024-09-12T00:36:23.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.625+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=WCP5562J3V8J tag=1TJS15B4JET1 type=write size=3629148 2024-09-12T00:36:23.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.627+0000 7f030cb87780 1 < completed write operation key=ELX0797T1L4C tag=X956WADM8VN2 type=write size=366604 2024-09-12T00:36:23.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.628+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=48K1T0XJYJ8W type=del size=220912 2024-09-12T00:36:23.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.629+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=FQZKA20XGVXY type=del 2024-09-12T00:36:23.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.631+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=HM44DG2D9FTQ type=write size=924891 2024-09-12T00:36:23.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.632+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~MTLM9GF37XM5.0 size=1048576 2024-09-12T00:36:23.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.633+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~MTLM9GF37XM5.1 size=1048576 2024-09-12T00:36:23.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.634+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~MTLM9GF37XM5.2 size=738523 2024-09-12T00:36:23.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.637+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=MTLM9GF37XM5 tag=TPJRRSCBSPKU type=write size=3884251 2024-09-12T00:36:23.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.638+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=PE5DVXLS9H2R type=write size=593378 2024-09-12T00:36:23.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.638+0000 7f030cb87780 1 < canceled part key=_multipart_INFFH9R3EFRY.2~6Q3ZU6A2RKIQ.0 size=1048576 2024-09-12T00:36:23.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.639+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~6Q3ZU6A2RKIQ.1 size=1048576 2024-09-12T00:36:23.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.641+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~6Q3ZU6A2RKIQ.2 size=398668 2024-09-12T00:36:23.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.644+0000 7f030cb87780 1 < canceled multipart upload key=INFFH9R3EFRY upload=6Q3ZU6A2RKIQ tag=TXSI80238UC9 type=write size=3544396 2024-09-12T00:36:23.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.645+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=LNAZBEMLHE95 type=del size=1064031 2024-09-12T00:36:23.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.648+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~2Q0AI75XNFB2.0 size=1048576 2024-09-12T00:36:23.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.651+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~2Q0AI75XNFB2.1 size=1048576 2024-09-12T00:36:23.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.652+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~2Q0AI75XNFB2.2 size=565325 2024-09-12T00:36:23.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.654+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=2Q0AI75XNFB2 tag=B96104UOAQ8F type=write size=3711053 2024-09-12T00:36:23.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.655+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=OCCRCRE63PVP type=del size=3460133 2024-09-12T00:36:23.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.657+0000 7f030cb87780 1 < canceled operation key=IHTFI7W4A6JT tag=D76HZ8GJW0N9 type=del size=2325566 2024-09-12T00:36:23.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.658+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=9BMV8LKVA1ZH type=del size=3558818 2024-09-12T00:36:23.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.660+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=6YSR8LPAHSTT type=del 2024-09-12T00:36:23.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.662+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=4JDNOAW1GGD3 type=del size=2408117 2024-09-12T00:36:23.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.663+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=60B2HFMVWMI4 type=del 2024-09-12T00:36:23.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.666+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=8CYJSLOL45GB type=del size=1145157 2024-09-12T00:36:23.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.666+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~J4HHGCN25KT2.0 size=1048576 2024-09-12T00:36:23.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.666+0000 7f030cb87780 1 < canceled part key=_multipart_CUDFTXFBC862.2~J4HHGCN25KT2.1 size=161940 2024-09-12T00:36:23.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.669+0000 7f030cb87780 1 < canceled multipart upload key=CUDFTXFBC862 upload=J4HHGCN25KT2 tag=SDEGQF7XD8CQ type=write size=2259092 2024-09-12T00:36:23.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.670+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=MMA5H9HUGZMN type=del size=1457736 2024-09-12T00:36:23.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.672+0000 7f030cb87780 1 < completed write operation key=99OWKRGA8ZZN tag=I0MV7T4I3ELI type=write size=254236 2024-09-12T00:36:23.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.673+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=LRKHGAQ5XMR1 type=del size=989186 2024-09-12T00:36:23.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.674+0000 7f030cb87780 1 < canceled operation key=V87B6SDB1HFZ tag=IOUU07XFH21E type=del size=2998470 2024-09-12T00:36:23.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.677+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~4H9A67EOZ6T2.0 size=1048576 2024-09-12T00:36:23.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.678+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~4H9A67EOZ6T2.1 size=1048576 2024-09-12T00:36:23.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.679+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~4H9A67EOZ6T2.2 size=110664 2024-09-12T00:36:23.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.679+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=4H9A67EOZ6T2 tag=3NLXIKK2PIA0 type=write size=3256392 2024-09-12T00:36:23.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.681+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~0XWK15BCRW3T.0 size=1048576 2024-09-12T00:36:23.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.683+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~0XWK15BCRW3T.1 size=716920 2024-09-12T00:36:23.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.685+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=0XWK15BCRW3T tag=NOEZ0AR4B6CG type=write size=2814072 2024-09-12T00:36:23.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.685+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=0PZJEOSFDFWY type=del size=426455 2024-09-12T00:36:23.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.687+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=BEDNS75E273M type=del 2024-09-12T00:36:23.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.688+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=93WNZ56WIQOJ type=del size=3624501 2024-09-12T00:36:23.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.690+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=0ZVOM03J3XD4 type=del 2024-09-12T00:36:23.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.693+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~TX3SJOCV1Q4J.0 size=1048576 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.694+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~TX3SJOCV1Q4J.1 size=1048576 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.695+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~TX3SJOCV1Q4J.2 size=514116 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.695+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=TX3SJOCV1Q4J tag=H33SHEVXQ764 type=write size=3659844 2024-09-12T00:36:23.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.696+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=YYWRHJ3W1ZD1 type=del 2024-09-12T00:36:23.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.697+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=I6Q5394AHNM9 type=del size=3599529 2024-09-12T00:36:23.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.699+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~WCP5562J3V8J.0 size=1048576 2024-09-12T00:36:23.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.701+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~WCP5562J3V8J.1 size=1048576 2024-09-12T00:36:23.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.702+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~WCP5562J3V8J.2 size=483420 2024-09-12T00:36:23.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.703+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=WCP5562J3V8J tag=1TJS15B4JET1 type=write size=3629148 2024-09-12T00:36:23.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.706+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~LQKR08N8LZ2Y.0 size=168631 2024-09-12T00:36:23.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.706+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=LQKR08N8LZ2Y tag=O8MWJNRC2UYN type=write size=1217207 2024-09-12T00:36:23.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.707+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=48K1T0XJYJ8W type=del 2024-09-12T00:36:23.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.709+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=P86B2CYG0TYR type=del size=1702935 2024-09-12T00:36:23.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.710+0000 7f030cb87780 1 < completed write operation key=92GDVW0Q8VKQ tag=HM44DG2D9FTQ type=write size=924891 2024-09-12T00:36:23.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.712+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=GL04HFRGXFJ8 type=del size=698721 2024-09-12T00:36:23.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.714+0000 7f030cb87780 1 < completed write operation key=V87B6SDB1HFZ tag=PE5DVXLS9H2R type=write size=593378 2024-09-12T00:36:23.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.715+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=B11FDAPKH2EG type=write size=868335 2024-09-12T00:36:23.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.717+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=LNAZBEMLHE95 type=del 2024-09-12T00:36:23.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.718+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=XJBK195603NL type=del size=3094227 2024-09-12T00:36:23.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.720+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=OCCRCRE63PVP type=del 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.723+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~IKHCWZXIAZQ0.0 size=279635 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.723+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=IKHCWZXIAZQ0 tag=PJCLK0XIQXEC type=write size=1328211 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.723+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=9BMV8LKVA1ZH type=del 2024-09-12T00:36:23.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.725+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=RH75EPKGJ3BO type=write size=524872 2024-09-12T00:36:23.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.728+0000 7f030cb87780 1 < suggested update operation key=DLR6A7XOERHW tag=4JDNOAW1GGD3 type=del size=2408117 2024-09-12T00:36:23.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.729+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=Y66G73S3TO5L type=del size=759686 2024-09-12T00:36:23.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.732+0000 7f030cb87780 1 < suggested update operation key=9MCRD2G3MZIT tag=8CYJSLOL45GB type=del size=1145157 2024-09-12T00:36:23.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.734+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~C0NHRO6AY06B.0 size=528531 2024-09-12T00:36:23.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.734+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=C0NHRO6AY06B tag=DK377N8P7G57 type=write size=1577107 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.737+0000 7f030cb87780 1 < suggested remove operation key=9MCRD2G3MZIT tag=MMA5H9HUGZMN type=del 2024-09-12T00:36:23.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.740+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~9HQV2QZHNCJ9.0 size=1048576 2024-09-12T00:36:23.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.741+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~9HQV2QZHNCJ9.1 size=587323 2024-09-12T00:36:23.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.741+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=9HQV2QZHNCJ9 tag=DE9OAVYS7PBZ type=write size=2684475 2024-09-12T00:36:23.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.742+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=LRKHGAQ5XMR1 type=del 2024-09-12T00:36:23.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.744+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=UWD201DW0F0W type=del size=272532 2024-09-12T00:36:23.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.745+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~4H9A67EOZ6T2.0 size=1048576 2024-09-12T00:36:23.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.746+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~4H9A67EOZ6T2.1 size=1048576 2024-09-12T00:36:23.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.747+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~4H9A67EOZ6T2.2 size=110664 2024-09-12T00:36:23.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.750+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=4H9A67EOZ6T2 tag=3NLXIKK2PIA0 type=write size=3256392 2024-09-12T00:36:23.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.751+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=5XIS0KLGK1J0 type=del size=2997325 2024-09-12T00:36:23.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.754+0000 7f030cb87780 1 < suggested update operation key=56I20YIPY82N tag=0PZJEOSFDFWY type=del size=426455 2024-09-12T00:36:23.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.755+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=A1IVS1HTVHP2 type=write size=616212 2024-09-12T00:36:23.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.756+0000 7f030cb87780 -1 < failed to complete operation key=DLR6A7XOERHW tag=93WNZ56WIQOJ type=del size=3624501: (22) Invalid argument 2024-09-12T00:36:23.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.759+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~4VNK8VSC705Z.0 size=1048576 2024-09-12T00:36:23.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.760+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~4VNK8VSC705Z.1 size=1048576 2024-09-12T00:36:23.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.760+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~4VNK8VSC705Z.2 size=477138 2024-09-12T00:36:23.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.760+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=4VNK8VSC705Z tag=2SDAFZC2B1E5 type=write size=3622866 2024-09-12T00:36:23.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.762+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~TX3SJOCV1Q4J.0 size=1048576 2024-09-12T00:36:23.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.763+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~TX3SJOCV1Q4J.1 size=1048576 2024-09-12T00:36:23.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.764+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~TX3SJOCV1Q4J.2 size=514116 2024-09-12T00:36:23.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.766+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=TX3SJOCV1Q4J tag=H33SHEVXQ764 type=write size=3659844 2024-09-12T00:36:23.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.768+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~1DQF1LFD1OLY.0 size=1048576 2024-09-12T00:36:23.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.770+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~1DQF1LFD1OLY.1 size=941563 2024-09-12T00:36:23.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.770+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=1DQF1LFD1OLY tag=PUNKA8JN76M7 type=write size=3038715 2024-09-12T00:36:23.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.771+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=I6Q5394AHNM9 type=del 2024-09-12T00:36:23.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.773+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~YUADX71ZYW2N.0 size=379603 2024-09-12T00:36:23.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.773+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=YUADX71ZYW2N tag=JU9SGL6EJHG5 type=write size=1428179 2024-09-12T00:36:23.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.775+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~LQKR08N8LZ2Y.0 size=168631 2024-09-12T00:36:23.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.777+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=LQKR08N8LZ2Y tag=O8MWJNRC2UYN type=write size=1217207 2024-09-12T00:36:23.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.780+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~U5NU8SH8E9R3.0 size=1048576 2024-09-12T00:36:23.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.781+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~U5NU8SH8E9R3.1 size=1048576 2024-09-12T00:36:23.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.782+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~U5NU8SH8E9R3.2 size=947831 2024-09-12T00:36:23.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.783+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=U5NU8SH8E9R3 tag=1UTE5620T2F6 type=write size=4093559 2024-09-12T00:36:23.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.785+0000 7f030cb87780 1 < suggested remove operation key=327RDLIWLVRO tag=P86B2CYG0TYR type=del 2024-09-12T00:36:23.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.790+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~9D439S0XX783.0 size=1048576 2024-09-12T00:36:23.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.791+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~9D439S0XX783.1 size=1048576 2024-09-12T00:36:23.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.792+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~9D439S0XX783.2 size=844046 2024-09-12T00:36:23.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.792+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=9D439S0XX783 tag=X03L357WTWW2 type=write size=3989774 2024-09-12T00:36:23.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.794+0000 7f030cb87780 1 < suggested remove operation key=N3KD1UVUVM95 tag=GL04HFRGXFJ8 type=del 2024-09-12T00:36:23.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.796+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=EH4FDW93OFXP type=del size=3268939 2024-09-12T00:36:23.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.798+0000 7f030cb87780 1 < completed write operation key=U5CWO1EN8BFI tag=B11FDAPKH2EG type=write size=868335 2024-09-12T00:36:23.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.799+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=GQ9PWVWRSWD6 type=write size=142641 2024-09-12T00:36:23.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.800+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=XJBK195603NL type=del 2024-09-12T00:36:23.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.802+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=RSVLTHKYFTI5 type=del size=2784230 2024-09-12T00:36:23.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.803+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~IKHCWZXIAZQ0.0 size=279635 2024-09-12T00:36:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.805+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=IKHCWZXIAZQ0 tag=PJCLK0XIQXEC type=write size=1328211 2024-09-12T00:36:23.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.807+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=3T3Y3K96K91B type=del size=1602769 2024-09-12T00:36:23.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.808+0000 7f030cb87780 1 < completed write operation key=ATTMOL2TGUN7 tag=RH75EPKGJ3BO type=write size=524872 2024-09-12T00:36:23.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.811+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~NDUF2WEXWO4U.0 size=1048576 2024-09-12T00:36:23.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.812+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~NDUF2WEXWO4U.1 size=1048576 2024-09-12T00:36:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.813+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~NDUF2WEXWO4U.2 size=614354 2024-09-12T00:36:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.813+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=NDUF2WEXWO4U tag=3NB4717XJL9Z type=write size=3760082 2024-09-12T00:36:23.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.814+0000 7f030cb87780 -1 < failed to complete operation key=N3KD1UVUVM95 tag=Y66G73S3TO5L type=del size=759686: (22) Invalid argument 2024-09-12T00:36:23.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.815+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=H3JW2ZW8XTS9 type=write size=103701 2024-09-12T00:36:23.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.818+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~C0NHRO6AY06B.0 size=528531 2024-09-12T00:36:23.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.819+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=C0NHRO6AY06B tag=DK377N8P7G57 type=write size=1577107 2024-09-12T00:36:23.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.821+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=BO344H5HS4NS type=del size=3278008 2024-09-12T00:36:23.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.822+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~9HQV2QZHNCJ9.0 size=1048576 2024-09-12T00:36:23.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.822+0000 7f030cb87780 1 < canceled part key=_multipart_N3KD1UVUVM95.2~9HQV2QZHNCJ9.1 size=587323 2024-09-12T00:36:23.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.824+0000 7f030cb87780 1 < canceled multipart upload key=N3KD1UVUVM95 upload=9HQV2QZHNCJ9 tag=DE9OAVYS7PBZ type=write size=2684475 2024-09-12T00:36:23.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.826+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=XLG27F4ESGIZ type=del size=1723140 2024-09-12T00:36:23.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.827+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=UWD201DW0F0W type=del 2024-09-12T00:36:23.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.828+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=P3GI052IYMZ3 type=write size=207104 2024-09-12T00:36:23.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.832+0000 7f030cb87780 1 < suggested remove operation key=JRPD5AAK84ZD tag=5XIS0KLGK1J0 type=del 2024-09-12T00:36:23.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.832+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=7IA47GW89J0J type=del size=896646 2024-09-12T00:36:23.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.834+0000 7f030cb87780 1 < completed write operation key=INFFH9R3EFRY tag=A1IVS1HTVHP2 type=write size=616212 2024-09-12T00:36:23.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.836+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=CG4FV1MWE9HX type=write size=249472 2024-09-12T00:36:23.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.837+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~4VNK8VSC705Z.0 size=1048576 2024-09-12T00:36:23.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.838+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~4VNK8VSC705Z.1 size=1048576 2024-09-12T00:36:23.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.840+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~4VNK8VSC705Z.2 size=477138 2024-09-12T00:36:23.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.841+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=4VNK8VSC705Z tag=2SDAFZC2B1E5 type=write size=3622866 2024-09-12T00:36:23.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.842+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=POIQG3AATJ6E type=del size=2792796 2024-09-12T00:36:23.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.844+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~1DQF1LFD1OLY.0 size=1048576 2024-09-12T00:36:23.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.845+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~1DQF1LFD1OLY.1 size=941563 2024-09-12T00:36:23.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.847+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=1DQF1LFD1OLY tag=PUNKA8JN76M7 type=write size=3038715 2024-09-12T00:36:23.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.849+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~SW0O64RIMO2V.0 size=1048576 2024-09-12T00:36:23.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.850+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~SW0O64RIMO2V.1 size=507920 2024-09-12T00:36:23.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.850+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=SW0O64RIMO2V tag=UGX2OEG34X8V type=write size=2605072 2024-09-12T00:36:23.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.852+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~YUADX71ZYW2N.0 size=379603 2024-09-12T00:36:23.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.854+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=YUADX71ZYW2N tag=JU9SGL6EJHG5 type=write size=1428179 2024-09-12T00:36:23.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.856+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~FGS2VEZ7SG3I.0 size=1048576 2024-09-12T00:36:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.857+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~FGS2VEZ7SG3I.1 size=623547 2024-09-12T00:36:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.857+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=FGS2VEZ7SG3I tag=G2H5G7PESK4S type=write size=2720699 2024-09-12T00:36:23.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.859+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~U5NU8SH8E9R3.0 size=1048576 2024-09-12T00:36:23.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.859+0000 7f030cb87780 1 < canceled part key=_multipart_3W7ANGL92ZF0.2~U5NU8SH8E9R3.1 size=1048576 2024-09-12T00:36:23.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.860+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~U5NU8SH8E9R3.2 size=947831 2024-09-12T00:36:23.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.862+0000 7f030cb87780 1 < canceled multipart upload key=3W7ANGL92ZF0 upload=U5NU8SH8E9R3 tag=1UTE5620T2F6 type=write size=4093559 2024-09-12T00:36:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.864+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=DFMCXT6S6Z4I type=del size=1813534 2024-09-12T00:36:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.865+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~9D439S0XX783.0 size=1048576 2024-09-12T00:36:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.866+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~9D439S0XX783.1 size=1048576 2024-09-12T00:36:23.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.867+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~9D439S0XX783.2 size=844046 2024-09-12T00:36:23.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.869+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=9D439S0XX783 tag=X03L357WTWW2 type=write size=3989774 2024-09-12T00:36:23.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.871+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=T0QVFXZEI0MB type=del size=1101730 2024-09-12T00:36:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.873+0000 7f030cb87780 1 < suggested update operation key=UFYMVGL264T8 tag=EH4FDW93OFXP type=del size=3268939 2024-09-12T00:36:23.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.876+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~OS1TO3IJP62U.0 size=873202 2024-09-12T00:36:23.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.876+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=OS1TO3IJP62U tag=GPIKPFAPAE9M type=write size=1921778 2024-09-12T00:36:23.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.877+0000 7f030cb87780 1 < completed write operation key=QGSJ51GMQXVK tag=GQ9PWVWRSWD6 type=write size=142641 2024-09-12T00:36:23.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.878+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=7CCK09OW42IX type=del size=2311554 2024-09-12T00:36:23.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.880+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=RSVLTHKYFTI5 type=del 2024-09-12T00:36:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.881+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=KL48U9O7OEQI type=write size=27187 2024-09-12T00:36:23.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.882+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=3T3Y3K96K91B type=del 2024-09-12T00:36:23.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.884+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=BS2ULOUGCSTE type=del size=3957107 2024-09-12T00:36:23.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.885+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~NDUF2WEXWO4U.0 size=1048576 2024-09-12T00:36:23.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.887+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~NDUF2WEXWO4U.1 size=1048576 2024-09-12T00:36:23.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.888+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~NDUF2WEXWO4U.2 size=614354 2024-09-12T00:36:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.890+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=NDUF2WEXWO4U tag=3NB4717XJL9Z type=write size=3760082 2024-09-12T00:36:23.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.893+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~QN022OBR6QO8.0 size=1048576 2024-09-12T00:36:23.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.894+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~QN022OBR6QO8.1 size=270076 2024-09-12T00:36:23.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.894+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=QN022OBR6QO8 tag=S8Q91STKNL6S type=write size=2367228 2024-09-12T00:36:23.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.896+0000 7f030cb87780 1 < suggested update operation key=JPEIGLC162K3 tag=H3JW2ZW8XTS9 type=write size=103701 2024-09-12T00:36:23.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.898+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=3PLYWDO92WCG type=write size=797890 2024-09-12T00:36:23.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.899+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=BO344H5HS4NS type=del 2024-09-12T00:36:23.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.902+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~7FPUY10HEOTE.0 size=1048576 2024-09-12T00:36:23.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.904+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~7FPUY10HEOTE.1 size=570216 2024-09-12T00:36:23.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.904+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=7FPUY10HEOTE tag=7AC8BKFDY0S3 type=write size=2667368 2024-09-12T00:36:23.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.904+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=XLG27F4ESGIZ type=del 2024-09-12T00:36:23.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.906+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=J2F2E76NNYW5 type=del size=1091967 2024-09-12T00:36:23.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.908+0000 7f030cb87780 1 < canceled operation key=U5CWO1EN8BFI tag=P3GI052IYMZ3 type=write size=207104 2024-09-12T00:36:23.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.910+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=VZMJC4WMV67M type=del size=2466790 2024-09-12T00:36:23.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.911+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=7IA47GW89J0J type=del 2024-09-12T00:36:23.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.912+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=DBAP0YDHTBOC type=write size=670196 2024-09-12T00:36:23.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.915+0000 7f030cb87780 1 < suggested remove operation key=3W7ANGL92ZF0 tag=CG4FV1MWE9HX type=write 2024-09-12T00:36:23.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.917+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=IX01V8YZJWEF type=del size=3584013 2024-09-12T00:36:23.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.918+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=POIQG3AATJ6E type=del 2024-09-12T00:36:23.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.919+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=QFZXJUN51I63 type=del size=685798 2024-09-12T00:36:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.921+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~SW0O64RIMO2V.0 size=1048576 2024-09-12T00:36:23.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.922+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~SW0O64RIMO2V.1 size=507920 2024-09-12T00:36:23.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.924+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=SW0O64RIMO2V tag=UGX2OEG34X8V type=write size=2605072 2024-09-12T00:36:23.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.927+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~AQLPUNW1F7TG.0 size=1048576 2024-09-12T00:36:23.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.927+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~AQLPUNW1F7TG.1 size=854730 2024-09-12T00:36:23.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.927+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=AQLPUNW1F7TG tag=JD2JA22NLLX9 type=write size=2951882 2024-09-12T00:36:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.929+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~FGS2VEZ7SG3I.0 size=1048576 2024-09-12T00:36:23.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.930+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~FGS2VEZ7SG3I.1 size=623547 2024-09-12T00:36:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.932+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=FGS2VEZ7SG3I tag=G2H5G7PESK4S type=write size=2720699 2024-09-12T00:36:23.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.934+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=DD6XUR4BBVBR type=del size=4142397 2024-09-12T00:36:23.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.935+0000 7f030cb87780 -1 < failed to complete operation key=JPEIGLC162K3 tag=DFMCXT6S6Z4I type=del size=1813534: (22) Invalid argument 2024-09-12T00:36:23.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.938+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~8KL2UTQUJHZK.0 size=1048576 2024-09-12T00:36:23.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.939+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~8KL2UTQUJHZK.1 size=161923 2024-09-12T00:36:23.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.939+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=8KL2UTQUJHZK tag=YB3Y7I71AW8M type=write size=2259075 2024-09-12T00:36:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.940+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=T0QVFXZEI0MB type=del 2024-09-12T00:36:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.942+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=MDPQFTH8PIE3 type=del size=4106019 2024-09-12T00:36:23.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.942+0000 7f030cb87780 1 < canceled part key=_multipart_56I20YIPY82N.2~OS1TO3IJP62U.0 size=873202 2024-09-12T00:36:23.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.944+0000 7f030cb87780 1 < canceled multipart upload key=56I20YIPY82N upload=OS1TO3IJP62U tag=GPIKPFAPAE9M type=write size=1921778 2024-09-12T00:36:23.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.946+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=P1EOSL27BQP8 type=del size=101743 2024-09-12T00:36:23.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.947+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=7CCK09OW42IX type=del 2024-09-12T00:36:23.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.949+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=969REIUYYH6R type=del size=3091308 2024-09-12T00:36:23.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.950+0000 7f030cb87780 1 < completed write operation key=QGSJ51GMQXVK tag=KL48U9O7OEQI type=write size=27187 2024-09-12T00:36:23.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.951+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=XQHZ9NG648S5 type=write size=1027904 2024-09-12T00:36:23.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.953+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=BS2ULOUGCSTE type=del 2024-09-12T00:36:23.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.955+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~XT9AYTQBSZTK.0 size=1048576 2024-09-12T00:36:23.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.956+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~XT9AYTQBSZTK.1 size=1048576 2024-09-12T00:36:23.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.957+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~XT9AYTQBSZTK.2 size=665182 2024-09-12T00:36:23.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.957+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=XT9AYTQBSZTK tag=6VEUFWN6H83A type=write size=3810910 2024-09-12T00:36:23.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.959+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~QN022OBR6QO8.0 size=1048576 2024-09-12T00:36:23.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.960+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~QN022OBR6QO8.1 size=270076 2024-09-12T00:36:23.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.963+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=QN022OBR6QO8 tag=S8Q91STKNL6S type=write size=2367228 2024-09-12T00:36:23.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.964+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=Q2HLN2N197TY type=del size=72957 2024-09-12T00:36:23.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.966+0000 7f030cb87780 1 < completed write operation key=U5CWO1EN8BFI tag=3PLYWDO92WCG type=write size=797890 2024-09-12T00:36:23.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.967+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=3IFVWUPB9KLA type=del size=486603 2024-09-12T00:36:23.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.967+0000 7f030cb87780 1 < canceled part key=_multipart_1PLGUJCB6J0V.2~7FPUY10HEOTE.0 size=1048576 2024-09-12T00:36:23.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.967+0000 7f030cb87780 1 < canceled part key=_multipart_1PLGUJCB6J0V.2~7FPUY10HEOTE.1 size=570216 2024-09-12T00:36:23.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.970+0000 7f030cb87780 1 < canceled multipart upload key=1PLGUJCB6J0V upload=7FPUY10HEOTE tag=7AC8BKFDY0S3 type=write size=2667368 2024-09-12T00:36:23.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.972+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~F1RZI7Y2YP4K.0 size=1048576 2024-09-12T00:36:23.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.974+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~F1RZI7Y2YP4K.1 size=1048576 2024-09-12T00:36:23.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.975+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~F1RZI7Y2YP4K.2 size=596803 2024-09-12T00:36:23.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.975+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=F1RZI7Y2YP4K tag=MZAXKYQQ1F3U type=write size=3742531 2024-09-12T00:36:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.976+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=J2F2E76NNYW5 type=del 2024-09-12T00:36:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.978+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~91DY5KKXH7Y4.0 size=1048576 2024-09-12T00:36:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.979+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~91DY5KKXH7Y4.1 size=531288 2024-09-12T00:36:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.979+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=91DY5KKXH7Y4 tag=XA3BCVKK5MD1 type=write size=2628440 2024-09-12T00:36:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.981+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=VZMJC4WMV67M type=del 2024-09-12T00:36:23.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.982+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=I4E2CY69TK9W type=del size=3511684 2024-09-12T00:36:23.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.985+0000 7f030cb87780 1 < suggested update operation key=U5CWO1EN8BFI tag=DBAP0YDHTBOC type=write size=670196 2024-09-12T00:36:23.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.987+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~45V2FFZ1H2G7.0 size=1048576 2024-09-12T00:36:23.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.988+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~45V2FFZ1H2G7.1 size=588401 2024-09-12T00:36:23.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.988+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=45V2FFZ1H2G7 tag=ZSGXB52164M6 type=write size=2685553 2024-09-12T00:36:23.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.991+0000 7f030cb87780 1 < suggested remove operation key=327RDLIWLVRO tag=IX01V8YZJWEF type=del 2024-09-12T00:36:23.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.993+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~B3ZLW0D0RREP.0 size=1048576 2024-09-12T00:36:23.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.995+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~B3ZLW0D0RREP.1 size=787029 2024-09-12T00:36:23.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.995+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=B3ZLW0D0RREP tag=O7V7RYI7EAXR type=write size=2884181 2024-09-12T00:36:23.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.996+0000 7f030cb87780 -1 < failed to complete operation key=327RDLIWLVRO tag=QFZXJUN51I63 type=del size=685798: (22) Invalid argument 2024-09-12T00:36:23.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.997+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=JZVK4BDUN8ER type=del size=2550939 2024-09-12T00:36:23.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:23.998+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~AQLPUNW1F7TG.0 size=1048576 2024-09-12T00:36:23.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.000+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~AQLPUNW1F7TG.1 size=854730 2024-09-12T00:36:24.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.002+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=AQLPUNW1F7TG tag=JD2JA22NLLX9 type=write size=2951882 2024-09-12T00:36:24.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.004+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~5T6KN0O4U8RB.0 size=1048576 2024-09-12T00:36:24.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.006+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~5T6KN0O4U8RB.1 size=797867 2024-09-12T00:36:24.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.006+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=5T6KN0O4U8RB tag=56IYM2EOT2JM type=write size=2895019 2024-09-12T00:36:24.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.007+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=DD6XUR4BBVBR type=del 2024-09-12T00:36:24.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.008+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=JLA53LQ4DTXY type=del size=3851234 2024-09-12T00:36:24.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.010+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~8KL2UTQUJHZK.0 size=1048576 2024-09-12T00:36:24.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.011+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~8KL2UTQUJHZK.1 size=161923 2024-09-12T00:36:24.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.013+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=8KL2UTQUJHZK tag=YB3Y7I71AW8M type=write size=2259075 2024-09-12T00:36:24.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.014+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=2XMCDEUC64QG type=del size=2861925 2024-09-12T00:36:24.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.016+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=MDPQFTH8PIE3 type=del 2024-09-12T00:36:24.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.018+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~JYGSGQVAV0VK.0 size=762205 2024-09-12T00:36:24.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.018+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=JYGSGQVAV0VK tag=OTRRTNV8S35R type=write size=1810781 2024-09-12T00:36:24.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.020+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=P1EOSL27BQP8 type=del 2024-09-12T00:36:24.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.021+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=3KGR0AJB4YO0 type=del size=2571793 2024-09-12T00:36:24.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.022+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=969REIUYYH6R type=del 2024-09-12T00:36:24.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.024+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=0XC6SMV5EXDS type=del size=2563048 2024-09-12T00:36:24.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.025+0000 7f030cb87780 1 < completed write operation key=INFFH9R3EFRY tag=XQHZ9NG648S5 type=write size=1027904 2024-09-12T00:36:24.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.026+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=TEP00199ZIAR type=del size=1576517 2024-09-12T00:36:24.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.028+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~XT9AYTQBSZTK.0 size=1048576 2024-09-12T00:36:24.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.029+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~XT9AYTQBSZTK.1 size=1048576 2024-09-12T00:36:24.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.030+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~XT9AYTQBSZTK.2 size=665182 2024-09-12T00:36:24.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.033+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=XT9AYTQBSZTK tag=6VEUFWN6H83A type=write size=3810910 2024-09-12T00:36:24.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.035+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~4Y4SDTZFEY7F.0 size=1048576 2024-09-12T00:36:24.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.037+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~4Y4SDTZFEY7F.1 size=427321 2024-09-12T00:36:24.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.037+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=4Y4SDTZFEY7F tag=1SWP9FT3ZP5A type=write size=2524473 2024-09-12T00:36:24.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.039+0000 7f030cb87780 1 < canceled operation key=CY2NS03IIUJJ tag=Q2HLN2N197TY type=del size=72957 2024-09-12T00:36:24.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.040+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=MTXD0CK7WRUT type=del size=2703877 2024-09-12T00:36:24.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.042+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=3IFVWUPB9KLA type=del 2024-09-12T00:36:24.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.043+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=GUKGU4DEIU2R type=del size=1738931 2024-09-12T00:36:24.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.047+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~F1RZI7Y2YP4K.0 size=1048576 2024-09-12T00:36:24.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.047+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~F1RZI7Y2YP4K.1 size=1048576 2024-09-12T00:36:24.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.048+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~F1RZI7Y2YP4K.2 size=596803 2024-09-12T00:36:24.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.050+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=F1RZI7Y2YP4K tag=MZAXKYQQ1F3U type=write size=3742531 2024-09-12T00:36:24.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.053+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~GTM3CVATA12W.0 size=1048576 2024-09-12T00:36:24.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.054+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~GTM3CVATA12W.1 size=1048576 2024-09-12T00:36:24.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.055+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~GTM3CVATA12W.2 size=548970 2024-09-12T00:36:24.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.055+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=GTM3CVATA12W tag=JRWBCBY28OKX type=write size=3694698 2024-09-12T00:36:24.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.056+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~91DY5KKXH7Y4.0 size=1048576 2024-09-12T00:36:24.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.057+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~91DY5KKXH7Y4.1 size=531288 2024-09-12T00:36:24.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.059+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=91DY5KKXH7Y4 tag=XA3BCVKK5MD1 type=write size=2628440 2024-09-12T00:36:24.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.061+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=9EDA6ZQ70N3M type=del size=943636 2024-09-12T00:36:24.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.062+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=I4E2CY69TK9W type=del 2024-09-12T00:36:24.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.064+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~OJ9KRR64ANC5.0 size=1048576 2024-09-12T00:36:24.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.065+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~OJ9KRR64ANC5.1 size=1048576 2024-09-12T00:36:24.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.066+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~OJ9KRR64ANC5.2 size=885101 2024-09-12T00:36:24.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.066+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=OJ9KRR64ANC5 tag=X6YRWL6PQFB4 type=write size=4030829 2024-09-12T00:36:24.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.068+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~45V2FFZ1H2G7.0 size=1048576 2024-09-12T00:36:24.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.069+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~45V2FFZ1H2G7.1 size=588401 2024-09-12T00:36:24.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.071+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=45V2FFZ1H2G7 tag=ZSGXB52164M6 type=write size=2685553 2024-09-12T00:36:24.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.074+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~93UN9W8IKQ0I.0 size=969516 2024-09-12T00:36:24.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.074+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=93UN9W8IKQ0I tag=TC8NDJE34OJI type=write size=2018092 2024-09-12T00:36:24.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.076+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~B3ZLW0D0RREP.0 size=1048576 2024-09-12T00:36:24.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.077+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~B3ZLW0D0RREP.1 size=787029 2024-09-12T00:36:24.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.079+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=B3ZLW0D0RREP tag=O7V7RYI7EAXR type=write size=2884181 2024-09-12T00:36:24.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.082+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~EUJAIDGNC8V5.0 size=1048576 2024-09-12T00:36:24.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.083+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~EUJAIDGNC8V5.1 size=1018654 2024-09-12T00:36:24.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.083+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=EUJAIDGNC8V5 tag=ARPEA4W7U784 type=write size=3115806 2024-09-12T00:36:24.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.084+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=JZVK4BDUN8ER type=del 2024-09-12T00:36:24.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.086+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~8Q2CSBFKLYIL.0 size=960646 2024-09-12T00:36:24.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.086+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=8Q2CSBFKLYIL tag=J2MG015ZQUJX type=write size=2009222 2024-09-12T00:36:24.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.087+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~5T6KN0O4U8RB.0 size=1048576 2024-09-12T00:36:24.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.087+0000 7f030cb87780 1 < canceled part key=_multipart_N3KD1UVUVM95.2~5T6KN0O4U8RB.1 size=797867 2024-09-12T00:36:24.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.090+0000 7f030cb87780 1 < canceled multipart upload key=N3KD1UVUVM95 upload=5T6KN0O4U8RB tag=56IYM2EOT2JM type=write size=2895019 2024-09-12T00:36:24.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.091+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=9PO2EO80QXJT type=write size=856803 2024-09-12T00:36:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.092+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=JLA53LQ4DTXY type=del 2024-09-12T00:36:24.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.094+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=47BCMYZAIVPH type=del size=1161701 2024-09-12T00:36:24.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.095+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=2XMCDEUC64QG type=del 2024-09-12T00:36:24.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.098+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~RVB89T6V92WS.0 size=999093 2024-09-12T00:36:24.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.098+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=RVB89T6V92WS tag=QYD7XWPZ13R4 type=write size=2047669 2024-09-12T00:36:24.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.099+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~JYGSGQVAV0VK.0 size=762205 2024-09-12T00:36:24.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.101+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=JYGSGQVAV0VK tag=OTRRTNV8S35R type=write size=1810781 2024-09-12T00:36:24.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.105+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~7NS85QNE7DCM.0 size=1048576 2024-09-12T00:36:24.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.105+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~7NS85QNE7DCM.1 size=319964 2024-09-12T00:36:24.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.105+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=7NS85QNE7DCM tag=DSHTKJ1S6NRK type=write size=2417116 2024-09-12T00:36:24.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.107+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=3KGR0AJB4YO0 type=del 2024-09-12T00:36:24.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.109+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~ZWD9EA9KZ2OK.0 size=1048576 2024-09-12T00:36:24.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.110+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~ZWD9EA9KZ2OK.1 size=1048576 2024-09-12T00:36:24.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.112+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~ZWD9EA9KZ2OK.2 size=1037375 2024-09-12T00:36:24.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.112+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=ZWD9EA9KZ2OK tag=9CNLOEUUADC9 type=write size=4183103 2024-09-12T00:36:24.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.114+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=0XC6SMV5EXDS type=del 2024-09-12T00:36:24.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.116+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~T0S396BW94UI.0 size=1048576 2024-09-12T00:36:24.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.117+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~T0S396BW94UI.1 size=294409 2024-09-12T00:36:24.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.117+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=T0S396BW94UI tag=QSOOGVCUCLVF type=write size=2391561 2024-09-12T00:36:24.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.118+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=TEP00199ZIAR type=del 2024-09-12T00:36:24.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.121+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~WHN25NS58I8S.0 size=493629 2024-09-12T00:36:24.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.121+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=WHN25NS58I8S tag=UM77RARLZTEQ type=write size=1542205 2024-09-12T00:36:24.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.122+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~4Y4SDTZFEY7F.0 size=1048576 2024-09-12T00:36:24.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.124+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~4Y4SDTZFEY7F.1 size=427321 2024-09-12T00:36:24.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.126+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=4Y4SDTZFEY7F tag=1SWP9FT3ZP5A type=write size=2524473 2024-09-12T00:36:24.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.127+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=X3BQ686MKHJR type=del size=2137270 2024-09-12T00:36:24.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.129+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=MTXD0CK7WRUT type=del 2024-09-12T00:36:24.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.130+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=P1XME1KSXTQS type=del size=941474 2024-09-12T00:36:24.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.133+0000 7f030cb87780 1 < suggested remove operation key=327RDLIWLVRO tag=GUKGU4DEIU2R type=del 2024-09-12T00:36:24.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.135+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~WUQQS90SXKA6.0 size=1048576 2024-09-12T00:36:24.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.136+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~WUQQS90SXKA6.1 size=775770 2024-09-12T00:36:24.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.136+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=WUQQS90SXKA6 tag=I19IAMN8DC08 type=write size=2872922 2024-09-12T00:36:24.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.138+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~GTM3CVATA12W.0 size=1048576 2024-09-12T00:36:24.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.140+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~GTM3CVATA12W.1 size=1048576 2024-09-12T00:36:24.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.140+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~GTM3CVATA12W.2 size=548970 2024-09-12T00:36:24.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.142+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=GTM3CVATA12W tag=JRWBCBY28OKX type=write size=3694698 2024-09-12T00:36:24.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.144+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=XMDDG0E7VGNV type=del size=974843 2024-09-12T00:36:24.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.145+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=9EDA6ZQ70N3M type=del 2024-09-12T00:36:24.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.147+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=WZW13JJ162Q8 type=write size=171045 2024-09-12T00:36:24.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.147+0000 7f030cb87780 1 < canceled part key=_multipart_UFYMVGL264T8.2~OJ9KRR64ANC5.0 size=1048576 2024-09-12T00:36:24.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.148+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~OJ9KRR64ANC5.1 size=1048576 2024-09-12T00:36:24.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.149+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~OJ9KRR64ANC5.2 size=885101 2024-09-12T00:36:24.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.152+0000 7f030cb87780 1 < canceled multipart upload key=UFYMVGL264T8 upload=OJ9KRR64ANC5 tag=X6YRWL6PQFB4 type=write size=4030829 2024-09-12T00:36:24.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.154+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~TQBTW1Y1SA3M.0 size=649083 2024-09-12T00:36:24.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.154+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=TQBTW1Y1SA3M tag=ZR1QDQV2MMLD type=write size=1697659 2024-09-12T00:36:24.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.155+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~93UN9W8IKQ0I.0 size=969516 2024-09-12T00:36:24.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.157+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=93UN9W8IKQ0I tag=TC8NDJE34OJI type=write size=2018092 2024-09-12T00:36:24.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.160+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~8N1QZLE6NHEK.0 size=235524 2024-09-12T00:36:24.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.160+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=8N1QZLE6NHEK tag=NNDHTBSX015N type=write size=1284100 2024-09-12T00:36:24.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.162+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~EUJAIDGNC8V5.0 size=1048576 2024-09-12T00:36:24.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.163+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~EUJAIDGNC8V5.1 size=1018654 2024-09-12T00:36:24.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.166+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=EUJAIDGNC8V5 tag=ARPEA4W7U784 type=write size=3115806 2024-09-12T00:36:24.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.167+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=GMYEZJRRII2R type=del size=1654301 2024-09-12T00:36:24.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.168+0000 7f030cb87780 1 < canceled part key=_multipart_6WHZRKLM3OLP.2~8Q2CSBFKLYIL.0 size=960646 2024-09-12T00:36:24.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.170+0000 7f030cb87780 1 < canceled multipart upload key=6WHZRKLM3OLP upload=8Q2CSBFKLYIL tag=J2MG015ZQUJX type=write size=2009222 2024-09-12T00:36:24.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.171+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=08VQC6AUC7V2 type=del size=1852644 2024-09-12T00:36:24.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.174+0000 7f030cb87780 1 < suggested remove operation key=QGSJ51GMQXVK tag=9PO2EO80QXJT type=write 2024-09-12T00:36:24.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.175+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=A8LK189KIUBZ type=del size=1770711 2024-09-12T00:36:24.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.177+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=47BCMYZAIVPH type=del 2024-09-12T00:36:24.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.178+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=KQOTWY81FWBH type=del size=915803 2024-09-12T00:36:24.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.179+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~RVB89T6V92WS.0 size=999093 2024-09-12T00:36:24.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.182+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=RVB89T6V92WS tag=QYD7XWPZ13R4 type=write size=2047669 2024-09-12T00:36:24.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.185+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~LBSK6XCYWQ1Q.0 size=1048576 2024-09-12T00:36:24.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.186+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~LBSK6XCYWQ1Q.1 size=264546 2024-09-12T00:36:24.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.186+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=LBSK6XCYWQ1Q tag=FAG7TSUU4YAW type=write size=2361698 2024-09-12T00:36:24.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.186+0000 7f030cb87780 1 < canceled part key=_multipart_327RDLIWLVRO.2~7NS85QNE7DCM.0 size=1048576 2024-09-12T00:36:24.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.187+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~7NS85QNE7DCM.1 size=319964 2024-09-12T00:36:24.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.189+0000 7f030cb87780 1 < canceled multipart upload key=327RDLIWLVRO upload=7NS85QNE7DCM tag=DSHTKJ1S6NRK type=write size=2417116 2024-09-12T00:36:24.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.192+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~Z70G73GZB3S2.0 size=1048576 2024-09-12T00:36:24.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.193+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~Z70G73GZB3S2.1 size=1048576 2024-09-12T00:36:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.194+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~Z70G73GZB3S2.2 size=467097 2024-09-12T00:36:24.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.194+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=Z70G73GZB3S2 tag=WD2H1R134QH3 type=write size=3612825 2024-09-12T00:36:24.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.196+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~ZWD9EA9KZ2OK.0 size=1048576 2024-09-12T00:36:24.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.198+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~ZWD9EA9KZ2OK.1 size=1048576 2024-09-12T00:36:24.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.199+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~ZWD9EA9KZ2OK.2 size=1037375 2024-09-12T00:36:24.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.200+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=ZWD9EA9KZ2OK tag=9CNLOEUUADC9 type=write size=4183103 2024-09-12T00:36:24.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.202+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=QB73IPM5KR9Z type=del size=1134507 2024-09-12T00:36:24.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.203+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~T0S396BW94UI.0 size=1048576 2024-09-12T00:36:24.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.205+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~T0S396BW94UI.1 size=294409 2024-09-12T00:36:24.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.207+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=T0S396BW94UI tag=QSOOGVCUCLVF type=write size=2391561 2024-09-12T00:36:24.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.210+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~8A64EJCCAV91.0 size=484713 2024-09-12T00:36:24.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.210+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=8A64EJCCAV91 tag=T05L0H0UKHYF type=write size=1533289 2024-09-12T00:36:24.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.210+0000 7f030cb87780 1 < canceled part key=_multipart_99OWKRGA8ZZN.2~WHN25NS58I8S.0 size=493629 2024-09-12T00:36:24.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.212+0000 7f030cb87780 1 < canceled multipart upload key=99OWKRGA8ZZN upload=WHN25NS58I8S tag=UM77RARLZTEQ type=write size=1542205 2024-09-12T00:36:24.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.216+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~7E6Y8Y74VZHI.0 size=753898 2024-09-12T00:36:24.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.216+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=7E6Y8Y74VZHI tag=YMA5OSXY50F0 type=write size=1802474 2024-09-12T00:36:24.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.216+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=X3BQ686MKHJR type=del 2024-09-12T00:36:24.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.219+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~C7GWVL5M1MJZ.0 size=548016 2024-09-12T00:36:24.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.219+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=C7GWVL5M1MJZ tag=GRCD5PBQYUB1 type=write size=1596592 2024-09-12T00:36:24.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.221+0000 7f030cb87780 1 < suggested remove operation key=56I20YIPY82N tag=P1XME1KSXTQS type=del 2024-09-12T00:36:24.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.223+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=INZDAPCNMC3M type=del size=3381585 2024-09-12T00:36:24.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.225+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~WUQQS90SXKA6.0 size=1048576 2024-09-12T00:36:24.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.226+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~WUQQS90SXKA6.1 size=775770 2024-09-12T00:36:24.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.229+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=WUQQS90SXKA6 tag=I19IAMN8DC08 type=write size=2872922 2024-09-12T00:36:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.231+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~8A51Z852X3M1.0 size=458322 2024-09-12T00:36:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.231+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=8A51Z852X3M1 tag=MTGPEPPMSQG4 type=write size=1506898 2024-09-12T00:36:24.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.232+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=XMDDG0E7VGNV type=del 2024-09-12T00:36:24.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.233+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=DZDZ687E1U6T type=del size=276712 2024-09-12T00:36:24.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.235+0000 7f030cb87780 1 < completed write operation key=39WSAOA6P09M tag=WZW13JJ162Q8 type=write size=171045 2024-09-12T00:36:24.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.236+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=6YY5J7LMB3BF type=write size=339608 2024-09-12T00:36:24.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.238+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~TQBTW1Y1SA3M.0 size=649083 2024-09-12T00:36:24.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.240+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=TQBTW1Y1SA3M tag=ZR1QDQV2MMLD type=write size=1697659 2024-09-12T00:36:24.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.243+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~E7JNS7DER8ND.0 size=1048576 2024-09-12T00:36:24.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.244+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~E7JNS7DER8ND.1 size=449614 2024-09-12T00:36:24.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.244+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=E7JNS7DER8ND tag=KBXRAYPYLG1B type=write size=2546766 2024-09-12T00:36:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.246+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~8N1QZLE6NHEK.0 size=235524 2024-09-12T00:36:24.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.247+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=8N1QZLE6NHEK tag=NNDHTBSX015N type=write size=1284100 2024-09-12T00:36:24.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.251+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~059M9NV3IVZ4.0 size=711104 2024-09-12T00:36:24.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.251+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=059M9NV3IVZ4 tag=Y0Z3YWO3YN8A type=write size=1759680 2024-09-12T00:36:24.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.251+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=GMYEZJRRII2R type=del 2024-09-12T00:36:24.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.254+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=EIV7CJBK2QGP type=del size=2797598 2024-09-12T00:36:24.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.255+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=08VQC6AUC7V2 type=del 2024-09-12T00:36:24.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.256+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=WR50S5SD2K4N type=del size=1534166 2024-09-12T00:36:24.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.258+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=A8LK189KIUBZ type=del 2024-09-12T00:36:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.260+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~Y9UO8WEY8OWC.0 size=1048576 2024-09-12T00:36:24.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.262+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~Y9UO8WEY8OWC.1 size=923974 2024-09-12T00:36:24.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.262+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=Y9UO8WEY8OWC tag=PX5VEH9VH532 type=write size=3021126 2024-09-12T00:36:24.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.263+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=KQOTWY81FWBH type=del 2024-09-12T00:36:24.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.265+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=AT6316GHFPYB type=write size=979567 2024-09-12T00:36:24.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.266+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~LBSK6XCYWQ1Q.0 size=1048576 2024-09-12T00:36:24.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.267+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~LBSK6XCYWQ1Q.1 size=264546 2024-09-12T00:36:24.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.270+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=LBSK6XCYWQ1Q tag=FAG7TSUU4YAW type=write size=2361698 2024-09-12T00:36:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.272+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~ZEKABHTQ1Y6U.0 size=1048576 2024-09-12T00:36:24.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.274+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~ZEKABHTQ1Y6U.1 size=644293 2024-09-12T00:36:24.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.274+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=ZEKABHTQ1Y6U tag=328I649MHC1E type=write size=2741445 2024-09-12T00:36:24.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.275+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~Z70G73GZB3S2.0 size=1048576 2024-09-12T00:36:24.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.276+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~Z70G73GZB3S2.1 size=1048576 2024-09-12T00:36:24.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.278+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~Z70G73GZB3S2.2 size=467097 2024-09-12T00:36:24.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.280+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=Z70G73GZB3S2 tag=WD2H1R134QH3 type=write size=3612825 2024-09-12T00:36:24.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.282+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~GUQ7UT8ER8E1.0 size=1048576 2024-09-12T00:36:24.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.284+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~GUQ7UT8ER8E1.1 size=1021305 2024-09-12T00:36:24.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.284+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=GUQ7UT8ER8E1 tag=WMRGJYI54EA8 type=write size=3118457 2024-09-12T00:36:24.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.286+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=QB73IPM5KR9Z type=del 2024-09-12T00:36:24.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.288+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~K2KWBZA4O3NF.0 size=1048576 2024-09-12T00:36:24.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.289+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~K2KWBZA4O3NF.1 size=741340 2024-09-12T00:36:24.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.289+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=K2KWBZA4O3NF tag=75LDYQ64K0SS type=write size=2838492 2024-09-12T00:36:24.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.290+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~8A64EJCCAV91.0 size=484713 2024-09-12T00:36:24.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.294+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=8A64EJCCAV91 tag=T05L0H0UKHYF type=write size=1533289 2024-09-12T00:36:24.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.296+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=E1G0SZZVB0Z4 type=del size=470570 2024-09-12T00:36:24.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.299+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~7E6Y8Y74VZHI.0 size=753898 2024-09-12T00:36:24.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.301+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=7E6Y8Y74VZHI tag=YMA5OSXY50F0 type=write size=1802474 2024-09-12T00:36:24.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.304+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~YU6Z2AI8PB0C.0 size=1048576 2024-09-12T00:36:24.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.304+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~YU6Z2AI8PB0C.1 size=1048576 2024-09-12T00:36:24.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.305+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~YU6Z2AI8PB0C.2 size=818384 2024-09-12T00:36:24.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.305+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=YU6Z2AI8PB0C tag=QZS2XS1ZD3NP type=write size=3964112 2024-09-12T00:36:24.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.306+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~C7GWVL5M1MJZ.0 size=548016 2024-09-12T00:36:24.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.309+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=C7GWVL5M1MJZ tag=GRCD5PBQYUB1 type=write size=1596592 2024-09-12T00:36:24.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.311+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~L4770H7QIXY1.0 size=1048576 2024-09-12T00:36:24.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.313+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~L4770H7QIXY1.1 size=411774 2024-09-12T00:36:24.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.313+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=L4770H7QIXY1 tag=O59NHG5J8P6M type=write size=2508926 2024-09-12T00:36:24.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.314+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=INZDAPCNMC3M type=del 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.318+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~D26Y72QDHABT.0 size=731746 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.318+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=D26Y72QDHABT tag=751GH9YLC333 type=write size=1780322 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.320+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~8A51Z852X3M1.0 size=458322 2024-09-12T00:36:24.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.322+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=8A51Z852X3M1 tag=MTGPEPPMSQG4 type=write size=1506898 2024-09-12T00:36:24.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.324+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~JB073KVFI52Z.0 size=1048576 2024-09-12T00:36:24.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.326+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~JB073KVFI52Z.1 size=469883 2024-09-12T00:36:24.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.326+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=JB073KVFI52Z tag=D86LZN0CJU9V type=write size=2567035 2024-09-12T00:36:24.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.329+0000 7f030cb87780 1 < suggested remove operation key=IY156CJWG2TB tag=DZDZ687E1U6T type=del 2024-09-12T00:36:24.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.331+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~79N8BNO9J5ES.0 size=1048576 2024-09-12T00:36:24.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.333+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~79N8BNO9J5ES.1 size=1048576 2024-09-12T00:36:24.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.334+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~79N8BNO9J5ES.2 size=409296 2024-09-12T00:36:24.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.334+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=79N8BNO9J5ES tag=R8VX6Y82Y3NV type=write size=3555024 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.335+0000 7f030cb87780 1 < completed write operation key=IHTFI7W4A6JT tag=6YY5J7LMB3BF type=write size=339608 2024-09-12T00:36:24.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.337+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=59QRRLTNSPP1 type=del size=3589392 2024-09-12T00:36:24.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.338+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~E7JNS7DER8ND.0 size=1048576 2024-09-12T00:36:24.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.339+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~E7JNS7DER8ND.1 size=449614 2024-09-12T00:36:24.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.342+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=E7JNS7DER8ND tag=KBXRAYPYLG1B type=write size=2546766 2024-09-12T00:36:24.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.343+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=KP6XD60ABS2K type=del size=890319 2024-09-12T00:36:24.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.345+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~059M9NV3IVZ4.0 size=711104 2024-09-12T00:36:24.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.347+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=059M9NV3IVZ4 tag=Y0Z3YWO3YN8A type=write size=1759680 2024-09-12T00:36:24.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.350+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~9M4KTS5D0V2Q.0 size=758581 2024-09-12T00:36:24.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.350+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=9M4KTS5D0V2Q tag=EM50W3Q7S909 type=write size=1807157 2024-09-12T00:36:24.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.351+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=EIV7CJBK2QGP type=del 2024-09-12T00:36:24.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.355+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~FZZTAR5HKQVW.0 size=1017428 2024-09-12T00:36:24.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.355+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=FZZTAR5HKQVW tag=LW6EZHERBQE1 type=write size=2066004 2024-09-12T00:36:24.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.355+0000 7f030cb87780 -1 < failed to complete operation key=IY156CJWG2TB tag=WR50S5SD2K4N type=del size=1534166: (22) Invalid argument 2024-09-12T00:36:24.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.356+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=YE2X6BVPODGV type=del size=952763 2024-09-12T00:36:24.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.358+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~Y9UO8WEY8OWC.0 size=1048576 2024-09-12T00:36:24.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.358+0000 7f030cb87780 1 < canceled part key=_multipart_IHTFI7W4A6JT.2~Y9UO8WEY8OWC.1 size=923974 2024-09-12T00:36:24.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.360+0000 7f030cb87780 1 < canceled multipart upload key=IHTFI7W4A6JT upload=Y9UO8WEY8OWC tag=PX5VEH9VH532 type=write size=3021126 2024-09-12T00:36:24.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.361+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=CFDB3ISQ5V9A type=del size=2817496 2024-09-12T00:36:24.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.363+0000 7f030cb87780 1 < completed write operation key=U5CWO1EN8BFI tag=AT6316GHFPYB type=write size=979567 2024-09-12T00:36:24.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.364+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=7E6G2LGAPOH2 type=del size=1630224 2024-09-12T00:36:24.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.366+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~ZEKABHTQ1Y6U.0 size=1048576 2024-09-12T00:36:24.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.367+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~ZEKABHTQ1Y6U.1 size=644293 2024-09-12T00:36:24.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.369+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=ZEKABHTQ1Y6U tag=328I649MHC1E type=write size=2741445 2024-09-12T00:36:24.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.371+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=O4470NILAENK type=del size=3171437 2024-09-12T00:36:24.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.372+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~GUQ7UT8ER8E1.0 size=1048576 2024-09-12T00:36:24.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.373+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~GUQ7UT8ER8E1.1 size=1021305 2024-09-12T00:36:24.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.376+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=GUQ7UT8ER8E1 tag=WMRGJYI54EA8 type=write size=3118457 2024-09-12T00:36:24.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.377+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=JSKQ4CONCT3M type=del size=1722698 2024-09-12T00:36:24.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.379+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~K2KWBZA4O3NF.0 size=1048576 2024-09-12T00:36:24.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.380+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~K2KWBZA4O3NF.1 size=741340 2024-09-12T00:36:24.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.382+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=K2KWBZA4O3NF tag=75LDYQ64K0SS type=write size=2838492 2024-09-12T00:36:24.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.385+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=0NUNJ9QT7JJU type=del size=765434 2024-09-12T00:36:24.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.387+0000 7f030cb87780 1 < suggested update operation key=1PLGUJCB6J0V tag=E1G0SZZVB0Z4 type=del size=470570 2024-09-12T00:36:24.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.388+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=I3W0JELSEGPA type=write size=1016626 2024-09-12T00:36:24.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.389+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~YU6Z2AI8PB0C.0 size=1048576 2024-09-12T00:36:24.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.389+0000 7f030cb87780 1 < canceled part key=_multipart_39WSAOA6P09M.2~YU6Z2AI8PB0C.1 size=1048576 2024-09-12T00:36:24.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.390+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~YU6Z2AI8PB0C.2 size=818384 2024-09-12T00:36:24.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.393+0000 7f030cb87780 1 < canceled multipart upload key=39WSAOA6P09M upload=YU6Z2AI8PB0C tag=QZS2XS1ZD3NP type=write size=3964112 2024-09-12T00:36:24.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.394+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=Y1J60T5HNIT1 type=del size=1884366 2024-09-12T00:36:24.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.395+0000 7f030cb87780 1 < canceled part key=_multipart_UFYMVGL264T8.2~L4770H7QIXY1.0 size=1048576 2024-09-12T00:36:24.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.396+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~L4770H7QIXY1.1 size=411774 2024-09-12T00:36:24.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.398+0000 7f030cb87780 1 < canceled multipart upload key=UFYMVGL264T8 upload=L4770H7QIXY1 tag=O59NHG5J8P6M type=write size=2508926 2024-09-12T00:36:24.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.399+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=283NF0G1F4TU type=del size=3412939 2024-09-12T00:36:24.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.401+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~D26Y72QDHABT.0 size=731746 2024-09-12T00:36:24.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.403+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=D26Y72QDHABT tag=751GH9YLC333 type=write size=1780322 2024-09-12T00:36:24.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.404+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=M9FM7E5Z5BPQ type=del size=1908116 2024-09-12T00:36:24.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.405+0000 7f030cb87780 1 < canceled part key=_multipart_99OWKRGA8ZZN.2~JB073KVFI52Z.0 size=1048576 2024-09-12T00:36:24.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.406+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~JB073KVFI52Z.1 size=469883 2024-09-12T00:36:24.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.408+0000 7f030cb87780 1 < canceled multipart upload key=99OWKRGA8ZZN upload=JB073KVFI52Z tag=D86LZN0CJU9V type=write size=2567035 2024-09-12T00:36:24.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.410+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=GV6UXL7FH18S type=del size=558632 2024-09-12T00:36:24.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.411+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~79N8BNO9J5ES.0 size=1048576 2024-09-12T00:36:24.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.412+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~79N8BNO9J5ES.1 size=1048576 2024-09-12T00:36:24.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.413+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~79N8BNO9J5ES.2 size=409296 2024-09-12T00:36:24.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.415+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=79N8BNO9J5ES tag=R8VX6Y82Y3NV type=write size=3555024 2024-09-12T00:36:24.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.416+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=41UO3RLPZ804 type=del size=369883 2024-09-12T00:36:24.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.420+0000 7f030cb87780 1 < suggested remove operation key=IY156CJWG2TB tag=59QRRLTNSPP1 type=del 2024-09-12T00:36:24.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.421+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=6ZA3S5DAVFXA type=del size=2302824 2024-09-12T00:36:24.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.422+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=KP6XD60ABS2K type=del 2024-09-12T00:36:24.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.425+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~4A9T8XU5AKQF.0 size=1048576 2024-09-12T00:36:24.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.426+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~4A9T8XU5AKQF.1 size=1048576 2024-09-12T00:36:24.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.427+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~4A9T8XU5AKQF.2 size=840626 2024-09-12T00:36:24.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.427+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=4A9T8XU5AKQF tag=AWN5D33YPIM3 type=write size=3986354 2024-09-12T00:36:24.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.430+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~9M4KTS5D0V2Q.0 size=758581 2024-09-12T00:36:24.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.432+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=9M4KTS5D0V2Q tag=EM50W3Q7S909 type=write size=1807157 2024-09-12T00:36:24.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.433+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=A1VJQTI3ZNUN type=del size=1301531 2024-09-12T00:36:24.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.435+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~FZZTAR5HKQVW.0 size=1017428 2024-09-12T00:36:24.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.437+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=FZZTAR5HKQVW tag=LW6EZHERBQE1 type=write size=2066004 2024-09-12T00:36:24.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.438+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=6BDS13SIGD6S type=del size=1404048 2024-09-12T00:36:24.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.441+0000 7f030cb87780 1 < suggested update operation key=800OHA7UURC4 tag=YE2X6BVPODGV type=del size=952763 2024-09-12T00:36:24.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.443+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~IQT6R4XIZT4Z.0 size=1048576 2024-09-12T00:36:24.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.445+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~IQT6R4XIZT4Z.1 size=409872 2024-09-12T00:36:24.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.445+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=IQT6R4XIZT4Z tag=IIO5P9EU9WBB type=write size=2507024 2024-09-12T00:36:24.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.447+0000 7f030cb87780 1 < suggested remove operation key=1PLGUJCB6J0V tag=CFDB3ISQ5V9A type=del 2024-09-12T00:36:24.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.448+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=W5M7FEH5H9LC type=del size=1384880 2024-09-12T00:36:24.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.449+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=7E6G2LGAPOH2 type=del 2024-09-12T00:36:24.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.451+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=ZLAI2UAZSPRO type=del size=2237792 2024-09-12T00:36:24.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.452+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=O4470NILAENK type=del 2024-09-12T00:36:24.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.453+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=60SW7CQQKLPF type=del size=536098 2024-09-12T00:36:24.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.454+0000 7f030cb87780 1 < canceled operation key=V0OLIRP3KH40 tag=JSKQ4CONCT3M type=del size=1722698 2024-09-12T00:36:24.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.457+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~JAMQ4RWZ5VUG.0 size=1048576 2024-09-12T00:36:24.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.458+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~JAMQ4RWZ5VUG.1 size=1048576 2024-09-12T00:36:24.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.459+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~JAMQ4RWZ5VUG.2 size=783031 2024-09-12T00:36:24.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.459+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=JAMQ4RWZ5VUG tag=6AL0BPP0Q4U9 type=write size=3928759 2024-09-12T00:36:24.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.462+0000 7f030cb87780 1 < suggested update operation key=39WSAOA6P09M tag=0NUNJ9QT7JJU type=del size=765434 2024-09-12T00:36:24.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.465+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~R2NH1WDRY9NC.0 size=1034549 2024-09-12T00:36:24.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.465+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=R2NH1WDRY9NC tag=UCXFH85ZXK3O type=write size=2083125 2024-09-12T00:36:24.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.466+0000 7f030cb87780 1 < completed write operation key=V0OLIRP3KH40 tag=I3W0JELSEGPA type=write size=1016626 2024-09-12T00:36:24.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.467+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=6ICVCGXT714D type=write size=780656 2024-09-12T00:36:24.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.468+0000 7f030cb87780 1 < canceled operation key=ATTMOL2TGUN7 tag=Y1J60T5HNIT1 type=del size=1884366 2024-09-12T00:36:24.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.471+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~BC5MP4TXGE0M.0 size=1048576 2024-09-12T00:36:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.472+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~BC5MP4TXGE0M.1 size=149119 2024-09-12T00:36:24.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.472+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=BC5MP4TXGE0M tag=XDTBEO77K6J6 type=write size=2246271 2024-09-12T00:36:24.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.473+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=283NF0G1F4TU type=del 2024-09-12T00:36:24.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.476+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~VL4TV9AYRI5B.0 size=1048576 2024-09-12T00:36:24.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.477+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~VL4TV9AYRI5B.1 size=1048576 2024-09-12T00:36:24.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.477+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~VL4TV9AYRI5B.2 size=259655 2024-09-12T00:36:24.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.477+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=VL4TV9AYRI5B tag=QQQA6B5E643A type=write size=3405383 2024-09-12T00:36:24.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.479+0000 7f030cb87780 1 < canceled operation key=9MCRD2G3MZIT tag=M9FM7E5Z5BPQ type=del size=1908116 2024-09-12T00:36:24.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.480+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=W2UXWN2C6BXC type=del size=2530783 2024-09-12T00:36:24.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.484+0000 7f030cb87780 1 < suggested remove operation key=POC8YA58U55N tag=GV6UXL7FH18S type=del 2024-09-12T00:36:24.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.485+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=WJA5RQUIS9PV type=del size=1020440 2024-09-12T00:36:24.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.486+0000 7f030cb87780 1 < canceled operation key=ELX0797T1L4C tag=41UO3RLPZ804 type=del size=369883 2024-09-12T00:36:24.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.488+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=ZK4B9RN0933E type=del size=832736 2024-09-12T00:36:24.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.490+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=6ZA3S5DAVFXA type=del 2024-09-12T00:36:24.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.493+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~CQ50Y97M1LGH.0 size=1048576 2024-09-12T00:36:24.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.494+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~CQ50Y97M1LGH.1 size=1048576 2024-09-12T00:36:24.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.495+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~CQ50Y97M1LGH.2 size=1015521 2024-09-12T00:36:24.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.495+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=CQ50Y97M1LGH tag=IGEH87CL85R1 type=write size=4161249 2024-09-12T00:36:24.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.497+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~4A9T8XU5AKQF.0 size=1048576 2024-09-12T00:36:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.498+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~4A9T8XU5AKQF.1 size=1048576 2024-09-12T00:36:24.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.498+0000 7f030cb87780 1 < canceled part key=_multipart_ATTMOL2TGUN7.2~4A9T8XU5AKQF.2 size=840626 2024-09-12T00:36:24.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.501+0000 7f030cb87780 1 < canceled multipart upload key=ATTMOL2TGUN7 upload=4A9T8XU5AKQF tag=AWN5D33YPIM3 type=write size=3986354 2024-09-12T00:36:24.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.503+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~33DAQECKFI2Z.0 size=1048576 2024-09-12T00:36:24.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.505+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~33DAQECKFI2Z.1 size=457481 2024-09-12T00:36:24.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.505+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=33DAQECKFI2Z tag=HN43CIHX88XO type=write size=2554633 2024-09-12T00:36:24.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.506+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=A1VJQTI3ZNUN type=del 2024-09-12T00:36:24.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.507+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=X9I977PXRYBY type=del size=1972928 2024-09-12T00:36:24.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.510+0000 7f030cb87780 1 < suggested remove operation key=U5CWO1EN8BFI tag=6BDS13SIGD6S type=del 2024-09-12T00:36:24.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.512+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=SXJCDYCRIDMR type=del size=1792003 2024-09-12T00:36:24.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.513+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~IQT6R4XIZT4Z.0 size=1048576 2024-09-12T00:36:24.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.514+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~IQT6R4XIZT4Z.1 size=409872 2024-09-12T00:36:24.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.516+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=IQT6R4XIZT4Z tag=IIO5P9EU9WBB type=write size=2507024 2024-09-12T00:36:24.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.518+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=9Z116WX17K71 type=del size=2751503 2024-09-12T00:36:24.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.519+0000 7f030cb87780 1 < canceled operation key=327RDLIWLVRO tag=W5M7FEH5H9LC type=del size=1384880 2024-09-12T00:36:24.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.521+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=GJ9AJ92I4OHA type=del size=3752953 2024-09-12T00:36:24.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.522+0000 7f030cb87780 1 < canceled operation key=CY2NS03IIUJJ tag=ZLAI2UAZSPRO type=del size=2237792 2024-09-12T00:36:24.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.524+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=7ONZ3F4K0PWY type=del size=3355409 2024-09-12T00:36:24.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.526+0000 7f030cb87780 1 < suggested update operation key=CUDFTXFBC862 tag=60SW7CQQKLPF type=del size=536098 2024-09-12T00:36:24.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.529+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~O18SIAR2IGWC.0 size=1048576 2024-09-12T00:36:24.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.530+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~O18SIAR2IGWC.1 size=1048576 2024-09-12T00:36:24.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.531+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~O18SIAR2IGWC.2 size=816325 2024-09-12T00:36:24.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.531+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=O18SIAR2IGWC tag=6OYIQ5KBWTF8 type=write size=3962053 2024-09-12T00:36:24.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.532+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~JAMQ4RWZ5VUG.0 size=1048576 2024-09-12T00:36:24.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.534+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~JAMQ4RWZ5VUG.1 size=1048576 2024-09-12T00:36:24.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.535+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~JAMQ4RWZ5VUG.2 size=783031 2024-09-12T00:36:24.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.538+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=JAMQ4RWZ5VUG tag=6AL0BPP0Q4U9 type=write size=3928759 2024-09-12T00:36:24.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.540+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~142RW1S5ZL9Z.0 size=287300 2024-09-12T00:36:24.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.540+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=142RW1S5ZL9Z tag=Y1LPCD6M0Z07 type=write size=1335876 2024-09-12T00:36:24.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.541+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~R2NH1WDRY9NC.0 size=1034549 2024-09-12T00:36:24.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.544+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=R2NH1WDRY9NC tag=UCXFH85ZXK3O type=write size=2083125 2024-09-12T00:36:24.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.546+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~Z5UWQEUHD2R6.0 size=1048576 2024-09-12T00:36:24.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.547+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~Z5UWQEUHD2R6.1 size=899431 2024-09-12T00:36:24.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.547+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=Z5UWQEUHD2R6 tag=PA0COOMCGT7V type=write size=2996583 2024-09-12T00:36:24.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.551+0000 7f030cb87780 1 < suggested update operation key=JPEIGLC162K3 tag=6ICVCGXT714D type=write size=780656 2024-09-12T00:36:24.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.554+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~5061P0OIDXP3.0 size=161664 2024-09-12T00:36:24.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.554+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=5061P0OIDXP3 tag=4C2RQQ9PAVF2 type=write size=1210240 2024-09-12T00:36:24.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.554+0000 7f030cb87780 1 < canceled part key=_multipart_39WSAOA6P09M.2~BC5MP4TXGE0M.0 size=1048576 2024-09-12T00:36:24.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.555+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~BC5MP4TXGE0M.1 size=149119 2024-09-12T00:36:24.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.558+0000 7f030cb87780 1 < canceled multipart upload key=39WSAOA6P09M upload=BC5MP4TXGE0M tag=XDTBEO77K6J6 type=write size=2246271 2024-09-12T00:36:24.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.561+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~GF7SOKHQV4NT.0 size=1048576 2024-09-12T00:36:24.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.562+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~GF7SOKHQV4NT.1 size=1048576 2024-09-12T00:36:24.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.563+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~GF7SOKHQV4NT.2 size=296691 2024-09-12T00:36:24.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.563+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=GF7SOKHQV4NT tag=Z7F53KODCE02 type=write size=3442419 2024-09-12T00:36:24.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.564+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~VL4TV9AYRI5B.0 size=1048576 2024-09-12T00:36:24.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.564+0000 7f030cb87780 1 < canceled part key=_multipart_CY2NS03IIUJJ.2~VL4TV9AYRI5B.1 size=1048576 2024-09-12T00:36:24.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.564+0000 7f030cb87780 1 < canceled part key=_multipart_CY2NS03IIUJJ.2~VL4TV9AYRI5B.2 size=259655 2024-09-12T00:36:24.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.567+0000 7f030cb87780 1 < canceled multipart upload key=CY2NS03IIUJJ upload=VL4TV9AYRI5B tag=QQQA6B5E643A type=write size=3405383 2024-09-12T00:36:24.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.569+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=BI0G9JED1HWB type=del size=2689551 2024-09-12T00:36:24.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.571+0000 7f030cb87780 1 < suggested remove operation key=IY156CJWG2TB tag=W2UXWN2C6BXC type=del 2024-09-12T00:36:24.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.573+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=3E1SV8K3L7XP type=del size=3205514 2024-09-12T00:36:24.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.574+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=WJA5RQUIS9PV type=del 2024-09-12T00:36:24.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.577+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~2CT61KXQB7IG.0 size=1048576 2024-09-12T00:36:24.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.578+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~2CT61KXQB7IG.1 size=122936 2024-09-12T00:36:24.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.578+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=2CT61KXQB7IG tag=VJZFON6LFCEP type=write size=2220088 2024-09-12T00:36:24.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.579+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=ZK4B9RN0933E type=del 2024-09-12T00:36:24.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.582+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~7HYNYGEBYW1D.0 size=699123 2024-09-12T00:36:24.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.582+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=7HYNYGEBYW1D tag=Q2M71X12BAT8 type=write size=1747699 2024-09-12T00:36:24.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.584+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~CQ50Y97M1LGH.0 size=1048576 2024-09-12T00:36:24.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.586+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~CQ50Y97M1LGH.1 size=1048576 2024-09-12T00:36:24.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.586+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~CQ50Y97M1LGH.2 size=1015521 2024-09-12T00:36:24.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.588+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=CQ50Y97M1LGH tag=IGEH87CL85R1 type=write size=4161249 2024-09-12T00:36:24.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.589+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=WZ9E10DXWCBD type=del size=402057 2024-09-12T00:36:24.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.591+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~33DAQECKFI2Z.0 size=1048576 2024-09-12T00:36:24.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.592+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~33DAQECKFI2Z.1 size=457481 2024-09-12T00:36:24.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.594+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=33DAQECKFI2Z tag=HN43CIHX88XO type=write size=2554633 2024-09-12T00:36:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.596+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~FLUTF8NG2ZM7.0 size=346362 2024-09-12T00:36:24.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.596+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=FLUTF8NG2ZM7 tag=EICT5UFT7C2O type=write size=1394938 2024-09-12T00:36:24.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.598+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=X9I977PXRYBY type=del 2024-09-12T00:36:24.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.599+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=6MDPS2ASVGWJ type=del size=3531616 2024-09-12T00:36:24.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.600+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=SXJCDYCRIDMR type=del 2024-09-12T00:36:24.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.603+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~F1T9R0ROO57I.0 size=1048576 2024-09-12T00:36:24.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.604+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~F1T9R0ROO57I.1 size=1048576 2024-09-12T00:36:24.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.605+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~F1T9R0ROO57I.2 size=520539 2024-09-12T00:36:24.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.605+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=F1T9R0ROO57I tag=SA49ICFEN97C type=write size=3666267 2024-09-12T00:36:24.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.606+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=9Z116WX17K71 type=del 2024-09-12T00:36:24.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.607+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=813FG7Q97YUS type=del size=2796868 2024-09-12T00:36:24.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.609+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=GJ9AJ92I4OHA type=del 2024-09-12T00:36:24.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.610+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=3RHZQOW8UAP5 type=del size=3415086 2024-09-12T00:36:24.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.612+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=7ONZ3F4K0PWY type=del 2024-09-12T00:36:24.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.613+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=L3N2G8XPGA5A type=del size=547257 2024-09-12T00:36:24.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.615+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~O18SIAR2IGWC.0 size=1048576 2024-09-12T00:36:24.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.616+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~O18SIAR2IGWC.1 size=1048576 2024-09-12T00:36:24.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.617+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~O18SIAR2IGWC.2 size=816325 2024-09-12T00:36:24.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.620+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=O18SIAR2IGWC tag=6OYIQ5KBWTF8 type=write size=3962053 2024-09-12T00:36:24.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.622+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=UCOTOA2RDNPL type=del size=1937242 2024-09-12T00:36:24.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.624+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~142RW1S5ZL9Z.0 size=287300 2024-09-12T00:36:24.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.626+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=142RW1S5ZL9Z tag=Y1LPCD6M0Z07 type=write size=1335876 2024-09-12T00:36:24.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.627+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=ALEZGRFM0NY6 type=write size=311158 2024-09-12T00:36:24.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.629+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~Z5UWQEUHD2R6.0 size=1048576 2024-09-12T00:36:24.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.629+0000 7f030cb87780 1 < canceled part key=_multipart_DLR6A7XOERHW.2~Z5UWQEUHD2R6.1 size=899431 2024-09-12T00:36:24.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.631+0000 7f030cb87780 1 < canceled multipart upload key=DLR6A7XOERHW upload=Z5UWQEUHD2R6 tag=PA0COOMCGT7V type=write size=2996583 2024-09-12T00:36:24.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.633+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~A6TQ5LY87MMO.0 size=1048576 2024-09-12T00:36:24.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.635+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~A6TQ5LY87MMO.1 size=30094 2024-09-12T00:36:24.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.635+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=A6TQ5LY87MMO tag=SLSFZMPGPG8E type=write size=2127246 2024-09-12T00:36:24.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.637+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~5061P0OIDXP3.0 size=161664 2024-09-12T00:36:24.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.638+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=5061P0OIDXP3 tag=4C2RQQ9PAVF2 type=write size=1210240 2024-09-12T00:36:24.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.641+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~2D4PGUF5PQBN.0 size=300739 2024-09-12T00:36:24.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.641+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=2D4PGUF5PQBN tag=9L8H5DA0SY1P type=write size=1349315 2024-09-12T00:36:24.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.642+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~GF7SOKHQV4NT.0 size=1048576 2024-09-12T00:36:24.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.644+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~GF7SOKHQV4NT.1 size=1048576 2024-09-12T00:36:24.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.644+0000 7f030cb87780 1 < canceled part key=_multipart_HUDEU16YTO0Y.2~GF7SOKHQV4NT.2 size=296691 2024-09-12T00:36:24.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.646+0000 7f030cb87780 1 < canceled multipart upload key=HUDEU16YTO0Y upload=GF7SOKHQV4NT tag=Z7F53KODCE02 type=write size=3442419 2024-09-12T00:36:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.649+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~HQ3RXIRDXK6H.0 size=1048576 2024-09-12T00:36:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.650+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~HQ3RXIRDXK6H.1 size=100731 2024-09-12T00:36:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.650+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=HQ3RXIRDXK6H tag=JAZ15V38RX05 type=write size=2197883 2024-09-12T00:36:24.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.651+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=BI0G9JED1HWB type=del 2024-09-12T00:36:24.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.653+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~AZXGDSO9WVAN.0 size=1048576 2024-09-12T00:36:24.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.655+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~AZXGDSO9WVAN.1 size=1048576 2024-09-12T00:36:24.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.656+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~AZXGDSO9WVAN.2 size=1025336 2024-09-12T00:36:24.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.656+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=AZXGDSO9WVAN tag=ND6RINHTJFZ8 type=write size=4171064 2024-09-12T00:36:24.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.660+0000 7f030cb87780 1 < suggested remove operation key=INFFH9R3EFRY tag=3E1SV8K3L7XP type=del 2024-09-12T00:36:24.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.662+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~TINFOE94YTMI.0 size=1048576 2024-09-12T00:36:24.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.664+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~TINFOE94YTMI.1 size=472602 2024-09-12T00:36:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.664+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=TINFOE94YTMI tag=W8RC2A629VLZ type=write size=2569754 2024-09-12T00:36:24.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.664+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~2CT61KXQB7IG.0 size=1048576 2024-09-12T00:36:24.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.666+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~2CT61KXQB7IG.1 size=122936 2024-09-12T00:36:24.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.669+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=2CT61KXQB7IG tag=VJZFON6LFCEP type=write size=2220088 2024-09-12T00:36:24.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.670+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=HLDDVHGV4BOX type=write size=155215 2024-09-12T00:36:24.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.671+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~7HYNYGEBYW1D.0 size=699123 2024-09-12T00:36:24.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.673+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=7HYNYGEBYW1D tag=Q2M71X12BAT8 type=write size=1747699 2024-09-12T00:36:24.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.675+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=QQ2BYF9S8FQT type=del size=1935982 2024-09-12T00:36:24.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.676+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=WZ9E10DXWCBD type=del 2024-09-12T00:36:24.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.677+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=S1PL9RSGGKOX type=del size=1543195 2024-09-12T00:36:24.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.679+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~FLUTF8NG2ZM7.0 size=346362 2024-09-12T00:36:24.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.681+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=FLUTF8NG2ZM7 tag=EICT5UFT7C2O type=write size=1394938 2024-09-12T00:36:24.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.683+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=LRZO3YK7F541 type=del size=1131807 2024-09-12T00:36:24.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.685+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=6MDPS2ASVGWJ type=del 2024-09-12T00:36:24.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.687+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~D24GVWRMEQNA.0 size=1048576 2024-09-12T00:36:24.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.688+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~D24GVWRMEQNA.1 size=1048576 2024-09-12T00:36:24.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.689+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~D24GVWRMEQNA.2 size=31060 2024-09-12T00:36:24.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.689+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=D24GVWRMEQNA tag=DRBA1RQKGJOB type=write size=3176788 2024-09-12T00:36:24.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.692+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~F1T9R0ROO57I.0 size=1048576 2024-09-12T00:36:24.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.693+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~F1T9R0ROO57I.1 size=1048576 2024-09-12T00:36:24.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.693+0000 7f030cb87780 1 < canceled part key=_multipart_6WHZRKLM3OLP.2~F1T9R0ROO57I.2 size=520539 2024-09-12T00:36:24.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.694+0000 7f030cb87780 1 < canceled multipart upload key=6WHZRKLM3OLP upload=F1T9R0ROO57I tag=SA49ICFEN97C type=write size=3666267 2024-09-12T00:36:24.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.696+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=HDUSNNC71QWY type=del size=3692727 2024-09-12T00:36:24.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.699+0000 7f030cb87780 1 < suggested remove operation key=POC8YA58U55N tag=813FG7Q97YUS type=del 2024-09-12T00:36:24.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.700+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=RJ3JIYIXTUWB type=del size=2814085 2024-09-12T00:36:24.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.700+0000 7f030cb87780 -1 < no bi entry to suggest for operation key=POC8YA58U55N tag=3RHZQOW8UAP5 type=del size=3415086: (2) No such file or directory 2024-09-12T00:36:24.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.702+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=MTR7XP6GNUWM type=del size=1153725 2024-09-12T00:36:24.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.703+0000 7f030cb87780 1 < canceled operation key=ZQD0491BHJPM tag=L3N2G8XPGA5A type=del size=547257 2024-09-12T00:36:24.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.704+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=1AR2Q3OWMDYB type=del size=4178874 2024-09-12T00:36:24.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.706+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=UCOTOA2RDNPL type=del 2024-09-12T00:36:24.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.707+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=KJE2VW756QFW type=del size=3990642 2024-09-12T00:36:24.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.709+0000 7f030cb87780 1 < completed write operation key=OR439FK5L43V tag=ALEZGRFM0NY6 type=write size=311158 2024-09-12T00:36:24.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.711+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~2W4GXX2XO8NQ.0 size=1048576 2024-09-12T00:36:24.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.713+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~2W4GXX2XO8NQ.1 size=833661 2024-09-12T00:36:24.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.713+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=2W4GXX2XO8NQ tag=8ONAX2YTBY6F type=write size=2930813 2024-09-12T00:36:24.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.714+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~A6TQ5LY87MMO.0 size=1048576 2024-09-12T00:36:24.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.715+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~A6TQ5LY87MMO.1 size=30094 2024-09-12T00:36:24.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.717+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=A6TQ5LY87MMO tag=SLSFZMPGPG8E type=write size=2127246 2024-09-12T00:36:24.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.720+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~JK1ISHUD66IH.0 size=1048576 2024-09-12T00:36:24.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.722+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~JK1ISHUD66IH.1 size=1048576 2024-09-12T00:36:24.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.723+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~JK1ISHUD66IH.2 size=474995 2024-09-12T00:36:24.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.723+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=JK1ISHUD66IH tag=Q1Q5S9QGUKZJ type=write size=3620723 2024-09-12T00:36:24.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.724+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~2D4PGUF5PQBN.0 size=300739 2024-09-12T00:36:24.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.726+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=2D4PGUF5PQBN tag=9L8H5DA0SY1P type=write size=1349315 2024-09-12T00:36:24.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.727+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=GJMROK4LCQT6 type=del size=3448875 2024-09-12T00:36:24.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.729+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~HQ3RXIRDXK6H.0 size=1048576 2024-09-12T00:36:24.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.730+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~HQ3RXIRDXK6H.1 size=100731 2024-09-12T00:36:24.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.732+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=HQ3RXIRDXK6H tag=JAZ15V38RX05 type=write size=2197883 2024-09-12T00:36:24.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.735+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~JI6RX5YUNDU1.0 size=258387 2024-09-12T00:36:24.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.735+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=JI6RX5YUNDU1 tag=LCQNLCBIKI9S type=write size=1306963 2024-09-12T00:36:24.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.736+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~AZXGDSO9WVAN.0 size=1048576 2024-09-12T00:36:24.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.738+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~AZXGDSO9WVAN.1 size=1048576 2024-09-12T00:36:24.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.739+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~AZXGDSO9WVAN.2 size=1025336 2024-09-12T00:36:24.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.741+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=AZXGDSO9WVAN tag=ND6RINHTJFZ8 type=write size=4171064 2024-09-12T00:36:24.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.742+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=SQ47UFJLN6A3 type=del size=699294 2024-09-12T00:36:24.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.744+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~TINFOE94YTMI.0 size=1048576 2024-09-12T00:36:24.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.745+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~TINFOE94YTMI.1 size=472602 2024-09-12T00:36:24.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.747+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=TINFOE94YTMI tag=W8RC2A629VLZ type=write size=2569754 2024-09-12T00:36:24.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.749+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=UXE0LXUR1X0P type=write size=836622 2024-09-12T00:36:24.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.750+0000 7f030cb87780 1 < completed write operation key=ZQD0491BHJPM tag=HLDDVHGV4BOX type=write size=155215 2024-09-12T00:36:24.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.751+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=Q6C3ACUHLK24 type=del size=130270 2024-09-12T00:36:24.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.753+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=QQ2BYF9S8FQT type=del 2024-09-12T00:36:24.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.754+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=QQ24V15VD67D type=del size=1847405 2024-09-12T00:36:24.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.758+0000 7f030cb87780 1 < suggested remove operation key=800OHA7UURC4 tag=S1PL9RSGGKOX type=del 2024-09-12T00:36:24.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.759+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=4N2ILER53R2B type=del size=2409470 2024-09-12T00:36:24.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.761+0000 7f030cb87780 1 < suggested update operation key=CY2NS03IIUJJ tag=LRZO3YK7F541 type=del size=1131807 2024-09-12T00:36:24.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.763+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=D1GTKMH6NEHY type=del size=1725052 2024-09-12T00:36:24.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.764+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~D24GVWRMEQNA.0 size=1048576 2024-09-12T00:36:24.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.764+0000 7f030cb87780 1 < canceled part key=_multipart_ELX0797T1L4C.2~D24GVWRMEQNA.1 size=1048576 2024-09-12T00:36:24.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.765+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~D24GVWRMEQNA.2 size=31060 2024-09-12T00:36:24.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.769+0000 7f030cb87780 1 < canceled multipart upload key=ELX0797T1L4C upload=D24GVWRMEQNA tag=DRBA1RQKGJOB type=write size=3176788 2024-09-12T00:36:24.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.771+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~2GBEEDNNEX89.0 size=1048576 2024-09-12T00:36:24.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.774+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~2GBEEDNNEX89.1 size=1048576 2024-09-12T00:36:24.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.774+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~2GBEEDNNEX89.2 size=299006 2024-09-12T00:36:24.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.774+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=2GBEEDNNEX89 tag=DRSZHOYQ2NQA type=write size=3444734 2024-09-12T00:36:24.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.776+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=HDUSNNC71QWY type=del 2024-09-12T00:36:24.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.777+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=OLYP4BC4M86M type=del size=3873224 2024-09-12T00:36:24.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.779+0000 7f030cb87780 1 < canceled operation key=N3KD1UVUVM95 tag=RJ3JIYIXTUWB type=del size=2814085 2024-09-12T00:36:24.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.780+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=CQJFTT5RESZK type=write size=967545 2024-09-12T00:36:24.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.782+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=MTR7XP6GNUWM type=del 2024-09-12T00:36:24.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.783+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=KK9WOIN0Z2AJ type=del size=2838717 2024-09-12T00:36:24.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.784+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=1AR2Q3OWMDYB type=del 2024-09-12T00:36:24.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.786+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=YH5ECPN03T8Q type=write size=716088 2024-09-12T00:36:24.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.787+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=KJE2VW756QFW type=del 2024-09-12T00:36:24.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.789+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=W7GUS6G65ZC4 type=del size=3278109 2024-09-12T00:36:24.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.789+0000 7f030cb87780 1 < canceled part key=_multipart_800OHA7UURC4.2~2W4GXX2XO8NQ.0 size=1048576 2024-09-12T00:36:24.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.790+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~2W4GXX2XO8NQ.1 size=833661 2024-09-12T00:36:24.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.792+0000 7f030cb87780 1 < canceled multipart upload key=800OHA7UURC4 upload=2W4GXX2XO8NQ tag=8ONAX2YTBY6F type=write size=2930813 2024-09-12T00:36:24.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.794+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=V6OXX52TYL4T type=write size=226187 2024-09-12T00:36:24.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.796+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~JK1ISHUD66IH.0 size=1048576 2024-09-12T00:36:24.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.797+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~JK1ISHUD66IH.1 size=1048576 2024-09-12T00:36:24.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.798+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~JK1ISHUD66IH.2 size=474995 2024-09-12T00:36:24.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.800+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=JK1ISHUD66IH tag=Q1Q5S9QGUKZJ type=write size=3620723 2024-09-12T00:36:24.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.801+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=1S4DL5ZCHTUU type=del size=3359560 2024-09-12T00:36:24.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.803+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=GJMROK4LCQT6 type=del 2024-09-12T00:36:24.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.805+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=SLZR42NQPKBT type=del size=2063048 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.806+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~JI6RX5YUNDU1.0 size=258387 2024-09-12T00:36:24.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.809+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=JI6RX5YUNDU1 tag=LCQNLCBIKI9S type=write size=1306963 2024-09-12T00:36:24.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.810+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=E44DG4II0BJ6 type=write size=946623 2024-09-12T00:36:24.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.811+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=SQ47UFJLN6A3 type=del 2024-09-12T00:36:24.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.813+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~KVLFTR58SDX9.0 size=286006 2024-09-12T00:36:24.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.813+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=KVLFTR58SDX9 tag=2GGYTLS4RP7N type=write size=1334582 2024-09-12T00:36:24.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.815+0000 7f030cb87780 1 < completed write operation key=IY156CJWG2TB tag=UXE0LXUR1X0P type=write size=836622 2024-09-12T00:36:24.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.818+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~OFMZLRKW8PHO.0 size=1048576 2024-09-12T00:36:24.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.819+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~OFMZLRKW8PHO.1 size=645611 2024-09-12T00:36:24.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.819+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=OFMZLRKW8PHO tag=TNMC1QSHMQAJ type=write size=2742763 2024-09-12T00:36:24.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.820+0000 7f030cb87780 1 < canceled operation key=ZQD0491BHJPM tag=Q6C3ACUHLK24 type=del size=130270 2024-09-12T00:36:24.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.823+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~5N5CTDOKU4NK.0 size=774479 2024-09-12T00:36:24.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.823+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=5N5CTDOKU4NK tag=H6FI8048OS3Q type=write size=1823055 2024-09-12T00:36:24.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.826+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=QQ24V15VD67D type=del 2024-09-12T00:36:24.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.828+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=3YGL2FKKMJT4 type=del size=3592731 2024-09-12T00:36:24.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.829+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=4N2ILER53R2B type=del 2024-09-12T00:36:24.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.830+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=PTWHBLTQURZK type=del size=868747 2024-09-12T00:36:24.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.831+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=D1GTKMH6NEHY type=del 2024-09-12T00:36:24.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.834+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~6JIAPRWBT9Z9.0 size=1048576 2024-09-12T00:36:24.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.836+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~6JIAPRWBT9Z9.1 size=725886 2024-09-12T00:36:24.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.836+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=6JIAPRWBT9Z9 tag=B0CIM49APVOO type=write size=2823038 2024-09-12T00:36:24.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.836+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~2GBEEDNNEX89.0 size=1048576 2024-09-12T00:36:24.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.838+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~2GBEEDNNEX89.1 size=1048576 2024-09-12T00:36:24.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.838+0000 7f030cb87780 1 < canceled part key=_multipart_OR439FK5L43V.2~2GBEEDNNEX89.2 size=299006 2024-09-12T00:36:24.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.840+0000 7f030cb87780 1 < canceled multipart upload key=OR439FK5L43V upload=2GBEEDNNEX89 tag=DRSZHOYQ2NQA type=write size=3444734 2024-09-12T00:36:24.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.842+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~CO2TI8AQWCNN.0 size=502375 2024-09-12T00:36:24.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.842+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=CO2TI8AQWCNN tag=3BRZ194IY3VL type=write size=1550951 2024-09-12T00:36:24.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.844+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=OLYP4BC4M86M type=del 2024-09-12T00:36:24.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.846+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=E8ZS2QXRH1CA type=del size=3660033 2024-09-12T00:36:24.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.847+0000 7f030cb87780 1 < completed write operation key=3W7ANGL92ZF0 tag=CQJFTT5RESZK type=write size=967545 2024-09-12T00:36:24.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.848+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=1FNTLQV0WPFY type=del size=1330819 2024-09-12T00:36:24.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.850+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=KK9WOIN0Z2AJ type=del 2024-09-12T00:36:24.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.853+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~V6DB2LR01NOV.0 size=1048576 2024-09-12T00:36:24.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.854+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~V6DB2LR01NOV.1 size=1048576 2024-09-12T00:36:24.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.856+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~V6DB2LR01NOV.2 size=257062 2024-09-12T00:36:24.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.856+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=V6DB2LR01NOV tag=EZXU1O9OMOGZ type=write size=3402790 2024-09-12T00:36:24.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.857+0000 7f030cb87780 1 < completed write operation key=OR439FK5L43V tag=YH5ECPN03T8Q type=write size=716088 2024-09-12T00:36:24.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.858+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=9V8P207O2ZVH type=write size=144361 2024-09-12T00:36:24.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.861+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=W7GUS6G65ZC4 type=del 2024-09-12T00:36:24.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.862+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=05NQ0KIPZQJV type=del size=3352249 2024-09-12T00:36:24.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.863+0000 7f030cb87780 1 < completed write operation key=1VOJGMWNKS0A tag=V6OXX52TYL4T type=write size=226187 2024-09-12T00:36:24.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.866+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~IF70MT2BX9PA.0 size=1048576 2024-09-12T00:36:24.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.868+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~IF70MT2BX9PA.1 size=1048576 2024-09-12T00:36:24.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.868+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~IF70MT2BX9PA.2 size=629929 2024-09-12T00:36:24.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.868+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=IF70MT2BX9PA tag=QT3X58LIGAUW type=write size=3775657 2024-09-12T00:36:24.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.869+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=1S4DL5ZCHTUU type=del 2024-09-12T00:36:24.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.871+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=UYM0DQHYJZKI type=del size=172728 2024-09-12T00:36:24.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.872+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=SLZR42NQPKBT type=del 2024-09-12T00:36:24.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.875+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~7YNK6CBGA6Z0.0 size=1048576 2024-09-12T00:36:24.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.876+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~7YNK6CBGA6Z0.1 size=980008 2024-09-12T00:36:24.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.876+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=7YNK6CBGA6Z0 tag=GLFC46U2F63G type=write size=3077160 2024-09-12T00:36:24.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.877+0000 7f030cb87780 1 < completed write operation key=327RDLIWLVRO tag=E44DG4II0BJ6 type=write size=946623 2024-09-12T00:36:24.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.880+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~YP9T0EDBHF2K.0 size=1048576 2024-09-12T00:36:24.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.881+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~YP9T0EDBHF2K.1 size=598878 2024-09-12T00:36:24.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.881+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=YP9T0EDBHF2K tag=BOW7YPM2GNGK type=write size=2696030 2024-09-12T00:36:24.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.882+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~KVLFTR58SDX9.0 size=286006 2024-09-12T00:36:24.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.885+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=KVLFTR58SDX9 tag=2GGYTLS4RP7N type=write size=1334582 2024-09-12T00:36:24.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.886+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=RCM5VNFMD3YW type=del size=3710142 2024-09-12T00:36:24.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.888+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~OFMZLRKW8PHO.0 size=1048576 2024-09-12T00:36:24.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.889+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~OFMZLRKW8PHO.1 size=645611 2024-09-12T00:36:24.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.892+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=OFMZLRKW8PHO tag=TNMC1QSHMQAJ type=write size=2742763 2024-09-12T00:36:24.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.894+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~3PB9BLHOCBY1.0 size=1048576 2024-09-12T00:36:24.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.895+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~3PB9BLHOCBY1.1 size=1048576 2024-09-12T00:36:24.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.896+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~3PB9BLHOCBY1.2 size=266493 2024-09-12T00:36:24.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.896+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=3PB9BLHOCBY1 tag=W4ZK5EQVR57F type=write size=3412221 2024-09-12T00:36:24.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.897+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~5N5CTDOKU4NK.0 size=774479 2024-09-12T00:36:24.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.900+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=5N5CTDOKU4NK tag=H6FI8048OS3Q type=write size=1823055 2024-09-12T00:36:24.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.901+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=XNR4KS245OCY type=del size=2077782 2024-09-12T00:36:24.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.902+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=3YGL2FKKMJT4 type=del 2024-09-12T00:36:24.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.905+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=Y8VBSIJ8GH55 type=del size=1771965 2024-09-12T00:36:24.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.906+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=PTWHBLTQURZK type=del 2024-09-12T00:36:24.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.907+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=WCN4EAP0X8O3 type=del size=3904990 2024-09-12T00:36:24.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.909+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~6JIAPRWBT9Z9.0 size=1048576 2024-09-12T00:36:24.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.910+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~6JIAPRWBT9Z9.1 size=725886 2024-09-12T00:36:24.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.912+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=6JIAPRWBT9Z9 tag=B0CIM49APVOO type=write size=2823038 2024-09-12T00:36:24.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.914+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=2VZANU8OSSAJ type=del size=3430888 2024-09-12T00:36:24.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.914+0000 7f030cb87780 1 < canceled part key=_multipart_INFFH9R3EFRY.2~CO2TI8AQWCNN.0 size=502375 2024-09-12T00:36:24.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.916+0000 7f030cb87780 1 < canceled multipart upload key=INFFH9R3EFRY upload=CO2TI8AQWCNN tag=3BRZ194IY3VL type=write size=1550951 2024-09-12T00:36:24.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.919+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=ID8L8LECKO55 type=del size=1255056 2024-09-12T00:36:24.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.920+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=E8ZS2QXRH1CA type=del 2024-09-12T00:36:24.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.923+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~PCGFOX3PJWLE.0 size=680359 2024-09-12T00:36:24.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.923+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=PCGFOX3PJWLE tag=8HDTKFXJOZCI type=write size=1728935 2024-09-12T00:36:24.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.924+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=1FNTLQV0WPFY type=del 2024-09-12T00:36:24.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.927+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~1BSGRZGUWDD7.0 size=1005050 2024-09-12T00:36:24.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.927+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=1BSGRZGUWDD7 tag=5MTMKM5HHKJH type=write size=2053626 2024-09-12T00:36:24.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.927+0000 7f030cb87780 1 < canceled part key=_multipart_ELX0797T1L4C.2~V6DB2LR01NOV.0 size=1048576 2024-09-12T00:36:24.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.928+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~V6DB2LR01NOV.1 size=1048576 2024-09-12T00:36:24.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.929+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~V6DB2LR01NOV.2 size=257062 2024-09-12T00:36:24.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.931+0000 7f030cb87780 1 < canceled multipart upload key=ELX0797T1L4C upload=V6DB2LR01NOV tag=EZXU1O9OMOGZ type=write size=3402790 2024-09-12T00:36:24.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.932+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=IGDMXIGOSHMC type=del size=3234695 2024-09-12T00:36:24.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.933+0000 7f030cb87780 1 < completed write operation key=QGSJ51GMQXVK tag=9V8P207O2ZVH type=write size=144361 2024-09-12T00:36:24.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.936+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~EOPQLEIY4EIJ.0 size=622996 2024-09-12T00:36:24.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.936+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=EOPQLEIY4EIJ tag=AGU0KJH8SUYN type=write size=1671572 2024-09-12T00:36:24.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.937+0000 7f030cb87780 1 < canceled operation key=ZQD0491BHJPM tag=05NQ0KIPZQJV type=del size=3352249 2024-09-12T00:36:24.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.941+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~B93OGZKM9JE3.0 size=1048576 2024-09-12T00:36:24.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.941+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~B93OGZKM9JE3.1 size=303698 2024-09-12T00:36:24.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.941+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=B93OGZKM9JE3 tag=BW38QACTAZWE type=write size=2400850 2024-09-12T00:36:24.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.943+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~IF70MT2BX9PA.0 size=1048576 2024-09-12T00:36:24.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.944+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~IF70MT2BX9PA.1 size=1048576 2024-09-12T00:36:24.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.945+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~IF70MT2BX9PA.2 size=629929 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.948+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=IF70MT2BX9PA tag=QT3X58LIGAUW type=write size=3775657 2024-09-12T00:36:24.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.950+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=3KHGIXVOF3OT type=del size=2694941 2024-09-12T00:36:24.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.950+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=UYM0DQHYJZKI type=del 2024-09-12T00:36:24.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.952+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=0WVY6FBQ6OZY type=del size=3828293 2024-09-12T00:36:24.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.953+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~7YNK6CBGA6Z0.0 size=1048576 2024-09-12T00:36:24.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.954+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~7YNK6CBGA6Z0.1 size=980008 2024-09-12T00:36:24.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.958+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=7YNK6CBGA6Z0 tag=GLFC46U2F63G type=write size=3077160 2024-09-12T00:36:24.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.962+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~U86L7C8NKDNS.0 size=757453 2024-09-12T00:36:24.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.962+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=U86L7C8NKDNS tag=6RL2E58FH5AV type=write size=1806029 2024-09-12T00:36:24.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.964+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~YP9T0EDBHF2K.0 size=1048576 2024-09-12T00:36:24.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.965+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~YP9T0EDBHF2K.1 size=598878 2024-09-12T00:36:24.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.967+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=YP9T0EDBHF2K tag=BOW7YPM2GNGK type=write size=2696030 2024-09-12T00:36:24.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.971+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~OCIWCNU5XPRK.0 size=1048576 2024-09-12T00:36:24.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.971+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~OCIWCNU5XPRK.1 size=1048576 2024-09-12T00:36:24.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.973+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~OCIWCNU5XPRK.2 size=847319 2024-09-12T00:36:24.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.973+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=OCIWCNU5XPRK tag=Y7TQLR5SIDSH type=write size=3993047 2024-09-12T00:36:24.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.976+0000 7f030cb87780 1 < suggested remove operation key=CY2NS03IIUJJ tag=RCM5VNFMD3YW type=del 2024-09-12T00:36:24.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.979+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~B2UNUANBLGKW.0 size=445221 2024-09-12T00:36:24.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.979+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=B2UNUANBLGKW tag=ZR8NDD044PVA type=write size=1493797 2024-09-12T00:36:24.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.980+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~3PB9BLHOCBY1.0 size=1048576 2024-09-12T00:36:24.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.981+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~3PB9BLHOCBY1.1 size=1048576 2024-09-12T00:36:24.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.983+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~3PB9BLHOCBY1.2 size=266493 2024-09-12T00:36:24.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.985+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=3PB9BLHOCBY1 tag=W4ZK5EQVR57F type=write size=3412221 2024-09-12T00:36:24.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.989+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~86EM1GXGQWSL.0 size=1048576 2024-09-12T00:36:24.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.989+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~86EM1GXGQWSL.1 size=832965 2024-09-12T00:36:24.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.989+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=86EM1GXGQWSL tag=CWUROQJ4ZVDB type=write size=2930117 2024-09-12T00:36:24.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.991+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=XNR4KS245OCY type=del 2024-09-12T00:36:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.992+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=C9MDCNGRRDP6 type=del size=1308825 2024-09-12T00:36:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.994+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=Y8VBSIJ8GH55 type=del 2024-09-12T00:36:24.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.998+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~A0WCFCPTJCQ9.0 size=1048576 2024-09-12T00:36:24.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.999+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~A0WCFCPTJCQ9.1 size=1048576 2024-09-12T00:36:24.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.999+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~A0WCFCPTJCQ9.2 size=490733 2024-09-12T00:36:24.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:24.999+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=A0WCFCPTJCQ9 tag=5RR7QHRMYVE2 type=write size=3636461 2024-09-12T00:36:25.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.002+0000 7f030cb87780 1 < suggested remove operation key=39WSAOA6P09M tag=WCN4EAP0X8O3 type=del 2024-09-12T00:36:25.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.006+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~4WE1M992H871.0 size=1048576 2024-09-12T00:36:25.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.006+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~4WE1M992H871.1 size=152061 2024-09-12T00:36:25.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.006+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=4WE1M992H871 tag=8GYE2983RAE0 type=write size=2249213 2024-09-12T00:36:25.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.010+0000 7f030cb87780 1 < suggested remove operation key=JPEIGLC162K3 tag=2VZANU8OSSAJ type=del 2024-09-12T00:36:25.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.012+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~I4PHD3U0GO1G.0 size=1048576 2024-09-12T00:36:25.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.014+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~I4PHD3U0GO1G.1 size=483187 2024-09-12T00:36:25.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.014+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=I4PHD3U0GO1G tag=3BWXCDGUGY8W type=write size=2580339 2024-09-12T00:36:25.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.015+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=ID8L8LECKO55 type=del 2024-09-12T00:36:25.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.019+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~X04SIEC38XTG.0 size=1048576 2024-09-12T00:36:25.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.019+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~X04SIEC38XTG.1 size=1048576 2024-09-12T00:36:25.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.021+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~X04SIEC38XTG.2 size=989938 2024-09-12T00:36:25.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.021+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=X04SIEC38XTG tag=AZUOG1C9LCZJ type=write size=4135666 2024-09-12T00:36:25.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.023+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~PCGFOX3PJWLE.0 size=680359 2024-09-12T00:36:25.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.025+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=PCGFOX3PJWLE tag=8HDTKFXJOZCI type=write size=1728935 2024-09-12T00:36:25.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.029+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~6Q3XL8GZ430S.0 size=1048576 2024-09-12T00:36:25.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.030+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~6Q3XL8GZ430S.1 size=90308 2024-09-12T00:36:25.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.030+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=6Q3XL8GZ430S tag=O8ELQ9CT59Z8 type=write size=2187460 2024-09-12T00:36:25.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.031+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~1BSGRZGUWDD7.0 size=1005050 2024-09-12T00:36:25.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.034+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=1BSGRZGUWDD7 tag=5MTMKM5HHKJH type=write size=2053626 2024-09-12T00:36:25.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.035+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=NYAY2DQT2408 type=del size=3156524 2024-09-12T00:36:25.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.037+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=IGDMXIGOSHMC type=del 2024-09-12T00:36:25.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.038+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=AO431HZWHOHB type=del size=3654231 2024-09-12T00:36:25.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.040+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~EOPQLEIY4EIJ.0 size=622996 2024-09-12T00:36:25.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.042+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=EOPQLEIY4EIJ tag=AGU0KJH8SUYN type=write size=1671572 2024-09-12T00:36:25.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.045+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~Y8SPFJ596CY2.0 size=1048576 2024-09-12T00:36:25.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.046+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~Y8SPFJ596CY2.1 size=362227 2024-09-12T00:36:25.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.046+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=Y8SPFJ596CY2 tag=YKCE5USE2HN5 type=write size=2459379 2024-09-12T00:36:25.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.047+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~B93OGZKM9JE3.0 size=1048576 2024-09-12T00:36:25.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.048+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~B93OGZKM9JE3.1 size=303698 2024-09-12T00:36:25.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.052+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=B93OGZKM9JE3 tag=BW38QACTAZWE type=write size=2400850 2024-09-12T00:36:25.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.052+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=MTRLK0LWQ849 type=del size=3791603 2024-09-12T00:36:25.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.054+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=3KHGIXVOF3OT type=del 2024-09-12T00:36:25.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.056+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~FBPUL5H1LMTX.0 size=1048576 2024-09-12T00:36:25.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.057+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~FBPUL5H1LMTX.1 size=1048576 2024-09-12T00:36:25.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.059+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~FBPUL5H1LMTX.2 size=241544 2024-09-12T00:36:25.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.059+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=FBPUL5H1LMTX tag=U81XPAGGBFPC type=write size=3387272 2024-09-12T00:36:25.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.060+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=0WVY6FBQ6OZY type=del 2024-09-12T00:36:25.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.062+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~DF8EJF5IW1LP.0 size=1048576 2024-09-12T00:36:25.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.064+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~DF8EJF5IW1LP.1 size=1048576 2024-09-12T00:36:25.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.065+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~DF8EJF5IW1LP.2 size=523714 2024-09-12T00:36:25.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.065+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=DF8EJF5IW1LP tag=E3UDEMEVTNPE type=write size=3669442 2024-09-12T00:36:25.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.066+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~U86L7C8NKDNS.0 size=757453 2024-09-12T00:36:25.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.068+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=U86L7C8NKDNS tag=6RL2E58FH5AV type=write size=1806029 2024-09-12T00:36:25.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.072+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~LSLP76O5CDR5.0 size=1048576 2024-09-12T00:36:25.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.072+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~LSLP76O5CDR5.1 size=1048576 2024-09-12T00:36:25.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.073+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~LSLP76O5CDR5.2 size=171235 2024-09-12T00:36:25.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.073+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=LSLP76O5CDR5 tag=VIC1CZ7PKI80 type=write size=3316963 2024-09-12T00:36:25.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.075+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~OCIWCNU5XPRK.0 size=1048576 2024-09-12T00:36:25.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.076+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~OCIWCNU5XPRK.1 size=1048576 2024-09-12T00:36:25.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.077+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~OCIWCNU5XPRK.2 size=847319 2024-09-12T00:36:25.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.079+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=OCIWCNU5XPRK tag=Y7TQLR5SIDSH type=write size=3993047 2024-09-12T00:36:25.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.081+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=1MVFU57F03PM type=del size=2255065 2024-09-12T00:36:25.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.082+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~B2UNUANBLGKW.0 size=445221 2024-09-12T00:36:25.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.084+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=B2UNUANBLGKW tag=ZR8NDD044PVA type=write size=1493797 2024-09-12T00:36:25.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.087+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~RXKY0234ERF3.0 size=1048576 2024-09-12T00:36:25.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.088+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~RXKY0234ERF3.1 size=1048576 2024-09-12T00:36:25.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.089+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~RXKY0234ERF3.2 size=71527 2024-09-12T00:36:25.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.089+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=RXKY0234ERF3 tag=0QREG7P70XAS type=write size=3217255 2024-09-12T00:36:25.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.090+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~86EM1GXGQWSL.0 size=1048576 2024-09-12T00:36:25.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.092+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~86EM1GXGQWSL.1 size=832965 2024-09-12T00:36:25.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.095+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=86EM1GXGQWSL tag=CWUROQJ4ZVDB type=write size=2930117 2024-09-12T00:36:25.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.097+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=XT04VAM58W4P type=del size=761540 2024-09-12T00:36:25.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.099+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=C9MDCNGRRDP6 type=del 2024-09-12T00:36:25.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.099+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=4ZOLGBHDPOYV type=write size=626384 2024-09-12T00:36:25.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.100+0000 7f030cb87780 1 < canceled part key=_multipart_UFYMVGL264T8.2~A0WCFCPTJCQ9.0 size=1048576 2024-09-12T00:36:25.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.101+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~A0WCFCPTJCQ9.1 size=1048576 2024-09-12T00:36:25.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.102+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~A0WCFCPTJCQ9.2 size=490733 2024-09-12T00:36:25.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.105+0000 7f030cb87780 1 < canceled multipart upload key=UFYMVGL264T8 upload=A0WCFCPTJCQ9 tag=5RR7QHRMYVE2 type=write size=3636461 2024-09-12T00:36:25.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.106+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=A9SKO1BYWQHP type=del size=1585046 2024-09-12T00:36:25.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.106+0000 7f030cb87780 1 < canceled part key=_multipart_9MCRD2G3MZIT.2~4WE1M992H871.0 size=1048576 2024-09-12T00:36:25.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.108+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~4WE1M992H871.1 size=152061 2024-09-12T00:36:25.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.110+0000 7f030cb87780 1 < canceled multipart upload key=9MCRD2G3MZIT upload=4WE1M992H871 tag=8GYE2983RAE0 type=write size=2249213 2024-09-12T00:36:25.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.113+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~W8CLOLIT9CHN.0 size=1048576 2024-09-12T00:36:25.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.114+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~W8CLOLIT9CHN.1 size=829775 2024-09-12T00:36:25.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.114+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=W8CLOLIT9CHN tag=AXXQGDN6V7UW type=write size=2926927 2024-09-12T00:36:25.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.116+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~I4PHD3U0GO1G.0 size=1048576 2024-09-12T00:36:25.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.117+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~I4PHD3U0GO1G.1 size=483187 2024-09-12T00:36:25.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.119+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=I4PHD3U0GO1G tag=3BWXCDGUGY8W type=write size=2580339 2024-09-12T00:36:25.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.122+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~X43ANS6QPGIL.0 size=846502 2024-09-12T00:36:25.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.122+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=X43ANS6QPGIL tag=WWB1CKLCNVW9 type=write size=1895078 2024-09-12T00:36:25.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.123+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~X04SIEC38XTG.0 size=1048576 2024-09-12T00:36:25.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.124+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~X04SIEC38XTG.1 size=1048576 2024-09-12T00:36:25.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.124+0000 7f030cb87780 1 < canceled part key=_multipart_INFFH9R3EFRY.2~X04SIEC38XTG.2 size=989938 2024-09-12T00:36:25.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.126+0000 7f030cb87780 1 < canceled multipart upload key=INFFH9R3EFRY upload=X04SIEC38XTG tag=AZUOG1C9LCZJ type=write size=4135666 2024-09-12T00:36:25.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.129+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~7ZRBF9C2NP4Y.0 size=1048576 2024-09-12T00:36:25.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.130+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~7ZRBF9C2NP4Y.1 size=1048576 2024-09-12T00:36:25.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.132+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~7ZRBF9C2NP4Y.2 size=284465 2024-09-12T00:36:25.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.132+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=7ZRBF9C2NP4Y tag=KZSVVQ2A5420 type=write size=3430193 2024-09-12T00:36:25.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.132+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~6Q3XL8GZ430S.0 size=1048576 2024-09-12T00:36:25.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.132+0000 7f030cb87780 1 < canceled part key=_multipart_1VOJGMWNKS0A.2~6Q3XL8GZ430S.1 size=90308 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.134+0000 7f030cb87780 1 < canceled multipart upload key=1VOJGMWNKS0A upload=6Q3XL8GZ430S tag=O8ELQ9CT59Z8 type=write size=2187460 2024-09-12T00:36:25.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.136+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=ANAPUS7D11QD type=del size=694895 2024-09-12T00:36:25.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.137+0000 7f030cb87780 1 < canceled operation key=POC8YA58U55N tag=NYAY2DQT2408 type=del size=3156524 2024-09-12T00:36:25.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.139+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=1MH5T318XVY7 type=del size=1935742 2024-09-12T00:36:25.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.140+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=AO431HZWHOHB type=del 2024-09-12T00:36:25.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.142+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=SDWL6U1ET3LO type=del size=3614576 2024-09-12T00:36:25.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.143+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~Y8SPFJ596CY2.0 size=1048576 2024-09-12T00:36:25.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.144+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~Y8SPFJ596CY2.1 size=362227 2024-09-12T00:36:25.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.146+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=Y8SPFJ596CY2 tag=YKCE5USE2HN5 type=write size=2459379 2024-09-12T00:36:25.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.148+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=18Z4G9LDLLDV type=del size=4085383 2024-09-12T00:36:25.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.149+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=MTRLK0LWQ849 type=del 2024-09-12T00:36:25.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.152+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~YT81Y5E9ESMI.0 size=872975 2024-09-12T00:36:25.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.152+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=YT81Y5E9ESMI tag=6S6BO6DOVS28 type=write size=1921551 2024-09-12T00:36:25.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.153+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~FBPUL5H1LMTX.0 size=1048576 2024-09-12T00:36:25.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.155+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~FBPUL5H1LMTX.1 size=1048576 2024-09-12T00:36:25.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.156+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~FBPUL5H1LMTX.2 size=241544 2024-09-12T00:36:25.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.158+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=FBPUL5H1LMTX tag=U81XPAGGBFPC type=write size=3387272 2024-09-12T00:36:25.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.161+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~KQR5A4P2I286.0 size=965255 2024-09-12T00:36:25.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.161+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=KQR5A4P2I286 tag=L06KCI2AOPRX type=write size=2013831 2024-09-12T00:36:25.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.162+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~DF8EJF5IW1LP.0 size=1048576 2024-09-12T00:36:25.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.163+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~DF8EJF5IW1LP.1 size=1048576 2024-09-12T00:36:25.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.164+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~DF8EJF5IW1LP.2 size=523714 2024-09-12T00:36:25.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.166+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=DF8EJF5IW1LP tag=E3UDEMEVTNPE type=write size=3669442 2024-09-12T00:36:25.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.167+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=7DTJ6U31S4XD type=del size=2923441 2024-09-12T00:36:25.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.169+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~LSLP76O5CDR5.0 size=1048576 2024-09-12T00:36:25.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.170+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~LSLP76O5CDR5.1 size=1048576 2024-09-12T00:36:25.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.171+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~LSLP76O5CDR5.2 size=171235 2024-09-12T00:36:25.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.173+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=LSLP76O5CDR5 tag=VIC1CZ7PKI80 type=write size=3316963 2024-09-12T00:36:25.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.174+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=7LBRWB0K63OR type=del size=4128785 2024-09-12T00:36:25.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.177+0000 7f030cb87780 1 < suggested update operation key=HUDEU16YTO0Y tag=1MVFU57F03PM type=del size=2255065 2024-09-12T00:36:25.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.178+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=F48N0YSYOLJC type=write size=986047 2024-09-12T00:36:25.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.179+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~RXKY0234ERF3.0 size=1048576 2024-09-12T00:36:25.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.181+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~RXKY0234ERF3.1 size=1048576 2024-09-12T00:36:25.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.182+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~RXKY0234ERF3.2 size=71527 2024-09-12T00:36:25.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.185+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=RXKY0234ERF3 tag=0QREG7P70XAS type=write size=3217255 2024-09-12T00:36:25.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.187+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~DKKBRHTSEDDL.0 size=1048576 2024-09-12T00:36:25.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.188+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~DKKBRHTSEDDL.1 size=1048576 2024-09-12T00:36:25.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.189+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~DKKBRHTSEDDL.2 size=484434 2024-09-12T00:36:25.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.189+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=DKKBRHTSEDDL tag=00NN8MWBLP34 type=write size=3630162 2024-09-12T00:36:25.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.190+0000 7f030cb87780 1 < canceled operation key=6WHZRKLM3OLP tag=XT04VAM58W4P type=del size=761540 2024-09-12T00:36:25.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.192+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~45Y58027ZTGP.0 size=445773 2024-09-12T00:36:25.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.192+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=45Y58027ZTGP tag=ZPI7DMVK84ZB type=write size=1494349 2024-09-12T00:36:25.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.194+0000 7f030cb87780 1 < completed write operation key=86TWUAZAHI4I tag=4ZOLGBHDPOYV type=write size=626384 2024-09-12T00:36:25.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.195+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=K962MA4F7BDY type=del size=3151107 2024-09-12T00:36:25.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.199+0000 7f030cb87780 1 < suggested update operation key=HUDEU16YTO0Y tag=A9SKO1BYWQHP type=del size=1585046 2024-09-12T00:36:25.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.201+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~QNKDINNG741R.0 size=1048576 2024-09-12T00:36:25.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.202+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~QNKDINNG741R.1 size=34860 2024-09-12T00:36:25.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.202+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=QNKDINNG741R tag=IO3Z4VX26OVQ type=write size=2132012 2024-09-12T00:36:25.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.204+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~W8CLOLIT9CHN.0 size=1048576 2024-09-12T00:36:25.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.205+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~W8CLOLIT9CHN.1 size=829775 2024-09-12T00:36:25.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.207+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=W8CLOLIT9CHN tag=AXXQGDN6V7UW type=write size=2926927 2024-09-12T00:36:25.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.209+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=F772XMOLU5VX type=del size=3064032 2024-09-12T00:36:25.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.211+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~X43ANS6QPGIL.0 size=846502 2024-09-12T00:36:25.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.213+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=X43ANS6QPGIL tag=WWB1CKLCNVW9 type=write size=1895078 2024-09-12T00:36:25.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.213+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=YYOQH0N7R9KL type=del size=2932400 2024-09-12T00:36:25.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.215+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~7ZRBF9C2NP4Y.0 size=1048576 2024-09-12T00:36:25.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.216+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~7ZRBF9C2NP4Y.1 size=1048576 2024-09-12T00:36:25.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.217+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~7ZRBF9C2NP4Y.2 size=284465 2024-09-12T00:36:25.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.220+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=7ZRBF9C2NP4Y tag=KZSVVQ2A5420 type=write size=3430193 2024-09-12T00:36:25.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.222+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=CE0QDI72H0FG type=del size=4184915 2024-09-12T00:36:25.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.224+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=ANAPUS7D11QD type=del 2024-09-12T00:36:25.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.225+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=3U21FJOBKLYJ type=del size=1124494 2024-09-12T00:36:25.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.228+0000 7f030cb87780 1 < suggested update operation key=N3KD1UVUVM95 tag=1MH5T318XVY7 type=del size=1935742 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.229+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=HAP5QH7HMY55 type=del size=2225044 2024-09-12T00:36:25.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.231+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=SDWL6U1ET3LO type=del 2024-09-12T00:36:25.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.232+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=YUPGUQZ5FWE5 type=write size=9875 2024-09-12T00:36:25.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.233+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=18Z4G9LDLLDV type=del 2024-09-12T00:36:25.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.237+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~W0GNKS2GK5NI.0 size=1048576 2024-09-12T00:36:25.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.238+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~W0GNKS2GK5NI.1 size=405994 2024-09-12T00:36:25.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.238+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=W0GNKS2GK5NI tag=TGB0HJA5WU2O type=write size=2503146 2024-09-12T00:36:25.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.238+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~YT81Y5E9ESMI.0 size=872975 2024-09-12T00:36:25.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.241+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=YT81Y5E9ESMI tag=6S6BO6DOVS28 type=write size=1921551 2024-09-12T00:36:25.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.242+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=ULERTWAHXY4S type=write size=1022568 2024-09-12T00:36:25.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.243+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~KQR5A4P2I286.0 size=965255 2024-09-12T00:36:25.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.246+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=KQR5A4P2I286 tag=L06KCI2AOPRX type=write size=2013831 2024-09-12T00:36:25.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.249+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~9AVG8N6MCO75.0 size=1048576 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.251+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~9AVG8N6MCO75.1 size=1048576 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.251+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~9AVG8N6MCO75.2 size=195476 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.251+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=9AVG8N6MCO75 tag=4M7TBXEHT5UO type=write size=3341204 2024-09-12T00:36:25.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.252+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=7DTJ6U31S4XD type=del 2024-09-12T00:36:25.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.256+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~QAUGAODAJ7US.0 size=1048576 2024-09-12T00:36:25.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.256+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~QAUGAODAJ7US.1 size=326278 2024-09-12T00:36:25.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.256+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=QAUGAODAJ7US tag=1T25VI4ZXKBS type=write size=2423430 2024-09-12T00:36:25.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.258+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=7LBRWB0K63OR type=del 2024-09-12T00:36:25.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.261+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~H9XRG440VMAH.0 size=873468 2024-09-12T00:36:25.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.261+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=H9XRG440VMAH tag=KY32N9NJGWLE type=write size=1922044 2024-09-12T00:36:25.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.263+0000 7f030cb87780 1 < completed write operation key=ATTMOL2TGUN7 tag=F48N0YSYOLJC type=write size=986047 2024-09-12T00:36:25.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.264+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=CFHFQS2N7UNE type=write size=530552 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.266+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~DKKBRHTSEDDL.0 size=1048576 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.266+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~DKKBRHTSEDDL.1 size=1048576 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.268+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~DKKBRHTSEDDL.2 size=484434 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.270+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=DKKBRHTSEDDL tag=00NN8MWBLP34 type=write size=3630162 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.272+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~5ISOOAJM3RWR.0 size=1048576 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.273+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~5ISOOAJM3RWR.1 size=1048576 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.275+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~5ISOOAJM3RWR.2 size=197436 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.275+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=5ISOOAJM3RWR tag=ZZNDECUOUTFU type=write size=3343164 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.276+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~45Y58027ZTGP.0 size=445773 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.278+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=45Y58027ZTGP tag=ZPI7DMVK84ZB type=write size=1494349 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.280+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=1M02Q609D5MS type=write size=756376 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.281+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=K962MA4F7BDY type=del 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.282+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=U6XFEF1EMXDC type=del size=1365493 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.284+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~QNKDINNG741R.0 size=1048576 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.286+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~QNKDINNG741R.1 size=34860 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.287+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=QNKDINNG741R tag=IO3Z4VX26OVQ type=write size=2132012 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.290+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~SEEWG4IR7A8H.0 size=1048576 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.291+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~SEEWG4IR7A8H.1 size=608756 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.291+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=SEEWG4IR7A8H tag=6DUYB2OD80ES type=write size=2705908 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.293+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=F772XMOLU5VX type=del 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.295+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~1FZWFNVIEVGF.0 size=704101 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.295+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=1FZWFNVIEVGF tag=67G12R60OY07 type=write size=1752677 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.296+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=YYOQH0N7R9KL type=del 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.298+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=MYD7U6LRB5YL type=del size=1213923 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.299+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=CE0QDI72H0FG type=del 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.301+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=88YB3BV1V7C3 type=del size=3331648 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.304+0000 7f030cb87780 1 < suggested update operation key=1PLGUJCB6J0V tag=3U21FJOBKLYJ type=del size=1124494 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.306+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~L7YO2OSGZ00P.0 size=801349 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.306+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=L7YO2OSGZ00P tag=0LT96VSDBXAZ type=write size=1849925 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.308+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=HAP5QH7HMY55 type=del 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.309+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=Z896MVC1Y0B9 type=del size=612466 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.310+0000 7f030cb87780 1 < completed write operation key=POC8YA58U55N tag=YUPGUQZ5FWE5 type=write size=9875 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.313+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~XSM0L4VR1WEY.0 size=363888 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.313+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=XSM0L4VR1WEY tag=RZJKNQG2OT0F type=write size=1412464 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.314+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~W0GNKS2GK5NI.0 size=1048576 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.315+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~W0GNKS2GK5NI.1 size=405994 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.318+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=W0GNKS2GK5NI tag=TGB0HJA5WU2O type=write size=2503146 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.318+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=1A9NJGPSISU2 type=write size=275929 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.320+0000 7f030cb87780 1 < completed write operation key=JPEIGLC162K3 tag=ULERTWAHXY4S type=write size=1022568 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.321+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=7022NPLJ9DMP type=del size=1883600 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.322+0000 7f030cb87780 1 < canceled part key=_multipart_92GDVW0Q8VKQ.2~9AVG8N6MCO75.0 size=1048576 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.323+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~9AVG8N6MCO75.1 size=1048576 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.325+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~9AVG8N6MCO75.2 size=195476 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.327+0000 7f030cb87780 1 < canceled multipart upload key=92GDVW0Q8VKQ upload=9AVG8N6MCO75 tag=4M7TBXEHT5UO type=write size=3341204 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.328+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=Z0BGYNG1OTAH type=write size=196495 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.330+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~QAUGAODAJ7US.0 size=1048576 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.331+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~QAUGAODAJ7US.1 size=326278 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.333+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=QAUGAODAJ7US tag=1T25VI4ZXKBS type=write size=2423430 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.335+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=TO6Q1VRSVZ54 type=del size=2769029 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.338+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~H9XRG440VMAH.0 size=873468 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.340+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=H9XRG440VMAH tag=KY32N9NJGWLE type=write size=1922044 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.341+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=GGTEA9CMC7JL type=del size=3060962 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.343+0000 7f030cb87780 1 < completed write operation key=ZQD0491BHJPM tag=CFHFQS2N7UNE type=write size=530552 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.345+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~X94GIPVKIDV4.0 size=70290 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.345+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=X94GIPVKIDV4 tag=ZDF39ZEJBN1K type=write size=1118866 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.347+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~5ISOOAJM3RWR.0 size=1048576 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.348+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~5ISOOAJM3RWR.1 size=1048576 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.350+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~5ISOOAJM3RWR.2 size=197436 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.352+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=5ISOOAJM3RWR tag=ZZNDECUOUTFU type=write size=3343164 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.353+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=XDBMNWB2S1ND type=del size=4120430 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.356+0000 7f030cb87780 1 < completed write operation key=OR439FK5L43V tag=1M02Q609D5MS type=write size=756376 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.357+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=4EP5IZSA5AFM type=del size=1330998 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.361+0000 7f030cb87780 1 < canceled operation key=92GDVW0Q8VKQ tag=U6XFEF1EMXDC type=del size=1365493 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.362+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=XQNIXG3CFWFI type=write size=520154 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.363+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~SEEWG4IR7A8H.0 size=1048576 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.363+0000 7f030cb87780 1 < canceled part key=_multipart_1VOJGMWNKS0A.2~SEEWG4IR7A8H.1 size=608756 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.366+0000 7f030cb87780 1 < canceled multipart upload key=1VOJGMWNKS0A upload=SEEWG4IR7A8H tag=6DUYB2OD80ES type=write size=2705908 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.367+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=SQ1HV28M7Z1S type=del size=1570386 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.370+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~1FZWFNVIEVGF.0 size=704101 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.372+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=1FZWFNVIEVGF tag=67G12R60OY07 type=write size=1752677 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.375+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~53O2MY1XKRKU.0 size=94895 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.375+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=53O2MY1XKRKU tag=5JE1ABF1E50C type=write size=1143471 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.376+0000 7f030cb87780 1 < canceled operation key=ATTMOL2TGUN7 tag=MYD7U6LRB5YL type=del size=1213923 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.379+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=GY26AKRQ46DK type=del size=2663952 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.379+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=88YB3BV1V7C3 type=del 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.381+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=F3KDY6X2A4RI type=del size=1690575 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.381+0000 7f030cb87780 1 < canceled part key=_multipart_ZQD0491BHJPM.2~L7YO2OSGZ00P.0 size=801349 2024-09-12T00:36:25.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.383+0000 7f030cb87780 1 < canceled multipart upload key=ZQD0491BHJPM upload=L7YO2OSGZ00P tag=0LT96VSDBXAZ type=write size=1849925 2024-09-12T00:36:25.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.386+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~03YTSAPG2FYQ.0 size=1048576 2024-09-12T00:36:25.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.387+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~03YTSAPG2FYQ.1 size=1048576 2024-09-12T00:36:25.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.388+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~03YTSAPG2FYQ.2 size=16362 2024-09-12T00:36:25.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.388+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=03YTSAPG2FYQ tag=XTV8Q6T2QQMG type=write size=3162090 2024-09-12T00:36:25.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.390+0000 7f030cb87780 1 < canceled operation key=POC8YA58U55N tag=Z896MVC1Y0B9 type=del size=612466 2024-09-12T00:36:25.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.392+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~QG1B1DUELXIK.0 size=1048576 2024-09-12T00:36:25.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.393+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~QG1B1DUELXIK.1 size=1048576 2024-09-12T00:36:25.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.394+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~QG1B1DUELXIK.2 size=152551 2024-09-12T00:36:25.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.394+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=QG1B1DUELXIK tag=9M23FEEBBHAJ type=write size=3298279 2024-09-12T00:36:25.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.396+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~XSM0L4VR1WEY.0 size=363888 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.398+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=XSM0L4VR1WEY tag=RZJKNQG2OT0F type=write size=1412464 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.400+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=SS49EZZLD5JS type=del size=319302 2024-09-12T00:36:25.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.401+0000 7f030cb87780 1 < completed write operation key=OR439FK5L43V tag=1A9NJGPSISU2 type=write size=275929 2024-09-12T00:36:25.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.403+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~CJ11WGRCKIXR.0 size=1048576 2024-09-12T00:36:25.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.405+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~CJ11WGRCKIXR.1 size=374506 2024-09-12T00:36:25.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.405+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=CJ11WGRCKIXR tag=XPT4MNL197HH type=write size=2471658 2024-09-12T00:36:25.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.406+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=7022NPLJ9DMP type=del 2024-09-12T00:36:25.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.408+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~761DGYLI0W9W.0 size=1048576 2024-09-12T00:36:25.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.410+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~761DGYLI0W9W.1 size=473394 2024-09-12T00:36:25.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.410+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=761DGYLI0W9W tag=J9FY6FXHBSHD type=write size=2570546 2024-09-12T00:36:25.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.411+0000 7f030cb87780 1 < completed write operation key=V87B6SDB1HFZ tag=Z0BGYNG1OTAH type=write size=196495 2024-09-12T00:36:25.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.414+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=DK4MDJQG5ASD type=del size=1432480 2024-09-12T00:36:25.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.415+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=TO6Q1VRSVZ54 type=del 2024-09-12T00:36:25.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.416+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=S47IQOZO5X4N type=del size=1836344 2024-09-12T00:36:25.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.418+0000 7f030cb87780 1 < canceled operation key=6WHZRKLM3OLP tag=GGTEA9CMC7JL type=del size=3060962 2024-09-12T00:36:25.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.419+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=V09P3J3W3M3V type=del size=1191040 2024-09-12T00:36:25.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.421+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~X94GIPVKIDV4.0 size=70290 2024-09-12T00:36:25.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.423+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=X94GIPVKIDV4 tag=ZDF39ZEJBN1K type=write size=1118866 2024-09-12T00:36:25.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.426+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~1INTSNB8EJJE.0 size=3339 2024-09-12T00:36:25.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.426+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=1INTSNB8EJJE tag=DAZX9J654167 type=write size=1051915 2024-09-12T00:36:25.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.427+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=XDBMNWB2S1ND type=del 2024-09-12T00:36:25.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.428+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=3REGEFW3117K type=write size=478879 2024-09-12T00:36:25.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.431+0000 7f030cb87780 1 < suggested update operation key=INFFH9R3EFRY tag=4EP5IZSA5AFM type=del size=1330998 2024-09-12T00:36:25.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.434+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~T6925YUWRA0A.0 size=614845 2024-09-12T00:36:25.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.434+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=T6925YUWRA0A tag=O5QD4EIRBJ2D type=write size=1663421 2024-09-12T00:36:25.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.435+0000 7f030cb87780 1 < completed write operation key=1PLGUJCB6J0V tag=XQNIXG3CFWFI type=write size=520154 2024-09-12T00:36:25.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.438+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=71QERHCMLEEK type=del size=3748960 2024-09-12T00:36:25.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.440+0000 7f030cb87780 1 < suggested update operation key=3W7ANGL92ZF0 tag=SQ1HV28M7Z1S type=del size=1570386 2024-09-12T00:36:25.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.442+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~T0S5BD2HV0N2.0 size=1048576 2024-09-12T00:36:25.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.444+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~T0S5BD2HV0N2.1 size=1048576 2024-09-12T00:36:25.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.444+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~T0S5BD2HV0N2.2 size=524916 2024-09-12T00:36:25.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.444+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=T0S5BD2HV0N2 tag=EHF9U7NBV8FJ type=write size=3670644 2024-09-12T00:36:25.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.446+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~53O2MY1XKRKU.0 size=94895 2024-09-12T00:36:25.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.448+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=53O2MY1XKRKU tag=5JE1ABF1E50C type=write size=1143471 2024-09-12T00:36:25.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.450+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=N3I3DSGVC9LB type=del size=3861815 2024-09-12T00:36:25.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.451+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=GY26AKRQ46DK type=del 2024-09-12T00:36:25.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.453+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=A520M5DAAF9O type=del size=1606277 2024-09-12T00:36:25.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.454+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=F3KDY6X2A4RI type=del 2024-09-12T00:36:25.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.457+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~DUJSM3TODGPS.0 size=1048576 2024-09-12T00:36:25.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.459+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~DUJSM3TODGPS.1 size=1048576 2024-09-12T00:36:25.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.460+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~DUJSM3TODGPS.2 size=553512 2024-09-12T00:36:25.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.460+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=DUJSM3TODGPS tag=JUCQXOX5JK1L type=write size=3699240 2024-09-12T00:36:25.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.460+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~03YTSAPG2FYQ.0 size=1048576 2024-09-12T00:36:25.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.461+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~03YTSAPG2FYQ.1 size=1048576 2024-09-12T00:36:25.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.463+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~03YTSAPG2FYQ.2 size=16362 2024-09-12T00:36:25.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.465+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=03YTSAPG2FYQ tag=XTV8Q6T2QQMG type=write size=3162090 2024-09-12T00:36:25.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.467+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=6ATM30BJRTNG type=write size=263037 2024-09-12T00:36:25.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.468+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~QG1B1DUELXIK.0 size=1048576 2024-09-12T00:36:25.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.468+0000 7f030cb87780 1 < canceled part key=_multipart_3W7ANGL92ZF0.2~QG1B1DUELXIK.1 size=1048576 2024-09-12T00:36:25.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.469+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~QG1B1DUELXIK.2 size=152551 2024-09-12T00:36:25.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.471+0000 7f030cb87780 1 < canceled multipart upload key=3W7ANGL92ZF0 upload=QG1B1DUELXIK tag=9M23FEEBBHAJ type=write size=3298279 2024-09-12T00:36:25.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.475+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~XEVBO9BQGZAN.0 size=1048576 2024-09-12T00:36:25.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.475+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~XEVBO9BQGZAN.1 size=1048576 2024-09-12T00:36:25.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.476+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~XEVBO9BQGZAN.2 size=81525 2024-09-12T00:36:25.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.476+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=XEVBO9BQGZAN tag=A101H7L2KADV type=write size=3227253 2024-09-12T00:36:25.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.478+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=SS49EZZLD5JS type=del 2024-09-12T00:36:25.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.480+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~H0C38J2FMH98.0 size=1048576 2024-09-12T00:36:25.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.482+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~H0C38J2FMH98.1 size=1048576 2024-09-12T00:36:25.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.483+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~H0C38J2FMH98.2 size=452526 2024-09-12T00:36:25.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.483+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=H0C38J2FMH98 tag=7CXBW22O4LQI type=write size=3598254 2024-09-12T00:36:25.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.484+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~CJ11WGRCKIXR.0 size=1048576 2024-09-12T00:36:25.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.486+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~CJ11WGRCKIXR.1 size=374506 2024-09-12T00:36:25.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.489+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=CJ11WGRCKIXR tag=XPT4MNL197HH type=write size=2471658 2024-09-12T00:36:25.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.493+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~AO420YMUP8WZ.0 size=1048576 2024-09-12T00:36:25.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.493+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~AO420YMUP8WZ.1 size=1048576 2024-09-12T00:36:25.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.495+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~AO420YMUP8WZ.2 size=325948 2024-09-12T00:36:25.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.495+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=AO420YMUP8WZ tag=SAM1LGWNL2G4 type=write size=3471676 2024-09-12T00:36:25.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.497+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~761DGYLI0W9W.0 size=1048576 2024-09-12T00:36:25.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.497+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~761DGYLI0W9W.1 size=473394 2024-09-12T00:36:25.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.500+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=761DGYLI0W9W tag=J9FY6FXHBSHD type=write size=2570546 2024-09-12T00:36:25.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.501+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=WP0VG3IIX2HY type=del size=3120102 2024-09-12T00:36:25.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.505+0000 7f030cb87780 1 < suggested update operation key=V0OLIRP3KH40 tag=DK4MDJQG5ASD type=del size=1432480 2024-09-12T00:36:25.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.505+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=FA9MSPLGF45Z type=del size=2367238 2024-09-12T00:36:25.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.509+0000 7f030cb87780 1 < suggested remove operation key=N3KD1UVUVM95 tag=S47IQOZO5X4N type=del 2024-09-12T00:36:25.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.512+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~9FXY7GZG90ZC.0 size=1048576 2024-09-12T00:36:25.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.512+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~9FXY7GZG90ZC.1 size=1048576 2024-09-12T00:36:25.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.514+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~9FXY7GZG90ZC.2 size=513094 2024-09-12T00:36:25.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.514+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=9FXY7GZG90ZC tag=4LA96IB8Z6RV type=write size=3658822 2024-09-12T00:36:25.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.515+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=V09P3J3W3M3V type=del 2024-09-12T00:36:25.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.516+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=4GSIVMNELXOF type=del size=2614692 2024-09-12T00:36:25.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.518+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~1INTSNB8EJJE.0 size=3339 2024-09-12T00:36:25.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.521+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=1INTSNB8EJJE tag=DAZX9J654167 type=write size=1051915 2024-09-12T00:36:25.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.523+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=RLLW34LIG9ML type=del size=1372757 2024-09-12T00:36:25.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.523+0000 7f030cb87780 1 < canceled operation key=QGSJ51GMQXVK tag=3REGEFW3117K type=write size=478879 2024-09-12T00:36:25.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.525+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=WFM3C95CJ6WR type=del size=2382534 2024-09-12T00:36:25.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.526+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~T6925YUWRA0A.0 size=614845 2024-09-12T00:36:25.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.528+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=T6925YUWRA0A tag=O5QD4EIRBJ2D type=write size=1663421 2024-09-12T00:36:25.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.531+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~61D3JGVO9RDW.0 size=1048576 2024-09-12T00:36:25.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.532+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~61D3JGVO9RDW.1 size=343333 2024-09-12T00:36:25.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.532+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=61D3JGVO9RDW tag=4P687W5AXNEP type=write size=2440485 2024-09-12T00:36:25.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.535+0000 7f030cb87780 1 < suggested update operation key=327RDLIWLVRO tag=71QERHCMLEEK type=del size=3748960 2024-09-12T00:36:25.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.538+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~EUOJ9B12IF1N.0 size=1048576 2024-09-12T00:36:25.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.538+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~EUOJ9B12IF1N.1 size=575849 2024-09-12T00:36:25.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.538+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=EUOJ9B12IF1N tag=3Y3JK7T4T35K type=write size=2673001 2024-09-12T00:36:25.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.539+0000 7f030cb87780 1 < canceled part key=_multipart_JRPD5AAK84ZD.2~T0S5BD2HV0N2.0 size=1048576 2024-09-12T00:36:25.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.541+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~T0S5BD2HV0N2.1 size=1048576 2024-09-12T00:36:25.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.542+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~T0S5BD2HV0N2.2 size=524916 2024-09-12T00:36:25.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.544+0000 7f030cb87780 1 < canceled multipart upload key=JRPD5AAK84ZD upload=T0S5BD2HV0N2 tag=EHF9U7NBV8FJ type=write size=3670644 2024-09-12T00:36:25.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.545+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=8B89AG48ADO0 type=write size=588248 2024-09-12T00:36:25.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.546+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=N3I3DSGVC9LB type=del 2024-09-12T00:36:25.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.548+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=YFPTENV11LUN type=del size=1884167 2024-09-12T00:36:25.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.549+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=A520M5DAAF9O type=del 2024-09-12T00:36:25.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.551+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=WF8FV9MMS7YH type=del size=2477413 2024-09-12T00:36:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.552+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~DUJSM3TODGPS.0 size=1048576 2024-09-12T00:36:25.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.553+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~DUJSM3TODGPS.1 size=1048576 2024-09-12T00:36:25.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.554+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~DUJSM3TODGPS.2 size=553512 2024-09-12T00:36:25.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.557+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=DUJSM3TODGPS tag=JUCQXOX5JK1L type=write size=3699240 2024-09-12T00:36:25.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.558+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=NDP0IR2QROR8 type=del size=4008533 2024-09-12T00:36:25.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.561+0000 7f030cb87780 1 < suggested remove operation key=INFFH9R3EFRY tag=6ATM30BJRTNG type=write 2024-09-12T00:36:25.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.565+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~K1MF4GP63MSI.0 size=61 2024-09-12T00:36:25.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.565+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=K1MF4GP63MSI tag=JASR2G0NRQMI type=write size=1048637 2024-09-12T00:36:25.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.565+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~XEVBO9BQGZAN.0 size=1048576 2024-09-12T00:36:25.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.566+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~XEVBO9BQGZAN.1 size=1048576 2024-09-12T00:36:25.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.567+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~XEVBO9BQGZAN.2 size=81525 2024-09-12T00:36:25.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.570+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=XEVBO9BQGZAN tag=A101H7L2KADV type=write size=3227253 2024-09-12T00:36:25.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.571+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=26KJRAMZ27YY type=del size=2635993 2024-09-12T00:36:25.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.571+0000 7f030cb87780 1 < canceled part key=_multipart_800OHA7UURC4.2~H0C38J2FMH98.0 size=1048576 2024-09-12T00:36:25.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.573+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~H0C38J2FMH98.1 size=1048576 2024-09-12T00:36:25.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.574+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~H0C38J2FMH98.2 size=452526 2024-09-12T00:36:25.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.576+0000 7f030cb87780 1 < canceled multipart upload key=800OHA7UURC4 upload=H0C38J2FMH98 tag=7CXBW22O4LQI type=write size=3598254 2024-09-12T00:36:25.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.577+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=CWR56AEULKO8 type=del size=665794 2024-09-12T00:36:25.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.578+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~AO420YMUP8WZ.0 size=1048576 2024-09-12T00:36:25.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.580+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~AO420YMUP8WZ.1 size=1048576 2024-09-12T00:36:25.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.581+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~AO420YMUP8WZ.2 size=325948 2024-09-12T00:36:25.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.583+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=AO420YMUP8WZ tag=SAM1LGWNL2G4 type=write size=3471676 2024-09-12T00:36:25.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.584+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=31CJKG9X928Y type=del size=2262553 2024-09-12T00:36:25.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.586+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=WP0VG3IIX2HY type=del 2024-09-12T00:36:25.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.588+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=07F0C4ASNKX3 type=del size=3342170 2024-09-12T00:36:25.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.590+0000 7f030cb87780 1 < suggested remove operation key=U5CWO1EN8BFI tag=FA9MSPLGF45Z type=del 2024-09-12T00:36:25.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.592+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=PVN83CXCRTBB type=del size=2194870 2024-09-12T00:36:25.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.593+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~9FXY7GZG90ZC.0 size=1048576 2024-09-12T00:36:25.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.594+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~9FXY7GZG90ZC.1 size=1048576 2024-09-12T00:36:25.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.595+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~9FXY7GZG90ZC.2 size=513094 2024-09-12T00:36:25.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.598+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=9FXY7GZG90ZC tag=4LA96IB8Z6RV type=write size=3658822 2024-09-12T00:36:25.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.599+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=YV23V98SWJ07 type=write size=288420 2024-09-12T00:36:25.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.600+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=4GSIVMNELXOF type=del 2024-09-12T00:36:25.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.603+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~7MCA6YQNSJM8.0 size=1048576 2024-09-12T00:36:25.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.604+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~7MCA6YQNSJM8.1 size=1048576 2024-09-12T00:36:25.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.605+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~7MCA6YQNSJM8.2 size=518561 2024-09-12T00:36:25.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.605+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=7MCA6YQNSJM8 tag=VVSAAAHCNVA8 type=write size=3664289 2024-09-12T00:36:25.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.606+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=RLLW34LIG9ML type=del 2024-09-12T00:36:25.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.608+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=NNTJLS9PRL0Q type=del size=1635970 2024-09-12T00:36:25.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.609+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=WFM3C95CJ6WR type=del 2024-09-12T00:36:25.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.611+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=4F8QNMVJ4HVG type=del size=2469487 2024-09-12T00:36:25.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.612+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~61D3JGVO9RDW.0 size=1048576 2024-09-12T00:36:25.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.614+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~61D3JGVO9RDW.1 size=343333 2024-09-12T00:36:25.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.616+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=61D3JGVO9RDW tag=4P687W5AXNEP type=write size=2440485 2024-09-12T00:36:25.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.618+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=T8XRT68CKD6I type=del size=378868 2024-09-12T00:36:25.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.620+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~EUOJ9B12IF1N.0 size=1048576 2024-09-12T00:36:25.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.621+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~EUOJ9B12IF1N.1 size=575849 2024-09-12T00:36:25.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.624+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=EUOJ9B12IF1N tag=3Y3JK7T4T35K type=write size=2673001 2024-09-12T00:36:25.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.626+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=5V9UHD0LAB9Y type=del size=3175463 2024-09-12T00:36:25.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.629+0000 7f030cb87780 1 < completed write operation key=N3KD1UVUVM95 tag=8B89AG48ADO0 type=write size=588248 2024-09-12T00:36:25.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.631+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=TTNRYF6476IF type=write size=15208 2024-09-12T00:36:25.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.632+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=YFPTENV11LUN type=del 2024-09-12T00:36:25.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.633+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=07XPABK31AO2 type=del size=75008 2024-09-12T00:36:25.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.635+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=WF8FV9MMS7YH type=del 2024-09-12T00:36:25.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.636+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=EY0SBDT9YA52 type=write size=50444 2024-09-12T00:36:25.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.638+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=NDP0IR2QROR8 type=del 2024-09-12T00:36:25.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.641+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~99OPZYBKXVHL.0 size=16240 2024-09-12T00:36:25.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.641+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=99OPZYBKXVHL tag=2B6QZQC0HN0G type=write size=1064816 2024-09-12T00:36:25.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.642+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~K1MF4GP63MSI.0 size=61 2024-09-12T00:36:25.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.644+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=K1MF4GP63MSI tag=JASR2G0NRQMI type=write size=1048637 2024-09-12T00:36:25.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.646+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=W6PM2KMUWDEE type=del size=2034599 2024-09-12T00:36:25.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.647+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=26KJRAMZ27YY type=del 2024-09-12T00:36:25.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.650+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=TFSGA0SQIFXQ type=del size=3317283 2024-09-12T00:36:25.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.651+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=CWR56AEULKO8 type=del 2024-09-12T00:36:25.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.654+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~4GWTJNVEU1ZG.0 size=1048576 2024-09-12T00:36:25.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.655+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~4GWTJNVEU1ZG.1 size=1048576 2024-09-12T00:36:25.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.656+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~4GWTJNVEU1ZG.2 size=219667 2024-09-12T00:36:25.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.656+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=4GWTJNVEU1ZG tag=DBVJNL5D7CNK type=write size=3365395 2024-09-12T00:36:25.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.658+0000 7f030cb87780 1 < suggested update operation key=UFYMVGL264T8 tag=31CJKG9X928Y type=del size=2262553 2024-09-12T00:36:25.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.660+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=V8YPDAY0XMHC type=del size=2256654 2024-09-12T00:36:25.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.662+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=07F0C4ASNKX3 type=del 2024-09-12T00:36:25.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.663+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=FZZ99MVJ1H3G type=del size=2858886 2024-09-12T00:36:25.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.664+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=PVN83CXCRTBB type=del 2024-09-12T00:36:25.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.666+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=SWV8QSXS4P20 type=del size=71305 2024-09-12T00:36:25.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.670+0000 7f030cb87780 1 < suggested update operation key=ZQD0491BHJPM tag=YV23V98SWJ07 type=write size=288420 2024-09-12T00:36:25.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.672+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~8YL410JUYOJQ.0 size=1048576 2024-09-12T00:36:25.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.673+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~8YL410JUYOJQ.1 size=549317 2024-09-12T00:36:25.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.673+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=8YL410JUYOJQ tag=SU4GNC89XV7T type=write size=2646469 2024-09-12T00:36:25.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.674+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~7MCA6YQNSJM8.0 size=1048576 2024-09-12T00:36:25.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.675+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~7MCA6YQNSJM8.1 size=1048576 2024-09-12T00:36:25.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.676+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~7MCA6YQNSJM8.2 size=518561 2024-09-12T00:36:25.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.680+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=7MCA6YQNSJM8 tag=VVSAAAHCNVA8 type=write size=3664289 2024-09-12T00:36:25.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.680+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=932SPDVH9R5N type=del size=2936805 2024-09-12T00:36:25.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.682+0000 7f030cb87780 1 < canceled operation key=3W7ANGL92ZF0 tag=NNTJLS9PRL0Q type=del size=1635970 2024-09-12T00:36:25.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.684+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~RB2SIN4YNIK5.0 size=193481 2024-09-12T00:36:25.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.684+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=RB2SIN4YNIK5 tag=BRFF85IIIHA0 type=write size=1242057 2024-09-12T00:36:25.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.686+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=4F8QNMVJ4HVG type=del 2024-09-12T00:36:25.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.689+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~0MSBK4DSUOZT.0 size=279414 2024-09-12T00:36:25.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.689+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=0MSBK4DSUOZT tag=K39PZAGY3FNV type=write size=1327990 2024-09-12T00:36:25.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.690+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=T8XRT68CKD6I type=del 2024-09-12T00:36:25.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.692+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=UTNF4KHGASWQ type=del size=2208286 2024-09-12T00:36:25.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.693+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=5V9UHD0LAB9Y type=del 2024-09-12T00:36:25.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.695+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=UMHAOX0NY00Y type=del size=2703234 2024-09-12T00:36:25.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.696+0000 7f030cb87780 1 < completed write operation key=HUDEU16YTO0Y tag=TTNRYF6476IF type=write size=15208 2024-09-12T00:36:25.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.698+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=RYI2W1IHUR8O type=del size=1467720 2024-09-12T00:36:25.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.700+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=07XPABK31AO2 type=del 2024-09-12T00:36:25.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.701+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=6YOF1O13Y5KF type=del size=3938076 2024-09-12T00:36:25.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.703+0000 7f030cb87780 1 < completed write operation key=1VOJGMWNKS0A tag=EY0SBDT9YA52 type=write size=50444 2024-09-12T00:36:25.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.707+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~P7CRTOCHGEQN.0 size=910851 2024-09-12T00:36:25.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.707+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=P7CRTOCHGEQN tag=ZBW7VIW9CM5X type=write size=1959427 2024-09-12T00:36:25.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.708+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~99OPZYBKXVHL.0 size=16240 2024-09-12T00:36:25.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.710+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=99OPZYBKXVHL tag=2B6QZQC0HN0G type=write size=1064816 2024-09-12T00:36:25.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.712+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=M51QOZM32JD1 type=del size=2945768 2024-09-12T00:36:25.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.714+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=W6PM2KMUWDEE type=del 2024-09-12T00:36:25.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.715+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=ITBTS7G1AEXW type=del size=2175260 2024-09-12T00:36:25.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.717+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=TFSGA0SQIFXQ type=del 2024-09-12T00:36:25.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.720+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~50QG64B58TWH.0 size=31178 2024-09-12T00:36:25.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.720+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=50QG64B58TWH tag=XDG4AUW5VB6P type=write size=1079754 2024-09-12T00:36:25.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.722+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~4GWTJNVEU1ZG.0 size=1048576 2024-09-12T00:36:25.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.723+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~4GWTJNVEU1ZG.1 size=1048576 2024-09-12T00:36:25.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.723+0000 7f030cb87780 1 < canceled part key=_multipart_HUDEU16YTO0Y.2~4GWTJNVEU1ZG.2 size=219667 2024-09-12T00:36:25.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.725+0000 7f030cb87780 1 < canceled multipart upload key=HUDEU16YTO0Y upload=4GWTJNVEU1ZG tag=DBVJNL5D7CNK type=write size=3365395 2024-09-12T00:36:25.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.726+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=JRIPB6GH7A52 type=del size=1123206 2024-09-12T00:36:25.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.727+0000 7f030cb87780 1 < canceled operation key=99OWKRGA8ZZN tag=V8YPDAY0XMHC type=del size=2256654 2024-09-12T00:36:25.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.729+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=KQHBX65RJ9RA type=del size=3810195 2024-09-12T00:36:25.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.731+0000 7f030cb87780 1 < canceled operation key=3W7ANGL92ZF0 tag=FZZ99MVJ1H3G type=del size=2858886 2024-09-12T00:36:25.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.732+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=52TIJPIZH3JL type=del size=1833008 2024-09-12T00:36:25.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.734+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=SWV8QSXS4P20 type=del 2024-09-12T00:36:25.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.736+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=AWGTEKZ9MM9R type=del size=1252400 2024-09-12T00:36:25.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.737+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~8YL410JUYOJQ.0 size=1048576 2024-09-12T00:36:25.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.738+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~8YL410JUYOJQ.1 size=549317 2024-09-12T00:36:25.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.741+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=8YL410JUYOJQ tag=SU4GNC89XV7T type=write size=2646469 2024-09-12T00:36:25.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.744+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~YUJZAI8GZ7MC.0 size=1048576 2024-09-12T00:36:25.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.745+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~YUJZAI8GZ7MC.1 size=1048576 2024-09-12T00:36:25.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.746+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~YUJZAI8GZ7MC.2 size=56418 2024-09-12T00:36:25.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.746+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=YUJZAI8GZ7MC tag=EIVM1U75IZ31 type=write size=3202146 2024-09-12T00:36:25.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.750+0000 7f030cb87780 1 < suggested remove operation key=6WHZRKLM3OLP tag=932SPDVH9R5N type=del 2024-09-12T00:36:25.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.750+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=BVI0MBL9PEVU type=del size=1566379 2024-09-12T00:36:25.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.752+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~RB2SIN4YNIK5.0 size=193481 2024-09-12T00:36:25.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.754+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=RB2SIN4YNIK5 tag=BRFF85IIIHA0 type=write size=1242057 2024-09-12T00:36:25.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.756+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=0X0ZRKXQIOMU type=write size=589676 2024-09-12T00:36:25.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.758+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~0MSBK4DSUOZT.0 size=279414 2024-09-12T00:36:25.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.761+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=0MSBK4DSUOZT tag=K39PZAGY3FNV type=write size=1327990 2024-09-12T00:36:25.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.763+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~9D8OGJY3BXZ1.0 size=1048576 2024-09-12T00:36:25.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.764+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~9D8OGJY3BXZ1.1 size=237698 2024-09-12T00:36:25.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.764+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=9D8OGJY3BXZ1 tag=3GGFM3QQ705K type=write size=2334850 2024-09-12T00:36:25.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.765+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=UTNF4KHGASWQ type=del 2024-09-12T00:36:25.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.766+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=13SF7QT62FSD type=del size=4130834 2024-09-12T00:36:25.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.769+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=UMHAOX0NY00Y type=del 2024-09-12T00:36:25.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.771+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=EMM45H9GMYV7 type=write size=973643 2024-09-12T00:36:25.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.773+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=RYI2W1IHUR8O type=del 2024-09-12T00:36:25.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.777+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~F2P619JQ0Q0V.0 size=1048576 2024-09-12T00:36:25.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.777+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~F2P619JQ0Q0V.1 size=1048576 2024-09-12T00:36:25.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.778+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~F2P619JQ0Q0V.2 size=854529 2024-09-12T00:36:25.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.778+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=F2P619JQ0Q0V tag=YWAVB2JHUZHI type=write size=4000257 2024-09-12T00:36:25.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.782+0000 7f030cb87780 1 < suggested update operation key=327RDLIWLVRO tag=6YOF1O13Y5KF type=del size=3938076 2024-09-12T00:36:25.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.783+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=LDE72M17O9I4 type=write size=91447 2024-09-12T00:36:25.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.786+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~P7CRTOCHGEQN.0 size=910851 2024-09-12T00:36:25.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.788+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=P7CRTOCHGEQN tag=ZBW7VIW9CM5X type=write size=1959427 2024-09-12T00:36:25.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.789+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=YX015C5EWR9X type=del size=67466 2024-09-12T00:36:25.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.790+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=M51QOZM32JD1 type=del 2024-09-12T00:36:25.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.792+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=WSX8IBGFZKBA type=del size=931116 2024-09-12T00:36:25.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.794+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=ITBTS7G1AEXW type=del 2024-09-12T00:36:25.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.795+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=B3ER2DX3TH5J type=del size=3771738 2024-09-12T00:36:25.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.797+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~50QG64B58TWH.0 size=31178 2024-09-12T00:36:25.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.799+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=50QG64B58TWH tag=XDG4AUW5VB6P type=write size=1079754 2024-09-12T00:36:25.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.802+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~Z6DONB3AJBBE.0 size=1048576 2024-09-12T00:36:25.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.803+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~Z6DONB3AJBBE.1 size=780460 2024-09-12T00:36:25.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.803+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=Z6DONB3AJBBE tag=Q402KGBXYQHH type=write size=2877612 2024-09-12T00:36:25.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.804+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=JRIPB6GH7A52 type=del 2024-09-12T00:36:25.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.806+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=58NZL22G95SN type=del size=2467117 2024-09-12T00:36:25.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.808+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=KQHBX65RJ9RA type=del 2024-09-12T00:36:25.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.809+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=5L1F0G230ZOL type=del size=866969 2024-09-12T00:36:25.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.812+0000 7f030cb87780 1 < suggested remove operation key=QGSJ51GMQXVK tag=52TIJPIZH3JL type=del 2024-09-12T00:36:25.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.813+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=HESSK4P28KEG type=write size=432561 2024-09-12T00:36:25.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.815+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=AWGTEKZ9MM9R type=del 2024-09-12T00:36:25.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.817+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~AVNZLQ3NLAFC.0 size=268828 2024-09-12T00:36:25.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.817+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=AVNZLQ3NLAFC tag=T3JVLIRXIALY type=write size=1317404 2024-09-12T00:36:25.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.819+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~YUJZAI8GZ7MC.0 size=1048576 2024-09-12T00:36:25.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.820+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~YUJZAI8GZ7MC.1 size=1048576 2024-09-12T00:36:25.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.820+0000 7f030cb87780 1 < canceled part key=_multipart_1VOJGMWNKS0A.2~YUJZAI8GZ7MC.2 size=56418 2024-09-12T00:36:25.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.824+0000 7f030cb87780 1 < canceled multipart upload key=1VOJGMWNKS0A upload=YUJZAI8GZ7MC tag=EIVM1U75IZ31 type=write size=3202146 2024-09-12T00:36:25.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.826+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~SEZ37KGIBGBH.0 size=656837 2024-09-12T00:36:25.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.826+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=SEZ37KGIBGBH tag=090J9ODZNL9O type=write size=1705413 2024-09-12T00:36:25.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.827+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=BVI0MBL9PEVU type=del 2024-09-12T00:36:25.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.828+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=PP741LS5LL48 type=del size=1521579 2024-09-12T00:36:25.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.831+0000 7f030cb87780 1 < suggested remove operation key=UFYMVGL264T8 tag=0X0ZRKXQIOMU type=write 2024-09-12T00:36:25.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.834+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~R1B2R4URO6Q5.0 size=1048576 2024-09-12T00:36:25.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.836+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~R1B2R4URO6Q5.1 size=533517 2024-09-12T00:36:25.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.836+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=R1B2R4URO6Q5 tag=PPODCJRQ272E type=write size=2630669 2024-09-12T00:36:25.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.837+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~9D8OGJY3BXZ1.0 size=1048576 2024-09-12T00:36:25.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.838+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~9D8OGJY3BXZ1.1 size=237698 2024-09-12T00:36:25.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.840+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=9D8OGJY3BXZ1 tag=3GGFM3QQ705K type=write size=2334850 2024-09-12T00:36:25.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.842+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=58NZ8BC8EVPA type=del size=1289300 2024-09-12T00:36:25.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.846+0000 7f030cb87780 1 < suggested remove operation key=ATTMOL2TGUN7 tag=13SF7QT62FSD type=del 2024-09-12T00:36:25.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.848+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~3XOHBDE81QC5.0 size=1048576 2024-09-12T00:36:25.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.849+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~3XOHBDE81QC5.1 size=276130 2024-09-12T00:36:25.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.849+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=3XOHBDE81QC5 tag=552B901141K4 type=write size=2373282 2024-09-12T00:36:25.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.850+0000 7f030cb87780 -1 < failed to complete operation key=327RDLIWLVRO tag=EMM45H9GMYV7 type=write size=973643: (22) Invalid argument 2024-09-12T00:36:25.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.852+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=Y5ZWDCDHTUF8 type=del size=654526 2024-09-12T00:36:25.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.853+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~F2P619JQ0Q0V.0 size=1048576 2024-09-12T00:36:25.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.854+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~F2P619JQ0Q0V.1 size=1048576 2024-09-12T00:36:25.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.856+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~F2P619JQ0Q0V.2 size=854529 2024-09-12T00:36:25.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.858+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=F2P619JQ0Q0V tag=YWAVB2JHUZHI type=write size=4000257 2024-09-12T00:36:25.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.860+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=SM7ISDHALRVA type=del size=3877606 2024-09-12T00:36:25.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.862+0000 7f030cb87780 1 < completed write operation key=CUDFTXFBC862 tag=LDE72M17O9I4 type=write size=91447 2024-09-12T00:36:25.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.862+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=S1L31201CD2V type=del size=3338096 2024-09-12T00:36:25.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.864+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=YX015C5EWR9X type=del 2024-09-12T00:36:25.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.865+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=VJIX2BR8V1GU type=del size=5466 2024-09-12T00:36:25.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.867+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=WSX8IBGFZKBA type=del 2024-09-12T00:36:25.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.870+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~GTRG8C87LP7K.0 size=1048576 2024-09-12T00:36:25.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.871+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~GTRG8C87LP7K.1 size=901007 2024-09-12T00:36:25.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.871+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=GTRG8C87LP7K tag=X9RLP7BBGUSB type=write size=2998159 2024-09-12T00:36:25.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.873+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=B3ER2DX3TH5J type=del 2024-09-12T00:36:25.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.874+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=NJJES3VDLFFB type=del size=3877618 2024-09-12T00:36:25.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.875+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~Z6DONB3AJBBE.0 size=1048576 2024-09-12T00:36:25.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.876+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~Z6DONB3AJBBE.1 size=780460 2024-09-12T00:36:25.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.878+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=Z6DONB3AJBBE tag=Q402KGBXYQHH type=write size=2877612 2024-09-12T00:36:25.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.880+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=MC5JHIBKG044 type=del size=2363950 2024-09-12T00:36:25.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.881+0000 7f030cb87780 1 < canceled operation key=1PLGUJCB6J0V tag=58NZL22G95SN type=del size=2467117 2024-09-12T00:36:25.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.884+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~0BL4YPUNCNSW.0 size=1048576 2024-09-12T00:36:25.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.886+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~0BL4YPUNCNSW.1 size=55119 2024-09-12T00:36:25.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.886+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=0BL4YPUNCNSW tag=LN6Z2CPY1NUB type=write size=2152271 2024-09-12T00:36:25.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.887+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=5L1F0G230ZOL type=del 2024-09-12T00:36:25.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.889+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=Y5U3L78L65I8 type=del size=2640342 2024-09-12T00:36:25.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.891+0000 7f030cb87780 1 < completed write operation key=1VOJGMWNKS0A tag=HESSK4P28KEG type=write size=432561 2024-09-12T00:36:25.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.891+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=8PE74KF23N97 type=del size=1822649 2024-09-12T00:36:25.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.893+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~AVNZLQ3NLAFC.0 size=268828 2024-09-12T00:36:25.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.896+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=AVNZLQ3NLAFC tag=T3JVLIRXIALY type=write size=1317404 2024-09-12T00:36:25.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.897+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=9AXKYAZNV2GA type=del size=1729941 2024-09-12T00:36:25.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.899+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~SEZ37KGIBGBH.0 size=656837 2024-09-12T00:36:25.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.901+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=SEZ37KGIBGBH tag=090J9ODZNL9O type=write size=1705413 2024-09-12T00:36:25.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.904+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~0PKA88N2G7H5.0 size=1048576 2024-09-12T00:36:25.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.905+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~0PKA88N2G7H5.1 size=1037261 2024-09-12T00:36:25.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.905+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=0PKA88N2G7H5 tag=65A2X36OEZ40 type=write size=3134413 2024-09-12T00:36:25.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.906+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=PP741LS5LL48 type=del 2024-09-12T00:36:25.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.909+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=7GY3E2R64DWL type=del size=1581573 2024-09-12T00:36:25.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.912+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~R1B2R4URO6Q5.0 size=1048576 2024-09-12T00:36:25.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.912+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~R1B2R4URO6Q5.1 size=533517 2024-09-12T00:36:25.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.914+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=R1B2R4URO6Q5 tag=PPODCJRQ272E type=write size=2630669 2024-09-12T00:36:25.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.917+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~U7SCAFUBR317.0 size=1048576 2024-09-12T00:36:25.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.918+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~U7SCAFUBR317.1 size=1048576 2024-09-12T00:36:25.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.919+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~U7SCAFUBR317.2 size=426677 2024-09-12T00:36:25.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.919+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=U7SCAFUBR317 tag=EYA7L0PN14G5 type=write size=3572405 2024-09-12T00:36:25.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.921+0000 7f030cb87780 1 < canceled operation key=U5CWO1EN8BFI tag=58NZ8BC8EVPA type=del size=1289300 2024-09-12T00:36:25.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.923+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~U37FZ2JV7R3B.0 size=3255 2024-09-12T00:36:25.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.923+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=U37FZ2JV7R3B tag=O16QBOJT5R3U type=write size=1051831 2024-09-12T00:36:25.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.925+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~3XOHBDE81QC5.0 size=1048576 2024-09-12T00:36:25.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.926+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~3XOHBDE81QC5.1 size=276130 2024-09-12T00:36:25.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.929+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=3XOHBDE81QC5 tag=552B901141K4 type=write size=2373282 2024-09-12T00:36:25.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.930+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=Q9QGJV1GK5FE type=del size=856385 2024-09-12T00:36:25.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.931+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=Y5ZWDCDHTUF8 type=del 2024-09-12T00:36:25.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.933+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~LIQG0UGZBXDG.0 size=1048576 2024-09-12T00:36:25.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.935+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~LIQG0UGZBXDG.1 size=932423 2024-09-12T00:36:25.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.935+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=LIQG0UGZBXDG tag=8Y3MR18BZK6P type=write size=3029575 2024-09-12T00:36:25.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.937+0000 7f030cb87780 1 < suggested update operation key=CUDFTXFBC862 tag=SM7ISDHALRVA type=del size=3877606 2024-09-12T00:36:25.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.940+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=RBRZ2XRGHX8R type=del size=2134883 2024-09-12T00:36:25.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.940+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=S1L31201CD2V type=del 2024-09-12T00:36:25.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.944+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~Z0SBV1QEQC08.0 size=1048576 2024-09-12T00:36:25.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.945+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~Z0SBV1QEQC08.1 size=1048576 2024-09-12T00:36:25.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.946+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~Z0SBV1QEQC08.2 size=976296 2024-09-12T00:36:25.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.946+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=Z0SBV1QEQC08 tag=33M0IN81E76H type=write size=4122024 2024-09-12T00:36:25.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.950+0000 7f030cb87780 1 < suggested update operation key=1PLGUJCB6J0V tag=VJIX2BR8V1GU type=del size=5466 2024-09-12T00:36:25.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.952+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~XHGEIQAVPETV.0 size=530634 2024-09-12T00:36:25.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.952+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=XHGEIQAVPETV tag=7VQN0J4CYKO6 type=write size=1579210 2024-09-12T00:36:25.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.953+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~GTRG8C87LP7K.0 size=1048576 2024-09-12T00:36:25.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.955+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~GTRG8C87LP7K.1 size=901007 2024-09-12T00:36:25.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.958+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=GTRG8C87LP7K tag=X9RLP7BBGUSB type=write size=2998159 2024-09-12T00:36:25.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.959+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=1QJKBRNCNXQT type=write size=926150 2024-09-12T00:36:25.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.960+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=NJJES3VDLFFB type=del 2024-09-12T00:36:25.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.962+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=TS7XUJ7WTCE7 type=del size=1887666 2024-09-12T00:36:25.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.965+0000 7f030cb87780 1 < suggested remove operation key=UFYMVGL264T8 tag=MC5JHIBKG044 type=del 2024-09-12T00:36:25.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.967+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~IFY7BUUA7WSU.0 size=1048576 2024-09-12T00:36:25.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.968+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~IFY7BUUA7WSU.1 size=1048576 2024-09-12T00:36:25.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.970+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~IFY7BUUA7WSU.2 size=308617 2024-09-12T00:36:25.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.970+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=IFY7BUUA7WSU tag=XOSC5NYO0L3X type=write size=3454345 2024-09-12T00:36:25.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.971+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~0BL4YPUNCNSW.0 size=1048576 2024-09-12T00:36:25.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.972+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~0BL4YPUNCNSW.1 size=55119 2024-09-12T00:36:25.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.974+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=0BL4YPUNCNSW tag=LN6Z2CPY1NUB type=write size=2152271 2024-09-12T00:36:25.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.977+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~J9EM1IA4W1RB.0 size=1048576 2024-09-12T00:36:25.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.977+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~J9EM1IA4W1RB.1 size=1048576 2024-09-12T00:36:25.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.978+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~J9EM1IA4W1RB.2 size=798595 2024-09-12T00:36:25.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.978+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=J9EM1IA4W1RB tag=EMBZIT67EX2Q type=write size=3944323 2024-09-12T00:36:25.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.980+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=Y5U3L78L65I8 type=del 2024-09-12T00:36:25.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.983+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~FI5T2G1CA4MY.0 size=1048576 2024-09-12T00:36:25.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.984+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~FI5T2G1CA4MY.1 size=1048576 2024-09-12T00:36:25.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.985+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~FI5T2G1CA4MY.2 size=308192 2024-09-12T00:36:25.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.985+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=FI5T2G1CA4MY tag=8S4L9677PSIJ type=write size=3453920 2024-09-12T00:36:25.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.988+0000 7f030cb87780 1 < suggested update operation key=U5CWO1EN8BFI tag=8PE74KF23N97 type=del size=1822649 2024-09-12T00:36:25.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.991+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~7518BZW36O61.0 size=1048576 2024-09-12T00:36:25.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.992+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~7518BZW36O61.1 size=851830 2024-09-12T00:36:25.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.992+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=7518BZW36O61 tag=364SEP99CV5Y type=write size=2948982 2024-09-12T00:36:25.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.993+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=9AXKYAZNV2GA type=del 2024-09-12T00:36:25.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.994+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=MON1C80GI8TR type=del size=2324980 2024-09-12T00:36:25.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.997+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~0PKA88N2G7H5.0 size=1048576 2024-09-12T00:36:25.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.998+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~0PKA88N2G7H5.1 size=1037261 2024-09-12T00:36:25.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:25.999+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=0PKA88N2G7H5 tag=65A2X36OEZ40 type=write size=3134413 2024-09-12T00:36:26.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.001+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=YZXPXD4B6BQK type=del size=2895588 2024-09-12T00:36:26.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.003+0000 7f030cb87780 1 < suggested remove operation key=1VOJGMWNKS0A tag=7GY3E2R64DWL type=del 2024-09-12T00:36:26.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.006+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=U7GQXHBOHAIU type=del size=3786124 2024-09-12T00:36:26.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.007+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~U7SCAFUBR317.0 size=1048576 2024-09-12T00:36:26.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.009+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~U7SCAFUBR317.1 size=1048576 2024-09-12T00:36:26.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.009+0000 7f030cb87780 1 < canceled part key=_multipart_327RDLIWLVRO.2~U7SCAFUBR317.2 size=426677 2024-09-12T00:36:26.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.010+0000 7f030cb87780 1 < canceled multipart upload key=327RDLIWLVRO upload=U7SCAFUBR317 tag=EYA7L0PN14G5 type=write size=3572405 2024-09-12T00:36:26.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.012+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=L0K50XIOLP0R type=del size=2170301 2024-09-12T00:36:26.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.013+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~U37FZ2JV7R3B.0 size=3255 2024-09-12T00:36:26.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.016+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=U37FZ2JV7R3B tag=O16QBOJT5R3U type=write size=1051831 2024-09-12T00:36:26.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.019+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~Y5ZNPGIU0MSG.0 size=1048576 2024-09-12T00:36:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.020+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~Y5ZNPGIU0MSG.1 size=786810 2024-09-12T00:36:26.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.020+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=Y5ZNPGIU0MSG tag=ZXR22XD48D2D type=write size=2883962 2024-09-12T00:36:26.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.021+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=Q9QGJV1GK5FE type=del 2024-09-12T00:36:26.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.024+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=L7MB3IHLA247 type=del size=2350612 2024-09-12T00:36:26.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.024+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~LIQG0UGZBXDG.0 size=1048576 2024-09-12T00:36:26.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.026+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~LIQG0UGZBXDG.1 size=932423 2024-09-12T00:36:26.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.028+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=LIQG0UGZBXDG tag=8Y3MR18BZK6P type=write size=3029575 2024-09-12T00:36:26.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.029+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=TBYA51LRA50L type=write size=728843 2024-09-12T00:36:26.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.031+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=RBRZ2XRGHX8R type=del 2024-09-12T00:36:26.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.032+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=HXMSIU6V1SJP type=del size=2814744 2024-09-12T00:36:26.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.034+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~Z0SBV1QEQC08.0 size=1048576 2024-09-12T00:36:26.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.036+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~Z0SBV1QEQC08.1 size=1048576 2024-09-12T00:36:26.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.036+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~Z0SBV1QEQC08.2 size=976296 2024-09-12T00:36:26.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.039+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=Z0SBV1QEQC08 tag=33M0IN81E76H type=write size=4122024 2024-09-12T00:36:26.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.040+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=O163RT2QGMOW type=del size=3251913 2024-09-12T00:36:26.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.042+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~XHGEIQAVPETV.0 size=530634 2024-09-12T00:36:26.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.047+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=XHGEIQAVPETV tag=7VQN0J4CYKO6 type=write size=1579210 2024-09-12T00:36:26.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.049+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=96LGV15TZE1M type=del size=971949 2024-09-12T00:36:26.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.050+0000 7f030cb87780 1 < canceled operation key=V0OLIRP3KH40 tag=1QJKBRNCNXQT type=write size=926150 2024-09-12T00:36:26.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.051+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=A38F62VFCLDT type=write size=850316 2024-09-12T00:36:26.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.052+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=TS7XUJ7WTCE7 type=del 2024-09-12T00:36:26.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.055+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~85V2OTQ8ISCP.0 size=1048576 2024-09-12T00:36:26.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.056+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~85V2OTQ8ISCP.1 size=240673 2024-09-12T00:36:26.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.056+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=85V2OTQ8ISCP tag=UWVFE79PCWFE type=write size=2337825 2024-09-12T00:36:26.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.057+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~IFY7BUUA7WSU.0 size=1048576 2024-09-12T00:36:26.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.058+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~IFY7BUUA7WSU.1 size=1048576 2024-09-12T00:36:26.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.059+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~IFY7BUUA7WSU.2 size=308617 2024-09-12T00:36:26.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.062+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=IFY7BUUA7WSU tag=XOSC5NYO0L3X type=write size=3454345 2024-09-12T00:36:26.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.064+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~481IO76E1ZQ4.0 size=1048576 2024-09-12T00:36:26.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.065+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~481IO76E1ZQ4.1 size=1048576 2024-09-12T00:36:26.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.067+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~481IO76E1ZQ4.2 size=977881 2024-09-12T00:36:26.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.067+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=481IO76E1ZQ4 tag=69MR1P2I145Y type=write size=4123609 2024-09-12T00:36:26.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.069+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~J9EM1IA4W1RB.0 size=1048576 2024-09-12T00:36:26.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.069+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~J9EM1IA4W1RB.1 size=1048576 2024-09-12T00:36:26.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.070+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~J9EM1IA4W1RB.2 size=798595 2024-09-12T00:36:26.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.073+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=J9EM1IA4W1RB tag=EMBZIT67EX2Q type=write size=3944323 2024-09-12T00:36:26.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.074+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=DWD8CEXI0595 type=del size=4190878 2024-09-12T00:36:26.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.075+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~FI5T2G1CA4MY.0 size=1048576 2024-09-12T00:36:26.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.077+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~FI5T2G1CA4MY.1 size=1048576 2024-09-12T00:36:26.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.077+0000 7f030cb87780 1 < canceled part key=_multipart_UFYMVGL264T8.2~FI5T2G1CA4MY.2 size=308192 2024-09-12T00:36:26.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.080+0000 7f030cb87780 1 < canceled multipart upload key=UFYMVGL264T8 upload=FI5T2G1CA4MY tag=8S4L9677PSIJ type=write size=3453920 2024-09-12T00:36:26.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.081+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=5OYQSBEHUWLZ type=del size=2812483 2024-09-12T00:36:26.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.083+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~7518BZW36O61.0 size=1048576 2024-09-12T00:36:26.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.083+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~7518BZW36O61.1 size=851830 2024-09-12T00:36:26.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.085+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=7518BZW36O61 tag=364SEP99CV5Y type=write size=2948982 2024-09-12T00:36:26.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.087+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=SMR9I3IRNHJ8 type=write size=664079 2024-09-12T00:36:26.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.089+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=MON1C80GI8TR type=del 2024-09-12T00:36:26.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.090+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=PC0KXRF8HF1F type=del size=3253844 2024-09-12T00:36:26.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.092+0000 7f030cb87780 1 < canceled operation key=HUDEU16YTO0Y tag=YZXPXD4B6BQK type=del size=2895588 2024-09-12T00:36:26.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.094+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~ZK7WBJAQ4UVD.0 size=1048576 2024-09-12T00:36:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.096+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~ZK7WBJAQ4UVD.1 size=1048576 2024-09-12T00:36:26.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.097+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~ZK7WBJAQ4UVD.2 size=962552 2024-09-12T00:36:26.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.097+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=ZK7WBJAQ4UVD tag=B4CXOHOEZ60V type=write size=4108280 2024-09-12T00:36:26.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.100+0000 7f030cb87780 1 < suggested update operation key=N3KD1UVUVM95 tag=U7GQXHBOHAIU type=del size=3786124 2024-09-12T00:36:26.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.101+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=VIM168IZOIQS type=del size=3646210 2024-09-12T00:36:26.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.105+0000 7f030cb87780 1 < suggested update operation key=ATTMOL2TGUN7 tag=L0K50XIOLP0R type=del size=2170301 2024-09-12T00:36:26.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.108+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~D8RL3U48IGVI.0 size=201975 2024-09-12T00:36:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.108+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=D8RL3U48IGVI tag=NQ5NY9RHZQHH type=write size=1250551 2024-09-12T00:36:26.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.109+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~Y5ZNPGIU0MSG.0 size=1048576 2024-09-12T00:36:26.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.109+0000 7f030cb87780 1 < canceled part key=_multipart_DLR6A7XOERHW.2~Y5ZNPGIU0MSG.1 size=786810 2024-09-12T00:36:26.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.111+0000 7f030cb87780 1 < canceled multipart upload key=DLR6A7XOERHW upload=Y5ZNPGIU0MSG tag=ZXR22XD48D2D type=write size=2883962 2024-09-12T00:36:26.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.112+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=YN59ZK3JXSYC type=del size=1568193 2024-09-12T00:36:26.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.114+0000 7f030cb87780 -1 < failed to complete operation key=ATTMOL2TGUN7 tag=L7MB3IHLA247 type=del size=2350612: (22) Invalid argument 2024-09-12T00:36:26.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.115+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=XIK3ONAXE0QZ type=del size=2536048 2024-09-12T00:36:26.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.117+0000 7f030cb87780 1 < completed write operation key=1VOJGMWNKS0A tag=TBYA51LRA50L type=write size=728843 2024-09-12T00:36:26.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.120+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~EBIGUNKUU0B1.0 size=57064 2024-09-12T00:36:26.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.120+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=EBIGUNKUU0B1 tag=F4RTFZK6XZJ4 type=write size=1105640 2024-09-12T00:36:26.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.121+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=HXMSIU6V1SJP type=del 2024-09-12T00:36:26.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.124+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~ABIRLM4AMR5S.0 size=1048576 2024-09-12T00:36:26.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.124+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~ABIRLM4AMR5S.1 size=302772 2024-09-12T00:36:26.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.124+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=ABIRLM4AMR5S tag=CGL5MSWFVALR type=write size=2399924 2024-09-12T00:36:26.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.126+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=O163RT2QGMOW type=del 2024-09-12T00:36:26.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.128+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~GGL5NAUQ6W6S.0 size=1048576 2024-09-12T00:36:26.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.130+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~GGL5NAUQ6W6S.1 size=1048576 2024-09-12T00:36:26.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.131+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~GGL5NAUQ6W6S.2 size=860857 2024-09-12T00:36:26.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.131+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=GGL5NAUQ6W6S tag=CF2R30YYHD0W type=write size=4006585 2024-09-12T00:36:26.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.133+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=96LGV15TZE1M type=del 2024-09-12T00:36:26.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.134+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=B8F9LMMQ3D9N type=del size=3816762 2024-09-12T00:36:26.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.137+0000 7f030cb87780 1 < suggested remove operation key=N3KD1UVUVM95 tag=A38F62VFCLDT type=write 2024-09-12T00:36:26.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.139+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~P6SQ1R9MONM9.0 size=562998 2024-09-12T00:36:26.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.139+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=P6SQ1R9MONM9 tag=PIWML1MABGHN type=write size=1611574 2024-09-12T00:36:26.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.142+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~85V2OTQ8ISCP.0 size=1048576 2024-09-12T00:36:26.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.143+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~85V2OTQ8ISCP.1 size=240673 2024-09-12T00:36:26.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.145+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=85V2OTQ8ISCP tag=UWVFE79PCWFE type=write size=2337825 2024-09-12T00:36:26.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.147+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~1B3HLPJWE205.0 size=156326 2024-09-12T00:36:26.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.147+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=1B3HLPJWE205 tag=SAA5I4ET0KO4 type=write size=1204902 2024-09-12T00:36:26.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.149+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~481IO76E1ZQ4.0 size=1048576 2024-09-12T00:36:26.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.150+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~481IO76E1ZQ4.1 size=1048576 2024-09-12T00:36:26.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.152+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~481IO76E1ZQ4.2 size=977881 2024-09-12T00:36:26.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.154+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=481IO76E1ZQ4 tag=69MR1P2I145Y type=write size=4123609 2024-09-12T00:36:26.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.156+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=PL8UA2ZVFKCS type=write size=199460 2024-09-12T00:36:26.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.156+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=DWD8CEXI0595 type=del 2024-09-12T00:36:26.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.158+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=D63RTE72UULA type=del size=917128 2024-09-12T00:36:26.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.160+0000 7f030cb87780 1 < completed delete operation key=3W7ANGL92ZF0 tag=5OYQSBEHUWLZ type=del 2024-09-12T00:36:26.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.161+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=JPW50V6A4G82 type=del size=1686747 2024-09-12T00:36:26.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.163+0000 7f030cb87780 1 < completed write operation key=ZQD0491BHJPM tag=SMR9I3IRNHJ8 type=write size=664079 2024-09-12T00:36:26.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.165+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~KTX72O2RO3OI.0 size=1048576 2024-09-12T00:36:26.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.167+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~KTX72O2RO3OI.1 size=131132 2024-09-12T00:36:26.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.167+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=KTX72O2RO3OI tag=CUZ0Z0IV2Y2E type=write size=2228284 2024-09-12T00:36:26.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.168+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=PC0KXRF8HF1F type=del 2024-09-12T00:36:26.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.170+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=JIG71JFTJ4HJ type=del size=837332 2024-09-12T00:36:26.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.171+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~ZK7WBJAQ4UVD.0 size=1048576 2024-09-12T00:36:26.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.171+0000 7f030cb87780 1 < canceled part key=_multipart_327RDLIWLVRO.2~ZK7WBJAQ4UVD.1 size=1048576 2024-09-12T00:36:26.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.172+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~ZK7WBJAQ4UVD.2 size=962552 2024-09-12T00:36:26.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.175+0000 7f030cb87780 1 < canceled multipart upload key=327RDLIWLVRO upload=ZK7WBJAQ4UVD tag=B4CXOHOEZ60V type=write size=4108280 2024-09-12T00:36:26.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.176+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=J6NRBTUIO8N3 type=del size=4154368 2024-09-12T00:36:26.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.179+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=VIM168IZOIQS type=del 2024-09-12T00:36:26.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.181+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=YHG4HQ7HWW62 type=del size=429554 2024-09-12T00:36:26.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.182+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~D8RL3U48IGVI.0 size=201975 2024-09-12T00:36:26.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.186+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=D8RL3U48IGVI tag=NQ5NY9RHZQHH type=write size=1250551 2024-09-12T00:36:26.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.188+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~AOYJNXMSAZAS.0 size=1048576 2024-09-12T00:36:26.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.189+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~AOYJNXMSAZAS.1 size=656695 2024-09-12T00:36:26.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.189+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=AOYJNXMSAZAS tag=C39D3QBV2M1V type=write size=2753847 2024-09-12T00:36:26.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.190+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=YN59ZK3JXSYC type=del 2024-09-12T00:36:26.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.193+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~ZUTH88RMO125.0 size=711726 2024-09-12T00:36:26.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.193+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=ZUTH88RMO125 tag=V66PUUI3OYBE type=write size=1760302 2024-09-12T00:36:26.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.194+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=XIK3ONAXE0QZ type=del 2024-09-12T00:36:26.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.197+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=N89PYMWVFB0O type=del size=1231896 2024-09-12T00:36:26.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.199+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~EBIGUNKUU0B1.0 size=57064 2024-09-12T00:36:26.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.201+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=EBIGUNKUU0B1 tag=F4RTFZK6XZJ4 type=write size=1105640 2024-09-12T00:36:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.202+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=IYCCK5YEGFWD type=del size=2793486 2024-09-12T00:36:26.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.204+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~ABIRLM4AMR5S.0 size=1048576 2024-09-12T00:36:26.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.205+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~ABIRLM4AMR5S.1 size=302772 2024-09-12T00:36:26.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.207+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=ABIRLM4AMR5S tag=CGL5MSWFVALR type=write size=2399924 2024-09-12T00:36:26.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.210+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~IS6ACG53AGYX.0 size=1048576 2024-09-12T00:36:26.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.211+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~IS6ACG53AGYX.1 size=532009 2024-09-12T00:36:26.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.211+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=IS6ACG53AGYX tag=B6U92ULQVKOQ type=write size=2629161 2024-09-12T00:36:26.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.213+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~GGL5NAUQ6W6S.0 size=1048576 2024-09-12T00:36:26.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.214+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~GGL5NAUQ6W6S.1 size=1048576 2024-09-12T00:36:26.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.216+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~GGL5NAUQ6W6S.2 size=860857 2024-09-12T00:36:26.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.219+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=GGL5NAUQ6W6S tag=CF2R30YYHD0W type=write size=4006585 2024-09-12T00:36:26.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.220+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=DT9S7MQNT9EM type=del size=3722466 2024-09-12T00:36:26.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.223+0000 7f030cb87780 1 < suggested update operation key=6WHZRKLM3OLP tag=B8F9LMMQ3D9N type=del size=3816762 2024-09-12T00:36:26.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.225+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=ULNJWXKR3H1A type=del size=264180 2024-09-12T00:36:26.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.226+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~P6SQ1R9MONM9.0 size=562998 2024-09-12T00:36:26.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.229+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=P6SQ1R9MONM9 tag=PIWML1MABGHN type=write size=1611574 2024-09-12T00:36:26.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.230+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=J419FSWOZML1 type=del size=1002785 2024-09-12T00:36:26.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.232+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~1B3HLPJWE205.0 size=156326 2024-09-12T00:36:26.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.234+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=1B3HLPJWE205 tag=SAA5I4ET0KO4 type=write size=1204902 2024-09-12T00:36:26.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.236+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~DYQ8NH5C1GDF.0 size=1048576 2024-09-12T00:36:26.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.238+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~DYQ8NH5C1GDF.1 size=1048576 2024-09-12T00:36:26.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.239+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~DYQ8NH5C1GDF.2 size=684247 2024-09-12T00:36:26.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.239+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=DYQ8NH5C1GDF tag=8AC41Q3JYNKV type=write size=3829975 2024-09-12T00:36:26.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.242+0000 7f030cb87780 1 < suggested update operation key=1PLGUJCB6J0V tag=PL8UA2ZVFKCS type=write size=199460 2024-09-12T00:36:26.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.245+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~9AJROOXBXF6K.0 size=56275 2024-09-12T00:36:26.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.245+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=9AJROOXBXF6K tag=F3ZTPUPB4RAE type=write size=1104851 2024-09-12T00:36:26.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.246+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=D63RTE72UULA type=del 2024-09-12T00:36:26.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.247+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=Y0UA609XX1NX type=del size=1052481 2024-09-12T00:36:26.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.251+0000 7f030cb87780 1 < suggested update operation key=JRPD5AAK84ZD tag=JPW50V6A4G82 type=del size=1686747 2024-09-12T00:36:26.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.254+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~U281WREGLYHC.0 size=350337 2024-09-12T00:36:26.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.254+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=U281WREGLYHC tag=DYL3GDEZ70IL type=write size=1398913 2024-09-12T00:36:26.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.256+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~KTX72O2RO3OI.0 size=1048576 2024-09-12T00:36:26.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.256+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~KTX72O2RO3OI.1 size=131132 2024-09-12T00:36:26.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.259+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=KTX72O2RO3OI tag=CUZ0Z0IV2Y2E type=write size=2228284 2024-09-12T00:36:26.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.260+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=FGO76YTSIL6T type=del size=2953206 2024-09-12T00:36:26.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.262+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=JIG71JFTJ4HJ type=del 2024-09-12T00:36:26.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.264+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~H09ZHL55ORTA.0 size=874344 2024-09-12T00:36:26.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.264+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=H09ZHL55ORTA tag=H1L97EAI3Z8I type=write size=1922920 2024-09-12T00:36:26.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.268+0000 7f030cb87780 1 < suggested remove operation key=92GDVW0Q8VKQ tag=J6NRBTUIO8N3 type=del 2024-09-12T00:36:26.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.268+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=GTGM9FY7F4PZ type=del size=3007652 2024-09-12T00:36:26.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.271+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=YHG4HQ7HWW62 type=del 2024-09-12T00:36:26.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.272+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=CIKN3UHADC60 type=del size=2361772 2024-09-12T00:36:26.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.273+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~AOYJNXMSAZAS.0 size=1048576 2024-09-12T00:36:26.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.275+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~AOYJNXMSAZAS.1 size=656695 2024-09-12T00:36:26.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.278+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=AOYJNXMSAZAS tag=C39D3QBV2M1V type=write size=2753847 2024-09-12T00:36:26.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.281+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~QVYFLD66GUT4.0 size=650135 2024-09-12T00:36:26.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.281+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=QVYFLD66GUT4 tag=LDWQ8HMJII0S type=write size=1698711 2024-09-12T00:36:26.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.282+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~ZUTH88RMO125.0 size=711726 2024-09-12T00:36:26.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.285+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=ZUTH88RMO125 tag=V66PUUI3OYBE type=write size=1760302 2024-09-12T00:36:26.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.287+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=MAHM04FSIN4T type=del size=411582 2024-09-12T00:36:26.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.289+0000 7f030cb87780 1 < canceled operation key=N3KD1UVUVM95 tag=N89PYMWVFB0O type=del size=1231896 2024-09-12T00:36:26.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.292+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~PUM3WSVDZ31S.0 size=1048576 2024-09-12T00:36:26.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.293+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~PUM3WSVDZ31S.1 size=1048576 2024-09-12T00:36:26.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.293+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~PUM3WSVDZ31S.2 size=751412 2024-09-12T00:36:26.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.293+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=PUM3WSVDZ31S tag=71LO68ZJMZFK type=write size=3897140 2024-09-12T00:36:26.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.296+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=IYCCK5YEGFWD type=del 2024-09-12T00:36:26.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.297+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=HEZ2LM44I2NV type=write size=333829 2024-09-12T00:36:26.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.297+0000 7f030cb87780 1 < canceled part key=_multipart_JPEIGLC162K3.2~IS6ACG53AGYX.0 size=1048576 2024-09-12T00:36:26.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.299+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~IS6ACG53AGYX.1 size=532009 2024-09-12T00:36:26.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.302+0000 7f030cb87780 1 < canceled multipart upload key=JPEIGLC162K3 upload=IS6ACG53AGYX tag=B6U92ULQVKOQ type=write size=2629161 2024-09-12T00:36:26.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.305+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~KPZB5KMXW9WE.0 size=313588 2024-09-12T00:36:26.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.305+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=KPZB5KMXW9WE tag=J8KHIIYZW6XM type=write size=1362164 2024-09-12T00:36:26.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.306+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=DT9S7MQNT9EM type=del 2024-09-12T00:36:26.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.307+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=0G0SL39TSJ28 type=del size=648290 2024-09-12T00:36:26.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.308+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=ULNJWXKR3H1A type=del 2024-09-12T00:36:26.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.310+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=KKNBOE3PA6EO type=del size=2742111 2024-09-12T00:36:26.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.311+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=J419FSWOZML1 type=del 2024-09-12T00:36:26.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.313+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=Z17HEZLY7XQ1 type=del size=3564424 2024-09-12T00:36:26.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.314+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~DYQ8NH5C1GDF.0 size=1048576 2024-09-12T00:36:26.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.316+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~DYQ8NH5C1GDF.1 size=1048576 2024-09-12T00:36:26.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.316+0000 7f030cb87780 1 < canceled part key=_multipart_OR439FK5L43V.2~DYQ8NH5C1GDF.2 size=684247 2024-09-12T00:36:26.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.319+0000 7f030cb87780 1 < canceled multipart upload key=OR439FK5L43V upload=DYQ8NH5C1GDF tag=8AC41Q3JYNKV type=write size=3829975 2024-09-12T00:36:26.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.321+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=UIAR40XASH6J type=del size=3699659 2024-09-12T00:36:26.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.322+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~9AJROOXBXF6K.0 size=56275 2024-09-12T00:36:26.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.326+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=9AJROOXBXF6K tag=F3ZTPUPB4RAE type=write size=1104851 2024-09-12T00:36:26.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.328+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~VSAIWCJQAPPB.0 size=1048576 2024-09-12T00:36:26.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.329+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~VSAIWCJQAPPB.1 size=156240 2024-09-12T00:36:26.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.329+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=VSAIWCJQAPPB tag=P0P204O9UY03 type=write size=2253392 2024-09-12T00:36:26.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.331+0000 7f030cb87780 -1 < failed to complete operation key=92GDVW0Q8VKQ tag=Y0UA609XX1NX type=del size=1052481: (22) Invalid argument 2024-09-12T00:36:26.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.332+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=4GW1RMGXICQP type=del size=825705 2024-09-12T00:36:26.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.333+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~U281WREGLYHC.0 size=350337 2024-09-12T00:36:26.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.336+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=U281WREGLYHC tag=DYL3GDEZ70IL type=write size=1398913 2024-09-12T00:36:26.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.338+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=OMAIRXGSP3V6 type=del size=3885329 2024-09-12T00:36:26.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.338+0000 7f030cb87780 -1 < failed to complete operation key=92GDVW0Q8VKQ tag=FGO76YTSIL6T type=del size=2953206: (22) Invalid argument 2024-09-12T00:36:26.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.341+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=RCSEDTT4ANAW type=del size=3155936 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.341+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~H09ZHL55ORTA.0 size=874344 2024-09-12T00:36:26.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.344+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=H09ZHL55ORTA tag=H1L97EAI3Z8I type=write size=1922920 2024-09-12T00:36:26.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.345+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=A9N1HLQAUUUK type=del size=2721051 2024-09-12T00:36:26.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.348+0000 7f030cb87780 1 < suggested remove operation key=1VOJGMWNKS0A tag=GTGM9FY7F4PZ type=del 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.349+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=1AIUS61382W7 type=del size=605493 2024-09-12T00:36:26.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.350+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=CIKN3UHADC60 type=del 2024-09-12T00:36:26.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.354+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~OHUA2GCCOTQP.0 size=1048576 2024-09-12T00:36:26.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.354+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~OHUA2GCCOTQP.1 size=1048576 2024-09-12T00:36:26.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.355+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~OHUA2GCCOTQP.2 size=610119 2024-09-12T00:36:26.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.355+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=OHUA2GCCOTQP tag=2F86X30JOMYM type=write size=3755847 2024-09-12T00:36:26.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.356+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~QVYFLD66GUT4.0 size=650135 2024-09-12T00:36:26.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.360+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=QVYFLD66GUT4 tag=LDWQ8HMJII0S type=write size=1698711 2024-09-12T00:36:26.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.362+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~JX6847GWPL4Z.0 size=1048576 2024-09-12T00:36:26.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.362+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~JX6847GWPL4Z.1 size=1048576 2024-09-12T00:36:26.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.364+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~JX6847GWPL4Z.2 size=631060 2024-09-12T00:36:26.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.364+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=JX6847GWPL4Z tag=2XGN233CFT63 type=write size=3776788 2024-09-12T00:36:26.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.365+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=MAHM04FSIN4T type=del 2024-09-12T00:36:26.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.368+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~33OMEB3EV5QL.0 size=1048576 2024-09-12T00:36:26.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.369+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~33OMEB3EV5QL.1 size=1048576 2024-09-12T00:36:26.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.371+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~33OMEB3EV5QL.2 size=630860 2024-09-12T00:36:26.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.371+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=33OMEB3EV5QL tag=QKWWT27I1SDT type=write size=3776588 2024-09-12T00:36:26.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.371+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~PUM3WSVDZ31S.0 size=1048576 2024-09-12T00:36:26.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.373+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~PUM3WSVDZ31S.1 size=1048576 2024-09-12T00:36:26.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.374+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~PUM3WSVDZ31S.2 size=751412 2024-09-12T00:36:26.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.376+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=PUM3WSVDZ31S tag=71LO68ZJMZFK type=write size=3897140 2024-09-12T00:36:26.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.379+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~O111XDDR6X1Z.0 size=212021 2024-09-12T00:36:26.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.379+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=O111XDDR6X1Z tag=OAA4K4H6BDC9 type=write size=1260597 2024-09-12T00:36:26.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.380+0000 7f030cb87780 1 < completed write operation key=9MCRD2G3MZIT tag=HEZ2LM44I2NV type=write size=333829 2024-09-12T00:36:26.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.382+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=ZGG2Z80SWVEP type=del size=2608459 2024-09-12T00:36:26.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.383+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~KPZB5KMXW9WE.0 size=313588 2024-09-12T00:36:26.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.386+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=KPZB5KMXW9WE tag=J8KHIIYZW6XM type=write size=1362164 2024-09-12T00:36:26.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.388+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~2JBVKIEMM7JV.0 size=571773 2024-09-12T00:36:26.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.388+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=2JBVKIEMM7JV tag=TG6GDTWLIEXP type=write size=1620349 2024-09-12T00:36:26.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.391+0000 7f030cb87780 1 < suggested remove operation key=POC8YA58U55N tag=0G0SL39TSJ28 type=del 2024-09-12T00:36:26.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.395+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~IAAAZFW2PNAC.0 size=1048576 2024-09-12T00:36:26.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.396+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~IAAAZFW2PNAC.1 size=586715 2024-09-12T00:36:26.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.396+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=IAAAZFW2PNAC tag=WY2V77AGLBDS type=write size=2683867 2024-09-12T00:36:26.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.397+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=KKNBOE3PA6EO type=del 2024-09-12T00:36:26.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.398+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=YX8VIVKL30LX type=del size=648042 2024-09-12T00:36:26.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.399+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=Z17HEZLY7XQ1 type=del 2024-09-12T00:36:26.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.402+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~6X6RAMZ8BLXT.0 size=1048576 2024-09-12T00:36:26.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.403+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~6X6RAMZ8BLXT.1 size=256520 2024-09-12T00:36:26.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.403+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=6X6RAMZ8BLXT tag=0NYSHFWL6PVC type=write size=2353672 2024-09-12T00:36:26.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.405+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=UIAR40XASH6J type=del 2024-09-12T00:36:26.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.406+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=WR4AYG80JFPL type=del size=2447969 2024-09-12T00:36:26.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.407+0000 7f030cb87780 1 < canceled part key=_multipart_DLR6A7XOERHW.2~VSAIWCJQAPPB.0 size=1048576 2024-09-12T00:36:26.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.408+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~VSAIWCJQAPPB.1 size=156240 2024-09-12T00:36:26.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.411+0000 7f030cb87780 1 < canceled multipart upload key=DLR6A7XOERHW upload=VSAIWCJQAPPB tag=P0P204O9UY03 type=write size=2253392 2024-09-12T00:36:26.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.412+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=I8O9J2PE9L16 type=del size=1118082 2024-09-12T00:36:26.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.413+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=4GW1RMGXICQP type=del 2024-09-12T00:36:26.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.415+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=8DVJXOHVW7GP type=write size=992997 2024-09-12T00:36:26.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.417+0000 7f030cb87780 1 < suggested remove operation key=ATTMOL2TGUN7 tag=OMAIRXGSP3V6 type=del 2024-09-12T00:36:26.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.419+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=9KQAG3VUGCW2 type=del size=277314 2024-09-12T00:36:26.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.420+0000 7f030cb87780 1 < canceled operation key=CUDFTXFBC862 tag=RCSEDTT4ANAW type=del size=3155936 2024-09-12T00:36:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.423+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~R093SGVN9GB8.0 size=1048576 2024-09-12T00:36:26.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.424+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~R093SGVN9GB8.1 size=548046 2024-09-12T00:36:26.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.424+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=R093SGVN9GB8 tag=ZLRXJRHKA3C5 type=write size=2645198 2024-09-12T00:36:26.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.426+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=A9N1HLQAUUUK type=del 2024-09-12T00:36:26.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.428+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~WK3PKNWAMBSS.0 size=1048576 2024-09-12T00:36:26.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.429+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~WK3PKNWAMBSS.1 size=548869 2024-09-12T00:36:26.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.429+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=WK3PKNWAMBSS tag=7MZE0SW0U226 type=write size=2646021 2024-09-12T00:36:26.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.432+0000 7f030cb87780 1 < suggested update operation key=ZQD0491BHJPM tag=1AIUS61382W7 type=del size=605493 2024-09-12T00:36:26.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.434+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=XDZ651KA0SRM type=write size=453906 2024-09-12T00:36:26.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.435+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~OHUA2GCCOTQP.0 size=1048576 2024-09-12T00:36:26.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.437+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~OHUA2GCCOTQP.1 size=1048576 2024-09-12T00:36:26.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.438+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~OHUA2GCCOTQP.2 size=610119 2024-09-12T00:36:26.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.441+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=OHUA2GCCOTQP tag=2F86X30JOMYM type=write size=3755847 2024-09-12T00:36:26.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.442+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=S4ALHQ1NO4V7 type=del size=642356 2024-09-12T00:36:26.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.444+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~JX6847GWPL4Z.0 size=1048576 2024-09-12T00:36:26.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.445+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~JX6847GWPL4Z.1 size=1048576 2024-09-12T00:36:26.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.446+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~JX6847GWPL4Z.2 size=631060 2024-09-12T00:36:26.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.448+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=JX6847GWPL4Z tag=2XGN233CFT63 type=write size=3776788 2024-09-12T00:36:26.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.451+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~1K60G0XWJJSZ.0 size=1048576 2024-09-12T00:36:26.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.452+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~1K60G0XWJJSZ.1 size=946906 2024-09-12T00:36:26.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.452+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=1K60G0XWJJSZ tag=145MKZAJJP63 type=write size=3044058 2024-09-12T00:36:26.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.452+0000 7f030cb87780 1 < canceled part key=_multipart_IY156CJWG2TB.2~33OMEB3EV5QL.0 size=1048576 2024-09-12T00:36:26.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.454+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~33OMEB3EV5QL.1 size=1048576 2024-09-12T00:36:26.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.455+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~33OMEB3EV5QL.2 size=630860 2024-09-12T00:36:26.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.459+0000 7f030cb87780 1 < canceled multipart upload key=IY156CJWG2TB upload=33OMEB3EV5QL tag=QKWWT27I1SDT type=write size=3776588 2024-09-12T00:36:26.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.462+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~CSZ3KAJV7LVW.0 size=103564 2024-09-12T00:36:26.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.462+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=CSZ3KAJV7LVW tag=OZ3IUMTQOHN2 type=write size=1152140 2024-09-12T00:36:26.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.463+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~O111XDDR6X1Z.0 size=212021 2024-09-12T00:36:26.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.465+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=O111XDDR6X1Z tag=OAA4K4H6BDC9 type=write size=1260597 2024-09-12T00:36:26.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.466+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=0ZKAQ7U58NHH type=write size=268347 2024-09-12T00:36:26.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.470+0000 7f030cb87780 1 < suggested update operation key=3W7ANGL92ZF0 tag=ZGG2Z80SWVEP type=del size=2608459 2024-09-12T00:36:26.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.473+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~3AJZAZJEH8MR.0 size=1048576 2024-09-12T00:36:26.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.474+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~3AJZAZJEH8MR.1 size=1048576 2024-09-12T00:36:26.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.475+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~3AJZAZJEH8MR.2 size=903750 2024-09-12T00:36:26.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.475+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=3AJZAZJEH8MR tag=36HGNWAI2JJ5 type=write size=4049478 2024-09-12T00:36:26.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.476+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~2JBVKIEMM7JV.0 size=571773 2024-09-12T00:36:26.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.480+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=2JBVKIEMM7JV tag=TG6GDTWLIEXP type=write size=1620349 2024-09-12T00:36:26.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.480+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=279ASRCB6EN8 type=del size=4097310 2024-09-12T00:36:26.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.482+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~IAAAZFW2PNAC.0 size=1048576 2024-09-12T00:36:26.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.483+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~IAAAZFW2PNAC.1 size=586715 2024-09-12T00:36:26.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.485+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=IAAAZFW2PNAC tag=WY2V77AGLBDS type=write size=2683867 2024-09-12T00:36:26.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.487+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=39I9AIDF63Z0 type=write size=312546 2024-09-12T00:36:26.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.488+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=YX8VIVKL30LX type=del 2024-09-12T00:36:26.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.489+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=BM9PGXPNAMCL type=del size=64196 2024-09-12T00:36:26.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.492+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~6X6RAMZ8BLXT.0 size=1048576 2024-09-12T00:36:26.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.492+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~6X6RAMZ8BLXT.1 size=256520 2024-09-12T00:36:26.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.494+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=6X6RAMZ8BLXT tag=0NYSHFWL6PVC type=write size=2353672 2024-09-12T00:36:26.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.498+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~1QQ088N9AW97.0 size=1048576 2024-09-12T00:36:26.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.499+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~1QQ088N9AW97.1 size=1048576 2024-09-12T00:36:26.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.500+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~1QQ088N9AW97.2 size=137881 2024-09-12T00:36:26.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.500+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=1QQ088N9AW97 tag=DNAIWZ13CKOC type=write size=3283609 2024-09-12T00:36:26.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.501+0000 7f030cb87780 1 < canceled operation key=1PLGUJCB6J0V tag=WR4AYG80JFPL type=del size=2447969 2024-09-12T00:36:26.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.502+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=5GAQV9TQ8NWZ type=del size=4052020 2024-09-12T00:36:26.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.504+0000 7f030cb87780 1 < suggested update operation key=1VOJGMWNKS0A tag=I8O9J2PE9L16 type=del size=1118082 2024-09-12T00:36:26.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.508+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~HXF84PHFPT9V.0 size=1048576 2024-09-12T00:36:26.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.509+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~HXF84PHFPT9V.1 size=1048576 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.509+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~HXF84PHFPT9V.2 size=641979 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.509+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=HXF84PHFPT9V tag=P9TCZ7JRZRW4 type=write size=3787707 2024-09-12T00:36:26.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.510+0000 7f030cb87780 1 < canceled operation key=POC8YA58U55N tag=8DVJXOHVW7GP type=write size=992997 2024-09-12T00:36:26.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.513+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~HNU074C73XKO.0 size=1048576 2024-09-12T00:36:26.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.515+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~HNU074C73XKO.1 size=1048576 2024-09-12T00:36:26.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.516+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~HNU074C73XKO.2 size=1002104 2024-09-12T00:36:26.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.516+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=HNU074C73XKO tag=JJPHBQJRO6LR type=write size=4147832 2024-09-12T00:36:26.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.517+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=9KQAG3VUGCW2 type=del 2024-09-12T00:36:26.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.518+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=OMSFA8IC8N4J type=del size=59939 2024-09-12T00:36:26.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.519+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~R093SGVN9GB8.0 size=1048576 2024-09-12T00:36:26.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.522+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~R093SGVN9GB8.1 size=548046 2024-09-12T00:36:26.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.524+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=R093SGVN9GB8 tag=ZLRXJRHKA3C5 type=write size=2645198 2024-09-12T00:36:26.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.525+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=I2TDU6UM9YY9 type=write size=733487 2024-09-12T00:36:26.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.526+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~WK3PKNWAMBSS.0 size=1048576 2024-09-12T00:36:26.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.527+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~WK3PKNWAMBSS.1 size=548869 2024-09-12T00:36:26.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.530+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=WK3PKNWAMBSS tag=7MZE0SW0U226 type=write size=2646021 2024-09-12T00:36:26.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.531+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=IQ8C9NLBES0B type=del size=2881799 2024-09-12T00:36:26.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.534+0000 7f030cb87780 1 < suggested update operation key=ATTMOL2TGUN7 tag=XDZ651KA0SRM type=write size=453906 2024-09-12T00:36:26.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.537+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~I30HJ8K6NRDD.0 size=232127 2024-09-12T00:36:26.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.537+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=I30HJ8K6NRDD tag=GNKDXLOFT7GS type=write size=1280703 2024-09-12T00:36:26.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.538+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=S4ALHQ1NO4V7 type=del 2024-09-12T00:36:26.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.540+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=NLKH2DAN6L98 type=write size=890907 2024-09-12T00:36:26.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.541+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~1K60G0XWJJSZ.0 size=1048576 2024-09-12T00:36:26.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.542+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~1K60G0XWJJSZ.1 size=946906 2024-09-12T00:36:26.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.545+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=1K60G0XWJJSZ tag=145MKZAJJP63 type=write size=3044058 2024-09-12T00:36:26.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.547+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~ET8XSOZFR90E.0 size=17950 2024-09-12T00:36:26.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.547+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=ET8XSOZFR90E tag=F0IWYZ2FRPWO type=write size=1066526 2024-09-12T00:36:26.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.550+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~CSZ3KAJV7LVW.0 size=103564 2024-09-12T00:36:26.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.554+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=CSZ3KAJV7LVW tag=OZ3IUMTQOHN2 type=write size=1152140 2024-09-12T00:36:26.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.554+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=NJMVP45SL61B type=del size=1795013 2024-09-12T00:36:26.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.556+0000 7f030cb87780 1 < completed write operation key=800OHA7UURC4 tag=0ZKAQ7U58NHH type=write size=268347 2024-09-12T00:36:26.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.557+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=F840YSTF3UH5 type=del size=3697398 2024-09-12T00:36:26.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.559+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~3AJZAZJEH8MR.0 size=1048576 2024-09-12T00:36:26.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.561+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~3AJZAZJEH8MR.1 size=1048576 2024-09-12T00:36:26.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.561+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~3AJZAZJEH8MR.2 size=903750 2024-09-12T00:36:26.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.564+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=3AJZAZJEH8MR tag=36HGNWAI2JJ5 type=write size=4049478 2024-09-12T00:36:26.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.566+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~75STL23CQS0S.0 size=274060 2024-09-12T00:36:26.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.566+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=75STL23CQS0S tag=EV27PYUE19HS type=write size=1322636 2024-09-12T00:36:26.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.568+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=279ASRCB6EN8 type=del 2024-09-12T00:36:26.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.573+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~40EVH2FNA4CU.0 size=1048576 2024-09-12T00:36:26.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.574+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~40EVH2FNA4CU.1 size=576515 2024-09-12T00:36:26.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.574+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=40EVH2FNA4CU tag=927LNCVCJQ0W type=write size=2673667 2024-09-12T00:36:26.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.576+0000 7f030cb87780 1 < completed write operation key=JRPD5AAK84ZD tag=39I9AIDF63Z0 type=write size=312546 2024-09-12T00:36:26.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.579+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~C2569TL0OLED.0 size=544600 2024-09-12T00:36:26.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.579+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=C2569TL0OLED tag=Y16B5U7CPLKI type=write size=1593176 2024-09-12T00:36:26.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.581+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=BM9PGXPNAMCL type=del 2024-09-12T00:36:26.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.582+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=CXUYAZ1ZFW29 type=del size=1673212 2024-09-12T00:36:26.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.584+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~1QQ088N9AW97.0 size=1048576 2024-09-12T00:36:26.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.585+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~1QQ088N9AW97.1 size=1048576 2024-09-12T00:36:26.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.586+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~1QQ088N9AW97.2 size=137881 2024-09-12T00:36:26.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.589+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=1QQ088N9AW97 tag=DNAIWZ13CKOC type=write size=3283609 2024-09-12T00:36:26.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.591+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=YF993HEK2EZD type=write size=624267 2024-09-12T00:36:26.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.592+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=5GAQV9TQ8NWZ type=del 2024-09-12T00:36:26.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.597+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~Y6XBESXWTNUW.0 size=1048576 2024-09-12T00:36:26.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.598+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~Y6XBESXWTNUW.1 size=503067 2024-09-12T00:36:26.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.598+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=Y6XBESXWTNUW tag=HIGW2I39W14G type=write size=2600219 2024-09-12T00:36:26.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.600+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~HXF84PHFPT9V.0 size=1048576 2024-09-12T00:36:26.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.600+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~HXF84PHFPT9V.1 size=1048576 2024-09-12T00:36:26.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.602+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~HXF84PHFPT9V.2 size=641979 2024-09-12T00:36:26.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.604+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=HXF84PHFPT9V tag=P9TCZ7JRZRW4 type=write size=3787707 2024-09-12T00:36:26.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.605+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=0QVJD7EIN056 type=del size=1598078 2024-09-12T00:36:26.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.607+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~HNU074C73XKO.0 size=1048576 2024-09-12T00:36:26.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.608+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~HNU074C73XKO.1 size=1048576 2024-09-12T00:36:26.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.609+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~HNU074C73XKO.2 size=1002104 2024-09-12T00:36:26.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.612+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=HNU074C73XKO tag=JJPHBQJRO6LR type=write size=4147832 2024-09-12T00:36:26.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.614+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=SF0H8J6FQE0U type=del size=3285479 2024-09-12T00:36:26.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.614+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=OMSFA8IC8N4J type=del 2024-09-12T00:36:26.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.616+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=E48WBV54EZFU type=del size=3225083 2024-09-12T00:36:26.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.618+0000 7f030cb87780 1 < completed write operation key=39WSAOA6P09M tag=I2TDU6UM9YY9 type=write size=733487 2024-09-12T00:36:26.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.620+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~N173L90Q5JZ0.0 size=1048576 2024-09-12T00:36:26.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.622+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~N173L90Q5JZ0.1 size=1048576 2024-09-12T00:36:26.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.623+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~N173L90Q5JZ0.2 size=222268 2024-09-12T00:36:26.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.623+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=N173L90Q5JZ0 tag=DEIXN5Y1EYU3 type=write size=3367996 2024-09-12T00:36:26.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.624+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=IQ8C9NLBES0B type=del 2024-09-12T00:36:26.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.625+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=NO9B1JRHGAI6 type=del size=2265266 2024-09-12T00:36:26.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.627+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~I30HJ8K6NRDD.0 size=232127 2024-09-12T00:36:26.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.629+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=I30HJ8K6NRDD tag=GNKDXLOFT7GS type=write size=1280703 2024-09-12T00:36:26.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.631+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~UW8SUD68MKKZ.0 size=1048576 2024-09-12T00:36:26.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.632+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~UW8SUD68MKKZ.1 size=935933 2024-09-12T00:36:26.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.632+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=UW8SUD68MKKZ tag=6NU7WO15S4RX type=write size=3033085 2024-09-12T00:36:26.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.635+0000 7f030cb87780 1 < suggested update operation key=1VOJGMWNKS0A tag=NLKH2DAN6L98 type=write size=890907 2024-09-12T00:36:26.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.638+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~LY7FLV3AQ7A5.0 size=1048576 2024-09-12T00:36:26.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.639+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~LY7FLV3AQ7A5.1 size=1048576 2024-09-12T00:36:26.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.640+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~LY7FLV3AQ7A5.2 size=615895 2024-09-12T00:36:26.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.640+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=LY7FLV3AQ7A5 tag=PV8MGB1CU12Z type=write size=3761623 2024-09-12T00:36:26.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.642+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~ET8XSOZFR90E.0 size=17950 2024-09-12T00:36:26.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.644+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=ET8XSOZFR90E tag=F0IWYZ2FRPWO type=write size=1066526 2024-09-12T00:36:26.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.645+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=XHTT4GUZCA95 type=del size=2513681 2024-09-12T00:36:26.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.647+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=NJMVP45SL61B type=del 2024-09-12T00:36:26.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.648+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=E0DYZTW7EDMQ type=write size=483092 2024-09-12T00:36:26.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.651+0000 7f030cb87780 1 < canceled operation key=99OWKRGA8ZZN tag=F840YSTF3UH5 type=del size=3697398 2024-09-12T00:36:26.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.654+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~ICYZX95VDNI9.0 size=1048576 2024-09-12T00:36:26.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.655+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~ICYZX95VDNI9.1 size=1048576 2024-09-12T00:36:26.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.655+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~ICYZX95VDNI9.2 size=619803 2024-09-12T00:36:26.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.655+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=ICYZX95VDNI9 tag=0O8KZN2SH1PI type=write size=3765531 2024-09-12T00:36:26.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.658+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~75STL23CQS0S.0 size=274060 2024-09-12T00:36:26.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.659+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=75STL23CQS0S tag=EV27PYUE19HS type=write size=1322636 2024-09-12T00:36:26.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.662+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=EJ1PSZNZLKTA type=del size=2976108 2024-09-12T00:36:26.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.663+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~40EVH2FNA4CU.0 size=1048576 2024-09-12T00:36:26.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.664+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~40EVH2FNA4CU.1 size=576515 2024-09-12T00:36:26.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.667+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=40EVH2FNA4CU tag=927LNCVCJQ0W type=write size=2673667 2024-09-12T00:36:26.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.668+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=1WM0XDMPK9P9 type=write size=581639 2024-09-12T00:36:26.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.671+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~C2569TL0OLED.0 size=544600 2024-09-12T00:36:26.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.674+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=C2569TL0OLED tag=Y16B5U7CPLKI type=write size=1593176 2024-09-12T00:36:26.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.676+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~ZH68ZU1VJEMM.0 size=1048576 2024-09-12T00:36:26.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.677+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~ZH68ZU1VJEMM.1 size=1048576 2024-09-12T00:36:26.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.678+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~ZH68ZU1VJEMM.2 size=197407 2024-09-12T00:36:26.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.678+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=ZH68ZU1VJEMM tag=UOMYC6V49KPF type=write size=3343135 2024-09-12T00:36:26.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.681+0000 7f030cb87780 1 < suggested update operation key=U5CWO1EN8BFI tag=CXUYAZ1ZFW29 type=del size=1673212 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.683+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=F2YYZ4IJTEP9 type=del size=3100877 2024-09-12T00:36:26.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.686+0000 7f030cb87780 1 < suggested remove operation key=INFFH9R3EFRY tag=YF993HEK2EZD type=write 2024-09-12T00:36:26.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.688+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=LTMGUXKL3A5O type=write size=844797 2024-09-12T00:36:26.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.689+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~Y6XBESXWTNUW.0 size=1048576 2024-09-12T00:36:26.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.690+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~Y6XBESXWTNUW.1 size=503067 2024-09-12T00:36:26.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.693+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=Y6XBESXWTNUW tag=HIGW2I39W14G type=write size=2600219 2024-09-12T00:36:26.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.694+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=UN9YIYGOKJE6 type=del size=3194008 2024-09-12T00:36:26.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.697+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=0QVJD7EIN056 type=del 2024-09-12T00:36:26.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.700+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~QQPFHCQZTYRT.0 size=1048576 2024-09-12T00:36:26.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.700+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~QQPFHCQZTYRT.1 size=154618 2024-09-12T00:36:26.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.700+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=QQPFHCQZTYRT tag=UMAHX2AXFO0Z type=write size=2251770 2024-09-12T00:36:26.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.702+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=SF0H8J6FQE0U type=del 2024-09-12T00:36:26.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.704+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~YWPLE5V2L97H.0 size=1048576 2024-09-12T00:36:26.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.705+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~YWPLE5V2L97H.1 size=856794 2024-09-12T00:36:26.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.705+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=YWPLE5V2L97H tag=NOMRX35P1TWJ type=write size=2953946 2024-09-12T00:36:26.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.707+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=E48WBV54EZFU type=del 2024-09-12T00:36:26.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.709+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=16VCWAKIYWQV type=del size=3180680 2024-09-12T00:36:26.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.711+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~N173L90Q5JZ0.0 size=1048576 2024-09-12T00:36:26.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.712+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~N173L90Q5JZ0.1 size=1048576 2024-09-12T00:36:26.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.713+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~N173L90Q5JZ0.2 size=222268 2024-09-12T00:36:26.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.714+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=N173L90Q5JZ0 tag=DEIXN5Y1EYU3 type=write size=3367996 2024-09-12T00:36:26.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.717+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~DYEFF0OU6RI8.0 size=1048576 2024-09-12T00:36:26.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.718+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~DYEFF0OU6RI8.1 size=778721 2024-09-12T00:36:26.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.718+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=DYEFF0OU6RI8 tag=PNBDDZUEYIGQ type=write size=2875873 2024-09-12T00:36:26.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.719+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=NO9B1JRHGAI6 type=del 2024-09-12T00:36:26.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.721+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=3WE94GXBRTLG type=del size=303536 2024-09-12T00:36:26.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.723+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~UW8SUD68MKKZ.0 size=1048576 2024-09-12T00:36:26.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.725+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~UW8SUD68MKKZ.1 size=935933 2024-09-12T00:36:26.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.726+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=UW8SUD68MKKZ tag=6NU7WO15S4RX type=write size=3033085 2024-09-12T00:36:26.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.728+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=LMRH12KY7VPZ type=del size=663259 2024-09-12T00:36:26.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.729+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~LY7FLV3AQ7A5.0 size=1048576 2024-09-12T00:36:26.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.730+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~LY7FLV3AQ7A5.1 size=1048576 2024-09-12T00:36:26.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.733+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~LY7FLV3AQ7A5.2 size=615895 2024-09-12T00:36:26.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.735+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=LY7FLV3AQ7A5 tag=PV8MGB1CU12Z type=write size=3761623 2024-09-12T00:36:26.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.737+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=RGSXF4K7BC8Q type=write size=58763 2024-09-12T00:36:26.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.738+0000 7f030cb87780 1 < canceled operation key=327RDLIWLVRO tag=XHTT4GUZCA95 type=del size=2513681 2024-09-12T00:36:26.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.742+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~661W7QGL49RW.0 size=1048576 2024-09-12T00:36:26.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.743+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~661W7QGL49RW.1 size=980032 2024-09-12T00:36:26.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.743+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=661W7QGL49RW tag=AR9VSXFN885C type=write size=3077184 2024-09-12T00:36:26.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.745+0000 7f030cb87780 1 < completed write operation key=92GDVW0Q8VKQ tag=E0DYZTW7EDMQ type=write size=483092 2024-09-12T00:36:26.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.745+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=OKNZBPWJUZE7 type=del size=2657061 2024-09-12T00:36:26.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.747+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~ICYZX95VDNI9.0 size=1048576 2024-09-12T00:36:26.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.748+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~ICYZX95VDNI9.1 size=1048576 2024-09-12T00:36:26.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.749+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~ICYZX95VDNI9.2 size=619803 2024-09-12T00:36:26.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.751+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=ICYZX95VDNI9 tag=0O8KZN2SH1PI type=write size=3765531 2024-09-12T00:36:26.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.755+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~3Z20OWNKGY33.0 size=729456 2024-09-12T00:36:26.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.755+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=3Z20OWNKGY33 tag=076YL5XICT9T type=write size=1778032 2024-09-12T00:36:26.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.755+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=EJ1PSZNZLKTA type=del 2024-09-12T00:36:26.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.757+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=M63TZ3ROTUOD type=del size=3442524 2024-09-12T00:36:26.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.758+0000 7f030cb87780 1 < completed write operation key=92GDVW0Q8VKQ tag=1WM0XDMPK9P9 type=write size=581639 2024-09-12T00:36:26.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.761+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~WFR0AWBD6D01.0 size=1048576 2024-09-12T00:36:26.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.762+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~WFR0AWBD6D01.1 size=292511 2024-09-12T00:36:26.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.762+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=WFR0AWBD6D01 tag=OLIWCIFKYT5I type=write size=2389663 2024-09-12T00:36:26.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.763+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~ZH68ZU1VJEMM.0 size=1048576 2024-09-12T00:36:26.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.765+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~ZH68ZU1VJEMM.1 size=1048576 2024-09-12T00:36:26.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.766+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~ZH68ZU1VJEMM.2 size=197407 2024-09-12T00:36:26.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.768+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=ZH68ZU1VJEMM tag=UOMYC6V49KPF type=write size=3343135 2024-09-12T00:36:26.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.771+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~BEJDRTB4SG2A.0 size=1048576 2024-09-12T00:36:26.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.772+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~BEJDRTB4SG2A.1 size=1048576 2024-09-12T00:36:26.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.773+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~BEJDRTB4SG2A.2 size=131255 2024-09-12T00:36:26.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.773+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=BEJDRTB4SG2A tag=4X15PMLM1PKS type=write size=3276983 2024-09-12T00:36:26.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.774+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=F2YYZ4IJTEP9 type=del 2024-09-12T00:36:26.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.777+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~JAMK7SXTZE7L.0 size=631633 2024-09-12T00:36:26.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.777+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=JAMK7SXTZE7L tag=C6RNG0UYUPGP type=write size=1680209 2024-09-12T00:36:26.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.778+0000 7f030cb87780 1 < completed write operation key=HUDEU16YTO0Y tag=LTMGUXKL3A5O type=write size=844797 2024-09-12T00:36:26.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.780+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=W8VI4M1SHH9E type=del size=900098 2024-09-12T00:36:26.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.781+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=UN9YIYGOKJE6 type=del 2024-09-12T00:36:26.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.783+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=UK68JWP272K9 type=write size=553204 2024-09-12T00:36:26.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.784+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~QQPFHCQZTYRT.0 size=1048576 2024-09-12T00:36:26.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.785+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~QQPFHCQZTYRT.1 size=154618 2024-09-12T00:36:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.788+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=QQPFHCQZTYRT tag=UMAHX2AXFO0Z type=write size=2251770 2024-09-12T00:36:26.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.791+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~18MCKPMPQ6GT.0 size=435009 2024-09-12T00:36:26.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.791+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=18MCKPMPQ6GT tag=7NI4BJF6PGR2 type=write size=1483585 2024-09-12T00:36:26.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.792+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~YWPLE5V2L97H.0 size=1048576 2024-09-12T00:36:26.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.793+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~YWPLE5V2L97H.1 size=856794 2024-09-12T00:36:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.796+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=YWPLE5V2L97H tag=NOMRX35P1TWJ type=write size=2953946 2024-09-12T00:36:26.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.797+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=GFF6AMKQYTIN type=write size=262828 2024-09-12T00:36:26.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.801+0000 7f030cb87780 1 < suggested update operation key=ELX0797T1L4C tag=16VCWAKIYWQV type=del size=3180680 2024-09-12T00:36:26.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.804+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~N6I88MKR2VFH.0 size=1048576 2024-09-12T00:36:26.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.804+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~N6I88MKR2VFH.1 size=388890 2024-09-12T00:36:26.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.804+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=N6I88MKR2VFH tag=W6312VNOF2B9 type=write size=2486042 2024-09-12T00:36:26.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.805+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~DYEFF0OU6RI8.0 size=1048576 2024-09-12T00:36:26.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.807+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~DYEFF0OU6RI8.1 size=778721 2024-09-12T00:36:26.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.809+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=DYEFF0OU6RI8 tag=PNBDDZUEYIGQ type=write size=2875873 2024-09-12T00:36:26.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.812+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~59UAAMLWCO44.0 size=639048 2024-09-12T00:36:26.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.812+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=59UAAMLWCO44 tag=CY00UGNCU4T6 type=write size=1687624 2024-09-12T00:36:26.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.815+0000 7f030cb87780 1 < suggested remove operation key=INFFH9R3EFRY tag=3WE94GXBRTLG type=del 2024-09-12T00:36:26.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.817+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~XDC5OCQN1227.0 size=1048576 2024-09-12T00:36:26.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.818+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~XDC5OCQN1227.1 size=1048576 2024-09-12T00:36:26.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.820+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~XDC5OCQN1227.2 size=209281 2024-09-12T00:36:26.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.820+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=XDC5OCQN1227 tag=3DJT5SUETGSQ type=write size=3355009 2024-09-12T00:36:26.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.821+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=LMRH12KY7VPZ type=del 2024-09-12T00:36:26.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.824+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~NAVFHJTPE98Q.0 size=1048576 2024-09-12T00:36:26.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.825+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~NAVFHJTPE98Q.1 size=1048576 2024-09-12T00:36:26.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.826+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~NAVFHJTPE98Q.2 size=15309 2024-09-12T00:36:26.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.826+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=NAVFHJTPE98Q tag=HAJ9363XODH4 type=write size=3161037 2024-09-12T00:36:26.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.827+0000 7f030cb87780 1 < completed write operation key=CUDFTXFBC862 tag=RGSXF4K7BC8Q type=write size=58763 2024-09-12T00:36:26.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.829+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=3O1V8WM1T5BG type=del size=90200 2024-09-12T00:36:26.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.830+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~661W7QGL49RW.0 size=1048576 2024-09-12T00:36:26.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.831+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~661W7QGL49RW.1 size=980032 2024-09-12T00:36:26.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.833+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=661W7QGL49RW tag=AR9VSXFN885C type=write size=3077184 2024-09-12T00:36:26.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.836+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~EI9EFZ36DH3J.0 size=1048576 2024-09-12T00:36:26.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.838+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~EI9EFZ36DH3J.1 size=1048576 2024-09-12T00:36:26.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.838+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~EI9EFZ36DH3J.2 size=264177 2024-09-12T00:36:26.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.838+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=EI9EFZ36DH3J tag=CEWPH52MPO9S type=write size=3409905 2024-09-12T00:36:26.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.841+0000 7f030cb87780 1 < suggested update operation key=3W7ANGL92ZF0 tag=OKNZBPWJUZE7 type=del size=2657061 2024-09-12T00:36:26.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.844+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~WJLEP6BIWW2Q.0 size=737332 2024-09-12T00:36:26.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.844+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=WJLEP6BIWW2Q tag=4246HYK613A7 type=write size=1785908 2024-09-12T00:36:26.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.845+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~3Z20OWNKGY33.0 size=729456 2024-09-12T00:36:26.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.848+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=3Z20OWNKGY33 tag=076YL5XICT9T type=write size=1778032 2024-09-12T00:36:26.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.849+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=T3LUFBO04FM1 type=del size=245145 2024-09-12T00:36:26.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.851+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=M63TZ3ROTUOD type=del 2024-09-12T00:36:26.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.853+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=NFP0E6ZG3VH7 type=del size=1865410 2024-09-12T00:36:26.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.854+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~WFR0AWBD6D01.0 size=1048576 2024-09-12T00:36:26.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.855+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~WFR0AWBD6D01.1 size=292511 2024-09-12T00:36:26.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.857+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=WFR0AWBD6D01 tag=OLIWCIFKYT5I type=write size=2389663 2024-09-12T00:36:26.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.858+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=GCWOT7506N56 type=del size=3548384 2024-09-12T00:36:26.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.860+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~BEJDRTB4SG2A.0 size=1048576 2024-09-12T00:36:26.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.862+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~BEJDRTB4SG2A.1 size=1048576 2024-09-12T00:36:26.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.862+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~BEJDRTB4SG2A.2 size=131255 2024-09-12T00:36:26.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.867+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=BEJDRTB4SG2A tag=4X15PMLM1PKS type=write size=3276983 2024-09-12T00:36:26.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.868+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=Y72UL3DT71U5 type=del size=4192882 2024-09-12T00:36:26.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.869+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~JAMK7SXTZE7L.0 size=631633 2024-09-12T00:36:26.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.871+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=JAMK7SXTZE7L tag=C6RNG0UYUPGP type=write size=1680209 2024-09-12T00:36:26.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.874+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=WVQTHXEEPTTI type=del size=4109696 2024-09-12T00:36:26.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.874+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=W8VI4M1SHH9E type=del 2024-09-12T00:36:26.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.876+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=8AHQA1HJF7RG type=del size=4030602 2024-09-12T00:36:26.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.877+0000 7f030cb87780 1 < completed write operation key=IY156CJWG2TB tag=UK68JWP272K9 type=write size=553204 2024-09-12T00:36:26.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.879+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=5ZAS6RY4OWJ6 type=del size=2241598 2024-09-12T00:36:26.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.880+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~18MCKPMPQ6GT.0 size=435009 2024-09-12T00:36:26.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.883+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=18MCKPMPQ6GT tag=7NI4BJF6PGR2 type=write size=1483585 2024-09-12T00:36:26.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.884+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=E0JOB9RPMED4 type=del size=2820886 2024-09-12T00:36:26.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.886+0000 7f030cb87780 1 < completed write operation key=99OWKRGA8ZZN tag=GFF6AMKQYTIN type=write size=262828 2024-09-12T00:36:26.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.889+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~KAKU0V4TKMY6.0 size=1048576 2024-09-12T00:36:26.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.889+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~KAKU0V4TKMY6.1 size=823257 2024-09-12T00:36:26.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.889+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=KAKU0V4TKMY6 tag=1894304WLSZH type=write size=2920409 2024-09-12T00:36:26.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.891+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~N6I88MKR2VFH.0 size=1048576 2024-09-12T00:36:26.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.892+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~N6I88MKR2VFH.1 size=388890 2024-09-12T00:36:26.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.895+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=N6I88MKR2VFH tag=W6312VNOF2B9 type=write size=2486042 2024-09-12T00:36:26.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.896+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=TF6LS18YL13E type=del size=1118870 2024-09-12T00:36:26.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.898+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~59UAAMLWCO44.0 size=639048 2024-09-12T00:36:26.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.901+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=59UAAMLWCO44 tag=CY00UGNCU4T6 type=write size=1687624 2024-09-12T00:36:26.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.901+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=DQXUSR250IXL type=del size=2610328 2024-09-12T00:36:26.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.903+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~XDC5OCQN1227.0 size=1048576 2024-09-12T00:36:26.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.904+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~XDC5OCQN1227.1 size=1048576 2024-09-12T00:36:26.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.906+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~XDC5OCQN1227.2 size=209281 2024-09-12T00:36:26.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.908+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=XDC5OCQN1227 tag=3DJT5SUETGSQ type=write size=3355009 2024-09-12T00:36:26.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.910+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~AB07CNO4FFGH.0 size=1048576 2024-09-12T00:36:26.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.912+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~AB07CNO4FFGH.1 size=410290 2024-09-12T00:36:26.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.912+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=AB07CNO4FFGH tag=2WETFLTWI7UP type=write size=2507442 2024-09-12T00:36:26.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.914+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~NAVFHJTPE98Q.0 size=1048576 2024-09-12T00:36:26.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.915+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~NAVFHJTPE98Q.1 size=1048576 2024-09-12T00:36:26.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.916+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~NAVFHJTPE98Q.2 size=15309 2024-09-12T00:36:26.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.919+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=NAVFHJTPE98Q tag=HAJ9363XODH4 type=write size=3161037 2024-09-12T00:36:26.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.920+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=VRCJINE1CQ1Z type=del size=1298344 2024-09-12T00:36:26.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.921+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=3O1V8WM1T5BG type=del 2024-09-12T00:36:26.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.925+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~MUXDU197QCIE.0 size=1048576 2024-09-12T00:36:26.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.925+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~MUXDU197QCIE.1 size=1048576 2024-09-12T00:36:26.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.926+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~MUXDU197QCIE.2 size=108690 2024-09-12T00:36:26.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.926+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=MUXDU197QCIE tag=RU62AQNF0GM3 type=write size=3254418 2024-09-12T00:36:26.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.928+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~EI9EFZ36DH3J.0 size=1048576 2024-09-12T00:36:26.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.929+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~EI9EFZ36DH3J.1 size=1048576 2024-09-12T00:36:26.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.930+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~EI9EFZ36DH3J.2 size=264177 2024-09-12T00:36:26.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.932+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=EI9EFZ36DH3J tag=CEWPH52MPO9S type=write size=3409905 2024-09-12T00:36:26.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.934+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=SI6CEY4KEW4M type=del size=1475859 2024-09-12T00:36:26.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.935+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~WJLEP6BIWW2Q.0 size=737332 2024-09-12T00:36:26.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.938+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=WJLEP6BIWW2Q tag=4246HYK613A7 type=write size=1785908 2024-09-12T00:36:26.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.939+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=WANXF3O20WMO type=write size=100673 2024-09-12T00:36:26.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.941+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=T3LUFBO04FM1 type=del 2024-09-12T00:36:26.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.943+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~4FH9W8DGBKWB.0 size=1048576 2024-09-12T00:36:26.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.944+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~4FH9W8DGBKWB.1 size=1048576 2024-09-12T00:36:26.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.946+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~4FH9W8DGBKWB.2 size=1000082 2024-09-12T00:36:26.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.946+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=4FH9W8DGBKWB tag=KWUB1EWLOTV4 type=write size=4145810 2024-09-12T00:36:26.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.949+0000 7f030cb87780 1 < suggested remove operation key=OR439FK5L43V tag=NFP0E6ZG3VH7 type=del 2024-09-12T00:36:26.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.950+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=UNS8FQ2IFN1Y type=del size=2995122 2024-09-12T00:36:26.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.952+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=GCWOT7506N56 type=del 2024-09-12T00:36:26.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.954+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~93HMBYI9X39H.0 size=1048576 2024-09-12T00:36:26.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.955+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~93HMBYI9X39H.1 size=597934 2024-09-12T00:36:26.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.955+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=93HMBYI9X39H tag=E7ETHVIGI6UW type=write size=2695086 2024-09-12T00:36:26.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.957+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=Y72UL3DT71U5 type=del 2024-09-12T00:36:26.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.959+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~PXFNLDWULL10.0 size=1048576 2024-09-12T00:36:26.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.960+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~PXFNLDWULL10.1 size=710305 2024-09-12T00:36:26.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.960+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=PXFNLDWULL10 tag=1DJD8NXK9EB5 type=write size=2807457 2024-09-12T00:36:26.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.962+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=WVQTHXEEPTTI type=del 2024-09-12T00:36:26.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.963+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=1Z3E186I792Z type=del size=1612438 2024-09-12T00:36:26.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.965+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=8AHQA1HJF7RG type=del 2024-09-12T00:36:26.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.966+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=1O4L8P8ZHM41 type=write size=33115 2024-09-12T00:36:26.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.968+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=5ZAS6RY4OWJ6 type=del 2024-09-12T00:36:26.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.969+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=YSTCI1AT636U type=write size=583789 2024-09-12T00:36:26.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.970+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=E0JOB9RPMED4 type=del 2024-09-12T00:36:26.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.973+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~60ZVOLPR28XD.0 size=1048576 2024-09-12T00:36:26.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.974+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~60ZVOLPR28XD.1 size=725711 2024-09-12T00:36:26.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.974+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=60ZVOLPR28XD tag=BQ8WTU3LG6W4 type=write size=2822863 2024-09-12T00:36:26.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.975+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~KAKU0V4TKMY6.0 size=1048576 2024-09-12T00:36:26.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.977+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~KAKU0V4TKMY6.1 size=823257 2024-09-12T00:36:26.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.980+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=KAKU0V4TKMY6 tag=1894304WLSZH type=write size=2920409 2024-09-12T00:36:26.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.981+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=8M6YAITRSXSY type=del size=2587595 2024-09-12T00:36:26.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.982+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=TF6LS18YL13E type=del 2024-09-12T00:36:26.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.985+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~GPJVU5Q3S6GE.0 size=356728 2024-09-12T00:36:26.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.985+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=GPJVU5Q3S6GE tag=II0XKJ2Q6UX0 type=write size=1405304 2024-09-12T00:36:26.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.988+0000 7f030cb87780 1 < suggested update operation key=99OWKRGA8ZZN tag=DQXUSR250IXL type=del size=2610328 2024-09-12T00:36:26.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.991+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~PLOFS58JPQS7.0 size=1048576 2024-09-12T00:36:26.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.991+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~PLOFS58JPQS7.1 size=1011940 2024-09-12T00:36:26.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.991+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=PLOFS58JPQS7 tag=5GCRMRVSIULB type=write size=3109092 2024-09-12T00:36:26.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.993+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~AB07CNO4FFGH.0 size=1048576 2024-09-12T00:36:26.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.993+0000 7f030cb87780 1 < canceled part key=_multipart_IY156CJWG2TB.2~AB07CNO4FFGH.1 size=410290 2024-09-12T00:36:26.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.995+0000 7f030cb87780 1 < canceled multipart upload key=IY156CJWG2TB upload=AB07CNO4FFGH tag=2WETFLTWI7UP type=write size=2507442 2024-09-12T00:36:26.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.999+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~J1FZFBPYGL04.0 size=1024559 2024-09-12T00:36:26.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:26.999+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=J1FZFBPYGL04 tag=HHHXVQ02I1A7 type=write size=2073135 2024-09-12T00:36:27.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.001+0000 7f030cb87780 1 < canceled operation key=CY2NS03IIUJJ tag=VRCJINE1CQ1Z type=del size=1298344 2024-09-12T00:36:27.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.001+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=0EO627E3E9NJ type=write size=784719 2024-09-12T00:36:27.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.003+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~MUXDU197QCIE.0 size=1048576 2024-09-12T00:36:27.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.004+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~MUXDU197QCIE.1 size=1048576 2024-09-12T00:36:27.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.005+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~MUXDU197QCIE.2 size=108690 2024-09-12T00:36:27.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.008+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=MUXDU197QCIE tag=RU62AQNF0GM3 type=write size=3254418 2024-09-12T00:36:27.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.009+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=K7MLFB70ZXQO type=del size=2348646 2024-09-12T00:36:27.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.011+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=SI6CEY4KEW4M type=del 2024-09-12T00:36:27.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.013+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~YQ0LZOP6BS7A.0 size=647268 2024-09-12T00:36:27.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.013+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=YQ0LZOP6BS7A tag=1FR92AEGG9I2 type=write size=1695844 2024-09-12T00:36:27.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.016+0000 7f030cb87780 1 < suggested update operation key=ELX0797T1L4C tag=WANXF3O20WMO type=write size=100673 2024-09-12T00:36:27.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.018+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=THPML7GOLMFT type=del size=154737 2024-09-12T00:36:27.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.019+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~4FH9W8DGBKWB.0 size=1048576 2024-09-12T00:36:27.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.020+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~4FH9W8DGBKWB.1 size=1048576 2024-09-12T00:36:27.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.023+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~4FH9W8DGBKWB.2 size=1000082 2024-09-12T00:36:27.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.026+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=4FH9W8DGBKWB tag=KWUB1EWLOTV4 type=write size=4145810 2024-09-12T00:36:27.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.027+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=6JMGKOYNBKT8 type=del size=1411462 2024-09-12T00:36:27.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.028+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=UNS8FQ2IFN1Y type=del 2024-09-12T00:36:27.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.030+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=OFYWCFTWLJ84 type=del size=3018734 2024-09-12T00:36:27.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.031+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~93HMBYI9X39H.0 size=1048576 2024-09-12T00:36:27.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.032+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~93HMBYI9X39H.1 size=597934 2024-09-12T00:36:27.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.035+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=93HMBYI9X39H tag=E7ETHVIGI6UW type=write size=2695086 2024-09-12T00:36:27.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.036+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=FKUMS92OSTMP type=del size=2113930 2024-09-12T00:36:27.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.037+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~PXFNLDWULL10.0 size=1048576 2024-09-12T00:36:27.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.039+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~PXFNLDWULL10.1 size=710305 2024-09-12T00:36:27.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.041+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=PXFNLDWULL10 tag=1DJD8NXK9EB5 type=write size=2807457 2024-09-12T00:36:27.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.043+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=H91N6O3V97TS type=del size=11599 2024-09-12T00:36:27.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.044+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=1Z3E186I792Z type=del 2024-09-12T00:36:27.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.046+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=OPV9UB5SKKES type=del size=346323 2024-09-12T00:36:27.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.048+0000 7f030cb87780 1 < canceled operation key=DLR6A7XOERHW tag=1O4L8P8ZHM41 type=write size=33115 2024-09-12T00:36:27.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.049+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=XFHTZ9YU4NX1 type=del size=1609751 2024-09-12T00:36:27.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.051+0000 7f030cb87780 1 < completed write operation key=IHTFI7W4A6JT tag=YSTCI1AT636U type=write size=583789 2024-09-12T00:36:27.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.053+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~HOVW1XHR6CVK.0 size=1048576 2024-09-12T00:36:27.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.054+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~HOVW1XHR6CVK.1 size=872396 2024-09-12T00:36:27.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.054+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=HOVW1XHR6CVK tag=5DUUEVDTGJMQ type=write size=2969548 2024-09-12T00:36:27.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.055+0000 7f030cb87780 1 < canceled part key=_multipart_39WSAOA6P09M.2~60ZVOLPR28XD.0 size=1048576 2024-09-12T00:36:27.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.056+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~60ZVOLPR28XD.1 size=725711 2024-09-12T00:36:27.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.058+0000 7f030cb87780 1 < canceled multipart upload key=39WSAOA6P09M upload=60ZVOLPR28XD tag=BQ8WTU3LG6W4 type=write size=2822863 2024-09-12T00:36:27.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.060+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=03D5DBWHXJJU type=del size=2680018 2024-09-12T00:36:27.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.063+0000 7f030cb87780 1 < suggested update operation key=39WSAOA6P09M tag=8M6YAITRSXSY type=del size=2587595 2024-09-12T00:36:27.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.064+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=8RP1JLFQB9ZL type=del size=1254969 2024-09-12T00:36:27.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.066+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~GPJVU5Q3S6GE.0 size=356728 2024-09-12T00:36:27.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.069+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=GPJVU5Q3S6GE tag=II0XKJ2Q6UX0 type=write size=1405304 2024-09-12T00:36:27.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.071+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~1J4KMAQCQ23D.0 size=1048576 2024-09-12T00:36:27.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.072+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~1J4KMAQCQ23D.1 size=493514 2024-09-12T00:36:27.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.072+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=1J4KMAQCQ23D tag=H4DHY9J9AXN7 type=write size=2590666 2024-09-12T00:36:27.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.073+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~PLOFS58JPQS7.0 size=1048576 2024-09-12T00:36:27.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.075+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~PLOFS58JPQS7.1 size=1011940 2024-09-12T00:36:27.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.077+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=PLOFS58JPQS7 tag=5GCRMRVSIULB type=write size=3109092 2024-09-12T00:36:27.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.078+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=TTACI4EPLQYL type=del size=358767 2024-09-12T00:36:27.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.080+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~J1FZFBPYGL04.0 size=1024559 2024-09-12T00:36:27.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.082+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=J1FZFBPYGL04 tag=HHHXVQ02I1A7 type=write size=2073135 2024-09-12T00:36:27.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.084+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=I74V815QR9XU type=del size=2181909 2024-09-12T00:36:27.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.085+0000 7f030cb87780 1 < canceled operation key=6WHZRKLM3OLP tag=0EO627E3E9NJ type=write size=784719 2024-09-12T00:36:27.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.089+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~TUTT1INQBU1B.0 size=1048576 2024-09-12T00:36:27.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.090+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~TUTT1INQBU1B.1 size=764394 2024-09-12T00:36:27.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.090+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=TUTT1INQBU1B tag=YRW0BMVWHPO0 type=write size=2861546 2024-09-12T00:36:27.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.092+0000 7f030cb87780 1 < suggested update operation key=N3KD1UVUVM95 tag=K7MLFB70ZXQO type=del size=2348646 2024-09-12T00:36:27.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.094+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~E9SD5EGOZN63.0 size=649780 2024-09-12T00:36:27.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.094+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=E9SD5EGOZN63 tag=NRUXL52U5DXS type=write size=1698356 2024-09-12T00:36:27.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.096+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~YQ0LZOP6BS7A.0 size=647268 2024-09-12T00:36:27.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.098+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=YQ0LZOP6BS7A tag=1FR92AEGG9I2 type=write size=1695844 2024-09-12T00:36:27.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.100+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=736RJQ1D6QMX type=del size=2784941 2024-09-12T00:36:27.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.101+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=THPML7GOLMFT type=del 2024-09-12T00:36:27.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.103+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=ZUICLGH0LRJX type=del size=3747009 2024-09-12T00:36:27.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.105+0000 7f030cb87780 -1 < failed to complete operation key=39WSAOA6P09M tag=6JMGKOYNBKT8 type=del size=1411462: (22) Invalid argument 2024-09-12T00:36:27.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.106+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=T2C61S3XORV9 type=del size=3379199 2024-09-12T00:36:27.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.107+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=OFYWCFTWLJ84 type=del 2024-09-12T00:36:27.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.109+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=FCLUSYCNR70T type=write size=132299 2024-09-12T00:36:27.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.111+0000 7f030cb87780 1 < canceled operation key=CY2NS03IIUJJ tag=FKUMS92OSTMP type=del size=2113930 2024-09-12T00:36:27.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.114+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~BOF4Y2RP5SR6.0 size=1048576 2024-09-12T00:36:27.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.115+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~BOF4Y2RP5SR6.1 size=1048576 2024-09-12T00:36:27.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.116+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~BOF4Y2RP5SR6.2 size=719115 2024-09-12T00:36:27.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.116+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=BOF4Y2RP5SR6 tag=C1YXNUEAOFHG type=write size=3864843 2024-09-12T00:36:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.118+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=H91N6O3V97TS type=del 2024-09-12T00:36:27.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.120+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~HRM1R32XQ9IG.0 size=1048576 2024-09-12T00:36:27.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.121+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~HRM1R32XQ9IG.1 size=756591 2024-09-12T00:36:27.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.121+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=HRM1R32XQ9IG tag=WTV2PBT1I4X4 type=write size=2853743 2024-09-12T00:36:27.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.123+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=OPV9UB5SKKES type=del 2024-09-12T00:36:27.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.125+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~TXDHDRH2WSQM.0 size=1048576 2024-09-12T00:36:27.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.126+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~TXDHDRH2WSQM.1 size=1048576 2024-09-12T00:36:27.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.127+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~TXDHDRH2WSQM.2 size=154914 2024-09-12T00:36:27.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.127+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=TXDHDRH2WSQM tag=F21GW4D0UBTX type=write size=3300642 2024-09-12T00:36:27.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.130+0000 7f030cb87780 1 < suggested update operation key=POC8YA58U55N tag=XFHTZ9YU4NX1 type=del size=1609751 2024-09-12T00:36:27.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.131+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=70L286C0JEUE type=del size=3565300 2024-09-12T00:36:27.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.133+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~HOVW1XHR6CVK.0 size=1048576 2024-09-12T00:36:27.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.134+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~HOVW1XHR6CVK.1 size=872396 2024-09-12T00:36:27.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.137+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=HOVW1XHR6CVK tag=5DUUEVDTGJMQ type=write size=2969548 2024-09-12T00:36:27.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.140+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~OVJNFPPK2IGF.0 size=1048576 2024-09-12T00:36:27.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.141+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~OVJNFPPK2IGF.1 size=1048576 2024-09-12T00:36:27.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.142+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~OVJNFPPK2IGF.2 size=35014 2024-09-12T00:36:27.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.142+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=OVJNFPPK2IGF tag=EW0USU1I9IFZ type=write size=3180742 2024-09-12T00:36:27.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.143+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=03D5DBWHXJJU type=del 2024-09-12T00:36:27.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.146+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~QO5UCRX0NIRB.0 size=1048576 2024-09-12T00:36:27.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.147+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~QO5UCRX0NIRB.1 size=548080 2024-09-12T00:36:27.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.147+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=QO5UCRX0NIRB tag=5WVJC8S3CHQU type=write size=2645232 2024-09-12T00:36:27.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.148+0000 7f030cb87780 1 < canceled operation key=DLR6A7XOERHW tag=8RP1JLFQB9ZL type=del size=1254969 2024-09-12T00:36:27.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.151+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~5COZSBYGLHAQ.0 size=464656 2024-09-12T00:36:27.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.151+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=5COZSBYGLHAQ tag=RPQ3KUJEKXJN type=write size=1513232 2024-09-12T00:36:27.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.152+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~1J4KMAQCQ23D.0 size=1048576 2024-09-12T00:36:27.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.152+0000 7f030cb87780 1 < canceled part key=_multipart_OR439FK5L43V.2~1J4KMAQCQ23D.1 size=493514 2024-09-12T00:36:27.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.154+0000 7f030cb87780 1 < canceled multipart upload key=OR439FK5L43V upload=1J4KMAQCQ23D tag=H4DHY9J9AXN7 type=write size=2590666 2024-09-12T00:36:27.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.156+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=YPEZHFT1KWMB type=write size=455690 2024-09-12T00:36:27.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.157+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=TTACI4EPLQYL type=del 2024-09-12T00:36:27.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.158+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=GV81DHB0QKYT type=del size=991875 2024-09-12T00:36:27.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.160+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=I74V815QR9XU type=del 2024-09-12T00:36:27.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.161+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=PKCLM72EY5IY type=del size=2674611 2024-09-12T00:36:27.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.163+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~TUTT1INQBU1B.0 size=1048576 2024-09-12T00:36:27.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.164+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~TUTT1INQBU1B.1 size=764394 2024-09-12T00:36:27.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.167+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=TUTT1INQBU1B tag=YRW0BMVWHPO0 type=write size=2861546 2024-09-12T00:36:27.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.169+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~EZKK9KEB1JDE.0 size=1048576 2024-09-12T00:36:27.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.170+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~EZKK9KEB1JDE.1 size=1048576 2024-09-12T00:36:27.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.172+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~EZKK9KEB1JDE.2 size=603803 2024-09-12T00:36:27.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.172+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=EZKK9KEB1JDE tag=794HQ0IVCNS4 type=write size=3749531 2024-09-12T00:36:27.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.174+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~E9SD5EGOZN63.0 size=649780 2024-09-12T00:36:27.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.176+0000 7f030cb87780 1 < completed multipart upload key=IY156CJWG2TB upload=E9SD5EGOZN63 tag=NRUXL52U5DXS type=write size=1698356 2024-09-12T00:36:27.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.177+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=AB3RKS2PVFGC type=del size=713071 2024-09-12T00:36:27.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.179+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=736RJQ1D6QMX type=del 2024-09-12T00:36:27.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.181+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~04AKIOPJZ4UW.0 size=1048576 2024-09-12T00:36:27.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.183+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~04AKIOPJZ4UW.1 size=75991 2024-09-12T00:36:27.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.183+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=04AKIOPJZ4UW tag=K9YL1Z7UV4SQ type=write size=2173143 2024-09-12T00:36:27.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.184+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=ZUICLGH0LRJX type=del 2024-09-12T00:36:27.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.187+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=YGV8UTD1QA01 type=del size=1334397 2024-09-12T00:36:27.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.187+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=T2C61S3XORV9 type=del 2024-09-12T00:36:27.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.190+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~ELTW4J3YDT75.0 size=1048576 2024-09-12T00:36:27.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.191+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~ELTW4J3YDT75.1 size=1048576 2024-09-12T00:36:27.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.192+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~ELTW4J3YDT75.2 size=914518 2024-09-12T00:36:27.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.192+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=ELTW4J3YDT75 tag=A2TZZAOOB6NA type=write size=4060246 2024-09-12T00:36:27.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.193+0000 7f030cb87780 1 < canceled operation key=IY156CJWG2TB tag=FCLUSYCNR70T type=write size=132299 2024-09-12T00:36:27.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.195+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=ROD0VKTV7ZET type=write size=896105 2024-09-12T00:36:27.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.196+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~BOF4Y2RP5SR6.0 size=1048576 2024-09-12T00:36:27.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.198+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~BOF4Y2RP5SR6.1 size=1048576 2024-09-12T00:36:27.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.198+0000 7f030cb87780 1 < canceled part key=_multipart_JPEIGLC162K3.2~BOF4Y2RP5SR6.2 size=719115 2024-09-12T00:36:27.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.200+0000 7f030cb87780 1 < canceled multipart upload key=JPEIGLC162K3 upload=BOF4Y2RP5SR6 tag=C1YXNUEAOFHG type=write size=3864843 2024-09-12T00:36:27.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.202+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=0Q4AGEXCDK3U type=write size=282445 2024-09-12T00:36:27.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.203+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~HRM1R32XQ9IG.0 size=1048576 2024-09-12T00:36:27.204 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.204+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~HRM1R32XQ9IG.1 size=756591 2024-09-12T00:36:27.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.209+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=HRM1R32XQ9IG tag=WTV2PBT1I4X4 type=write size=2853743 2024-09-12T00:36:27.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.210+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~442ICGRTXTDF.0 size=1048576 2024-09-12T00:36:27.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.212+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~442ICGRTXTDF.1 size=832305 2024-09-12T00:36:27.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.212+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=442ICGRTXTDF tag=C1039FZZ75YR type=write size=2929457 2024-09-12T00:36:27.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.213+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~TXDHDRH2WSQM.0 size=1048576 2024-09-12T00:36:27.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.214+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~TXDHDRH2WSQM.1 size=1048576 2024-09-12T00:36:27.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.215+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~TXDHDRH2WSQM.2 size=154914 2024-09-12T00:36:27.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.218+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=TXDHDRH2WSQM tag=F21GW4D0UBTX type=write size=3300642 2024-09-12T00:36:27.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.219+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=EU0792XUSIKE type=del size=2684137 2024-09-12T00:36:27.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.221+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=70L286C0JEUE type=del 2024-09-12T00:36:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.222+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=CRPU0S22FEBZ type=del size=2302180 2024-09-12T00:36:27.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.222+0000 7f030cb87780 1 < canceled part key=_multipart_ATTMOL2TGUN7.2~OVJNFPPK2IGF.0 size=1048576 2024-09-12T00:36:27.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.224+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~OVJNFPPK2IGF.1 size=1048576 2024-09-12T00:36:27.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.225+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~OVJNFPPK2IGF.2 size=35014 2024-09-12T00:36:27.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.227+0000 7f030cb87780 1 < canceled multipart upload key=ATTMOL2TGUN7 upload=OVJNFPPK2IGF tag=EW0USU1I9IFZ type=write size=3180742 2024-09-12T00:36:27.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.228+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=UY2TBIGG83UE type=del size=793909 2024-09-12T00:36:27.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.228+0000 7f030cb87780 1 < canceled part key=_multipart_CY2NS03IIUJJ.2~QO5UCRX0NIRB.0 size=1048576 2024-09-12T00:36:27.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.230+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~QO5UCRX0NIRB.1 size=548080 2024-09-12T00:36:27.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.232+0000 7f030cb87780 1 < canceled multipart upload key=CY2NS03IIUJJ upload=QO5UCRX0NIRB tag=5WVJC8S3CHQU type=write size=2645232 2024-09-12T00:36:27.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.233+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=WQE7VZB1VF43 type=del size=704374 2024-09-12T00:36:27.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.234+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~5COZSBYGLHAQ.0 size=464656 2024-09-12T00:36:27.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.237+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=5COZSBYGLHAQ tag=RPQ3KUJEKXJN type=write size=1513232 2024-09-12T00:36:27.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.240+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~N78TT68L5XVI.0 size=1048576 2024-09-12T00:36:27.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.242+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~N78TT68L5XVI.1 size=843146 2024-09-12T00:36:27.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.242+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=N78TT68L5XVI tag=1LI4S1CT9CO0 type=write size=2940298 2024-09-12T00:36:27.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.243+0000 7f030cb87780 1 < canceled operation key=800OHA7UURC4 tag=YPEZHFT1KWMB type=write size=455690 2024-09-12T00:36:27.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.244+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=CFFOQX3V6N4P type=del size=2305536 2024-09-12T00:36:27.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.245+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=GV81DHB0QKYT type=del 2024-09-12T00:36:27.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.247+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=10DC9YCL006O type=del size=3291875 2024-09-12T00:36:27.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.250+0000 7f030cb87780 1 < suggested update operation key=U5CWO1EN8BFI tag=PKCLM72EY5IY type=del size=2674611 2024-09-12T00:36:27.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.251+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=832089KE2VLY type=del size=3700190 2024-09-12T00:36:27.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.252+0000 7f030cb87780 1 < canceled part key=_multipart_U5CWO1EN8BFI.2~EZKK9KEB1JDE.0 size=1048576 2024-09-12T00:36:27.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.253+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~EZKK9KEB1JDE.1 size=1048576 2024-09-12T00:36:27.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.254+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~EZKK9KEB1JDE.2 size=603803 2024-09-12T00:36:27.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.257+0000 7f030cb87780 1 < canceled multipart upload key=U5CWO1EN8BFI upload=EZKK9KEB1JDE tag=794HQ0IVCNS4 type=write size=3749531 2024-09-12T00:36:27.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.257+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=LSR12OEWW3TX type=write size=218624 2024-09-12T00:36:27.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.259+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=AB3RKS2PVFGC type=del 2024-09-12T00:36:27.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.262+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~O4NHMT4JO4C6.0 size=1048576 2024-09-12T00:36:27.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.264+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~O4NHMT4JO4C6.1 size=643601 2024-09-12T00:36:27.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.264+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=O4NHMT4JO4C6 tag=QBNT2BD8WFH0 type=write size=2740753 2024-09-12T00:36:27.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.264+0000 7f030cb87780 1 < canceled part key=_multipart_92GDVW0Q8VKQ.2~04AKIOPJZ4UW.0 size=1048576 2024-09-12T00:36:27.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.264+0000 7f030cb87780 1 < canceled part key=_multipart_92GDVW0Q8VKQ.2~04AKIOPJZ4UW.1 size=75991 2024-09-12T00:36:27.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.266+0000 7f030cb87780 1 < canceled multipart upload key=92GDVW0Q8VKQ upload=04AKIOPJZ4UW tag=K9YL1Z7UV4SQ type=write size=2173143 2024-09-12T00:36:27.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.267+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=LQQLRAKLFUNW type=del size=3394140 2024-09-12T00:36:27.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.270+0000 7f030cb87780 1 < canceled operation key=CUDFTXFBC862 tag=YGV8UTD1QA01 type=del size=1334397 2024-09-12T00:36:27.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.271+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=HG5DPS0KOWA0 type=del size=2653415 2024-09-12T00:36:27.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.274+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~ELTW4J3YDT75.0 size=1048576 2024-09-12T00:36:27.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.276+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~ELTW4J3YDT75.1 size=1048576 2024-09-12T00:36:27.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.277+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~ELTW4J3YDT75.2 size=914518 2024-09-12T00:36:27.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.279+0000 7f030cb87780 1 < completed multipart upload key=OR439FK5L43V upload=ELTW4J3YDT75 tag=A2TZZAOOB6NA type=write size=4060246 2024-09-12T00:36:27.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.281+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=BTT0Y2A18KVA type=del size=2556752 2024-09-12T00:36:27.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.283+0000 7f030cb87780 1 < suggested update operation key=UFYMVGL264T8 tag=ROD0VKTV7ZET type=write size=896105 2024-09-12T00:36:27.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.286+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~XSFV6PJ46QA0.0 size=1048576 2024-09-12T00:36:27.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.287+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~XSFV6PJ46QA0.1 size=1048576 2024-09-12T00:36:27.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.288+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~XSFV6PJ46QA0.2 size=384020 2024-09-12T00:36:27.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.288+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=XSFV6PJ46QA0 tag=83SWDP4R5YO9 type=write size=3529748 2024-09-12T00:36:27.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.290+0000 7f030cb87780 1 < completed write operation key=JPEIGLC162K3 tag=0Q4AGEXCDK3U type=write size=282445 2024-09-12T00:36:27.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.292+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=IHJ0SOWF10GO type=del size=1826372 2024-09-12T00:36:27.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.294+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~442ICGRTXTDF.0 size=1048576 2024-09-12T00:36:27.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.294+0000 7f030cb87780 1 < canceled part key=_multipart_JRPD5AAK84ZD.2~442ICGRTXTDF.1 size=832305 2024-09-12T00:36:27.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.296+0000 7f030cb87780 1 < canceled multipart upload key=JRPD5AAK84ZD upload=442ICGRTXTDF tag=C1039FZZ75YR type=write size=2929457 2024-09-12T00:36:27.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.299+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~2EG2AUIURDYC.0 size=1048576 2024-09-12T00:36:27.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.300+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~2EG2AUIURDYC.1 size=1048576 2024-09-12T00:36:27.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.302+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~2EG2AUIURDYC.2 size=530071 2024-09-12T00:36:27.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.302+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=2EG2AUIURDYC tag=MWDUUVF7EF1A type=write size=3675799 2024-09-12T00:36:27.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.303+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=EU0792XUSIKE type=del 2024-09-12T00:36:27.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.305+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=MXWMPEQKCBS4 type=del size=2326890 2024-09-12T00:36:27.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.306+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=CRPU0S22FEBZ type=del 2024-09-12T00:36:27.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.307+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~6M9GO777MCYY.0 size=1048576 2024-09-12T00:36:27.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.309+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~6M9GO777MCYY.1 size=555623 2024-09-12T00:36:27.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.309+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=6M9GO777MCYY tag=0OUEK8NEEFEK type=write size=2652775 2024-09-12T00:36:27.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.312+0000 7f030cb87780 1 < suggested update operation key=IY156CJWG2TB tag=UY2TBIGG83UE type=del size=793909 2024-09-12T00:36:27.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.314+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~33J4B7RQ5BUQ.0 size=1048576 2024-09-12T00:36:27.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.315+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~33J4B7RQ5BUQ.1 size=1048576 2024-09-12T00:36:27.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.316+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~33J4B7RQ5BUQ.2 size=47467 2024-09-12T00:36:27.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.316+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=33J4B7RQ5BUQ tag=HCSPFRCMEX5T type=write size=3193195 2024-09-12T00:36:27.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.319+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=WQE7VZB1VF43 type=del 2024-09-12T00:36:27.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.319+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=H4V3TQHSJM44 type=del size=1772094 2024-09-12T00:36:27.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.319+0000 7f030cb87780 1 < canceled part key=_multipart_39WSAOA6P09M.2~N78TT68L5XVI.0 size=1048576 2024-09-12T00:36:27.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.320+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~N78TT68L5XVI.1 size=843146 2024-09-12T00:36:27.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.323+0000 7f030cb87780 1 < canceled multipart upload key=39WSAOA6P09M upload=N78TT68L5XVI tag=1LI4S1CT9CO0 type=write size=2940298 2024-09-12T00:36:27.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.325+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~9DFH9N2Q4LXY.0 size=1048576 2024-09-12T00:36:27.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.326+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~9DFH9N2Q4LXY.1 size=1048576 2024-09-12T00:36:27.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.328+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~9DFH9N2Q4LXY.2 size=790947 2024-09-12T00:36:27.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.328+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=9DFH9N2Q4LXY tag=YS1X02RU46JU type=write size=3936675 2024-09-12T00:36:27.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.329+0000 7f030cb87780 1 < completed delete operation key=1VOJGMWNKS0A tag=CFFOQX3V6N4P type=del 2024-09-12T00:36:27.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.331+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~LAKFOZCI3ZFY.0 size=1048576 2024-09-12T00:36:27.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.332+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~LAKFOZCI3ZFY.1 size=912233 2024-09-12T00:36:27.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.332+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=LAKFOZCI3ZFY tag=S2Z593I0S2HA type=write size=3009385 2024-09-12T00:36:27.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.334+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=10DC9YCL006O type=del 2024-09-12T00:36:27.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.335+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=EDMGT31M63WC type=del size=1446133 2024-09-12T00:36:27.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.337+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=832089KE2VLY type=del 2024-09-12T00:36:27.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.338+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=PRSBU5SAVAAY type=write size=192114 2024-09-12T00:36:27.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.339+0000 7f030cb87780 1 < completed write operation key=ELX0797T1L4C tag=LSR12OEWW3TX type=write size=218624 2024-09-12T00:36:27.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.342+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=SVE9DH8YLEYU type=del size=1613341 2024-09-12T00:36:27.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.342+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~O4NHMT4JO4C6.0 size=1048576 2024-09-12T00:36:27.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.344+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~O4NHMT4JO4C6.1 size=643601 2024-09-12T00:36:27.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.346+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=O4NHMT4JO4C6 tag=QBNT2BD8WFH0 type=write size=2740753 2024-09-12T00:36:27.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.348+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~XHPPKGMT6Q65.0 size=935945 2024-09-12T00:36:27.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.348+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=XHPPKGMT6Q65 tag=OV49OZUHVCRD type=write size=1984521 2024-09-12T00:36:27.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.350+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=LQQLRAKLFUNW type=del 2024-09-12T00:36:27.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.351+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=MR759UWPEE1Q type=write size=397177 2024-09-12T00:36:27.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.353+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=HG5DPS0KOWA0 type=del 2024-09-12T00:36:27.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.354+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=T0LJKU2VWL4T type=del size=3593989 2024-09-12T00:36:27.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.355+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=BTT0Y2A18KVA type=del 2024-09-12T00:36:27.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.357+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=FY4B0IQJHHIE type=del size=2153604 2024-09-12T00:36:27.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.360+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~XSFV6PJ46QA0.0 size=1048576 2024-09-12T00:36:27.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.360+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~XSFV6PJ46QA0.1 size=1048576 2024-09-12T00:36:27.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.362+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~XSFV6PJ46QA0.2 size=384020 2024-09-12T00:36:27.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.364+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=XSFV6PJ46QA0 tag=83SWDP4R5YO9 type=write size=3529748 2024-09-12T00:36:27.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.365+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=3HIZ7UGD0407 type=del size=652418 2024-09-12T00:36:27.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.368+0000 7f030cb87780 1 < suggested update operation key=POC8YA58U55N tag=IHJ0SOWF10GO type=del size=1826372 2024-09-12T00:36:27.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.369+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=TVUX5KFWB5P3 type=del size=2176405 2024-09-12T00:36:27.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.369+0000 7f030cb87780 1 < canceled part key=_multipart_JRPD5AAK84ZD.2~2EG2AUIURDYC.0 size=1048576 2024-09-12T00:36:27.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.370+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~2EG2AUIURDYC.1 size=1048576 2024-09-12T00:36:27.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.372+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~2EG2AUIURDYC.2 size=530071 2024-09-12T00:36:27.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.374+0000 7f030cb87780 1 < canceled multipart upload key=JRPD5AAK84ZD upload=2EG2AUIURDYC tag=MWDUUVF7EF1A type=write size=3675799 2024-09-12T00:36:27.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.377+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~WC200EP68E00.0 size=1048576 2024-09-12T00:36:27.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.378+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~WC200EP68E00.1 size=1048576 2024-09-12T00:36:27.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.380+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~WC200EP68E00.2 size=982728 2024-09-12T00:36:27.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.380+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=WC200EP68E00 tag=3ZF8KV2XWZJX type=write size=4128456 2024-09-12T00:36:27.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.381+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=MXWMPEQKCBS4 type=del 2024-09-12T00:36:27.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.385+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~E3NXW3U19M5J.0 size=1048576 2024-09-12T00:36:27.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.385+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~E3NXW3U19M5J.1 size=455913 2024-09-12T00:36:27.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.385+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=E3NXW3U19M5J tag=I6JVSPFEZMCM type=write size=2553065 2024-09-12T00:36:27.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.387+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~6M9GO777MCYY.0 size=1048576 2024-09-12T00:36:27.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.388+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~6M9GO777MCYY.1 size=555623 2024-09-12T00:36:27.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.390+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=6M9GO777MCYY tag=0OUEK8NEEFEK type=write size=2652775 2024-09-12T00:36:27.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.392+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=750EQU8LX8D7 type=del size=1809545 2024-09-12T00:36:27.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.394+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~33J4B7RQ5BUQ.0 size=1048576 2024-09-12T00:36:27.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.396+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~33J4B7RQ5BUQ.1 size=1048576 2024-09-12T00:36:27.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.397+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~33J4B7RQ5BUQ.2 size=47467 2024-09-12T00:36:27.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.399+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=33J4B7RQ5BUQ tag=HCSPFRCMEX5T type=write size=3193195 2024-09-12T00:36:27.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.401+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=V2330XF1G2J2 type=del size=3342773 2024-09-12T00:36:27.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.402+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=H4V3TQHSJM44 type=del 2024-09-12T00:36:27.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.403+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=M1DV17K7VXLJ type=del size=1410387 2024-09-12T00:36:27.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.406+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~9DFH9N2Q4LXY.0 size=1048576 2024-09-12T00:36:27.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.407+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~9DFH9N2Q4LXY.1 size=1048576 2024-09-12T00:36:27.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.408+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~9DFH9N2Q4LXY.2 size=790947 2024-09-12T00:36:27.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.410+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=9DFH9N2Q4LXY tag=YS1X02RU46JU type=write size=3936675 2024-09-12T00:36:27.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.412+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=ASTPAU3LQX6T type=del size=3802078 2024-09-12T00:36:27.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.413+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~LAKFOZCI3ZFY.0 size=1048576 2024-09-12T00:36:27.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.414+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~LAKFOZCI3ZFY.1 size=912233 2024-09-12T00:36:27.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.417+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=LAKFOZCI3ZFY tag=S2Z593I0S2HA type=write size=3009385 2024-09-12T00:36:27.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.419+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=W0C2Y0DJX0XS type=del size=4112220 2024-09-12T00:36:27.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.420+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=EDMGT31M63WC type=del 2024-09-12T00:36:27.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.421+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=14LGF0RQWKKD type=write size=525338 2024-09-12T00:36:27.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.424+0000 7f030cb87780 1 < completed write operation key=1PLGUJCB6J0V tag=PRSBU5SAVAAY type=write size=192114 2024-09-12T00:36:27.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.425+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=2UFO8DURF6K9 type=del size=2449102 2024-09-12T00:36:27.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.426+0000 7f030cb87780 1 < completed delete operation key=IY156CJWG2TB tag=SVE9DH8YLEYU type=del 2024-09-12T00:36:27.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.427+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=N07HD9XU7JEZ type=del size=1999689 2024-09-12T00:36:27.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.429+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~XHPPKGMT6Q65.0 size=935945 2024-09-12T00:36:27.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.431+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=XHPPKGMT6Q65 tag=OV49OZUHVCRD type=write size=1984521 2024-09-12T00:36:27.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.432+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=E9PU9D3F2O9W type=del size=579082 2024-09-12T00:36:27.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.434+0000 7f030cb87780 1 < completed write operation key=9MCRD2G3MZIT tag=MR759UWPEE1Q type=write size=397177 2024-09-12T00:36:27.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.435+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=V1YOWK0FRKY2 type=del size=1255888 2024-09-12T00:36:27.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.436+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=T0LJKU2VWL4T type=del 2024-09-12T00:36:27.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.437+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=PWUK25V1UYVR type=del size=3742233 2024-09-12T00:36:27.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.440+0000 7f030cb87780 1 < suggested remove operation key=1PLGUJCB6J0V tag=FY4B0IQJHHIE type=del 2024-09-12T00:36:27.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.443+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~9MY1LF2KS8FL.0 size=1048576 2024-09-12T00:36:27.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.444+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~9MY1LF2KS8FL.1 size=300926 2024-09-12T00:36:27.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.444+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=9MY1LF2KS8FL tag=9A6G6MN8US36 type=write size=2398078 2024-09-12T00:36:27.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.446+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=3HIZ7UGD0407 type=del 2024-09-12T00:36:27.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.447+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~YGZZF4URBU9D.0 size=1048576 2024-09-12T00:36:27.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.449+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~YGZZF4URBU9D.1 size=1048576 2024-09-12T00:36:27.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.450+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~YGZZF4URBU9D.2 size=642066 2024-09-12T00:36:27.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.450+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=YGZZF4URBU9D tag=XHV9DZ4OG8TK type=write size=3787794 2024-09-12T00:36:27.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.451+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=TVUX5KFWB5P3 type=del 2024-09-12T00:36:27.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.452+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=7SKVAOG1W83A type=del size=291886 2024-09-12T00:36:27.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.454+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~WC200EP68E00.0 size=1048576 2024-09-12T00:36:27.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.455+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~WC200EP68E00.1 size=1048576 2024-09-12T00:36:27.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.456+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~WC200EP68E00.2 size=982728 2024-09-12T00:36:27.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.460+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=WC200EP68E00 tag=3ZF8KV2XWZJX type=write size=4128456 2024-09-12T00:36:27.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.462+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~OO37GNZRG3L4.0 size=1048576 2024-09-12T00:36:27.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.463+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~OO37GNZRG3L4.1 size=884516 2024-09-12T00:36:27.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.463+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=OO37GNZRG3L4 tag=G057SDWHI0N2 type=write size=2981668 2024-09-12T00:36:27.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.465+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~E3NXW3U19M5J.0 size=1048576 2024-09-12T00:36:27.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.466+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~E3NXW3U19M5J.1 size=455913 2024-09-12T00:36:27.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.468+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=E3NXW3U19M5J tag=I6JVSPFEZMCM type=write size=2553065 2024-09-12T00:36:27.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.469+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=5436VATB2NU6 type=del size=2313490 2024-09-12T00:36:27.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.472+0000 7f030cb87780 1 < suggested remove operation key=CUDFTXFBC862 tag=750EQU8LX8D7 type=del 2024-09-12T00:36:27.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.473+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=5X7PK1L43YKE type=del size=612192 2024-09-12T00:36:27.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.475+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=V2330XF1G2J2 type=del 2024-09-12T00:36:27.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.478+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~D138L0X780GD.0 size=1048576 2024-09-12T00:36:27.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.478+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~D138L0X780GD.1 size=913488 2024-09-12T00:36:27.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.478+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=D138L0X780GD tag=DKIR4V3ENWE1 type=write size=3010640 2024-09-12T00:36:27.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.480+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=M1DV17K7VXLJ type=del 2024-09-12T00:36:27.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.483+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~2229Y8BXNBE3.0 size=332554 2024-09-12T00:36:27.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.483+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=2229Y8BXNBE3 tag=2TQFQY3FWN9L type=write size=1381130 2024-09-12T00:36:27.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.484+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=ASTPAU3LQX6T type=del 2024-09-12T00:36:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.487+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~AL4ZYWV1PZFA.0 size=683144 2024-09-12T00:36:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.487+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=AL4ZYWV1PZFA tag=PLIICZ0YSKSO type=write size=1731720 2024-09-12T00:36:27.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.488+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=W0C2Y0DJX0XS type=del 2024-09-12T00:36:27.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.491+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~1JX5525ALV6Q.0 size=1016566 2024-09-12T00:36:27.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.491+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=1JX5525ALV6Q tag=G8EDHO447M1C type=write size=2065142 2024-09-12T00:36:27.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.493+0000 7f030cb87780 1 < canceled operation key=U5CWO1EN8BFI tag=14LGF0RQWKKD type=write size=525338 2024-09-12T00:36:27.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.494+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=AYHZVP7GGBTS type=del size=3922775 2024-09-12T00:36:27.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.496+0000 7f030cb87780 1 < suggested remove operation key=POC8YA58U55N tag=2UFO8DURF6K9 type=del 2024-09-12T00:36:27.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.499+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~5L9N68RC10YL.0 size=348228 2024-09-12T00:36:27.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.499+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=5L9N68RC10YL tag=LOCYEZ64QQKE type=write size=1396804 2024-09-12T00:36:27.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.502+0000 7f030cb87780 1 < suggested remove operation key=IHTFI7W4A6JT tag=N07HD9XU7JEZ type=del 2024-09-12T00:36:27.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.504+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=35H8ED7FEULT type=write size=494069 2024-09-12T00:36:27.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.505+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=E9PU9D3F2O9W type=del 2024-09-12T00:36:27.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.507+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~LF0H9N9V5YDS.0 size=1048576 2024-09-12T00:36:27.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.508+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~LF0H9N9V5YDS.1 size=867865 2024-09-12T00:36:27.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.508+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=LF0H9N9V5YDS tag=0FHBS5X8TEBD type=write size=2965017 2024-09-12T00:36:27.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.510+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=V1YOWK0FRKY2 type=del 2024-09-12T00:36:27.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.512+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~193E79L67IA4.0 size=1048576 2024-09-12T00:36:27.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.514+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~193E79L67IA4.1 size=1048576 2024-09-12T00:36:27.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.515+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~193E79L67IA4.2 size=287372 2024-09-12T00:36:27.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.515+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=193E79L67IA4 tag=1MCOI3259UJX type=write size=3433100 2024-09-12T00:36:27.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.516+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=PWUK25V1UYVR type=del 2024-09-12T00:36:27.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.518+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=AZFJJSY5J2TH type=del size=4144522 2024-09-12T00:36:27.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.518+0000 7f030cb87780 1 < canceled part key=_multipart_9MCRD2G3MZIT.2~9MY1LF2KS8FL.0 size=1048576 2024-09-12T00:36:27.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.519+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~9MY1LF2KS8FL.1 size=300926 2024-09-12T00:36:27.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.521+0000 7f030cb87780 1 < canceled multipart upload key=9MCRD2G3MZIT upload=9MY1LF2KS8FL tag=9A6G6MN8US36 type=write size=2398078 2024-09-12T00:36:27.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.524+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~902TB75WJ2LN.0 size=149280 2024-09-12T00:36:27.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.524+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=902TB75WJ2LN tag=KPLZAEEREMDG type=write size=1197856 2024-09-12T00:36:27.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.526+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~YGZZF4URBU9D.0 size=1048576 2024-09-12T00:36:27.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.527+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~YGZZF4URBU9D.1 size=1048576 2024-09-12T00:36:27.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.528+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~YGZZF4URBU9D.2 size=642066 2024-09-12T00:36:27.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.530+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=YGZZF4URBU9D tag=XHV9DZ4OG8TK type=write size=3787794 2024-09-12T00:36:27.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.531+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=BSZIP05SAQR9 type=del size=2487398 2024-09-12T00:36:27.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.533+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=7SKVAOG1W83A type=del 2024-09-12T00:36:27.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.534+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=PFD7XM9031UP type=del size=503725 2024-09-12T00:36:27.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.535+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~OO37GNZRG3L4.0 size=1048576 2024-09-12T00:36:27.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.538+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~OO37GNZRG3L4.1 size=884516 2024-09-12T00:36:27.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.542+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=OO37GNZRG3L4 tag=G057SDWHI0N2 type=write size=2981668 2024-09-12T00:36:27.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.543+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=NPETMN5QD0Q8 type=del size=1731038 2024-09-12T00:36:27.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.544+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=5436VATB2NU6 type=del 2024-09-12T00:36:27.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.547+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~1T35MXLTHEEB.0 size=574505 2024-09-12T00:36:27.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.547+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=1T35MXLTHEEB tag=MZKHUO3L29DS type=write size=1623081 2024-09-12T00:36:27.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.549+0000 7f030cb87780 1 < suggested update operation key=U5CWO1EN8BFI tag=5X7PK1L43YKE type=del size=612192 2024-09-12T00:36:27.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.552+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~B8189K0YP15P.0 size=53397 2024-09-12T00:36:27.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.552+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=B8189K0YP15P tag=3W3TOMY1SVQE type=write size=1101973 2024-09-12T00:36:27.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.552+0000 7f030cb87780 1 < canceled part key=_multipart_CUDFTXFBC862.2~D138L0X780GD.0 size=1048576 2024-09-12T00:36:27.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.553+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~D138L0X780GD.1 size=913488 2024-09-12T00:36:27.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.556+0000 7f030cb87780 1 < canceled multipart upload key=CUDFTXFBC862 upload=D138L0X780GD tag=DKIR4V3ENWE1 type=write size=3010640 2024-09-12T00:36:27.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.557+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=2JE8WOKRS3VA type=del size=144490 2024-09-12T00:36:27.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.558+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~2229Y8BXNBE3.0 size=332554 2024-09-12T00:36:27.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.561+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=2229Y8BXNBE3 tag=2TQFQY3FWN9L type=write size=1381130 2024-09-12T00:36:27.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.563+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~M3LSHUKKCT5R.0 size=1048576 2024-09-12T00:36:27.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.565+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~M3LSHUKKCT5R.1 size=1048576 2024-09-12T00:36:27.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.566+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~M3LSHUKKCT5R.2 size=515989 2024-09-12T00:36:27.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.566+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=M3LSHUKKCT5R tag=GZCE1FT4P7XB type=write size=3661717 2024-09-12T00:36:27.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.567+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~AL4ZYWV1PZFA.0 size=683144 2024-09-12T00:36:27.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.569+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=AL4ZYWV1PZFA tag=PLIICZ0YSKSO type=write size=1731720 2024-09-12T00:36:27.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.571+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=561WBY2HB8Z0 type=del size=4056583 2024-09-12T00:36:27.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.572+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~1JX5525ALV6Q.0 size=1016566 2024-09-12T00:36:27.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.575+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=1JX5525ALV6Q tag=G8EDHO447M1C type=write size=2065142 2024-09-12T00:36:27.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.577+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~0XCTJ7JZ4VMD.0 size=471114 2024-09-12T00:36:27.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.577+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=0XCTJ7JZ4VMD tag=VYE86FF3M57G type=write size=1519690 2024-09-12T00:36:27.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.579+0000 7f030cb87780 1 < completed delete operation key=800OHA7UURC4 tag=AYHZVP7GGBTS type=del 2024-09-12T00:36:27.580 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.580+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=GID1U4WLMIWZ type=del size=1580366 2024-09-12T00:36:27.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.582+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~5L9N68RC10YL.0 size=348228 2024-09-12T00:36:27.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.584+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=5L9N68RC10YL tag=LOCYEZ64QQKE type=write size=1396804 2024-09-12T00:36:27.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.585+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=BARVCBKE9IAJ type=del size=301816 2024-09-12T00:36:27.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.587+0000 7f030cb87780 1 < canceled operation key=JPEIGLC162K3 tag=35H8ED7FEULT type=write size=494069 2024-09-12T00:36:27.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.588+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=5GBWPLYJQ6F6 type=write size=931661 2024-09-12T00:36:27.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.590+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~LF0H9N9V5YDS.0 size=1048576 2024-09-12T00:36:27.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.590+0000 7f030cb87780 1 < canceled part key=_multipart_U5CWO1EN8BFI.2~LF0H9N9V5YDS.1 size=867865 2024-09-12T00:36:27.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.592+0000 7f030cb87780 1 < canceled multipart upload key=U5CWO1EN8BFI upload=LF0H9N9V5YDS tag=0FHBS5X8TEBD type=write size=2965017 2024-09-12T00:36:27.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.595+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~XY6A78AMZW5L.0 size=1048576 2024-09-12T00:36:27.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.596+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~XY6A78AMZW5L.1 size=1048576 2024-09-12T00:36:27.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.597+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~XY6A78AMZW5L.2 size=122096 2024-09-12T00:36:27.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.597+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=XY6A78AMZW5L tag=C694QOB7USCK type=write size=3267824 2024-09-12T00:36:27.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.598+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~193E79L67IA4.0 size=1048576 2024-09-12T00:36:27.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.600+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~193E79L67IA4.1 size=1048576 2024-09-12T00:36:27.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.602+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~193E79L67IA4.2 size=287372 2024-09-12T00:36:27.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.603+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=193E79L67IA4 tag=1MCOI3259UJX type=write size=3433100 2024-09-12T00:36:27.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.605+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=8MYL3K4MZZHA type=del size=1803832 2024-09-12T00:36:27.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.607+0000 7f030cb87780 1 < canceled operation key=JRPD5AAK84ZD tag=AZFJJSY5J2TH type=del size=4144522 2024-09-12T00:36:27.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.610+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~Z5JRT3B6YYRQ.0 size=90650 2024-09-12T00:36:27.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.610+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=Z5JRT3B6YYRQ tag=4X6UTK3KP9CJ type=write size=1139226 2024-09-12T00:36:27.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.610+0000 7f030cb87780 1 < canceled part key=_multipart_92GDVW0Q8VKQ.2~902TB75WJ2LN.0 size=149280 2024-09-12T00:36:27.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.612+0000 7f030cb87780 1 < canceled multipart upload key=92GDVW0Q8VKQ upload=902TB75WJ2LN tag=KPLZAEEREMDG type=write size=1197856 2024-09-12T00:36:27.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.614+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=QIWBGM4YZKXO type=del size=2185706 2024-09-12T00:36:27.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.617+0000 7f030cb87780 1 < suggested remove operation key=1VOJGMWNKS0A tag=BSZIP05SAQR9 type=del 2024-09-12T00:36:27.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.620+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~AGM5IC4I0PS7.0 size=719177 2024-09-12T00:36:27.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.620+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=AGM5IC4I0PS7 tag=Q933FYDW3C8U type=write size=1767753 2024-09-12T00:36:27.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.622+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=PFD7XM9031UP type=del 2024-09-12T00:36:27.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.624+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=ALE7LBX7XKWT type=del size=4021864 2024-09-12T00:36:27.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.626+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=NPETMN5QD0Q8 type=del 2024-09-12T00:36:27.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.626+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=6SXZ2PPS1ZSM type=del size=3167766 2024-09-12T00:36:27.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.628+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~1T35MXLTHEEB.0 size=574505 2024-09-12T00:36:27.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.630+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=1T35MXLTHEEB tag=MZKHUO3L29DS type=write size=1623081 2024-09-12T00:36:27.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.631+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=ACXW880NCWD3 type=del size=779249 2024-09-12T00:36:27.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.633+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~B8189K0YP15P.0 size=53397 2024-09-12T00:36:27.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.635+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=B8189K0YP15P tag=3W3TOMY1SVQE type=write size=1101973 2024-09-12T00:36:27.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.636+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=YBLNR16C0HLE type=del size=312866 2024-09-12T00:36:27.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.639+0000 7f030cb87780 1 < suggested remove operation key=99OWKRGA8ZZN tag=2JE8WOKRS3VA type=del 2024-09-12T00:36:27.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.641+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=Q82K8PW5C80T type=del size=2073461 2024-09-12T00:36:27.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.642+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~M3LSHUKKCT5R.0 size=1048576 2024-09-12T00:36:27.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.646+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~M3LSHUKKCT5R.1 size=1048576 2024-09-12T00:36:27.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.647+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~M3LSHUKKCT5R.2 size=515989 2024-09-12T00:36:27.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.649+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=M3LSHUKKCT5R tag=GZCE1FT4P7XB type=write size=3661717 2024-09-12T00:36:27.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.650+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=991KC8FW39JS type=write size=395891 2024-09-12T00:36:27.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.654+0000 7f030cb87780 1 < suggested remove operation key=ZQD0491BHJPM tag=561WBY2HB8Z0 type=del 2024-09-12T00:36:27.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.657+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~52COI1444CM2.0 size=612806 2024-09-12T00:36:27.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.657+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=52COI1444CM2 tag=03WZKI7CWVFS type=write size=1661382 2024-09-12T00:36:27.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.658+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~0XCTJ7JZ4VMD.0 size=471114 2024-09-12T00:36:27.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.661+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=0XCTJ7JZ4VMD tag=VYE86FF3M57G type=write size=1519690 2024-09-12T00:36:27.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.662+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=STFBO7FKPBKB type=del size=492302 2024-09-12T00:36:27.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.664+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=GID1U4WLMIWZ type=del 2024-09-12T00:36:27.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.667+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~B80Y287OD7SL.0 size=1048576 2024-09-12T00:36:27.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.668+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~B80Y287OD7SL.1 size=233742 2024-09-12T00:36:27.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.668+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=B80Y287OD7SL tag=XKEL5UHV0NQD type=write size=2330894 2024-09-12T00:36:27.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.670+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=BARVCBKE9IAJ type=del 2024-09-12T00:36:27.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.671+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=Z3UR8AKL8YCT type=del size=3838273 2024-09-12T00:36:27.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.672+0000 7f030cb87780 -1 < failed to complete operation key=ZQD0491BHJPM tag=5GBWPLYJQ6F6 type=write size=931661: (22) Invalid argument 2024-09-12T00:36:27.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.673+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=J1JXMKFTJJQX type=write size=864925 2024-09-12T00:36:27.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.674+0000 7f030cb87780 1 < canceled part key=_multipart_CY2NS03IIUJJ.2~XY6A78AMZW5L.0 size=1048576 2024-09-12T00:36:27.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.676+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~XY6A78AMZW5L.1 size=1048576 2024-09-12T00:36:27.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.677+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~XY6A78AMZW5L.2 size=122096 2024-09-12T00:36:27.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.681+0000 7f030cb87780 1 < canceled multipart upload key=CY2NS03IIUJJ upload=XY6A78AMZW5L tag=C694QOB7USCK type=write size=3267824 2024-09-12T00:36:27.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.682+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=72HHCVOCOYI8 type=write size=641160 2024-09-12T00:36:27.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.685+0000 7f030cb87780 1 < suggested update operation key=56I20YIPY82N tag=8MYL3K4MZZHA type=del size=1803832 2024-09-12T00:36:27.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.686+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=VDH2X66XQ13E type=write size=35889 2024-09-12T00:36:27.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.687+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~Z5JRT3B6YYRQ.0 size=90650 2024-09-12T00:36:27.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.690+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=Z5JRT3B6YYRQ tag=4X6UTK3KP9CJ type=write size=1139226 2024-09-12T00:36:27.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.691+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=5G6W4ZU5H0D8 type=write size=834269 2024-09-12T00:36:27.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.693+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=QIWBGM4YZKXO type=del 2024-09-12T00:36:27.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.694+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=OOYBYY1RSPF1 type=write size=540085 2024-09-12T00:36:27.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.696+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~AGM5IC4I0PS7.0 size=719177 2024-09-12T00:36:27.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.698+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=AGM5IC4I0PS7 tag=Q933FYDW3C8U type=write size=1767753 2024-09-12T00:36:27.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.700+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~5JP2K02I9FA3.0 size=1048576 2024-09-12T00:36:27.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.701+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~5JP2K02I9FA3.1 size=708252 2024-09-12T00:36:27.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.701+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=5JP2K02I9FA3 tag=ROQG04CIY1JR type=write size=2805404 2024-09-12T00:36:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.703+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=ALE7LBX7XKWT type=del 2024-09-12T00:36:27.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.706+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~PVR47OEX09OO.0 size=734578 2024-09-12T00:36:27.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.706+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=PVR47OEX09OO tag=RP5Z3KTA8Q1O type=write size=1783154 2024-09-12T00:36:27.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.708+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=6SXZ2PPS1ZSM type=del 2024-09-12T00:36:27.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.709+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=BLVHLTU21SW1 type=write size=940840 2024-09-12T00:36:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.710+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=ACXW880NCWD3 type=del 2024-09-12T00:36:27.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.714+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~DLEFP1IV3Z5Y.0 size=1048576 2024-09-12T00:36:27.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.715+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~DLEFP1IV3Z5Y.1 size=1048576 2024-09-12T00:36:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.716+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~DLEFP1IV3Z5Y.2 size=978845 2024-09-12T00:36:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.716+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=DLEFP1IV3Z5Y tag=Q0OIV1EHZ2HL type=write size=4124573 2024-09-12T00:36:27.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.719+0000 7f030cb87780 1 < suggested remove operation key=39WSAOA6P09M tag=YBLNR16C0HLE type=del 2024-09-12T00:36:27.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.719+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=GF56BEWVBVIB type=del size=2814596 2024-09-12T00:36:27.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.722+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=Q82K8PW5C80T type=del 2024-09-12T00:36:27.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.723+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=35666IOJ6KRC type=write size=780225 2024-09-12T00:36:27.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.724+0000 7f030cb87780 1 < completed write operation key=800OHA7UURC4 tag=991KC8FW39JS type=write size=395891 2024-09-12T00:36:27.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.725+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=LCTJX9G73BB3 type=del size=2525928 2024-09-12T00:36:27.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.727+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~52COI1444CM2.0 size=612806 2024-09-12T00:36:27.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.730+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=52COI1444CM2 tag=03WZKI7CWVFS type=write size=1661382 2024-09-12T00:36:27.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.731+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~1XTS6D31IXVY.0 size=444787 2024-09-12T00:36:27.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.731+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=1XTS6D31IXVY tag=6XCB86L9NGHO type=write size=1493363 2024-09-12T00:36:27.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.733+0000 7f030cb87780 -1 < failed to complete operation key=56I20YIPY82N tag=STFBO7FKPBKB type=del size=492302: (22) Invalid argument 2024-09-12T00:36:27.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.734+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=494SRHFI4LGQ type=del size=2024006 2024-09-12T00:36:27.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.736+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~B80Y287OD7SL.0 size=1048576 2024-09-12T00:36:27.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.736+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~B80Y287OD7SL.1 size=233742 2024-09-12T00:36:27.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.740+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=B80Y287OD7SL tag=XKEL5UHV0NQD type=write size=2330894 2024-09-12T00:36:27.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.741+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~1J9U9N0HFGZE.0 size=1048576 2024-09-12T00:36:27.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.742+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~1J9U9N0HFGZE.1 size=902991 2024-09-12T00:36:27.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.742+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=1J9U9N0HFGZE tag=X63MWKY33D27 type=write size=3000143 2024-09-12T00:36:27.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.744+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=Z3UR8AKL8YCT type=del 2024-09-12T00:36:27.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.745+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=CHG8M4KYEW3Y type=del size=2325645 2024-09-12T00:36:27.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.746+0000 7f030cb87780 1 < completed write operation key=POC8YA58U55N tag=J1JXMKFTJJQX type=write size=864925 2024-09-12T00:36:27.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.749+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=R5GU6MZIXLRA type=write size=581319 2024-09-12T00:36:27.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.749+0000 7f030cb87780 1 < completed write operation key=INFFH9R3EFRY tag=72HHCVOCOYI8 type=write size=641160 2024-09-12T00:36:27.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.751+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=GGIWPXSOJYM9 type=del size=2690140 2024-09-12T00:36:27.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.752+0000 7f030cb87780 1 < completed write operation key=92GDVW0Q8VKQ tag=VDH2X66XQ13E type=write size=35889 2024-09-12T00:36:27.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.755+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~5XZN0W21OJJJ.0 size=1048576 2024-09-12T00:36:27.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.756+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~5XZN0W21OJJJ.1 size=1048576 2024-09-12T00:36:27.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.757+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~5XZN0W21OJJJ.2 size=619362 2024-09-12T00:36:27.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.757+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=5XZN0W21OJJJ tag=3Q1P52O2PZLJ type=write size=3765090 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.758+0000 7f030cb87780 1 < completed write operation key=INFFH9R3EFRY tag=5G6W4ZU5H0D8 type=write size=834269 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.761+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=CQUW21IPF3WA type=del size=3788195 2024-09-12T00:36:27.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.761+0000 7f030cb87780 1 < canceled operation key=JPEIGLC162K3 tag=OOYBYY1RSPF1 type=write size=540085 2024-09-12T00:36:27.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.763+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=10ZYEL7X3A46 type=del size=1392263 2024-09-12T00:36:27.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.764+0000 7f030cb87780 1 < canceled part key=_multipart_U5CWO1EN8BFI.2~5JP2K02I9FA3.0 size=1048576 2024-09-12T00:36:27.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.765+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~5JP2K02I9FA3.1 size=708252 2024-09-12T00:36:27.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.767+0000 7f030cb87780 1 < canceled multipart upload key=U5CWO1EN8BFI upload=5JP2K02I9FA3 tag=ROQG04CIY1JR type=write size=2805404 2024-09-12T00:36:27.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.768+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=X577J8O3GC7H type=del size=1147931 2024-09-12T00:36:27.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.771+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~PVR47OEX09OO.0 size=734578 2024-09-12T00:36:27.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.772+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=PVR47OEX09OO tag=RP5Z3KTA8Q1O type=write size=1783154 2024-09-12T00:36:27.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.774+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~W0QKF32FL4BW.0 size=998169 2024-09-12T00:36:27.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.774+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=W0QKF32FL4BW tag=384CJG83DKJ4 type=write size=2046745 2024-09-12T00:36:27.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.777+0000 7f030cb87780 1 < completed write operation key=99OWKRGA8ZZN tag=BLVHLTU21SW1 type=write size=940840 2024-09-12T00:36:27.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.779+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~W15IUVTSJ82I.0 size=53796 2024-09-12T00:36:27.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.779+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=W15IUVTSJ82I tag=36M4UCU24527 type=write size=1102372 2024-09-12T00:36:27.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.781+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~DLEFP1IV3Z5Y.0 size=1048576 2024-09-12T00:36:27.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.781+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~DLEFP1IV3Z5Y.1 size=1048576 2024-09-12T00:36:27.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.782+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~DLEFP1IV3Z5Y.2 size=978845 2024-09-12T00:36:27.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.785+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=DLEFP1IV3Z5Y tag=Q0OIV1EHZ2HL type=write size=4124573 2024-09-12T00:36:27.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.788+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~3RL4NM2K9G92.0 size=1048576 2024-09-12T00:36:27.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.789+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~3RL4NM2K9G92.1 size=665148 2024-09-12T00:36:27.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.789+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=3RL4NM2K9G92 tag=JPBCMQVHAKCF type=write size=2762300 2024-09-12T00:36:27.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.791+0000 7f030cb87780 1 < suggested update operation key=JPEIGLC162K3 tag=GF56BEWVBVIB type=del size=2814596 2024-09-12T00:36:27.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.794+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~JSGPOBUNJQ1V.0 size=1048576 2024-09-12T00:36:27.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.797+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~JSGPOBUNJQ1V.1 size=915774 2024-09-12T00:36:27.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.797+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=JSGPOBUNJQ1V tag=WF66HU8LBLY4 type=write size=3012926 2024-09-12T00:36:27.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.798+0000 7f030cb87780 1 < completed write operation key=86TWUAZAHI4I tag=35666IOJ6KRC type=write size=780225 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.800+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=WJS890ITSTOK type=del size=2046280 2024-09-12T00:36:27.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.802+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=LCTJX9G73BB3 type=del 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.804+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~9ECDVKJ70J7C.0 size=1048576 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.805+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~9ECDVKJ70J7C.1 size=1048576 2024-09-12T00:36:27.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.806+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~9ECDVKJ70J7C.2 size=829075 2024-09-12T00:36:27.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.806+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=9ECDVKJ70J7C tag=H7DOYUXRZ4CF type=write size=3974803 2024-09-12T00:36:27.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.807+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~1XTS6D31IXVY.0 size=444787 2024-09-12T00:36:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.810+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=1XTS6D31IXVY tag=6XCB86L9NGHO type=write size=1493363 2024-09-12T00:36:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.813+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=AV3L7T9FHWJ8 type=write size=116307 2024-09-12T00:36:27.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.817+0000 7f030cb87780 1 < suggested update operation key=ZQD0491BHJPM tag=494SRHFI4LGQ type=del size=2024006 2024-09-12T00:36:27.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.818+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=A6EXDCEF3YU5 type=del size=112768 2024-09-12T00:36:27.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.820+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~1J9U9N0HFGZE.0 size=1048576 2024-09-12T00:36:27.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.820+0000 7f030cb87780 1 < canceled part key=_multipart_OR439FK5L43V.2~1J9U9N0HFGZE.1 size=902991 2024-09-12T00:36:27.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.821+0000 7f030cb87780 1 < canceled multipart upload key=OR439FK5L43V upload=1J9U9N0HFGZE tag=X63MWKY33D27 type=write size=3000143 2024-09-12T00:36:27.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.822+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=3VHGTKNLUPPG type=del size=1728142 2024-09-12T00:36:27.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.824+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=CHG8M4KYEW3Y type=del 2024-09-12T00:36:27.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.826+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~YGX4T5NBXYGM.0 size=1048576 2024-09-12T00:36:27.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.828+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~YGX4T5NBXYGM.1 size=1048576 2024-09-12T00:36:27.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.829+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~YGX4T5NBXYGM.2 size=1042331 2024-09-12T00:36:27.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.829+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=YGX4T5NBXYGM tag=M0T2NIMSQ1IH type=write size=4188059 2024-09-12T00:36:27.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.831+0000 7f030cb87780 1 < suggested update operation key=3W7ANGL92ZF0 tag=R5GU6MZIXLRA type=write size=581319 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.833+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=OP5YVJZ8UMV7 type=del size=3751669 2024-09-12T00:36:27.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.834+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=GGIWPXSOJYM9 type=del 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.836+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~P2I3IC0GL391.0 size=1048576 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.838+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~P2I3IC0GL391.1 size=1048576 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.838+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~P2I3IC0GL391.2 size=468035 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.838+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=P2I3IC0GL391 tag=CS36WL59QDBT type=write size=3613763 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.840+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~5XZN0W21OJJJ.0 size=1048576 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.842+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~5XZN0W21OJJJ.1 size=1048576 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.843+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~5XZN0W21OJJJ.2 size=619362 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.844+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=5XZN0W21OJJJ tag=3Q1P52O2PZLJ type=write size=3765090 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.845+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=IFFK27KAK5XK type=del size=1086510 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.848+0000 7f030cb87780 1 < suggested remove operation key=1VOJGMWNKS0A tag=CQUW21IPF3WA type=del 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.849+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=OVW6LNA8UZN6 type=del size=2573394 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.851+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=10ZYEL7X3A46 type=del 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.853+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~70V4Z4N389P4.0 size=1048576 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.854+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~70V4Z4N389P4.1 size=1048576 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.855+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~70V4Z4N389P4.2 size=351737 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.855+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=70V4Z4N389P4 tag=UMTJ12UYAHOU type=write size=3497465 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.856+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=X577J8O3GC7H type=del 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.859+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~XB45UX714HUW.0 size=1048576 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.860+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~XB45UX714HUW.1 size=16302 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.860+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=XB45UX714HUW tag=R1C5Q89JZ15R type=write size=2113454 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.861+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~W0QKF32FL4BW.0 size=998169 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.864+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=W0QKF32FL4BW tag=384CJG83DKJ4 type=write size=2046745 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.866+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=FKMEV8BZ11NZ type=write size=561978 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.868+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~W15IUVTSJ82I.0 size=53796 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.869+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=W15IUVTSJ82I tag=36M4UCU24527 type=write size=1102372 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.873+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~1717C5Y8OSN8.0 size=1048576 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.873+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~1717C5Y8OSN8.1 size=696842 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.873+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=1717C5Y8OSN8 tag=6ULGE3NSF8V8 type=write size=2793994 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.876+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~3RL4NM2K9G92.0 size=1048576 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.876+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~3RL4NM2K9G92.1 size=665148 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.880+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=3RL4NM2K9G92 tag=JPBCMQVHAKCF type=write size=2762300 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.880+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=JSCB8UTJS4M8 type=del size=1624122 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.882+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~JSGPOBUNJQ1V.0 size=1048576 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.883+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~JSGPOBUNJQ1V.1 size=915774 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.886+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=JSGPOBUNJQ1V tag=WF66HU8LBLY4 type=write size=3012926 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.887+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~RD0K9NL0T0MU.0 size=985541 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.887+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=RD0K9NL0T0MU tag=7QGLZBO8FNV8 type=write size=2034117 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.889+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=WJS890ITSTOK type=del 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.892+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~DEJ89X1JJTBI.0 size=1048576 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.892+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~DEJ89X1JJTBI.1 size=1048576 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.894+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~DEJ89X1JJTBI.2 size=731203 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.894+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=DEJ89X1JJTBI tag=P8GXVOBIP7PG type=write size=3876931 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.895+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~9ECDVKJ70J7C.0 size=1048576 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.897+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~9ECDVKJ70J7C.1 size=1048576 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.898+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~9ECDVKJ70J7C.2 size=829075 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.900+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=9ECDVKJ70J7C tag=H7DOYUXRZ4CF type=write size=3974803 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.900+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=VP3MKT5OKGAE type=del size=3876769 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.904+0000 7f030cb87780 1 < suggested remove operation key=V0OLIRP3KH40 tag=AV3L7T9FHWJ8 type=write 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.906+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=QUXF2HUPOY53 type=del size=592373 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.907+0000 7f030cb87780 1 < canceled operation key=HUDEU16YTO0Y tag=A6EXDCEF3YU5 type=del size=112768 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.907+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=HJAFM3I20JZ7 type=write size=603719 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.909+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=3VHGTKNLUPPG type=del 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.910+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=PLQF8D82L085 type=del size=3695931 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.910+0000 7f030cb87780 1 < canceled part key=_multipart_U5CWO1EN8BFI.2~YGX4T5NBXYGM.0 size=1048576 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.911+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~YGX4T5NBXYGM.1 size=1048576 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.914+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~YGX4T5NBXYGM.2 size=1042331 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.916+0000 7f030cb87780 1 < canceled multipart upload key=U5CWO1EN8BFI upload=YGX4T5NBXYGM tag=M0T2NIMSQ1IH type=write size=4188059 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.917+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~EV5ILGSMEX3A.0 size=1048576 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.919+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~EV5ILGSMEX3A.1 size=1048576 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.920+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~EV5ILGSMEX3A.2 size=377608 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.920+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=EV5ILGSMEX3A tag=5TWB8DHB71QB type=write size=3523336 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.921+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=OP5YVJZ8UMV7 type=del 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.923+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=9KALJVJ46P6C type=write size=911884 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.924+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~P2I3IC0GL391.0 size=1048576 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.926+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~P2I3IC0GL391.1 size=1048576 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.926+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~P2I3IC0GL391.2 size=468035 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.930+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=P2I3IC0GL391 tag=CS36WL59QDBT type=write size=3613763 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.931+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=23W7XCVA43SR type=write size=443585 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.932+0000 7f030cb87780 1 < canceled operation key=IY156CJWG2TB tag=IFFK27KAK5XK type=del size=1086510 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.935+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=9ZDIKJBNTHHT type=del size=1306111 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.935+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=OVW6LNA8UZN6 type=del 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.939+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~D6ILHBSJ2R3R.0 size=1048576 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.940+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~D6ILHBSJ2R3R.1 size=478371 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.940+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=D6ILHBSJ2R3R tag=169UAO63MUYO type=write size=2575523 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.942+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~70V4Z4N389P4.0 size=1048576 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.943+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~70V4Z4N389P4.1 size=1048576 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.944+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~70V4Z4N389P4.2 size=351737 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.946+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=70V4Z4N389P4 tag=UMTJ12UYAHOU type=write size=3497465 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.947+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=UMGW1F2SD7NN type=del size=3698341 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.949+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~XB45UX714HUW.0 size=1048576 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.950+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~XB45UX714HUW.1 size=16302 2024-09-12T00:36:27.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.953+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=XB45UX714HUW tag=R1C5Q89JZ15R type=write size=2113454 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.955+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=GFWYJPOT0FFS type=del size=3575795 2024-09-12T00:36:27.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.957+0000 7f030cb87780 1 < completed write operation key=U5CWO1EN8BFI tag=FKMEV8BZ11NZ type=write size=561978 2024-09-12T00:36:27.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.958+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~D4NTBWOVUUWH.0 size=1048576 2024-09-12T00:36:27.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.960+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~D4NTBWOVUUWH.1 size=214877 2024-09-12T00:36:27.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.960+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=D4NTBWOVUUWH tag=C0QYK2Z33XZS type=write size=2312029 2024-09-12T00:36:27.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.962+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~1717C5Y8OSN8.0 size=1048576 2024-09-12T00:36:27.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.962+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~1717C5Y8OSN8.1 size=696842 2024-09-12T00:36:27.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.964+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=1717C5Y8OSN8 tag=6ULGE3NSF8V8 type=write size=2793994 2024-09-12T00:36:27.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.968+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~WPHDUH98VN51.0 size=1048576 2024-09-12T00:36:27.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.968+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~WPHDUH98VN51.1 size=1048576 2024-09-12T00:36:27.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.970+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~WPHDUH98VN51.2 size=42605 2024-09-12T00:36:27.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.970+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=WPHDUH98VN51 tag=338NJRWLI45B type=write size=3188333 2024-09-12T00:36:27.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.971+0000 7f030cb87780 1 < canceled operation key=ZQD0491BHJPM tag=JSCB8UTJS4M8 type=del size=1624122 2024-09-12T00:36:27.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.973+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=REP3CI1ER6PE type=del size=262517 2024-09-12T00:36:27.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.974+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~RD0K9NL0T0MU.0 size=985541 2024-09-12T00:36:27.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.977+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=RD0K9NL0T0MU tag=7QGLZBO8FNV8 type=write size=2034117 2024-09-12T00:36:27.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.977+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=JUA3N4NDS5UA type=del size=3361803 2024-09-12T00:36:27.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.980+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~DEJ89X1JJTBI.0 size=1048576 2024-09-12T00:36:27.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.980+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~DEJ89X1JJTBI.1 size=1048576 2024-09-12T00:36:27.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.982+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~DEJ89X1JJTBI.2 size=731203 2024-09-12T00:36:27.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.984+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=DEJ89X1JJTBI tag=P8GXVOBIP7PG type=write size=3876931 2024-09-12T00:36:27.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.985+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~0KWKUWUNM3LI.0 size=334467 2024-09-12T00:36:27.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.985+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=0KWKUWUNM3LI tag=5UF149VI49PM type=write size=1383043 2024-09-12T00:36:27.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.988+0000 7f030cb87780 1 < suggested update operation key=INFFH9R3EFRY tag=VP3MKT5OKGAE type=del size=3876769 2024-09-12T00:36:27.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.992+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~UH7INI4RO66Y.0 size=1048576 2024-09-12T00:36:27.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.993+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~UH7INI4RO66Y.1 size=1048576 2024-09-12T00:36:27.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.994+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~UH7INI4RO66Y.2 size=10741 2024-09-12T00:36:27.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.994+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=UH7INI4RO66Y tag=T1QQNRVNORW0 type=write size=3156469 2024-09-12T00:36:27.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.994+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=QUXF2HUPOY53 type=del 2024-09-12T00:36:27.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.997+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=87VJHYJENU8T type=del size=3179669 2024-09-12T00:36:27.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:27.998+0000 7f030cb87780 1 < completed write operation key=9MCRD2G3MZIT tag=HJAFM3I20JZ7 type=write size=603719 2024-09-12T00:36:27.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.000+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~GJ2FLUX5T2UO.0 size=1048576 2024-09-12T00:36:28.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.001+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~GJ2FLUX5T2UO.1 size=412484 2024-09-12T00:36:28.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.001+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=GJ2FLUX5T2UO tag=NRJIJ1QILOZW type=write size=2509636 2024-09-12T00:36:28.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.002+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=PLQF8D82L085 type=del 2024-09-12T00:36:28.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.006+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~HNW2OMM5IKQF.0 size=1048576 2024-09-12T00:36:28.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.006+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~HNW2OMM5IKQF.1 size=1048576 2024-09-12T00:36:28.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.008+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~HNW2OMM5IKQF.2 size=385581 2024-09-12T00:36:28.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.008+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=HNW2OMM5IKQF tag=BXWNUCLXYYTN type=write size=3531309 2024-09-12T00:36:28.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.009+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~EV5ILGSMEX3A.0 size=1048576 2024-09-12T00:36:28.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.010+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~EV5ILGSMEX3A.1 size=1048576 2024-09-12T00:36:28.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.011+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~EV5ILGSMEX3A.2 size=377608 2024-09-12T00:36:28.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.013+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=EV5ILGSMEX3A tag=5TWB8DHB71QB type=write size=3523336 2024-09-12T00:36:28.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.015+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=436FQW091QNP type=del size=1152666 2024-09-12T00:36:28.016 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.016+0000 7f030cb87780 1 < completed write operation key=IY156CJWG2TB tag=9KALJVJ46P6C type=write size=911884 2024-09-12T00:36:28.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.018+0000 7f030cb87780 1 > prepared operation key=U5CWO1EN8BFI tag=RN4XFI4T6W3V type=del size=3859844 2024-09-12T00:36:28.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.019+0000 7f030cb87780 1 < completed write operation key=CY2NS03IIUJJ tag=23W7XCVA43SR type=write size=443585 2024-09-12T00:36:28.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.020+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=QKTH5KHW3IOA type=write size=472373 2024-09-12T00:36:28.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.023+0000 7f030cb87780 1 < suggested update operation key=HUDEU16YTO0Y tag=9ZDIKJBNTHHT type=del size=1306111 2024-09-12T00:36:28.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.024+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=VBSZPDTK9QWY type=del size=137439 2024-09-12T00:36:28.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.025+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~D6ILHBSJ2R3R.0 size=1048576 2024-09-12T00:36:28.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.026+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~D6ILHBSJ2R3R.1 size=478371 2024-09-12T00:36:28.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.029+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=D6ILHBSJ2R3R tag=169UAO63MUYO type=write size=2575523 2024-09-12T00:36:28.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.031+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~KUEEJVYP7JTY.0 size=1048576 2024-09-12T00:36:28.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.032+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~KUEEJVYP7JTY.1 size=279280 2024-09-12T00:36:28.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.032+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=KUEEJVYP7JTY tag=6MV8VIIE5IJ3 type=write size=2376432 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.033+0000 7f030cb87780 1 < canceled operation key=9MCRD2G3MZIT tag=UMGW1F2SD7NN type=del size=3698341 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.036+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=UQMQ1EWL6OLV type=write size=580437 2024-09-12T00:36:28.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.036+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=GFWYJPOT0FFS type=del 2024-09-12T00:36:28.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.041+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~83R2QOQCNE8P.0 size=1048576 2024-09-12T00:36:28.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.043+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~83R2QOQCNE8P.1 size=385538 2024-09-12T00:36:28.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.043+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=83R2QOQCNE8P tag=JGJPOO6UV18S type=write size=2482690 2024-09-12T00:36:28.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.043+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~D4NTBWOVUUWH.0 size=1048576 2024-09-12T00:36:28.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.045+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~D4NTBWOVUUWH.1 size=214877 2024-09-12T00:36:28.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.048+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=D4NTBWOVUUWH tag=C0QYK2Z33XZS type=write size=2312029 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.049+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~7J49G59T6ZLD.0 size=1048576 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.051+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~7J49G59T6ZLD.1 size=682597 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.051+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=7J49G59T6ZLD tag=NHS30GU6JN8N type=write size=2779749 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.052+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~WPHDUH98VN51.0 size=1048576 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.053+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~WPHDUH98VN51.1 size=1048576 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.054+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~WPHDUH98VN51.2 size=42605 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.058+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=WPHDUH98VN51 tag=338NJRWLI45B type=write size=3188333 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.058+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=C5MNH3N34MGI type=del size=1572276 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.061+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=REP3CI1ER6PE type=del 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.061+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=ILBJK0X65HVZ type=write size=244163 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.064+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=JUA3N4NDS5UA type=del 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.065+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=9R4I4OWMON9T type=del size=3102785 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.066+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~0KWKUWUNM3LI.0 size=334467 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.070+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=0KWKUWUNM3LI tag=5UF149VI49PM type=write size=1383043 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.070+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=0PV7XL089300 type=write size=148899 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.074+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~UH7INI4RO66Y.0 size=1048576 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.077+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~UH7INI4RO66Y.1 size=1048576 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.078+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~UH7INI4RO66Y.2 size=10741 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.080+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=UH7INI4RO66Y tag=T1QQNRVNORW0 type=write size=3156469 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.081+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=60WIL1ITB3XO type=del size=2665779 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.084+0000 7f030cb87780 1 < suggested update operation key=9MCRD2G3MZIT tag=87VJHYJENU8T type=del size=3179669 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.085+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=MKM9V9KP5EQD type=del size=281851 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.086+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~GJ2FLUX5T2UO.0 size=1048576 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.088+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~GJ2FLUX5T2UO.1 size=412484 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.090+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=GJ2FLUX5T2UO tag=NRJIJ1QILOZW type=write size=2509636 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.093+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~919UKD3S4EXM.0 size=1048576 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.093+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~919UKD3S4EXM.1 size=394796 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.093+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=919UKD3S4EXM tag=QVNAD055OLNP type=write size=2491948 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.095+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~HNW2OMM5IKQF.0 size=1048576 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.095+0000 7f030cb87780 1 < canceled part key=_multipart_86TWUAZAHI4I.2~HNW2OMM5IKQF.1 size=1048576 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.097+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~HNW2OMM5IKQF.2 size=385581 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.099+0000 7f030cb87780 1 < canceled multipart upload key=86TWUAZAHI4I upload=HNW2OMM5IKQF tag=BXWNUCLXYYTN type=write size=3531309 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.101+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~K08B01T30HGN.0 size=1048576 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.102+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~K08B01T30HGN.1 size=1048576 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.104+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~K08B01T30HGN.2 size=940603 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.104+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=K08B01T30HGN tag=7CCEF3TV0EJQ type=write size=4086331 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.104+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=436FQW091QNP type=del 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.108+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~NYVLOJUZTZVG.0 size=768388 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.108+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=NYVLOJUZTZVG tag=CCXN0XT0B34L type=write size=1816964 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.109+0000 7f030cb87780 1 < completed delete operation key=U5CWO1EN8BFI tag=RN4XFI4T6W3V type=del 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.111+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~P5NL9KIUNXHT.0 size=231300 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.111+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=P5NL9KIUNXHT tag=1YWOP76BMP46 type=write size=1279876 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.113+0000 7f030cb87780 1 < completed write operation key=86TWUAZAHI4I tag=QKTH5KHW3IOA type=write size=472373 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.115+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~YSUL3LFXL4DM.0 size=964298 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.115+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=YSUL3LFXL4DM tag=OI0MT2R1W4WT type=write size=2012874 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.116+0000 7f030cb87780 1 < canceled operation key=INFFH9R3EFRY tag=VBSZPDTK9QWY type=del size=137439 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.117+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=R1NLT94M338L type=del size=1530051 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.118+0000 7f030cb87780 1 < canceled part key=_multipart_CUDFTXFBC862.2~KUEEJVYP7JTY.0 size=1048576 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.119+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~KUEEJVYP7JTY.1 size=279280 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.122+0000 7f030cb87780 1 < canceled multipart upload key=CUDFTXFBC862 upload=KUEEJVYP7JTY tag=6MV8VIIE5IJ3 type=write size=2376432 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.122+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=IBHI2TWNH5GD type=write size=12607 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.124+0000 7f030cb87780 1 < completed write operation key=UFYMVGL264T8 tag=UQMQ1EWL6OLV type=write size=580437 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.125+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=F6HOLAI73Y96 type=write size=158324 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.128+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~83R2QOQCNE8P.0 size=1048576 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.128+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~83R2QOQCNE8P.1 size=385538 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.130+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=83R2QOQCNE8P tag=JGJPOO6UV18S type=write size=2482690 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.133+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~WHTUKMZIF20X.0 size=150743 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.133+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=WHTUKMZIF20X tag=TOXQBXP94KQ5 type=write size=1199319 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.134+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~7J49G59T6ZLD.0 size=1048576 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.135+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~7J49G59T6ZLD.1 size=682597 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.137+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=7J49G59T6ZLD tag=NHS30GU6JN8N type=write size=2779749 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.138+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=P61ZVYQPTXP1 type=del size=2027380 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.139+0000 7f030cb87780 1 < canceled operation key=INFFH9R3EFRY tag=C5MNH3N34MGI type=del size=1572276 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.142+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=FAZJAVYDRL6T type=del size=166673 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.143+0000 7f030cb87780 1 < completed write operation key=86TWUAZAHI4I tag=ILBJK0X65HVZ type=write size=244163 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.145+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~R8MKUKNU7B97.0 size=1048576 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.146+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~R8MKUKNU7B97.1 size=1048576 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.148+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~R8MKUKNU7B97.2 size=795947 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.148+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=R8MKUKNU7B97 tag=2OJE7NXI9R9S type=write size=3941675 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.148+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=9R4I4OWMON9T type=del 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.150+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=SRU2YKW7OUUJ type=del size=3433284 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.151+0000 7f030cb87780 1 < completed write operation key=JRPD5AAK84ZD tag=0PV7XL089300 type=write size=148899 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.154+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~L215SDU7459H.0 size=692081 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.154+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=L215SDU7459H tag=OBSIXKPP8WMG type=write size=1740657 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.155+0000 7f030cb87780 -1 < failed to complete operation key=9MCRD2G3MZIT tag=60WIL1ITB3XO type=del size=2665779: (22) Invalid argument 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.157+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~UL67U1FGJTC4.0 size=1048576 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.158+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~UL67U1FGJTC4.1 size=261303 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.158+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=UL67U1FGJTC4 tag=OM0H6KXHW3PV type=write size=2358455 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.162+0000 7f030cb87780 1 < suggested update operation key=1PLGUJCB6J0V tag=MKM9V9KP5EQD type=del size=281851 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.164+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~JE7C452S5UO3.0 size=855594 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.164+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=JE7C452S5UO3 tag=MIWCOIFKNWE1 type=write size=1904170 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.165+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~919UKD3S4EXM.0 size=1048576 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.166+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~919UKD3S4EXM.1 size=394796 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.169+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=919UKD3S4EXM tag=QVNAD055OLNP type=write size=2491948 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.170+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=0XC2LSWSOIGJ type=del size=2518924 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.171+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~K08B01T30HGN.0 size=1048576 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.172+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~K08B01T30HGN.1 size=1048576 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.173+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~K08B01T30HGN.2 size=940603 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.175+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=K08B01T30HGN tag=7CCEF3TV0EJQ type=write size=4086331 2024-09-12T00:36:28.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.178+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~D6U6IUK006S7.0 size=1048576 2024-09-12T00:36:28.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.180+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~D6U6IUK006S7.1 size=54573 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.180+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=D6U6IUK006S7 tag=323NV0ZH4D46 type=write size=2151725 2024-09-12T00:36:28.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.180+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~NYVLOJUZTZVG.0 size=768388 2024-09-12T00:36:28.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.182+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=NYVLOJUZTZVG tag=CCXN0XT0B34L type=write size=1816964 2024-09-12T00:36:28.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.186+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~FW1D639Y4P7L.0 size=1048576 2024-09-12T00:36:28.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.187+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~FW1D639Y4P7L.1 size=1048576 2024-09-12T00:36:28.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.187+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~FW1D639Y4P7L.2 size=211919 2024-09-12T00:36:28.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.187+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=FW1D639Y4P7L tag=VB3CC5Z9JZV1 type=write size=3357647 2024-09-12T00:36:28.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.189+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~P5NL9KIUNXHT.0 size=231300 2024-09-12T00:36:28.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.192+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=P5NL9KIUNXHT tag=1YWOP76BMP46 type=write size=1279876 2024-09-12T00:36:28.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.193+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~FU21S7X1W3OP.0 size=1048576 2024-09-12T00:36:28.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.195+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~FU21S7X1W3OP.1 size=686402 2024-09-12T00:36:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.195+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=FU21S7X1W3OP tag=ALVZAHBFXNMC type=write size=2783554 2024-09-12T00:36:28.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.196+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~YSUL3LFXL4DM.0 size=964298 2024-09-12T00:36:28.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.200+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=YSUL3LFXL4DM tag=OI0MT2R1W4WT type=write size=2012874 2024-09-12T00:36:28.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.202+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=37OROAIKIEJA type=del size=3450943 2024-09-12T00:36:28.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.206+0000 7f030cb87780 1 < suggested remove operation key=56I20YIPY82N tag=R1NLT94M338L type=del 2024-09-12T00:36:28.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.207+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=4OZ45I74ONXO type=write size=790336 2024-09-12T00:36:28.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.209+0000 7f030cb87780 1 < completed write operation key=IHTFI7W4A6JT tag=IBHI2TWNH5GD type=write size=12607 2024-09-12T00:36:28.210 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.210+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=2NB95JWGHM97 type=del size=1318296 2024-09-12T00:36:28.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.213+0000 7f030cb87780 1 < suggested remove operation key=POC8YA58U55N tag=F6HOLAI73Y96 type=write 2024-09-12T00:36:28.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.214+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=4CC3B6CI51B2 type=del size=2586754 2024-09-12T00:36:28.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.216+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~WHTUKMZIF20X.0 size=150743 2024-09-12T00:36:28.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.219+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=WHTUKMZIF20X tag=TOXQBXP94KQ5 type=write size=1199319 2024-09-12T00:36:28.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.220+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=K7BA8506UHMY type=del size=2988452 2024-09-12T00:36:28.221 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.222+0000 7f030cb87780 -1 < failed to complete operation key=1PLGUJCB6J0V tag=P61ZVYQPTXP1 type=del size=2027380: (22) Invalid argument 2024-09-12T00:36:28.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.225+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~SX3W222LC2V4.0 size=770332 2024-09-12T00:36:28.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.225+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=SX3W222LC2V4 tag=C9R94Q0KX70F type=write size=1818908 2024-09-12T00:36:28.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.225+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=FAZJAVYDRL6T type=del 2024-09-12T00:36:28.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.228+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~96XTDPJQG5AI.0 size=469695 2024-09-12T00:36:28.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.228+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=96XTDPJQG5AI tag=A0LZ6O98FKZS type=write size=1518271 2024-09-12T00:36:28.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.230+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~R8MKUKNU7B97.0 size=1048576 2024-09-12T00:36:28.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.231+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~R8MKUKNU7B97.1 size=1048576 2024-09-12T00:36:28.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.233+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~R8MKUKNU7B97.2 size=795947 2024-09-12T00:36:28.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.236+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=R8MKUKNU7B97 tag=2OJE7NXI9R9S type=write size=3941675 2024-09-12T00:36:28.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.238+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~S3SKYRLMEZ4P.0 size=1048576 2024-09-12T00:36:28.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.239+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~S3SKYRLMEZ4P.1 size=72973 2024-09-12T00:36:28.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.239+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=S3SKYRLMEZ4P tag=2FYXYEVQ5X5N type=write size=2170125 2024-09-12T00:36:28.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.241+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=SRU2YKW7OUUJ type=del 2024-09-12T00:36:28.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.244+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~SG1MUU4DPRZ2.0 size=507136 2024-09-12T00:36:28.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.244+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=SG1MUU4DPRZ2 tag=Q64NOI4XH0LA type=write size=1555712 2024-09-12T00:36:28.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.246+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~L215SDU7459H.0 size=692081 2024-09-12T00:36:28.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.248+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=L215SDU7459H tag=OBSIXKPP8WMG type=write size=1740657 2024-09-12T00:36:28.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.248+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=35KJZT0BUETU type=write size=800036 2024-09-12T00:36:28.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.251+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~UL67U1FGJTC4.0 size=1048576 2024-09-12T00:36:28.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.251+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~UL67U1FGJTC4.1 size=261303 2024-09-12T00:36:28.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.253+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=UL67U1FGJTC4 tag=OM0H6KXHW3PV type=write size=2358455 2024-09-12T00:36:28.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.256+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~G1Z15TKE7N56.0 size=1048576 2024-09-12T00:36:28.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.257+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~G1Z15TKE7N56.1 size=1017296 2024-09-12T00:36:28.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.257+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=G1Z15TKE7N56 tag=ME52EEV715RI type=write size=3114448 2024-09-12T00:36:28.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.259+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~JE7C452S5UO3.0 size=855594 2024-09-12T00:36:28.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.261+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=JE7C452S5UO3 tag=MIWCOIFKNWE1 type=write size=1904170 2024-09-12T00:36:28.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.262+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=08RAFBHTBMW7 type=del size=4080441 2024-09-12T00:36:28.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.265+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=0XC2LSWSOIGJ type=del 2024-09-12T00:36:28.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.267+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~R72D2OLBYQ2S.0 size=1048576 2024-09-12T00:36:28.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.267+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~R72D2OLBYQ2S.1 size=1048576 2024-09-12T00:36:28.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.270+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~R72D2OLBYQ2S.2 size=903391 2024-09-12T00:36:28.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.270+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=R72D2OLBYQ2S tag=2WN51VROLGJ8 type=write size=4049119 2024-09-12T00:36:28.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.270+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~D6U6IUK006S7.0 size=1048576 2024-09-12T00:36:28.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.270+0000 7f030cb87780 1 < canceled part key=_multipart_6WHZRKLM3OLP.2~D6U6IUK006S7.1 size=54573 2024-09-12T00:36:28.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.273+0000 7f030cb87780 1 < canceled multipart upload key=6WHZRKLM3OLP upload=D6U6IUK006S7 tag=323NV0ZH4D46 type=write size=2151725 2024-09-12T00:36:28.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.276+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~7S8QNAFIOYSB.0 size=1048576 2024-09-12T00:36:28.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.277+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~7S8QNAFIOYSB.1 size=1048576 2024-09-12T00:36:28.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.278+0000 7f030cb87780 1 > prepared part key=_multipart_1PLGUJCB6J0V.2~7S8QNAFIOYSB.2 size=469641 2024-09-12T00:36:28.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.278+0000 7f030cb87780 1 > prepared multipart upload key=1PLGUJCB6J0V upload=7S8QNAFIOYSB tag=P87WF8AWFYQF type=write size=3615369 2024-09-12T00:36:28.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.278+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~FW1D639Y4P7L.0 size=1048576 2024-09-12T00:36:28.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.280+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~FW1D639Y4P7L.1 size=1048576 2024-09-12T00:36:28.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.281+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~FW1D639Y4P7L.2 size=211919 2024-09-12T00:36:28.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.283+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=FW1D639Y4P7L tag=VB3CC5Z9JZV1 type=write size=3357647 2024-09-12T00:36:28.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.286+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~QTOAEXIKA0F9.0 size=1048576 2024-09-12T00:36:28.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.287+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~QTOAEXIKA0F9.1 size=1048576 2024-09-12T00:36:28.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.288+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~QTOAEXIKA0F9.2 size=826858 2024-09-12T00:36:28.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.288+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=QTOAEXIKA0F9 tag=K7D4NCQKMPPV type=write size=3972586 2024-09-12T00:36:28.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.290+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~FU21S7X1W3OP.0 size=1048576 2024-09-12T00:36:28.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.290+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~FU21S7X1W3OP.1 size=686402 2024-09-12T00:36:28.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.293+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=FU21S7X1W3OP tag=ALVZAHBFXNMC type=write size=2783554 2024-09-12T00:36:28.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.294+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=RYXXVH7HACQR type=del size=2811650 2024-09-12T00:36:28.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.296+0000 7f030cb87780 1 < completed delete operation key=INFFH9R3EFRY tag=37OROAIKIEJA type=del 2024-09-12T00:36:28.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.298+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=UABUFL2VQVDA type=write size=878738 2024-09-12T00:36:28.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.298+0000 7f030cb87780 1 < completed write operation key=V87B6SDB1HFZ tag=4OZ45I74ONXO type=write size=790336 2024-09-12T00:36:28.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.301+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=0I4A133VG7PV type=del size=1304909 2024-09-12T00:36:28.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.302+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=2NB95JWGHM97 type=del 2024-09-12T00:36:28.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.304+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~5VVFIZZ7N38Z.0 size=1048576 2024-09-12T00:36:28.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.305+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~5VVFIZZ7N38Z.1 size=1048576 2024-09-12T00:36:28.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.306+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~5VVFIZZ7N38Z.2 size=372952 2024-09-12T00:36:28.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.306+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=5VVFIZZ7N38Z tag=I1TW5PBSUSY8 type=write size=3518680 2024-09-12T00:36:28.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.310+0000 7f030cb87780 1 < suggested update operation key=JRPD5AAK84ZD tag=4CC3B6CI51B2 type=del size=2586754 2024-09-12T00:36:28.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.312+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~XK0W99KKJW2P.0 size=1048576 2024-09-12T00:36:28.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.314+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~XK0W99KKJW2P.1 size=1048576 2024-09-12T00:36:28.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.315+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~XK0W99KKJW2P.2 size=407308 2024-09-12T00:36:28.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.315+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=XK0W99KKJW2P tag=QIGFIWK4DCFK type=write size=3553036 2024-09-12T00:36:28.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.316+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=K7BA8506UHMY type=del 2024-09-12T00:36:28.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.318+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~R3Y4PCBIRGPU.0 size=899697 2024-09-12T00:36:28.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.318+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=R3Y4PCBIRGPU tag=J49UBFC4NAMM type=write size=1948273 2024-09-12T00:36:28.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.319+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~SX3W222LC2V4.0 size=770332 2024-09-12T00:36:28.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.322+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=SX3W222LC2V4 tag=C9R94Q0KX70F type=write size=1818908 2024-09-12T00:36:28.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.323+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=JQDPFUI0NK99 type=write size=862189 2024-09-12T00:36:28.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.326+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~96XTDPJQG5AI.0 size=469695 2024-09-12T00:36:28.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.328+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=96XTDPJQG5AI tag=A0LZ6O98FKZS type=write size=1518271 2024-09-12T00:36:28.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.328+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=TJZC7YQSSKKB type=write size=588488 2024-09-12T00:36:28.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.331+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~S3SKYRLMEZ4P.0 size=1048576 2024-09-12T00:36:28.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.331+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~S3SKYRLMEZ4P.1 size=72973 2024-09-12T00:36:28.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.336+0000 7f030cb87780 1 < completed multipart upload key=39WSAOA6P09M upload=S3SKYRLMEZ4P tag=2FYXYEVQ5X5N type=write size=2170125 2024-09-12T00:36:28.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.337+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=TB98YHCCRIZY type=write size=990836 2024-09-12T00:36:28.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.338+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~SG1MUU4DPRZ2.0 size=507136 2024-09-12T00:36:28.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.340+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=SG1MUU4DPRZ2 tag=Q64NOI4XH0LA type=write size=1555712 2024-09-12T00:36:28.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.342+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=VECSDR3I2UF4 type=del size=3357801 2024-09-12T00:36:28.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.343+0000 7f030cb87780 1 < completed write operation key=86TWUAZAHI4I tag=35KJZT0BUETU type=write size=800036 2024-09-12T00:36:28.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.345+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=2PU9NDA4PQ1B type=del size=3383401 2024-09-12T00:36:28.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.346+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~G1Z15TKE7N56.0 size=1048576 2024-09-12T00:36:28.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.346+0000 7f030cb87780 1 < canceled part key=_multipart_CUDFTXFBC862.2~G1Z15TKE7N56.1 size=1017296 2024-09-12T00:36:28.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.349+0000 7f030cb87780 1 < canceled multipart upload key=CUDFTXFBC862 upload=G1Z15TKE7N56 tag=ME52EEV715RI type=write size=3114448 2024-09-12T00:36:28.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.350+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~JZIHKOUDI8PE.0 size=1048576 2024-09-12T00:36:28.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.352+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~JZIHKOUDI8PE.1 size=1048576 2024-09-12T00:36:28.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.354+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~JZIHKOUDI8PE.2 size=931439 2024-09-12T00:36:28.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.354+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=JZIHKOUDI8PE tag=4D9T25JDQCBB type=write size=4077167 2024-09-12T00:36:28.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.354+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=08RAFBHTBMW7 type=del 2024-09-12T00:36:28.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.356+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~NTQW9NCSEI18.0 size=1048576 2024-09-12T00:36:28.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.358+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~NTQW9NCSEI18.1 size=1048576 2024-09-12T00:36:28.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.359+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~NTQW9NCSEI18.2 size=171978 2024-09-12T00:36:28.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.359+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=NTQW9NCSEI18 tag=UXJY122A8UG2 type=write size=3317706 2024-09-12T00:36:28.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.361+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~R72D2OLBYQ2S.0 size=1048576 2024-09-12T00:36:28.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.361+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~R72D2OLBYQ2S.1 size=1048576 2024-09-12T00:36:28.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.362+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~R72D2OLBYQ2S.2 size=903391 2024-09-12T00:36:28.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.364+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=R72D2OLBYQ2S tag=2WN51VROLGJ8 type=write size=4049119 2024-09-12T00:36:28.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.367+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~Z27DZEFVSQD3.0 size=1048576 2024-09-12T00:36:28.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.368+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~Z27DZEFVSQD3.1 size=990901 2024-09-12T00:36:28.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.368+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=Z27DZEFVSQD3 tag=MHUC7S8U93RC type=write size=3088053 2024-09-12T00:36:28.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.369+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~7S8QNAFIOYSB.0 size=1048576 2024-09-12T00:36:28.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.370+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~7S8QNAFIOYSB.1 size=1048576 2024-09-12T00:36:28.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.371+0000 7f030cb87780 1 < completed part key=_multipart_1PLGUJCB6J0V.2~7S8QNAFIOYSB.2 size=469641 2024-09-12T00:36:28.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.373+0000 7f030cb87780 1 < completed multipart upload key=1PLGUJCB6J0V upload=7S8QNAFIOYSB tag=P87WF8AWFYQF type=write size=3615369 2024-09-12T00:36:28.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.375+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=BV8TFWXPBV1N type=write size=550095 2024-09-12T00:36:28.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.377+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~QTOAEXIKA0F9.0 size=1048576 2024-09-12T00:36:28.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.378+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~QTOAEXIKA0F9.1 size=1048576 2024-09-12T00:36:28.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.379+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~QTOAEXIKA0F9.2 size=826858 2024-09-12T00:36:28.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.382+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=QTOAEXIKA0F9 tag=K7D4NCQKMPPV type=write size=3972586 2024-09-12T00:36:28.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.383+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~GFU48XRRLLAQ.0 size=1048576 2024-09-12T00:36:28.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.384+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~GFU48XRRLLAQ.1 size=688791 2024-09-12T00:36:28.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.384+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=GFU48XRRLLAQ tag=RXHZQV2601UA type=write size=2785943 2024-09-12T00:36:28.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.387+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=RYXXVH7HACQR type=del 2024-09-12T00:36:28.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.388+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~IU61ZT3X0TJF.0 size=691627 2024-09-12T00:36:28.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.388+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=IU61ZT3X0TJF tag=V962TAME5BFT type=write size=1740203 2024-09-12T00:36:28.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.390+0000 7f030cb87780 1 < completed write operation key=800OHA7UURC4 tag=UABUFL2VQVDA type=write size=878738 2024-09-12T00:36:28.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.393+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~2LT98FPA2U5T.0 size=1048576 2024-09-12T00:36:28.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.394+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~2LT98FPA2U5T.1 size=1048576 2024-09-12T00:36:28.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.395+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~2LT98FPA2U5T.2 size=899411 2024-09-12T00:36:28.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.395+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=2LT98FPA2U5T tag=K3QIN34ZU4EI type=write size=4045139 2024-09-12T00:36:28.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.396+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=0I4A133VG7PV type=del 2024-09-12T00:36:28.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.398+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~WLGH4L8V2T67.0 size=1048576 2024-09-12T00:36:28.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.400+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~WLGH4L8V2T67.1 size=433096 2024-09-12T00:36:28.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.400+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=WLGH4L8V2T67 tag=D33RZFN09F04 type=write size=2530248 2024-09-12T00:36:28.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.402+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~5VVFIZZ7N38Z.0 size=1048576 2024-09-12T00:36:28.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.402+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~5VVFIZZ7N38Z.1 size=1048576 2024-09-12T00:36:28.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.403+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~5VVFIZZ7N38Z.2 size=372952 2024-09-12T00:36:28.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.406+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=5VVFIZZ7N38Z tag=I1TW5PBSUSY8 type=write size=3518680 2024-09-12T00:36:28.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.407+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=IYJ6M2UDAM9Z type=del size=308685 2024-09-12T00:36:28.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.409+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~XK0W99KKJW2P.0 size=1048576 2024-09-12T00:36:28.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.409+0000 7f030cb87780 1 < canceled part key=_multipart_INFFH9R3EFRY.2~XK0W99KKJW2P.1 size=1048576 2024-09-12T00:36:28.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.409+0000 7f030cb87780 1 < canceled part key=_multipart_INFFH9R3EFRY.2~XK0W99KKJW2P.2 size=407308 2024-09-12T00:36:28.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.411+0000 7f030cb87780 1 < canceled multipart upload key=INFFH9R3EFRY upload=XK0W99KKJW2P tag=QIGFIWK4DCFK type=write size=3553036 2024-09-12T00:36:28.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.413+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~TKVWUW2HJX3H.0 size=1048576 2024-09-12T00:36:28.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.414+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~TKVWUW2HJX3H.1 size=211481 2024-09-12T00:36:28.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.414+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=TKVWUW2HJX3H tag=E8D2B4L49YI0 type=write size=2308633 2024-09-12T00:36:28.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.417+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~R3Y4PCBIRGPU.0 size=899697 2024-09-12T00:36:28.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.419+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=R3Y4PCBIRGPU tag=J49UBFC4NAMM type=write size=1948273 2024-09-12T00:36:28.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.419+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=YQYNLHFD997M type=del size=599934 2024-09-12T00:36:28.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.422+0000 7f030cb87780 1 < suggested remove operation key=92GDVW0Q8VKQ tag=JQDPFUI0NK99 type=write 2024-09-12T00:36:28.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.426+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~GA8PRZHF61SC.0 size=1048576 2024-09-12T00:36:28.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.427+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~GA8PRZHF61SC.1 size=1019165 2024-09-12T00:36:28.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.427+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=GA8PRZHF61SC tag=J080LXSLISV0 type=write size=3116317 2024-09-12T00:36:28.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.427+0000 7f030cb87780 1 < canceled operation key=JRPD5AAK84ZD tag=TJZC7YQSSKKB type=write size=588488 2024-09-12T00:36:28.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.430+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~Y9R5Y1X64ICZ.0 size=705131 2024-09-12T00:36:28.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.430+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=Y9R5Y1X64ICZ tag=594QJ82LHUNB type=write size=1753707 2024-09-12T00:36:28.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.431+0000 7f030cb87780 1 < completed write operation key=HUDEU16YTO0Y tag=TB98YHCCRIZY type=write size=990836 2024-09-12T00:36:28.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.434+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=3BSLSSDO80J4 type=del size=1652575 2024-09-12T00:36:28.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.436+0000 7f030cb87780 1 < suggested update operation key=V0OLIRP3KH40 tag=VECSDR3I2UF4 type=del size=3357801 2024-09-12T00:36:28.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.437+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=SIBER9R39IM9 type=del size=3140858 2024-09-12T00:36:28.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.441+0000 7f030cb87780 1 < suggested update operation key=ZQD0491BHJPM tag=2PU9NDA4PQ1B type=del size=3383401 2024-09-12T00:36:28.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.444+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~KPKIY5YVE9V1.0 size=1048576 2024-09-12T00:36:28.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.445+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~KPKIY5YVE9V1.1 size=47245 2024-09-12T00:36:28.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.445+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=KPKIY5YVE9V1 tag=3G40QN16LKHV type=write size=2144397 2024-09-12T00:36:28.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.445+0000 7f030cb87780 1 < canceled part key=_multipart_9MCRD2G3MZIT.2~JZIHKOUDI8PE.0 size=1048576 2024-09-12T00:36:28.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.445+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~JZIHKOUDI8PE.1 size=1048576 2024-09-12T00:36:28.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.446+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~JZIHKOUDI8PE.2 size=931439 2024-09-12T00:36:28.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.449+0000 7f030cb87780 1 < canceled multipart upload key=9MCRD2G3MZIT upload=JZIHKOUDI8PE tag=4D9T25JDQCBB type=write size=4077167 2024-09-12T00:36:28.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.450+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=K3RSL58ZHOMH type=del size=284144 2024-09-12T00:36:28.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.451+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~NTQW9NCSEI18.0 size=1048576 2024-09-12T00:36:28.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.452+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~NTQW9NCSEI18.1 size=1048576 2024-09-12T00:36:28.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.454+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~NTQW9NCSEI18.2 size=171978 2024-09-12T00:36:28.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.457+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=NTQW9NCSEI18 tag=UXJY122A8UG2 type=write size=3317706 2024-09-12T00:36:28.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.460+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=XYYH99W11S1W type=del size=112329 2024-09-12T00:36:28.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.461+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~Z27DZEFVSQD3.0 size=1048576 2024-09-12T00:36:28.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.463+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~Z27DZEFVSQD3.1 size=990901 2024-09-12T00:36:28.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.465+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=Z27DZEFVSQD3 tag=MHUC7S8U93RC type=write size=3088053 2024-09-12T00:36:28.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.466+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=M8UYS2E4AC5X type=del size=2143180 2024-09-12T00:36:28.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.470+0000 7f030cb87780 1 < suggested update operation key=OR439FK5L43V tag=BV8TFWXPBV1N type=write size=550095 2024-09-12T00:36:28.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.470+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=1WVQB0W74V6E type=del size=2835529 2024-09-12T00:36:28.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.471+0000 7f030cb87780 1 < canceled part key=_multipart_ZQD0491BHJPM.2~GFU48XRRLLAQ.0 size=1048576 2024-09-12T00:36:28.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.473+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~GFU48XRRLLAQ.1 size=688791 2024-09-12T00:36:28.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.475+0000 7f030cb87780 1 < canceled multipart upload key=ZQD0491BHJPM upload=GFU48XRRLLAQ tag=RXHZQV2601UA type=write size=2785943 2024-09-12T00:36:28.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.477+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=0O240XT2SL3S type=del size=740723 2024-09-12T00:36:28.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.477+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~IU61ZT3X0TJF.0 size=691627 2024-09-12T00:36:28.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.481+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=IU61ZT3X0TJF tag=V962TAME5BFT type=write size=1740203 2024-09-12T00:36:28.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.482+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=QMADL55V7EMI type=del size=2828168 2024-09-12T00:36:28.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.483+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~2LT98FPA2U5T.0 size=1048576 2024-09-12T00:36:28.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.485+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~2LT98FPA2U5T.1 size=1048576 2024-09-12T00:36:28.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.486+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~2LT98FPA2U5T.2 size=899411 2024-09-12T00:36:28.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.488+0000 7f030cb87780 1 < completed multipart upload key=3W7ANGL92ZF0 upload=2LT98FPA2U5T tag=K3QIN34ZU4EI type=write size=4045139 2024-09-12T00:36:28.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.489+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=XOJKOTR65GIZ type=del size=3131524 2024-09-12T00:36:28.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.491+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~WLGH4L8V2T67.0 size=1048576 2024-09-12T00:36:28.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.491+0000 7f030cb87780 1 < canceled part key=_multipart_IY156CJWG2TB.2~WLGH4L8V2T67.1 size=433096 2024-09-12T00:36:28.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.494+0000 7f030cb87780 1 < canceled multipart upload key=IY156CJWG2TB upload=WLGH4L8V2T67 tag=D33RZFN09F04 type=write size=2530248 2024-09-12T00:36:28.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.496+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~IQ4YOASXLCK2.0 size=780628 2024-09-12T00:36:28.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.496+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=IQ4YOASXLCK2 tag=MXAOIUF6JOR7 type=write size=1829204 2024-09-12T00:36:28.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.497+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=IYJ6M2UDAM9Z type=del 2024-09-12T00:36:28.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.501+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~GLO7MOIUEMLF.0 size=1000736 2024-09-12T00:36:28.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.501+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=GLO7MOIUEMLF tag=J5FKYNOEL1JO type=write size=2049312 2024-09-12T00:36:28.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.502+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~TKVWUW2HJX3H.0 size=1048576 2024-09-12T00:36:28.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.504+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~TKVWUW2HJX3H.1 size=211481 2024-09-12T00:36:28.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.506+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=TKVWUW2HJX3H tag=E8D2B4L49YI0 type=write size=2308633 2024-09-12T00:36:28.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.509+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~1DHCW95J3JRX.0 size=1048576 2024-09-12T00:36:28.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.509+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~1DHCW95J3JRX.1 size=903938 2024-09-12T00:36:28.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.509+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=1DHCW95J3JRX tag=5VRCNTQRSJFH type=write size=3001090 2024-09-12T00:36:28.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.512+0000 7f030cb87780 1 < suggested update operation key=CUDFTXFBC862 tag=YQYNLHFD997M type=del size=599934 2024-09-12T00:36:28.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.515+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~YEPY7EAOJ9TL.0 size=1048576 2024-09-12T00:36:28.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.516+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~YEPY7EAOJ9TL.1 size=1048576 2024-09-12T00:36:28.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.517+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~YEPY7EAOJ9TL.2 size=709164 2024-09-12T00:36:28.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.517+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=YEPY7EAOJ9TL tag=UAONQKO71YDX type=write size=3854892 2024-09-12T00:36:28.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.518+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~GA8PRZHF61SC.0 size=1048576 2024-09-12T00:36:28.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.519+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~GA8PRZHF61SC.1 size=1019165 2024-09-12T00:36:28.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.523+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=GA8PRZHF61SC tag=J080LXSLISV0 type=write size=3116317 2024-09-12T00:36:28.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.523+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=RVXRKJK3W1KS type=del size=559954 2024-09-12T00:36:28.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.525+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~Y9R5Y1X64ICZ.0 size=705131 2024-09-12T00:36:28.527 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.529+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=Y9R5Y1X64ICZ tag=594QJ82LHUNB type=write size=1753707 2024-09-12T00:36:28.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.531+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~QE9C02OYC9E9.0 size=1048576 2024-09-12T00:36:28.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.533+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~QE9C02OYC9E9.1 size=1048576 2024-09-12T00:36:28.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.533+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~QE9C02OYC9E9.2 size=166857 2024-09-12T00:36:28.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.533+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=QE9C02OYC9E9 tag=RZDPF8FPQGOD type=write size=3312585 2024-09-12T00:36:28.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.534+0000 7f030cb87780 -1 < failed to complete operation key=OR439FK5L43V tag=3BSLSSDO80J4 type=del size=1652575: (22) Invalid argument 2024-09-12T00:36:28.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.536+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=BBZMRB45RTSX type=del size=3163485 2024-09-12T00:36:28.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.537+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=SIBER9R39IM9 type=del 2024-09-12T00:36:28.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.540+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=22VGO27126XR type=del size=2422866 2024-09-12T00:36:28.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.541+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~KPKIY5YVE9V1.0 size=1048576 2024-09-12T00:36:28.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.542+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~KPKIY5YVE9V1.1 size=47245 2024-09-12T00:36:28.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.545+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=KPKIY5YVE9V1 tag=3G40QN16LKHV type=write size=2144397 2024-09-12T00:36:28.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.547+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~Z43Z5IPJVKCC.0 size=1048576 2024-09-12T00:36:28.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.549+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~Z43Z5IPJVKCC.1 size=1048576 2024-09-12T00:36:28.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.550+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~Z43Z5IPJVKCC.2 size=593602 2024-09-12T00:36:28.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.550+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=Z43Z5IPJVKCC tag=9EKBVWT65KY3 type=write size=3739330 2024-09-12T00:36:28.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.553+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=K3RSL58ZHOMH type=del 2024-09-12T00:36:28.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.556+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~PXAACHNBS75J.0 size=1048576 2024-09-12T00:36:28.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.557+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~PXAACHNBS75J.1 size=531928 2024-09-12T00:36:28.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.557+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=PXAACHNBS75J tag=MDIFCSY53N1F type=write size=2629080 2024-09-12T00:36:28.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.558+0000 7f030cb87780 -1 < failed to complete operation key=OR439FK5L43V tag=XYYH99W11S1W type=del size=112329: (22) Invalid argument 2024-09-12T00:36:28.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.560+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~BW8UR39YSSXR.0 size=1048576 2024-09-12T00:36:28.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.561+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~BW8UR39YSSXR.1 size=174155 2024-09-12T00:36:28.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.562+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=BW8UR39YSSXR tag=LSHWL5JGUWNL type=write size=2271307 2024-09-12T00:36:28.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.564+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=M8UYS2E4AC5X type=del 2024-09-12T00:36:28.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.565+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=HNDKZ418CEXX type=del size=1461266 2024-09-12T00:36:28.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.566+0000 7f030cb87780 1 < canceled operation key=V87B6SDB1HFZ tag=1WVQB0W74V6E type=del size=2835529 2024-09-12T00:36:28.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.570+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~B7HSG25Z3402.0 size=707957 2024-09-12T00:36:28.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.570+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=B7HSG25Z3402 tag=YOEVPMP0U13T type=write size=1756533 2024-09-12T00:36:28.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.571+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=0O240XT2SL3S type=del 2024-09-12T00:36:28.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.573+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=CN9WRB2TDMCQ type=del size=49022 2024-09-12T00:36:28.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.574+0000 7f030cb87780 1 < canceled operation key=IHTFI7W4A6JT tag=QMADL55V7EMI type=del size=2828168 2024-09-12T00:36:28.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.577+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=37H2G14O4EI7 type=del size=1677872 2024-09-12T00:36:28.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.580+0000 7f030cb87780 1 < suggested remove operation key=UFYMVGL264T8 tag=XOJKOTR65GIZ type=del 2024-09-12T00:36:28.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.581+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~F5MW71QW3XYV.0 size=1048576 2024-09-12T00:36:28.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.582+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~F5MW71QW3XYV.1 size=121603 2024-09-12T00:36:28.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.583+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=F5MW71QW3XYV tag=MWXWQN7Y9W9R type=write size=2218755 2024-09-12T00:36:28.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.584+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~IQ4YOASXLCK2.0 size=780628 2024-09-12T00:36:28.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.586+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=IQ4YOASXLCK2 tag=MXAOIUF6JOR7 type=write size=1829204 2024-09-12T00:36:28.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.590+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~ONNVBCJ9ZGYR.0 size=1048576 2024-09-12T00:36:28.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.590+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~ONNVBCJ9ZGYR.1 size=1048576 2024-09-12T00:36:28.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.591+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~ONNVBCJ9ZGYR.2 size=480353 2024-09-12T00:36:28.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.591+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=ONNVBCJ9ZGYR tag=0JNO8TUXEBDR type=write size=3626081 2024-09-12T00:36:28.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.594+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~GLO7MOIUEMLF.0 size=1000736 2024-09-12T00:36:28.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.595+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=GLO7MOIUEMLF tag=J5FKYNOEL1JO type=write size=2049312 2024-09-12T00:36:28.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.596+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=BAY0MG6N0SAQ type=del size=1273270 2024-09-12T00:36:28.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.600+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~1DHCW95J3JRX.0 size=1048576 2024-09-12T00:36:28.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.601+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~1DHCW95J3JRX.1 size=903938 2024-09-12T00:36:28.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.603+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=1DHCW95J3JRX tag=5VRCNTQRSJFH type=write size=3001090 2024-09-12T00:36:28.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.606+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~NGMOEG5YSMR8.0 size=549748 2024-09-12T00:36:28.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.606+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=NGMOEG5YSMR8 tag=MJ2SIIO1SPH2 type=write size=1598324 2024-09-12T00:36:28.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.606+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~YEPY7EAOJ9TL.0 size=1048576 2024-09-12T00:36:28.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.607+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~YEPY7EAOJ9TL.1 size=1048576 2024-09-12T00:36:28.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.609+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~YEPY7EAOJ9TL.2 size=709164 2024-09-12T00:36:28.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.612+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=YEPY7EAOJ9TL tag=UAONQKO71YDX type=write size=3854892 2024-09-12T00:36:28.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.612+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=7J59S6U66OHL type=del size=3662967 2024-09-12T00:36:28.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.615+0000 7f030cb87780 1 < suggested remove operation key=JPEIGLC162K3 tag=RVXRKJK3W1KS type=del 2024-09-12T00:36:28.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.618+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~AJAQYZBGOYTO.0 size=1048576 2024-09-12T00:36:28.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.620+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~AJAQYZBGOYTO.1 size=1048576 2024-09-12T00:36:28.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.621+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~AJAQYZBGOYTO.2 size=331198 2024-09-12T00:36:28.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.621+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=AJAQYZBGOYTO tag=QVKMCYGK4IUO type=write size=3476926 2024-09-12T00:36:28.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.622+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~QE9C02OYC9E9.0 size=1048576 2024-09-12T00:36:28.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.624+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~QE9C02OYC9E9.1 size=1048576 2024-09-12T00:36:28.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.625+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~QE9C02OYC9E9.2 size=166857 2024-09-12T00:36:28.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.627+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=QE9C02OYC9E9 tag=RZDPF8FPQGOD type=write size=3312585 2024-09-12T00:36:28.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.630+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~MQPUZX76ASXY.0 size=1048576 2024-09-12T00:36:28.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.631+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~MQPUZX76ASXY.1 size=1048576 2024-09-12T00:36:28.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.632+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~MQPUZX76ASXY.2 size=116362 2024-09-12T00:36:28.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.632+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=MQPUZX76ASXY tag=NPLS36UN4DIC type=write size=3262090 2024-09-12T00:36:28.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.633+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=BBZMRB45RTSX type=del 2024-09-12T00:36:28.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.635+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=FI56KEB3JND3 type=del size=1427948 2024-09-12T00:36:28.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.636+0000 7f030cb87780 1 < completed delete operation key=CUDFTXFBC862 tag=22VGO27126XR type=del 2024-09-12T00:36:28.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.638+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=YN1S0N7U7KB2 type=write size=425204 2024-09-12T00:36:28.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.640+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~Z43Z5IPJVKCC.0 size=1048576 2024-09-12T00:36:28.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.643+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~Z43Z5IPJVKCC.1 size=1048576 2024-09-12T00:36:28.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.644+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~Z43Z5IPJVKCC.2 size=593602 2024-09-12T00:36:28.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.647+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=Z43Z5IPJVKCC tag=9EKBVWT65KY3 type=write size=3739330 2024-09-12T00:36:28.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.648+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=PJAR3X06FIHS type=del size=800269 2024-09-12T00:36:28.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.649+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~PXAACHNBS75J.0 size=1048576 2024-09-12T00:36:28.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.651+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~PXAACHNBS75J.1 size=531928 2024-09-12T00:36:28.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.654+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=PXAACHNBS75J tag=MDIFCSY53N1F type=write size=2629080 2024-09-12T00:36:28.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.655+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=4JXKF8S2UPUD type=del size=744309 2024-09-12T00:36:28.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.656+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~BW8UR39YSSXR.0 size=1048576 2024-09-12T00:36:28.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.657+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~BW8UR39YSSXR.1 size=174155 2024-09-12T00:36:28.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.660+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=BW8UR39YSSXR tag=LSHWL5JGUWNL type=write size=2271307 2024-09-12T00:36:28.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.661+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=IYPR5412K1JW type=del size=168473 2024-09-12T00:36:28.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.663+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=HNDKZ418CEXX type=del 2024-09-12T00:36:28.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.665+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~2SW2455P7ZT0.0 size=1048576 2024-09-12T00:36:28.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.666+0000 7f030cb87780 1 > prepared part key=_multipart_327RDLIWLVRO.2~2SW2455P7ZT0.1 size=740726 2024-09-12T00:36:28.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.666+0000 7f030cb87780 1 > prepared multipart upload key=327RDLIWLVRO upload=2SW2455P7ZT0 tag=YN9405KTS234 type=write size=2837878 2024-09-12T00:36:28.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.669+0000 7f030cb87780 1 < completed part key=_multipart_IHTFI7W4A6JT.2~B7HSG25Z3402.0 size=707957 2024-09-12T00:36:28.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.671+0000 7f030cb87780 1 < completed multipart upload key=IHTFI7W4A6JT upload=B7HSG25Z3402 tag=YOEVPMP0U13T type=write size=1756533 2024-09-12T00:36:28.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.674+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~GB0TBJALOGME.0 size=1048576 2024-09-12T00:36:28.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.674+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~GB0TBJALOGME.1 size=1004824 2024-09-12T00:36:28.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.674+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=GB0TBJALOGME tag=YLOX6FP9R4M9 type=write size=3101976 2024-09-12T00:36:28.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.677+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=CN9WRB2TDMCQ type=del 2024-09-12T00:36:28.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.677+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=EI6RT9PO349A type=del size=1554415 2024-09-12T00:36:28.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.680+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=37H2G14O4EI7 type=del 2024-09-12T00:36:28.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.683+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~A31GIRFQC906.0 size=1048576 2024-09-12T00:36:28.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.683+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~A31GIRFQC906.1 size=1048576 2024-09-12T00:36:28.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.684+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~A31GIRFQC906.2 size=1002314 2024-09-12T00:36:28.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.684+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=A31GIRFQC906 tag=QUJ1Q1OZ4ZS4 type=write size=4148042 2024-09-12T00:36:28.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.686+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~F5MW71QW3XYV.0 size=1048576 2024-09-12T00:36:28.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.688+0000 7f030cb87780 1 < completed part key=_multipart_CUDFTXFBC862.2~F5MW71QW3XYV.1 size=121603 2024-09-12T00:36:28.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.690+0000 7f030cb87780 1 < completed multipart upload key=CUDFTXFBC862 upload=F5MW71QW3XYV tag=MWXWQN7Y9W9R type=write size=2218755 2024-09-12T00:36:28.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.691+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=LVZI08G7ZENP type=del size=2499595 2024-09-12T00:36:28.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.693+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~ONNVBCJ9ZGYR.0 size=1048576 2024-09-12T00:36:28.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.693+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~ONNVBCJ9ZGYR.1 size=1048576 2024-09-12T00:36:28.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.694+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~ONNVBCJ9ZGYR.2 size=480353 2024-09-12T00:36:28.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.697+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=ONNVBCJ9ZGYR tag=0JNO8TUXEBDR type=write size=3626081 2024-09-12T00:36:28.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.700+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~1J83S2A13UZO.0 size=1048576 2024-09-12T00:36:28.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.701+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~1J83S2A13UZO.1 size=865080 2024-09-12T00:36:28.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.701+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=1J83S2A13UZO tag=822W8UYFIR81 type=write size=2962232 2024-09-12T00:36:28.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.702+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=BAY0MG6N0SAQ type=del 2024-09-12T00:36:28.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.705+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=7VMQF5WXOJVP type=del size=103915 2024-09-12T00:36:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.705+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~NGMOEG5YSMR8.0 size=549748 2024-09-12T00:36:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.709+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=NGMOEG5YSMR8 tag=MJ2SIIO1SPH2 type=write size=1598324 2024-09-12T00:36:28.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.710+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=LFP0YR5KH7JX type=del size=1511555 2024-09-12T00:36:28.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.713+0000 7f030cb87780 1 < suggested update operation key=327RDLIWLVRO tag=7J59S6U66OHL type=del size=3662967 2024-09-12T00:36:28.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.714+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=ZLSTJBFZP1SK type=del size=2063704 2024-09-12T00:36:28.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.716+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~AJAQYZBGOYTO.0 size=1048576 2024-09-12T00:36:28.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.716+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~AJAQYZBGOYTO.1 size=1048576 2024-09-12T00:36:28.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.718+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~AJAQYZBGOYTO.2 size=331198 2024-09-12T00:36:28.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.721+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=AJAQYZBGOYTO tag=QVKMCYGK4IUO type=write size=3476926 2024-09-12T00:36:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.723+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~HBA3NEJMXHIG.0 size=959404 2024-09-12T00:36:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.723+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=HBA3NEJMXHIG tag=K4ILYAA5MIYA type=write size=2007980 2024-09-12T00:36:28.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.724+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~MQPUZX76ASXY.0 size=1048576 2024-09-12T00:36:28.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.724+0000 7f030cb87780 1 < canceled part key=_multipart_9MCRD2G3MZIT.2~MQPUZX76ASXY.1 size=1048576 2024-09-12T00:36:28.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.725+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~MQPUZX76ASXY.2 size=116362 2024-09-12T00:36:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.728+0000 7f030cb87780 1 < canceled multipart upload key=9MCRD2G3MZIT upload=MQPUZX76ASXY tag=NPLS36UN4DIC type=write size=3262090 2024-09-12T00:36:28.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.730+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=UXZWF3UJX8FO type=del size=3656917 2024-09-12T00:36:28.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.730+0000 7f030cb87780 1 < canceled operation key=3W7ANGL92ZF0 tag=FI56KEB3JND3 type=del size=1427948 2024-09-12T00:36:28.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.734+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~JGYJJKN3WDHT.0 size=1048576 2024-09-12T00:36:28.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.735+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~JGYJJKN3WDHT.1 size=1048576 2024-09-12T00:36:28.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.736+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~JGYJJKN3WDHT.2 size=695749 2024-09-12T00:36:28.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.736+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=JGYJJKN3WDHT tag=26UWPKE97HZC type=write size=3841477 2024-09-12T00:36:28.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.739+0000 7f030cb87780 1 < suggested update operation key=IY156CJWG2TB tag=YN1S0N7U7KB2 type=write size=425204 2024-09-12T00:36:28.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.742+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~S8BX5YNTFUGY.0 size=1048576 2024-09-12T00:36:28.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.743+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~S8BX5YNTFUGY.1 size=808157 2024-09-12T00:36:28.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.743+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=S8BX5YNTFUGY tag=LGSJ8DZXYLI8 type=write size=2905309 2024-09-12T00:36:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.745+0000 7f030cb87780 1 < suggested update operation key=86TWUAZAHI4I tag=PJAR3X06FIHS type=del size=800269 2024-09-12T00:36:28.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.746+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=THD8F1XHKSA3 type=del size=1818223 2024-09-12T00:36:28.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.748+0000 7f030cb87780 1 < completed delete operation key=IHTFI7W4A6JT tag=4JXKF8S2UPUD type=del 2024-09-12T00:36:28.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.749+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=VF9TWU2MHBSR type=del size=3045984 2024-09-12T00:36:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.750+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=IYPR5412K1JW type=del 2024-09-12T00:36:28.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.753+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~95RXPM38ZX9U.0 size=1048576 2024-09-12T00:36:28.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.754+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~95RXPM38ZX9U.1 size=1048576 2024-09-12T00:36:28.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.755+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~95RXPM38ZX9U.2 size=961354 2024-09-12T00:36:28.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.755+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=95RXPM38ZX9U tag=SXJGS7T2NY54 type=write size=4107082 2024-09-12T00:36:28.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.757+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~2SW2455P7ZT0.0 size=1048576 2024-09-12T00:36:28.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.757+0000 7f030cb87780 1 < completed part key=_multipart_327RDLIWLVRO.2~2SW2455P7ZT0.1 size=740726 2024-09-12T00:36:28.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.760+0000 7f030cb87780 1 < completed multipart upload key=327RDLIWLVRO upload=2SW2455P7ZT0 tag=YN9405KTS234 type=write size=2837878 2024-09-12T00:36:28.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.763+0000 7f030cb87780 1 > prepared part key=_multipart_92GDVW0Q8VKQ.2~I5D3GD77FX5P.0 size=298511 2024-09-12T00:36:28.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.763+0000 7f030cb87780 1 > prepared multipart upload key=92GDVW0Q8VKQ upload=I5D3GD77FX5P tag=OFUSS4ZWJ5WX type=write size=1347087 2024-09-12T00:36:28.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.764+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~GB0TBJALOGME.0 size=1048576 2024-09-12T00:36:28.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.765+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~GB0TBJALOGME.1 size=1004824 2024-09-12T00:36:28.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.769+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=GB0TBJALOGME tag=YLOX6FP9R4M9 type=write size=3101976 2024-09-12T00:36:28.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.772+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~VU2L28XPIP6J.0 size=1048576 2024-09-12T00:36:28.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.772+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~VU2L28XPIP6J.1 size=659010 2024-09-12T00:36:28.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.772+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=VU2L28XPIP6J tag=1IZZ04HLP0MW type=write size=2756162 2024-09-12T00:36:28.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.775+0000 7f030cb87780 1 < completed delete operation key=HUDEU16YTO0Y tag=EI6RT9PO349A type=del 2024-09-12T00:36:28.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.775+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=37MQ9EBW2XM8 type=del size=3947706 2024-09-12T00:36:28.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.778+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~A31GIRFQC906.0 size=1048576 2024-09-12T00:36:28.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.779+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~A31GIRFQC906.1 size=1048576 2024-09-12T00:36:28.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.781+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~A31GIRFQC906.2 size=1002314 2024-09-12T00:36:28.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.783+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=A31GIRFQC906 tag=QUJ1Q1OZ4ZS4 type=write size=4148042 2024-09-12T00:36:28.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.786+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~RJOM1O6VN2Z5.0 size=1048576 2024-09-12T00:36:28.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.788+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~RJOM1O6VN2Z5.1 size=1048576 2024-09-12T00:36:28.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.788+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~RJOM1O6VN2Z5.2 size=128051 2024-09-12T00:36:28.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.788+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=RJOM1O6VN2Z5 tag=ALJP390AY3GK type=write size=3273779 2024-09-12T00:36:28.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.791+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=LVZI08G7ZENP type=del 2024-09-12T00:36:28.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.791+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=P5BZL7J07LKE type=del size=1918783 2024-09-12T00:36:28.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.793+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~1J83S2A13UZO.0 size=1048576 2024-09-12T00:36:28.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.795+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~1J83S2A13UZO.1 size=865080 2024-09-12T00:36:28.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.796+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=1J83S2A13UZO tag=822W8UYFIR81 type=write size=2962232 2024-09-12T00:36:28.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.797+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=1GEXIJNE7L7L type=del size=1828390 2024-09-12T00:36:28.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.801+0000 7f030cb87780 1 < suggested remove operation key=HUDEU16YTO0Y tag=7VMQF5WXOJVP type=del 2024-09-12T00:36:28.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.802+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=2S9DJQ6DKY2N type=del size=135707 2024-09-12T00:36:28.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.804+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=LFP0YR5KH7JX type=del 2024-09-12T00:36:28.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.805+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=LILO46M2P63Z type=del size=301071 2024-09-12T00:36:28.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.807+0000 7f030cb87780 1 < canceled operation key=POC8YA58U55N tag=ZLSTJBFZP1SK type=del size=2063704 2024-09-12T00:36:28.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.809+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=T2G30OCNF30E type=del size=3459582 2024-09-12T00:36:28.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.810+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~HBA3NEJMXHIG.0 size=959404 2024-09-12T00:36:28.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.813+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=HBA3NEJMXHIG tag=K4ILYAA5MIYA type=write size=2007980 2024-09-12T00:36:28.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.813+0000 7f030cb87780 1 > prepared operation key=CUDFTXFBC862 tag=7QK560RIIVGR type=del size=915226 2024-09-12T00:36:28.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.816+0000 7f030cb87780 1 < suggested remove operation key=JRPD5AAK84ZD tag=UXZWF3UJX8FO type=del 2024-09-12T00:36:28.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.818+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=DVXRZW68C102 type=del size=821843 2024-09-12T00:36:28.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.819+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~JGYJJKN3WDHT.0 size=1048576 2024-09-12T00:36:28.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.820+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~JGYJJKN3WDHT.1 size=1048576 2024-09-12T00:36:28.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.821+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~JGYJJKN3WDHT.2 size=695749 2024-09-12T00:36:28.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.824+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=JGYJJKN3WDHT tag=26UWPKE97HZC type=write size=3841477 2024-09-12T00:36:28.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.826+0000 7f030cb87780 1 > prepared operation key=N3KD1UVUVM95 tag=2BA6MWUFVD5L type=del size=1259733 2024-09-12T00:36:28.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.826+0000 7f030cb87780 1 < canceled part key=_multipart_INFFH9R3EFRY.2~S8BX5YNTFUGY.0 size=1048576 2024-09-12T00:36:28.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.826+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~S8BX5YNTFUGY.1 size=808157 2024-09-12T00:36:28.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.828+0000 7f030cb87780 1 < canceled multipart upload key=INFFH9R3EFRY upload=S8BX5YNTFUGY tag=LGSJ8DZXYLI8 type=write size=2905309 2024-09-12T00:36:28.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.830+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=YXAUCXWAF2VA type=write size=702981 2024-09-12T00:36:28.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.831+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=THD8F1XHKSA3 type=del 2024-09-12T00:36:28.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.833+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=KQRCBQ9JUMI8 type=del size=3895334 2024-09-12T00:36:28.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.835+0000 7f030cb87780 -1 < failed to complete operation key=HUDEU16YTO0Y tag=VF9TWU2MHBSR type=del size=3045984: (22) Invalid argument 2024-09-12T00:36:28.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.835+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=FU830GA0AZOU type=del size=1114686 2024-09-12T00:36:28.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.837+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~95RXPM38ZX9U.0 size=1048576 2024-09-12T00:36:28.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.838+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~95RXPM38ZX9U.1 size=1048576 2024-09-12T00:36:28.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.840+0000 7f030cb87780 1 < completed part key=_multipart_56I20YIPY82N.2~95RXPM38ZX9U.2 size=961354 2024-09-12T00:36:28.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.842+0000 7f030cb87780 1 < completed multipart upload key=56I20YIPY82N upload=95RXPM38ZX9U tag=SXJGS7T2NY54 type=write size=4107082 2024-09-12T00:36:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.843+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=X4LSP3UDIXC2 type=write size=856548 2024-09-12T00:36:28.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.845+0000 7f030cb87780 1 < completed part key=_multipart_92GDVW0Q8VKQ.2~I5D3GD77FX5P.0 size=298511 2024-09-12T00:36:28.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.846+0000 7f030cb87780 1 < completed multipart upload key=92GDVW0Q8VKQ upload=I5D3GD77FX5P tag=OFUSS4ZWJ5WX type=write size=1347087 2024-09-12T00:36:28.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.850+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~J5FYGOUDVO93.0 size=1048576 2024-09-12T00:36:28.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.851+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~J5FYGOUDVO93.1 size=618376 2024-09-12T00:36:28.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.851+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=J5FYGOUDVO93 tag=I6OEK4UDNILI type=write size=2715528 2024-09-12T00:36:28.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.851+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~VU2L28XPIP6J.0 size=1048576 2024-09-12T00:36:28.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.853+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~VU2L28XPIP6J.1 size=659010 2024-09-12T00:36:28.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.856+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=VU2L28XPIP6J tag=1IZZ04HLP0MW type=write size=2756162 2024-09-12T00:36:28.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.858+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~LC223EOUAYVJ.0 size=1048576 2024-09-12T00:36:28.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.860+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~LC223EOUAYVJ.1 size=1048576 2024-09-12T00:36:28.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.861+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~LC223EOUAYVJ.2 size=218882 2024-09-12T00:36:28.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.861+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=LC223EOUAYVJ tag=RMSVRR2C3P77 type=write size=3364610 2024-09-12T00:36:28.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.861+0000 7f030cb87780 1 < completed delete operation key=99OWKRGA8ZZN tag=37MQ9EBW2XM8 type=del 2024-09-12T00:36:28.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.863+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=EAL5V7GQ8INM type=del size=435306 2024-09-12T00:36:28.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.864+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~RJOM1O6VN2Z5.0 size=1048576 2024-09-12T00:36:28.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.868+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~RJOM1O6VN2Z5.1 size=1048576 2024-09-12T00:36:28.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.869+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~RJOM1O6VN2Z5.2 size=128051 2024-09-12T00:36:28.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.871+0000 7f030cb87780 1 < completed multipart upload key=POC8YA58U55N upload=RJOM1O6VN2Z5 tag=ALJP390AY3GK type=write size=3273779 2024-09-12T00:36:28.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.874+0000 7f030cb87780 1 > prepared part key=_multipart_U5CWO1EN8BFI.2~7WIQVEUKHAK9.0 size=102082 2024-09-12T00:36:28.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.874+0000 7f030cb87780 1 > prepared multipart upload key=U5CWO1EN8BFI upload=7WIQVEUKHAK9 tag=P7HS3M8LBGSP type=write size=1150658 2024-09-12T00:36:28.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.874+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=P5BZL7J07LKE type=del 2024-09-12T00:36:28.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.878+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~Z0EMTM8DFC9K.0 size=1048576 2024-09-12T00:36:28.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.878+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~Z0EMTM8DFC9K.1 size=1010952 2024-09-12T00:36:28.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.878+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=Z0EMTM8DFC9K tag=7S7WQS448YFT type=write size=3108104 2024-09-12T00:36:28.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.882+0000 7f030cb87780 1 < suggested update operation key=CUDFTXFBC862 tag=1GEXIJNE7L7L type=del size=1828390 2024-09-12T00:36:28.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.882+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=5G48H0TH68YE type=del size=3902450 2024-09-12T00:36:28.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.884+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=2S9DJQ6DKY2N type=del 2024-09-12T00:36:28.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.887+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=LNN369YDB531 type=del size=612943 2024-09-12T00:36:28.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.887+0000 7f030cb87780 1 < completed delete operation key=56I20YIPY82N tag=LILO46M2P63Z type=del 2024-09-12T00:36:28.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.889+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~QZLSOGXOMKCM.0 size=583915 2024-09-12T00:36:28.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.889+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=QZLSOGXOMKCM tag=IKPP5H5GOF30 type=write size=1632491 2024-09-12T00:36:28.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.892+0000 7f030cb87780 1 < completed delete operation key=1PLGUJCB6J0V tag=T2G30OCNF30E type=del 2024-09-12T00:36:28.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.894+0000 7f030cb87780 1 > prepared part key=_multipart_86TWUAZAHI4I.2~I17V9CKBZJTU.0 size=595274 2024-09-12T00:36:28.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.894+0000 7f030cb87780 1 > prepared multipart upload key=86TWUAZAHI4I upload=I17V9CKBZJTU tag=7U842J627OAP type=write size=1643850 2024-09-12T00:36:28.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.896+0000 7f030cb87780 1 < suggested remove operation key=CUDFTXFBC862 tag=7QK560RIIVGR type=del 2024-09-12T00:36:28.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.899+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=A1010W1Z6N60 type=del size=1890241 2024-09-12T00:36:28.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.900+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=DVXRZW68C102 type=del 2024-09-12T00:36:28.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.901+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=YNLU52JG2EQG type=write size=645859 2024-09-12T00:36:28.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.903+0000 7f030cb87780 1 < completed delete operation key=N3KD1UVUVM95 tag=2BA6MWUFVD5L type=del 2024-09-12T00:36:28.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.904+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=SU8JRJMY14WM type=del size=2081215 2024-09-12T00:36:28.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.906+0000 7f030cb87780 1 < completed write operation key=V87B6SDB1HFZ tag=YXAUCXWAF2VA type=write size=702981 2024-09-12T00:36:28.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.908+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=ACU3L5HC9JA4 type=del size=2914927 2024-09-12T00:36:28.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.908+0000 7f030cb87780 1 < completed delete operation key=QGSJ51GMQXVK tag=KQRCBQ9JUMI8 type=del 2024-09-12T00:36:28.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.911+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=ECYM895OHUX4 type=del size=704287 2024-09-12T00:36:28.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.912+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=FU830GA0AZOU type=del 2024-09-12T00:36:28.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.912+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=WUNKUXDWGXVM type=del size=2160153 2024-09-12T00:36:28.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.915+0000 7f030cb87780 1 < canceled operation key=ZQD0491BHJPM tag=X4LSP3UDIXC2 type=write size=856548 2024-09-12T00:36:28.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.916+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~6K2RH320VPUY.0 size=746562 2024-09-12T00:36:28.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.916+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=6K2RH320VPUY tag=VUUM3WFFBA68 type=write size=1795138 2024-09-12T00:36:28.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.919+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~J5FYGOUDVO93.0 size=1048576 2024-09-12T00:36:28.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.920+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~J5FYGOUDVO93.1 size=618376 2024-09-12T00:36:28.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.922+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=J5FYGOUDVO93 tag=I6OEK4UDNILI type=write size=2715528 2024-09-12T00:36:28.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.924+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=25F5VJMSJQTH type=del size=967422 2024-09-12T00:36:28.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.925+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~LC223EOUAYVJ.0 size=1048576 2024-09-12T00:36:28.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.925+0000 7f030cb87780 1 < canceled part key=_multipart_DLR6A7XOERHW.2~LC223EOUAYVJ.1 size=1048576 2024-09-12T00:36:28.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.925+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~LC223EOUAYVJ.2 size=218882 2024-09-12T00:36:28.927 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.929+0000 7f030cb87780 1 < canceled multipart upload key=DLR6A7XOERHW upload=LC223EOUAYVJ tag=RMSVRR2C3P77 type=write size=3364610 2024-09-12T00:36:28.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.931+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~IILRB98W92C9.0 size=1048576 2024-09-12T00:36:28.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.932+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~IILRB98W92C9.1 size=1048576 2024-09-12T00:36:28.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.934+0000 7f030cb87780 1 > prepared part key=_multipart_99OWKRGA8ZZN.2~IILRB98W92C9.2 size=788646 2024-09-12T00:36:28.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.934+0000 7f030cb87780 1 > prepared multipart upload key=99OWKRGA8ZZN upload=IILRB98W92C9 tag=S0Q6ZLWMNQ5Z type=write size=3934374 2024-09-12T00:36:28.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.934+0000 7f030cb87780 1 < completed delete operation key=327RDLIWLVRO tag=EAL5V7GQ8INM type=del 2024-09-12T00:36:28.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.937+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=MEFF608E8Z50 type=del size=3962111 2024-09-12T00:36:28.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.937+0000 7f030cb87780 1 < completed part key=_multipart_U5CWO1EN8BFI.2~7WIQVEUKHAK9.0 size=102082 2024-09-12T00:36:28.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.940+0000 7f030cb87780 1 < completed multipart upload key=U5CWO1EN8BFI upload=7WIQVEUKHAK9 tag=P7HS3M8LBGSP type=write size=1150658 2024-09-12T00:36:28.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.942+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=N7YDAQ5P7VI3 type=del size=1648512 2024-09-12T00:36:28.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.942+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~Z0EMTM8DFC9K.0 size=1048576 2024-09-12T00:36:28.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.944+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~Z0EMTM8DFC9K.1 size=1010952 2024-09-12T00:36:28.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.947+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=Z0EMTM8DFC9K tag=7S7WQS448YFT type=write size=3108104 2024-09-12T00:36:28.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.949+0000 7f030cb87780 1 > prepared part key=_multipart_CY2NS03IIUJJ.2~Z15HDN11TGZZ.0 size=250625 2024-09-12T00:36:28.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.949+0000 7f030cb87780 1 > prepared multipart upload key=CY2NS03IIUJJ upload=Z15HDN11TGZZ tag=LUCQOAJMCOAO type=write size=1299201 2024-09-12T00:36:28.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.950+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=5G48H0TH68YE type=del 2024-09-12T00:36:28.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.952+0000 7f030cb87780 1 > prepared operation key=86TWUAZAHI4I tag=AKX8DHREWRTX type=del size=2991564 2024-09-12T00:36:28.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.954+0000 7f030cb87780 1 < canceled operation key=6WHZRKLM3OLP tag=LNN369YDB531 type=del size=612943 2024-09-12T00:36:28.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.955+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=P7NGL0SYOYD5 type=del size=101680 2024-09-12T00:36:28.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.957+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~QZLSOGXOMKCM.0 size=583915 2024-09-12T00:36:28.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.958+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=QZLSOGXOMKCM tag=IKPP5H5GOF30 type=write size=1632491 2024-09-12T00:36:28.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.961+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~PYPFUKCWZ7VE.0 size=1048576 2024-09-12T00:36:28.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.962+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~PYPFUKCWZ7VE.1 size=424766 2024-09-12T00:36:28.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.962+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=PYPFUKCWZ7VE tag=KPX8Z5LJOXTZ type=write size=2521918 2024-09-12T00:36:28.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.965+0000 7f030cb87780 1 < completed part key=_multipart_86TWUAZAHI4I.2~I17V9CKBZJTU.0 size=595274 2024-09-12T00:36:28.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.968+0000 7f030cb87780 1 < completed multipart upload key=86TWUAZAHI4I upload=I17V9CKBZJTU tag=7U842J627OAP type=write size=1643850 2024-09-12T00:36:28.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.968+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=TZBVGMB5AP8S type=del size=3007164 2024-09-12T00:36:28.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.970+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=A1010W1Z6N60 type=del 2024-09-12T00:36:28.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.973+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~NVV83041SMUY.0 size=1048576 2024-09-12T00:36:28.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.973+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~NVV83041SMUY.1 size=659126 2024-09-12T00:36:28.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.973+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=NVV83041SMUY tag=MTMOY5W6OJCP type=write size=2756278 2024-09-12T00:36:28.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.977+0000 7f030cb87780 1 < suggested update operation key=327RDLIWLVRO tag=YNLU52JG2EQG type=write size=645859 2024-09-12T00:36:28.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.979+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~GTB42067L3ZX.0 size=1048576 2024-09-12T00:36:28.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.980+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~GTB42067L3ZX.1 size=1048576 2024-09-12T00:36:28.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.981+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~GTB42067L3ZX.2 size=729561 2024-09-12T00:36:28.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.981+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=GTB42067L3ZX tag=40FEEP68YV94 type=write size=3875289 2024-09-12T00:36:28.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.982+0000 7f030cb87780 1 < completed delete operation key=DLR6A7XOERHW tag=SU8JRJMY14WM type=del 2024-09-12T00:36:28.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.983+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=W5DLDW2OAQSG type=del size=2531054 2024-09-12T00:36:28.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.986+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=ACU3L5HC9JA4 type=del 2024-09-12T00:36:28.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.989+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~KLHIEIAEFRZI.0 size=531247 2024-09-12T00:36:28.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.989+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=KLHIEIAEFRZI tag=2OJ1AG3A6BR7 type=write size=1579823 2024-09-12T00:36:28.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.990+0000 7f030cb87780 1 < suggested update operation key=HUDEU16YTO0Y tag=ECYM895OHUX4 type=del size=704287 2024-09-12T00:36:28.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.994+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~V8NPK3UCWA2B.0 size=1048576 2024-09-12T00:36:28.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.994+0000 7f030cb87780 1 > prepared part key=_multipart_800OHA7UURC4.2~V8NPK3UCWA2B.1 size=455683 2024-09-12T00:36:28.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.994+0000 7f030cb87780 1 > prepared multipart upload key=800OHA7UURC4 upload=V8NPK3UCWA2B tag=33APE8CE6V9P type=write size=2552835 2024-09-12T00:36:28.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.996+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=WUNKUXDWGXVM type=del 2024-09-12T00:36:28.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.998+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=LLIS2W2LDK46 type=del size=2111743 2024-09-12T00:36:28.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:28.998+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~6K2RH320VPUY.0 size=746562 2024-09-12T00:36:29.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.003+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=6K2RH320VPUY tag=VUUM3WFFBA68 type=write size=1795138 2024-09-12T00:36:29.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.004+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=KQU212E59KK0 type=del size=785846 2024-09-12T00:36:29.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.005+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=25F5VJMSJQTH type=del 2024-09-12T00:36:29.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.008+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~ETOM1L2X2097.0 size=53872 2024-09-12T00:36:29.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.008+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=ETOM1L2X2097 tag=NIRYNQJ8814R type=write size=1102448 2024-09-12T00:36:29.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.008+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~IILRB98W92C9.0 size=1048576 2024-09-12T00:36:29.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.010+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~IILRB98W92C9.1 size=1048576 2024-09-12T00:36:29.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.011+0000 7f030cb87780 1 < completed part key=_multipart_99OWKRGA8ZZN.2~IILRB98W92C9.2 size=788646 2024-09-12T00:36:29.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.014+0000 7f030cb87780 1 < completed multipart upload key=99OWKRGA8ZZN upload=IILRB98W92C9 tag=S0Q6ZLWMNQ5Z type=write size=3934374 2024-09-12T00:36:29.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.014+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=3L0AX88MP2IC type=del size=2408097 2024-09-12T00:36:29.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.017+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=MEFF608E8Z50 type=del 2024-09-12T00:36:29.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.018+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=Z91VJARJJB5E type=del size=2765513 2024-09-12T00:36:29.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.019+0000 7f030cb87780 1 < canceled operation key=92GDVW0Q8VKQ tag=N7YDAQ5P7VI3 type=del size=1648512 2024-09-12T00:36:29.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.021+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=FR7BXP5FFACS type=write size=819781 2024-09-12T00:36:29.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.021+0000 7f030cb87780 1 < completed part key=_multipart_CY2NS03IIUJJ.2~Z15HDN11TGZZ.0 size=250625 2024-09-12T00:36:29.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.025+0000 7f030cb87780 1 < completed multipart upload key=CY2NS03IIUJJ upload=Z15HDN11TGZZ tag=LUCQOAJMCOAO type=write size=1299201 2024-09-12T00:36:29.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.028+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~PG1PD0J3B48O.0 size=1048576 2024-09-12T00:36:29.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.029+0000 7f030cb87780 1 > prepared part key=_multipart_OR439FK5L43V.2~PG1PD0J3B48O.1 size=421173 2024-09-12T00:36:29.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.029+0000 7f030cb87780 1 > prepared multipart upload key=OR439FK5L43V upload=PG1PD0J3B48O tag=SHPBWJ5ZXP4P type=write size=2518325 2024-09-12T00:36:29.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.029+0000 7f030cb87780 1 < completed delete operation key=86TWUAZAHI4I tag=AKX8DHREWRTX type=del 2024-09-12T00:36:29.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.031+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=CLQ982A0GQZY type=del size=909464 2024-09-12T00:36:29.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.034+0000 7f030cb87780 1 < suggested update operation key=DLR6A7XOERHW tag=P7NGL0SYOYD5 type=del size=101680 2024-09-12T00:36:29.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.036+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=2NSOLVRIM8XY type=del size=3071965 2024-09-12T00:36:29.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.038+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~PYPFUKCWZ7VE.0 size=1048576 2024-09-12T00:36:29.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.038+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~PYPFUKCWZ7VE.1 size=424766 2024-09-12T00:36:29.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.041+0000 7f030cb87780 1 < completed multipart upload key=HUDEU16YTO0Y upload=PYPFUKCWZ7VE tag=KPX8Z5LJOXTZ type=write size=2521918 2024-09-12T00:36:29.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.043+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~7EYNZFZDY0BT.0 size=350689 2024-09-12T00:36:29.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.043+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=7EYNZFZDY0BT tag=ZMLSC3707XIX type=write size=1399265 2024-09-12T00:36:29.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.045+0000 7f030cb87780 -1 < failed to complete operation key=327RDLIWLVRO tag=TZBVGMB5AP8S type=del size=3007164: (22) Invalid argument 2024-09-12T00:36:29.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.047+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~H3GHSXKPG6T1.0 size=486216 2024-09-12T00:36:29.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.047+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=H3GHSXKPG6T1 tag=RC2ZTKR5UBZ7 type=write size=1534792 2024-09-12T00:36:29.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.048+0000 7f030cb87780 1 < canceled part key=_multipart_1VOJGMWNKS0A.2~NVV83041SMUY.0 size=1048576 2024-09-12T00:36:29.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.049+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~NVV83041SMUY.1 size=659126 2024-09-12T00:36:29.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.052+0000 7f030cb87780 1 < canceled multipart upload key=1VOJGMWNKS0A upload=NVV83041SMUY tag=MTMOY5W6OJCP type=write size=2756278 2024-09-12T00:36:29.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.052+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=ZUXYOOB0TMMU type=del size=3150695 2024-09-12T00:36:29.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.055+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~GTB42067L3ZX.0 size=1048576 2024-09-12T00:36:29.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.056+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~GTB42067L3ZX.1 size=1048576 2024-09-12T00:36:29.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.057+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~GTB42067L3ZX.2 size=729561 2024-09-12T00:36:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.060+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=GTB42067L3ZX tag=40FEEP68YV94 type=write size=3875289 2024-09-12T00:36:29.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.062+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~QMQBHE3IOQW8.0 size=1048576 2024-09-12T00:36:29.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.063+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~QMQBHE3IOQW8.1 size=260859 2024-09-12T00:36:29.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.063+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=QMQBHE3IOQW8 tag=1M17LQDUFQPR type=write size=2358011 2024-09-12T00:36:29.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.064+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=W5DLDW2OAQSG type=del 2024-09-12T00:36:29.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.067+0000 7f030cb87780 1 > prepared operation key=1VOJGMWNKS0A tag=CTB13DUZQJNS type=write size=132043 2024-09-12T00:36:29.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.067+0000 7f030cb87780 1 < canceled part key=_multipart_6WHZRKLM3OLP.2~KLHIEIAEFRZI.0 size=531247 2024-09-12T00:36:29.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.068+0000 7f030cb87780 1 < canceled multipart upload key=6WHZRKLM3OLP upload=KLHIEIAEFRZI tag=2OJ1AG3A6BR7 type=write size=1579823 2024-09-12T00:36:29.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.070+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=TTFNV43DDQAK type=del size=3918871 2024-09-12T00:36:29.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.073+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~V8NPK3UCWA2B.0 size=1048576 2024-09-12T00:36:29.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.073+0000 7f030cb87780 1 < completed part key=_multipart_800OHA7UURC4.2~V8NPK3UCWA2B.1 size=455683 2024-09-12T00:36:29.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.076+0000 7f030cb87780 1 < completed multipart upload key=800OHA7UURC4 upload=V8NPK3UCWA2B tag=33APE8CE6V9P type=write size=2552835 2024-09-12T00:36:29.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.078+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=99BKFDEE7A4A type=del size=2576031 2024-09-12T00:36:29.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.080+0000 7f030cb87780 1 < suggested remove operation key=DLR6A7XOERHW tag=LLIS2W2LDK46 type=del 2024-09-12T00:36:29.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.084+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~CP77VIF132KC.0 size=1048576 2024-09-12T00:36:29.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.084+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~CP77VIF132KC.1 size=1048576 2024-09-12T00:36:29.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.086+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~CP77VIF132KC.2 size=34229 2024-09-12T00:36:29.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.086+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=CP77VIF132KC tag=87ZW2WOHCGR7 type=write size=3179957 2024-09-12T00:36:29.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.088+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=KQU212E59KK0 type=del 2024-09-12T00:36:29.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.088+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=KJ9ZVFP3OKZE type=del size=1303169 2024-09-12T00:36:29.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.091+0000 7f030cb87780 1 < completed part key=_multipart_JPEIGLC162K3.2~ETOM1L2X2097.0 size=53872 2024-09-12T00:36:29.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.093+0000 7f030cb87780 1 < completed multipart upload key=JPEIGLC162K3 upload=ETOM1L2X2097 tag=NIRYNQJ8814R type=write size=1102448 2024-09-12T00:36:29.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.095+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=X97A9A4DO1YB type=del size=3941793 2024-09-12T00:36:29.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.095+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=3L0AX88MP2IC type=del 2024-09-12T00:36:29.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.099+0000 7f030cb87780 1 > prepared part key=_multipart_UFYMVGL264T8.2~5PPXMVZ31756.0 size=875884 2024-09-12T00:36:29.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.099+0000 7f030cb87780 1 > prepared multipart upload key=UFYMVGL264T8 upload=5PPXMVZ31756 tag=ENN3BQQGCBW3 type=write size=1924460 2024-09-12T00:36:29.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.101+0000 7f030cb87780 1 < completed delete operation key=ATTMOL2TGUN7 tag=Z91VJARJJB5E type=del 2024-09-12T00:36:29.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.101+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=V05OJJQYI1BM type=del size=1766684 2024-09-12T00:36:29.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.104+0000 7f030cb87780 1 < completed write operation key=V0OLIRP3KH40 tag=FR7BXP5FFACS type=write size=819781 2024-09-12T00:36:29.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.104+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=X8CALIBO7CMN type=del size=2935041 2024-09-12T00:36:29.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.105+0000 7f030cb87780 1 < canceled part key=_multipart_OR439FK5L43V.2~PG1PD0J3B48O.0 size=1048576 2024-09-12T00:36:29.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.107+0000 7f030cb87780 1 < completed part key=_multipart_OR439FK5L43V.2~PG1PD0J3B48O.1 size=421173 2024-09-12T00:36:29.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.108+0000 7f030cb87780 1 < canceled multipart upload key=OR439FK5L43V upload=PG1PD0J3B48O tag=SHPBWJ5ZXP4P type=write size=2518325 2024-09-12T00:36:29.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.111+0000 7f030cb87780 1 > prepared operation key=1PLGUJCB6J0V tag=GZSWYMTH72CJ type=del size=596028 2024-09-12T00:36:29.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.112+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=CLQ982A0GQZY type=del 2024-09-12T00:36:29.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.115+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=O4VASAY57NRQ type=del size=428497 2024-09-12T00:36:29.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.115+0000 7f030cb87780 1 < completed delete operation key=6WHZRKLM3OLP tag=2NSOLVRIM8XY type=del 2024-09-12T00:36:29.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.118+0000 7f030cb87780 1 > prepared operation key=ZQD0491BHJPM tag=1CMRUMB3JTA6 type=del size=3776818 2024-09-12T00:36:29.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.119+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~7EYNZFZDY0BT.0 size=350689 2024-09-12T00:36:29.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.122+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=7EYNZFZDY0BT tag=ZMLSC3707XIX type=write size=1399265 2024-09-12T00:36:29.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.125+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~X1TQMGQ09YR8.0 size=1048576 2024-09-12T00:36:29.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.125+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~X1TQMGQ09YR8.1 size=1048576 2024-09-12T00:36:29.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.127+0000 7f030cb87780 1 > prepared part key=_multipart_3W7ANGL92ZF0.2~X1TQMGQ09YR8.2 size=541225 2024-09-12T00:36:29.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.127+0000 7f030cb87780 1 > prepared multipart upload key=3W7ANGL92ZF0 upload=X1TQMGQ09YR8 tag=ZG7MNTQAKSQR type=write size=3686953 2024-09-12T00:36:29.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.128+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~H3GHSXKPG6T1.0 size=486216 2024-09-12T00:36:29.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.130+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=H3GHSXKPG6T1 tag=RC2ZTKR5UBZ7 type=write size=1534792 2024-09-12T00:36:29.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.132+0000 7f030cb87780 1 > prepared operation key=ATTMOL2TGUN7 tag=1PKK1YIBMGZY type=write size=841111 2024-09-12T00:36:29.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.133+0000 7f030cb87780 1 < completed delete operation key=V0OLIRP3KH40 tag=ZUXYOOB0TMMU type=del 2024-09-12T00:36:29.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.137+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~0XNTUMU1OF81.0 size=1048576 2024-09-12T00:36:29.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.138+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~0XNTUMU1OF81.1 size=1048576 2024-09-12T00:36:29.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.139+0000 7f030cb87780 1 > prepared part key=_multipart_IY156CJWG2TB.2~0XNTUMU1OF81.2 size=1043566 2024-09-12T00:36:29.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.139+0000 7f030cb87780 1 > prepared multipart upload key=IY156CJWG2TB upload=0XNTUMU1OF81 tag=VS62Z7A6GQP2 type=write size=4189294 2024-09-12T00:36:29.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.141+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~QMQBHE3IOQW8.0 size=1048576 2024-09-12T00:36:29.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.143+0000 7f030cb87780 1 < completed part key=_multipart_QGSJ51GMQXVK.2~QMQBHE3IOQW8.1 size=260859 2024-09-12T00:36:29.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.144+0000 7f030cb87780 1 < completed multipart upload key=QGSJ51GMQXVK upload=QMQBHE3IOQW8 tag=1M17LQDUFQPR type=write size=2358011 2024-09-12T00:36:29.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.146+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=PURF5VQDLZ9G type=del size=3231419 2024-09-12T00:36:29.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.147+0000 7f030cb87780 1 < completed write operation key=1VOJGMWNKS0A tag=CTB13DUZQJNS type=write size=132043 2024-09-12T00:36:29.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.149+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~1R453VS9L39W.0 size=1048576 2024-09-12T00:36:29.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.150+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~1R453VS9L39W.1 size=407223 2024-09-12T00:36:29.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.150+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=1R453VS9L39W tag=TZVJNW4JL1TF type=write size=2504375 2024-09-12T00:36:29.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.152+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=TTFNV43DDQAK type=del 2024-09-12T00:36:29.154 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.154+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~HM6FO3R7X1AJ.0 size=1048576 2024-09-12T00:36:29.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.156+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~HM6FO3R7X1AJ.1 size=1048576 2024-09-12T00:36:29.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.158+0000 7f030cb87780 1 > prepared part key=_multipart_JRPD5AAK84ZD.2~HM6FO3R7X1AJ.2 size=78165 2024-09-12T00:36:29.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.158+0000 7f030cb87780 1 > prepared multipart upload key=JRPD5AAK84ZD upload=HM6FO3R7X1AJ tag=SGFP5WSS2JW5 type=write size=3223893 2024-09-12T00:36:29.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.160+0000 7f030cb87780 1 < suggested remove operation key=3W7ANGL92ZF0 tag=99BKFDEE7A4A type=del 2024-09-12T00:36:29.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.164+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~QZ8HWILOW0C5.0 size=1048576 2024-09-12T00:36:29.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.165+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~QZ8HWILOW0C5.1 size=1048576 2024-09-12T00:36:29.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.166+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~QZ8HWILOW0C5.2 size=49477 2024-09-12T00:36:29.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.166+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=QZ8HWILOW0C5 tag=F66DAL9WM7BF type=write size=3195205 2024-09-12T00:36:29.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.168+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~CP77VIF132KC.0 size=1048576 2024-09-12T00:36:29.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.168+0000 7f030cb87780 1 < canceled part key=_multipart_HUDEU16YTO0Y.2~CP77VIF132KC.1 size=1048576 2024-09-12T00:36:29.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.169+0000 7f030cb87780 1 < completed part key=_multipart_HUDEU16YTO0Y.2~CP77VIF132KC.2 size=34229 2024-09-12T00:36:29.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.171+0000 7f030cb87780 1 < canceled multipart upload key=HUDEU16YTO0Y upload=CP77VIF132KC tag=87ZW2WOHCGR7 type=write size=3179957 2024-09-12T00:36:29.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.172+0000 7f030cb87780 1 > prepared operation key=ELX0797T1L4C tag=DNJA9A201DYS type=del size=2559865 2024-09-12T00:36:29.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.174+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=KJ9ZVFP3OKZE type=del 2024-09-12T00:36:29.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.175+0000 7f030cb87780 1 > prepared operation key=IY156CJWG2TB tag=TDC1URMG4C14 type=del size=3991691 2024-09-12T00:36:29.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.178+0000 7f030cb87780 1 < completed delete operation key=CY2NS03IIUJJ tag=X97A9A4DO1YB type=del 2024-09-12T00:36:29.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.179+0000 7f030cb87780 1 > prepared operation key=327RDLIWLVRO tag=QPHCS0BURTMU type=write size=488697 2024-09-12T00:36:29.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.181+0000 7f030cb87780 1 < completed part key=_multipart_UFYMVGL264T8.2~5PPXMVZ31756.0 size=875884 2024-09-12T00:36:29.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.183+0000 7f030cb87780 1 < completed multipart upload key=UFYMVGL264T8 upload=5PPXMVZ31756 tag=ENN3BQQGCBW3 type=write size=1924460 2024-09-12T00:36:29.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.186+0000 7f030cb87780 1 > prepared part key=_multipart_V0OLIRP3KH40.2~107UYGJB0QRK.0 size=386598 2024-09-12T00:36:29.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.186+0000 7f030cb87780 1 > prepared multipart upload key=V0OLIRP3KH40 upload=107UYGJB0QRK tag=277H33X3WT77 type=write size=1435174 2024-09-12T00:36:29.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.188+0000 7f030cb87780 1 < completed delete operation key=JPEIGLC162K3 tag=V05OJJQYI1BM type=del 2024-09-12T00:36:29.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.189+0000 7f030cb87780 1 > prepared operation key=39WSAOA6P09M tag=50YETP2P0FU1 type=del size=403123 2024-09-12T00:36:29.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.190+0000 7f030cb87780 -1 < no bi entry to suggest for operation key=3W7ANGL92ZF0 tag=X8CALIBO7CMN type=del size=2935041: (2) No such file or directory 2024-09-12T00:36:29.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.192+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~DEYOFH0GOB6S.0 size=1048576 2024-09-12T00:36:29.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.193+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~DEYOFH0GOB6S.1 size=1048576 2024-09-12T00:36:29.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.194+0000 7f030cb87780 1 > prepared part key=_multipart_V87B6SDB1HFZ.2~DEYOFH0GOB6S.2 size=755785 2024-09-12T00:36:29.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.194+0000 7f030cb87780 1 > prepared multipart upload key=V87B6SDB1HFZ upload=DEYOFH0GOB6S tag=OEQ9ETFJKLU9 type=write size=3901513 2024-09-12T00:36:29.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.196+0000 7f030cb87780 1 < suggested remove operation key=1PLGUJCB6J0V tag=GZSWYMTH72CJ type=del 2024-09-12T00:36:29.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.198+0000 7f030cb87780 1 > prepared operation key=HUDEU16YTO0Y tag=SED3SU9EK7UL type=write size=358615 2024-09-12T00:36:29.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.201+0000 7f030cb87780 1 < suggested update operation key=JPEIGLC162K3 tag=O4VASAY57NRQ type=del size=428497 2024-09-12T00:36:29.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.203+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=EQTAJT9E09UB type=write size=245441 2024-09-12T00:36:29.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.204+0000 7f030cb87780 1 < completed delete operation key=ZQD0491BHJPM tag=1CMRUMB3JTA6 type=del 2024-09-12T00:36:29.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.206+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=QWHM0PM4OJNA type=write size=112758 2024-09-12T00:36:29.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.207+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~X1TQMGQ09YR8.0 size=1048576 2024-09-12T00:36:29.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.207+0000 7f030cb87780 1 < canceled part key=_multipart_3W7ANGL92ZF0.2~X1TQMGQ09YR8.1 size=1048576 2024-09-12T00:36:29.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.209+0000 7f030cb87780 1 < completed part key=_multipart_3W7ANGL92ZF0.2~X1TQMGQ09YR8.2 size=541225 2024-09-12T00:36:29.209 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.211+0000 7f030cb87780 1 < canceled multipart upload key=3W7ANGL92ZF0 upload=X1TQMGQ09YR8 tag=ZG7MNTQAKSQR type=write size=3686953 2024-09-12T00:36:29.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.213+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~DNKIJ41JPHY7.0 size=1048576 2024-09-12T00:36:29.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.214+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~DNKIJ41JPHY7.1 size=1048576 2024-09-12T00:36:29.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.216+0000 7f030cb87780 1 > prepared part key=_multipart_POC8YA58U55N.2~DNKIJ41JPHY7.2 size=751366 2024-09-12T00:36:29.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.216+0000 7f030cb87780 1 > prepared multipart upload key=POC8YA58U55N upload=DNKIJ41JPHY7 tag=Y1ICHYASB91W type=write size=3897094 2024-09-12T00:36:29.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.216+0000 7f030cb87780 1 < completed write operation key=ATTMOL2TGUN7 tag=1PKK1YIBMGZY type=write size=841111 2024-09-12T00:36:29.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.217+0000 7f030cb87780 1 > prepared operation key=JRPD5AAK84ZD tag=LO50UH32M07F type=del size=117787 2024-09-12T00:36:29.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.218+0000 7f030cb87780 1 < canceled part key=_multipart_IY156CJWG2TB.2~0XNTUMU1OF81.0 size=1048576 2024-09-12T00:36:29.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.220+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~0XNTUMU1OF81.1 size=1048576 2024-09-12T00:36:29.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.221+0000 7f030cb87780 1 < completed part key=_multipart_IY156CJWG2TB.2~0XNTUMU1OF81.2 size=1043566 2024-09-12T00:36:29.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.223+0000 7f030cb87780 1 < canceled multipart upload key=IY156CJWG2TB upload=0XNTUMU1OF81 tag=VS62Z7A6GQP2 type=write size=4189294 2024-09-12T00:36:29.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.225+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=92YAUH9S79AX type=del size=1761037 2024-09-12T00:36:29.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.226+0000 7f030cb87780 -1 < failed to complete operation key=3W7ANGL92ZF0 tag=PURF5VQDLZ9G type=del size=3231419: (22) Invalid argument 2024-09-12T00:36:29.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.229+0000 7f030cb87780 1 > prepared part key=_multipart_ATTMOL2TGUN7.2~9UTPPNC1V5YO.0 size=391095 2024-09-12T00:36:29.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.229+0000 7f030cb87780 1 > prepared multipart upload key=ATTMOL2TGUN7 upload=9UTPPNC1V5YO tag=Z1OLRQTY8LXZ type=write size=1439671 2024-09-12T00:36:29.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.229+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~1R453VS9L39W.0 size=1048576 2024-09-12T00:36:29.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.231+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~1R453VS9L39W.1 size=407223 2024-09-12T00:36:29.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.234+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=1R453VS9L39W tag=TZVJNW4JL1TF type=write size=2504375 2024-09-12T00:36:29.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.235+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~XQNWVS1CP247.0 size=532782 2024-09-12T00:36:29.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.235+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=XQNWVS1CP247 tag=9J682G1MOLRG type=write size=1581358 2024-09-12T00:36:29.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.238+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~HM6FO3R7X1AJ.0 size=1048576 2024-09-12T00:36:29.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.239+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~HM6FO3R7X1AJ.1 size=1048576 2024-09-12T00:36:29.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.239+0000 7f030cb87780 1 < completed part key=_multipart_JRPD5AAK84ZD.2~HM6FO3R7X1AJ.2 size=78165 2024-09-12T00:36:29.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.242+0000 7f030cb87780 1 < completed multipart upload key=JRPD5AAK84ZD upload=HM6FO3R7X1AJ tag=SGFP5WSS2JW5 type=write size=3223893 2024-09-12T00:36:29.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.244+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~45PVKMDD7QGQ.0 size=1048576 2024-09-12T00:36:29.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.245+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~45PVKMDD7QGQ.1 size=1048576 2024-09-12T00:36:29.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.247+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~45PVKMDD7QGQ.2 size=215369 2024-09-12T00:36:29.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.247+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=45PVKMDD7QGQ tag=MQSZ1GFE16AS type=write size=3361097 2024-09-12T00:36:29.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.248+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~QZ8HWILOW0C5.0 size=1048576 2024-09-12T00:36:29.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.248+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~QZ8HWILOW0C5.1 size=1048576 2024-09-12T00:36:29.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.249+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~QZ8HWILOW0C5.2 size=49477 2024-09-12T00:36:29.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.252+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=QZ8HWILOW0C5 tag=F66DAL9WM7BF type=write size=3195205 2024-09-12T00:36:29.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.254+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=1K6FBD3RO3Q2 type=write size=881146 2024-09-12T00:36:29.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.255+0000 7f030cb87780 1 < completed delete operation key=ELX0797T1L4C tag=DNJA9A201DYS type=del 2024-09-12T00:36:29.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.257+0000 7f030cb87780 1 > prepared operation key=OR439FK5L43V tag=C29Z85XUZXXI type=del size=2330193 2024-09-12T00:36:29.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.257+0000 7f030cb87780 1 < canceled operation key=IY156CJWG2TB tag=TDC1URMG4C14 type=del size=3991691 2024-09-12T00:36:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.260+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=I189K0TY7T01 type=del size=2811338 2024-09-12T00:36:29.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.260+0000 7f030cb87780 1 < completed write operation key=327RDLIWLVRO tag=QPHCS0BURTMU type=write size=488697 2024-09-12T00:36:29.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.263+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=HN05XRIYH6UM type=write size=863761 2024-09-12T00:36:29.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.264+0000 7f030cb87780 1 < completed part key=_multipart_V0OLIRP3KH40.2~107UYGJB0QRK.0 size=386598 2024-09-12T00:36:29.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.267+0000 7f030cb87780 1 < completed multipart upload key=V0OLIRP3KH40 upload=107UYGJB0QRK tag=277H33X3WT77 type=write size=1435174 2024-09-12T00:36:29.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.269+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~VROB3E4IILV0.0 size=1048576 2024-09-12T00:36:29.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.269+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~VROB3E4IILV0.1 size=1048576 2024-09-12T00:36:29.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.270+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~VROB3E4IILV0.2 size=999424 2024-09-12T00:36:29.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.270+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=VROB3E4IILV0 tag=YNHCZQAW38UQ type=write size=4145152 2024-09-12T00:36:29.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.273+0000 7f030cb87780 1 < completed delete operation key=39WSAOA6P09M tag=50YETP2P0FU1 type=del 2024-09-12T00:36:29.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.276+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~BKRGXF30KJ9F.0 size=1048576 2024-09-12T00:36:29.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.276+0000 7f030cb87780 1 > prepared part key=_multipart_ELX0797T1L4C.2~BKRGXF30KJ9F.1 size=263073 2024-09-12T00:36:29.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.276+0000 7f030cb87780 1 > prepared multipart upload key=ELX0797T1L4C upload=BKRGXF30KJ9F tag=APD1EDOF7HRX type=write size=2360225 2024-09-12T00:36:29.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.279+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~DEYOFH0GOB6S.0 size=1048576 2024-09-12T00:36:29.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.280+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~DEYOFH0GOB6S.1 size=1048576 2024-09-12T00:36:29.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.281+0000 7f030cb87780 1 < completed part key=_multipart_V87B6SDB1HFZ.2~DEYOFH0GOB6S.2 size=755785 2024-09-12T00:36:29.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.283+0000 7f030cb87780 1 < completed multipart upload key=V87B6SDB1HFZ upload=DEYOFH0GOB6S tag=OEQ9ETFJKLU9 type=write size=3901513 2024-09-12T00:36:29.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.285+0000 7f030cb87780 1 > prepared operation key=6WHZRKLM3OLP tag=99ZIB0D5LEUC type=write size=534655 2024-09-12T00:36:29.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.288+0000 7f030cb87780 1 < suggested remove operation key=HUDEU16YTO0Y tag=SED3SU9EK7UL type=write 2024-09-12T00:36:29.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.289+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=8G30A3N3ESQE type=del size=3304139 2024-09-12T00:36:29.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.293+0000 7f030cb87780 1 < suggested update operation key=INFFH9R3EFRY tag=EQTAJT9E09UB type=write size=245441 2024-09-12T00:36:29.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.294+0000 7f030cb87780 1 > prepared operation key=92GDVW0Q8VKQ tag=7PB1EMYSXMQ7 type=del size=1396628 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.295+0000 7f030cb87780 1 < completed write operation key=6WHZRKLM3OLP tag=QWHM0PM4OJNA type=write size=112758 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.296+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=CB0653OX7YUV type=write size=304316 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.297+0000 7f030cb87780 1 < canceled part key=_multipart_POC8YA58U55N.2~DNKIJ41JPHY7.0 size=1048576 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.299+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~DNKIJ41JPHY7.1 size=1048576 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.301+0000 7f030cb87780 1 < completed part key=_multipart_POC8YA58U55N.2~DNKIJ41JPHY7.2 size=751366 2024-09-12T00:36:29.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.302+0000 7f030cb87780 1 < canceled multipart upload key=POC8YA58U55N upload=DNKIJ41JPHY7 tag=Y1ICHYASB91W type=write size=3897094 2024-09-12T00:36:29.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.305+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=K9RTSZ34F1O3 type=del size=714305 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.305+0000 7f030cb87780 1 < completed delete operation key=JRPD5AAK84ZD tag=LO50UH32M07F type=del 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.308+0000 7f030cb87780 1 > prepared operation key=56I20YIPY82N tag=AF1C3S22RUE8 type=write size=906345 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.308+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=92YAUH9S79AX type=del 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.311+0000 7f030cb87780 1 > prepared operation key=QGSJ51GMQXVK tag=KNAS2UQDPVVJ type=del size=1460250 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.311+0000 7f030cb87780 1 < completed part key=_multipart_ATTMOL2TGUN7.2~9UTPPNC1V5YO.0 size=391095 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.315+0000 7f030cb87780 1 < completed multipart upload key=ATTMOL2TGUN7 upload=9UTPPNC1V5YO tag=Z1OLRQTY8LXZ type=write size=1439671 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.316+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=4LE1PO07ED2P type=del size=2175122 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.318+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~XQNWVS1CP247.0 size=532782 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.320+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=XQNWVS1CP247 tag=9J682G1MOLRG type=write size=1581358 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.322+0000 7f030cb87780 1 > prepared operation key=9MCRD2G3MZIT tag=W3RQUNCM62T7 type=del size=1586359 2024-09-12T00:36:29.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.322+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~45PVKMDD7QGQ.0 size=1048576 2024-09-12T00:36:29.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.324+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~45PVKMDD7QGQ.1 size=1048576 2024-09-12T00:36:29.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.324+0000 7f030cb87780 1 < completed part key=_multipart_ZQD0491BHJPM.2~45PVKMDD7QGQ.2 size=215369 2024-09-12T00:36:29.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.328+0000 7f030cb87780 1 < completed multipart upload key=ZQD0491BHJPM upload=45PVKMDD7QGQ tag=MQSZ1GFE16AS type=write size=3361097 2024-09-12T00:36:29.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.328+0000 7f030cb87780 1 > prepared operation key=800OHA7UURC4 tag=LCTFN2R1HQEM type=write size=573577 2024-09-12T00:36:29.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.331+0000 7f030cb87780 1 < completed write operation key=56I20YIPY82N tag=1K6FBD3RO3Q2 type=write size=881146 2024-09-12T00:36:29.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.331+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=SW5QVIN4AEU8 type=del size=809242 2024-09-12T00:36:29.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.333+0000 7f030cb87780 1 < completed delete operation key=OR439FK5L43V tag=C29Z85XUZXXI type=del 2024-09-12T00:36:29.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.336+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~DQEEQT6M3Y49.0 size=1048576 2024-09-12T00:36:29.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.336+0000 7f030cb87780 1 > prepared part key=_multipart_INFFH9R3EFRY.2~DQEEQT6M3Y49.1 size=547748 2024-09-12T00:36:29.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.336+0000 7f030cb87780 1 > prepared multipart upload key=INFFH9R3EFRY upload=DQEEQT6M3Y49 tag=5LFVF14F4YDQ type=write size=2644900 2024-09-12T00:36:29.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.339+0000 7f030cb87780 1 < completed delete operation key=UFYMVGL264T8 tag=I189K0TY7T01 type=del 2024-09-12T00:36:29.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.340+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~DKREXF4UQMJ6.0 size=74718 2024-09-12T00:36:29.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.340+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=DKREXF4UQMJ6 tag=MD4LN1RM0719 type=write size=1123294 2024-09-12T00:36:29.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.342+0000 7f030cb87780 1 < completed write operation key=POC8YA58U55N tag=HN05XRIYH6UM type=write size=863761 2024-09-12T00:36:29.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.345+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~JAFZEJ7T31Z8.0 size=1048576 2024-09-12T00:36:29.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.347+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~JAFZEJ7T31Z8.1 size=1048576 2024-09-12T00:36:29.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.348+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~JAFZEJ7T31Z8.2 size=98167 2024-09-12T00:36:29.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.348+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=JAFZEJ7T31Z8 tag=96IJ363KOBX4 type=write size=3243895 2024-09-12T00:36:29.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.349+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~VROB3E4IILV0.0 size=1048576 2024-09-12T00:36:29.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.349+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~VROB3E4IILV0.1 size=1048576 2024-09-12T00:36:29.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.351+0000 7f030cb87780 1 < completed part key=_multipart_9MCRD2G3MZIT.2~VROB3E4IILV0.2 size=999424 2024-09-12T00:36:29.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.354+0000 7f030cb87780 1 < completed multipart upload key=9MCRD2G3MZIT upload=VROB3E4IILV0 tag=YNHCZQAW38UQ type=write size=4145152 2024-09-12T00:36:29.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.354+0000 7f030cb87780 1 > prepared operation key=3W7ANGL92ZF0 tag=4FYML5DRRSVF type=del size=127929 2024-09-12T00:36:29.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.355+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~BKRGXF30KJ9F.0 size=1048576 2024-09-12T00:36:29.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.356+0000 7f030cb87780 1 < completed part key=_multipart_ELX0797T1L4C.2~BKRGXF30KJ9F.1 size=263073 2024-09-12T00:36:29.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.359+0000 7f030cb87780 1 < completed multipart upload key=ELX0797T1L4C upload=BKRGXF30KJ9F tag=APD1EDOF7HRX type=write size=2360225 2024-09-12T00:36:29.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.362+0000 7f030cb87780 1 > prepared operation key=IHTFI7W4A6JT tag=M7A12GDDYE7I type=write size=1047688 2024-09-12T00:36:29.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.362+0000 7f030cb87780 1 < completed write operation key=6WHZRKLM3OLP tag=99ZIB0D5LEUC type=write size=534655 2024-09-12T00:36:29.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.366+0000 7f030cb87780 1 > prepared part key=_multipart_N3KD1UVUVM95.2~CXVUX1I1XADG.0 size=729509 2024-09-12T00:36:29.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.366+0000 7f030cb87780 1 > prepared multipart upload key=N3KD1UVUVM95 upload=CXVUX1I1XADG tag=96PIU7AAVN6F type=write size=1778085 2024-09-12T00:36:29.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.366+0000 7f030cb87780 1 < canceled operation key=99OWKRGA8ZZN tag=8G30A3N3ESQE type=del size=3304139 2024-09-12T00:36:29.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.369+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~3ZY3P6WF05FY.0 size=1048576 2024-09-12T00:36:29.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.371+0000 7f030cb87780 1 > prepared part key=_multipart_6WHZRKLM3OLP.2~3ZY3P6WF05FY.1 size=797457 2024-09-12T00:36:29.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.371+0000 7f030cb87780 1 > prepared multipart upload key=6WHZRKLM3OLP upload=3ZY3P6WF05FY tag=OBYCI5RKAXJ4 type=write size=2894609 2024-09-12T00:36:29.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.371+0000 7f030cb87780 1 < completed delete operation key=92GDVW0Q8VKQ tag=7PB1EMYSXMQ7 type=del 2024-09-12T00:36:29.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.374+0000 7f030cb87780 1 > prepared operation key=POC8YA58U55N tag=YQO4373OD2HC type=write size=792451 2024-09-12T00:36:29.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.377+0000 7f030cb87780 1 < suggested remove operation key=99OWKRGA8ZZN tag=CB0653OX7YUV type=write 2024-09-12T00:36:29.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.378+0000 7f030cb87780 1 > prepared operation key=V87B6SDB1HFZ tag=XMCNUM8RQPRW type=del size=1956871 2024-09-12T00:36:29.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.378+0000 7f030cb87780 1 < canceled operation key=9MCRD2G3MZIT tag=K9RTSZ34F1O3 type=del size=714305 2024-09-12T00:36:29.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.382+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~KE2M5HWOTFSF.0 size=1048576 2024-09-12T00:36:29.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.383+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~KE2M5HWOTFSF.1 size=1048576 2024-09-12T00:36:29.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.384+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~KE2M5HWOTFSF.2 size=882489 2024-09-12T00:36:29.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.384+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=KE2M5HWOTFSF tag=OQ1R8LE6F0TL type=write size=4028217 2024-09-12T00:36:29.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.386+0000 7f030cb87780 1 < completed write operation key=56I20YIPY82N tag=AF1C3S22RUE8 type=write size=906345 2024-09-12T00:36:29.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.386+0000 7f030cb87780 1 > prepared operation key=V0OLIRP3KH40 tag=J0EFV350JIWC type=write size=791951 2024-09-12T00:36:29.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.389+0000 7f030cb87780 1 < suggested remove operation key=QGSJ51GMQXVK tag=KNAS2UQDPVVJ type=del 2024-09-12T00:36:29.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.392+0000 7f030cb87780 1 > prepared operation key=JPEIGLC162K3 tag=JFK2UXOO9LOT type=write size=651070 2024-09-12T00:36:29.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.392+0000 7f030cb87780 1 < completed delete operation key=POC8YA58U55N tag=4LE1PO07ED2P type=del 2024-09-12T00:36:29.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.395+0000 7f030cb87780 1 > prepared operation key=CY2NS03IIUJJ tag=F4EIGKPT74O4 type=del size=597097 2024-09-12T00:36:29.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.395+0000 7f030cb87780 1 < completed delete operation key=9MCRD2G3MZIT tag=W3RQUNCM62T7 type=del 2024-09-12T00:36:29.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.398+0000 7f030cb87780 1 > prepared part key=_multipart_HUDEU16YTO0Y.2~E21T1AM0MFDS.0 size=213090 2024-09-12T00:36:29.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.398+0000 7f030cb87780 1 > prepared multipart upload key=HUDEU16YTO0Y upload=E21T1AM0MFDS tag=CUIN4FUD7U31 type=write size=1261666 2024-09-12T00:36:29.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.400+0000 7f030cb87780 1 < completed write operation key=800OHA7UURC4 tag=LCTFN2R1HQEM type=write size=573577 2024-09-12T00:36:29.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.403+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~BWLFI8CYC2XR.0 size=1048576 2024-09-12T00:36:29.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.403+0000 7f030cb87780 1 > prepared part key=_multipart_39WSAOA6P09M.2~BWLFI8CYC2XR.1 size=679370 2024-09-12T00:36:29.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.403+0000 7f030cb87780 1 > prepared multipart upload key=39WSAOA6P09M upload=BWLFI8CYC2XR tag=WSIWY1N9SFOE type=write size=2776522 2024-09-12T00:36:29.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.404+0000 7f030cb87780 1 < canceled operation key=3W7ANGL92ZF0 tag=SW5QVIN4AEU8 type=del size=809242 2024-09-12T00:36:29.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.407+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~AX6JG9JFPZT9.0 size=1048576 2024-09-12T00:36:29.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.409+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~AX6JG9JFPZT9.1 size=1048576 2024-09-12T00:36:29.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.410+0000 7f030cb87780 1 > prepared part key=_multipart_1VOJGMWNKS0A.2~AX6JG9JFPZT9.2 size=496792 2024-09-12T00:36:29.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.410+0000 7f030cb87780 1 > prepared multipart upload key=1VOJGMWNKS0A upload=AX6JG9JFPZT9 tag=RFB220R1SQS5 type=write size=3642520 2024-09-12T00:36:29.411 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.411+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~DQEEQT6M3Y49.0 size=1048576 2024-09-12T00:36:29.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.413+0000 7f030cb87780 1 < completed part key=_multipart_INFFH9R3EFRY.2~DQEEQT6M3Y49.1 size=547748 2024-09-12T00:36:29.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.416+0000 7f030cb87780 1 < completed multipart upload key=INFFH9R3EFRY upload=DQEEQT6M3Y49 tag=5LFVF14F4YDQ type=write size=2644900 2024-09-12T00:36:29.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.418+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~BHCOUGZ6K1SX.0 size=1048576 2024-09-12T00:36:29.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.418+0000 7f030cb87780 1 > prepared part key=_multipart_IHTFI7W4A6JT.2~BHCOUGZ6K1SX.1 size=298380 2024-09-12T00:36:29.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.418+0000 7f030cb87780 1 > prepared multipart upload key=IHTFI7W4A6JT upload=BHCOUGZ6K1SX tag=6T5BAGCACWST type=write size=2395532 2024-09-12T00:36:29.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.421+0000 7f030cb87780 1 < completed part key=_multipart_1VOJGMWNKS0A.2~DKREXF4UQMJ6.0 size=74718 2024-09-12T00:36:29.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.423+0000 7f030cb87780 1 < completed multipart upload key=1VOJGMWNKS0A upload=DKREXF4UQMJ6 tag=MD4LN1RM0719 type=write size=1123294 2024-09-12T00:36:29.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.426+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~YS30CLS1K06R.0 size=1048576 2024-09-12T00:36:29.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.426+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~YS30CLS1K06R.1 size=1048576 2024-09-12T00:36:29.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.427+0000 7f030cb87780 1 > prepared part key=_multipart_9MCRD2G3MZIT.2~YS30CLS1K06R.2 size=914337 2024-09-12T00:36:29.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.427+0000 7f030cb87780 1 > prepared multipart upload key=9MCRD2G3MZIT upload=YS30CLS1K06R tag=2WVOI50GKGAQ type=write size=4060065 2024-09-12T00:36:29.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.429+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~JAFZEJ7T31Z8.0 size=1048576 2024-09-12T00:36:29.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.429+0000 7f030cb87780 1 < canceled part key=_multipart_39WSAOA6P09M.2~JAFZEJ7T31Z8.1 size=1048576 2024-09-12T00:36:29.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.430+0000 7f030cb87780 1 < completed part key=_multipart_39WSAOA6P09M.2~JAFZEJ7T31Z8.2 size=98167 2024-09-12T00:36:29.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.434+0000 7f030cb87780 1 < canceled multipart upload key=39WSAOA6P09M upload=JAFZEJ7T31Z8 tag=96IJ363KOBX4 type=write size=3243895 2024-09-12T00:36:29.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.434+0000 7f030cb87780 1 > prepared operation key=INFFH9R3EFRY tag=69J2SFNABGJK type=del size=2723028 2024-09-12T00:36:29.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.438+0000 7f030cb87780 1 < suggested update operation key=3W7ANGL92ZF0 tag=4FYML5DRRSVF type=del size=127929 2024-09-12T00:36:29.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.439+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=9SDU1893DEXV type=del size=2293863 2024-09-12T00:36:29.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.440+0000 7f030cb87780 1 < completed write operation key=IHTFI7W4A6JT tag=M7A12GDDYE7I type=write size=1047688 2024-09-12T00:36:29.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.442+0000 7f030cb87780 1 > prepared operation key=UFYMVGL264T8 tag=L6L0YWQZI9FT type=del size=3292536 2024-09-12T00:36:29.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.443+0000 7f030cb87780 1 < completed part key=_multipart_N3KD1UVUVM95.2~CXVUX1I1XADG.0 size=729509 2024-09-12T00:36:29.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.445+0000 7f030cb87780 1 < completed multipart upload key=N3KD1UVUVM95 upload=CXVUX1I1XADG tag=96PIU7AAVN6F type=write size=1778085 2024-09-12T00:36:29.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.447+0000 7f030cb87780 1 > prepared operation key=99OWKRGA8ZZN tag=ZA0DUQSSLB7T type=del size=3068266 2024-09-12T00:36:29.448 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.449+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~3ZY3P6WF05FY.0 size=1048576 2024-09-12T00:36:29.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.450+0000 7f030cb87780 1 < completed part key=_multipart_6WHZRKLM3OLP.2~3ZY3P6WF05FY.1 size=797457 2024-09-12T00:36:29.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.452+0000 7f030cb87780 1 < completed multipart upload key=6WHZRKLM3OLP upload=3ZY3P6WF05FY tag=OBYCI5RKAXJ4 type=write size=2894609 2024-09-12T00:36:29.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.454+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~TDOL2AEHRDEV.0 size=1048576 2024-09-12T00:36:29.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.456+0000 7f030cb87780 1 > prepared part key=_multipart_JPEIGLC162K3.2~TDOL2AEHRDEV.1 size=77584 2024-09-12T00:36:29.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.456+0000 7f030cb87780 1 > prepared multipart upload key=JPEIGLC162K3 upload=TDOL2AEHRDEV tag=5LG211Z2597S type=write size=2174736 2024-09-12T00:36:29.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.457+0000 7f030cb87780 1 < completed write operation key=POC8YA58U55N tag=YQO4373OD2HC type=write size=792451 2024-09-12T00:36:29.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.460+0000 7f030cb87780 1 > prepared part key=_multipart_DLR6A7XOERHW.2~7S166D25GFVS.0 size=150604 2024-09-12T00:36:29.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.460+0000 7f030cb87780 1 > prepared multipart upload key=DLR6A7XOERHW upload=7S166D25GFVS tag=5PI4M341P4SV type=write size=1199180 2024-09-12T00:36:29.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.462+0000 7f030cb87780 1 < completed delete operation key=V87B6SDB1HFZ tag=XMCNUM8RQPRW type=del 2024-09-12T00:36:29.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.464+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~ZM5CGUTF7AAJ.0 size=1048576 2024-09-12T00:36:29.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.466+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~ZM5CGUTF7AAJ.1 size=1048576 2024-09-12T00:36:29.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.468+0000 7f030cb87780 1 > prepared part key=_multipart_QGSJ51GMQXVK.2~ZM5CGUTF7AAJ.2 size=172720 2024-09-12T00:36:29.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.468+0000 7f030cb87780 1 > prepared multipart upload key=QGSJ51GMQXVK upload=ZM5CGUTF7AAJ tag=GV36JW10EY46 type=write size=3318448 2024-09-12T00:36:29.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.470+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~KE2M5HWOTFSF.0 size=1048576 2024-09-12T00:36:29.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.470+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~KE2M5HWOTFSF.1 size=1048576 2024-09-12T00:36:29.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.471+0000 7f030cb87780 1 < completed part key=_multipart_DLR6A7XOERHW.2~KE2M5HWOTFSF.2 size=882489 2024-09-12T00:36:29.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.474+0000 7f030cb87780 1 < completed multipart upload key=DLR6A7XOERHW upload=KE2M5HWOTFSF tag=OQ1R8LE6F0TL type=write size=4028217 2024-09-12T00:36:29.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.476+0000 7f030cb87780 1 > prepared operation key=DLR6A7XOERHW tag=BQJGN9EZOO02 type=del size=2652394 2024-09-12T00:36:29.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.476+0000 7f030cb87780 1 < completed write operation key=V0OLIRP3KH40 tag=J0EFV350JIWC type=write size=791951 2024-09-12T00:36:29.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.480+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~5PL7SFSNOGW8.0 size=1048576 2024-09-12T00:36:29.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.480+0000 7f030cb87780 1 > prepared part key=_multipart_ZQD0491BHJPM.2~5PL7SFSNOGW8.1 size=716209 2024-09-12T00:36:29.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.480+0000 7f030cb87780 1 > prepared multipart upload key=ZQD0491BHJPM upload=5PL7SFSNOGW8 tag=4R6HZ7A1EWEL type=write size=2813361 2024-09-12T00:36:29.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.483+0000 7f030cb87780 1 < completed write operation key=JPEIGLC162K3 tag=JFK2UXOO9LOT type=write size=651070 2024-09-12T00:36:29.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.484+0000 7f030cb87780 1 > prepared part key=_multipart_CUDFTXFBC862.2~A910JJL670L3.0 size=616982 2024-09-12T00:36:29.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.484+0000 7f030cb87780 1 > prepared multipart upload key=CUDFTXFBC862 upload=A910JJL670L3 tag=6X6X6359YAJ1 type=write size=1665558 2024-09-12T00:36:29.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.487+0000 7f030cb87780 1 < canceled operation key=CY2NS03IIUJJ tag=F4EIGKPT74O4 type=del size=597097 2024-09-12T00:36:29.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.489+0000 7f030cb87780 1 > prepared part key=_multipart_56I20YIPY82N.2~C5LQYSG6L4ZM.0 size=410005 2024-09-12T00:36:29.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:36:29.489+0000 7f030cb87780 1 > prepared multipart upload key=56I20YIPY82N upload=C5LQYSG6L4ZM tag=4CTUBGNETX5H type=write size=1458581 2024-09-12T00:36:29.488 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] cls_rgw_stats.simulate (10938 ms) 2024-09-12T00:36:29.488 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 1 test from cls_rgw_stats (10938 ms total) 2024-09-12T00:36:29.488 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:36:29.488 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:30.471 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 1 test from 1 test suite ran. (13785 ms total) 2024-09-12T00:36:30.471 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 1 test. 2024-09-12T00:36:30.474 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:30.475 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:30.558 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:36:30.560 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:36:30.560 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:36:30.645 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-09-12T00:36:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:36:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:32.499 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:36:32.499 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:36:32.512 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (12 ms) 2024-09-12T00:36:32.512 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:36:32.514 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (3 ms) 2024-09-12T00:36:32.514 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:36:32.517 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T00:36:32.517 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:36:32.521 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-12T00:36:32.521 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:36:32.528 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-12T00:36:32.528 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:36:32.536 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64 (8 ms) 2024-09-12T00:36:32.536 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:36:32.539 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-12T00:36:32.539 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:36:32.542 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-12T00:36:32.542 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:36:32.545 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (3 ms) 2024-09-12T00:36:32.545 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:36:32.549 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-12T00:36:32.549 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:36:32.550 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:36:32.550 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:36:32.550 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-12T00:36:32.550 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:36:32.556 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-09-12T00:36:32.556 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:36:32.564 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (8 ms) 2024-09-12T00:36:32.564 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:36:32.571 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-09-12T00:36:32.571 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:36:32.577 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-12T00:36:32.577 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:36:32.586 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-12T00:36:32.586 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:36:32.593 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (7 ms) 2024-09-12T00:36:32.593 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:36:32.595 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-12T00:36:32.595 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:36:32.598 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T00:36:32.598 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:36:32.599 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T00:36:32.599 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:36:32.599 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T00:36:32.600 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:36:32.606 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-12T00:36:32.607 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:36:32.615 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (8 ms) 2024-09-12T00:36:32.615 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:36:32.624 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (9 ms) 2024-09-12T00:36:32.625 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:36:32.631 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (7 ms) 2024-09-12T00:36:32.631 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:36:32.633 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T00:36:32.633 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:36:32.635 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T00:36:32.635 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:36:32.636 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T00:36:32.636 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:36:32.637 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-12T00:36:32.637 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:36:32.644 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-12T00:36:32.645 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 31 tests from CmpOmap (145 ms total) 2024-09-12T00:36:32.645 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:36:32.645 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:33.497 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 31 tests from 1 test suite ran. (2850 ms total) 2024-09-12T00:36:33.497 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 31 tests. 2024-09-12T00:36:33.498 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:33.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:33.541 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:36:33.542 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:36:33.543 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:36:33.629 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-09-12T00:36:33.629 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:36:33.629 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:33.629 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:36:33.629 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:36:36.529 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2898 ms) 2024-09-12T00:36:36.529 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:36:39.556 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3029 ms) 2024-09-12T00:36:39.557 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:36:42.575 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Reserve (3019 ms) 2024-09-12T00:36:42.575 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:36:45.596 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3021 ms) 2024-09-12T00:36:45.596 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:36:48.615 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Commit (3019 ms) 2024-09-12T00:36:48.615 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:36:51.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Stats (3031 ms) 2024-09-12T00:36:51.646 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:36:55.677 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4030 ms) 2024-09-12T00:36:55.677 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:36:58.677 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Abort (3001 ms) 2024-09-12T00:36:58.677 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:37:01.713 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ReserveError (3036 ms) 2024-09-12T00:37:01.714 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:37:04.730 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.CommitError (3017 ms) 2024-09-12T00:37:04.730 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:37:07.751 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AbortError (3021 ms) 2024-09-12T00:37:07.752 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:37:10.767 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3015 ms) 2024-09-12T00:37:10.768 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:37:13.793 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3027 ms) 2024-09-12T00:37:13.793 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:37:16.809 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3016 ms) 2024-09-12T00:37:16.809 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:37:19.833 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3024 ms) 2024-09-12T00:37:19.834 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:37:22.853 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3019 ms) 2024-09-12T00:37:22.853 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:37:25.865 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3010 ms) 2024-09-12T00:37:25.865 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:37:28.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.Cleanup (3029 ms) 2024-09-12T00:37:28.893 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:37:39.934 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11042 ms) 2024-09-12T00:37:39.934 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:37:42.962 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3028 ms) 2024-09-12T00:37:42.962 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:37:56.004 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13041 ms) 2024-09-12T00:37:56.004 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:38:00.037 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4034 ms) 2024-09-12T00:38:00.037 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:38:05.069 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5032 ms) 2024-09-12T00:38:05.069 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:38:10.109 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5040 ms) 2024-09-12T00:38:10.109 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from TestCls2PCQueue (96480 ms total) 2024-09-12T00:38:10.109 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:38:10.109 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:38:10.109 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 24 tests from 1 test suite ran. (96480 ms total) 2024-09-12T00:38:10.109 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 24 tests. 2024-09-12T00:38:10.112 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:38:10.113 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:38:10.153 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:38:10.155 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:38:10.155 DEBUG:teuthology.orchestra.run.smithi083:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:38:10.246 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:10.246 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:10.247 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:38:10.247 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:12.119 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:38:12.120 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:38:12.141 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsAccount.add (22 ms) 2024-09-12T00:38:12.141 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:38:12.147 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsAccount.get (6 ms) 2024-09-12T00:38:12.147 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:38:12.155 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsAccount.rm (8 ms) 2024-09-12T00:38:12.155 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:38:12.168 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] ClsAccount.list (13 ms) 2024-09-12T00:38:12.168 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from ClsAccount (49 ms total) 2024-09-12T00:38:12.168 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:38:12.168 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:38:13.120 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 4 tests from 1 test suite ran. (2874 ms total) 2024-09-12T00:38:13.121 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 4 tests. 2024-09-12T00:38:13.125 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:38:13.125 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:38:13.168 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:38:13.169 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:38:13.169 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:38:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:13.263 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:13.264 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:38:13.264 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:15.140 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:38:15.140 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:38:15.155 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.init_existing_queue (15 ms) 2024-09-12T00:38:15.155 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:38:15.158 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-12T00:38:15.158 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:38:15.536 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (378 ms) 2024-09-12T00:38:15.536 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:38:15.537 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-12T00:38:15.537 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:38:15.540 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T00:38:15.540 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:38:15.542 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T00:38:15.542 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 6 tests from rgw_gc_log (402 ms total) 2024-09-12T00:38:15.542 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:38:15.542 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:38:16.153 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 6 tests from 1 test suite ran. (2890 ms total) 2024-09-12T00:38:16.153 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 6 tests. 2024-09-12T00:38:16.156 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:38:16.156 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:38:16.198 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:38:16.199 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:38:16.199 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:38:16.296 INFO:tasks.workunit.client.0.smithi083.stdout:Running main() from gmock_main.cc 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i= 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i= 2024-09-12T00:38:16.297 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i= 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.298 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.299 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.300 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.301 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-09-12T00:38:16.301 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.301 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.301 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.301 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.301 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.301 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.301 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.301 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-09-12T00:38:16.302 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.303 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i= 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i= 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i= 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.305 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.306 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.307 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.307 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.307 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.307 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.307 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.307 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.308 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.309 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.310 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i=v1 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i=v1 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns= i=v1 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-09-12T00:38:16.311 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.312 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.312 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.312 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.312 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.312 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.312 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.312 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.312 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.313 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.314 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.315 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.316 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.317 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: _obj[v1] 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.318 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.319 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.320 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.321 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.322 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_obj", 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.323 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i= 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i= 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i= 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.324 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.325 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.325 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.325 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.325 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.325 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.325 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.325 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.326 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.327 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.328 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.329 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i= 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.330 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i= 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i= 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.331 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.332 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.333 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.334 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.335 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.336 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i=v1 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i=v1 2024-09-12T00:38:16.337 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns= i=v1 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.338 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.339 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.340 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.341 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.342 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:38:16.343 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout:parsed: obj[v1] 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout: "obj1": { 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.344 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.345 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "obj2": { 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.346 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3": { 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.347 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: "obj3-2": { 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.348 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "obj", 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "v1", 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.349 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.350 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.351 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.352 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.352 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.352 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.352 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.352 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.352 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.352 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.352 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.352 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.353 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.353 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.353 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker_myobj", 2024-09-12T00:38:16.353 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.353 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.354 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.354 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.354 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.354 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.354 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.354 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.355 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.356 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.357 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.357 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.357 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.357 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.357 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.357 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.357 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.358 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.358 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.358 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.358 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.358 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.358 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.358 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.359 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.359 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.359 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.359 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.359 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.360 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.360 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.360 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.360 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.360 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.360 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.361 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker_myobj", 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.362 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.363 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.364 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.364 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.364 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.364 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.364 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.364 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.364 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.364 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.364 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.365 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.366 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.367 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.368 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.369 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.370 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.371 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.372 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.373 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.374 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.375 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.376 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.377 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.378 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.379 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.380 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.381 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.382 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.383 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.384 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.385 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.386 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.387 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.388 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.389 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.389 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.389 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.389 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.389 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.389 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.390 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.392 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.393 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.394 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj", 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.395 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.396 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.397 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.398 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj", 2024-09-12T00:38:16.399 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.400 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.401 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.402 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.403 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.404 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.405 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.406 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.407 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.408 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.409 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.410 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.411 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.412 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.413 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.414 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.415 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.416 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.416 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.416 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.416 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.416 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.416 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.417 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.417 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.417 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.417 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.417 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.417 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.418 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.418 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.418 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.418 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.418 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.418 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.418 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.419 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.419 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.419 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:38:16.419 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-09-12T00:38:16.419 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.419 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.420 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.420 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.420 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.420 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.420 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.420 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.420 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.420 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.421 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.421 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.421 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.421 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.421 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.421 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.422 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.422 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.422 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.422 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.422 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.422 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.423 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.423 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.423 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.423 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.423 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.423 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.424 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.425 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.426 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.427 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.427 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.427 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.427 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.427 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.427 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.428 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.428 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.428 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.428 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.428 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.428 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.429 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.430 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.431 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.432 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.433 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.434 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.435 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.436 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj_", 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.438 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj_", 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.443 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.444 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.445 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.446 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.448 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.448 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.448 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.448 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.448 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.448 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.448 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.448 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.448 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.449 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.450 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.451 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.452 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.453 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.453 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.453 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.453 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.453 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.453 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.454 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.454 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.454 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.454 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.454 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.454 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.455 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.455 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.455 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.455 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.455 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.455 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.455 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.456 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.456 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.456 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.456 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.456 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.456 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.456 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.457 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.457 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.457 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.457 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.457 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.457 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.457 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.457 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.458 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.458 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.458 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.458 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.458 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.458 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.459 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.459 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.459 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.459 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.459 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.459 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.460 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.460 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.460 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.460 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.460 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:38:16.460 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.461 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.462 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.463 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.464 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.465 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.466 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.467 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.468 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": "default-placement.data", 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.469 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "test", 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": "", 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": "" 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.470 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.471 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: "obj": { 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.472 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.473 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.474 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.475 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.476 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker_myobj", 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.477 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.478 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker_myobj", 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.479 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.480 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.481 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.482 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.483 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:38:16.484 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.485 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:38:16.486 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.487 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.488 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.489 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.490 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.491 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "myobj", 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.492 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj", 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.493 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.494 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj", 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.495 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.496 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.497 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.498 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.499 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.500 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.501 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:38:16.502 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj" 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.503 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.504 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.505 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.506 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.507 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj", 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.508 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj_", 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.509 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.510 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker___myobj_", 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.511 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.512 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.513 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.514 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.515 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "", 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.516 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.517 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.518 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "marker__myobj_" 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.519 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "" 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.520 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj": { 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj": { 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.521 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.522 INFO:tasks.workunit.client.0.smithi083.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "raw_obj2": { 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "pool": ".data-pool", 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "loc": "" 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "new_obj2": { 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket": { 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "ebtest", 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "marker": "marker", 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_id": "bucket-id", 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "tenant": "", 2024-09-12T00:38:16.523 INFO:tasks.workunit.client.0.smithi083.stdout: "explicit_placement": { 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: "data_pool": ".data-pool", 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: "data_extra_pool": "", 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: "index_pool": ".index-pool" 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: "key": { 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: "name": "_myobj_", 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: "instance": "inst", 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: "ns": "ns" 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:38:16.524 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-12T00:38:16.525 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T00:38:16.525 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:38:16.525 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:38:16.525 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T00:38:16.525 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 4 tests. 2024-09-12T00:38:16.525 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:38:16.525 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:38:16.566 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:38:16.567 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:38:16.567 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:38:16.682 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:16.682 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:16.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.724+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.726+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.726+0000 7fec36d28800 20 realm 2024-09-12T00:38:16.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.726+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.726+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.726+0000 7fec36d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:16.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.726+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.726+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.726+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.727+0000 7fec36d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:16.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.727+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.727+0000 7fec36d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:16.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.727+0000 7fec36d28800 20 searching for the correct realm 2024-09-12T00:38:16.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.740+0000 7fec33270640 0 -- 172.21.15.83:0/2439236377 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7fec1c02b030 msgr2=0x7fec1c035410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:16.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.748+0000 7fec32a6f640 0 -- 172.21.15.83:0/2439236377 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fec2c017070 msgr2=0x7fec2c07e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.751+0000 7fec36d28800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.751+0000 7fec36d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.751+0000 7fec36d28800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.751+0000 7fec36d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.751+0000 7fec36d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.751+0000 7fec36d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.751+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 20 zone default found 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 4 Realm: () 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 20 zonegroup default 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.752+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.753+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.753+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.753+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.753+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.753+0000 7fec36d28800 20 started sync module instance, tier type = 2024-09-12T00:38:16.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.753+0000 7fec36d28800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:38:16.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.763+0000 7fec36d28800 20 add_watcher() i=0 2024-09-12T00:38:16.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.763+0000 7fec36d28800 20 add_watcher() i=1 2024-09-12T00:38:16.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.763+0000 7fec36d28800 20 add_watcher() i=2 2024-09-12T00:38:16.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.763+0000 7fec36d28800 20 add_watcher() i=3 2024-09-12T00:38:16.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.763+0000 7fec36d28800 20 add_watcher() i=4 2024-09-12T00:38:16.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.763+0000 7fec36d28800 20 add_watcher() i=5 2024-09-12T00:38:16.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.763+0000 7fec36d28800 20 add_watcher() i=6 2024-09-12T00:38:16.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.764+0000 7fec36d28800 20 add_watcher() i=7 2024-09-12T00:38:16.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.764+0000 7fec36d28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:16.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.766+0000 7feae97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:16.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.766+0000 7fec36d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:16.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.766+0000 7fec36d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:16.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.766+0000 7fec36d28800 5 note: GC not initialized 2024-09-12T00:38:16.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fea63fff640 20 reqs_thread_entry: start 2024-09-12T00:38:16.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fec36d28800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:16.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fec36d28800 20 Filter name: none 2024-09-12T00:38:16.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fea61ffb640 20 reqs_thread_entry: start 2024-09-12T00:38:16.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fec36d28800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:38:16.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fec36d28800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:38:16.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fec36d28800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:38:16.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fec36d28800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:38:16.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.767+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:38:16.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:38:16.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 10 cache get: name=default.rgw.meta+users.keys+WkxvvN89eYQdMO5P90U4UMt1yWc= : miss 2024-09-12T00:38:16.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 10 cache put: name=default.rgw.meta+users.keys+WkxvvN89eYQdMO5P90U4UMt1yWc= info.flags=0x0 2024-09-12T00:38:16.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 10 adding default.rgw.meta+users.keys+WkxvvN89eYQdMO5P90U4UMt1yWc= to cache LRU end 2024-09-12T00:38:16.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 10 cache get: name=default.rgw.meta+users.keys+WkxvvN89eYQdMO5P90U4UMt1yWc= : hit (negative entry) 2024-09-12T00:38:16.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.768+0000 7fec36d28800 10 cache get: name=default.rgw.meta+users.keys+WkxvvN89eYQdMO5P90U4UMt1yWc= : hit (negative entry) 2024-09-12T00:38:16.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.770+0000 7fec36d28800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:38:16.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.770+0000 7fec36d28800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:38:16.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.770+0000 7fec36d28800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:38:16.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.770+0000 7feb167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758594 cookie 94707288745856 notifier 5297 bl.length()=697 2024-09-12T00:38:16.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.770+0000 7feb167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:38:16.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.770+0000 7feb167fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:38:16.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.771+0000 7fec36d28800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:38:16.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.771+0000 7fec36d28800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:38:16.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.771+0000 7fec36d28800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:38:16.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.772+0000 7feb167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758595 cookie 94707288742432 notifier 5297 bl.length()=194 2024-09-12T00:38:16.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.772+0000 7feb167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:38:16.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.772+0000 7feb167fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:38:16.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.773+0000 7fec36d28800 10 cache put: name=default.rgw.meta+users.keys+WkxvvN89eYQdMO5P90U4UMt1yWc= info.flags=0x7 2024-09-12T00:38:16.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.773+0000 7fec36d28800 10 moving default.rgw.meta+users.keys+WkxvvN89eYQdMO5P90U4UMt1yWc= to cache LRU end 2024-09-12T00:38:16.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.773+0000 7fec36d28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:WkxvvN89eYQdMO5P90U4UMt1yWc=, ofs0, ns] 2024-09-12T00:38:16.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.773+0000 7feb167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758595 cookie 94707288754864 notifier 5297 bl.length()=203 2024-09-12T00:38:16.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.773+0000 7feb167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WkxvvN89eYQdMO5P90U4UMt1yWc= info.flags=0x7 2024-09-12T00:38:16.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.773+0000 7feb167fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WkxvvN89eYQdMO5P90U4UMt1yWc= to cache LRU end 2024-09-12T00:38:16.775 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "display_name": "librgw test user", 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "email": "librgw@example.com", 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "suspended": 0, 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "subusers": [], 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "keys": [ 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: { 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "access_key": "WkxvvN89eYQdMO5P90U4UMt1yWc=", 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "secret_key": "RzurG07ipfejpe4fDI1VXQkcqv3X9THDMpqjAQmEd2Jf2Gl43Uur5A==", 2024-09-12T00:38:16.776 INFO:tasks.workunit.client.0.smithi083.stdout: "active": true, 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-09-12T00:38:16.769700Z" 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: ], 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "swift_keys": [], 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "caps": [], 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "default_placement": "", 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "placement_tags": [], 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_quota": { 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:38:16.777 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "user_quota": { 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "type": "rgw", 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:38:16.778 INFO:tasks.workunit.client.0.smithi083.stdout: "account_id": "", 2024-09-12T00:38:16.779 INFO:tasks.workunit.client.0.smithi083.stdout: "path": "/", 2024-09-12T00:38:16.779 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-09-12T00:38:16.769687Z", 2024-09-12T00:38:16.779 INFO:tasks.workunit.client.0.smithi083.stdout: "tags": [], 2024-09-12T00:38:16.779 INFO:tasks.workunit.client.0.smithi083.stdout: "group_ids": [] 2024-09-12T00:38:16.779 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:38:16.779 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:38:16.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.775+0000 7feae97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:16.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.777+0000 7fec36d28800 20 remove_watcher() i=0 2024-09-12T00:38:16.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.777+0000 7fec36d28800 2 removed watcher, disabling cache 2024-09-12T00:38:16.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.778+0000 7fec36d28800 20 remove_watcher() i=1 2024-09-12T00:38:16.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.779+0000 7fec36d28800 20 remove_watcher() i=2 2024-09-12T00:38:16.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.780+0000 7fec36d28800 20 remove_watcher() i=3 2024-09-12T00:38:16.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.781+0000 7fec36d28800 20 remove_watcher() i=4 2024-09-12T00:38:16.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.782+0000 7fec36d28800 20 remove_watcher() i=5 2024-09-12T00:38:16.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.783+0000 7fec36d28800 20 remove_watcher() i=6 2024-09-12T00:38:16.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:16.784+0000 7fec36d28800 20 remove_watcher() i=7 2024-09-12T00:38:16.793 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1.1 2024-09-12T00:38:16.814 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:38:16.814 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:16.814 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:38:16.814 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:38:16.825 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:16.825 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:17.200 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (386 ms) 2024-09-12T00:38:17.200 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:38:17.201 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:38:17.201 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:38:17.201 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:38:17.201 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:38:17.208 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:38:17.213 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/f1 2024-09-12T00:38:17.216 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/f2 2024-09-12T00:38:17.219 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:38:17.222 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:38:17.225 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:38:17.228 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:38:17.231 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:38:17.234 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:38:17.237 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:38:17.240 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:38:17.243 INFO:tasks.workunit.client.0.smithi083.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:38:17.246 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_HIER1 (45 ms) 2024-09-12T00:38:17.246 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:38:17.342 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_DIRS1 (96 ms) 2024-09-12T00:38:17.342 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:38:17.342 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:38:17.343 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:38:17.358 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (16 ms) 2024-09-12T00:38:17.358 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:38:17.394 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (36 ms) 2024-09-12T00:38:17.394 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:38:17.394 INFO:tasks.workunit.client.0.smithi083.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:38:17.400 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-12T00:38:17.401 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:38:17.401 INFO:tasks.workunit.client.0.smithi083.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:38:17.407 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-12T00:38:17.408 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:38:17.408 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:38:17.408 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:38:17.408 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:38:17.408 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:38:17.408 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:38:17.408 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:38:17.408 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:38:17.409 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:38:17.410 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:38:17.410 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:38:17.411 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:38:17.411 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:38:17.411 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:38:17.413 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:38:17.413 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:38:17.415 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:38:17.415 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:38:17.415 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:38:17.416 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:38:17.416 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:38:17.417 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:38:17.417 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READ_DIRS1 (11 ms) 2024-09-12T00:38:17.417 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:38:17.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_SETUP1 (172 ms) 2024-09-12T00:38:17.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:38:17.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:38:17.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:38:17.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:38:17.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:38:17.591 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:38:17.591 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:38:17.591 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:38:17.592 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:38:17.598 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:38:17.598 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:38:17.600 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:38:17.602 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:38:17.605 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:38:17.605 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:38:17.605 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:38:17.606 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:38:17.606 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:38:17.607 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:38:17.608 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:38:17.609 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:38:17.610 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:38:17.611 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:38:17.611 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:38:17.611 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:38:17.611 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:38:17.611 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:38:17.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:17.611+0000 7f4b8f1428c0 -1 shutting down 2024-09-12T00:38:17.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:17.612+0000 7f4a67147640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65496, si_uid : 1000, si_addr0x3e80000ffd8, si_status0 2024-09-12T00:38:47.261 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29652 ms) 2024-09-12T00:38:47.261 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW (30447 ms total) 2024-09-12T00:38:47.262 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:38:47.262 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:38:47.262 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 24 tests from 1 test suite ran. (30447 ms total) 2024-09-12T00:38:47.262 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 24 tests. 2024-09-12T00:38:47.268 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1.2 2024-09-12T00:38:47.292 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:38:47.292 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:47.292 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:38:47.292 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:38:47.300 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:47.300 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:47.888 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (596 ms) 2024-09-12T00:38:47.888 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:38:47.889 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:38:47.889 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:38:47.889 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:38:47.889 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:38:47.889 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:38:47.890 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:38:47.891 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:38:47.892 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:38:47.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:47.890+0000 7f3bc9b0c8c0 -1 shutting down 2024-09-12T00:38:47.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:38:47.891+0000 7f3aa384b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66118, si_uid : 1000, si_addr0x3e800010246, si_status0 2024-09-12T00:39:18.274 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30384 ms) 2024-09-12T00:39:18.275 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW (30981 ms total) 2024-09-12T00:39:18.275 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:39:18.275 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:18.275 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 24 tests from 1 test suite ran. (30981 ms total) 2024-09-12T00:39:18.275 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 24 tests. 2024-09-12T00:39:18.280 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1.3 2024-09-12T00:39:18.304 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:39:18.304 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:39:18.304 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:39:18.304 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:39:18.315 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:18.315 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:18.493 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (188 ms) 2024-09-12T00:39:18.493 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:39:18.494 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:39:18.494 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:39:18.494 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:39:18.494 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:39:18.498 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-12T00:39:18.498 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:39:18.560 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETUP_DIRS1 (62 ms) 2024-09-12T00:39:18.560 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:39:18.560 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:39:18.560 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:39:18.561 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:39:18.562 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:39:18.563 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:39:18.563 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:39:18.563 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:39:18.563 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:39:18.564 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:39:18.565 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:39:18.565 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:39:18.567 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:39:18.567 INFO:tasks.workunit.client.0.smithi083.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:39:18.567 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:39:18.568 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:39:18.568 INFO:tasks.workunit.client.0.smithi083.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:39:18.569 INFO:tasks.workunit.client.0.smithi083.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:39:18.569 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-12T00:39:18.569 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:39:18.569 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:39:18.570 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:39:18.571 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:39:18.571 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:39:18.571 INFO:tasks.workunit.client.0.smithi083.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:39:18.571 INFO:tasks.workunit.client.0.smithi083.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:39:18.571 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:39:18.571 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:39:18.575 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:39:18.575 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:39:18.577 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:39:18.579 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:39:18.581 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:39:18.582 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:39:18.582 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:39:18.583 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:39:18.583 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:39:18.584 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:39:18.584 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:39:18.586 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:39:18.586 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.HIER1 (17 ms) 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:39:18.587 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:39:18.588 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:39:18.588 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:39:18.588 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:39:18.588 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:39:18.588 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:39:18.588 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:39:18.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:39:18.587+0000 7efe781208c0 -1 shutting down 2024-09-12T00:39:18.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:39:18.588+0000 7efd4ff75640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66737, si_uid : 1000, si_addr0x3e8000104b1, si_status0 2024-09-12T00:39:48.657 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30071 ms) 2024-09-12T00:39:48.658 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 24 tests from LibRGW (30353 ms total) 2024-09-12T00:39:48.658 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:39:48.658 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:48.658 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 24 tests from 1 test suite ran. (30353 ms total) 2024-09-12T00:39:48.658 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 24 tests. 2024-09-12T00:39:48.664 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2.1 2024-09-12T00:39:48.689 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:39:48.689 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:39:48.689 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:39:48.689 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:39:48.698 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:48.698 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:48.876 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (187 ms) 2024-09-12T00:39:48.876 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:39:48.876 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:39:48.877 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:39:48.884 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2024-09-12T00:39:48.884 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:39:48.884 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:39:48.884 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:39:48.890 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave0 2024-09-12T00:39:48.897 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave1 2024-09-12T00:39:48.903 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave2 2024-09-12T00:39:48.910 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave3 2024-09-12T00:39:48.917 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave4 2024-09-12T00:39:48.924 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave5 2024-09-12T00:39:48.931 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave6 2024-09-12T00:39:48.937 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave7 2024-09-12T00:39:48.944 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave8 2024-09-12T00:39:48.950 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave9 2024-09-12T00:39:48.950 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (66 ms) 2024-09-12T00:39:48.950 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:39:49.090 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (140 ms) 2024-09-12T00:39:49.090 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:39:49.090 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:39:49.090 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:39:49.090 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:39:49.090 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:39:49.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:39:49.091+0000 7f67f432b8c0 -1 shutting down 2024-09-12T00:39:49.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:39:49.092+0000 7f66cc2a4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67359, si_uid : 1000, si_addr0x3e80001071f, si_status0 2024-09-12T00:40:19.220 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30130 ms) 2024-09-12T00:40:19.221 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from LibRGW (30531 ms total) 2024-09-12T00:40:19.221 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:40:19.221 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:40:19.221 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 9 tests from 1 test suite ran. (30531 ms total) 2024-09-12T00:40:19.221 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 9 tests. 2024-09-12T00:40:19.226 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2.2 2024-09-12T00:40:19.251 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:40:19.251 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:40:19.251 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:40:19.251 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:40:19.260 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:19.260 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:19.434 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (183 ms) 2024-09-12T00:40:19.434 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:40:19.435 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:40:19.435 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:40:19.435 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:40:19.435 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:40:19.451 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (16 ms) 2024-09-12T00:40:19.451 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:40:19.457 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave0 2024-09-12T00:40:19.464 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave1 2024-09-12T00:40:19.470 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave2 2024-09-12T00:40:19.477 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave3 2024-09-12T00:40:19.483 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave4 2024-09-12T00:40:19.490 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave5 2024-09-12T00:40:19.496 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave6 2024-09-12T00:40:19.503 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave7 2024-09-12T00:40:19.509 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave8 2024-09-12T00:40:19.516 INFO:tasks.workunit.client.0.smithi083.stdout:created: sorrydave9 2024-09-12T00:40:19.516 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (65 ms) 2024-09-12T00:40:19.516 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:40:19.654 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (138 ms) 2024-09-12T00:40:19.654 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:40:19.654 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:40:19.655 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:40:19.655 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:40:19.655 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:40:19.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:40:19.656+0000 7eff54ac58c0 -1 shutting down 2024-09-12T00:40:19.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:40:19.657+0000 7efe2ba1c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67982, si_uid : 1000, si_addr0x3e80001098e, si_status0 2024-09-12T00:40:49.717 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30062 ms) 2024-09-12T00:40:49.717 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 9 tests from LibRGW (30465 ms total) 2024-09-12T00:40:49.717 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:40:49.717 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:40:49.717 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 9 tests from 1 test suite ran. (30465 ms total) 2024-09-12T00:40:49.717 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 9 tests. 2024-09-12T00:40:49.722 INFO:tasks.workunit.client.0.smithi083.stdout:phase 3.1 2024-09-12T00:40:50.036 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:40:50.036 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:40:50.036 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:40:50.036 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:40:50.045 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:50.045 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:50.218 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (182 ms) 2024-09-12T00:40:50.218 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:40:50.219 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:40:50.219 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:40:50.226 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2024-09-12T00:40:50.226 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:40:50.228 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (2 ms) 2024-09-12T00:40:50.228 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:40:50.229 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:40:50.229 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:40:50.281 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LARGE1 (52 ms) 2024-09-12T00:40:50.281 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:40:50.328 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LARGE2 (47 ms) 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:40:50.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:40:50.329+0000 7ff84351f8c0 -1 shutting down 2024-09-12T00:40:50.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:40:50.331+0000 7ff71a831640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68601, si_uid : 1000, si_addr0x3e800010bf9, si_status0 2024-09-12T00:41:20.499 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30171 ms) 2024-09-12T00:41:20.500 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 13 tests from LibRGW (30463 ms total) 2024-09-12T00:41:20.500 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:41:20.500 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:41:20.500 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 13 tests from 1 test suite ran. (30463 ms total) 2024-09-12T00:41:20.500 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 13 tests. 2024-09-12T00:41:20.507 INFO:tasks.workunit.client.0.smithi083.stdout:phase 3.2 2024-09-12T00:41:20.826 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:41:20.826 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:41:20.826 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:41:20.826 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:41:20.834 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:20.834 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:21.003 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (177 ms) 2024-09-12T00:41:21.004 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:41:21.004 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:41:21.004 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:41:21.004 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:41:21.005 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:41:21.008 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:41:21.008 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:41:21.011 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:41:21.012 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:41:21.069 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LARGE1 (56 ms) 2024-09-12T00:41:21.069 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:41:21.069 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:41:21.069 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:41:21.069 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:41:21.069 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:41:21.074 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-12T00:41:21.074 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:41:21.087 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (14 ms) 2024-09-12T00:41:21.088 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:41:21.088 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:41:21.088 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:41:21.088 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:41:21.088 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:41:21.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:41:21.088+0000 7f9177f448c0 -1 shutting down 2024-09-12T00:41:21.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:41:21.089+0000 7f904ff47640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69220, si_uid : 1000, si_addr0x3e800010e64, si_status0 2024-09-12T00:41:51.312 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30223 ms) 2024-09-12T00:41:51.312 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 13 tests from LibRGW (30485 ms total) 2024-09-12T00:41:51.312 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:41:51.312 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:41:51.312 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 13 tests from 1 test suite ran. (30485 ms total) 2024-09-12T00:41:51.312 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 13 tests. 2024-09-12T00:41:51.319 INFO:tasks.workunit.client.0.smithi083.stdout:phase 4.1 2024-09-12T00:41:51.343 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:41:51.343 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:41:51.343 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:41:51.343 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:41:51.344 INFO:tasks.workunit.client.0.smithi083.stdout:read i1: 64001 2024-09-12T00:41:51.344 INFO:tasks.workunit.client.0.smithi083.stdout:read s1: blunderbuss 2024-09-12T00:41:51.344 INFO:tasks.workunit.client.0.smithi083.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:41:51.344 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:41:51.354 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:51.355 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:51.536 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (193 ms) 2024-09-12T00:41:51.536 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:41:51.536 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:41:51.536 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:41:51.552 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-12T00:41:51.552 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_0 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_1 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_2 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_3 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_4 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_5 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_6 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_7 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_8 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_9 2024-09-12T00:41:52.110 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_10 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_11 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_12 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_13 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_14 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_15 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_16 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_17 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_18 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_19 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_20 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_21 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_22 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_23 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_24 2024-09-12T00:41:52.111 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_25 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_26 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_27 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_28 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_29 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_30 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_31 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_32 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_33 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_34 2024-09-12T00:41:52.112 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_35 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_36 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_37 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_38 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_39 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_40 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_41 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_42 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_43 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_44 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_45 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_46 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_47 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_48 2024-09-12T00:41:52.113 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_49 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_50 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_51 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_52 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_53 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_54 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_55 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_56 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_57 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_58 2024-09-12T00:41:52.114 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_59 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_60 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_61 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_62 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_63 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_64 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_65 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_66 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_67 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_68 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_69 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_70 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_71 2024-09-12T00:41:52.115 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_72 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_73 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_74 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_75 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_76 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_77 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_78 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_79 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_80 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_81 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_82 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_83 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_84 2024-09-12T00:41:52.116 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_85 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_86 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_87 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_88 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_89 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_90 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_91 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_92 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_93 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_94 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_95 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_96 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_97 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_98 2024-09-12T00:41:52.117 INFO:tasks.workunit.client.0.smithi083.stdout:created: dmarker:f_99 2024-09-12T00:41:52.118 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (558 ms) 2024-09-12T00:41:52.118 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:41:52.119 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:41:52.119 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:41:52.119 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:41:52.119 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:41:52.119 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:41:52.119 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:41:52.119 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:41:52.119 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:41:52.119 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:41:52.120 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:41:52.121 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:41:52.122 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:41:52.123 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:41:52.124 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:41:52.125 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:41:52.126 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:41:52.127 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:41:52.128 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:41:52.129 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:41:52.130 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:41:52.131 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:41:52.132 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:41:52.133 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:41:52.134 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:41:52.135 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:41:52.135 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:41:52.135 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:41:52.135 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:41:52.135 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:41:52.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:41:52.116+0000 7f0f3d33d8c0 -1 shutting down 2024-09-12T00:41:52.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:41:52.117+0000 7f0e1533c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69840, si_uid : 1000, si_addr0x3e8000110d0, si_status0 2024-09-12T00:42:21.606 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29490 ms) 2024-09-12T00:42:21.606 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from LibRGW (30262 ms total) 2024-09-12T00:42:21.606 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:42:21.606 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:42:21.606 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 11 tests from 1 test suite ran. (30262 ms total) 2024-09-12T00:42:21.606 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 11 tests. 2024-09-12T00:42:21.613 INFO:tasks.workunit.client.0.smithi083.stdout:phase 4.2 2024-09-12T00:42:21.638 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:42:21.638 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:42:21.638 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:42:21.638 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:42:21.638 INFO:tasks.workunit.client.0.smithi083.stdout:read i1: 64001 2024-09-12T00:42:21.638 INFO:tasks.workunit.client.0.smithi083.stdout:read s1: blunderbuss 2024-09-12T00:42:21.639 INFO:tasks.workunit.client.0.smithi083.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:42:21.639 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:42:21.646 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:21.646 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:21.844 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (206 ms) 2024-09-12T00:42:21.844 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:42:21.845 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:42:21.845 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:42:21.854 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-09-12T00:42:21.854 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:42:21.854 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:42:21.854 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:42:21.854 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:42:21.855 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:42:21.858 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:42:21.858 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:42:21.858 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:42:21.858 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:42:21.859 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:42:21.860 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:42:21.860 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:42:21.860 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:42:21.860 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:42:21.860 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:42:21.860 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:42:21.860 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:42:21.861 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:42:21.862 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:42:21.863 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:42:21.864 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:42:21.865 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:42:21.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:42:21.867 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:42:21.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:42:21.859+0000 7fed7a12b8c0 -1 shutting down 2024-09-12T00:42:21.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:42:21.860+0000 7fec520a4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70459, si_uid : 1000, si_addr0x3e80001133b, si_status0 2024-09-12T00:42:52.145 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30288 ms) 2024-09-12T00:42:52.146 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 11 tests from LibRGW (30507 ms total) 2024-09-12T00:42:52.146 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:42:52.146 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:42:52.146 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 11 tests from 1 test suite ran. (30507 ms total) 2024-09-12T00:42:52.146 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 11 tests. 2024-09-12T00:42:52.152 INFO:tasks.workunit.client.0.smithi083.stdout:phase 5.1 2024-09-12T00:42:52.184 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:42:52.185 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:42:52.185 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:42:52.185 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:42:52.195 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:52.195 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:52.574 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-09-12T00:42:52.574 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:42:52.574 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:42:52.574 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:42:52.582 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2024-09-12T00:42:52.582 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:42:52.585 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-12T00:42:52.585 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:42:52.585 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:42:52.585 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:42:52.586 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:42:52.586 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:42:52.586 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:42:52.586 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:42:52.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-12T00:42:52.591 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:42:52.593 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T00:42:52.593 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:42:52.593 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:42:52.593 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:42:52.593 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:42:52.594 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:42:52.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:42:52.594+0000 7fbc361248c0 -1 shutting down 2024-09-12T00:42:52.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:42:52.596+0000 7fbb0e09a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71078, si_uid : 1000, si_addr0x3e8000115a6, si_status0 2024-09-12T00:43:22.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30272 ms) 2024-09-12T00:43:22.866 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from LibRGW (30680 ms total) 2024-09-12T00:43:22.866 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:43:22.866 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:43:22.866 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 19 tests from 1 test suite ran. (30680 ms total) 2024-09-12T00:43:22.866 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 19 tests. 2024-09-12T00:43:22.872 INFO:tasks.workunit.client.0.smithi083.stdout:phase 5.2 2024-09-12T00:43:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:43:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:43:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:43:22.905 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:43:22.912 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:22.913 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:23.497 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (592 ms) 2024-09-12T00:43:23.497 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:43:23.498 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:43:23.498 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:43:23.498 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:43:23.498 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:43:23.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:43:23.502 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:43:23.503 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:43:23.504 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:43:23.504 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:43:23.504 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:43:23.504 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:43:23.504 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:43:23.504 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:43:23.508 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-12T00:43:23.508 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:43:23.522 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.DELETE_BUCKET (14 ms) 2024-09-12T00:43:23.523 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:43:23.523 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:43:23.523 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:43:23.523 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:43:23.523 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:43:23.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:43:23.523+0000 7f335c60e8c0 -1 shutting down 2024-09-12T00:43:23.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:43:23.524+0000 7f323200e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71697, si_uid : 1000, si_addr0x3e800011811, si_status0 2024-09-12T00:43:53.762 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (30239 ms) 2024-09-12T00:43:53.762 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 19 tests from LibRGW (30856 ms total) 2024-09-12T00:43:53.762 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:43:53.762 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:43:53.762 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 19 tests from 1 test suite ran. (30856 ms total) 2024-09-12T00:43:53.762 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 19 tests. 2024-09-12T00:43:53.767 INFO:tasks.workunit.client.0.smithi083.stdout:phase 6.1 2024-09-12T00:43:53.792 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:43:53.792 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment set-up. 2024-09-12T00:43:53.792 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:43:53.792 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:43:53.800 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:53.800 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:53.974 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.INIT (183 ms) 2024-09-12T00:43:53.975 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:43:53.975 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:43:53.975 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:43:53.989 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CREATE_BUCKETS (15 ms) 2024-09-12T00:43:53.990 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:43:53.994 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (5 ms) 2024-09-12T00:43:53.995 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.TOPDIR_RENAME (19 ms) 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:43:54.039 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SUBDIR_RENAME (25 ms) 2024-09-12T00:43:54.039 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:43:54.062 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (23 ms) 2024-09-12T00:43:54.062 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:43:54.062 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:43:54.062 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:43:54.062 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:43:54.062 INFO:tasks.workunit.client.0.smithi083.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:43:54.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:43:54.063+0000 7fdd04e538c0 -1 shutting down 2024-09-12T00:43:54.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:43:54.064+0000 7fdbdeb92640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 72316, si_uid : 1000, si_addr0x3e800011a7c, si_status0 2024-09-12T00:44:24.024 INFO:tasks.workunit.client.0.smithi083.stdout:[ OK ] LibRGW.SHUTDOWN (29962 ms) 2024-09-12T00:44:24.024 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] 10 tests from LibRGW (30232 ms total) 2024-09-12T00:44:24.025 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:44:24.025 INFO:tasks.workunit.client.0.smithi083.stdout:[----------] Global test environment tear-down 2024-09-12T00:44:24.025 INFO:tasks.workunit.client.0.smithi083.stdout:[==========] 10 tests from 1 test suite ran. (30232 ms total) 2024-09-12T00:44:24.025 INFO:tasks.workunit.client.0.smithi083.stdout:[ PASSED ] 10 tests. 2024-09-12T00:44:24.033 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:44:24.033 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:44:24.078 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:44:24.079 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:44:24.079 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:44:24.154 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -z ']' 2024-09-12T00:44:24.154 INFO:tasks.workunit.client.0.smithi083.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:44:24.154 INFO:tasks.workunit.client.0.smithi083.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:44:24.154 INFO:tasks.workunit.client.0.smithi083.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:44:24.154 INFO:tasks.workunit.client.0.smithi083.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:44:24.155 INFO:tasks.workunit.client.0.smithi083.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T00:44:24.191 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:24.191 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:24.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.229+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.230+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.230+0000 7fbfe2a2f800 20 realm 2024-09-12T00:44:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.230+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.230+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.230+0000 7fbfe2a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:24.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.230+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.230+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.230+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.231+0000 7fbfe2a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.231+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.231+0000 7fbfe2a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:24.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.231+0000 7fbfe2a2f800 20 searching for the correct realm 2024-09-12T00:44:24.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.235+0000 7fbfd7fff640 0 -- 172.21.15.83:0/810529412 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fbfc80467d0 msgr2=0x7fbfc800f750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:24.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.239+0000 7fbfe0d1a640 0 -- 172.21.15.83:0/810529412 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x562f44193190 msgr2=0x562f44195600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:24.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.243+0000 7fbfe2a2f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:44:24.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.243+0000 7fbfe2a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:24.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.243+0000 7fbfe2a2f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:44:24.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.243+0000 7fbfe2a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:24.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.243+0000 7fbfe2a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:24.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.243+0000 7fbfe2a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:24.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.243+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:24.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 zone default found 2024-09-12T00:44:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 4 Realm: () 2024-09-12T00:44:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:44:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:44:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 zonegroup default 2024-09-12T00:44:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.244+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.245+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.245+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.245+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.245+0000 7fbfe2a2f800 20 started sync module instance, tier type = 2024-09-12T00:44:24.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.245+0000 7fbfe2a2f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:44:24.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.254+0000 7fbfe2a2f800 20 add_watcher() i=0 2024-09-12T00:44:24.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.254+0000 7fbfe2a2f800 20 add_watcher() i=1 2024-09-12T00:44:24.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.254+0000 7fbfe2a2f800 20 add_watcher() i=2 2024-09-12T00:44:24.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.254+0000 7fbfe2a2f800 20 add_watcher() i=3 2024-09-12T00:44:24.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.254+0000 7fbfe2a2f800 20 add_watcher() i=4 2024-09-12T00:44:24.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.254+0000 7fbfe2a2f800 20 add_watcher() i=5 2024-09-12T00:44:24.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.254+0000 7fbfe2a2f800 20 add_watcher() i=6 2024-09-12T00:44:24.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.255+0000 7fbfe2a2f800 20 add_watcher() i=7 2024-09-12T00:44:24.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.255+0000 7fbfe2a2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:24.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.257+0000 7fbe96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:24.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.258+0000 7fbfe2a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:24.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.258+0000 7fbfe2a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:24.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.258+0000 7fbfe2a2f800 5 note: GC not initialized 2024-09-12T00:44:24.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.258+0000 7fbe95fdb640 20 reqs_thread_entry: start 2024-09-12T00:44:24.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.258+0000 7fbfe2a2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:44:24.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.258+0000 7fbfe2a2f800 20 Filter name: none 2024-09-12T00:44:24.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.258+0000 7fbe077fe640 20 reqs_thread_entry: start 2024-09-12T00:44:24.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.258+0000 7fbfe2a2f800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:44:24.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.258+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.259+0000 7fbfe2a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.260+0000 7fbfe2a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:24.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.260+0000 7fbfe2a2f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:44:24.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.260+0000 7fbfe2a2f800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:44:24.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.260+0000 7fbfe2a2f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:44:24.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.260+0000 7fbfe2a2f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:44:24.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.261+0000 7fbfe2a2f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:44:24.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.261+0000 7fbfe2a2f800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:44:24.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.261+0000 7fbfe2a2f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:44:24.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.261+0000 7fbeb77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758661 cookie 94761006023808 notifier 5513 bl.length()=677 2024-09-12T00:44:24.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.261+0000 7fbeb77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:44:24.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.261+0000 7fbeb77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:44:24.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.263+0000 7fbfe2a2f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:44:24.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.263+0000 7fbfe2a2f800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:44:24.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.263+0000 7fbfe2a2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:44:24.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.263+0000 7fbeb77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758600 cookie 94761006009744 notifier 5513 bl.length()=187 2024-09-12T00:44:24.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.263+0000 7fbeb77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:44:24.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.263+0000 7fbeb77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:44:24.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.265+0000 7fbfe2a2f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:44:24.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.265+0000 7fbfe2a2f800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:44:24.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.265+0000 7fbfe2a2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:44:24.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.265+0000 7fbeb6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758601 cookie 94761006009744 notifier 5513 bl.length()=197 2024-09-12T00:44:24.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.265+0000 7fbeb6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:44:24.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.265+0000 7fbeb6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:44:24.264 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:44:24.264 INFO:tasks.workunit.client.0.smithi083.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:44:24.264 INFO:tasks.workunit.client.0.smithi083.stdout: "display_name": "maven test user", 2024-09-12T00:44:24.264 INFO:tasks.workunit.client.0.smithi083.stdout: "email": "sigv4@example.com", 2024-09-12T00:44:24.264 INFO:tasks.workunit.client.0.smithi083.stdout: "suspended": 0, 2024-09-12T00:44:24.264 INFO:tasks.workunit.client.0.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "subusers": [], 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "keys": [ 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: { 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "user": "ceph-test-maven", 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "active": true, 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-09-12T00:44:24.260790Z" 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: ], 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "swift_keys": [], 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "caps": [], 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:44:24.265 INFO:tasks.workunit.client.0.smithi083.stdout: "default_placement": "", 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "placement_tags": [], 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_quota": { 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "user_quota": { 2024-09-12T00:44:24.266 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-09-12T00:44:24.267 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:44:24.267 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-09-12T00:44:24.267 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:44:24.267 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-09-12T00:44:24.267 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:44:24.267 INFO:tasks.workunit.client.0.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:44:24.267 INFO:tasks.workunit.client.0.smithi083.stdout: "type": "rgw", 2024-09-12T00:44:24.267 INFO:tasks.workunit.client.0.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:44:24.267 INFO:tasks.workunit.client.0.smithi083.stdout: "account_id": "", 2024-09-12T00:44:24.268 INFO:tasks.workunit.client.0.smithi083.stdout: "path": "/", 2024-09-12T00:44:24.268 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-09-12T00:44:24.260776Z", 2024-09-12T00:44:24.268 INFO:tasks.workunit.client.0.smithi083.stdout: "tags": [], 2024-09-12T00:44:24.268 INFO:tasks.workunit.client.0.smithi083.stdout: "group_ids": [] 2024-09-12T00:44:24.268 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:44:24.268 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:44:24.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.266+0000 7fbe96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:24.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.268+0000 7fbfe2a2f800 20 remove_watcher() i=0 2024-09-12T00:44:24.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.268+0000 7fbfe2a2f800 2 removed watcher, disabling cache 2024-09-12T00:44:24.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.269+0000 7fbfe2a2f800 20 remove_watcher() i=1 2024-09-12T00:44:24.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.271+0000 7fbfe2a2f800 20 remove_watcher() i=2 2024-09-12T00:44:24.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.272+0000 7fbfe2a2f800 20 remove_watcher() i=3 2024-09-12T00:44:24.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.272+0000 7fbfe2a2f800 20 remove_watcher() i=4 2024-09-12T00:44:24.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.273+0000 7fbfe2a2f800 20 remove_watcher() i=5 2024-09-12T00:44:24.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.274+0000 7fbfe2a2f800 20 remove_watcher() i=6 2024-09-12T00:44:24.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:44:24.275+0000 7fbfe2a2f800 20 remove_watcher() i=7 2024-09-12T00:44:24.284 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -z ']' 2024-09-12T00:44:24.285 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T00:44:24.285 INFO:tasks.workunit.client.0.smithi083.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:44:24.285 INFO:tasks.workunit.client.0.smithi083.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi083.front.sepia.ceph.com:443 2024-09-12T00:44:24.286 INFO:tasks.workunit.client.0.smithi083.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi083.front.sepia.ceph.com:443 2024-09-12T00:44:24.286 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T00:44:24.286 INFO:tasks.workunit.client.0.smithi083.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:44:24.286 INFO:tasks.workunit.client.0.smithi083.stderr:+ ./mvnw clean package 2024-09-12T00:44:24.294 INFO:tasks.workunit.client.0.smithi083.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:44:25.744 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Scanning for projects... 2024-09-12T00:44:25.861 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:44:25.940 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 69 kB/s) 2024-09-12T00:44:25.951 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:44:25.993 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 27/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 34/83 kB Progress (1): 36/83 kB Progress (1): 37/83 kB Progress (1): 38/83 kB Progress (1): 40/83 kB Progress (1): 41/83 kB Progress (1): 43/83 kB Progress (1): 44/83 kB Progress (1): 45/83 kB Progress (1): 47/83 kB Progress (1): 48/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-12T00:44:26.000 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:44:26.020 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-12T00:44:26.042 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:26.042 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:44:26.042 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:44:26.042 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] from pom.xml 2024-09-12T00:44:26.042 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:44:26.044 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:44:26.061 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T00:44:26.067 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:44:26.084 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 550 kB/s) 2024-09-12T00:44:26.087 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:44:26.106 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.5 MB/s) 2024-09-12T00:44:26.111 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:44:26.126 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-12T00:44:26.136 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:44:26.154 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/36 kB Progress (1): 31/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-12T00:44:26.160 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:44:26.179 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 429 kB/s) 2024-09-12T00:44:26.181 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:44:26.197 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-12T00:44:26.199 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:44:26.219 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.4 MB/s) 2024-09-12T00:44:26.222 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:44:26.237 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-12T00:44:26.242 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:44:26.259 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-12T00:44:26.263 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:44:26.281 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 545 kB/s) 2024-09-12T00:44:26.286 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:44:26.304 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-12T00:44:26.310 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:44:26.326 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-12T00:44:26.328 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:44:26.344 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-12T00:44:26.347 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:44:26.363 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-12T00:44:26.366 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:44:26.383 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.4 MB/s) 2024-09-12T00:44:26.388 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:44:26.403 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 402 kB/s) 2024-09-12T00:44:26.406 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:44:26.426 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/45 kB Progress (1): 31/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-09-12T00:44:26.432 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:44:26.448 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 423 kB/s) 2024-09-12T00:44:26.450 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:44:26.466 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 582 kB/s) 2024-09-12T00:44:26.469 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:44:26.485 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-12T00:44:26.488 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:44:26.503 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-12T00:44:26.507 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:44:26.523 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-12T00:44:26.536 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:44:26.555 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 320 kB/s) 2024-09-12T00:44:26.557 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:44:26.574 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.2 MB/s) 2024-09-12T00:44:26.581 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:44:26.593 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-12T00:44:26.600 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:44:26.617 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-12T00:44:26.619 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:44:26.635 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-12T00:44:26.637 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:44:26.652 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-12T00:44:26.656 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:44:26.672 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-12T00:44:26.676 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:44:26.691 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-12T00:44:26.695 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:44:26.714 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 548 kB/s) 2024-09-12T00:44:26.718 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:44:26.736 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 94 kB/s) 2024-09-12T00:44:26.740 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:44:26.760 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 191 kB/s) 2024-09-12T00:44:26.764 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:44:26.779 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-12T00:44:26.782 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:44:26.800 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 64 kB/s) 2024-09-12T00:44:26.802 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:44:26.827 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 153 kB/s) 2024-09-12T00:44:26.828 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:44:26.844 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-12T00:44:26.847 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:44:26.861 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-12T00:44:26.865 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:44:26.882 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-12T00:44:26.886 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:44:26.909 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 127 kB/s) 2024-09-12T00:44:26.913 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:44:26.929 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 436 kB/s) 2024-09-12T00:44:26.933 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:44:26.955 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 237 kB/s) 2024-09-12T00:44:26.959 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:44:26.974 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-12T00:44:26.978 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:44:26.995 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-09-12T00:44:26.997 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:44:27.018 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 115 kB/s) 2024-09-12T00:44:27.021 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:44:27.037 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 379 kB/s) 2024-09-12T00:44:27.041 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:44:27.056 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 404 kB/s) 2024-09-12T00:44:27.059 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:44:27.075 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-12T00:44:27.079 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:44:27.094 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 217 kB/s) 2024-09-12T00:44:27.098 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:44:27.114 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 255 kB/s) 2024-09-12T00:44:27.116 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:44:27.132 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 111 kB/s) 2024-09-12T00:44:27.135 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:44:27.150 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-12T00:44:27.153 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:44:27.168 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-12T00:44:27.170 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:44:27.184 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-12T00:44:27.189 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:44:27.204 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-12T00:44:27.209 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:44:27.227 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 261 kB/s) 2024-09-12T00:44:27.230 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:44:27.246 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-09-12T00:44:27.252 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:44:27.268 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 873 kB/s) 2024-09-12T00:44:27.270 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:44:27.288 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.8 MB/s) 2024-09-12T00:44:27.293 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:44:27.308 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-12T00:44:27.312 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:44:27.328 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 965 kB/s) 2024-09-12T00:44:27.330 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:44:27.348 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.7 MB/s) 2024-09-12T00:44:27.353 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:44:27.368 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T00:44:27.372 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:44:27.390 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-12T00:44:27.392 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:44:27.428 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/78 kB Progress (1): 31/78 kB Progress (1): 48/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 2.2 MB/s) 2024-09-12T00:44:27.432 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:44:27.448 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 240 kB/s) 2024-09-12T00:44:27.450 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:44:27.465 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T00:44:27.467 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:44:27.484 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:44:27.486 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:44:27.501 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 212 kB/s) 2024-09-12T00:44:27.503 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:44:27.518 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-12T00:44:27.521 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:44:27.538 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 157 kB/s) 2024-09-12T00:44:27.541 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:44:27.558 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 85 kB/s) 2024-09-12T00:44:27.560 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:44:27.576 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 188 kB/s) 2024-09-12T00:44:27.579 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:44:27.595 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:44:27.597 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:44:27.616 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 169 kB/s) 2024-09-12T00:44:27.618 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:44:27.635 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-09-12T00:44:27.639 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:44:27.655 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 60 kB/s) 2024-09-12T00:44:27.657 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:44:27.673 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 191 kB/s) 2024-09-12T00:44:27.676 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:44:27.692 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-12T00:44:27.694 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:44:27.709 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T00:44:27.711 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:44:27.727 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-12T00:44:27.730 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:44:27.748 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 168 kB/s) 2024-09-12T00:44:27.767 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:44:27.875 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 30 MB/s) 2024-09-12T00:44:27.877 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:44:27.877 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:44:27.877 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:44:27.877 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:44:27.878 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:44:27.897 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 1.8 MB/s) 2024-09-12T00:44:27.897 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:44:27.914 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 446 kB/s) 2024-09-12T00:44:27.914 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:44:27.928 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/98 kB Progress (2): 16/98 kB | 16/71 kB Progress (3): 16/98 kB | 16/71 kB | 1.4/16 kB Progress (3): 16/98 kB | 16/71 kB | 2.8/16 kB Progress (3): 16/98 kB | 16/71 kB | 4.1/16 kB Progress (3): 16/98 kB | 16/71 kB | 5.5/16 kB Progress (3): 16/98 kB | 16/71 kB | 6.9/16 kB Progress (3): 16/98 kB | 16/71 kB | 8.3/16 kB Progress (3): 16/98 kB | 16/71 kB | 9.7/16 kB Progress (3): 16/98 kB | 16/71 kB | 11/16 kB Progress (3): 16/98 kB | 16/71 kB | 12/16 kB Progress (3): 16/98 kB | 16/71 kB | 14/16 kB Progress (3): 16/98 kB | 16/71 kB | 15/16 kB Progress (3): 16/98 kB | 16/71 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 310 kB/s) 2024-09-12T00:44:27.928 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:44:27.943 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 16/98 kB | 16/71 kB | 16/782 kB Progress (3): 16/98 kB | 16/71 kB | 33/782 kB Progress (3): 16/98 kB | 16/71 kB | 49/782 kB Progress (3): 16/98 kB | 16/71 kB | 65/782 kB Progress (3): 16/98 kB | 16/71 kB | 82/782 kB Progress (3): 16/98 kB | 16/71 kB | 98/782 kB Progress (3): 16/98 kB | 16/71 kB | 115/782 kB Progress (3): 16/98 kB | 16/71 kB | 131/782 kB Progress (3): 16/98 kB | 16/71 kB | 147/782 kB Progress (3): 16/98 kB | 16/71 kB | 164/782 kB Progress (3): 16/98 kB | 16/71 kB | 180/782 kB Progress (3): 16/98 kB | 16/71 kB | 197/782 kB Progress (3): 16/98 kB | 16/71 kB | 213/782 kB Progress (3): 16/98 kB | 16/71 kB | 229/782 kB Progress (3): 16/98 kB | 16/71 kB | 246/782 kB Progress (3): 16/98 kB | 16/71 kB | 262/782 kB Progress (3): 33/98 kB | 16/71 kB | 262/782 kB Progress (3): 33/98 kB | 16/71 kB | 278/782 kB Progress (3): 33/98 kB | 16/71 kB | 295/782 kB Progress (3): 33/98 kB | 16/71 kB | 311/782 kB Progress (3): 33/98 kB | 16/71 kB | 328/782 kB Progress (3): 33/98 kB | 16/71 kB | 344/782 kB Progress (3): 33/98 kB | 16/71 kB | 360/782 kB Progress (3): 33/98 kB | 16/71 kB | 369/782 kB Progress (3): 33/98 kB | 33/71 kB | 369/782 kB Progress (3): 33/98 kB | 33/71 kB | 385/782 kB Progress (3): 33/98 kB | 33/71 kB | 393/782 kB Progress (3): 33/98 kB | 33/71 kB | 410/782 kB Progress (3): 33/98 kB | 33/71 kB | 426/782 kB Progress (3): 33/98 kB | 33/71 kB | 442/782 kB Progress (3): 49/98 kB | 33/71 kB | 442/782 kB Progress (3): 49/98 kB | 33/71 kB | 459/782 kB Progress (3): 49/98 kB | 33/71 kB | 475/782 kB Progress (3): 49/98 kB | 33/71 kB | 491/782 kB Progress (3): 49/98 kB | 33/71 kB | 508/782 kB Progress (3): 49/98 kB | 49/71 kB | 508/782 kB Progress (3): 49/98 kB | 49/71 kB | 524/782 kB Progress (3): 49/98 kB | 49/71 kB | 541/782 kB Progress (4): 49/98 kB | 49/71 kB | 541/782 kB | 1.4/49 kB Progress (4): 49/98 kB | 49/71 kB | 541/782 kB | 2.8/49 kB Progress (4): 49/98 kB | 49/71 kB | 557/782 kB | 2.8/49 kB Progress (4): 49/98 kB | 49/71 kB | 557/782 kB | 4.1/49 kB Progress (4): 49/98 kB | 49/71 kB | 557/782 kB | 5.5/49 kB Progress (4): 49/98 kB | 49/71 kB | 557/782 kB | 6.9/49 kB Progress (4): 49/98 kB | 49/71 kB | 573/782 kB | 6.9/49 kB Progress (4): 49/98 kB | 49/71 kB | 573/782 kB | 8.3/49 kB Progress (4): 49/98 kB | 49/71 kB | 573/782 kB | 9.7/49 kB Progress (4): 49/98 kB | 49/71 kB | 573/782 kB | 11/49 kB Progress (4): 49/98 kB | 49/71 kB | 590/782 kB | 11/49 kB Progress (4): 49/98 kB | 49/71 kB | 590/782 kB | 12/49 kB Progress (4): 49/98 kB | 49/71 kB | 590/782 kB | 14/49 kB Progress (4): 49/98 kB | 49/71 kB | 590/782 kB | 15/49 kB Progress (4): 49/98 kB | 49/71 kB | 606/782 kB | 15/49 kB Progress (4): 49/98 kB | 49/71 kB | 606/782 kB | 16/49 kB Progress (4): 49/98 kB | 49/71 kB | 606/782 kB | 17/49 kB Progress (4): 49/98 kB | 49/71 kB | 606/782 kB | 19/49 kB Progress (4): 49/98 kB | 49/71 kB | 623/782 kB | 19/49 kB Progress (4): 49/98 kB | 49/71 kB | 623/782 kB | 20/49 kB Progress (4): 49/98 kB | 49/71 kB | 639/782 kB | 20/49 kB Progress (4): 49/98 kB | 49/71 kB | 639/782 kB | 21/49 kB Progress (4): 49/98 kB | 49/71 kB | 655/782 kB | 21/49 kB Progress (4): 49/98 kB | 49/71 kB | 655/782 kB | 23/49 kB Progress (4): 49/98 kB | 49/71 kB | 655/782 kB | 24/49 kB Progress (4): 49/98 kB | 49/71 kB | 655/782 kB | 25/49 kB Progress (4): 49/98 kB | 49/71 kB | 672/782 kB | 25/49 kB Progress (4): 49/98 kB | 49/71 kB | 688/782 kB | 25/49 kB Progress (4): 49/98 kB | 49/71 kB | 688/782 kB | 27/49 kB Progress (4): 49/98 kB | 49/71 kB | 688/782 kB | 28/49 kB Progress (4): 49/98 kB | 49/71 kB | 704/782 kB | 28/49 kB Progress (4): 49/98 kB | 49/71 kB | 704/782 kB | 30/49 kB Progress (4): 49/98 kB | 49/71 kB | 721/782 kB | 30/49 kB Progress (4): 49/98 kB | 49/71 kB | 737/782 kB | 30/49 kB Progress (4): 49/98 kB | 49/71 kB | 754/782 kB | 30/49 kB Progress (4): 49/98 kB | 49/71 kB | 770/782 kB | 30/49 kB Progress (4): 49/98 kB | 49/71 kB | 782 kB | 30/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-12T00:44:27.943 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:44:27.945 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (4): 49/98 kB | 49/71 kB | 30/49 kB | 1.4/11 kB Progress (4): 49/98 kB | 49/71 kB | 30/49 kB | 2.8/11 kB Progress (4): 49/98 kB | 49/71 kB | 30/49 kB | 4.1/11 kB Progress (4): 49/98 kB | 49/71 kB | 30/49 kB | 5.5/11 kB Progress (4): 49/98 kB | 49/71 kB | 30/49 kB | 6.9/11 kB Progress (4): 49/98 kB | 49/71 kB | 30/49 kB | 8.3/11 kB Progress (4): 49/98 kB | 49/71 kB | 30/49 kB | 9.7/11 kB Progress (4): 49/98 kB | 49/71 kB | 30/49 kB | 11/11 kB Progress (4): 49/98 kB | 49/71 kB | 30/49 kB | 11 kB Progress (4): 66/98 kB | 49/71 kB | 30/49 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 167 kB/s) 2024-09-12T00:44:27.946 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:44:27.948 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 82/98 kB | 49/71 kB | 30/49 kB Progress (3): 98 kB | 49/71 kB | 30/49 kB Progress (3): 98 kB | 66/71 kB | 30/49 kB Progress (3): 98 kB | 71 kB | 30/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-12T00:44:27.948 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:44:27.948 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 966 kB/s) 2024-09-12T00:44:27.948 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:44:27.952 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 31/49 kB Progress (1): 32/49 kB Progress (1): 34/49 kB Progress (1): 35/49 kB Progress (1): 36/49 kB Progress (1): 38/49 kB Progress (1): 39/49 kB Progress (1): 41/49 kB Progress (1): 42/49 kB Progress (1): 43/49 kB Progress (1): 45/49 kB Progress (1): 46/49 kB Progress (1): 48/49 kB Progress (1): 49/49 kB Progress (1): 49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 648 kB/s) 2024-09-12T00:44:27.952 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:44:27.960 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (1): 64/205 kB Progress (1): 80/205 kB Progress (1): 97/205 kB Progress (1): 113/205 kB Progress (1): 129/205 kB Progress (1): 146/205 kB Progress (1): 162/205 kB Progress (1): 179/205 kB Progress (1): 195/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.5 MB/s) 2024-09-12T00:44:27.961 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:44:27.966 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/30 kB Progress (1): 2.8/30 kB Progress (1): 4.1/30 kB Progress (1): 5.5/30 kB Progress (1): 6.9/30 kB Progress (1): 8.3/30 kB Progress (1): 9.7/30 kB Progress (1): 11/30 kB Progress (1): 12/30 kB Progress (1): 14/30 kB Progress (1): 15/30 kB Progress (1): 17/30 kB Progress (1): 18/30 kB Progress (1): 19/30 kB Progress (1): 21/30 kB Progress (1): 22/30 kB Progress (1): 23/30 kB Progress (1): 25/30 kB Progress (1): 26/30 kB Progress (1): 28/30 kB Progress (1): 29/30 kB Progress (1): 30 kB Progress (2): 30 kB | 16/798 kB Progress (2): 30 kB | 33/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 343 kB/s) 2024-09-12T00:44:27.966 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:44:27.969 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 49/798 kB Progress (1): 66/798 kB Progress (2): 66/798 kB | 1.4/13 kB Progress (2): 66/798 kB | 2.8/13 kB Progress (2): 66/798 kB | 4.1/13 kB Progress (2): 66/798 kB | 5.5/13 kB Progress (2): 66/798 kB | 6.9/13 kB Progress (2): 66/798 kB | 8.3/13 kB Progress (2): 66/798 kB | 9.7/13 kB Progress (2): 66/798 kB | 11/13 kB Progress (2): 82/798 kB | 11/13 kB Progress (2): 82/798 kB | 12/13 kB Progress (2): 82/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 147 kB/s) 2024-09-12T00:44:27.969 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:44:27.979 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 98/798 kB Progress (2): 98/798 kB | 16/81 kB Progress (2): 98/798 kB | 33/81 kB Progress (2): 98/798 kB | 49/81 kB Progress (3): 98/798 kB | 49/81 kB | 16/182 kB Progress (3): 98/798 kB | 49/81 kB | 33/182 kB Progress (3): 98/798 kB | 64/81 kB | 33/182 kB Progress (3): 98/798 kB | 64/81 kB | 49/182 kB Progress (3): 98/798 kB | 64/81 kB | 62/182 kB Progress (3): 98/798 kB | 64/81 kB | 78/182 kB Progress (3): 115/798 kB | 64/81 kB | 78/182 kB Progress (3): 115/798 kB | 64/81 kB | 94/182 kB Progress (3): 115/798 kB | 64/81 kB | 111/182 kB Progress (3): 131/798 kB | 64/81 kB | 111/182 kB Progress (3): 131/798 kB | 64/81 kB | 127/182 kB Progress (3): 131/798 kB | 64/81 kB | 143/182 kB Progress (3): 131/798 kB | 64/81 kB | 160/182 kB Progress (3): 147/798 kB | 64/81 kB | 160/182 kB Progress (3): 147/798 kB | 64/81 kB | 176/182 kB Progress (3): 147/798 kB | 64/81 kB | 182 kB Progress (3): 164/798 kB | 64/81 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.8 MB/s) 2024-09-12T00:44:27.979 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:44:27.984 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 180/798 kB | 64/81 kB Progress (2): 197/798 kB | 64/81 kB Progress (2): 213/798 kB | 64/81 kB Progress (2): 229/798 kB | 64/81 kB Progress (3): 229/798 kB | 64/81 kB | 16/151 kB Progress (3): 246/798 kB | 64/81 kB | 16/151 kB Progress (3): 262/798 kB | 64/81 kB | 16/151 kB Progress (3): 279/798 kB | 64/81 kB | 16/151 kB Progress (3): 279/798 kB | 64/81 kB | 33/151 kB Progress (3): 295/798 kB | 64/81 kB | 33/151 kB Progress (3): 295/798 kB | 80/81 kB | 33/151 kB Progress (3): 300/798 kB | 80/81 kB | 33/151 kB Progress (3): 300/798 kB | 81 kB | 33/151 kB Progress (3): 316/798 kB | 81 kB | 33/151 kB Progress (3): 316/798 kB | 81 kB | 49/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 767 kB/s) 2024-09-12T00:44:27.984 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:44:27.986 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 316/798 kB | 49/151 kB | 16/27 kB Progress (3): 316/798 kB | 62/151 kB | 16/27 kB Progress (3): 316/798 kB | 62/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 255 kB/s) 2024-09-12T00:44:27.986 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:44:27.997 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 332/798 kB | 62/151 kB Progress (2): 341/798 kB | 62/151 kB Progress (2): 357/798 kB | 62/151 kB Progress (2): 373/798 kB | 62/151 kB Progress (2): 390/798 kB | 62/151 kB Progress (2): 406/798 kB | 62/151 kB Progress (2): 422/798 kB | 62/151 kB Progress (2): 439/798 kB | 62/151 kB Progress (2): 455/798 kB | 62/151 kB Progress (2): 472/798 kB | 62/151 kB Progress (2): 488/798 kB | 62/151 kB Progress (2): 488/798 kB | 79/151 kB Progress (2): 504/798 kB | 79/151 kB Progress (2): 521/798 kB | 79/151 kB Progress (2): 537/798 kB | 79/151 kB Progress (2): 554/798 kB | 79/151 kB Progress (2): 554/798 kB | 95/151 kB Progress (2): 570/798 kB | 95/151 kB Progress (2): 586/798 kB | 95/151 kB Progress (2): 603/798 kB | 95/151 kB Progress (2): 603/798 kB | 111/151 kB Progress (2): 619/798 kB | 111/151 kB Progress (2): 635/798 kB | 111/151 kB Progress (2): 652/798 kB | 111/151 kB Progress (2): 668/798 kB | 111/151 kB Progress (2): 668/798 kB | 128/151 kB Progress (2): 685/798 kB | 128/151 kB Progress (2): 685/798 kB | 144/151 kB Progress (2): 685/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-12T00:44:27.997 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:44:28.000 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 685/798 kB | 15/30 kB Progress (2): 685/798 kB | 30 kB Progress (2): 701/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 248 kB/s) 2024-09-12T00:44:28.000 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 717/798 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:44:28.002 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 734/798 kB Progress (1): 750/798 kB Progress (1): 766/798 kB Progress (1): 783/798 kB Progress (2): 783/798 kB | 16/385 kB Progress (2): 798 kB | 16/385 kB Progress (2): 798 kB | 33/385 kB Progress (2): 798 kB | 49/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.5 MB/s) 2024-09-12T00:44:28.002 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:44:28.004 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 65/385 kB Progress (1): 82/385 kB Progress (2): 82/385 kB | 13 kB Progress (2): 98/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 105 kB/s) 2024-09-12T00:44:28.004 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:44:28.012 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (2): 147/385 kB | 16/75 kB Progress (2): 147/385 kB | 33/75 kB Progress (2): 147/385 kB | 49/75 kB Progress (2): 147/385 kB | 66/75 kB Progress (2): 147/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 560 kB/s) 2024-09-12T00:44:28.012 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:44:28.019 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (2): 245/385 kB | 16/780 kB Progress (2): 245/385 kB | 32/780 kB Progress (2): 262/385 kB | 32/780 kB Progress (2): 262/385 kB | 49/780 kB Progress (2): 278/385 kB | 49/780 kB Progress (2): 278/385 kB | 65/780 kB Progress (2): 278/385 kB | 81/780 kB Progress (2): 295/385 kB | 81/780 kB Progress (2): 295/385 kB | 98/780 kB Progress (2): 311/385 kB | 98/780 kB Progress (2): 311/385 kB | 114/780 kB Progress (2): 311/385 kB | 130/780 kB Progress (2): 311/385 kB | 147/780 kB Progress (2): 327/385 kB | 147/780 kB Progress (2): 327/385 kB | 163/780 kB Progress (2): 344/385 kB | 163/780 kB Progress (2): 344/385 kB | 180/780 kB Progress (2): 344/385 kB | 196/780 kB Progress (2): 360/385 kB | 196/780 kB Progress (2): 360/385 kB | 212/780 kB Progress (2): 376/385 kB | 212/780 kB Progress (2): 385 kB | 212/780 kB Progress (2): 385 kB | 229/780 kB Progress (2): 385 kB | 245/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.7 MB/s) 2024-09-12T00:44:28.019 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:44:28.028 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 262/780 kB Progress (1): 278/780 kB Progress (1): 294/780 kB Progress (1): 311/780 kB Progress (2): 311/780 kB | 15/501 kB Progress (2): 327/780 kB | 15/501 kB Progress (2): 343/780 kB | 15/501 kB Progress (2): 360/780 kB | 15/501 kB Progress (2): 376/780 kB | 15/501 kB Progress (2): 393/780 kB | 15/501 kB Progress (2): 393/780 kB | 31/501 kB Progress (2): 409/780 kB | 31/501 kB Progress (2): 425/780 kB | 31/501 kB Progress (2): 442/780 kB | 31/501 kB Progress (2): 458/780 kB | 31/501 kB Progress (2): 475/780 kB | 31/501 kB Progress (2): 491/780 kB | 31/501 kB Progress (2): 507/780 kB | 31/501 kB Progress (2): 507/780 kB | 48/501 kB Progress (2): 524/780 kB | 48/501 kB Progress (2): 540/780 kB | 48/501 kB Progress (2): 556/780 kB | 48/501 kB Progress (2): 573/780 kB | 48/501 kB Progress (2): 589/780 kB | 48/501 kB Progress (2): 606/780 kB | 48/501 kB Progress (2): 622/780 kB | 48/501 kB Progress (2): 638/780 kB | 48/501 kB Progress (2): 655/780 kB | 48/501 kB Progress (2): 658/780 kB | 48/501 kB Progress (2): 674/780 kB | 48/501 kB Progress (2): 691/780 kB | 48/501 kB Progress (2): 707/780 kB | 48/501 kB Progress (2): 723/780 kB | 48/501 kB Progress (2): 740/780 kB | 48/501 kB Progress (2): 756/780 kB | 48/501 kB Progress (3): 756/780 kB | 48/501 kB | 16/329 kB Progress (3): 772/780 kB | 48/501 kB | 16/329 kB Progress (3): 780 kB | 48/501 kB | 16/329 kB Progress (3): 780 kB | 48/501 kB | 32/329 kB Progress (3): 780 kB | 48/501 kB | 49/329 kB Progress (4): 780 kB | 48/501 kB | 49/329 kB | 16/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.3 MB/s) 2024-09-12T00:44:28.028 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 48/501 kB | 65/329 kB | 16/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:44:28.032 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (3): 48/501 kB | 65/329 kB | 32/354 kB Progress (3): 48/501 kB | 81/329 kB | 32/354 kB Progress (3): 48/501 kB | 81/329 kB | 49/354 kB Progress (3): 48/501 kB | 98/329 kB | 49/354 kB Progress (3): 48/501 kB | 114/329 kB | 49/354 kB Progress (3): 48/501 kB | 114/329 kB | 65/354 kB Progress (3): 48/501 kB | 130/329 kB | 65/354 kB Progress (3): 48/501 kB | 130/329 kB | 78/354 kB Progress (3): 48/501 kB | 147/329 kB | 78/354 kB Progress (3): 48/501 kB | 163/329 kB | 78/354 kB Progress (3): 48/501 kB | 163/329 kB | 95/354 kB Progress (3): 48/501 kB | 180/329 kB | 95/354 kB Progress (3): 48/501 kB | 196/329 kB | 95/354 kB Progress (3): 48/501 kB | 196/329 kB | 111/354 kB Progress (3): 48/501 kB | 212/329 kB | 111/354 kB Progress (3): 48/501 kB | 228/329 kB | 111/354 kB Progress (3): 48/501 kB | 228/329 kB | 127/354 kB Progress (3): 48/501 kB | 245/329 kB | 127/354 kB Progress (3): 48/501 kB | 261/329 kB | 127/354 kB Progress (3): 48/501 kB | 261/329 kB | 144/354 kB Progress (3): 48/501 kB | 277/329 kB | 144/354 kB Progress (3): 64/501 kB | 277/329 kB | 144/354 kB Progress (3): 64/501 kB | 294/329 kB | 144/354 kB Progress (3): 64/501 kB | 294/329 kB | 160/354 kB Progress (3): 81/501 kB | 294/329 kB | 160/354 kB Progress (3): 81/501 kB | 310/329 kB | 160/354 kB Progress (3): 81/501 kB | 310/329 kB | 177/354 kB Progress (3): 81/501 kB | 326/329 kB | 177/354 kB Progress (3): 81/501 kB | 329 kB | 177/354 kB Progress (3): 81/501 kB | 329 kB | 193/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.1 MB/s) 2024-09-12T00:44:28.032 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:44:28.035 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 81/501 kB | 209/354 kB Progress (2): 96/501 kB | 209/354 kB Progress (2): 112/501 kB | 209/354 kB Progress (3): 112/501 kB | 209/354 kB | 16/41 kB Progress (3): 112/501 kB | 209/354 kB | 32/41 kB Progress (3): 112/501 kB | 209/354 kB | 41 kB Progress (3): 128/501 kB | 209/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 265 kB/s) 2024-09-12T00:44:28.035 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:44:28.043 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 145/501 kB | 209/354 kB Progress (2): 161/501 kB | 209/354 kB Progress (2): 177/501 kB | 209/354 kB Progress (2): 177/501 kB | 226/354 kB Progress (2): 177/501 kB | 242/354 kB Progress (2): 177/501 kB | 258/354 kB Progress (2): 177/501 kB | 275/354 kB Progress (2): 177/501 kB | 291/354 kB Progress (2): 177/501 kB | 308/354 kB Progress (2): 177/501 kB | 324/354 kB Progress (2): 177/501 kB | 340/354 kB Progress (2): 177/501 kB | 354 kB Progress (2): 194/501 kB | 354 kB Progress (2): 210/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-12T00:44:28.043 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:44:28.043 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 210/501 kB | 6.4 kB Progress (2): 227/501 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 39 kB/s) 2024-09-12T00:44:28.044 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:44:28.055 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 243/501 kB Progress (1): 259/501 kB Progress (1): 276/501 kB Progress (1): 292/501 kB Progress (1): 309/501 kB Progress (2): 309/501 kB | 15/586 kB Progress (2): 325/501 kB | 15/586 kB Progress (2): 325/501 kB | 31/586 kB Progress (2): 325/501 kB | 48/586 kB Progress (2): 325/501 kB | 64/586 kB Progress (2): 341/501 kB | 64/586 kB Progress (2): 341/501 kB | 78/586 kB Progress (2): 358/501 kB | 78/586 kB Progress (2): 358/501 kB | 95/586 kB Progress (2): 358/501 kB | 111/586 kB Progress (2): 374/501 kB | 111/586 kB Progress (2): 374/501 kB | 127/586 kB Progress (2): 390/501 kB | 127/586 kB Progress (2): 390/501 kB | 144/586 kB Progress (2): 407/501 kB | 144/586 kB Progress (2): 407/501 kB | 160/586 kB Progress (2): 423/501 kB | 160/586 kB Progress (2): 423/501 kB | 176/586 kB Progress (2): 423/501 kB | 193/586 kB Progress (2): 423/501 kB | 209/586 kB Progress (2): 423/501 kB | 226/586 kB Progress (2): 423/501 kB | 242/586 kB Progress (2): 423/501 kB | 258/586 kB Progress (2): 423/501 kB | 275/586 kB Progress (2): 423/501 kB | 291/586 kB Progress (2): 423/501 kB | 308/586 kB Progress (2): 423/501 kB | 324/586 kB Progress (2): 423/501 kB | 340/586 kB Progress (2): 423/501 kB | 357/586 kB Progress (2): 423/501 kB | 373/586 kB Progress (3): 423/501 kB | 373/586 kB | 16/211 kB Progress (3): 423/501 kB | 389/586 kB | 16/211 kB Progress (3): 423/501 kB | 389/586 kB | 32/211 kB Progress (3): 423/501 kB | 406/586 kB | 32/211 kB Progress (3): 423/501 kB | 406/586 kB | 49/211 kB Progress (3): 423/501 kB | 406/586 kB | 49/211 kB Progress (3): 423/501 kB | 422/586 kB | 49/211 kB Progress (3): 423/501 kB | 422/586 kB | 65/211 kB Progress (3): 423/501 kB | 439/586 kB | 65/211 kB Progress (3): 440/501 kB | 439/586 kB | 65/211 kB Progress (3): 440/501 kB | 439/586 kB | 81/211 kB Progress (3): 456/501 kB | 439/586 kB | 81/211 kB Progress (3): 456/501 kB | 455/586 kB | 81/211 kB Progress (3): 472/501 kB | 455/586 kB | 81/211 kB Progress (3): 472/501 kB | 455/586 kB | 98/211 kB Progress (3): 472/501 kB | 471/586 kB | 98/211 kB Progress (3): 489/501 kB | 471/586 kB | 98/211 kB Progress (3): 489/501 kB | 471/586 kB | 114/211 kB Progress (3): 501 kB | 471/586 kB | 114/211 kB Progress (3): 501 kB | 488/586 kB | 114/211 kB Progress (3): 501 kB | 488/586 kB | 131/211 kB Progress (3): 501 kB | 504/586 kB | 131/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-09-12T00:44:28.055 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:44:28.057 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 504/586 kB | 147/211 kB Progress (2): 521/586 kB | 147/211 kB Progress (2): 521/586 kB | 163/211 kB Progress (2): 537/586 kB | 163/211 kB Progress (2): 537/586 kB | 180/211 kB Progress (2): 553/586 kB | 180/211 kB Progress (2): 553/586 kB | 196/211 kB Progress (2): 570/586 kB | 196/211 kB Progress (2): 570/586 kB | 211 kB Progress (2): 586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T00:44:28.069 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.1 MB/s) 2024-09-12T00:44:28.069 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:44:28.069 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:44:28.070 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 75 kB/s) 2024-09-12T00:44:28.070 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:44:28.071 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 32/106 kB Progress (1): 49/106 kB Progress (1): 65/106 kB Progress (1): 81/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 556 kB/s) 2024-09-12T00:44:28.071 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:44:28.073 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 35 kB/s) 2024-09-12T00:44:28.073 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:44:28.085 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/245 kB Progress (1): 31/245 kB Progress (2): 31/245 kB | 16/16 kB Progress (2): 31/245 kB | 16 kB Progress (2): 48/245 kB | 16 kB Progress (2): 64/245 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 80 kB/s) 2024-09-12T00:44:28.085 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:44:28.088 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 81/245 kB Progress (1): 95/245 kB Progress (1): 112/245 kB Progress (2): 112/245 kB | 15/205 kB Progress (2): 128/245 kB | 15/205 kB Progress (2): 128/245 kB | 31/205 kB Progress (2): 145/245 kB | 31/205 kB Progress (2): 145/245 kB | 48/205 kB Progress (2): 161/245 kB | 48/205 kB Progress (2): 161/245 kB | 64/205 kB Progress (2): 177/245 kB | 64/205 kB Progress (2): 177/245 kB | 77/205 kB Progress (2): 194/245 kB | 77/205 kB Progress (2): 194/245 kB | 94/205 kB Progress (2): 210/245 kB | 94/205 kB Progress (2): 210/245 kB | 110/205 kB Progress (2): 226/245 kB | 110/205 kB Progress (2): 226/245 kB | 126/205 kB Progress (3): 226/245 kB | 126/205 kB | 15 kB Progress (3): 243/245 kB | 126/205 kB | 15 kB Progress (3): 243/245 kB | 143/205 kB | 15 kB Progress (3): 245 kB | 143/205 kB | 15 kB Progress (3): 245 kB | 159/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 73 kB/s) 2024-09-12T00:44:28.088 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:44:28.088 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 245 kB | 175/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T00:44:28.088 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:44:28.089 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 192/205 kB Progress (1): 205 kB Progress (2): 205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 980 kB/s) 2024-09-12T00:44:28.089 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:44:28.089 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 30 kB/s) 2024-09-12T00:44:28.103 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/17 kB Progress (2): 16/17 kB | 16/24 kB Progress (3): 16/17 kB | 16/24 kB | 16/23 kB Progress (3): 17 kB | 16/24 kB | 16/23 kB Progress (3): 17 kB | 24 kB | 16/23 kB Progress (3): 17 kB | 24 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 101 kB/s) 2024-09-12T00:44:28.103 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 108 kB/s) 2024-09-12T00:44:28.103 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 78 kB/s) 2024-09-12T00:44:28.107 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 806 kB/s) 2024-09-12T00:44:28.125 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:28.125 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:44:28.130 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:44:28.145 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T00:44:28.147 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:44:28.162 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-09-12T00:44:28.164 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:44:28.179 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-12T00:44:28.182 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:44:28.198 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 891 kB/s) 2024-09-12T00:44:28.202 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:44:28.220 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.5 MB/s) 2024-09-12T00:44:28.220 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:44:28.254 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 6.3 MB/s) 2024-09-12T00:44:28.289 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:28.289 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:44:28.292 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:44:28.306 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T00:44:28.308 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:44:28.325 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-09-12T00:44:28.328 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:44:28.343 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-12T00:44:28.344 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:44:28.366 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.1 MB/s) 2024-09-12T00:44:28.369 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:44:28.384 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 377 kB/s) 2024-09-12T00:44:28.386 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:44:28.400 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-12T00:44:28.403 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:44:28.417 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-12T00:44:28.421 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:44:28.433 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T00:44:28.434 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:44:28.449 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T00:44:28.451 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:44:28.470 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 169 kB/s) 2024-09-12T00:44:28.471 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:44:28.487 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-12T00:44:28.489 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:44:28.504 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 558 kB/s) 2024-09-12T00:44:28.506 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:44:28.521 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-12T00:44:28.524 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:44:28.541 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-09-12T00:44:28.545 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:44:28.562 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 300 kB/s) 2024-09-12T00:44:28.564 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:44:28.581 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.8 MB/s) 2024-09-12T00:44:28.585 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:44:28.600 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-12T00:44:28.603 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:44:28.622 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/85 kB Progress (1): 32/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-12T00:44:28.622 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:44:28.622 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:44:28.622 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:44:28.622 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:44:28.623 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:44:28.637 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 147 kB/s) 2024-09-12T00:44:28.637 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:44:28.638 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/55 kB Progress (1): 33/55 kB Progress (1): 49/55 kB Progress (2): 49/55 kB | 8.5 kB Progress (2): 55 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.1 MB/s) 2024-09-12T00:44:28.639 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 471 kB/s) 2024-09-12T00:44:28.639 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:44:28.642 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/269 kB Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-09-12T00:44:28.649 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/41 kB Progress (1): 32/41 kB Progress (1): 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 1.4 MB/s) 2024-09-12T00:44:28.657 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 66/327 kB Progress (1): 82/327 kB Progress (1): 98/327 kB Progress (1): 115/327 kB Progress (1): 131/327 kB Progress (1): 147/327 kB Progress (1): 164/327 kB Progress (1): 180/327 kB Progress (1): 197/327 kB Progress (1): 213/327 kB Progress (1): 229/327 kB Progress (1): 246/327 kB Progress (1): 256/327 kB Progress (1): 272/327 kB Progress (1): 289/327 kB Progress (2): 289/327 kB | 16/587 kB Progress (2): 305/327 kB | 16/587 kB Progress (2): 305/327 kB | 33/587 kB Progress (2): 321/327 kB | 33/587 kB Progress (2): 327 kB | 33/587 kB Progress (2): 327 kB | 49/587 kB Progress (2): 327 kB | 63/587 kB Progress (2): 327 kB | 79/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.1 MB/s) 2024-09-12T00:44:28.668 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 95/587 kB Progress (1): 112/587 kB Progress (1): 128/587 kB Progress (1): 144/587 kB Progress (1): 161/587 kB Progress (1): 177/587 kB Progress (1): 194/587 kB Progress (1): 210/587 kB Progress (1): 226/587 kB Progress (1): 243/587 kB Progress (1): 259/587 kB Progress (1): 276/587 kB Progress (1): 292/587 kB Progress (1): 308/587 kB Progress (1): 325/587 kB Progress (1): 341/587 kB Progress (1): 357/587 kB Progress (1): 374/587 kB Progress (1): 390/587 kB Progress (1): 407/587 kB Progress (1): 415/587 kB Progress (1): 431/587 kB Progress (1): 448/587 kB Progress (1): 464/587 kB Progress (1): 480/587 kB Progress (1): 497/587 kB Progress (1): 513/587 kB Progress (1): 529/587 kB Progress (1): 546/587 kB Progress (1): 562/587 kB Progress (1): 579/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 12 MB/s) 2024-09-12T00:44:28.706 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:44:28.707 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:28.707 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:44:28.710 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:44:28.727 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 296 kB/s) 2024-09-12T00:44:28.729 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:44:28.744 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T00:44:28.745 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:44:28.796 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 639 kB/s) 2024-09-12T00:44:28.798 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:44:28.813 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-12T00:44:28.817 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:44:28.835 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 43 kB/s) 2024-09-12T00:44:28.837 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:44:28.855 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 236 kB/s) 2024-09-12T00:44:28.856 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:44:28.872 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T00:44:28.875 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:44:28.891 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-12T00:44:28.893 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:44:28.910 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 244 kB/s) 2024-09-12T00:44:28.913 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:44:28.935 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 113 kB/s) 2024-09-12T00:44:28.937 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:44:28.954 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 627 kB/s) 2024-09-12T00:44:28.957 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:44:28.972 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T00:44:28.975 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:44:28.989 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T00:44:28.992 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:44:29.012 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 53 kB/s) 2024-09-12T00:44:29.013 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:44:29.042 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 299 kB/s) 2024-09-12T00:44:29.043 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:44:29.059 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T00:44:29.062 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:44:29.077 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-12T00:44:29.080 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:44:29.096 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-09-12T00:44:29.099 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:44:29.114 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-12T00:44:29.115 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:44:29.135 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 302 kB/s) 2024-09-12T00:44:29.136 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:44:29.152 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.7 MB/s) 2024-09-12T00:44:29.156 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:44:29.171 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 75 kB/s) 2024-09-12T00:44:29.173 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:44:29.189 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-09-12T00:44:29.195 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:44:29.214 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 713 kB/s) 2024-09-12T00:44:29.215 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:44:29.215 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:44:29.215 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:44:29.215 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:44:29.216 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:44:29.229 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-12T00:44:29.229 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:44:29.235 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/334 kB Progress (1): 32/334 kB Progress (1): 49/334 kB Progress (1): 65/334 kB Progress (1): 78/334 kB Progress (1): 94/334 kB Progress (1): 110/334 kB Progress (1): 127/334 kB Progress (1): 143/334 kB Progress (1): 159/334 kB Progress (1): 176/334 kB Progress (1): 192/334 kB Progress (1): 209/334 kB Progress (1): 225/334 kB Progress (1): 241/334 kB Progress (1): 258/334 kB Progress (1): 274/334 kB Progress (2): 274/334 kB | 16/27 kB Progress (2): 291/334 kB | 16/27 kB Progress (3): 291/334 kB | 16/27 kB | 16/55 kB Progress (3): 307/334 kB | 16/27 kB | 16/55 kB Progress (3): 307/334 kB | 16/27 kB | 33/55 kB Progress (3): 307/334 kB | 27 kB | 33/55 kB Progress (3): 323/334 kB | 27 kB | 33/55 kB Progress (3): 323/334 kB | 27 kB | 49/55 kB Progress (3): 334 kB | 27 kB | 49/55 kB Progress (3): 334 kB | 27 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.4 MB/s) 2024-09-12T00:44:29.235 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:44:29.235 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T00:44:29.236 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:44:29.236 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.7 MB/s) 2024-09-12T00:44:29.239 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/122 kB Progress (1): 32/122 kB Progress (1): 49/122 kB Progress (1): 65/122 kB Progress (1): 81/122 kB Progress (1): 98/122 kB Progress (1): 114/122 kB Progress (1): 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 4.9 MB/s) 2024-09-12T00:44:29.247 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 62/267 kB Progress (1): 79/267 kB Progress (1): 95/267 kB Progress (1): 112/267 kB Progress (1): 128/267 kB Progress (1): 144/267 kB Progress (1): 161/267 kB Progress (1): 177/267 kB Progress (1): 193/267 kB Progress (1): 210/267 kB Progress (1): 226/267 kB Progress (1): 243/267 kB Progress (1): 259/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.1 MB/s) 2024-09-12T00:44:29.248 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/23 kB Progress (2): 16/23 kB | 4.7 kB Progress (2): 23 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 691 kB/s) 2024-09-12T00:44:29.249 INFO:tasks.workunit.client.0.smithi083.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 141 kB/s) 2024-09-12T00:44:29.297 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:44:29.298 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:44:29.890 INFO:tasks.workunit.client.0.smithi083.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:44:29.890 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:29.890 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:44:29.893 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:44:29.893 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:29.893 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:44:29.897 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:44:29.897 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:44:30.053 INFO:tasks.workunit.client.0.smithi083.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:44:30.053 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:30.053 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:44:30.057 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:44:30.071 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T00:44:30.075 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:44:30.089 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T00:44:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:44:30.108 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-12T00:44:30.110 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:44:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-12T00:44:30.128 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:44:30.142 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-12T00:44:30.145 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:44:30.159 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-12T00:44:30.163 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:44:30.177 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-12T00:44:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:44:30.194 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 169 kB/s) 2024-09-12T00:44:30.196 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:44:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-12T00:44:30.213 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:44:30.229 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T00:44:30.232 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:44:30.248 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 362 kB/s) 2024-09-12T00:44:30.251 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:44:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-12T00:44:30.268 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:44:30.284 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.4 MB/s) 2024-09-12T00:44:30.286 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:44:30.300 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-12T00:44:30.302 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:44:30.317 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T00:44:30.320 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:44:30.333 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T00:44:30.335 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:44:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-12T00:44:30.355 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:44:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 474 kB/s) 2024-09-12T00:44:30.374 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:44:30.393 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 121 kB/s) 2024-09-12T00:44:30.396 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:44:30.411 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 162 kB/s) 2024-09-12T00:44:30.414 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:44:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 103 kB/s) 2024-09-12T00:44:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:44:30.445 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T00:44:30.447 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:44:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.4 MB/s) 2024-09-12T00:44:30.464 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:44:30.478 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T00:44:30.479 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:44:30.493 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T00:44:30.496 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:44:30.510 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T00:44:30.511 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:44:30.526 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T00:44:30.527 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:44:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 560 kB/s) 2024-09-12T00:44:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:44:30.560 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-12T00:44:30.562 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:44:30.579 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 131 kB/s) 2024-09-12T00:44:30.582 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:44:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-12T00:44:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:44:30.614 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T00:44:30.615 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:44:30.630 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T00:44:30.633 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:44:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-12T00:44:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:44:30.663 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 319 kB/s) 2024-09-12T00:44:30.665 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:44:30.681 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-12T00:44:30.682 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:44:30.697 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-12T00:44:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:44:30.719 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 867 kB/s) 2024-09-12T00:44:30.721 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:44:30.743 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 673 kB/s) 2024-09-12T00:44:30.745 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:44:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 50 kB/s) 2024-09-12T00:44:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:44:30.775 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T00:44:30.777 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:44:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-12T00:44:30.794 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:44:30.811 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 187 kB/s) 2024-09-12T00:44:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:44:30.831 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 236 kB/s) 2024-09-12T00:44:30.834 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:44:30.849 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 128 kB/s) 2024-09-12T00:44:30.852 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:44:30.867 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 232 kB/s) 2024-09-12T00:44:30.869 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:44:30.885 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-09-12T00:44:30.887 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:44:30.907 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 642 kB/s) 2024-09-12T00:44:30.909 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:44:30.925 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T00:44:30.926 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:44:30.942 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-12T00:44:30.943 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:44:30.960 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-09-12T00:44:30.961 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:44:30.976 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 489 kB/s) 2024-09-12T00:44:30.977 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:44:30.991 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T00:44:30.993 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:44:31.008 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 487 kB/s) 2024-09-12T00:44:31.010 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:44:31.024 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T00:44:31.026 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:44:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-12T00:44:31.044 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:44:31.058 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-12T00:44:31.060 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:44:31.075 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-12T00:44:31.076 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:44:31.090 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T00:44:31.092 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:44:31.106 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-12T00:44:31.107 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:44:31.122 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.7 MB/s) 2024-09-12T00:44:31.125 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:44:31.138 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-12T00:44:31.142 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:44:31.171 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-09-12T00:44:31.171 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:44:31.171 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:44:31.171 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:44:31.171 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:44:31.172 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:44:31.188 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/118 kB Progress (2): 14 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-12T00:44:31.189 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:44:31.189 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 49/118 kB Progress (1): 66/118 kB Progress (2): 66/118 kB | 16/26 kB Progress (3): 66/118 kB | 16/26 kB | 16/171 kB Progress (3): 66/118 kB | 26 kB | 16/171 kB Progress (3): 82/118 kB | 26 kB | 16/171 kB Progress (3): 82/118 kB | 26 kB | 33/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.6 MB/s) 2024-09-12T00:44:31.189 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:44:31.189 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 82/118 kB | 49/171 kB Progress (2): 98/118 kB | 49/171 kB Progress (2): 98/118 kB | 64/171 kB Progress (2): 113/118 kB | 64/171 kB Progress (2): 113/118 kB | 81/171 kB Progress (2): 118 kB | 81/171 kB Progress (2): 118 kB | 97/171 kB Progress (2): 118 kB | 113/171 kB Progress (2): 118 kB | 130/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.5 MB/s) 2024-09-12T00:44:31.189 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:44:31.189 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 146/171 kB Progress (1): 163/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-12T00:44:31.189 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:44:31.193 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 372 kB/s) 2024-09-12T00:44:31.193 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:44:31.202 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/136 kB Progress (1): 33/136 kB Progress (1): 49/136 kB Progress (1): 64/136 kB Progress (1): 80/136 kB Progress (1): 97/136 kB Progress (1): 113/136 kB Progress (1): 129/136 kB Progress (1): 136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.3 MB/s) 2024-09-12T00:44:31.203 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:44:31.209 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/501 kB Progress (1): 31/501 kB Progress (1): 48/501 kB Progress (1): 64/501 kB Progress (1): 77/501 kB Progress (1): 93/501 kB Progress (1): 110/501 kB Progress (1): 126/501 kB Progress (1): 143/501 kB Progress (1): 159/501 kB Progress (1): 175/501 kB Progress (1): 192/501 kB Progress (1): 208/501 kB Progress (1): 224/501 kB Progress (1): 241/501 kB Progress (1): 257/501 kB Progress (1): 274/501 kB Progress (1): 290/501 kB Progress (2): 290/501 kB | 16/61 kB Progress (2): 306/501 kB | 16/61 kB Progress (2): 306/501 kB | 33/61 kB Progress (2): 323/501 kB | 33/61 kB Progress (2): 323/501 kB | 49/61 kB Progress (2): 339/501 kB | 49/61 kB Progress (2): 339/501 kB | 61 kB Progress (3): 339/501 kB | 61 kB | 16/58 kB Progress (3): 356/501 kB | 61 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.6 MB/s) 2024-09-12T00:44:31.209 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 372/501 kB | 16/58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:44:31.210 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 372/501 kB | 32/58 kB Progress (2): 388/501 kB | 32/58 kB Progress (2): 388/501 kB | 49/58 kB Progress (2): 405/501 kB | 49/58 kB Progress (2): 405/501 kB | 58 kB Progress (2): 421/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.5 MB/s) 2024-09-12T00:44:31.210 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 437/501 kB Progress (1): 454/501 kB Progress (1): 470/501 kB Progress (1): 487/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-12T00:44:31.221 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/124 kB Progress (1): 31/124 kB Progress (1): 48/124 kB Progress (1): 64/124 kB Progress (1): 81/124 kB Progress (1): 97/124 kB Progress (2): 97/124 kB | 16/146 kB Progress (2): 110/124 kB | 16/146 kB Progress (2): 110/124 kB | 32/146 kB Progress (2): 124 kB | 32/146 kB Progress (2): 124 kB | 49/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.5 MB/s) 2024-09-12T00:44:31.223 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 65/146 kB Progress (1): 81/146 kB Progress (1): 98/146 kB Progress (1): 114/146 kB Progress (1): 130/146 kB Progress (1): 146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 2.8 MB/s) 2024-09-12T00:44:31.261 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 27 MB/s) 2024-09-12T00:44:31.333 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:31.334 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:44:31.337 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:44:31.354 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 280 kB/s) 2024-09-12T00:44:31.356 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:44:31.373 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 306 kB/s) 2024-09-12T00:44:31.374 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:44:31.391 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15/45 kB Progress (1): 31/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.7 MB/s) 2024-09-12T00:44:31.394 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:44:31.414 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 4.1/21 kB Progress (1): 20/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.0 MB/s) 2024-09-12T00:44:31.417 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:44:31.432 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-12T00:44:31.434 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:44:31.455 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 187 kB/s) 2024-09-12T00:44:31.458 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:44:31.487 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 207 kB/s) 2024-09-12T00:44:31.489 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:44:31.504 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-12T00:44:31.506 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:44:31.525 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.1 MB/s) 2024-09-12T00:44:31.529 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:44:31.550 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 692 kB/s) 2024-09-12T00:44:31.553 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:44:31.570 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 120 kB/s) 2024-09-12T00:44:31.572 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:44:31.606 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 249 kB/s) 2024-09-12T00:44:31.608 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:44:31.624 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.6 MB/s) 2024-09-12T00:44:31.630 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:44:31.650 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 1.9 MB/s) 2024-09-12T00:44:31.650 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:44:31.650 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:44:31.650 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:44:31.651 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:44:31.651 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:44:31.666 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/58 kB Progress (2): 16/58 kB | 16/211 kB Progress (3): 16/58 kB | 16/211 kB | 15/26 kB Progress (3): 16/58 kB | 33/211 kB | 15/26 kB Progress (3): 16/58 kB | 33/211 kB | 26 kB Progress (3): 16/58 kB | 49/211 kB | 26 kB Progress (3): 16/58 kB | 66/211 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T00:44:31.666 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:44:31.668 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 16/58 kB | 82/211 kB Progress (2): 32/58 kB | 82/211 kB Progress (2): 32/58 kB | 98/211 kB Progress (2): 49/58 kB | 98/211 kB Progress (2): 49/58 kB | 115/211 kB Progress (2): 58 kB | 115/211 kB Progress (2): 58 kB | 131/211 kB Progress (2): 58 kB | 147/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.2 MB/s) 2024-09-12T00:44:31.668 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:44:31.670 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 164/211 kB Progress (2): 164/211 kB | 16/79 kB Progress (2): 180/211 kB | 16/79 kB Progress (2): 197/211 kB | 16/79 kB Progress (2): 197/211 kB | 33/79 kB Progress (2): 211 kB | 33/79 kB Progress (2): 211 kB | 49/79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T00:44:31.670 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 66/79 kB Progress (1): 79 kB Progress (2): 79 kB | 0/1.0 MB Progress (2): 79 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.0 MB/s) 2024-09-12T00:44:31.688 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 0/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 15/116 kB Progress (2): 1.0/1.0 MB | 15/116 kB Progress (2): 1.0/1.0 MB | 31/116 kB Progress (2): 1.0/1.0 MB | 31/116 kB Progress (2): 1.0/1.0 MB | 48/116 kB Progress (2): 1.0/1.0 MB | 48/116 kB Progress (2): 1.0/1.0 MB | 64/116 kB Progress (2): 1.0/1.0 MB | 64/116 kB Progress (2): 1.0 MB | 64/116 kB Progress (2): 1.0 MB | 81/116 kB Progress (2): 1.0 MB | 97/116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 30 MB/s) 2024-09-12T00:44:31.689 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 113/116 kB Progress (1): 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.4 MB/s) 2024-09-12T00:44:31.696 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 79/267 kB Progress (1): 96/267 kB Progress (1): 112/267 kB Progress (1): 128/267 kB Progress (1): 145/267 kB Progress (1): 161/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 210/267 kB Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 5.8 MB/s) 2024-09-12T00:44:31.827 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:44:31.875 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:44:31.875 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:44:31.875 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:44:31.875 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Total time: 6.160 s 2024-09-12T00:44:31.875 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Finished at: 2024-09-12T00:44:31Z 2024-09-12T00:44:31.876 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:44:31.899 INFO:tasks.workunit.client.0.smithi083.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:44:31.908 INFO:tasks.workunit.client.0.smithi083.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:44:32.889 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Scanning for projects... 2024-09-12T00:44:32.963 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:32.964 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:44:32.964 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:44:32.964 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] from pom.xml 2024-09-12T00:44:32.964 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:44:33.221 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:33.221 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:44:33.353 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:44:33.353 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:33.353 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:44:33.466 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:44:33.466 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:33.466 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:44:33.468 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:44:33.468 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:33.468 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:44:33.475 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:44:33.475 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:33.475 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:44:33.649 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:44:33.870 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:44:34.085 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 21 kB/s) 2024-09-12T00:44:34.098 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:44:34.117 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-09-12T00:44:34.125 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:44:34.144 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-12T00:44:34.151 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:44:34.168 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-12T00:44:34.172 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:44:34.191 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 160 kB/s) 2024-09-12T00:44:34.195 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:44:34.211 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T00:44:34.213 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:44:34.232 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-09-12T00:44:34.237 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:44:34.264 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.0 MB/s) 2024-09-12T00:44:34.265 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:44:34.266 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:44:34.266 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:44:34.266 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:44:34.267 INFO:tasks.workunit.client.0.smithi083.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:44:34.286 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 798 kB/s) 2024-09-12T00:44:34.317 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (1): 6.9/7.7 kB Progress (1): 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 147 kB/s) 2024-09-12T00:44:34.352 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 1.4/169 kB Progress (1): 2.8/169 kB Progress (1): 4.1/169 kB Progress (1): 5.5/169 kB Progress (1): 6.9/169 kB Progress (1): 8.3/169 kB Progress (1): 9.7/169 kB Progress (1): 11/169 kB Progress (1): 12/169 kB Progress (1): 14/169 kB Progress (1): 15/169 kB Progress (1): 17/169 kB Progress (1): 18/169 kB Progress (1): 19/169 kB Progress (1): 21/169 kB Progress (1): 22/169 kB Progress (1): 23/169 kB Progress (2): 23/169 kB | 1.4/103 kB Progress (2): 25/169 kB | 1.4/103 kB Progress (2): 25/169 kB | 2.8/103 kB Progress (2): 26/169 kB | 2.8/103 kB Progress (2): 26/169 kB | 4.1/103 kB Progress (2): 28/169 kB | 4.1/103 kB Progress (2): 28/169 kB | 5.5/103 kB Progress (3): 28/169 kB | 5.5/103 kB | 1.4/189 kB Progress (3): 28/169 kB | 6.9/103 kB | 1.4/189 kB Progress (3): 29/169 kB | 6.9/103 kB | 1.4/189 kB Progress (3): 29/169 kB | 8.3/103 kB | 1.4/189 kB Progress (3): 29/169 kB | 8.3/103 kB | 2.8/189 kB Progress (3): 29/169 kB | 9.7/103 kB | 2.8/189 kB Progress (3): 30/169 kB | 9.7/103 kB | 2.8/189 kB Progress (3): 30/169 kB | 11/103 kB | 2.8/189 kB Progress (3): 30/169 kB | 11/103 kB | 4.1/189 kB Progress (3): 30/169 kB | 12/103 kB | 4.1/189 kB Progress (3): 30/169 kB | 12/103 kB | 5.5/189 kB Progress (3): 30/169 kB | 14/103 kB | 5.5/189 kB Progress (3): 30/169 kB | 14/103 kB | 6.9/189 kB Progress (3): 30/169 kB | 15/103 kB | 6.9/189 kB Progress (3): 30/169 kB | 15/103 kB | 8.3/189 kB Progress (3): 30/169 kB | 17/103 kB | 8.3/189 kB Progress (3): 30/169 kB | 17/103 kB | 9.7/189 kB Progress (3): 30/169 kB | 18/103 kB | 9.7/189 kB Progress (3): 30/169 kB | 18/103 kB | 11/189 kB Progress (3): 30/169 kB | 19/103 kB | 11/189 kB Progress (3): 30/169 kB | 19/103 kB | 12/189 kB Progress (3): 32/169 kB | 19/103 kB | 12/189 kB Progress (3): 32/169 kB | 21/103 kB | 12/189 kB Progress (3): 32/169 kB | 21/103 kB | 14/189 kB Progress (3): 32/169 kB | 22/103 kB | 14/189 kB Progress (3): 33/169 kB | 22/103 kB | 14/189 kB Progress (3): 33/169 kB | 23/103 kB | 14/189 kB Progress (3): 33/169 kB | 23/103 kB | 15/189 kB Progress (3): 33/169 kB | 25/103 kB | 15/189 kB Progress (3): 34/169 kB | 25/103 kB | 15/189 kB Progress (3): 34/169 kB | 26/103 kB | 15/189 kB Progress (3): 34/169 kB | 26/103 kB | 16/189 kB Progress (3): 34/169 kB | 28/103 kB | 16/189 kB Progress (3): 36/169 kB | 28/103 kB | 16/189 kB Progress (3): 36/169 kB | 29/103 kB | 16/189 kB Progress (3): 37/169 kB | 29/103 kB | 16/189 kB Progress (3): 37/169 kB | 30/103 kB | 16/189 kB Progress (3): 39/169 kB | 30/103 kB | 16/189 kB Progress (3): 40/169 kB | 30/103 kB | 16/189 kB Progress (3): 41/169 kB | 30/103 kB | 16/189 kB Progress (3): 41/169 kB | 32/103 kB | 16/189 kB Progress (3): 43/169 kB | 32/103 kB | 16/189 kB Progress (3): 43/169 kB | 33/103 kB | 16/189 kB Progress (3): 44/169 kB | 33/103 kB | 16/189 kB Progress (3): 44/169 kB | 34/103 kB | 16/189 kB Progress (3): 46/169 kB | 34/103 kB | 16/189 kB Progress (3): 46/169 kB | 36/103 kB | 16/189 kB Progress (3): 46/169 kB | 36/103 kB | 32/189 kB Progress (3): 46/169 kB | 37/103 kB | 32/189 kB Progress (3): 47/169 kB | 37/103 kB | 32/189 kB Progress (3): 47/169 kB | 39/103 kB | 32/189 kB Progress (3): 48/169 kB | 39/103 kB | 32/189 kB Progress (3): 49/169 kB | 39/103 kB | 32/189 kB Progress (3): 49/169 kB | 40/103 kB | 32/189 kB Progress (3): 49/169 kB | 40/103 kB | 49/189 kB Progress (3): 49/169 kB | 41/103 kB | 49/189 kB Progress (3): 49/169 kB | 43/103 kB | 49/189 kB Progress (3): 49/169 kB | 44/103 kB | 49/189 kB Progress (3): 49/169 kB | 46/103 kB | 49/189 kB Progress (3): 66/169 kB | 46/103 kB | 49/189 kB Progress (3): 66/169 kB | 47/103 kB | 49/189 kB Progress (3): 66/169 kB | 48/103 kB | 49/189 kB Progress (3): 66/169 kB | 49/103 kB | 49/189 kB Progress (3): 82/169 kB | 49/103 kB | 49/189 kB Progress (3): 98/169 kB | 49/103 kB | 49/189 kB Progress (3): 115/169 kB | 49/103 kB | 49/189 kB Progress (3): 131/169 kB | 49/103 kB | 49/189 kB Progress (3): 131/169 kB | 66/103 kB | 49/189 kB Progress (3): 131/169 kB | 66/103 kB | 65/189 kB Progress (3): 147/169 kB | 66/103 kB | 65/189 kB Progress (3): 147/169 kB | 82/103 kB | 65/189 kB Progress (3): 147/169 kB | 82/103 kB | 81/189 kB Progress (3): 147/169 kB | 82/103 kB | 98/189 kB Progress (3): 147/169 kB | 98/103 kB | 98/189 kB Progress (3): 147/169 kB | 98/103 kB | 114/189 kB Progress (3): 147/169 kB | 103 kB | 114/189 kB Progress (3): 147/169 kB | 103 kB | 130/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-12T00:44:34.353 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (2): 147/169 kB | 147/189 kB Progress (2): 164/169 kB | 147/189 kB Progress (2): 169 kB | 147/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.9 MB/s) 2024-09-12T00:44:34.361 INFO:tasks.workunit.client.0.smithi083.stdout:Progress (1): 163/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-12T00:44:34.374 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:34.374 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:44:34.375 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] T E S T S 2024-09-12T00:44:34.375 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:44:34.805 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:44:34.845 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjects.java: starting test run: 2024-09-12T00:44:34.845 INFO:tasks.workunit.client.0.smithi083.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:44:34.845 INFO:tasks.workunit.client.0.smithi083.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:44:34.845 INFO:tasks.workunit.client.0.smithi083.stdout: EndpointUrl=https://smithi083.front.sepia.ceph.com:443 2024-09-12T00:44:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:44:35.042 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Environment Variables Read 2024-09-12T00:44:35.344 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:44:35.344 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-09-12T00:44:35.344 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generating File 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: File Generated 2024-09-12T00:44:35.345 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Generated Big Files 2024-09-12T00:44:35.626 INFO:tasks.workunit.client.0.smithi083.stdout:HeadBucketResponse() 2024-09-12T00:44:35.627 INFO:tasks.workunit.client.0.smithi083.stdout:sheik is ready 2024-09-12T00:44:35.627 INFO:tasks.workunit.client.0.smithi083.stdout:DEBUG: Test Bucket Created 2024-09-12T00:44:35.643 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:44:35.743 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:44:35.844 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:44:35.895 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:44:35.944 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:44:36.037 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:44:36.044 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:44:36.145 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:44:36.244 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:44:36.344 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:44:38.247 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:44:38.548 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:44:40.370 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-0b 2024-09-12T00:44:40.371 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-8b 2024-09-12T00:44:40.372 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-200b 2024-09-12T00:44:40.373 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-21983b 2024-09-12T00:44:40.374 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-5519b 2024-09-12T00:44:40.375 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-204329b 2024-09-12T00:44:40.376 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-256k 2024-09-12T00:44:40.376 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-1m 2024-09-12T00:44:40.377 INFO:tasks.workunit.client.0.smithi083.stdout:arg: file-1038757b 2024-09-12T00:44:40.411 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:44:40.412 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-09-12T00:44:40.451 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:44:40.451 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-09-12T00:44:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:44:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-09-12T00:44:40.551 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:44:40.551 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-09-12T00:44:40.647 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:44:40.647 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-09-12T00:44:40.651 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:44:40.677 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-09-12T00:44:40.708 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:44:40.708 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-09-12T00:44:40.751 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:44:40.806 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-09-12T00:44:40.851 INFO:tasks.workunit.client.0.smithi083.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:44:40.852 INFO:tasks.workunit.client.0.smithi083.stdout:PutObjectResponse 2024-09-12T00:44:40.952 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:44:41.252 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:44:41.653 INFO:tasks.workunit.client.0.smithi083.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:44:43.863 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.053 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:44:43.877 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:43.877 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Results: 2024-09-12T00:44:43.877 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:43.877 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:44:43.877 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] 2024-09-12T00:44:43.879 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:44:43.880 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:44:43.880 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:44:43.880 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Total time: 11.011 s 2024-09-12T00:44:43.881 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] Finished at: 2024-09-12T00:44:43Z 2024-09-12T00:44:43.881 INFO:tasks.workunit.client.0.smithi083.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:44:43.892 INFO:tasks.workunit.client.0.smithi083.stderr:+ exit 2024-09-12T00:44:43.893 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:44:43.893 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:44:43.972 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:44:43.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:44:44.345 DEBUG:teuthology.parallel:result is None 2024-09-12T00:44:44.345 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:44:44.384 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:44:44.384 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:44.452 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:44:44.452 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:44:44.462 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:44:44.462 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:44:44.463 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:44.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:44:44.521 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:44:44.521 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:44.590 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:44.590 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:44:44.659 INFO:tasks.workunit:timeout=3h 2024-09-12T00:44:44.660 INFO:tasks.workunit:cleanup=True 2024-09-12T00:44:44.660 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:44:44.729 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:45:43.230 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:45:43.231 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:45:43.231 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:45:43.231 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:45:43.231 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:45:43.231 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:45:43.231 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:45:43.232 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:45:43.233 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:45:43.235 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:45:43.305 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:45:43.307 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:45:43.307 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:45:43.355 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:45:43.403 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:45:43.442 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:45:43.444 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:45:43.444 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:45:43.485 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:45:43.485 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:45:43.485 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:45:43.555 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:45:43.557 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:45:43.557 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:45:43.631 INFO:tasks.workunit.client.0.smithi083.stdout:INFO: fully qualified domain name: smithi083.front.sepia.ceph.com 2024-09-12T00:45:43.631 INFO:tasks.workunit.client.0.smithi083.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:45:43.632 INFO:tasks.workunit.client.0.smithi083.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T00:45:46.088 INFO:tasks.workunit.client.0.smithi083.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:45:46.273 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting pip 2024-09-12T00:45:46.278 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:45:46.322 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: pip 2024-09-12T00:45:46.323 INFO:tasks.workunit.client.0.smithi083.stdout: Attempting uninstall: pip 2024-09-12T00:45:46.323 INFO:tasks.workunit.client.0.smithi083.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:45:46.476 INFO:tasks.workunit.client.0.smithi083.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:45:46.481 INFO:tasks.workunit.client.0.smithi083.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:45:47.215 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed pip-24.2 2024-09-12T00:45:48.030 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting boto3 2024-09-12T00:45:48.031 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:45:48.558 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:45:48.559 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:45:48.610 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:45:48.611 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:45:48.672 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:45:48.673 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:45:48.732 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:45:48.733 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:45:48.808 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:45:48.809 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:45:48.946 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:45:48.947 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:45:48.951 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:45:48.953 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:45:48.962 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:45:48.963 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:45:48.965 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:45:48.966 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:45:48.967 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:45:49.040 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:45:50.070 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:45:50.302 INFO:tasks.workunit.client.0.smithi083.stdout:INFO: creating user 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout:{ 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout: "user_id": "testid", 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout: "display_name": "M. Tester", 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout: "email": "tester@ceph.com", 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout: "suspended": 0, 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout: "subusers": [], 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout: "keys": [ 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout: { 2024-09-12T00:45:50.613 INFO:tasks.workunit.client.0.smithi083.stdout: "user": "testid", 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "active": true, 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-09-12T00:45:50.609495Z" 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: } 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: ], 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "swift_keys": [], 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "caps": [], 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "default_placement": "", 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "placement_tags": [], 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "bucket_quota": { 2024-09-12T00:45:50.614 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "user_quota": { 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "enabled": false, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size": -1, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "max_objects": -1 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: }, 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "type": "rgw", 2024-09-12T00:45:50.615 INFO:tasks.workunit.client.0.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:45:50.616 INFO:tasks.workunit.client.0.smithi083.stdout: "account_id": "", 2024-09-12T00:45:50.616 INFO:tasks.workunit.client.0.smithi083.stdout: "path": "/", 2024-09-12T00:45:50.616 INFO:tasks.workunit.client.0.smithi083.stdout: "create_date": "2024-09-12T00:45:50.609484Z", 2024-09-12T00:45:50.616 INFO:tasks.workunit.client.0.smithi083.stdout: "tags": [], 2024-09-12T00:45:50.616 INFO:tasks.workunit.client.0.smithi083.stdout: "group_ids": [] 2024-09-12T00:45:50.616 INFO:tasks.workunit.client.0.smithi083.stdout:} 2024-09-12T00:45:50.616 INFO:tasks.workunit.client.0.smithi083.stdout: 2024-09-12T00:45:55.548 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:55.548 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:55.577 INFO:tasks.workunit.client.0.smithi083.stderr:5+0 records in 2024-09-12T00:45:55.577 INFO:tasks.workunit.client.0.smithi083.stderr:5+0 records out 2024-09-12T00:45:55.578 INFO:tasks.workunit.client.0.smithi083.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0153923 s, 341 MB/s 2024-09-12T00:45:55.581 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:55.581 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:55.638 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:55.638 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:55.698 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:55.698 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:55.757 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:55.757 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:55.817 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:55.817 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:55.877 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:55.877 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:55.931 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:55.931 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:55.986 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:55.986 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:56.045 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:56.045 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:56.105 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:56.105 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:56.163 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:56.163 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:56.220 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:56.220 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:56.274 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:56.274 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:56.331 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:56.331 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:56.379 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:45:56.379 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:45:56.433 INFO:tasks.workunit.client.0.smithi083.stdout:bucket nams is reupload-bkt-101121 2024-09-12T00:45:56.433 INFO:tasks.workunit.client.0.smithi083.stdout:endpoint is https://smithi083.front.sepia.ceph.com:443 2024-09-12T00:45:56.433 INFO:tasks.workunit.client.0.smithi083.stdout:start UploadId=2~y6KvyBHSAYi2JNDDJTK1WUfpGV0c5ob 2024-09-12T00:45:56.433 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.433 INFO:tasks.workunit.client.0.smithi083.stdout:phase 1 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 2} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.434 INFO:tasks.workunit.client.0.smithi083.stdout:phase 2 uploaded part {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1} 2024-09-12T00:45:56.435 INFO:tasks.workunit.client.0.smithi083.stdout:completing multipart upload, parts=[{'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 1}, {'ETag': '"a5ce3052771d0bd077ed979030ed82dc"', 'PartNumber': 2}] 2024-09-12T00:45:57.486 INFO:tasks.workunit.client.0.smithi083.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:45:57.486 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4_mpu_test4 2024-09-12T00:45:57.486 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4__multipart_mpu_test4.2~y6KvyBHSAYi2JNDDJTK1WUfpGV0c5ob.2 2024-09-12T00:45:57.486 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4__multipart_mpu_test4.s9BTe-L_ejmTAFEGJv5jxCDMmihxL9sk.1 2024-09-12T00:45:57.486 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4__shadow_mpu_test4.2~y6KvyBHSAYi2JNDDJTK1WUfpGV0c5ob.2_1 2024-09-12T00:45:57.486 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4__shadow_mpu_test4.s9BTe-L_ejmTAFEGJv5jxCDMmihxL9sk.1_1 2024-09-12T00:45:57.546 INFO:tasks.workunit.client.0.smithi083.stdout:rados ls: 2024-09-12T00:45:57.547 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4_mpu_test4 2024-09-12T00:45:57.547 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4__multipart_mpu_test4.2~y6KvyBHSAYi2JNDDJTK1WUfpGV0c5ob.2 2024-09-12T00:45:57.547 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4__multipart_mpu_test4.s9BTe-L_ejmTAFEGJv5jxCDMmihxL9sk.1 2024-09-12T00:45:57.547 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4__shadow_mpu_test4.2~y6KvyBHSAYi2JNDDJTK1WUfpGV0c5ob.2_1 2024-09-12T00:45:57.547 INFO:tasks.workunit.client.0.smithi083.stdout:ad4424e4-de7c-4376-b125-e717016a3484.4511.4__shadow_mpu_test4.s9BTe-L_ejmTAFEGJv5jxCDMmihxL9sk.1_1 2024-09-12T00:45:57.550 INFO:tasks.workunit.client.0.smithi083.stdout:== PASSED == 2024-09-12T00:45:57.550 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:45:57.551 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:45:57.629 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:45:57.629 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:45:58.003 DEBUG:teuthology.parallel:result is None 2024-09-12T00:45:58.003 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:45:58.041 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:45:58.041 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:45:58.110 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:45:58.110 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:45:58.125 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:45:58.125 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:45:58.125 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:45:58.125 DEBUG:teuthology.orchestra.run.smithi083:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:45:58.178 INFO:teuthology.orchestra.run.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:45:58.365 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:45:58.366 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:45:58.366 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key BMKKXWUPZDTZBDXKGNSD --secret qiojSskbAnlAX/svRFaBejFMCSGjaqeF/AdzkL2/K/c/6qnaRWz0vA== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:45:58.475 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:58.475 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:58.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.510+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.512+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.512+0000 7f0aaa333800 20 realm 2024-09-12T00:45:58.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.512+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.512+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.512+0000 7f0aaa333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:58.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.512+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.512+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.512+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.513+0000 7f0aaa333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:58.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.513+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.513+0000 7f0aaa333800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:58.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.513+0000 7f0aaa333800 20 searching for the correct realm 2024-09-12T00:45:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.516+0000 7f0aa6076640 0 -- 172.21.15.83:0/87348715 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f0a9807a8f0 msgr2=0x7f0a980d8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:58.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.722+0000 7f0aa6076640 0 -- 172.21.15.83:0/87348715 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f0a94003cb0 msgr2=0x7f0aa005fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:45:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:45:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:45:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.928+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 20 zone default found 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 4 Realm: () 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 20 zonegroup default 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.929+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.930+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.930+0000 7f0aaa333800 20 started sync module instance, tier type = 2024-09-12T00:45:58.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.930+0000 7f0aaa333800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:45:58.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.939+0000 7f0aaa333800 20 add_watcher() i=0 2024-09-12T00:45:58.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.939+0000 7f0aaa333800 20 add_watcher() i=1 2024-09-12T00:45:58.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.939+0000 7f0aaa333800 20 add_watcher() i=2 2024-09-12T00:45:58.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.939+0000 7f0aaa333800 20 add_watcher() i=3 2024-09-12T00:45:58.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.939+0000 7f0aaa333800 20 add_watcher() i=4 2024-09-12T00:45:58.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.939+0000 7f0aaa333800 20 add_watcher() i=5 2024-09-12T00:45:58.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.939+0000 7f0aaa333800 20 add_watcher() i=6 2024-09-12T00:45:58.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.940+0000 7f0aaa333800 20 add_watcher() i=7 2024-09-12T00:45:58.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.940+0000 7f0aaa333800 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:58.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.942+0000 7f095cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:58.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.942+0000 7f0aaa333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:58.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.942+0000 7f0aaa333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.942+0000 7f0aaa333800 5 note: GC not initialized 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.942+0000 7f08d77fe640 20 reqs_thread_entry: start 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.942+0000 7f0aaa333800 20 init_complete bucket index max shards: 1 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 20 Filter name: none 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f08d57fa640 20 reqs_thread_entry: start 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:45:58.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:45:58.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:45:58.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 10 cache get: name=default.rgw.meta+users.keys+BMKKXWUPZDTZBDXKGNSD : miss 2024-09-12T00:45:58.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 20 rados->read ofs=0 len=0 2024-09-12T00:45:58.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.943+0000 7f0aaa333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.944+0000 7f0aaa333800 10 cache put: name=default.rgw.meta+users.keys+BMKKXWUPZDTZBDXKGNSD info.flags=0x0 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.944+0000 7f0aaa333800 10 adding default.rgw.meta+users.keys+BMKKXWUPZDTZBDXKGNSD to cache LRU end 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.944+0000 7f0aaa333800 10 cache get: name=default.rgw.meta+users.keys+BMKKXWUPZDTZBDXKGNSD : hit (negative entry) 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.944+0000 7f0aaa333800 10 cache get: name=default.rgw.meta+users.keys+BMKKXWUPZDTZBDXKGNSD : hit (negative entry) 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.945+0000 7f0aaa333800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.945+0000 7f0aaa333800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.945+0000 7f0aaa333800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.945+0000 7f0989ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660537 cookie 93927228077424 notifier 5621 bl.length()=675 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.945+0000 7f0989ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:45:58.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.945+0000 7f0989ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:45:58.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.947+0000 7f0aaa333800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:45:58.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.947+0000 7f0aaa333800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:45:58.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.947+0000 7f0aaa333800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:45:58.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.947+0000 7f0989ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660490 cookie 93927228067680 notifier 5621 bl.length()=202 2024-09-12T00:45:58.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.947+0000 7f0989ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:45:58.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.947+0000 7f0989ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:45:58.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.948+0000 7f0aaa333800 10 cache put: name=default.rgw.meta+users.keys+BMKKXWUPZDTZBDXKGNSD info.flags=0x7 2024-09-12T00:45:58.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.948+0000 7f0aaa333800 10 moving default.rgw.meta+users.keys+BMKKXWUPZDTZBDXKGNSD to cache LRU end 2024-09-12T00:45:58.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.948+0000 7f0aaa333800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:BMKKXWUPZDTZBDXKGNSD, ofs0, ns] 2024-09-12T00:45:58.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.948+0000 7f09897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660538 cookie 93927228077424 notifier 5621 bl.length()=190 2024-09-12T00:45:58.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.948+0000 7f09897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BMKKXWUPZDTZBDXKGNSD info.flags=0x7 2024-09-12T00:45:58.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.948+0000 7f09897fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BMKKXWUPZDTZBDXKGNSD to cache LRU end 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "ragweed.client.0", 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "BMKKXWUPZDTZBDXKGNSD", 2024-09-12T00:45:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "qiojSskbAnlAX/svRFaBejFMCSGjaqeF/AdzkL2/K/c/6qnaRWz0vA==", 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:45:58.944781Z" 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:45:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:45:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-09-12T00:45:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:45:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:45:58.944767Z", 2024-09-12T00:45:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:45:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:45:58.951 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:45:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:45:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.950+0000 7f095cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.952+0000 7f0aaa333800 20 remove_watcher() i=0 2024-09-12T00:45:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.952+0000 7f0aaa333800 2 removed watcher, disabling cache 2024-09-12T00:45:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.953+0000 7f0aaa333800 20 remove_watcher() i=1 2024-09-12T00:45:58.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.955+0000 7f0aaa333800 20 remove_watcher() i=2 2024-09-12T00:45:58.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.956+0000 7f0aaa333800 20 remove_watcher() i=3 2024-09-12T00:45:58.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.957+0000 7f0aaa333800 20 remove_watcher() i=4 2024-09-12T00:45:58.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.958+0000 7f0aaa333800 20 remove_watcher() i=5 2024-09-12T00:45:58.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.959+0000 7f0aaa333800 20 remove_watcher() i=6 2024-09-12T00:45:58.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:58.960+0000 7f0aaa333800 20 remove_watcher() i=7 2024-09-12T00:45:58.970 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:45:58.970 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key TMRIVRSUPYLBNQXKXKLM --secret Aij9zfew3NR/1uCmD8M2JZX5VH7HDTUziMlCoCTx3jlfbvC0Gje8WA== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:45:59.036 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:59.036 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:59.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.070+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.072+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.072+0000 7fee14e0f800 20 realm 2024-09-12T00:45:59.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.072+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.072+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.072+0000 7fee14e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:59.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.072+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.073+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.073+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.073+0000 7fee14e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:59.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.073+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.074+0000 7fee14e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:59.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.074+0000 7fee14e0f800 20 searching for the correct realm 2024-09-12T00:45:59.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.077+0000 7fee0fd47640 0 -- 172.21.15.83:0/1126532389 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fee0406d8c0 msgr2=0x7fee0406e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:59.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.283+0000 7fee10d49640 0 -- 172.21.15.83:0/1126532389 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x565318eb9b30 msgr2=0x565318ebbf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:59.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:45:59.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:59.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:45:59.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:59.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:59.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:59.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.289+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 zone default found 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 4 Realm: () 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 zonegroup default 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 started sync module instance, tier type = 2024-09-12T00:45:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.290+0000 7fee14e0f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:45:59.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.300+0000 7fee14e0f800 20 add_watcher() i=0 2024-09-12T00:45:59.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.300+0000 7fee14e0f800 20 add_watcher() i=1 2024-09-12T00:45:59.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.300+0000 7fee14e0f800 20 add_watcher() i=2 2024-09-12T00:45:59.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.300+0000 7fee14e0f800 20 add_watcher() i=3 2024-09-12T00:45:59.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.300+0000 7fee14e0f800 20 add_watcher() i=4 2024-09-12T00:45:59.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.300+0000 7fee14e0f800 20 add_watcher() i=5 2024-09-12T00:45:59.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.300+0000 7fee14e0f800 20 add_watcher() i=6 2024-09-12T00:45:59.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.301+0000 7fee14e0f800 20 add_watcher() i=7 2024-09-12T00:45:59.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.301+0000 7fee14e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.303+0000 7fecc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.303+0000 7fee14e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.303+0000 7fee14e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 5 note: GC not initialized 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fecc5fdb640 20 reqs_thread_entry: start 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 20 Filter name: none 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fec377fe640 20 reqs_thread_entry: start 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:45:59.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:45:59.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:45:59.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.304+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 10 cache get: name=default.rgw.meta+users.keys+TMRIVRSUPYLBNQXKXKLM : miss 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 10 cache put: name=default.rgw.meta+users.keys+TMRIVRSUPYLBNQXKXKLM info.flags=0x0 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 10 adding default.rgw.meta+users.keys+TMRIVRSUPYLBNQXKXKLM to cache LRU end 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 10 cache get: name=default.rgw.meta+users.keys+TMRIVRSUPYLBNQXKXKLM : hit (negative entry) 2024-09-12T00:45:59.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.305+0000 7fee14e0f800 10 cache get: name=default.rgw.meta+users.keys+TMRIVRSUPYLBNQXKXKLM : hit (negative entry) 2024-09-12T00:45:59.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.306+0000 7fee14e0f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:45:59.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.306+0000 7fee14e0f800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:45:59.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.306+0000 7fee14e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:45:59.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.307+0000 7fece77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660491 cookie 94914900423840 notifier 5958 bl.length()=675 2024-09-12T00:45:59.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.307+0000 7fece77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:45:59.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.307+0000 7fece77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:45:59.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.309+0000 7fee14e0f800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:45:59.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.309+0000 7fee14e0f800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:45:59.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.309+0000 7fee14e0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:45:59.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.309+0000 7fece77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660539 cookie 94914900421008 notifier 5958 bl.length()=202 2024-09-12T00:45:59.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.309+0000 7fece77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:45:59.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.309+0000 7fece77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:45:59.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.310+0000 7fee14e0f800 10 cache put: name=default.rgw.meta+users.keys+TMRIVRSUPYLBNQXKXKLM info.flags=0x7 2024-09-12T00:45:59.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.310+0000 7fee14e0f800 10 moving default.rgw.meta+users.keys+TMRIVRSUPYLBNQXKXKLM to cache LRU end 2024-09-12T00:45:59.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.310+0000 7fee14e0f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:TMRIVRSUPYLBNQXKXKLM, ofs0, ns] 2024-09-12T00:45:59.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.310+0000 7fece6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660496 cookie 94914900376144 notifier 5958 bl.length()=190 2024-09-12T00:45:59.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.310+0000 7fece6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TMRIVRSUPYLBNQXKXKLM info.flags=0x7 2024-09-12T00:45:59.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.310+0000 7fece6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TMRIVRSUPYLBNQXKXKLM to cache LRU end 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "sysuser.client.0", 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "TMRIVRSUPYLBNQXKXKLM", 2024-09-12T00:45:59.310 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "Aij9zfew3NR/1uCmD8M2JZX5VH7HDTUziMlCoCTx3jlfbvC0Gje8WA==", 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:45:59.306171Z" 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "system": true, 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:45:59.311 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-09-12T00:45:59.312 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:45:59.313 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-09-12T00:45:59.313 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:45:59.313 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:45:59.306157Z", 2024-09-12T00:45:59.313 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:45:59.313 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:45:59.313 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:45:59.313 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:45:59.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.312+0000 7fecc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:59.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.314+0000 7fee14e0f800 20 remove_watcher() i=0 2024-09-12T00:45:59.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.314+0000 7fee14e0f800 2 removed watcher, disabling cache 2024-09-12T00:45:59.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.315+0000 7fee14e0f800 20 remove_watcher() i=1 2024-09-12T00:45:59.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.316+0000 7fee14e0f800 20 remove_watcher() i=2 2024-09-12T00:45:59.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.317+0000 7fee14e0f800 20 remove_watcher() i=3 2024-09-12T00:45:59.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.318+0000 7fee14e0f800 20 remove_watcher() i=4 2024-09-12T00:45:59.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.319+0000 7fee14e0f800 20 remove_watcher() i=5 2024-09-12T00:45:59.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.320+0000 7fee14e0f800 20 remove_watcher() i=6 2024-09-12T00:45:59.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:45:59.321+0000 7fee14e0f800 20 remove_watcher() i=7 2024-09-12T00:45:59.330 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:45:59.331 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:45:59.331 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:45:59.359 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:45:59.360 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:45:59.360 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:45:59.428 DEBUG:teuthology.orchestra.run.smithi083:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:45:59.628 INFO:teuthology.orchestra.run.smithi083.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:45:59.798 INFO:teuthology.orchestra.run.smithi083.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:46:00.334 INFO:teuthology.orchestra.run.smithi083.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:46:06.391 INFO:teuthology.orchestra.run.smithi083.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:46:09.850 INFO:teuthology.orchestra.run.smithi083.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=691c28b2c177bb2c325407801b047329f3f05e6bd3f57b97e4016630d04e7448,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:46:09.850 INFO:teuthology.orchestra.run.smithi083.stdout:py run-test-pre: PYTHONHASHSEED='1359520513' 2024-09-12T00:46:09.850 INFO:teuthology.orchestra.run.smithi083.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:46:10.052 INFO:teuthology.orchestra.run.smithi083.stdout:============================= test session starts ============================== 2024-09-12T00:46:10.053 INFO:teuthology.orchestra.run.smithi083.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:46:10.053 INFO:teuthology.orchestra.run.smithi083.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:46:10.053 INFO:teuthology.orchestra.run.smithi083.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:46:10.053 INFO:teuthology.orchestra.run.smithi083.stdout:configfile: pytest.ini 2024-09-12T00:46:10.146 INFO:teuthology.orchestra.run.smithi083.stdout:collecting ... collected 9 items 2024-09-12T00:46:10.147 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:46:12.016 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:46:13.497 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:46:14.225 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:46:14.957 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:46:21.000 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:46:22.622 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:46:24.646 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:46:27.743 INFO:teuthology.orchestra.run.smithi083.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:46:27.743 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:46:27.743 INFO:teuthology.orchestra.run.smithi083.stdout:=============================== warnings summary =============================== 2024-09-12T00:46:27.743 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T00:46:27.743 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T00:46:27.743 INFO:teuthology.orchestra.run.smithi083.stdout: import imp 2024-09-12T00:46:27.743 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:46:27.743 INFO:teuthology.orchestra.run.smithi083.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T00:46:27.744 INFO:teuthology.orchestra.run.smithi083.stdout:======================== 9 passed, 1 warning in 17.69s ========================= 2024-09-12T00:46:27.774 INFO:teuthology.orchestra.run.smithi083.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:46:27.775 INFO:teuthology.orchestra.run.smithi083.stdout: py: commands succeeded 2024-09-12T00:46:27.775 INFO:teuthology.orchestra.run.smithi083.stdout: congratulations :) 2024-09-12T00:46:27.793 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:46:27.794 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:46:27.823 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:46:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:27.920 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:27.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.954+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.956+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.956+0000 7f2bef946800 20 realm 2024-09-12T00:46:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.956+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.956+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.956+0000 7f2bef946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.956+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.957+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.957+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.957+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.957+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.958+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.958+0000 7f2bef946800 20 searching for the correct realm 2024-09-12T00:46:27.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.962+0000 7f2bedc31640 0 -- 172.21.15.83:0/1598094319 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f2bd801c060 msgr2=0x7f2bd805e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:27.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.965+0000 7f2bed430640 0 -- 172.21.15.83:0/1598094319 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f2be808f410 msgr2=0x7f2be808f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:27.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.969+0000 7f2bef946800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:46:27.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.969+0000 7f2bef946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:27.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.969+0000 7f2bef946800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:46:27.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.969+0000 7f2bef946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:27.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.969+0000 7f2bef946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:27.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.969+0000 7f2bef946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:27.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.969+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.969+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.969+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 20 zone default found 2024-09-12T00:46:27.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 4 Realm: () 2024-09-12T00:46:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:46:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:46:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 20 zonegroup default 2024-09-12T00:46:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.970+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.971+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.971+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:27.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.971+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:27.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.971+0000 7f2bef946800 20 started sync module instance, tier type = 2024-09-12T00:46:27.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.971+0000 7f2bef946800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:46:27.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.980+0000 7f2bef946800 20 add_watcher() i=0 2024-09-12T00:46:27.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.980+0000 7f2bef946800 20 add_watcher() i=1 2024-09-12T00:46:27.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.980+0000 7f2bef946800 20 add_watcher() i=2 2024-09-12T00:46:27.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.980+0000 7f2bef946800 20 add_watcher() i=3 2024-09-12T00:46:27.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.980+0000 7f2bef946800 20 add_watcher() i=4 2024-09-12T00:46:27.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.980+0000 7f2bef946800 20 add_watcher() i=5 2024-09-12T00:46:27.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.980+0000 7f2bef946800 20 add_watcher() i=6 2024-09-12T00:46:27.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.981+0000 7f2bef946800 20 add_watcher() i=7 2024-09-12T00:46:27.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.981+0000 7f2bef946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:27.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.983+0000 7f2aa3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:27.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.983+0000 7f2bef946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:27.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:27.983+0000 7f2bef946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:28.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2aa2fe5640 20 reqs_thread_entry: start 2024-09-12T00:46:28.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2bef946800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:28.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2bef946800 20 Filter name: none 2024-09-12T00:46:28.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2aa0fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:28.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2bef946800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:46:28.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:46:28.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2bef946800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:46:28.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2bef946800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:46:28.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.020+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.021+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ad4424e4-de7c-4376-b125-e717016a3484.4511.5 : miss 2024-09-12T00:46:28.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.021+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:46:28.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ad4424e4-de7c-4376-b125-e717016a3484.4511.5 info.flags=0x17 2024-09-12T00:46:28.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:ad4424e4-de7c-4376-b125-e717016a3484.4511.5 to cache LRU end 2024-09-12T00:46:28.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ad4424e4-de7c-4376-b125-e717016a3484.4511.5 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55f0611b49a8 s->prefetch_data=0 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.022+0000 7f2bef946800 10 manifest: total_size = 5007 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.023+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.10399794923662544361 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.023+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55f0611b49a8 s->prefetch_data=0 2024-09-12T00:46:28.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.023+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f0611b49a8 2024-09-12T00:46:28.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.023+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.5.0 2024-09-12T00:46:28.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.025+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.025+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5007 stripe_ofs=5007 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.025+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.10399794923662544361 2024-09-12T00:46:28.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.025+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.025+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.lLZv4QrjQd48cu6zRbCzD6MMNVqepCf_0 2024-09-12T00:46:28.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.025+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.025+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.025+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.10399794923662544361 2024-09-12T00:46:28.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.027+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:46:28.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.027+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55f06113e498 s->prefetch_data=0 2024-09-12T00:46:28.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.027+0000 7f2bef946800 10 manifest: total_size = 5209 2024-09-12T00:46:28.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.027+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.1357618948363251008 2024-09-12T00:46:28.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.027+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55f06113e498 s->prefetch_data=0 2024-09-12T00:46:28.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.027+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113e498 2024-09-12T00:46:28.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.027+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.5.0 2024-09-12T00:46:28.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.030+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.030+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5209 stripe_ofs=5209 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.030+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1357618948363251008 2024-09-12T00:46:28.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.030+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.030+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.4UYbSlm1n5W6htkUyhurMfPpACItp-__0 2024-09-12T00:46:28.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.030+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:46:28.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.030+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.030+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1357618948363251008 2024-09-12T00:46:28.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.031+0000 7f2abffff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:46:28.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.031+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.032+0000 7f2bef946800 10 manifest: total_size = 7510 2024-09-12T00:46:28.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.032+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.17745138053283030251 2024-09-12T00:46:28.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.032+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.032+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.032+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.5.0 2024-09-12T00:46:28.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.034+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.034+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=7510 stripe_ofs=7510 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.034+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17745138053283030251 2024-09-12T00:46:28.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.034+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.034+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.hz53NFigERm_GLP9NNOoND0u6kNulKY_0 2024-09-12T00:46:28.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.034+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.034+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.034+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17745138053283030251 2024-09-12T00:46:28.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.035+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:46:28.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.036+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55f06113e3a8 s->prefetch_data=0 2024-09-12T00:46:28.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.036+0000 7f2bef946800 10 manifest: total_size = 4907 2024-09-12T00:46:28.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.036+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.11399748414591887083 2024-09-12T00:46:28.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.036+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55f06113e3a8 s->prefetch_data=0 2024-09-12T00:46:28.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.036+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113e3a8 2024-09-12T00:46:28.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.036+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.5.0 2024-09-12T00:46:28.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.039+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.039+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4907 stripe_ofs=4907 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.039+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.11399748414591887083 2024-09-12T00:46:28.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.039+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.039+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.ioD68x0LtQRhVBAHg34Dc-JvtjExdrL_0 2024-09-12T00:46:28.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.039+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.039+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.039+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.11399748414591887083 2024-09-12T00:46:28.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.040+0000 7f2abffff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:46:28.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.041+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.041+0000 7f2bef946800 10 manifest: total_size = 7673 2024-09-12T00:46:28.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.041+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.1376252023809909018 2024-09-12T00:46:28.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.041+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.041+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113e1a8 2024-09-12T00:46:28.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.041+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.5.0 2024-09-12T00:46:28.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.043+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.043+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=7673 stripe_ofs=7673 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.043+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1376252023809909018 2024-09-12T00:46:28.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.043+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.043+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.032RnzqrGSbGNzaucPB8xsu5WYQvVfN_0 2024-09-12T00:46:28.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.043+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:46:28.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.043+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.043+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1376252023809909018 2024-09-12T00:46:28.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.044+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:46:28.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.044+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.045+0000 7f2bef946800 10 manifest: total_size = 5241 2024-09-12T00:46:28.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.045+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.8698872575690833284 2024-09-12T00:46:28.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.045+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.045+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113e1a8 2024-09-12T00:46:28.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.045+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.5.0 2024-09-12T00:46:28.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.047+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.047+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5241 stripe_ofs=5241 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.047+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.8698872575690833284 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.047+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.047+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.9pRtBD4Uuw-aC2_X_24sNuu5DIwA8Tq_0 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.047+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.047+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.047+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.8698872575690833284 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.049+0000 7f2abffff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.049+0000 7f2bef946800 20 get_obj_state: octx=0x55f061134af0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.049+0000 7f2bef946800 10 manifest: total_size = 7814 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.049+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.6363602362399097346 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.049+0000 7f2bef946800 20 get_obj_state: octx=0x55f061134af0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.049+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113e1a8 2024-09-12T00:46:28.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.049+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.5.0 2024-09-12T00:46:28.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.052+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.052+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=7814 stripe_ofs=7814 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.052+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.6363602362399097346 2024-09-12T00:46:28.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.052+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.052+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.QJrYjWgxmG2Mgj6u65v9BY7bozWk9i5_0 2024-09-12T00:46:28.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.052+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:46:28.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.052+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.052+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.6363602362399097346 2024-09-12T00:46:28.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.053+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:46:28.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.053+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.054+0000 7f2bef946800 10 manifest: total_size = 5086 2024-09-12T00:46:28.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.054+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.11071671523346308977 2024-09-12T00:46:28.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.054+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00817e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.054+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113e1a8 2024-09-12T00:46:28.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.054+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.5.0 2024-09-12T00:46:28.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.056+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.056+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5086 stripe_ofs=5086 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.056+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.11071671523346308977 2024-09-12T00:46:28.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.056+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.056+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.Y78swkFHUXxYtRR-BiCkv5rP0skoHRe_0 2024-09-12T00:46:28.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.056+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.056+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.056+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.11071671523346308977 2024-09-12T00:46:28.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.058+0000 7f2abffff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:46:28.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.058+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.058+0000 7f2bef946800 10 manifest: total_size = 7783 2024-09-12T00:46:28.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.058+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.2738704888318142884 2024-09-12T00:46:28.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.058+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55f06113e1a8 s->prefetch_data=0 2024-09-12T00:46:28.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.058+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113e1a8 2024-09-12T00:46:28.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.058+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.5.0 2024-09-12T00:46:28.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.061+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.061+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=7783 stripe_ofs=7783 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.061+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.2738704888318142884 2024-09-12T00:46:28.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.061+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.061+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.0uYS8gzDbprxSMwDorBPzbgzUMc-HZG_0 2024-09-12T00:46:28.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.061+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:46:28.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.061+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.061+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.2738704888318142884 2024-09-12T00:46:28.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.062+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:46:28.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.062+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.062+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.062+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.062+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.062+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.062+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.062+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[ad4424e4-de7c-4376-b125-e717016a3484.4511.5])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.064+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:46:28.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.064+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.064+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:46:28.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.064+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:46:28.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.064+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:46:28.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.065+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:46:28.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.065+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:46:28.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.065+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94490908909184 notifier 5991 bl.length()=162 2024-09-12T00:46:28.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.067+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:ad4424e4-de7c-4376-b125-e717016a3484.4511.5 from cache 2024-09-12T00:46:28.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.067+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:ad4424e4-de7c-4376-b125-e717016a3484.4511.5, ofs0, ns] 2024-09-12T00:46:28.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.067+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 94490908923952 notifier 5991 bl.length()=219 2024-09-12T00:46:28.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.068+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ad4424e4-de7c-4376-b125-e717016a3484.4511.5 : miss 2024-09-12T00:46:28.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.068+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.069+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.069+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ad4424e4-de7c-4376-b125-e717016a3484.4511.5 info.flags=0x0 2024-09-12T00:46:28.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.069+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/ad4424e4-de7c-4376-b125-e717016a3484.4511.5 to cache LRU end 2024-09-12T00:46:28.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.071+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.12 : miss 2024-09-12T00:46:28.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.071+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.071+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:46:28.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.071+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.12 info.flags=0x17 2024-09-12T00:46:28.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.071+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.12 to cache LRU end 2024-09-12T00:46:28.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.071+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.071+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.071+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.12 2024-09-12T00:46:28.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.072+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:46:28.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.072+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55f0611b41a8 s->prefetch_data=0 2024-09-12T00:46:28.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.072+0000 7f2bef946800 10 manifest: total_size = 886297 2024-09-12T00:46:28.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.072+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.7779540561805460697 2024-09-12T00:46:28.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.072+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55f0611b41a8 s->prefetch_data=0 2024-09-12T00:46:28.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.072+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f0611b41a8 2024-09-12T00:46:28.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.072+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.12.0 2024-09-12T00:46:28.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:46:28.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-12T00:46:28.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:46:28.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:46:28.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-12T00:46:28.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.7779540561805460697 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.12__multipart_foo.2~tbmP6EMUwBVwbsgZNpXZonM0bqwT-S6.1 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.12__multipart_foo.2~tbmP6EMUwBVwbsgZNpXZonM0bqwT-S6.2 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:46:28.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.12__multipart_foo.2~tbmP6EMUwBVwbsgZNpXZonM0bqwT-S6.3 2024-09-12T00:46:28.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:46:28.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.12__multipart_foo.2~tbmP6EMUwBVwbsgZNpXZonM0bqwT-S6.4 2024-09-12T00:46:28.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:46:28.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.074+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.7779540561805460697 2024-09-12T00:46:28.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.076+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:46:28.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.076+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.076+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.076+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.076+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.076+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.076+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.076+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[ad4424e4-de7c-4376-b125-e717016a3484.4511.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.078+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:46:28.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.078+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.078+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:46:28.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.078+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:46:28.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.078+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:46:28.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.079+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:46:28.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.079+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:46:28.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.079+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94490908913472 notifier 5991 bl.length()=191 2024-09-12T00:46:28.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.080+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.12 from cache 2024-09-12T00:46:28.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.080+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.12, ofs0, ns] 2024-09-12T00:46:28.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.081+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94490908921680 notifier 5991 bl.length()=249 2024-09-12T00:46:28.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.082+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.12 : miss 2024-09-12T00:46:28.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.082+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.082+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.082+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.12 info.flags=0x0 2024-09-12T00:46:28.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.082+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.12 to cache LRU end 2024-09-12T00:46:28.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.084+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.13 : miss 2024-09-12T00:46:28.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.084+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.085+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:46:28.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.085+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.13 info.flags=0x17 2024-09-12T00:46:28.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.085+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.13 to cache LRU end 2024-09-12T00:46:28.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.085+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.085+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.085+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.13 2024-09-12T00:46:28.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.085+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:46:28.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.085+0000 7f2bef946800 20 get_obj_state: octx=0x55f061136150 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55f0611b41a8 s->prefetch_data=0 2024-09-12T00:46:28.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.086+0000 7f2bef946800 10 manifest: total_size = 1667 2024-09-12T00:46:28.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.086+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.15292665891768697852 2024-09-12T00:46:28.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.086+0000 7f2bef946800 20 get_obj_state: octx=0x55f061136150 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55f0611b41a8 s->prefetch_data=0 2024-09-12T00:46:28.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.086+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f0611b41a8 2024-09-12T00:46:28.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.086+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.13.0 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=516 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4191756 part_ofs=1548 rule->part_size=119 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:46:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.15292665891768697852 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.13__multipart_foo.2~CuyNtxa3V1ZPNJ7keLEPdVTlJ4jhvgF.1 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.13__multipart_foo.2~CuyNtxa3V1ZPNJ7keLEPdVTlJ4jhvgF.2 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.13__multipart_foo.2~CuyNtxa3V1ZPNJ7keLEPdVTlJ4jhvgF.3 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.13__multipart_foo.2~CuyNtxa3V1ZPNJ7keLEPdVTlJ4jhvgF.4 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.088+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.15292665891768697852 2024-09-12T00:46:28.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.089+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:46:28.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.090+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.090+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.090+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.090+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.090+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.090+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.090+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[ad4424e4-de7c-4376-b125-e717016a3484.4511.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.091+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:46:28.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.091+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.092+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:46:28.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.092+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:46:28.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.092+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:46:28.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.093+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:46:28.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.093+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:46:28.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.093+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94490908917600 notifier 5991 bl.length()=198 2024-09-12T00:46:28.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.094+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.13 from cache 2024-09-12T00:46:28.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.094+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.13, ofs0, ns] 2024-09-12T00:46:28.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.095+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464330 cookie 94490908913472 notifier 5991 bl.length()=256 2024-09-12T00:46:28.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.096+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.13 : miss 2024-09-12T00:46:28.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.096+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.097+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.097+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.13 info.flags=0x0 2024-09-12T00:46:28.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.097+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.13 to cache LRU end 2024-09-12T00:46:28.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.099+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.11 : miss 2024-09-12T00:46:28.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.099+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.099+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:46:28.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.099+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.11 info.flags=0x17 2024-09-12T00:46:28.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.099+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.11 to cache LRU end 2024-09-12T00:46:28.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.099+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.099+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.099+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.11 2024-09-12T00:46:28.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.100+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo[8nmo2jDsLHHPOCMXqkcrr5ilV8GZJI0] 2024-09-12T00:46:28.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.100+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.11.0 2024-09-12T00:46:28.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.100+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a9360 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55f061139c48 s->prefetch_data=0 2024-09-12T00:46:28.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.100+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to 090e9wa33wrrtr1zhuijcy5dp5pu26di 2024-09-12T00:46:28.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.100+0000 7f2bef946800 20 get_obj_state_impl: setting s->olh_tag to o0ldtwcwq2cxxxvdrpwv61izh8yby3er 2024-09-12T00:46:28.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.100+0000 7f2bef946800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o0ldtwcwq2cxxxvdrpwv61izh8yby3er 2024-09-12T00:46:28.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.102+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.11.0 2024-09-12T00:46:28.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.103+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.11.0 2024-09-12T00:46:28.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.103+0000 7f2bef946800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:46:28.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.103+0000 7f2bef946800 20 olh_log_entry: epoch=3 op=3 key=foo[8nmo2jDsLHHPOCMXqkcrr5ilV8GZJI0] 2024-09-12T00:46:28.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.104+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a9360 obj=test-client.0-r-test-multipart-index-versioning.1:_:8nmo2jDsLHHPOCMXqkcrr5ilV8GZJI0_foo state=0x55f061151838 s->prefetch_data=0 2024-09-12T00:46:28.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.104+0000 7f2bef946800 10 manifest: total_size = 18874368 2024-09-12T00:46:28.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.104+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.4666019008261958638 2024-09-12T00:46:28.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.104+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a9360 obj=test-client.0-r-test-multipart-index-versioning.1:_:8nmo2jDsLHHPOCMXqkcrr5ilV8GZJI0_foo state=0x55f061151838 s->prefetch_data=0 2024-09-12T00:46:28.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.104+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061151838 2024-09-12T00:46:28.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.104+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.11.0 2024-09-12T00:46:28.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:46:28.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:46:28.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=14675968 stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:46:28.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=18866176 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:46:28.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:46:28.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T00:46:28.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=19918848 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:46:28.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T00:46:28.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.4666019008261958638 2024-09-12T00:46:28.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.11__multipart_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.1 2024-09-12T00:46:28.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:46:28.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.11__shadow_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.1_1 2024-09-12T00:46:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 590 2024-09-12T00:46:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.11__multipart_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.2 2024-09-12T00:46:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 836 2024-09-12T00:46:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.11__shadow_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.2_1 2024-09-12T00:46:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1080 2024-09-12T00:46:28.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.11__multipart_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.3 2024-09-12T00:46:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1326 2024-09-12T00:46:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.11__shadow_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.3_1 2024-09-12T00:46:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1570 2024-09-12T00:46:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.11__multipart_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.4 2024-09-12T00:46:28.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1816 2024-09-12T00:46:28.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.106+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.4666019008261958638 2024-09-12T00:46:28.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.108+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo[8nmo2jDsLHHPOCMXqkcrr5ilV8GZJI0] 2024-09-12T00:46:28.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.109+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a9360 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55f061139c48 s->prefetch_data=0 2024-09-12T00:46:28.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.117+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.11.0 2024-09-12T00:46:28.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.118+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.11.0 2024-09-12T00:46:28.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.118+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.118+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.119+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.119+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.119+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.119+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.119+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[ad4424e4-de7c-4376-b125-e717016a3484.4511.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.120+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:46:28.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.120+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.121+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:46:28.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.121+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:46:28.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.121+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:46:28.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.122+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:46:28.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.122+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:46:28.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.122+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94490908917600 notifier 5991 bl.length()=193 2024-09-12T00:46:28.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.123+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.11 from cache 2024-09-12T00:46:28.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.123+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.11, ofs0, ns] 2024-09-12T00:46:28.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.124+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 94490908933664 notifier 5991 bl.length()=251 2024-09-12T00:46:28.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.125+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.11 : miss 2024-09-12T00:46:28.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.125+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.125+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.125+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.11 info.flags=0x0 2024-09-12T00:46:28.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.125+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.11 to cache LRU end 2024-09-12T00:46:28.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.128+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.10 : miss 2024-09-12T00:46:28.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.128+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.129+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T00:46:28.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.129+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.10 info.flags=0x17 2024-09-12T00:46:28.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.129+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.10 to cache LRU end 2024-09-12T00:46:28.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.129+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.129+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.129+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.10 2024-09-12T00:46:28.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.129+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:46:28.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.129+0000 7f2bef946800 20 get_obj_state: octx=0x55f061135e60 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.130+0000 7f2bef946800 10 manifest: total_size = 886297 2024-09-12T00:46:28.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.130+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.14203095611337332989 2024-09-12T00:46:28.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.130+0000 7f2bef946800 20 get_obj_state: octx=0x55f061135e60 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.130+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.130+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.10.0 2024-09-12T00:46:28.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:46:28.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-12T00:46:28.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:46:28.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:46:28.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-12T00:46:28.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:46:28.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:46:28.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2024-09-12T00:46:28.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:46:28.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.14203095611337332989 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.10__multipart_foo.2~1D-KYGVPcXFtT9NP_4Oi7aexhE_McKs.1 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.10__multipart_foo.2~1D-KYGVPcXFtT9NP_4Oi7aexhE_McKs.2 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.10__multipart_foo.2~1D-KYGVPcXFtT9NP_4Oi7aexhE_McKs.3 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.10__multipart_foo.2~1D-KYGVPcXFtT9NP_4Oi7aexhE_McKs.4 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:46:28.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.132+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.14203095611337332989 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.133+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.134+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.134+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.134+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.134+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.134+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.134+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.134+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[ad4424e4-de7c-4376-b125-e717016a3484.4511.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.135+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.135+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.136+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T00:46:28.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.136+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:46:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.136+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:46:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.137+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:46:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.137+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:46:28.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.137+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464331 cookie 94490908921680 notifier 5991 bl.length()=183 2024-09-12T00:46:28.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.138+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.10 from cache 2024-09-12T00:46:28.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.138+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.10, ofs0, ns] 2024-09-12T00:46:28.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.139+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94490908925664 notifier 5991 bl.length()=241 2024-09-12T00:46:28.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.140+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.10 : miss 2024-09-12T00:46:28.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.140+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.140+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.140+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.10 info.flags=0x0 2024-09-12T00:46:28.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.140+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.10 to cache LRU end 2024-09-12T00:46:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.142+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.16 : miss 2024-09-12T00:46:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.142+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:46:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.16 info.flags=0x17 2024-09-12T00:46:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.16 to cache LRU end 2024-09-12T00:46:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.16 2024-09-12T00:46:28.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:46:28.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.143+0000 7f2bef946800 20 get_obj_state: octx=0x55f061108f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.144+0000 7f2bef946800 10 manifest: total_size = 5242880 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.144+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.6992183830369905437 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.144+0000 7f2bef946800 20 get_obj_state: octx=0x55f061108f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.144+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.144+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.6992183830369905437 2024-09-12T00:46:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.0XMrGLJIreGrReSSSMu3P07fFpLScJy_0 2024-09-12T00:46:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:46:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.0XMrGLJIreGrReSSSMu3P07fFpLScJy_1 2024-09-12T00:46:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:46:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.146+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.6992183830369905437 2024-09-12T00:46:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.148+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:46:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.148+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd805c3a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55f061142698 s->prefetch_data=0 2024-09-12T00:46:28.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.148+0000 7f2bef946800 10 manifest: total_size = 5242880 2024-09-12T00:46:28.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.148+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.2649774012608343008 2024-09-12T00:46:28.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.148+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd805c3a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55f061142698 s->prefetch_data=0 2024-09-12T00:46:28.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.148+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142698 2024-09-12T00:46:28.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.148+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.2649774012608343008 2024-09-12T00:46:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.0XMrGLJIreGrReSSSMu3P07fFpLScJy_0 2024-09-12T00:46:28.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:46:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.0XMrGLJIreGrReSSSMu3P07fFpLScJy_1 2024-09-12T00:46:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:46:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.150+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.2649774012608343008 2024-09-12T00:46:28.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.152+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:46:28.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.152+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55f061138268 s->prefetch_data=0 2024-09-12T00:46:28.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.152+0000 7f2bef946800 10 manifest: total_size = 5242880 2024-09-12T00:46:28.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.152+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _dQO7R3gZAvtgzuCqh0j9RTZYNaV1x49 2024-09-12T00:46:28.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.152+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55f061138268 s->prefetch_data=0 2024-09-12T00:46:28.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.152+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061138268 2024-09-12T00:46:28.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.152+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _dQO7R3gZAvtgzuCqh0j9RTZYNaV1x49 2024-09-12T00:46:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.KHeHYalt5Ex4giWQqBNHsCV0TKSHnJx_0 2024-09-12T00:46:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:46:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.KHeHYalt5Ex4giWQqBNHsCV0TKSHnJx_1 2024-09-12T00:46:28.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:46:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.154+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _dQO7R3gZAvtgzuCqh0j9RTZYNaV1x49 2024-09-12T00:46:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.155+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:46:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.156+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.156+0000 7f2bef946800 10 manifest: total_size = 5242880 2024-09-12T00:46:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.156+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _agU-s2eqdaNkneBMntZk7KWV6zCqqQ0 2024-09-12T00:46:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.156+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.156+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142628 2024-09-12T00:46:28.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.156+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _agU-s2eqdaNkneBMntZk7KWV6zCqqQ0 2024-09-12T00:46:28.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.13cBF--n_VlHHrD3gSYVQ6Z0TcHf8nJ_0 2024-09-12T00:46:28.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:46:28.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.13cBF--n_VlHHrD3gSYVQ6Z0TcHf8nJ_1 2024-09-12T00:46:28.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:46:28.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.158+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _agU-s2eqdaNkneBMntZk7KWV6zCqqQ0 2024-09-12T00:46:28.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.159+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:46:28.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.159+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a6d20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.160+0000 7f2bef946800 10 manifest: total_size = 5242880 2024-09-12T00:46:28.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.160+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.13108915940228347323 2024-09-12T00:46:28.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.160+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a6d20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.160+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142628 2024-09-12T00:46:28.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.160+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.13108915940228347323 2024-09-12T00:46:28.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.MG8nPlonksgcChJv_OYjBh4RwMnHcsi_0 2024-09-12T00:46:28.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:46:28.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.MG8nPlonksgcChJv_OYjBh4RwMnHcsi_1 2024-09-12T00:46:28.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:46:28.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.162+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.13108915940228347323 2024-09-12T00:46:28.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.164+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.164+0000 7f2bef946800 10 manifest: total_size = 5242880 2024-09-12T00:46:28.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.164+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _z2x-JIMPlBjbD7bQk815koWE4toAYvR 2024-09-12T00:46:28.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.164+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.164+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142628 2024-09-12T00:46:28.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.164+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.164+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:46:28.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _z2x-JIMPlBjbD7bQk815koWE4toAYvR 2024-09-12T00:46:28.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.K00DB6pwufwgoXvTw-e5LvRzc7vtuMQ_0 2024-09-12T00:46:28.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:46:28.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.K00DB6pwufwgoXvTw-e5LvRzc7vtuMQ_1 2024-09-12T00:46:28.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:46:28.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.166+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _z2x-JIMPlBjbD7bQk815koWE4toAYvR 2024-09-12T00:46:28.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.167+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.168+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a6d20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.168+0000 7f2bef946800 10 manifest: total_size = 5242880 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.168+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.1799723717736693119 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.168+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a6d20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.168+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142628 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.168+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1799723717736693119 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.MG8nPlonksgcChJv_OYjBh4RwMnHcsi_0 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:46:28.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.MG8nPlonksgcChJv_OYjBh4RwMnHcsi_1 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.170+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1799723717736693119 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.171+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.172+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.172+0000 7f2bef946800 10 manifest: total_size = 5242880 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.172+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _SVtne8XA56qrssd_dmnqhP-PO2PEQWc 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.172+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.172+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142628 2024-09-12T00:46:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.172+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _SVtne8XA56qrssd_dmnqhP-PO2PEQWc 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.cYB1QapYKZjETBXz1VPKaqR8Y9TFSpx_0 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.cYB1QapYKZjETBXz1VPKaqR8Y9TFSpx_1 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.174+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _SVtne8XA56qrssd_dmnqhP-PO2PEQWc 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.175+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.175+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.176+0000 7f2bef946800 10 manifest: total_size = 27200 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.176+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.17241298126303196040 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.176+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.176+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142628 2024-09-12T00:46:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.176+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.178+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.178+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=27200 stripe_ofs=27200 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.178+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17241298126303196040 2024-09-12T00:46:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.178+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.178+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.4lmMqj0DXIIWMjfhSBPWGHGKdqEZZrf_0 2024-09-12T00:46:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.178+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:46:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.178+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.178+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17241298126303196040 2024-09-12T00:46:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.179+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:46:28.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.180+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a6d20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.180+0000 7f2bef946800 10 manifest: total_size = 27200 2024-09-12T00:46:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.180+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _t7X0NxWL0-bvbm7HqkIWTFmtEvvnuFi 2024-09-12T00:46:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.180+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00a6d20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.180+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142628 2024-09-12T00:46:28.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.180+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.184+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.184+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=27200 stripe_ofs=27200 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.184+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _t7X0NxWL0-bvbm7HqkIWTFmtEvvnuFi 2024-09-12T00:46:28.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.184+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.184+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.w5YuhtnJ5hpL71RMewI1a3sqwFqsCla_0 2024-09-12T00:46:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.184+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:46:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.184+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.184+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _t7X0NxWL0-bvbm7HqkIWTFmtEvvnuFi 2024-09-12T00:46:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.187+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:46:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.187+0000 7f2bef946800 20 get_obj_state: octx=0x55f0611b4920 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.188+0000 7f2bef946800 10 manifest: total_size = 27200 2024-09-12T00:46:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.188+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _to-wl91l2MBF7RQ8lHwFQp6aeDzHrOf 2024-09-12T00:46:28.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.188+0000 7f2bef946800 20 get_obj_state: octx=0x55f0611b4920 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.188+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142628 2024-09-12T00:46:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.188+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.190+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.190+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=27200 stripe_ofs=27200 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.190+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _to-wl91l2MBF7RQ8lHwFQp6aeDzHrOf 2024-09-12T00:46:28.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.190+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.190+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.68Y30TEfBlzfJZOwpCgUJjz9LTJ49___0 2024-09-12T00:46:28.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.190+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:46:28.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.190+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.190+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _to-wl91l2MBF7RQ8lHwFQp6aeDzHrOf 2024-09-12T00:46:28.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.191+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:46:28.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.191+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.192+0000 7f2bef946800 10 manifest: total_size = 27200 2024-09-12T00:46:28.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.192+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.11828576584538917956 2024-09-12T00:46:28.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.192+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be007f580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55f061142628 s->prefetch_data=0 2024-09-12T00:46:28.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.192+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061142628 2024-09-12T00:46:28.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.192+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.16.0 2024-09-12T00:46:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.194+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.194+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=27200 stripe_ofs=27200 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.194+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.11828576584538917956 2024-09-12T00:46:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.194+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.194+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.4lmMqj0DXIIWMjfhSBPWGHGKdqEZZrf_0 2024-09-12T00:46:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.194+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:46:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.194+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.194+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.11828576584538917956 2024-09-12T00:46:28.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.195+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:46:28.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.196+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.196+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.196+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.196+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.196+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.196+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.196+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[ad4424e4-de7c-4376-b125-e717016a3484.4511.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.198+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:46:28.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.198+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.198+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:46:28.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.198+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:46:28.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.198+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:46:28.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.199+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:46:28.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.199+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:46:28.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.199+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 94490908917600 notifier 5991 bl.length()=189 2024-09-12T00:46:28.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.201+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.16 from cache 2024-09-12T00:46:28.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.201+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.16, ofs0, ns] 2024-09-12T00:46:28.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.201+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94490908933664 notifier 5991 bl.length()=247 2024-09-12T00:46:28.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.202+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.16 : miss 2024-09-12T00:46:28.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.202+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.202+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.202+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.16 info.flags=0x0 2024-09-12T00:46:28.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.202+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.16 to cache LRU end 2024-09-12T00:46:28.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.205+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.17 : miss 2024-09-12T00:46:28.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.205+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.205+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:46:28.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.205+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.17 info.flags=0x17 2024-09-12T00:46:28.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.205+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.17 to cache LRU end 2024-09-12T00:46:28.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.205+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.17 2024-09-12T00:46:28.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:46:28.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:46:28.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113de60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.4038075457448231455 2024-09-12T00:46:28.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113de60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.206+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.4038075457448231455 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.1 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.1_1 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.2 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.2_1 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.3 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.209+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.4038075457448231455 2024-09-12T00:46:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.211+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:46:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.211+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd8098050 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.211+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.211+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.17258382422275565967 2024-09-12T00:46:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.211+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd8098050 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.211+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.211+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17258382422275565967 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.1 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.1_1 2024-09-12T00:46:28.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T00:46:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.2 2024-09-12T00:46:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T00:46:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.2_1 2024-09-12T00:46:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T00:46:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.3 2024-09-12T00:46:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T00:46:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.213+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17258382422275565967 2024-09-12T00:46:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.215+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:46:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.215+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd804b2b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.215+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.215+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _x_uRNfNdxV3Zg8pELVDqWDgjBT9zg5m 2024-09-12T00:46:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.215+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd804b2b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.215+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.215+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _x_uRNfNdxV3Zg8pELVDqWDgjBT9zg5m 2024-09-12T00:46:28.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.wuUG0FgwE90cigINEBKB1n8kU9t9wqa_0 2024-09-12T00:46:28.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:46:28.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.wuUG0FgwE90cigINEBKB1n8kU9t9wqa_1 2024-09-12T00:46:28.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:46:28.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.wuUG0FgwE90cigINEBKB1n8kU9t9wqa_2 2024-09-12T00:46:28.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T00:46:28.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.217+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _x_uRNfNdxV3Zg8pELVDqWDgjBT9zg5m 2024-09-12T00:46:28.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.219+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:46:28.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.219+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd804b2b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.219+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.219+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _H1ISm8UgJLE391gllwpGfH1nLnF_Gma 2024-09-12T00:46:28.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.219+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd804b2b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.219+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.219+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _H1ISm8UgJLE391gllwpGfH1nLnF_Gma 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.uS-4XW0V5k07hEHWje1nYRbj8GmaBiK_0 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.uS-4XW0V5k07hEHWje1nYRbj8GmaBiK_1 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.uS-4XW0V5k07hEHWje1nYRbj8GmaBiK_2 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.222+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _H1ISm8UgJLE391gllwpGfH1nLnF_Gma 2024-09-12T00:46:28.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.223+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:46:28.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.223+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd8098050 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.223+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.223+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.12415201487894214794 2024-09-12T00:46:28.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.223+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd8098050 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.223+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.223+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.12415201487894214794 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.1 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.1_1 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.2 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.2_1 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.3 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.225+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.12415201487894214794 2024-09-12T00:46:28.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.227+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:46:28.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.227+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113ec40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.227+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.227+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _-_3BqJLM8u5gGTzg5HTVoNRiSL1jCfR 2024-09-12T00:46:28.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.227+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113ec40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.227+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.227+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _-_3BqJLM8u5gGTzg5HTVoNRiSL1jCfR 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.UZuEkjKtPDAV0SygaX3fAC_qwr3SbLy_0 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.UZuEkjKtPDAV0SygaX3fAC_qwr3SbLy_1 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.UZuEkjKtPDAV0SygaX3fAC_qwr3SbLy_2 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.230+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _-_3BqJLM8u5gGTzg5HTVoNRiSL1jCfR 2024-09-12T00:46:28.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.231+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:46:28.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.231+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113ec40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.231+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.231+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.17571563513785573170 2024-09-12T00:46:28.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.231+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113ec40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.231+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.232+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17571563513785573170 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.1 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.1_1 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.2 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.2_1 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.3 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:46:28.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.234+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17571563513785573170 2024-09-12T00:46:28.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.235+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:46:28.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.235+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00b6f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.236+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.236+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _lFLFjrCUD8atOFN1gcHIDhonmYlXFFZ 2024-09-12T00:46:28.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.236+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00b6f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.236+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.236+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _lFLFjrCUD8atOFN1gcHIDhonmYlXFFZ 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.sm6n_sxmF2l1A78yNtIJY4xarlo_vMF_0 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.sm6n_sxmF2l1A78yNtIJY4xarlo_vMF_1 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.sm6n_sxmF2l1A78yNtIJY4xarlo_vMF_2 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.238+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _lFLFjrCUD8atOFN1gcHIDhonmYlXFFZ 2024-09-12T00:46:28.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.239+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:46:28.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.239+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00b6f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.240+0000 7f2bef946800 10 manifest: total_size = 1087 2024-09-12T00:46:28.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.240+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.18201264319122564769 2024-09-12T00:46:28.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.240+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be00b6f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.240+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.240+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=55 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.18201264319122564769 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.1 2024-09-12T00:46:28.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:46:28.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.2 2024-09-12T00:46:28.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:46:28.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.3 2024-09-12T00:46:28.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:46:28.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.242+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.18201264319122564769 2024-09-12T00:46:28.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.243+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:46:28.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.243+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd804b2b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.244+0000 7f2bef946800 10 manifest: total_size = 1087 2024-09-12T00:46:28.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.244+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _rvah2xjnxB6Q5xBt0EGG_9OFRvdp1ws 2024-09-12T00:46:28.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.244+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd804b2b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.244+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.244+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.246+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.246+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.246+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _rvah2xjnxB6Q5xBt0EGG_9OFRvdp1ws 2024-09-12T00:46:28.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.246+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.246+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.14BVmJVmJbIZgTc6g639d8n-4rdwoCV_0 2024-09-12T00:46:28.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.246+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:46:28.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.246+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.246+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _rvah2xjnxB6Q5xBt0EGG_9OFRvdp1ws 2024-09-12T00:46:28.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.247+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:46:28.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.247+0000 7f2bef946800 20 get_obj_state: octx=0x55f061139530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.248+0000 7f2bef946800 10 manifest: total_size = 1087 2024-09-12T00:46:28.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.248+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to _sVl0s79uTCBcX8qiq291heqfd2rqMdi 2024-09-12T00:46:28.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.248+0000 7f2bef946800 20 get_obj_state: octx=0x55f061139530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.248+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.248+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.250+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.250+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.250+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: _sVl0s79uTCBcX8qiq291heqfd2rqMdi 2024-09-12T00:46:28.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.250+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.250+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.brkxwjATlQcSRpUcw5nxVwFAiRmyjlu_0 2024-09-12T00:46:28.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.250+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:46:28.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.250+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.250+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _sVl0s79uTCBcX8qiq291heqfd2rqMdi 2024-09-12T00:46:28.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.251+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:46:28.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.251+0000 7f2bef946800 20 get_obj_state: octx=0x55f061139530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.252+0000 7f2bef946800 10 manifest: total_size = 1087 2024-09-12T00:46:28.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.252+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.4550461025323712225 2024-09-12T00:46:28.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.252+0000 7f2bef946800 20 get_obj_state: octx=0x55f061139530 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55f06113ce18 s->prefetch_data=0 2024-09-12T00:46:28.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.252+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06113ce18 2024-09-12T00:46:28.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.252+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.17.0 2024-09-12T00:46:28.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=55 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.4550461025323712225 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.1 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.2 2024-09-12T00:46:28.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:46:28.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.3 2024-09-12T00:46:28.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:46:28.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.254+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.4550461025323712225 2024-09-12T00:46:28.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.255+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:46:28.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.255+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.255+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.255+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.255+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.255+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.255+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.255+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[ad4424e4-de7c-4376-b125-e717016a3484.4511.17])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.257+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:46:28.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.257+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.257+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:46:28.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.257+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:46:28.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.257+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:46:28.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.258+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:46:28.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.258+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:46:28.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.258+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464267 cookie 94490908919936 notifier 5991 bl.length()=199 2024-09-12T00:46:28.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.260+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.17 from cache 2024-09-12T00:46:28.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.260+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.17, ofs0, ns] 2024-09-12T00:46:28.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.260+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94490908917600 notifier 5991 bl.length()=257 2024-09-12T00:46:28.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.262+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.17 : miss 2024-09-12T00:46:28.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.262+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.262+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.262+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.17 info.flags=0x0 2024-09-12T00:46:28.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.262+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.17 to cache LRU end 2024-09-12T00:46:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.264+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.15 : miss 2024-09-12T00:46:28.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.264+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.264+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:46:28.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.264+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.15 info.flags=0x17 2024-09-12T00:46:28.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.264+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.15 to cache LRU end 2024-09-12T00:46:28.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.264+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.264+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.264+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.15 2024-09-12T00:46:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.265+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:46:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.265+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:46:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.265+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:46:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.265+0000 7f2bef946800 20 get_obj_state: octx=0x55f0611576d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.265+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.265+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.2007950747603464997 2024-09-12T00:46:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.265+0000 7f2bef946800 20 get_obj_state: octx=0x55f0611576d0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.265+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.265+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.15.0 2024-09-12T00:46:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.2007950747603464997 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.1 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__shadow_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.1_1 2024-09-12T00:46:28.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:46:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.2 2024-09-12T00:46:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:46:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__shadow_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.2_1 2024-09-12T00:46:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:46:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.3 2024-09-12T00:46:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:46:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.267+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.2007950747603464997 2024-09-12T00:46:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.268+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:46:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.269+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd804b2b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.269+0000 7f2bef946800 10 manifest: total_size = 11534336 2024-09-12T00:46:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.269+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.223688285799172176 2024-09-12T00:46:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.269+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd804b2b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.269+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.269+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.15.0 2024-09-12T00:46:28.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.271+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.271+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.271+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.223688285799172176 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.1 2024-09-12T00:46:28.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__shadow_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.1_1 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 643 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.2 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 916 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__shadow_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.2_1 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1187 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.3 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1460 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.272+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.223688285799172176 2024-09-12T00:46:28.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.273+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:46:28.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.273+0000 7f2bef946800 20 get_obj_state: octx=0x55f06115a2c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55f0611525c8 s->prefetch_data=0 2024-09-12T00:46:28.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.273+0000 7f2bef946800 10 manifest: total_size = 16378 2024-09-12T00:46:28.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.273+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.12940570078999178984 2024-09-12T00:46:28.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.273+0000 7f2bef946800 20 get_obj_state: octx=0x55f06115a2c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55f0611525c8 s->prefetch_data=0 2024-09-12T00:46:28.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.273+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f0611525c8 2024-09-12T00:46:28.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.273+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.15.0 2024-09-12T00:46:28.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T00:46:28.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7671 2024-09-12T00:46:28.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-09-12T00:46:28.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T00:46:28.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4197879 part_ofs=7671 rule->part_size=7672 2024-09-12T00:46:28.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2024-09-12T00:46:28.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 RGWObjManifest::operator++(): stripe_ofs=4205551 part_ofs=15343 rule->part_size=1035 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.12940570078999178984 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-STANDARD.2~X5JPoFSufFOdMVt_ezbmzNxcIPH7CsN.1 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-STANDARD.2~X5JPoFSufFOdMVt_ezbmzNxcIPH7CsN.2 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-STANDARD.2~X5JPoFSufFOdMVt_ezbmzNxcIPH7CsN.3 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.275+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.12940570078999178984 2024-09-12T00:46:28.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.277+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:46:28.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.277+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.277+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.277+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.277+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.277+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.277+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.277+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[ad4424e4-de7c-4376-b125-e717016a3484.4511.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.279+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:46:28.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.279+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.279+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:46:28.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.279+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:46:28.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.279+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:46:28.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.280+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:46:28.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.280+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:46:28.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.281+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94490908925664 notifier 5991 bl.length()=194 2024-09-12T00:46:28.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.282+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.15 from cache 2024-09-12T00:46:28.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.282+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.15, ofs0, ns] 2024-09-12T00:46:28.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.282+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94490908917600 notifier 5991 bl.length()=252 2024-09-12T00:46:28.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.284+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.15 : miss 2024-09-12T00:46:28.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.284+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.284+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.284+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.15 info.flags=0x0 2024-09-12T00:46:28.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.284+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.15 to cache LRU end 2024-09-12T00:46:28.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.286+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.14 : miss 2024-09-12T00:46:28.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.286+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:46:28.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.14 info.flags=0x17 2024-09-12T00:46:28.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.14 to cache LRU end 2024-09-12T00:46:28.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.14 2024-09-12T00:46:28.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:46:28.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:46:28.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:46:28.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 20 get_obj_state: octx=0x55f061151dd0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55f061138268 s->prefetch_data=0 2024-09-12T00:46:28.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 10 manifest: total_size = 10485760 2024-09-12T00:46:28.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.727932486181784996 2024-09-12T00:46:28.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 20 get_obj_state: octx=0x55f061151dd0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55f061138268 s->prefetch_data=0 2024-09-12T00:46:28.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061138268 2024-09-12T00:46:28.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.287+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.14.0 2024-09-12T00:46:28.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.727932486181784996 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.BouH6xau7WCeB64kiW2KyLkgyK8lTdz_0 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 336 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.BouH6xau7WCeB64kiW2KyLkgyK8lTdz_1 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 573 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.BouH6xau7WCeB64kiW2KyLkgyK8lTdz_2 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 810 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.290+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.727932486181784996 2024-09-12T00:46:28.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.291+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:46:28.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.291+0000 7f2bef946800 20 get_obj_state: octx=0x55f061151dd0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55f061138268 s->prefetch_data=0 2024-09-12T00:46:28.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.292+0000 7f2bef946800 10 manifest: total_size = 10485760 2024-09-12T00:46:28.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.292+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.16154578081488253045 2024-09-12T00:46:28.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.292+0000 7f2bef946800 20 get_obj_state: octx=0x55f061151dd0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55f061138268 s->prefetch_data=0 2024-09-12T00:46:28.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.292+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061138268 2024-09-12T00:46:28.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.292+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.14.0 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.16154578081488253045 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.CXdZOnJ3Y-rVUve3y3p_wTpmWbbfOt4_0 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:46:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.CXdZOnJ3Y-rVUve3y3p_wTpmWbbfOt4_1 2024-09-12T00:46:28.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:46:28.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.CXdZOnJ3Y-rVUve3y3p_wTpmWbbfOt4_2 2024-09-12T00:46:28.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-09-12T00:46:28.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.295+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.16154578081488253045 2024-09-12T00:46:28.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.296+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:46:28.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.297+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd805c3a0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.297+0000 7f2bef946800 10 manifest: total_size = 53503 2024-09-12T00:46:28.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.297+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.13237157112382762071 2024-09-12T00:46:28.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.297+0000 7f2bef946800 20 get_obj_state: octx=0x7f2bd805c3a0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.297+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.297+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.14.0 2024-09-12T00:46:28.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.301+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.301+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=53503 stripe_ofs=53503 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.301+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.13237157112382762071 2024-09-12T00:46:28.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.301+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.301+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.fJ_sJNYhy6FJMMfERRQilMsh4aVQyMk_0 2024-09-12T00:46:28.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.301+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:46:28.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.301+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.301+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.13237157112382762071 2024-09-12T00:46:28.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.302+0000 7f2abffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:46:28.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.302+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.302+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.302+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.302+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.302+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.302+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.302+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[ad4424e4-de7c-4376-b125-e717016a3484.4511.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.304+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:46:28.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.304+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.304+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:46:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.304+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:46:28.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.305+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:46:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.306+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:46:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.306+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:46:28.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.306+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 94490908917600 notifier 5991 bl.length()=184 2024-09-12T00:46:28.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.308+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.14 from cache 2024-09-12T00:46:28.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.308+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.14, ofs0, ns] 2024-09-12T00:46:28.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.308+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94490908913472 notifier 5991 bl.length()=242 2024-09-12T00:46:28.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.310+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.14 : miss 2024-09-12T00:46:28.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.310+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.310+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.310+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.14 info.flags=0x0 2024-09-12T00:46:28.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.310+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.14 to cache LRU end 2024-09-12T00:46:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.312+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.7 : miss 2024-09-12T00:46:28.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.312+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.312+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:46:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.312+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.7 info.flags=0x17 2024-09-12T00:46:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.312+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.7 to cache LRU end 2024-09-12T00:46:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.312+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.312+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.312+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.7 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113dda0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 10 manifest: total_size = 0 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.2276953633739203933 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113dda0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.313+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.7.0 2024-09-12T00:46:28.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.316+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113dda0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55f0611592a8 s->prefetch_data=0 2024-09-12T00:46:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.316+0000 7f2bef946800 10 manifest: total_size = 0 2024-09-12T00:46:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.316+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.3567864459844248686 2024-09-12T00:46:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.316+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113dda0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55f0611592a8 s->prefetch_data=0 2024-09-12T00:46:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.316+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f0611592a8 2024-09-12T00:46:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.316+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.7.0 2024-09-12T00:46:28.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.317+0000 7f2abffff640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:46:28.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.319+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113dda0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55f0611592a8 s->prefetch_data=0 2024-09-12T00:46:28.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.319+0000 7f2bef946800 10 manifest: total_size = 0 2024-09-12T00:46:28.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.319+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.1702786724112588845 2024-09-12T00:46:28.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.319+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113dda0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55f0611592a8 s->prefetch_data=0 2024-09-12T00:46:28.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.319+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f0611592a8 2024-09-12T00:46:28.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.319+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.7.0 2024-09-12T00:46:28.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.320+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:46:28.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.321+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113dda0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55f0611592a8 s->prefetch_data=0 2024-09-12T00:46:28.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.322+0000 7f2bef946800 10 manifest: total_size = 0 2024-09-12T00:46:28.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.322+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.1091473371710426122 2024-09-12T00:46:28.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.322+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113dda0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55f0611592a8 s->prefetch_data=0 2024-09-12T00:46:28.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.322+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f0611592a8 2024-09-12T00:46:28.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.322+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.7.0 2024-09-12T00:46:28.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.323+0000 7f2abffff640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:46:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.324+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.324+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.325+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:46:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.326+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.326+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.326+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.326+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.326+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[ad4424e4-de7c-4376-b125-e717016a3484.4511.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.327+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:46:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.327+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.328+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:46:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.328+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:46:28.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.328+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:46:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.329+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:46:28.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.329+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:46:28.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.329+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 94490908913472 notifier 5991 bl.length()=181 2024-09-12T00:46:28.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.331+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.7 from cache 2024-09-12T00:46:28.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.331+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:ad4424e4-de7c-4376-b125-e717016a3484.4511.7, ofs0, ns] 2024-09-12T00:46:28.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.331+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 94490908913472 notifier 5991 bl.length()=238 2024-09-12T00:46:28.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.332+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.7 : miss 2024-09-12T00:46:28.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.332+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.333+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.333+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.7 info.flags=0x0 2024-09-12T00:46:28.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.333+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ad4424e4-de7c-4376-b125-e717016a3484.4511.7 to cache LRU end 2024-09-12T00:46:28.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.335+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ad4424e4-de7c-4376-b125-e717016a3484.4511.8 : miss 2024-09-12T00:46:28.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.335+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.335+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:46:28.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.335+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ad4424e4-de7c-4376-b125-e717016a3484.4511.8 info.flags=0x17 2024-09-12T00:46:28.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.335+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ad4424e4-de7c-4376-b125-e717016a3484.4511.8 to cache LRU end 2024-09-12T00:46:28.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.335+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.335+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.335+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ad4424e4-de7c-4376-b125-e717016a3484.4511.8 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113c540 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55f061150828 s->prefetch_data=0 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 10 manifest: total_size = 24595 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.1519820486523448212 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113c540 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55f061150828 s->prefetch_data=0 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061150828 2024-09-12T00:46:28.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.336+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.8.0 2024-09-12T00:46:28.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.338+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.338+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.338+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1519820486523448212 2024-09-12T00:46:28.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.338+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.338+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.8__shadow_.oVrljPRVIZ-eNSGciSBrXX5ce4XL7kU_0 2024-09-12T00:46:28.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.338+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:46:28.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.338+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.338+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.1519820486523448212 2024-09-12T00:46:28.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.340+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:46:28.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.340+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113c540 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55f061150828 s->prefetch_data=0 2024-09-12T00:46:28.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.340+0000 7f2bef946800 10 manifest: total_size = 524288 2024-09-12T00:46:28.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.340+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.17199939327028829567 2024-09-12T00:46:28.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.340+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113c540 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55f061150828 s->prefetch_data=0 2024-09-12T00:46:28.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.340+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061150828 2024-09-12T00:46:28.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.340+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.8.0 2024-09-12T00:46:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.342+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.342+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.342+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17199939327028829567 2024-09-12T00:46:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.342+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.342+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.8__shadow_.aJ5YlO5PkQjkkfXn3_9l_NoXI6KNQMY_0 2024-09-12T00:46:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.342+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.342+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.342+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17199939327028829567 2024-09-12T00:46:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.344+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113c540 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55f061150828 s->prefetch_data=0 2024-09-12T00:46:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.344+0000 7f2abffff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:46:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.344+0000 7f2bef946800 10 manifest: total_size = 527 2024-09-12T00:46:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.344+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.16736400965522795434 2024-09-12T00:46:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.344+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113c540 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55f061150828 s->prefetch_data=0 2024-09-12T00:46:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.344+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061150828 2024-09-12T00:46:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.344+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.8.0 2024-09-12T00:46:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.346+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.346+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.346+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.16736400965522795434 2024-09-12T00:46:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.346+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.346+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.8__shadow_.Vmye5YvBmTZ0JFaTCHYLEw9oZ0TKlW__0 2024-09-12T00:46:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.346+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.346+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.346+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.16736400965522795434 2024-09-12T00:46:28.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.348+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:46:28.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.348+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113c540 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55f061150828 s->prefetch_data=0 2024-09-12T00:46:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.348+0000 7f2bef946800 10 manifest: total_size = 527 2024-09-12T00:46:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.348+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.18116676333579152495 2024-09-12T00:46:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.348+0000 7f2bef946800 20 get_obj_state: octx=0x55f06113c540 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55f061150828 s->prefetch_data=0 2024-09-12T00:46:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.348+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f061150828 2024-09-12T00:46:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.348+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.8.0 2024-09-12T00:46:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.350+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.350+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.350+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.18116676333579152495 2024-09-12T00:46:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.350+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.350+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.8__shadow_.64LxyjhDrxrrBj8zuSVT8_y7W1HvnDr_0 2024-09-12T00:46:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.350+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.350+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.350+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.18116676333579152495 2024-09-12T00:46:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.351+0000 7f2abffff640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:46:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.352+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.352+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.352+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.352+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.352+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.352+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.352+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[ad4424e4-de7c-4376-b125-e717016a3484.4511.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.354+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:46:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.354+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.354+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:46:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.354+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:46:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.354+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:46:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.355+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:46:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.355+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:46:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.355+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 94490908913472 notifier 5991 bl.length()=181 2024-09-12T00:46:28.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.357+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ad4424e4-de7c-4376-b125-e717016a3484.4511.8 from cache 2024-09-12T00:46:28.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.357+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:ad4424e4-de7c-4376-b125-e717016a3484.4511.8, ofs0, ns] 2024-09-12T00:46:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.357+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 94490908913472 notifier 5991 bl.length()=238 2024-09-12T00:46:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.358+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ad4424e4-de7c-4376-b125-e717016a3484.4511.8 : miss 2024-09-12T00:46:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.358+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.359+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.359+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ad4424e4-de7c-4376-b125-e717016a3484.4511.8 info.flags=0x0 2024-09-12T00:46:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.359+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ad4424e4-de7c-4376-b125-e717016a3484.4511.8 to cache LRU end 2024-09-12T00:46:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.361+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ad4424e4-de7c-4376-b125-e717016a3484.4511.9 : miss 2024-09-12T00:46:28.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.361+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.361+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:46:28.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.361+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ad4424e4-de7c-4376-b125-e717016a3484.4511.9 info.flags=0x17 2024-09-12T00:46:28.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.361+0000 7f2bef946800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ad4424e4-de7c-4376-b125-e717016a3484.4511.9 to cache LRU end 2024-09-12T00:46:28.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.361+0000 7f2bef946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:28.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.361+0000 7f2bef946800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:46:28.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.361+0000 7f2bef946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ad4424e4-de7c-4376-b125-e717016a3484.4511.9 2024-09-12T00:46:28.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:46:28.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:46:28.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:46:28.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:46:28.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 20 get_obj_state: octx=0x55f061139550 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 10 manifest: total_size = 49187 2024-09-12T00:46:28.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.17958428436095683054 2024-09-12T00:46:28.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 20 get_obj_state: octx=0x55f061139550 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.362+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.9.0 2024-09-12T00:46:28.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.365+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.365+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.365+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17958428436095683054 2024-09-12T00:46:28.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.365+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.365+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.9__shadow_.4aRFOvLk3eSMC-dJSno1Y1ZRkr_tOUh_0 2024-09-12T00:46:28.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.365+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.365+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.365+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.17958428436095683054 2024-09-12T00:46:28.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.366+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:46:28.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.367+0000 7f2bef946800 20 get_obj_state: octx=0x55f061139550 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.367+0000 7f2bef946800 10 manifest: total_size = 4134 2024-09-12T00:46:28.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.367+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.5265732624081516485 2024-09-12T00:46:28.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.367+0000 7f2bef946800 20 get_obj_state: octx=0x55f061139550 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.367+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.367+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.9.0 2024-09-12T00:46:28.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.369+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.369+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.369+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.5265732624081516485 2024-09-12T00:46:28.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.369+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.369+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.9__shadow_.ve2SBGfjCWSfAEK8DaijUegnLNzWSXr_0 2024-09-12T00:46:28.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.369+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:46:28.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.369+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.369+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.5265732624081516485 2024-09-12T00:46:28.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.371+0000 7f2abffff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:46:28.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.371+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be804de90 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.371+0000 7f2bef946800 10 manifest: total_size = 49187 2024-09-12T00:46:28.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.371+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.10277254171200928865 2024-09-12T00:46:28.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.371+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be804de90 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.371+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.371+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.9.0 2024-09-12T00:46:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.374+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.374+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.374+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.10277254171200928865 2024-09-12T00:46:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.374+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.374+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.9__shadow_.ZaE-fejPTbttZEfY4j1COy_-bpoIBA4_0 2024-09-12T00:46:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.374+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.374+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.374+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.10277254171200928865 2024-09-12T00:46:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.375+0000 7f2ad0ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:46:28.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.376+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be804de90 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.376+0000 7f2bef946800 10 manifest: total_size = 55 2024-09-12T00:46:28.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.376+0000 7f2bef946800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.12928961352979677850 2024-09-12T00:46:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.376+0000 7f2bef946800 20 get_obj_state: octx=0x7f2be804de90 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55f06108bdb8 s->prefetch_data=0 2024-09-12T00:46:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.376+0000 7f2bef946800 20 prepare_atomic_modification: state is not atomic. state=0x55f06108bdb8 2024-09-12T00:46:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.376+0000 7f2bef946800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.9.0 2024-09-12T00:46:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.378+0000 7f2bef946800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:46:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.378+0000 7f2bef946800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T00:46:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.378+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.12928961352979677850 2024-09-12T00:46:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.378+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:46:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.378+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ad4424e4-de7c-4376-b125-e717016a3484.4511.9__shadow_.Pj1Vf2LT52pEbun5PX3dKeg-hrUnCEc_0 2024-09-12T00:46:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.378+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:46:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.378+0000 7f2bef946800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:46:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.378+0000 7f2bef946800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ad4424e4-de7c-4376-b125-e717016a3484.4511.12928961352979677850 2024-09-12T00:46:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.379+0000 7f2abffff640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:46:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.380+0000 7f2bef946800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:46:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.380+0000 7f2bef946800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:46:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.380+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:46:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.380+0000 7f2bef946800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:46:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.380+0000 7f2bef946800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:46:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.380+0000 7f2bef946800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:46:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.380+0000 7f2bef946800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[ad4424e4-de7c-4376-b125-e717016a3484.4511.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:46:28.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.382+0000 7f2bef946800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:46:28.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.382+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.382+0000 7f2bef946800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:46:28.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.382+0000 7f2bef946800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:46:28.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.382+0000 7f2bef946800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:46:28.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.384+0000 7f2bef946800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:46:28.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.384+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:46:28.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.384+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94490908913472 notifier 5991 bl.length()=181 2024-09-12T00:46:28.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.386+0000 7f2bef946800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ad4424e4-de7c-4376-b125-e717016a3484.4511.9 from cache 2024-09-12T00:46:28.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.386+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:ad4424e4-de7c-4376-b125-e717016a3484.4511.9, ofs0, ns] 2024-09-12T00:46:28.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.386+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94490908913472 notifier 5991 bl.length()=238 2024-09-12T00:46:28.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.387+0000 7f2bef946800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ad4424e4-de7c-4376-b125-e717016a3484.4511.9 : miss 2024-09-12T00:46:28.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.387+0000 7f2bef946800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.388+0000 7f2bef946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.388+0000 7f2bef946800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ad4424e4-de7c-4376-b125-e717016a3484.4511.9 info.flags=0x0 2024-09-12T00:46:28.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.388+0000 7f2bef946800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ad4424e4-de7c-4376-b125-e717016a3484.4511.9 to cache LRU end 2024-09-12T00:46:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.390+0000 7f2bef946800 10 removing key index: BMKKXWUPZDTZBDXKGNSD 2024-09-12T00:46:28.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.391+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:BMKKXWUPZDTZBDXKGNSD, ofs0, ns] 2024-09-12T00:46:28.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.391+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94490908921680 notifier 5991 bl.length()=170 2024-09-12T00:46:28.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.392+0000 7f2bef946800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:46:28.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.393+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:46:28.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.393+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94490908917600 notifier 5991 bl.length()=182 2024-09-12T00:46:28.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.393+0000 7f2bef946800 10 removing user buckets index 2024-09-12T00:46:28.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.394+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:46:28.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.395+0000 7f2abffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464340 cookie 94490908925664 notifier 5991 bl.length()=173 2024-09-12T00:46:28.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.395+0000 7f2bef946800 10 removing user index: ragweed.client.0 2024-09-12T00:46:28.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.396+0000 7f2bef946800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:46:28.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.396+0000 7f2bef946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:46:28.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.396+0000 7f2ad0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464340 cookie 94490908921680 notifier 5991 bl.length()=165 2024-09-12T00:46:28.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.397+0000 7f2aa3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.399+0000 7f2bef946800 20 remove_watcher() i=0 2024-09-12T00:46:28.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.399+0000 7f2bef946800 2 removed watcher, disabling cache 2024-09-12T00:46:28.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.401+0000 7f2bef946800 20 remove_watcher() i=1 2024-09-12T00:46:28.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.402+0000 7f2bef946800 20 remove_watcher() i=2 2024-09-12T00:46:28.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.403+0000 7f2bef946800 20 remove_watcher() i=3 2024-09-12T00:46:28.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.404+0000 7f2bef946800 20 remove_watcher() i=4 2024-09-12T00:46:28.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.405+0000 7f2bef946800 20 remove_watcher() i=5 2024-09-12T00:46:28.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.406+0000 7f2bef946800 20 remove_watcher() i=6 2024-09-12T00:46:28.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.407+0000 7f2bef946800 20 remove_watcher() i=7 2024-09-12T00:46:28.416 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:46:28.513 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:28.513 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:28.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.548+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.550+0000 7f1ad112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.550+0000 7f1ad112c800 20 realm 2024-09-12T00:46:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.550+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.550+0000 7f1ad112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.550+0000 7f1ad112c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.550+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.550+0000 7f1ad112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.550+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.551+0000 7f1ad112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.551+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.551+0000 7f1ad112c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:28.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.551+0000 7f1ad112c800 20 searching for the correct realm 2024-09-12T00:46:28.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.756+0000 7f1ac7fff640 0 -- 172.21.15.83:0/1603368148 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f1ab8069ba0 msgr2=0x7f1ab808f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.961+0000 7f1acd650640 0 -- 172.21.15.83:0/1603368148 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5593640f96d0 msgr2=0x5593640fbb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:28.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:46:28.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:28.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:46:28.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:28.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:28.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:28.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:28.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.966+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:28.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 20 zone default found 2024-09-12T00:46:28.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 4 Realm: () 2024-09-12T00:46:28.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 20 zonegroup default 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.967+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.968+0000 7f1ad112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.968+0000 7f1ad112c800 20 started sync module instance, tier type = 2024-09-12T00:46:28.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.968+0000 7f1ad112c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:46:28.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.977+0000 7f1ad112c800 20 add_watcher() i=0 2024-09-12T00:46:28.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.977+0000 7f1ad112c800 20 add_watcher() i=1 2024-09-12T00:46:28.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.977+0000 7f1ad112c800 20 add_watcher() i=2 2024-09-12T00:46:28.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.977+0000 7f1ad112c800 20 add_watcher() i=3 2024-09-12T00:46:28.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.977+0000 7f1ad112c800 20 add_watcher() i=4 2024-09-12T00:46:28.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.977+0000 7f1ad112c800 20 add_watcher() i=5 2024-09-12T00:46:28.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.977+0000 7f1ad112c800 20 add_watcher() i=6 2024-09-12T00:46:28.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.978+0000 7f1ad112c800 20 add_watcher() i=7 2024-09-12T00:46:28.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.978+0000 7f1ad112c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:28.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.980+0000 7f1982fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:28.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.980+0000 7f1ad112c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:28.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:28.980+0000 7f1ad112c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:29.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.018+0000 7f1981fe3640 20 reqs_thread_entry: start 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.018+0000 7f1ad112c800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.018+0000 7f1ad112c800 20 Filter name: none 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.018+0000 7f18f37fe640 20 reqs_thread_entry: start 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.018+0000 7f1ad112c800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.018+0000 7f1ad112c800 20 rados->read ofs=0 len=0 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.019+0000 7f1ad112c800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.019+0000 7f1ad112c800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.019+0000 7f1ad112c800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.019+0000 7f1ad112c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:29.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.019+0000 7f1ad112c800 10 removing key index: TMRIVRSUPYLBNQXKXKLM 2024-09-12T00:46:29.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.020+0000 7f1ad112c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:TMRIVRSUPYLBNQXKXKLM, ofs0, ns] 2024-09-12T00:46:29.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.020+0000 7f19a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94091527302704 notifier 6009 bl.length()=170 2024-09-12T00:46:29.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.020+0000 7f1ad112c800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:46:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.021+0000 7f1ad112c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:46:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.022+0000 7f19a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464341 cookie 94091527358528 notifier 6009 bl.length()=182 2024-09-12T00:46:29.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.022+0000 7f1ad112c800 10 removing user buckets index 2024-09-12T00:46:29.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.023+0000 7f1ad112c800 10 removing user index: sysuser.client.0 2024-09-12T00:46:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.024+0000 7f1ad112c800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:46:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.024+0000 7f1ad112c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:46:29.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.025+0000 7f19a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94091527354640 notifier 6009 bl.length()=165 2024-09-12T00:46:29.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.026+0000 7f1982fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:29.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.028+0000 7f1ad112c800 20 remove_watcher() i=0 2024-09-12T00:46:29.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.028+0000 7f1ad112c800 2 removed watcher, disabling cache 2024-09-12T00:46:29.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.029+0000 7f1ad112c800 20 remove_watcher() i=1 2024-09-12T00:46:29.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.030+0000 7f1ad112c800 20 remove_watcher() i=2 2024-09-12T00:46:29.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.031+0000 7f1ad112c800 20 remove_watcher() i=3 2024-09-12T00:46:29.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.032+0000 7f1ad112c800 20 remove_watcher() i=4 2024-09-12T00:46:29.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.033+0000 7f1ad112c800 20 remove_watcher() i=5 2024-09-12T00:46:29.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.034+0000 7f1ad112c800 20 remove_watcher() i=6 2024-09-12T00:46:29.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:46:29.035+0000 7f1ad112c800 20 remove_watcher() i=7 2024-09-12T00:46:29.044 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:46:29.045 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:46:29.117 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:46:29.127 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:46:29.127 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:46:29.127 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:46:29.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:46:29.157 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:46:29.158 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:46:29.227 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:46:29.227 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:46:29.296 INFO:tasks.workunit:timeout=3h 2024-09-12T00:46:29.296 INFO:tasks.workunit:cleanup=True 2024-09-12T00:46:29.297 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:46:29.365 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:47:14.307 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:47:14.307 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:14.307 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:47:14.307 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:47:14.307 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:47:14.307 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:14.308 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:47:14.311 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:47:14.380 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:47:14.382 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:47:14.382 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:47:14.430 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:47:14.478 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:47:14.517 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:47:14.519 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:47:14.519 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:47:14.557 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:47:14.560 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:47:14.560 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:47:14.630 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:47:14.632 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:47:14.632 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:47:14.704 INFO:tasks.workunit.client.0.smithi083.stderr:+ ulimit -c 0 2024-09-12T00:47:14.704 INFO:tasks.workunit.client.0.smithi083.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:47:14.705 INFO:tasks.workunit.client.0.smithi083.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:47:14.705 INFO:tasks.workunit.client.0.smithi083.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:47:17.025 INFO:tasks.workunit.client.0.smithi083.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ deactivate nondestructive 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV 2024-09-12T00:47:17.026 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:47:17.027 INFO:tasks.workunit.client.0.smithi083.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:47:17.028 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PATH 2024-09-12T00:47:17.028 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T00:47:17.028 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -z '' ']' 2024-09-12T00:47:17.028 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:47:17.028 INFO:tasks.workunit.client.0.smithi083.stderr:++ PS1='(rgw) ' 2024-09-12T00:47:17.028 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PS1 2024-09-12T00:47:17.028 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:47:17.028 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-09-12T00:47:17.028 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install pip --upgrade 2024-09-12T00:47:17.255 INFO:tasks.workunit.client.0.smithi083.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:47:17.436 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting pip 2024-09-12T00:47:17.441 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:47:17.486 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: pip 2024-09-12T00:47:17.486 INFO:tasks.workunit.client.0.smithi083.stdout: Attempting uninstall: pip 2024-09-12T00:47:17.486 INFO:tasks.workunit.client.0.smithi083.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:47:17.640 INFO:tasks.workunit.client.0.smithi083.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:47:17.645 INFO:tasks.workunit.client.0.smithi083.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:47:18.378 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed pip-24.2 2024-09-12T00:47:18.425 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install boto3 2024-09-12T00:47:19.202 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting boto3 2024-09-12T00:47:19.203 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:47:19.746 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:47:19.747 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:47:19.797 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:47:19.798 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:47:19.853 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:47:19.854 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:47:19.912 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:47:19.913 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:47:19.988 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:47:19.989 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:47:20.184 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:47:20.185 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:47:20.189 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:47:20.191 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:47:20.201 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:47:20.202 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:47:20.203 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:47:20.204 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:47:20.206 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:47:20.281 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:47:21.331 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:47:21.449 INFO:tasks.workunit.client.0.smithi083.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:47:21.572 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:47:21.608 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:21.608 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:21.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.647+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.648+0000 7f4af3daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:21.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.648+0000 7f4af3daf800 20 realm 2024-09-12T00:47:21.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.648+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.649+0000 7f4af3daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:21.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.649+0000 7f4af3daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:21.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.649+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.649+0000 7f4af3daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:21.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.649+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.649+0000 7f4af3daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:21.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.649+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.650+0000 7f4af3daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:21.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.650+0000 7f4af3daf800 20 searching for the correct realm 2024-09-12T00:47:21.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.653+0000 7f4af1899640 0 -- 172.21.15.83:0/2519733824 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f4ae40a70b0 msgr2=0x7f4ae40a3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.657+0000 7f4af1899640 0 -- 172.21.15.83:0/2519733824 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f4ae0003cc0 msgr2=0x7f4aec016440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:21.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.864+0000 7f4af3daf800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:21.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.864+0000 7f4af3daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.864+0000 7f4af3daf800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.864+0000 7f4af3daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.864+0000 7f4af3daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.864+0000 7f4af3daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.864+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:21.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:21.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 20 zone default found 2024-09-12T00:47:21.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 4 Realm: () 2024-09-12T00:47:21.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 20 zonegroup default 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.865+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.866+0000 7f4af3daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.866+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.866+0000 7f4af3daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.866+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.866+0000 7f4af3daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.866+0000 7f4af3daf800 20 started sync module instance, tier type = 2024-09-12T00:47:21.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.866+0000 7f4af3daf800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:21.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.876+0000 7f4af3daf800 20 add_watcher() i=0 2024-09-12T00:47:21.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.876+0000 7f4af3daf800 20 add_watcher() i=1 2024-09-12T00:47:21.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.876+0000 7f4af3daf800 20 add_watcher() i=2 2024-09-12T00:47:21.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.876+0000 7f4af3daf800 20 add_watcher() i=3 2024-09-12T00:47:21.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.876+0000 7f4af3daf800 20 add_watcher() i=4 2024-09-12T00:47:21.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.876+0000 7f4af3daf800 20 add_watcher() i=5 2024-09-12T00:47:21.875 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.876+0000 7f4af3daf800 20 add_watcher() i=6 2024-09-12T00:47:21.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.877+0000 7f4af3daf800 20 add_watcher() i=7 2024-09-12T00:47:21.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.877+0000 7f4af3daf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:21.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.879+0000 7f49a3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.879+0000 7f4af3daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.879+0000 7f4af3daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 5 note: GC not initialized 2024-09-12T00:47:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f49a2ffd640 20 reqs_thread_entry: start 2024-09-12T00:47:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 20 Filter name: none 2024-09-12T00:47:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f49a0ff9640 20 reqs_thread_entry: start 2024-09-12T00:47:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:47:21.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:21.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.880+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.881+0000 7f4af3daf800 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.881+0000 7f4af3daf800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.881+0000 7f4af3daf800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.881+0000 7f4af3daf800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.881+0000 7f4af3daf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.881+0000 7f4af3daf800 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.881+0000 7f4af3daf800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.881+0000 7f4af3daf800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.881+0000 7f4af3daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:21.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.882+0000 7f4af3daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T00:47:21.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.882+0000 7f4af3daf800 20 get_user_info_from_index found 0 xattrs 2024-09-12T00:47:21.882 INFO:tasks.workunit.client.0.smithi083.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T00:47:21.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.882+0000 7f49a3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:21.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.884+0000 7f4af3daf800 20 remove_watcher() i=0 2024-09-12T00:47:21.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.884+0000 7f4af3daf800 2 removed watcher, disabling cache 2024-09-12T00:47:21.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.885+0000 7f4af3daf800 20 remove_watcher() i=1 2024-09-12T00:47:21.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.887+0000 7f4af3daf800 20 remove_watcher() i=2 2024-09-12T00:47:21.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.888+0000 7f4af3daf800 20 remove_watcher() i=3 2024-09-12T00:47:21.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.889+0000 7f4af3daf800 20 remove_watcher() i=4 2024-09-12T00:47:21.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.891+0000 7f4af3daf800 20 remove_watcher() i=5 2024-09-12T00:47:21.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.892+0000 7f4af3daf800 20 remove_watcher() i=6 2024-09-12T00:47:21.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:21.893+0000 7f4af3daf800 20 remove_watcher() i=7 2024-09-12T00:47:42.449 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:42.449 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:42.495 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:42.495 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:42.507 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:42.507 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:42.519 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:42.519 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:42.525 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:42.525 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:42.568 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:42.568 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:42.610 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard add 2024-09-12T00:47:42.610 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:42.611 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:47:42.641 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:42.641 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:42.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.680+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.682+0000 7f4615f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.682+0000 7f4615f24800 20 realm 2024-09-12T00:47:42.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.682+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.683+0000 7f4615f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.683+0000 7f4615f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:42.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.683+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.683+0000 7f4615f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.683+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.683+0000 7f4615f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:42.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.683+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.684+0000 7f4615f24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:42.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.684+0000 7f4615f24800 20 searching for the correct realm 2024-09-12T00:47:42.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.687+0000 7f460bfff640 0 -- 172.21.15.83:0/2889697124 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f45fc064c10 msgr2=0x7f45fc08c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:42.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.892+0000 7f460bfff640 0 -- 172.21.15.83:0/2889697124 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55da35a37e80 msgr2=0x55da35a3a270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:42.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.897+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 20 zone default found 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 4 Realm: () 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 20 zonegroup default 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.898+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.899+0000 7f4615f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.899+0000 7f4615f24800 20 started sync module instance, tier type = 2024-09-12T00:47:42.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.899+0000 7f4615f24800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.908+0000 7f4615f24800 20 add_watcher() i=0 2024-09-12T00:47:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.908+0000 7f4615f24800 20 add_watcher() i=1 2024-09-12T00:47:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.908+0000 7f4615f24800 20 add_watcher() i=2 2024-09-12T00:47:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.908+0000 7f4615f24800 20 add_watcher() i=3 2024-09-12T00:47:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.908+0000 7f4615f24800 20 add_watcher() i=4 2024-09-12T00:47:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.908+0000 7f4615f24800 20 add_watcher() i=5 2024-09-12T00:47:42.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.908+0000 7f4615f24800 20 add_watcher() i=6 2024-09-12T00:47:42.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.910+0000 7f4615f24800 20 add_watcher() i=7 2024-09-12T00:47:42.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.910+0000 7f4615f24800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:42.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.912+0000 7f44c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:42.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.912+0000 7f4615f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:42.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.912+0000 7f4615f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:42.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.912+0000 7f4615f24800 5 note: GC not initialized 2024-09-12T00:47:42.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.913+0000 7f44c27fc640 20 reqs_thread_entry: start 2024-09-12T00:47:42.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.913+0000 7f4615f24800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:42.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.913+0000 7f4615f24800 20 Filter name: none 2024-09-12T00:47:42.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.913+0000 7f4433fff640 20 reqs_thread_entry: start 2024-09-12T00:47:42.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.913+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.913+0000 7f4615f24800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.913+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.914+0000 7f4615f24800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.914+0000 7f4615f24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.914+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.914+0000 7f4615f24800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.914+0000 7f4615f24800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.914+0000 7f4615f24800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:42.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.914+0000 7f4615f24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:42.914 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.916+0000 7f44c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:42.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.918+0000 7f4615f24800 20 remove_watcher() i=0 2024-09-12T00:47:42.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.918+0000 7f4615f24800 2 removed watcher, disabling cache 2024-09-12T00:47:42.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.919+0000 7f4615f24800 20 remove_watcher() i=1 2024-09-12T00:47:42.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.920+0000 7f4615f24800 20 remove_watcher() i=2 2024-09-12T00:47:42.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.921+0000 7f4615f24800 20 remove_watcher() i=3 2024-09-12T00:47:42.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.922+0000 7f4615f24800 20 remove_watcher() i=4 2024-09-12T00:47:42.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.923+0000 7f4615f24800 20 remove_watcher() i=5 2024-09-12T00:47:42.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.924+0000 7f4615f24800 20 remove_watcher() i=6 2024-09-12T00:47:42.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:42.926+0000 7f4615f24800 20 remove_watcher() i=7 2024-09-12T00:47:42.935 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:42.936 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:42.936 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: ad4424e4-de7c-4376-b125-e717016a3484.4511.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:47:42.936 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:42.937 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T00:47:42.967 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:42.967 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:43.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.005+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.007+0000 7fe376016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.007+0000 7fe376016800 20 realm 2024-09-12T00:47:43.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.007+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.007+0000 7fe376016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.007+0000 7fe376016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:43.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.007+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.007+0000 7fe376016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.007+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.008+0000 7fe376016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:43.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.008+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.008+0000 7fe376016800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:43.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.008+0000 7fe376016800 20 searching for the correct realm 2024-09-12T00:47:43.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.011+0000 7fe370fe6640 0 -- 172.21.15.83:0/687076724 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fe35c094420 msgr2=0x7fe35c0948a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:43.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.417+0000 7fe3717e7640 0 -- 172.21.15.83:0/687076724 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fe36c048400 msgr2=0x7fe36c0760c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:43.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:43.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:43.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:43.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:43.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:43.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:43.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:43.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.423+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:43.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 20 zone default found 2024-09-12T00:47:43.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 4 Realm: () 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 20 zonegroup default 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.424+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.425+0000 7fe376016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.425+0000 7fe376016800 20 started sync module instance, tier type = 2024-09-12T00:47:43.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.425+0000 7fe376016800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:43.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.435+0000 7fe376016800 20 add_watcher() i=0 2024-09-12T00:47:43.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.435+0000 7fe376016800 20 add_watcher() i=1 2024-09-12T00:47:43.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.435+0000 7fe376016800 20 add_watcher() i=2 2024-09-12T00:47:43.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.435+0000 7fe376016800 20 add_watcher() i=3 2024-09-12T00:47:43.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.435+0000 7fe376016800 20 add_watcher() i=4 2024-09-12T00:47:43.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.435+0000 7fe376016800 20 add_watcher() i=5 2024-09-12T00:47:43.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.435+0000 7fe376016800 20 add_watcher() i=6 2024-09-12T00:47:43.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.436+0000 7fe376016800 20 add_watcher() i=7 2024-09-12T00:47:43.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.436+0000 7fe376016800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:43.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.438+0000 7fe2277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:43.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.438+0000 7fe376016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:43.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.438+0000 7fe376016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:43.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.438+0000 7fe376016800 5 note: GC not initialized 2024-09-12T00:47:43.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.438+0000 7fe2267e4640 20 reqs_thread_entry: start 2024-09-12T00:47:43.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.438+0000 7fe376016800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:43.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.438+0000 7fe376016800 20 Filter name: none 2024-09-12T00:47:43.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe197fff640 20 reqs_thread_entry: start 2024-09-12T00:47:43.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:47:43.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:43.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:47:43.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:47:43.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:47:43.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:43.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:43.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:43.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:43.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:43.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.439+0000 7fe376016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:47:43.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.442+0000 7fe2277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:43.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.444+0000 7fe376016800 20 remove_watcher() i=0 2024-09-12T00:47:43.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.444+0000 7fe376016800 2 removed watcher, disabling cache 2024-09-12T00:47:43.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.445+0000 7fe376016800 20 remove_watcher() i=1 2024-09-12T00:47:43.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.446+0000 7fe376016800 20 remove_watcher() i=2 2024-09-12T00:47:43.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.447+0000 7fe376016800 20 remove_watcher() i=3 2024-09-12T00:47:43.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.448+0000 7fe376016800 20 remove_watcher() i=4 2024-09-12T00:47:43.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.449+0000 7fe376016800 20 remove_watcher() i=5 2024-09-12T00:47:43.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.450+0000 7fe376016800 20 remove_watcher() i=6 2024-09-12T00:47:43.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.451+0000 7fe376016800 20 remove_watcher() i=7 2024-09-12T00:47:43.462 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard list 2024-09-12T00:47:43.489 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:43.489 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:43.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.527+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.529+0000 7f40acdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.529+0000 7f40acdaf800 20 realm 2024-09-12T00:47:43.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.529+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.529+0000 7f40acdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.529+0000 7f40acdaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:43.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.530+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.530+0000 7f40acdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.530+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.530+0000 7f40acdaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:43.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.530+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.531+0000 7f40acdaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:43.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.531+0000 7f40acdaf800 20 searching for the correct realm 2024-09-12T00:47:43.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.534+0000 7f40a209f640 0 -- 172.21.15.83:0/3537588468 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f40940463f0 msgr2=0x7f4094046830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:43.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.740+0000 7f40ab0a1640 0 -- 172.21.15.83:0/3537588468 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55cf754cf3f0 msgr2=0x55cf754d18b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:43.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:43.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:43.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:43.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:43.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:43.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:43.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:43.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:43.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 zone default found 2024-09-12T00:47:43.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 4 Realm: () 2024-09-12T00:47:43.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:43.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 zonegroup default 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.746+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.747+0000 7f40acdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.747+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.747+0000 7f40acdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.747+0000 7f40acdaf800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.747+0000 7f40acdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.747+0000 7f40acdaf800 20 started sync module instance, tier type = 2024-09-12T00:47:43.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.747+0000 7f40acdaf800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:43.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.757+0000 7f40acdaf800 20 add_watcher() i=0 2024-09-12T00:47:43.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.757+0000 7f40acdaf800 20 add_watcher() i=1 2024-09-12T00:47:43.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.757+0000 7f40acdaf800 20 add_watcher() i=2 2024-09-12T00:47:43.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.757+0000 7f40acdaf800 20 add_watcher() i=3 2024-09-12T00:47:43.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.757+0000 7f40acdaf800 20 add_watcher() i=4 2024-09-12T00:47:43.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.757+0000 7f40acdaf800 20 add_watcher() i=5 2024-09-12T00:47:43.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.757+0000 7f40acdaf800 20 add_watcher() i=6 2024-09-12T00:47:43.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.759+0000 7f40acdaf800 20 add_watcher() i=7 2024-09-12T00:47:43.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.759+0000 7f40acdaf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:43.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.761+0000 7f3f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:43.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.761+0000 7f40acdaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:43.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.761+0000 7f40acdaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:43.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.761+0000 7f40acdaf800 5 note: GC not initialized 2024-09-12T00:47:43.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.761+0000 7f3edbfff640 20 reqs_thread_entry: start 2024-09-12T00:47:43.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.762+0000 7f40acdaf800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:43.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.762+0000 7f40acdaf800 20 Filter name: none 2024-09-12T00:47:43.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.762+0000 7f3ed9ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:43.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.768+0000 7f3f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:43.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.770+0000 7f40acdaf800 20 remove_watcher() i=0 2024-09-12T00:47:43.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.770+0000 7f40acdaf800 2 removed watcher, disabling cache 2024-09-12T00:47:43.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.771+0000 7f40acdaf800 20 remove_watcher() i=1 2024-09-12T00:47:43.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.772+0000 7f40acdaf800 20 remove_watcher() i=2 2024-09-12T00:47:43.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.773+0000 7f40acdaf800 20 remove_watcher() i=3 2024-09-12T00:47:43.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.774+0000 7f40acdaf800 20 remove_watcher() i=4 2024-09-12T00:47:43.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.776+0000 7f40acdaf800 20 remove_watcher() i=5 2024-09-12T00:47:43.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.777+0000 7f40acdaf800 20 remove_watcher() i=6 2024-09-12T00:47:43.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.778+0000 7f40acdaf800 20 remove_watcher() i=7 2024-09-12T00:47:43.787 INFO:tasks.workunit.client.0.smithi083.stderr:bucket name a-bucket 2024-09-12T00:47:43.787 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard process 2024-09-12T00:47:43.787 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:43.788 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard process 2024-09-12T00:47:43.815 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:43.815 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:43.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.853+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.855+0000 7f03b0a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.855+0000 7f03b0a17800 20 realm 2024-09-12T00:47:43.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.855+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.855+0000 7f03b0a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.855+0000 7f03b0a17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:43.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.855+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.855+0000 7f03b0a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.855+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.856+0000 7f03b0a17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:43.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.856+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.856+0000 7f03b0a17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:43.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.857+0000 7f03b0a17800 20 searching for the correct realm 2024-09-12T00:47:43.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.860+0000 7f03ac9e8640 0 -- 172.21.15.83:0/1495295919 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f03940997a0 msgr2=0x7f0394098270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:43.862 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.864+0000 7f03ac1e7640 0 -- 172.21.15.83:0/1495295919 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f03a4061040 msgr2=0x7f03a408b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:43.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.867+0000 7f03b0a17800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:43.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.867+0000 7f03b0a17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:43.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.867+0000 7f03b0a17800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:43.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.867+0000 7f03b0a17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:43.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.867+0000 7f03b0a17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:43.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.867+0000 7f03b0a17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:43.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.867+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:43.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:43.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 20 zone default found 2024-09-12T00:47:43.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 4 Realm: () 2024-09-12T00:47:43.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:43.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:43.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:43.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 20 zonegroup default 2024-09-12T00:47:43.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.868+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.869+0000 7f03b0a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.869+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.869+0000 7f03b0a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.869+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.869+0000 7f03b0a17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:43.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.869+0000 7f03b0a17800 20 started sync module instance, tier type = 2024-09-12T00:47:43.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.869+0000 7f03b0a17800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:43.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.878+0000 7f03b0a17800 20 add_watcher() i=0 2024-09-12T00:47:43.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.878+0000 7f03b0a17800 20 add_watcher() i=1 2024-09-12T00:47:43.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.878+0000 7f03b0a17800 20 add_watcher() i=2 2024-09-12T00:47:43.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.878+0000 7f03b0a17800 20 add_watcher() i=3 2024-09-12T00:47:43.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.878+0000 7f03b0a17800 20 add_watcher() i=4 2024-09-12T00:47:43.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.878+0000 7f03b0a17800 20 add_watcher() i=5 2024-09-12T00:47:43.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.878+0000 7f03b0a17800 20 add_watcher() i=6 2024-09-12T00:47:43.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.879+0000 7f03b0a17800 20 add_watcher() i=7 2024-09-12T00:47:43.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.879+0000 7f03b0a17800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:43.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.881+0000 7f02627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:43.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.881+0000 7f03b0a17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:43.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.881+0000 7f03b0a17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:43.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.881+0000 7f03b0a17800 5 note: GC not initialized 2024-09-12T00:47:43.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.882+0000 7f02617e2640 20 reqs_thread_entry: start 2024-09-12T00:47:43.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.882+0000 7f03b0a17800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:43.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.882+0000 7f03b0a17800 20 Filter name: none 2024-09-12T00:47:43.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.882+0000 7f01d2ffd640 20 reqs_thread_entry: start 2024-09-12T00:47:43.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.882+0000 7f03b0a17800 20 processing logshard = reshard.0000000000 2024-09-12T00:47:43.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.885+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:47:43.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.885+0000 7f03b0a17800 20 processing logshard = reshard.0000000001 2024-09-12T00:47:43.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.887+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:47:43.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.887+0000 7f03b0a17800 20 processing logshard = reshard.0000000002 2024-09-12T00:47:43.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.889+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:47:43.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.889+0000 7f03b0a17800 20 processing logshard = reshard.0000000003 2024-09-12T00:47:43.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.891+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:47:43.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.891+0000 7f03b0a17800 20 processing logshard = reshard.0000000004 2024-09-12T00:47:43.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.894+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:47:43.893 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.894+0000 7f03b0a17800 20 processing logshard = reshard.0000000005 2024-09-12T00:47:43.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.896+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:47:43.895 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.896+0000 7f03b0a17800 20 processing logshard = reshard.0000000006 2024-09-12T00:47:43.896 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 20 process_entry resharding a-bucket 2024-09-12T00:47:43.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:47:43.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:43.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:47:43.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:47:43.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:47:43.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:43.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:43.897 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:43.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:43.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:43.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:43.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.898+0000 7f03b0a17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:47:43.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.903+0000 7f03b0a17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:43.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.903+0000 7f03b0a17800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:43.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.903+0000 7f03b0a17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:43.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.903+0000 7f03b0a17800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:47:43.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.904+0000 7f028b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464344 cookie 94568894310352 notifier 5756 bl.length()=911 2024-09-12T00:47:43.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.904+0000 7f028b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:43.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.904+0000 7f028b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:43.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.904+0000 7f028b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:43.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.904+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:47:43.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.904+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:47:43.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.904+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:47:43.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.904+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:47:43.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.907+0000 7f03b0a17800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.0 2024-09-12T00:47:43.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.907+0000 7f03b0a17800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.0 2024-09-12T00:47:43.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.907+0000 7f03b0a17800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.1 2024-09-12T00:47:43.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.907+0000 7f03b0a17800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.1 2024-09-12T00:47:43.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.907+0000 7f03b0a17800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.0 2024-09-12T00:47:43.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.907+0000 7f03b0a17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:43.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.907+0000 7f03b0a17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:47:43.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f03b0a17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:43.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f03b0a17800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:43.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f03b0a17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:43.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f03b0a17800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:47:43.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f028b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94568894310352 notifier 5756 bl.length()=911 2024-09-12T00:47:43.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f028b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:43.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f028b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:43.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f028b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:43.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:47:43.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:47:43.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:47:43.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.909+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:47:43.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.911+0000 7f03b0a17800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.0 2024-09-12T00:47:43.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.911+0000 7f03b0a17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:43.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.911+0000 7f03b0a17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:47:43.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.912+0000 7f03b0a17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:43.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.912+0000 7f03b0a17800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:43.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.912+0000 7f03b0a17800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:43.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.912+0000 7f03b0a17800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:47:43.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.913+0000 7f028affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 94568894310352 notifier 5756 bl.length()=879 2024-09-12T00:47:43.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.913+0000 7f028affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:43.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.913+0000 7f028affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:43.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.913+0000 7f028affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:43.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.913+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:47:43.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.913+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:47:43.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.913+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:47:43.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.913+0000 7f03b0a17800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:47:43.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.914+0000 7f03b0a17800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T00:47:43.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.915+0000 7f03b0a17800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:47:43.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.917+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:47:43.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.917+0000 7f03b0a17800 20 processing logshard = reshard.0000000007 2024-09-12T00:47:43.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.919+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:47:43.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.919+0000 7f03b0a17800 20 processing logshard = reshard.0000000008 2024-09-12T00:47:43.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.923+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:47:43.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.923+0000 7f03b0a17800 20 processing logshard = reshard.0000000009 2024-09-12T00:47:43.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.925+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:47:43.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.925+0000 7f03b0a17800 20 processing logshard = reshard.0000000010 2024-09-12T00:47:43.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.928+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:47:43.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.928+0000 7f03b0a17800 20 processing logshard = reshard.0000000011 2024-09-12T00:47:43.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.930+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:47:43.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.930+0000 7f03b0a17800 20 processing logshard = reshard.0000000012 2024-09-12T00:47:43.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.932+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:47:43.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.932+0000 7f03b0a17800 20 processing logshard = reshard.0000000013 2024-09-12T00:47:43.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.935+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:47:43.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.935+0000 7f03b0a17800 20 processing logshard = reshard.0000000014 2024-09-12T00:47:43.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.938+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:47:43.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.938+0000 7f03b0a17800 20 processing logshard = reshard.0000000015 2024-09-12T00:47:43.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.940+0000 7f03b0a17800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:47:43.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.941+0000 7f02627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:43.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.943+0000 7f03b0a17800 20 remove_watcher() i=0 2024-09-12T00:47:43.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.943+0000 7f03b0a17800 2 removed watcher, disabling cache 2024-09-12T00:47:43.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.944+0000 7f03b0a17800 20 remove_watcher() i=1 2024-09-12T00:47:43.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.945+0000 7f03b0a17800 20 remove_watcher() i=2 2024-09-12T00:47:43.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.945+0000 7f03b0a17800 20 remove_watcher() i=3 2024-09-12T00:47:43.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.946+0000 7f03b0a17800 20 remove_watcher() i=4 2024-09-12T00:47:43.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.947+0000 7f03b0a17800 20 remove_watcher() i=5 2024-09-12T00:47:43.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.948+0000 7f03b0a17800 20 remove_watcher() i=6 2024-09-12T00:47:43.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:43.950+0000 7f03b0a17800 20 remove_watcher() i=7 2024-09-12T00:47:48.966 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:47:49.001 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:49.001 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:49.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.043+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.045+0000 7fafe1440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.045+0000 7fafe1440800 20 realm 2024-09-12T00:47:49.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.045+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.046+0000 7fafe1440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.046+0000 7fafe1440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:49.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.046+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.046+0000 7fafe1440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.046+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.047+0000 7fafe1440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:49.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.047+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.047+0000 7fafe1440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:49.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.047+0000 7fafe1440800 20 searching for the correct realm 2024-09-12T00:47:49.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.051+0000 7fafdf72b640 0 -- 172.21.15.83:0/2499662782 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7fafd404d040 msgr2=0x7fafd404c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:49.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.055+0000 7fafdef2a640 0 -- 172.21.15.83:0/2499662782 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fafd803b040 msgr2=0x7fafd803b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:49.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:49.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:49.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:49.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:49.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:49.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:49.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:49.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.060+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 20 zone default found 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 4 Realm: () 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 20 zonegroup default 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.061+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.062+0000 7fafe1440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.062+0000 7fafe1440800 20 started sync module instance, tier type = 2024-09-12T00:47:49.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.062+0000 7fafe1440800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:49.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.072+0000 7fafe1440800 20 add_watcher() i=0 2024-09-12T00:47:49.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.072+0000 7fafe1440800 20 add_watcher() i=1 2024-09-12T00:47:49.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.072+0000 7fafe1440800 20 add_watcher() i=2 2024-09-12T00:47:49.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.072+0000 7fafe1440800 20 add_watcher() i=3 2024-09-12T00:47:49.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.072+0000 7fafe1440800 20 add_watcher() i=4 2024-09-12T00:47:49.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.072+0000 7fafe1440800 20 add_watcher() i=5 2024-09-12T00:47:49.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.072+0000 7fafe1440800 20 add_watcher() i=6 2024-09-12T00:47:49.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.073+0000 7fafe1440800 20 add_watcher() i=7 2024-09-12T00:47:49.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.073+0000 7fafe1440800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:49.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.075+0000 7fae957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:49.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.075+0000 7fafe1440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:49.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.075+0000 7fafe1440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:49.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.075+0000 7fafe1440800 5 note: GC not initialized 2024-09-12T00:47:49.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.075+0000 7fae0ffff640 20 reqs_thread_entry: start 2024-09-12T00:47:49.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.075+0000 7fafe1440800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:49.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.075+0000 7fafe1440800 20 Filter name: none 2024-09-12T00:47:49.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.076+0000 7fae0dffb640 20 reqs_thread_entry: start 2024-09-12T00:47:49.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.076+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.076+0000 7fafe1440800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:49.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.076+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.076+0000 7fafe1440800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:49.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.076+0000 7fafe1440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:49.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.077+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.077+0000 7fafe1440800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:49.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.077+0000 7fafe1440800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.077+0000 7fafe1440800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:49.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.077+0000 7fafe1440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:49.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.079+0000 7fae957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:49.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.081+0000 7fafe1440800 20 remove_watcher() i=0 2024-09-12T00:47:49.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.081+0000 7fafe1440800 2 removed watcher, disabling cache 2024-09-12T00:47:49.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.082+0000 7fafe1440800 20 remove_watcher() i=1 2024-09-12T00:47:49.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.083+0000 7fafe1440800 20 remove_watcher() i=2 2024-09-12T00:47:49.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.084+0000 7fafe1440800 20 remove_watcher() i=3 2024-09-12T00:47:49.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.085+0000 7fafe1440800 20 remove_watcher() i=4 2024-09-12T00:47:49.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.086+0000 7fafe1440800 20 remove_watcher() i=5 2024-09-12T00:47:49.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.087+0000 7fafe1440800 20 remove_watcher() i=6 2024-09-12T00:47:49.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.088+0000 7fafe1440800 20 remove_watcher() i=7 2024-09-12T00:47:49.097 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:49.098 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:49.098 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: ad4424e4-de7c-4376-b125-e717016a3484.4511.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:47:49.098 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:49.098 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard add non empty bucket 2024-09-12T00:47:49.098 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:49.102 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:49.102 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:49.111 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:49.111 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:49.119 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:49.119 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:49.127 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:49.127 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:49.136 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:49.136 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:49.144 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:49.145 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:49.153 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:49.153 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:49.161 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:49.161 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:49.168 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:47:49.197 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:49.197 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:49.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.237+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.238+0000 7f148753b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.238+0000 7f148753b800 20 realm 2024-09-12T00:47:49.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.238+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.239+0000 7f148753b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.239+0000 7f148753b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:49.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.239+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.239+0000 7f148753b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.239+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.239+0000 7f148753b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:49.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.239+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.240+0000 7f148753b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:49.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.240+0000 7f148753b800 20 searching for the correct realm 2024-09-12T00:47:49.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.243+0000 7f147bfff640 0 -- 172.21.15.83:0/1834988790 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f146c0d92f0 msgr2=0x7f146c0bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:49.447 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.448+0000 7f1483abc640 0 -- 172.21.15.83:0/1834988790 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x563117d51f60 msgr2=0x563117d543b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.453+0000 7f148753b800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.453+0000 7f148753b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.453+0000 7f148753b800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.453+0000 7f148753b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.453+0000 7f148753b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:49.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.453+0000 7f148753b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:49.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.453+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.453+0000 7f148753b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.453+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 zone default found 2024-09-12T00:47:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 4 Realm: () 2024-09-12T00:47:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 zonegroup default 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.454+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.455+0000 7f148753b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.455+0000 7f148753b800 20 started sync module instance, tier type = 2024-09-12T00:47:49.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.455+0000 7f148753b800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.463+0000 7f148753b800 20 add_watcher() i=0 2024-09-12T00:47:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.463+0000 7f148753b800 20 add_watcher() i=1 2024-09-12T00:47:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.463+0000 7f148753b800 20 add_watcher() i=2 2024-09-12T00:47:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.463+0000 7f148753b800 20 add_watcher() i=3 2024-09-12T00:47:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.463+0000 7f148753b800 20 add_watcher() i=4 2024-09-12T00:47:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.463+0000 7f148753b800 20 add_watcher() i=5 2024-09-12T00:47:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.463+0000 7f148753b800 20 add_watcher() i=6 2024-09-12T00:47:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.464+0000 7f148753b800 20 add_watcher() i=7 2024-09-12T00:47:49.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.464+0000 7f148753b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:49.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.466+0000 7f1339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:49.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.466+0000 7f148753b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:49.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.466+0000 7f148753b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:49.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.466+0000 7f148753b800 5 note: GC not initialized 2024-09-12T00:47:49.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.466+0000 7f1338fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:49.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.466+0000 7f148753b800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:49.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.466+0000 7f148753b800 20 Filter name: none 2024-09-12T00:47:49.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.466+0000 7f12b27fc640 20 reqs_thread_entry: start 2024-09-12T00:47:49.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.466+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.467+0000 7f148753b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:49.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.467+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.467+0000 7f148753b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:49.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.467+0000 7f148753b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:49.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.467+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.467+0000 7f148753b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:49.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.467+0000 7f148753b800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.468+0000 7f148753b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:49.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.468+0000 7f148753b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:49.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.469+0000 7f1339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:49.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.471+0000 7f148753b800 20 remove_watcher() i=0 2024-09-12T00:47:49.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.471+0000 7f148753b800 2 removed watcher, disabling cache 2024-09-12T00:47:49.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.472+0000 7f148753b800 20 remove_watcher() i=1 2024-09-12T00:47:49.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.473+0000 7f148753b800 20 remove_watcher() i=2 2024-09-12T00:47:49.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.474+0000 7f148753b800 20 remove_watcher() i=3 2024-09-12T00:47:49.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.475+0000 7f148753b800 20 remove_watcher() i=4 2024-09-12T00:47:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.476+0000 7f148753b800 20 remove_watcher() i=5 2024-09-12T00:47:49.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.477+0000 7f148753b800 20 remove_watcher() i=6 2024-09-12T00:47:49.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.478+0000 7f148753b800 20 remove_watcher() i=7 2024-09-12T00:47:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:49.489 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:49.489 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: ad4424e4-de7c-4376-b125-e717016a3484.4511.18 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T00:47:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:49.490 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T00:47:49.521 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:49.521 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:49.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.559+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.561+0000 7f419b02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.561+0000 7f419b02f800 20 realm 2024-09-12T00:47:49.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.561+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.561+0000 7f419b02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.561+0000 7f419b02f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:49.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.561+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.561+0000 7f419b02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.561+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.562+0000 7f419b02f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:49.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.562+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.562+0000 7f419b02f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:49.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.562+0000 7f419b02f800 20 searching for the correct realm 2024-09-12T00:47:49.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.565+0000 7f4198b19640 0 -- 172.21.15.83:0/4251713908 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f418c070450 msgr2=0x7f418c070890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:49.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.568+0000 7f4198b19640 0 -- 172.21.15.83:0/4251713908 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f4194034040 msgr2=0x7f4194034420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:49.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.775+0000 7f419b02f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.775+0000 7f419b02f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.775+0000 7f419b02f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.775+0000 7f419b02f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.775+0000 7f419b02f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.775+0000 7f419b02f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.775+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:49.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 20 zone default found 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 4 Realm: () 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 20 zonegroup default 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.776+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.777+0000 7f419b02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.777+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.777+0000 7f419b02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.777+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.777+0000 7f419b02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.777+0000 7f419b02f800 20 started sync module instance, tier type = 2024-09-12T00:47:49.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.777+0000 7f419b02f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:49.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.786+0000 7f419b02f800 20 add_watcher() i=0 2024-09-12T00:47:49.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.786+0000 7f419b02f800 20 add_watcher() i=1 2024-09-12T00:47:49.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.786+0000 7f419b02f800 20 add_watcher() i=2 2024-09-12T00:47:49.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.786+0000 7f419b02f800 20 add_watcher() i=3 2024-09-12T00:47:49.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.786+0000 7f419b02f800 20 add_watcher() i=4 2024-09-12T00:47:49.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.786+0000 7f419b02f800 20 add_watcher() i=5 2024-09-12T00:47:49.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.786+0000 7f419b02f800 20 add_watcher() i=6 2024-09-12T00:47:49.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.787+0000 7f419b02f800 20 add_watcher() i=7 2024-09-12T00:47:49.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.787+0000 7f419b02f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:49.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.789+0000 7f404efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:49.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.790+0000 7f419b02f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:49.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.790+0000 7f419b02f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:49.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.790+0000 7f419b02f800 5 note: GC not initialized 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.790+0000 7f404dfe3640 20 reqs_thread_entry: start 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.790+0000 7f419b02f800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.790+0000 7f419b02f800 20 Filter name: none 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.790+0000 7f3fbf7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.790+0000 7f419b02f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.790+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:49.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:49.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:49.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:49.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:49.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.791+0000 7f419b02f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:47:49.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.793+0000 7f404efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:49.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.795+0000 7f419b02f800 20 remove_watcher() i=0 2024-09-12T00:47:49.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.795+0000 7f419b02f800 2 removed watcher, disabling cache 2024-09-12T00:47:49.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.797+0000 7f419b02f800 20 remove_watcher() i=1 2024-09-12T00:47:49.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.798+0000 7f419b02f800 20 remove_watcher() i=2 2024-09-12T00:47:49.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.798+0000 7f419b02f800 20 remove_watcher() i=3 2024-09-12T00:47:49.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.800+0000 7f419b02f800 20 remove_watcher() i=4 2024-09-12T00:47:49.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.800+0000 7f419b02f800 20 remove_watcher() i=5 2024-09-12T00:47:49.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.801+0000 7f419b02f800 20 remove_watcher() i=6 2024-09-12T00:47:49.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.803+0000 7f419b02f800 20 remove_watcher() i=7 2024-09-12T00:47:49.813 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard list 2024-09-12T00:47:49.840 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:49.840 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:49.876 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.877+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.879+0000 7fa2d3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.879+0000 7fa2d3c0e800 20 realm 2024-09-12T00:47:49.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.879+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.880+0000 7fa2d3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.878 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.880+0000 7fa2d3c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:49.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.880+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.880+0000 7fa2d3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:49.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.880+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.880+0000 7fa2d3c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:49.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.880+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:49.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.881+0000 7fa2d3c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:49.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.881+0000 7fa2d3c0e800 20 searching for the correct realm 2024-09-12T00:47:49.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:49.884+0000 7fa2cea58640 0 -- 172.21.15.83:0/3909663516 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fa2c40660b0 msgr2=0x7fa2c40678f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:50.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.089+0000 7fa2cfa5a640 0 -- 172.21.15.83:0/3909663516 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x560e0b8e24d0 msgr2=0x560e0b8e4950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.093+0000 7fa2d3c0e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.093+0000 7fa2d3c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.093+0000 7fa2d3c0e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.093+0000 7fa2d3c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.093+0000 7fa2d3c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.093+0000 7fa2d3c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.093+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.093+0000 7fa2d3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.093+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:50.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 20 zone default found 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 4 Realm: () 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 20 zonegroup default 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.094+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.095+0000 7fa2d3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.095+0000 7fa2d3c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.095+0000 7fa2d3c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.095+0000 7fa2d3c0e800 20 started sync module instance, tier type = 2024-09-12T00:47:50.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.095+0000 7fa2d3c0e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:50.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.104+0000 7fa2d3c0e800 20 add_watcher() i=0 2024-09-12T00:47:50.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.104+0000 7fa2d3c0e800 20 add_watcher() i=1 2024-09-12T00:47:50.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.104+0000 7fa2d3c0e800 20 add_watcher() i=2 2024-09-12T00:47:50.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.104+0000 7fa2d3c0e800 20 add_watcher() i=3 2024-09-12T00:47:50.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.104+0000 7fa2d3c0e800 20 add_watcher() i=4 2024-09-12T00:47:50.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.104+0000 7fa2d3c0e800 20 add_watcher() i=5 2024-09-12T00:47:50.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.104+0000 7fa2d3c0e800 20 add_watcher() i=6 2024-09-12T00:47:50.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.104+0000 7fa2d3c0e800 20 add_watcher() i=7 2024-09-12T00:47:50.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.104+0000 7fa2d3c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:50.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.107+0000 7fa185fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.107+0000 7fa2d3c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.107+0000 7fa2d3c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.107+0000 7fa2d3c0e800 5 note: GC not initialized 2024-09-12T00:47:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.107+0000 7fa184fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.107+0000 7fa2d3c0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.107+0000 7fa2d3c0e800 20 Filter name: none 2024-09-12T00:47:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.108+0000 7fa0fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:50.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.113+0000 7fa185fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:50.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.116+0000 7fa2d3c0e800 20 remove_watcher() i=0 2024-09-12T00:47:50.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.116+0000 7fa2d3c0e800 2 removed watcher, disabling cache 2024-09-12T00:47:50.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.117+0000 7fa2d3c0e800 20 remove_watcher() i=1 2024-09-12T00:47:50.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.118+0000 7fa2d3c0e800 20 remove_watcher() i=2 2024-09-12T00:47:50.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.119+0000 7fa2d3c0e800 20 remove_watcher() i=3 2024-09-12T00:47:50.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.120+0000 7fa2d3c0e800 20 remove_watcher() i=4 2024-09-12T00:47:50.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.121+0000 7fa2d3c0e800 20 remove_watcher() i=5 2024-09-12T00:47:50.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.121+0000 7fa2d3c0e800 20 remove_watcher() i=6 2024-09-12T00:47:50.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.123+0000 7fa2d3c0e800 20 remove_watcher() i=7 2024-09-12T00:47:50.132 INFO:tasks.workunit.client.0.smithi083.stderr:bucket name a-bucket 2024-09-12T00:47:50.132 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard process non empty bucket 2024-09-12T00:47:50.132 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:50.133 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshard process 2024-09-12T00:47:50.159 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:50.159 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:50.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.197+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.199+0000 7ff45e098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.199+0000 7ff45e098800 20 realm 2024-09-12T00:47:50.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.199+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.199+0000 7ff45e098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.199+0000 7ff45e098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:50.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.199+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.199+0000 7ff45e098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.199+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.200+0000 7ff45e098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:50.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.200+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.200+0000 7ff45e098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:50.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.200+0000 7ff45e098800 20 searching for the correct realm 2024-09-12T00:47:50.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.404+0000 7ff45bb82640 0 -- 172.21.15.83:0/671065011 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7ff44c070ad0 msgr2=0x7ff44c066370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:50.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.407+0000 7ff45bb82640 0 -- 172.21.15.83:0/671065011 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff4540c5040 msgr2=0x7ff4540a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:50.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.613+0000 7ff45e098800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.613+0000 7ff45e098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.613+0000 7ff45e098800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.613+0000 7ff45e098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.613+0000 7ff45e098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.613+0000 7ff45e098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.613+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:50.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:50.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 20 zone default found 2024-09-12T00:47:50.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 4 Realm: () 2024-09-12T00:47:50.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 20 zonegroup default 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.614+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.615+0000 7ff45e098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.615+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.615+0000 7ff45e098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.615+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.615+0000 7ff45e098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.615+0000 7ff45e098800 20 started sync module instance, tier type = 2024-09-12T00:47:50.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.615+0000 7ff45e098800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:50.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.624+0000 7ff45e098800 20 add_watcher() i=0 2024-09-12T00:47:50.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.624+0000 7ff45e098800 20 add_watcher() i=1 2024-09-12T00:47:50.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.624+0000 7ff45e098800 20 add_watcher() i=2 2024-09-12T00:47:50.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.624+0000 7ff45e098800 20 add_watcher() i=3 2024-09-12T00:47:50.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.624+0000 7ff45e098800 20 add_watcher() i=4 2024-09-12T00:47:50.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.624+0000 7ff45e098800 20 add_watcher() i=5 2024-09-12T00:47:50.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.624+0000 7ff45e098800 20 add_watcher() i=6 2024-09-12T00:47:50.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.625+0000 7ff45e098800 20 add_watcher() i=7 2024-09-12T00:47:50.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.625+0000 7ff45e098800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:50.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.627+0000 7ff311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:50.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.627+0000 7ff45e098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:50.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.627+0000 7ff45e098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:50.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.627+0000 7ff45e098800 5 note: GC not initialized 2024-09-12T00:47:50.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.627+0000 7ff310fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:50.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.628+0000 7ff45e098800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:50.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.628+0000 7ff45e098800 20 Filter name: none 2024-09-12T00:47:50.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.628+0000 7ff28a7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:50.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.628+0000 7ff45e098800 20 processing logshard = reshard.0000000000 2024-09-12T00:47:50.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.630+0000 7ff45e098800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:47:50.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.630+0000 7ff45e098800 20 processing logshard = reshard.0000000001 2024-09-12T00:47:50.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.632+0000 7ff45e098800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:47:50.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.632+0000 7ff45e098800 20 processing logshard = reshard.0000000002 2024-09-12T00:47:50.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.634+0000 7ff45e098800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:47:50.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.635+0000 7ff45e098800 20 processing logshard = reshard.0000000003 2024-09-12T00:47:50.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.637+0000 7ff45e098800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:47:50.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.637+0000 7ff45e098800 20 processing logshard = reshard.0000000004 2024-09-12T00:47:50.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.639+0000 7ff45e098800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:47:50.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.639+0000 7ff45e098800 20 processing logshard = reshard.0000000005 2024-09-12T00:47:50.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.641+0000 7ff45e098800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:47:50.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.641+0000 7ff45e098800 20 processing logshard = reshard.0000000006 2024-09-12T00:47:50.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 20 process_entry resharding a-bucket 2024-09-12T00:47:50.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:47:50.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:50.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:47:50.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:47:50.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:47:50.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:50.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:50.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:50.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:50.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.643+0000 7ff45e098800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:50.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.644+0000 7ff45e098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:47:50.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.648+0000 7ff45e098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:50.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.648+0000 7ff45e098800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:50.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.648+0000 7ff45e098800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:50.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.648+0000 7ff45e098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.648+0000 7ff33affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94104993826656 notifier 5840 bl.length()=911 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.648+0000 7ff33affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.648+0000 7ff33affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.648+0000 7ff33affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.649+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.649+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.649+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.649+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.651+0000 7ff45e098800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:47:50.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.651+0000 7ff45e098800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:47:50.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.651+0000 7ff45e098800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:47:50.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.651+0000 7ff45e098800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:47:50.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.651+0000 7ff45e098800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:47:50.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.651+0000 7ff45e098800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:47:50.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.651+0000 7ff45e098800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.0 2024-09-12T00:47:50.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.651+0000 7ff45e098800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.0 2024-09-12T00:47:50.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.652+0000 7ff45e098800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.1 2024-09-12T00:47:50.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.652+0000 7ff45e098800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.1 2024-09-12T00:47:50.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.654+0000 7ff45e098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:50.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.654+0000 7ff45e098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:47:50.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff45e098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:50.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff45e098800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:50.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff45e098800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:50.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff45e098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:47:50.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff33affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464348 cookie 94104993826656 notifier 5840 bl.length()=911 2024-09-12T00:47:50.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff33affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:50.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff33affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:50.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff33affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:50.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:47:50.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:47:50.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:47:50.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.655+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:47:50.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.657+0000 7ff45e098800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.0 2024-09-12T00:47:50.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.657+0000 7ff45e098800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.0 2024-09-12T00:47:50.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.657+0000 7ff45e098800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.1 2024-09-12T00:47:50.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.657+0000 7ff45e098800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.1.1 2024-09-12T00:47:50.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.657+0000 7ff45e098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:50.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.657+0000 7ff45e098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:47:50.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff45e098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:50.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff45e098800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff45e098800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff45e098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff33a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464349 cookie 94104993826656 notifier 5840 bl.length()=879 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff33a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff33a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff33a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:47:50.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.659+0000 7ff45e098800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:47:50.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.660+0000 7ff45e098800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T00:47:50.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.661+0000 7ff45e098800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:47:50.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.663+0000 7ff45e098800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:47:50.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.663+0000 7ff45e098800 20 processing logshard = reshard.0000000007 2024-09-12T00:47:50.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.666+0000 7ff45e098800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:47:50.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.666+0000 7ff45e098800 20 processing logshard = reshard.0000000008 2024-09-12T00:47:50.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.668+0000 7ff45e098800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:47:50.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.668+0000 7ff45e098800 20 processing logshard = reshard.0000000009 2024-09-12T00:47:50.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.670+0000 7ff45e098800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:47:50.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.670+0000 7ff45e098800 20 processing logshard = reshard.0000000010 2024-09-12T00:47:50.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.673+0000 7ff45e098800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:47:50.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.673+0000 7ff45e098800 20 processing logshard = reshard.0000000011 2024-09-12T00:47:50.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.676+0000 7ff45e098800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:47:50.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.676+0000 7ff45e098800 20 processing logshard = reshard.0000000012 2024-09-12T00:47:50.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.678+0000 7ff45e098800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:47:50.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.678+0000 7ff45e098800 20 processing logshard = reshard.0000000013 2024-09-12T00:47:50.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.681+0000 7ff45e098800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:47:50.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.681+0000 7ff45e098800 20 processing logshard = reshard.0000000014 2024-09-12T00:47:50.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.683+0000 7ff45e098800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:47:50.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.683+0000 7ff45e098800 20 processing logshard = reshard.0000000015 2024-09-12T00:47:50.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.685+0000 7ff45e098800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:47:50.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.686+0000 7ff311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:50.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.688+0000 7ff45e098800 20 remove_watcher() i=0 2024-09-12T00:47:50.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.688+0000 7ff45e098800 2 removed watcher, disabling cache 2024-09-12T00:47:50.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.689+0000 7ff45e098800 20 remove_watcher() i=1 2024-09-12T00:47:50.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.690+0000 7ff45e098800 20 remove_watcher() i=2 2024-09-12T00:47:50.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.691+0000 7ff45e098800 20 remove_watcher() i=3 2024-09-12T00:47:50.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.692+0000 7ff45e098800 20 remove_watcher() i=4 2024-09-12T00:47:50.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.693+0000 7ff45e098800 20 remove_watcher() i=5 2024-09-12T00:47:50.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.694+0000 7ff45e098800 20 remove_watcher() i=6 2024-09-12T00:47:50.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.695+0000 7ff45e098800 20 remove_watcher() i=7 2024-09-12T00:47:50.705 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:47:50.735 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:50.736 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:50.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.773+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.775+0000 7feef5c17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.775+0000 7feef5c17800 20 realm 2024-09-12T00:47:50.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.775+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.775+0000 7feef5c17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.775+0000 7feef5c17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:50.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.775+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.776+0000 7feef5c17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.776+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.776+0000 7feef5c17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:50.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.776+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.777+0000 7feef5c17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:50.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.777+0000 7feef5c17800 20 searching for the correct realm 2024-09-12T00:47:50.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.780+0000 7feeebfff640 0 -- 172.21.15.83:0/3117446067 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7feedc060820 msgr2=0x7feedc0176f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:50.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.783+0000 7feef13e7640 0 -- 172.21.15.83:0/3117446067 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7feeec00e040 msgr2=0x7feeec065320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:50.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.787+0000 7feef5c17800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:50.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.787+0000 7feef5c17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:50.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.787+0000 7feef5c17800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:50.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.787+0000 7feef5c17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:50.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.787+0000 7feef5c17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:50.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.787+0000 7feef5c17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:50.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.787+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.787+0000 7feef5c17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.787+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:50.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:50.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 20 zone default found 2024-09-12T00:47:50.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 4 Realm: () 2024-09-12T00:47:50.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:50.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:50.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:50.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 20 zonegroup default 2024-09-12T00:47:50.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.788+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.789+0000 7feef5c17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.789+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.789+0000 7feef5c17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:50.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.789+0000 7feef5c17800 20 started sync module instance, tier type = 2024-09-12T00:47:50.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.789+0000 7feef5c17800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:50.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.797+0000 7feef5c17800 20 add_watcher() i=0 2024-09-12T00:47:50.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.797+0000 7feef5c17800 20 add_watcher() i=1 2024-09-12T00:47:50.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.797+0000 7feef5c17800 20 add_watcher() i=2 2024-09-12T00:47:50.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.797+0000 7feef5c17800 20 add_watcher() i=3 2024-09-12T00:47:50.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.797+0000 7feef5c17800 20 add_watcher() i=4 2024-09-12T00:47:50.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.797+0000 7feef5c17800 20 add_watcher() i=5 2024-09-12T00:47:50.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.797+0000 7feef5c17800 20 add_watcher() i=6 2024-09-12T00:47:50.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.798+0000 7feef5c17800 20 add_watcher() i=7 2024-09-12T00:47:50.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.798+0000 7feef5c17800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:50.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.800+0000 7feda7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:50.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.800+0000 7feef5c17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:50.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.800+0000 7feef5c17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.800+0000 7feef5c17800 5 note: GC not initialized 2024-09-12T00:47:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.800+0000 7feda6fe5640 20 reqs_thread_entry: start 2024-09-12T00:47:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.800+0000 7feef5c17800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.800+0000 7feef5c17800 20 Filter name: none 2024-09-12T00:47:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.800+0000 7feda4fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.800+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.801+0000 7feef5c17800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:50.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.801+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.801+0000 7feef5c17800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:50.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.801+0000 7feef5c17800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:50.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.801+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.802+0000 7feef5c17800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:47:50.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.802+0000 7feef5c17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:50.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.802+0000 7feef5c17800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:47:50.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.802+0000 7feef5c17800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:50.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.803+0000 7feda7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:50.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.805+0000 7feef5c17800 20 remove_watcher() i=0 2024-09-12T00:47:50.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.805+0000 7feef5c17800 2 removed watcher, disabling cache 2024-09-12T00:47:50.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.806+0000 7feef5c17800 20 remove_watcher() i=1 2024-09-12T00:47:50.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.807+0000 7feef5c17800 20 remove_watcher() i=2 2024-09-12T00:47:50.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.808+0000 7feef5c17800 20 remove_watcher() i=3 2024-09-12T00:47:50.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.809+0000 7feef5c17800 20 remove_watcher() i=4 2024-09-12T00:47:50.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.810+0000 7feef5c17800 20 remove_watcher() i=5 2024-09-12T00:47:50.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.811+0000 7feef5c17800 20 remove_watcher() i=6 2024-09-12T00:47:50.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:50.812+0000 7feef5c17800 20 remove_watcher() i=7 2024-09-12T00:47:50.821 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:50.821 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:50.821 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: ad4424e4-de7c-4376-b125-e717016a3484.4511.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:47:50.822 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:50.822 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:47:50.822 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:50.823 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.823 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.834 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.834 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.877 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.877 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.885 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.885 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.892 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.892 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.900 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.900 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.907 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.907 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.915 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.916 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.923 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.923 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.931 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.931 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.938 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.938 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.946 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.947 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.955 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.955 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.963 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.963 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.971 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.971 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.979 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.979 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.987 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.987 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:50.994 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:50.994 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:51.002 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:51.003 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:51.010 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:51.010 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:51.018 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:51.018 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:51.026 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:51.026 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:51.034 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:47:51.062 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:51.062 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:51.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.099+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.101+0000 7f3a1da20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.102+0000 7f3a1da20800 20 realm 2024-09-12T00:47:51.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.102+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.102+0000 7f3a1da20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.102+0000 7f3a1da20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:51.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.102+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.102+0000 7f3a1da20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.102+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.103+0000 7f3a1da20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:51.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.103+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.103+0000 7f3a1da20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:51.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.103+0000 7f3a1da20800 20 searching for the correct realm 2024-09-12T00:47:51.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.107+0000 7f3a1bd12640 0 -- 172.21.15.83:0/1305651510 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f3a04033420 msgr2=0x7f3a04033840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:51.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.109+0000 7f3a1b511640 0 -- 172.21.15.83:0/1305651510 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f3a1406c0b0 msgr2=0x7f3a1408f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:51.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:51.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:51.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:51.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:51.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:51.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:51.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:51.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.113+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:51.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 20 zone default found 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 4 Realm: () 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 20 zonegroup default 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.114+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.115+0000 7f3a1da20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.115+0000 7f3a1da20800 20 started sync module instance, tier type = 2024-09-12T00:47:51.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.115+0000 7f3a1da20800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:51.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.136+0000 7f3a1da20800 20 add_watcher() i=0 2024-09-12T00:47:51.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.136+0000 7f3a1da20800 20 add_watcher() i=1 2024-09-12T00:47:51.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.136+0000 7f3a1da20800 20 add_watcher() i=2 2024-09-12T00:47:51.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.136+0000 7f3a1da20800 20 add_watcher() i=3 2024-09-12T00:47:51.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.136+0000 7f3a1da20800 20 add_watcher() i=4 2024-09-12T00:47:51.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.136+0000 7f3a1da20800 20 add_watcher() i=5 2024-09-12T00:47:51.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.136+0000 7f3a1da20800 20 add_watcher() i=6 2024-09-12T00:47:51.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.137+0000 7f3a1da20800 20 add_watcher() i=7 2024-09-12T00:47:51.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.137+0000 7f3a1da20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:51.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.139+0000 7f38d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:51.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.139+0000 7f3a1da20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:51.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.139+0000 7f3a1da20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:51.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.139+0000 7f3a1da20800 5 note: GC not initialized 2024-09-12T00:47:51.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.139+0000 7f38d0fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:51.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.139+0000 7f3a1da20800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:51.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.139+0000 7f3a1da20800 20 Filter name: none 2024-09-12T00:47:51.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.139+0000 7f384a7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:51.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.139+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.140+0000 7f3a1da20800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:51.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.140+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.141+0000 7f3a1da20800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:51.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.141+0000 7f3a1da20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:51.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.141+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.141+0000 7f3a1da20800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:51.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.141+0000 7f3a1da20800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.142+0000 7f3a1da20800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:51.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.142+0000 7f3a1da20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:51.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.143+0000 7f38d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:51.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.145+0000 7f3a1da20800 20 remove_watcher() i=0 2024-09-12T00:47:51.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.145+0000 7f3a1da20800 2 removed watcher, disabling cache 2024-09-12T00:47:51.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.146+0000 7f3a1da20800 20 remove_watcher() i=1 2024-09-12T00:47:51.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.147+0000 7f3a1da20800 20 remove_watcher() i=2 2024-09-12T00:47:51.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.148+0000 7f3a1da20800 20 remove_watcher() i=3 2024-09-12T00:47:51.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.148+0000 7f3a1da20800 20 remove_watcher() i=4 2024-09-12T00:47:51.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.150+0000 7f3a1da20800 20 remove_watcher() i=5 2024-09-12T00:47:51.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.150+0000 7f3a1da20800 20 remove_watcher() i=6 2024-09-12T00:47:51.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.151+0000 7f3a1da20800 20 remove_watcher() i=7 2024-09-12T00:47:51.161 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:51.161 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:51.161 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-init-index id: ad4424e4-de7c-4376-b125-e717016a3484.4511.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:47:51.161 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:51.162 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:47:51.196 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:51.197 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:51.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.235+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.236+0000 7f0e852bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.236+0000 7f0e852bb800 20 realm 2024-09-12T00:47:51.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.236+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.236+0000 7f0e852bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.236+0000 7f0e852bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:51.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.236+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.237+0000 7f0e852bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.237+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.237+0000 7f0e852bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:51.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.237+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.237+0000 7f0e852bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:51.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.237+0000 7f0e852bb800 20 searching for the correct realm 2024-09-12T00:47:51.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.241+0000 7f0e835a6640 0 -- 172.21.15.83:0/151335345 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f0e7808c920 msgr2=0x7f0e78064440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:51.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.244+0000 7f0e82da5640 0 -- 172.21.15.83:0/151335345 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f0e7c017020 msgr2=0x7f0e7c039440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:51.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.248+0000 7f0e852bb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:51.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.248+0000 7f0e852bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:51.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.248+0000 7f0e852bb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:51.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.248+0000 7f0e852bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:51.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.248+0000 7f0e852bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:51.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.248+0000 7f0e852bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:51.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.248+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.248+0000 7f0e852bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.248+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 zone default found 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 4 Realm: () 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 zonegroup default 2024-09-12T00:47:51.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.249+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.250+0000 7f0e852bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.250+0000 7f0e852bb800 20 started sync module instance, tier type = 2024-09-12T00:47:51.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.250+0000 7f0e852bb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:51.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.258+0000 7f0e852bb800 20 add_watcher() i=0 2024-09-12T00:47:51.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.258+0000 7f0e852bb800 20 add_watcher() i=1 2024-09-12T00:47:51.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.258+0000 7f0e852bb800 20 add_watcher() i=2 2024-09-12T00:47:51.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.258+0000 7f0e852bb800 20 add_watcher() i=3 2024-09-12T00:47:51.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.258+0000 7f0e852bb800 20 add_watcher() i=4 2024-09-12T00:47:51.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.258+0000 7f0e852bb800 20 add_watcher() i=5 2024-09-12T00:47:51.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.258+0000 7f0e852bb800 20 add_watcher() i=6 2024-09-12T00:47:51.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.259+0000 7f0e852bb800 20 add_watcher() i=7 2024-09-12T00:47:51.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.259+0000 7f0e852bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:51.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.260+0000 7f0d397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:51.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.261+0000 7f0e852bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:51.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.261+0000 7f0e852bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:51.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.261+0000 7f0e852bb800 5 note: GC not initialized 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.261+0000 7f0cb3fff640 20 reqs_thread_entry: start 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.261+0000 7f0e852bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.261+0000 7f0e852bb800 20 Filter name: none 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.261+0000 7f0cb1ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.261+0000 7f0e852bb800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.261+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 : miss 2024-09-12T00:47:51.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:51.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 info.flags=0x17 2024-09-12T00:47:51.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 to cache LRU end 2024-09-12T00:47:51.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:51.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:51.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.262+0000 7f0e852bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 2024-09-12T00:47:51.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.263+0000 7f0e852bb800 -1 Injecting error=-5 at location=init_index 2024-09-12T00:47:51.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.263+0000 7f0e852bb800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:47:51.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.265+0000 7f0d397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:51.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.267+0000 7f0e852bb800 20 remove_watcher() i=0 2024-09-12T00:47:51.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.267+0000 7f0e852bb800 2 removed watcher, disabling cache 2024-09-12T00:47:51.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.268+0000 7f0e852bb800 20 remove_watcher() i=1 2024-09-12T00:47:51.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.269+0000 7f0e852bb800 20 remove_watcher() i=2 2024-09-12T00:47:51.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.270+0000 7f0e852bb800 20 remove_watcher() i=3 2024-09-12T00:47:51.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.272+0000 7f0e852bb800 20 remove_watcher() i=4 2024-09-12T00:47:51.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.273+0000 7f0e852bb800 20 remove_watcher() i=5 2024-09-12T00:47:51.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.274+0000 7f0e852bb800 20 remove_watcher() i=6 2024-09-12T00:47:51.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.274+0000 7f0e852bb800 20 remove_watcher() i=7 2024-09-12T00:47:51.285 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:47:51.314 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:51.314 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:51.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.357+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.359+0000 7f068920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.359+0000 7f068920f800 20 realm 2024-09-12T00:47:51.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.359+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.359+0000 7f068920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.359+0000 7f068920f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:51.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.359+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.359+0000 7f068920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.359+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.360+0000 7f068920f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:51.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.360+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.360+0000 7f068920f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:51.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.360+0000 7f068920f800 20 searching for the correct realm 2024-09-12T00:47:51.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.363+0000 7f067ffff640 0 -- 172.21.15.83:0/1537887746 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f06700649c0 msgr2=0x7f06700ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:51.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.569+0000 7f0685123640 0 -- 172.21.15.83:0/1537887746 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x563315ca4100 msgr2=0x563315ca6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:51.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.573+0000 7f068920f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:51.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.573+0000 7f068920f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:51.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.573+0000 7f068920f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:51.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.573+0000 7f068920f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.573+0000 7f068920f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.573+0000 7f068920f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.573+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 zone default found 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 4 Realm: () 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:51.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:51.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:51.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 zonegroup default 2024-09-12T00:47:51.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.574+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.575+0000 7f068920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.575+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.575+0000 7f068920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.575+0000 7f068920f800 20 started sync module instance, tier type = 2024-09-12T00:47:51.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.575+0000 7f068920f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:51.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.584+0000 7f068920f800 20 add_watcher() i=0 2024-09-12T00:47:51.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.584+0000 7f068920f800 20 add_watcher() i=1 2024-09-12T00:47:51.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.584+0000 7f068920f800 20 add_watcher() i=2 2024-09-12T00:47:51.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.584+0000 7f068920f800 20 add_watcher() i=3 2024-09-12T00:47:51.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.584+0000 7f068920f800 20 add_watcher() i=4 2024-09-12T00:47:51.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.584+0000 7f068920f800 20 add_watcher() i=5 2024-09-12T00:47:51.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.584+0000 7f068920f800 20 add_watcher() i=6 2024-09-12T00:47:51.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.585+0000 7f068920f800 20 add_watcher() i=7 2024-09-12T00:47:51.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.585+0000 7f068920f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:51.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.586+0000 7f053afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:51.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.587+0000 7f068920f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:51.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.587+0000 7f068920f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:51.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.587+0000 7f068920f800 5 note: GC not initialized 2024-09-12T00:47:51.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.587+0000 7f0539fe3640 20 reqs_thread_entry: start 2024-09-12T00:47:51.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.587+0000 7f068920f800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:51.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.587+0000 7f068920f800 20 Filter name: none 2024-09-12T00:47:51.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.587+0000 7f04ab7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:51.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.587+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.588+0000 7f068920f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:51.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.588+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.588+0000 7f068920f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:51.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.588+0000 7f068920f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:51.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.588+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.589+0000 7f068920f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:51.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.589+0000 7f068920f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.589+0000 7f068920f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:51.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.589+0000 7f068920f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:51.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.590+0000 7f053afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:51.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.592+0000 7f068920f800 20 remove_watcher() i=0 2024-09-12T00:47:51.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.592+0000 7f068920f800 2 removed watcher, disabling cache 2024-09-12T00:47:51.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.593+0000 7f068920f800 20 remove_watcher() i=1 2024-09-12T00:47:51.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.594+0000 7f068920f800 20 remove_watcher() i=2 2024-09-12T00:47:51.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.595+0000 7f068920f800 20 remove_watcher() i=3 2024-09-12T00:47:51.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.596+0000 7f068920f800 20 remove_watcher() i=4 2024-09-12T00:47:51.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.597+0000 7f068920f800 20 remove_watcher() i=5 2024-09-12T00:47:51.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.598+0000 7f068920f800 20 remove_watcher() i=6 2024-09-12T00:47:51.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.599+0000 7f068920f800 20 remove_watcher() i=7 2024-09-12T00:47:51.608 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:51.608 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:51.609 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-init-index id: ad4424e4-de7c-4376-b125-e717016a3484.4511.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:47:51.609 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:51.611 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:51.611 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:51.618 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:51.618 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:51.662 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:47:51.693 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:51.693 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:51.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.732+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.733+0000 7ff857f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.733+0000 7ff857f39800 20 realm 2024-09-12T00:47:51.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.733+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.733+0000 7ff857f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.733+0000 7ff857f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:51.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.733+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.734+0000 7ff857f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.734+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.734+0000 7ff857f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:51.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.734+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.735+0000 7ff857f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:51.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.735+0000 7ff857f39800 20 searching for the correct realm 2024-09-12T00:47:51.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.738+0000 7ff84bfff640 0 -- 172.21.15.83:0/1887471930 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff83c00cb00 msgr2=0x7ff83c060e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:51.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.742+0000 7ff8543c8640 0 -- 172.21.15.83:0/1887471930 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55a607c67ba0 msgr2=0x55a607c6a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:51.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.745+0000 7ff857f39800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:51.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.745+0000 7ff857f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:51.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.745+0000 7ff857f39800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:51.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.745+0000 7ff857f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:51.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.745+0000 7ff857f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:51.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.745+0000 7ff857f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:51.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.745+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:51.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:51.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 zone default found 2024-09-12T00:47:51.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 4 Realm: () 2024-09-12T00:47:51.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:51.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:51.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:51.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 zonegroup default 2024-09-12T00:47:51.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.746+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.747+0000 7ff857f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.747+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.747+0000 7ff857f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.747+0000 7ff857f39800 20 started sync module instance, tier type = 2024-09-12T00:47:51.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.747+0000 7ff857f39800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:51.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.755+0000 7ff857f39800 20 add_watcher() i=0 2024-09-12T00:47:51.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.755+0000 7ff857f39800 20 add_watcher() i=1 2024-09-12T00:47:51.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.755+0000 7ff857f39800 20 add_watcher() i=2 2024-09-12T00:47:51.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.755+0000 7ff857f39800 20 add_watcher() i=3 2024-09-12T00:47:51.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.755+0000 7ff857f39800 20 add_watcher() i=4 2024-09-12T00:47:51.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.755+0000 7ff857f39800 20 add_watcher() i=5 2024-09-12T00:47:51.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.756+0000 7ff857f39800 20 add_watcher() i=6 2024-09-12T00:47:51.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.757+0000 7ff857f39800 20 add_watcher() i=7 2024-09-12T00:47:51.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.757+0000 7ff857f39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:51.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.759+0000 7ff709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:51.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.759+0000 7ff857f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:51.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.759+0000 7ff857f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.759+0000 7ff857f39800 5 note: GC not initialized 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.759+0000 7ff708fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.759+0000 7ff857f39800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.760+0000 7ff857f39800 20 Filter name: none 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.760+0000 7ff6827fc640 20 reqs_thread_entry: start 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.760+0000 7ff857f39800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.760+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.760+0000 7ff857f39800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.760+0000 7ff857f39800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.760+0000 7ff857f39800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.760+0000 7ff857f39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 : miss 2024-09-12T00:47:51.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.760+0000 7ff857f39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.761+0000 7ff857f39800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:51.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.761+0000 7ff857f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 info.flags=0x17 2024-09-12T00:47:51.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.761+0000 7ff857f39800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 to cache LRU end 2024-09-12T00:47:51.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.761+0000 7ff857f39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:51.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.761+0000 7ff857f39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:51.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.761+0000 7ff857f39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 2024-09-12T00:47:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.764+0000 7ff857f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 info.flags=0x17 2024-09-12T00:47:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.764+0000 7ff857f39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 to cache LRU end 2024-09-12T00:47:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.764+0000 7ff857f39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.764+0000 7ff857f39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20, ofs0, ns] 2024-09-12T00:47:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.764+0000 7ff732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94171583449504 notifier 5924 bl.length()=995 2024-09-12T00:47:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.764+0000 7ff732ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 info.flags=0x17 2024-09-12T00:47:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.764+0000 7ff732ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 to cache LRU end 2024-09-12T00:47:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.764+0000 7ff732ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:51.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.765+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): orig_sources= new_sources= 2024-09-12T00:47:51.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.765+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): potential sources added=[] removed=[] 2024-09-12T00:47:51.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.765+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): orig_dests= new_dests= 2024-09-12T00:47:51.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.765+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): potential dests added=[] removed=[] 2024-09-12T00:47:51.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.767+0000 7ff857f39800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.20.1.0 2024-09-12T00:47:51.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.767+0000 7ff857f39800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.20.1.0 2024-09-12T00:47:51.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.767+0000 7ff857f39800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.20.1.1 2024-09-12T00:47:51.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.767+0000 7ff857f39800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.20.1.1 2024-09-12T00:47:51.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.767+0000 7ff857f39800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.20.0 2024-09-12T00:47:51.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.769+0000 7ff857f39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:51.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.769+0000 7ff857f39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 2024-09-12T00:47:51.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.770+0000 7ff857f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 info.flags=0x17 2024-09-12T00:47:51.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.770+0000 7ff857f39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 to cache LRU end 2024-09-12T00:47:51.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.770+0000 7ff857f39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:51.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.770+0000 7ff857f39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20, ofs0, ns] 2024-09-12T00:47:51.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.770+0000 7ff732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 94171583449504 notifier 5924 bl.length()=995 2024-09-12T00:47:51.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.770+0000 7ff732ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 info.flags=0x17 2024-09-12T00:47:51.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.770+0000 7ff732ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 to cache LRU end 2024-09-12T00:47:51.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.770+0000 7ff732ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:51.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.771+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): orig_sources= new_sources= 2024-09-12T00:47:51.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.771+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): potential sources added=[] removed=[] 2024-09-12T00:47:51.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.771+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): orig_dests= new_dests= 2024-09-12T00:47:51.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.771+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): potential dests added=[] removed=[] 2024-09-12T00:47:51.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.772+0000 7ff857f39800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.20.0 2024-09-12T00:47:51.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.772+0000 7ff857f39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:51.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.772+0000 7ff857f39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 2024-09-12T00:47:51.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.773+0000 7ff857f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 info.flags=0x17 2024-09-12T00:47:51.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.773+0000 7ff857f39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 to cache LRU end 2024-09-12T00:47:51.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.773+0000 7ff857f39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:51.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.773+0000 7ff857f39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20, ofs0, ns] 2024-09-12T00:47:51.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.773+0000 7ff7327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94171583449504 notifier 5924 bl.length()=963 2024-09-12T00:47:51.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.773+0000 7ff7327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 info.flags=0x17 2024-09-12T00:47:51.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.773+0000 7ff7327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.20 to cache LRU end 2024-09-12T00:47:51.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.773+0000 7ff7327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:51.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.774+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): orig_sources= new_sources= 2024-09-12T00:47:51.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.774+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): potential sources added=[] removed=[] 2024-09-12T00:47:51.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.774+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): orig_dests= new_dests= 2024-09-12T00:47:51.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.774+0000 7ff857f39800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.20]): potential dests added=[] removed=[] 2024-09-12T00:47:51.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.775+0000 7ff857f39800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:47:51.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.777+0000 7ff709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:51.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.779+0000 7ff857f39800 20 remove_watcher() i=0 2024-09-12T00:47:51.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.779+0000 7ff857f39800 2 removed watcher, disabling cache 2024-09-12T00:47:51.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.780+0000 7ff857f39800 20 remove_watcher() i=1 2024-09-12T00:47:51.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.781+0000 7ff857f39800 20 remove_watcher() i=2 2024-09-12T00:47:51.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.782+0000 7ff857f39800 20 remove_watcher() i=3 2024-09-12T00:47:51.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.783+0000 7ff857f39800 20 remove_watcher() i=4 2024-09-12T00:47:51.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.784+0000 7ff857f39800 20 remove_watcher() i=5 2024-09-12T00:47:51.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.784+0000 7ff857f39800 20 remove_watcher() i=6 2024-09-12T00:47:51.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.785+0000 7ff857f39800 20 remove_watcher() i=7 2024-09-12T00:47:51.796 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:47:51.825 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:51.825 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:51.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.863+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.864+0000 7fba16137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.864+0000 7fba16137800 20 realm 2024-09-12T00:47:51.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.864+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.865+0000 7fba16137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.865+0000 7fba16137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:51.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.865+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.865+0000 7fba16137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:51.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.865+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.865+0000 7fba16137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:51.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.866+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:51.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.866+0000 7fba16137800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:51.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.866+0000 7fba16137800 20 searching for the correct realm 2024-09-12T00:47:51.867 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:51.869+0000 7fba09620640 0 -- 172.21.15.83:0/2327276176 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fb9fc021470 msgr2=0x7fb9fc0218f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:52.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.075+0000 7fba12622640 0 -- 172.21.15.83:0/2327276176 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x557fa0dca480 msgr2=0x557fa0dcc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:52.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.079+0000 7fba16137800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:52.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.079+0000 7fba16137800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:52.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.079+0000 7fba16137800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:52.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.079+0000 7fba16137800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:52.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.079+0000 7fba16137800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:52.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.079+0000 7fba16137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:52.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.079+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:52.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 20 zone default found 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 4 Realm: () 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 20 zonegroup default 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.080+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.081+0000 7fba16137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.081+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.081+0000 7fba16137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.081+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.081+0000 7fba16137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.081+0000 7fba16137800 20 started sync module instance, tier type = 2024-09-12T00:47:52.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.081+0000 7fba16137800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:52.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.089+0000 7fba16137800 20 add_watcher() i=0 2024-09-12T00:47:52.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.089+0000 7fba16137800 20 add_watcher() i=1 2024-09-12T00:47:52.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.089+0000 7fba16137800 20 add_watcher() i=2 2024-09-12T00:47:52.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.089+0000 7fba16137800 20 add_watcher() i=3 2024-09-12T00:47:52.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.089+0000 7fba16137800 20 add_watcher() i=4 2024-09-12T00:47:52.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.089+0000 7fba16137800 20 add_watcher() i=5 2024-09-12T00:47:52.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.089+0000 7fba16137800 20 add_watcher() i=6 2024-09-12T00:47:52.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.090+0000 7fba16137800 20 add_watcher() i=7 2024-09-12T00:47:52.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.090+0000 7fba16137800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:52.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.092+0000 7fb8c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:52.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.092+0000 7fba16137800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:52.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.092+0000 7fba16137800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:52.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.092+0000 7fba16137800 5 note: GC not initialized 2024-09-12T00:47:52.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.092+0000 7fb8c27fc640 20 reqs_thread_entry: start 2024-09-12T00:47:52.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.092+0000 7fba16137800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:52.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.093+0000 7fba16137800 20 Filter name: none 2024-09-12T00:47:52.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.093+0000 7fb833fff640 20 reqs_thread_entry: start 2024-09-12T00:47:52.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.093+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.093+0000 7fba16137800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:52.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.093+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.094+0000 7fba16137800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:52.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.094+0000 7fba16137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:52.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.094+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.094+0000 7fba16137800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:52.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.095+0000 7fba16137800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.096+0000 7fba16137800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:52.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.096+0000 7fba16137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:52.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.097+0000 7fb8c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:52.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.099+0000 7fba16137800 20 remove_watcher() i=0 2024-09-12T00:47:52.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.099+0000 7fba16137800 2 removed watcher, disabling cache 2024-09-12T00:47:52.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.100+0000 7fba16137800 20 remove_watcher() i=1 2024-09-12T00:47:52.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.101+0000 7fba16137800 20 remove_watcher() i=2 2024-09-12T00:47:52.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.103+0000 7fba16137800 20 remove_watcher() i=3 2024-09-12T00:47:52.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.103+0000 7fba16137800 20 remove_watcher() i=4 2024-09-12T00:47:52.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.104+0000 7fba16137800 20 remove_watcher() i=5 2024-09-12T00:47:52.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.105+0000 7fba16137800 20 remove_watcher() i=6 2024-09-12T00:47:52.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.106+0000 7fba16137800 20 remove_watcher() i=7 2024-09-12T00:47:52.115 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:52.115 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:52.115 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-init-index id: ad4424e4-de7c-4376-b125-e717016a3484.4511.20 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:47:52.115 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:52.117 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.117 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.121 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.121 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.165 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.165 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.179 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:47:52.179 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:52.180 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.180 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.189 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.190 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.232 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.233 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.240 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.240 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.247 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.248 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.255 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.255 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.263 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.263 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.272 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.272 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.279 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.280 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.287 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.287 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.294 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.294 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.302 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.302 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.310 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.310 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.317 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.317 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.325 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.325 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.332 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.332 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.340 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.340 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.347 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.347 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.355 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.355 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.362 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.362 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.370 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.370 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.378 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:52.378 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:52.386 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:47:52.415 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:52.415 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:52.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.453+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.455+0000 7fe8feb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.455+0000 7fe8feb40800 20 realm 2024-09-12T00:47:52.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.455+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.455+0000 7fe8feb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.455+0000 7fe8feb40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:52.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.455+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.455+0000 7fe8feb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.455+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.456+0000 7fe8feb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:52.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.456+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.456+0000 7fe8feb40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:52.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.456+0000 7fe8feb40800 20 searching for the correct realm 2024-09-12T00:47:52.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.460+0000 7fe8fa085640 0 -- 172.21.15.83:0/3103039509 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fe8f002b3c0 msgr2=0x7fe8f002b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:52.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.665+0000 7fe8fb087640 0 -- 172.21.15.83:0/3103039509 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56459c110d60 msgr2=0x56459c113150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:52.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.669+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 zone default found 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 4 Realm: () 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 zonegroup default 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 started sync module instance, tier type = 2024-09-12T00:47:52.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.670+0000 7fe8feb40800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:52.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.680+0000 7fe8feb40800 20 add_watcher() i=0 2024-09-12T00:47:52.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.680+0000 7fe8feb40800 20 add_watcher() i=1 2024-09-12T00:47:52.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.680+0000 7fe8feb40800 20 add_watcher() i=2 2024-09-12T00:47:52.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.680+0000 7fe8feb40800 20 add_watcher() i=3 2024-09-12T00:47:52.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.680+0000 7fe8feb40800 20 add_watcher() i=4 2024-09-12T00:47:52.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.680+0000 7fe8feb40800 20 add_watcher() i=5 2024-09-12T00:47:52.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.680+0000 7fe8feb40800 20 add_watcher() i=6 2024-09-12T00:47:52.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.681+0000 7fe8feb40800 20 add_watcher() i=7 2024-09-12T00:47:52.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.681+0000 7fe8feb40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:52.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.682+0000 7fe7b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:52.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.683+0000 7fe8feb40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:52.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.683+0000 7fe8feb40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:52.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.683+0000 7fe8feb40800 5 note: GC not initialized 2024-09-12T00:47:52.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.683+0000 7fe72bfff640 20 reqs_thread_entry: start 2024-09-12T00:47:52.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.683+0000 7fe8feb40800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:52.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.683+0000 7fe8feb40800 20 Filter name: none 2024-09-12T00:47:52.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.683+0000 7fe729ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:52.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.683+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.684+0000 7fe8feb40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:52.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.684+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.684+0000 7fe8feb40800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:52.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.684+0000 7fe8feb40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:52.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.684+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.685+0000 7fe8feb40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:52.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.685+0000 7fe8feb40800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.685+0000 7fe8feb40800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:52.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.685+0000 7fe8feb40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:52.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.686+0000 7fe7b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:52.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.688+0000 7fe8feb40800 20 remove_watcher() i=0 2024-09-12T00:47:52.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.688+0000 7fe8feb40800 2 removed watcher, disabling cache 2024-09-12T00:47:52.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.689+0000 7fe8feb40800 20 remove_watcher() i=1 2024-09-12T00:47:52.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.690+0000 7fe8feb40800 20 remove_watcher() i=2 2024-09-12T00:47:52.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.691+0000 7fe8feb40800 20 remove_watcher() i=3 2024-09-12T00:47:52.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.692+0000 7fe8feb40800 20 remove_watcher() i=4 2024-09-12T00:47:52.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.693+0000 7fe8feb40800 20 remove_watcher() i=5 2024-09-12T00:47:52.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.694+0000 7fe8feb40800 20 remove_watcher() i=6 2024-09-12T00:47:52.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.695+0000 7fe8feb40800 20 remove_watcher() i=7 2024-09-12T00:47:52.703 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:52.703 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:52.703 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-init-index id: ad4424e4-de7c-4376-b125-e717016a3484.4511.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:47:52.704 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:52.705 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:47:52.741 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:52.741 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:52.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.780+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.781+0000 7ff5c990c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.781+0000 7ff5c990c800 20 realm 2024-09-12T00:47:52.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.781+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.781+0000 7ff5c990c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.781+0000 7ff5c990c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:52.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.781+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.782+0000 7ff5c990c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:52.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.782+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.782+0000 7ff5c990c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:52.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.782+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:52.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.783+0000 7ff5c990c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:52.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.783+0000 7ff5c990c800 20 searching for the correct realm 2024-09-12T00:47:52.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.785+0000 7ff5c73f6640 0 -- 172.21.15.83:0/2879571679 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7ff5b8026040 msgr2=0x7ff5b800d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:52.989 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:52.990+0000 7ff5c73f6640 0 -- 172.21.15.83:0/2879571679 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff5c0061070 msgr2=0x7ff5c00a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:53.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.197+0000 7ff5c990c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:53.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.197+0000 7ff5c990c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:53.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.197+0000 7ff5c990c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:53.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.197+0000 7ff5c990c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:53.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.197+0000 7ff5c990c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:53.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.197+0000 7ff5c990c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:53.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.197+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.197+0000 7ff5c990c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.197+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:53.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 20 zone default found 2024-09-12T00:47:53.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 4 Realm: () 2024-09-12T00:47:53.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:53.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:53.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:53.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 20 zonegroup default 2024-09-12T00:47:53.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.198+0000 7ff5c990c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.199+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.199+0000 7ff5c990c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.199+0000 7ff5c990c800 20 started sync module instance, tier type = 2024-09-12T00:47:53.202 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.199+0000 7ff5c990c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:53.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.207+0000 7ff5c990c800 20 add_watcher() i=0 2024-09-12T00:47:53.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.207+0000 7ff5c990c800 20 add_watcher() i=1 2024-09-12T00:47:53.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.207+0000 7ff5c990c800 20 add_watcher() i=2 2024-09-12T00:47:53.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.207+0000 7ff5c990c800 20 add_watcher() i=3 2024-09-12T00:47:53.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.207+0000 7ff5c990c800 20 add_watcher() i=4 2024-09-12T00:47:53.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.207+0000 7ff5c990c800 20 add_watcher() i=5 2024-09-12T00:47:53.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.207+0000 7ff5c990c800 20 add_watcher() i=6 2024-09-12T00:47:53.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.208+0000 7ff5c990c800 20 add_watcher() i=7 2024-09-12T00:47:53.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.208+0000 7ff5c990c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:53.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.210+0000 7ff47dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:53.211 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.210+0000 7ff5c990c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:53.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.210+0000 7ff5c990c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:53.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.210+0000 7ff5c990c800 5 note: GC not initialized 2024-09-12T00:47:53.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.210+0000 7ff47cfe1640 20 reqs_thread_entry: start 2024-09-12T00:47:53.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff5c990c800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:53.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff5c990c800 20 Filter name: none 2024-09-12T00:47:53.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff3f67fc640 20 reqs_thread_entry: start 2024-09-12T00:47:53.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff5c990c800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:47:53.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff5c990c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:53.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff5c990c800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:47:53.213 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff5c990c800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:47:53.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff5c990c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 : miss 2024-09-12T00:47:53.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.211+0000 7ff5c990c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.212+0000 7ff5c990c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:53.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.212+0000 7ff5c990c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 info.flags=0x17 2024-09-12T00:47:53.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.212+0000 7ff5c990c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 to cache LRU end 2024-09-12T00:47:53.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.212+0000 7ff5c990c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:53.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.212+0000 7ff5c990c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:53.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.212+0000 7ff5c990c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 2024-09-12T00:47:53.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.213+0000 7ff5c990c800 -1 Injecting error=-95 at location=init_index 2024-09-12T00:47:53.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.213+0000 7ff5c990c800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:47:53.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.215+0000 7ff5c990c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 info.flags=0x17 2024-09-12T00:47:53.217 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.215+0000 7ff5c990c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 to cache LRU end 2024-09-12T00:47:53.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.215+0000 7ff5c990c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:53.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.215+0000 7ff5c990c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21, ofs0, ns] 2024-09-12T00:47:53.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.215+0000 7ff4aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464352 cookie 94744885519904 notifier 5978 bl.length()=995 2024-09-12T00:47:53.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.215+0000 7ff4aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 info.flags=0x17 2024-09-12T00:47:53.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.215+0000 7ff4aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 to cache LRU end 2024-09-12T00:47:53.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.215+0000 7ff4aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:53.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.216+0000 7ff5c990c800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.21]): orig_sources= new_sources= 2024-09-12T00:47:53.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.216+0000 7ff5c990c800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.21]): potential sources added=[] removed=[] 2024-09-12T00:47:53.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.216+0000 7ff5c990c800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.21]): orig_dests= new_dests= 2024-09-12T00:47:53.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.216+0000 7ff5c990c800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.21]): potential dests added=[] removed=[] 2024-09-12T00:47:53.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.217+0000 7ff5c990c800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.21.1.0 2024-09-12T00:47:53.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.217+0000 7ff5c990c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.21.1.0 2024-09-12T00:47:53.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.217+0000 7ff5c990c800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.21.1.1 2024-09-12T00:47:53.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.217+0000 7ff5c990c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.21.1.1 2024-09-12T00:47:53.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.217+0000 7ff5c990c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.21.0 2024-09-12T00:47:53.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.219+0000 7ff5c990c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:53.222 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.219+0000 7ff5c990c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 2024-09-12T00:47:53.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.220+0000 7ff5c990c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 info.flags=0x17 2024-09-12T00:47:53.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.220+0000 7ff5c990c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 to cache LRU end 2024-09-12T00:47:53.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.220+0000 7ff5c990c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:53.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.220+0000 7ff5c990c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21, ofs0, ns] 2024-09-12T00:47:53.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.220+0000 7ff4aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464353 cookie 94744885519904 notifier 5978 bl.length()=963 2024-09-12T00:47:53.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.220+0000 7ff4aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 info.flags=0x17 2024-09-12T00:47:53.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.220+0000 7ff4aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ad4424e4-de7c-4376-b125-e717016a3484.4511.21 to cache LRU end 2024-09-12T00:47:53.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.220+0000 7ff4aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:53.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.221+0000 7ff5c990c800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.21]): orig_sources= new_sources= 2024-09-12T00:47:53.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.221+0000 7ff5c990c800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.21]): potential sources added=[] removed=[] 2024-09-12T00:47:53.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.221+0000 7ff5c990c800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.21]): orig_dests= new_dests= 2024-09-12T00:47:53.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.221+0000 7ff5c990c800 20 handle_bi_update(): bucket=:error-at-init-index[ad4424e4-de7c-4376-b125-e717016a3484.4511.21]): potential dests added=[] removed=[] 2024-09-12T00:47:53.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.222+0000 7ff5c990c800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:47:53.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.223+0000 7ff47dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:53.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.226+0000 7ff5c990c800 20 remove_watcher() i=0 2024-09-12T00:47:53.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.226+0000 7ff5c990c800 2 removed watcher, disabling cache 2024-09-12T00:47:53.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.227+0000 7ff5c990c800 20 remove_watcher() i=1 2024-09-12T00:47:53.226 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.228+0000 7ff5c990c800 20 remove_watcher() i=2 2024-09-12T00:47:53.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.229+0000 7ff5c990c800 20 remove_watcher() i=3 2024-09-12T00:47:53.228 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.230+0000 7ff5c990c800 20 remove_watcher() i=4 2024-09-12T00:47:53.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.230+0000 7ff5c990c800 20 remove_watcher() i=5 2024-09-12T00:47:53.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.231+0000 7ff5c990c800 20 remove_watcher() i=6 2024-09-12T00:47:53.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.232+0000 7ff5c990c800 20 remove_watcher() i=7 2024-09-12T00:47:53.242 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:47:53.271 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:53.271 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:53.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.308+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.310+0000 7fcfad1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.310+0000 7fcfad1af800 20 realm 2024-09-12T00:47:53.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.310+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.310+0000 7fcfad1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.310+0000 7fcfad1af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:53.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.310+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.310+0000 7fcfad1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.310+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.311+0000 7fcfad1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.311+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.311+0000 7fcfad1af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:53.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.311+0000 7fcfad1af800 20 searching for the correct realm 2024-09-12T00:47:53.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.315+0000 7fcfab49a640 0 -- 172.21.15.83:0/3231871930 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55846a6f1440 msgr2=0x55846a6f3830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.318+0000 7fcfaa498640 0 -- 172.21.15.83:0/3231871930 >> [v2:172.21.15.120:6800/3447039892,v1:172.21.15.120:6801/3447039892] conn(0x55846a6fa880 msgr2=0x55846a6fccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:53.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:53.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:53.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:53.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:53.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:53.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.321+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 zone default found 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 4 Realm: () 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 zonegroup default 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 started sync module instance, tier type = 2024-09-12T00:47:53.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.322+0000 7fcfad1af800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:53.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.330+0000 7fcfad1af800 20 add_watcher() i=0 2024-09-12T00:47:53.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.330+0000 7fcfad1af800 20 add_watcher() i=1 2024-09-12T00:47:53.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.330+0000 7fcfad1af800 20 add_watcher() i=2 2024-09-12T00:47:53.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.330+0000 7fcfad1af800 20 add_watcher() i=3 2024-09-12T00:47:53.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.330+0000 7fcfad1af800 20 add_watcher() i=4 2024-09-12T00:47:53.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.330+0000 7fcfad1af800 20 add_watcher() i=5 2024-09-12T00:47:53.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.330+0000 7fcfad1af800 20 add_watcher() i=6 2024-09-12T00:47:53.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.331+0000 7fcfad1af800 20 add_watcher() i=7 2024-09-12T00:47:53.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.331+0000 7fcfad1af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:53.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.333+0000 7fce617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.333+0000 7fcfad1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.333+0000 7fcfad1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.333+0000 7fcfad1af800 5 note: GC not initialized 2024-09-12T00:47:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.334+0000 7fcddbfff640 20 reqs_thread_entry: start 2024-09-12T00:47:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.334+0000 7fcfad1af800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.334+0000 7fcfad1af800 20 Filter name: none 2024-09-12T00:47:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.334+0000 7fcdd9ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:53.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.334+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.334+0000 7fcfad1af800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:53.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.334+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.335+0000 7fcfad1af800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:53.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.335+0000 7fcfad1af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:53.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.335+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.335+0000 7fcfad1af800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:47:53.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.335+0000 7fcfad1af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.335+0000 7fcfad1af800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:47:53.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.335+0000 7fcfad1af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:53.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.337+0000 7fce617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:53.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.339+0000 7fcfad1af800 20 remove_watcher() i=0 2024-09-12T00:47:53.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.339+0000 7fcfad1af800 2 removed watcher, disabling cache 2024-09-12T00:47:53.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.340+0000 7fcfad1af800 20 remove_watcher() i=1 2024-09-12T00:47:53.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.341+0000 7fcfad1af800 20 remove_watcher() i=2 2024-09-12T00:47:53.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.342+0000 7fcfad1af800 20 remove_watcher() i=3 2024-09-12T00:47:53.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.343+0000 7fcfad1af800 20 remove_watcher() i=4 2024-09-12T00:47:53.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.344+0000 7fcfad1af800 20 remove_watcher() i=5 2024-09-12T00:47:53.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.345+0000 7fcfad1af800 20 remove_watcher() i=6 2024-09-12T00:47:53.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.346+0000 7fcfad1af800 20 remove_watcher() i=7 2024-09-12T00:47:53.354 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.355 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:53.355 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-init-index id: ad4424e4-de7c-4376-b125-e717016a3484.4511.21 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:47:53.355 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.356 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.357 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.360 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.360 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.403 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.403 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.417 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:47:53.417 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.418 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.418 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.428 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.428 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.470 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.471 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.479 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.479 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.486 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.487 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.494 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.494 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.502 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.502 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.510 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.510 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.518 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.518 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.526 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.526 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.533 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.533 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.542 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.542 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.549 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.549 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.557 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.557 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.566 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.566 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.574 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.575 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.583 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.583 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.590 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.591 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.598 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.598 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.607 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.607 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.615 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.615 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.623 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:53.624 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:53.631 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:47:53.660 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:53.660 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:53.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.698+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.699+0000 7fe75d525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.699+0000 7fe75d525800 20 realm 2024-09-12T00:47:53.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.699+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.700+0000 7fe75d525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.700+0000 7fe75d525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:53.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.700+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.700+0000 7fe75d525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.700+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.700+0000 7fe75d525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.700+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.701+0000 7fe75d525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:53.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.701+0000 7fe75d525800 20 searching for the correct realm 2024-09-12T00:47:53.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.705+0000 7fe7599af640 0 -- 172.21.15.83:0/3456808312 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x556ca328a5f0 msgr2=0x556ca328c9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.708+0000 7fe7589ad640 0 -- 172.21.15.83:0/3456808312 >> [v2:172.21.15.120:6800/3447039892,v1:172.21.15.120:6801/3447039892] conn(0x556ca3293bd0 msgr2=0x556ca3295fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.712+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 20 zone default found 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 4 Realm: () 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 20 zonegroup default 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.713+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.714+0000 7fe75d525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.714+0000 7fe75d525800 20 started sync module instance, tier type = 2024-09-12T00:47:53.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.714+0000 7fe75d525800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:53.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.722+0000 7fe75d525800 20 add_watcher() i=0 2024-09-12T00:47:53.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.722+0000 7fe75d525800 20 add_watcher() i=1 2024-09-12T00:47:53.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.722+0000 7fe75d525800 20 add_watcher() i=2 2024-09-12T00:47:53.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.722+0000 7fe75d525800 20 add_watcher() i=3 2024-09-12T00:47:53.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.722+0000 7fe75d525800 20 add_watcher() i=4 2024-09-12T00:47:53.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.722+0000 7fe75d525800 20 add_watcher() i=5 2024-09-12T00:47:53.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.722+0000 7fe75d525800 20 add_watcher() i=6 2024-09-12T00:47:53.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.722+0000 7fe75d525800 20 add_watcher() i=7 2024-09-12T00:47:53.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.722+0000 7fe75d525800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:53.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.726+0000 7fe60f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:53.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.726+0000 7fe75d525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:53.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.726+0000 7fe75d525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:53.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.726+0000 7fe75d525800 5 note: GC not initialized 2024-09-12T00:47:53.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.726+0000 7fe60e7e4640 20 reqs_thread_entry: start 2024-09-12T00:47:53.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.726+0000 7fe75d525800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:53.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.726+0000 7fe75d525800 20 Filter name: none 2024-09-12T00:47:53.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.726+0000 7fe57ffff640 20 reqs_thread_entry: start 2024-09-12T00:47:53.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.726+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.727+0000 7fe75d525800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:47:53.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.727+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.728+0000 7fe75d525800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:47:53.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.728+0000 7fe75d525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:53.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.728+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.728+0000 7fe75d525800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:47:53.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.728+0000 7fe75d525800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.728+0000 7fe75d525800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:47:53.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.728+0000 7fe75d525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:53.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.730+0000 7fe60f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:53.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.732+0000 7fe75d525800 20 remove_watcher() i=0 2024-09-12T00:47:53.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.732+0000 7fe75d525800 2 removed watcher, disabling cache 2024-09-12T00:47:53.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.733+0000 7fe75d525800 20 remove_watcher() i=1 2024-09-12T00:47:53.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.734+0000 7fe75d525800 20 remove_watcher() i=2 2024-09-12T00:47:53.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.735+0000 7fe75d525800 20 remove_watcher() i=3 2024-09-12T00:47:53.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.736+0000 7fe75d525800 20 remove_watcher() i=4 2024-09-12T00:47:53.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.737+0000 7fe75d525800 20 remove_watcher() i=5 2024-09-12T00:47:53.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.738+0000 7fe75d525800 20 remove_watcher() i=6 2024-09-12T00:47:53.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.739+0000 7fe75d525800 20 remove_watcher() i=7 2024-09-12T00:47:53.747 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.748 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:53.748 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-init-indext id: ad4424e4-de7c-4376-b125-e717016a3484.4511.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:47:53.748 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.749 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:47:53.782 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:53.782 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:53.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.820+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.822+0000 7f89e7125800 20 realm 2024-09-12T00:47:53.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.822+0000 7f89e7125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:53.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.823+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.823+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.823+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:53.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.823+0000 7f89e7125800 20 searching for the correct realm 2024-09-12T00:47:53.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.827+0000 7f89e2532640 0 -- 172.21.15.83:0/3586711154 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f89d8024040 msgr2=0x7f89d803c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.830+0000 7f89e2d33640 0 -- 172.21.15.83:0/3586711154 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f89dc0b1160 msgr2=0x7f89dc0a70e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:53.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:53.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:53.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:53.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:53.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 zone default found 2024-09-12T00:47:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 4 Realm: () 2024-09-12T00:47:53.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:53.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:53.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:53.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 zonegroup default 2024-09-12T00:47:53.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.835+0000 7f89e7125800 20 started sync module instance, tier type = 2024-09-12T00:47:53.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.835+0000 7f89e7125800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:53.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=0 2024-09-12T00:47:53.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=1 2024-09-12T00:47:53.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=2 2024-09-12T00:47:53.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=3 2024-09-12T00:47:53.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=4 2024-09-12T00:47:53.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=5 2024-09-12T00:47:53.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=6 2024-09-12T00:47:53.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.844+0000 7f89e7125800 20 add_watcher() i=7 2024-09-12T00:47:53.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.844+0000 7f89e7125800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:53.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.846+0000 7f88997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:53.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.847+0000 7f89e7125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:53.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.847+0000 7f89e7125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:53.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.847+0000 7f89e7125800 5 note: GC not initialized 2024-09-12T00:47:53.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.847+0000 7f8813fff640 20 reqs_thread_entry: start 2024-09-12T00:47:53.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.847+0000 7f89e7125800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:53.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.847+0000 7f89e7125800 20 Filter name: none 2024-09-12T00:47:53.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.847+0000 7f8811ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:53.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.847+0000 7f89e7125800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:47:53.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.847+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:47:53.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:47:53.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:47:53.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 : miss 2024-09-12T00:47:53.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:47:53.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:47:53.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:47:53.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:53.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:53.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.848+0000 7f89e7125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 2024-09-12T00:47:53.849 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89e7125800 time 2024-09-12T00:47:53.850755+0000 2024-09-12T00:47:53.849 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:53.849 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:53.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f89e878c71a] 2024-09-12T00:47:53.849 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f89e878c8d8] 2024-09-12T00:47:53.849 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565004ae3641] 2024-09-12T00:47:53.849 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd877a4) [0x565004ff57a4] 2024-09-12T00:47:53.849 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x565004af331d] 2024-09-12T00:47:53.849 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:47:53.850 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f89e7429590] 2024-09-12T00:47:53.850 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:47:53.850 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:47:53.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.850+0000 7f89e7125800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89e7125800 time 2024-09-12T00:47:53.850755+0000 2024-09-12T00:47:53.850 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:53.850 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.850 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:53.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f89e878c71a] 2024-09-12T00:47:53.850 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f89e878c8d8] 2024-09-12T00:47:53.851 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565004ae3641] 2024-09-12T00:47:53.851 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd877a4) [0x565004ff57a4] 2024-09-12T00:47:53.851 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x565004af331d] 2024-09-12T00:47:53.851 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:47:53.851 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f89e7429590] 2024-09-12T00:47:53.851 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:47:53.851 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:47:53.852 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.852 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:47:53.852 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f89e7125800 thread_name:radosgw-admin 2024-09-12T00:47:53.872 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:53.872 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f89e743e6f0] 2024-09-12T00:47:53.872 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f89e748b99c] 2024-09-12T00:47:53.872 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:47:53.872 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f89e878c774] 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f89e878c8d8] 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565004ae3641] 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd877a4) [0x565004ff57a4] 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x565004af331d] 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f89e7429590] 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.851+0000 7f89e7125800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f89e7125800 thread_name:radosgw-admin 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.873 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f89e743e6f0] 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f89e748b99c] 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f89e878c774] 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f89e878c8d8] 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565004ae3641] 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd877a4) [0x565004ff57a4] 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x565004af331d] 2024-09-12T00:47:53.874 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f89e7429590] 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:47:53.803+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:47:53.803+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:47:53.803+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:47:53.803+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.875 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:47:53.803+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x565005ee1a10 auth_method 0 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:47:53.803+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:47:53.803+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:47:53.803+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:47:53.803+0000 7f89e2532640 10 monclient(hunting): handle_auth_done global_id 6017 payload 274 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:47:53.803+0000 7f89e2532640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:47:53.803+0000 7f89e2532640 1 monclient: found mon.noname-c 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:47:53.803+0000 7f89e2532640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: dump: 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.876 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: dump: 2024-09-12T00:47:53.877 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:47:53.803+0000 7f89e7125800 5 monclient: authenticate success, global_id 6017 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:47:53.803+0000 7f89e7125800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:47:53.803+0000 7f89e7125800 4 set_mon_vals no callback set 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:47:53.804+0000 7f89e7125800 10 monclient: shutdown 2024-09-12T00:47:53.878 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 asok(0x565005e0a630) unregister_commands rotate-key 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:47:53.804+0000 7f89e7125800 10 monclient: build_initial_monmap 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:47:53.804+0000 7f89e7125800 1 build_initial for_mkfs: 0 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:47:53.804+0000 7f89e7125800 10 monclient: monmap: 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.879 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding auth protocol: cephx 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding auth protocol: cephx 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding auth protocol: cephx 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.880 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:47:53.805+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:47:53.805+0000 7f89e7125800 1 librados: starting msgr at 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:47:53.805+0000 7f89e7125800 1 librados: starting objecter 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 asok(0x565005e0a630) register_command objecter_requests hook 0x56500602ef40 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:47:53.805+0000 7f89e7125800 1 librados: setting wanted keys 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:47:53.805+0000 7f89e7125800 1 librados: calling monclient init 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient: init 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding auth protocol: cephx 2024-09-12T00:47:53.881 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding auth protocol: cephx 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding auth protocol: cephx 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.882 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:47:53.805+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:47:53.805+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 asok(0x565005e0a630) register_command rotate-key hook 0x565006029b78 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-a con 0x565005ee1a10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-b con 0x565005f6d140 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-c con 0x565005f6f880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.883 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): authenticate will time out at 1827.074781s 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x565005ee1a10 auth_method 0 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): get_auth_request con 0x565005f6f880 auth_method 0 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.884 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:47:53.806+0000 7f89e2d33640 10 monclient(hunting): handle_auth_done global_id 6390 payload 824 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:47:53.806+0000 7f89e2d33640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:47:53.806+0000 7f89e2d33640 1 monclient: found mon.noname-a 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:47:53.806+0000 7f89e2d33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: dump: 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.885 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: dump: 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.886 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:47:53.806+0000 7f89e7125800 5 monclient: authenticate success, global_id 6390 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:47:53.806+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:47:53.806+0000 7f89e7125800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:47:53.806+0000 7f88d0e09640 4 set_mon_vals no callback set 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:47:53.806+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:47:53.806+0000 7f89e7125800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:47:53.806+0000 7f89e7125800 1 librados: init done 2024-09-12T00:47:53.887 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:47:53.808+0000 7f88cf606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:47:53.808+0000 7f88cf606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:47:53.808+0000 7f88cf606640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:47:53.808+0000 7f89e2532640 10 monclient: get_auth_request con 0x7f88c8076470 auth_method 0 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:47:53.809+0000 7f89e3534640 10 monclient: get_auth_request con 0x565006052260 auth_method 0 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:47:53.809+0000 7f89e2d33640 10 monclient: get_auth_request con 0x565006075220 auth_method 0 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:47:53.810+0000 7f89e2532640 10 monclient: get_auth_request con 0x56500607a2b0 auth_method 0 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:47:53.811+0000 7f89e7125800 10 monclient: build_initial_monmap 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:47:53.811+0000 7f89e7125800 1 build_initial for_mkfs: 0 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:47:53.811+0000 7f89e7125800 10 monclient: monmap: 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:53.888 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding auth protocol: cephx 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding auth protocol: cephx 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding auth protocol: cephx 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.889 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:47:53.811+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 asok(0x565005e0a630) register_command objecter_requests cmddesc objecter_requests hook 0x565006081d60 EEXIST 2024-09-12T00:47:53.890 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:47:53.811+0000 7f89e7125800 10 monclient: init 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding auth protocol: cephx 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding auth protocol: cephx 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding auth protocol: cephx 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.891 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:47:53.812+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:47:53.812+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:47:53.812+0000 7f89e7125800 5 asok(0x565005e0a630) register_command rotate-key cmddesc rotate-key hook 0x56500607d430 EEXIST 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-b con 0x5650060ab9a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-c con 0x5650060a4390 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-a con 0x5650060a6ea0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.892 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): authenticate will time out at 1827.081555s 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): get_auth_request con 0x5650060a4390 auth_method 0 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): get_auth_request con 0x5650060a6ea0 auth_method 0 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.893 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x5650060ab9a0 auth_method 0 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): handle_auth_done global_id 6393 payload 824 2024-09-12T00:47:53.894 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:47:53.812+0000 7f89e3534640 1 monclient: found mon.noname-a 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: dump: 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.895 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: dump: 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.896 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.897 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.897 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.897 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.897 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.897 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.897 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.897 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.897 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:47:53.813+0000 7f89e7125800 5 monclient: authenticate success, global_id 6393 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:47:53.813+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:47:53.813+0000 7f89e7125800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:47:53.813+0000 7f89e3d35640 4 set_mon_vals no callback set 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:47:53.813+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:47:53.813+0000 7f89e7125800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:47:53.815+0000 7f88cce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:47:53.815+0000 7f88cce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:47:53.815+0000 7f88cce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:47:53.815+0000 7f89e2d33640 10 monclient: get_auth_request con 0x7f88bc0763b0 auth_method 0 2024-09-12T00:47:53.898 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:47:53.815+0000 7f89e7125800 10 monclient: get_monmap_and_config 2024-09-12T00:47:53.899 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:47:53.815+0000 7f89e7125800 10 monclient: build_initial_monmap 2024-09-12T00:47:53.899 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:47:53.815+0000 7f89e7125800 1 build_initial for_mkfs: 0 2024-09-12T00:47:53.899 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:47:53.815+0000 7f89e7125800 10 monclient: monmap: 2024-09-12T00:47:53.899 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:47:53.899 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:53.899 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:47:53.899 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:47:53.899 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:53.899 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding auth protocol: cephx 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding auth protocol: cephx 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding auth protocol: cephx 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.900 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:47:53.815+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:47:53.815+0000 7f89e7125800 10 monclient: init 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding auth protocol: cephx 2024-09-12T00:47:53.901 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding auth protocol: cephx 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding auth protocol: cephx 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.902 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:47:53.816+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:47:53.816+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:47:53.816+0000 7f89e7125800 5 asok(0x565005e0a630) register_command rotate-key cmddesc rotate-key hook 0x7fff34b30208 EEXIST 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-a con 0x5650060fafd0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:47:53.903 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-c con 0x5650060eb920 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:47:53.904 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-b con 0x5650060f6400 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:47:53.904 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.904 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.904 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.904 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:53.904 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): authenticate will time out at 1827.085446s 2024-09-12T00:47:53.904 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x5650060fafd0 auth_method 0 2024-09-12T00:47:53.904 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.904 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): get_auth_request con 0x5650060eb920 auth_method 0 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.905 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): handle_auth_done global_id 6396 payload 274 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:47:53.816+0000 7f89e2d33640 1 monclient: found mon.noname-a 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: dump: 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.906 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: dump: 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.907 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 monclient: authenticate success, global_id 6396 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:47:53.817+0000 7f89e7125800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:47:53.817+0000 7f89e7125800 4 set_mon_vals no callback set 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:47:53.817+0000 7f89e7125800 10 monclient: shutdown 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:47:53.817+0000 7f89e7125800 10 monclient: build_initial_monmap 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:47:53.817+0000 7f89e7125800 1 build_initial for_mkfs: 0 2024-09-12T00:47:53.908 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:47:53.817+0000 7f89e7125800 10 monclient: monmap: 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding auth protocol: cephx 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding auth protocol: cephx 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding auth protocol: cephx 2024-09-12T00:47:53.909 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.910 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:47:53.817+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:47:53.817+0000 7f89e7125800 1 librados: starting msgr at 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:47:53.817+0000 7f89e7125800 1 librados: starting objecter 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 asok(0x565005e0a630) register_command objecter_requests cmddesc objecter_requests hook 0x5650060cc710 EEXIST 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:47:53.818+0000 7f89e7125800 1 librados: setting wanted keys 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:47:53.818+0000 7f89e7125800 1 librados: calling monclient init 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient: init 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding auth protocol: cephx 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding auth protocol: cephx 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding auth protocol: cephx 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.911 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:47:53.818+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:47:53.818+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.912 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 asok(0x565005e0a630) register_command rotate-key cmddesc rotate-key hook 0x565005eb4678 EEXIST 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-c con 0x5650060eb920 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-b con 0x5650060f6400 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-a con 0x5650060fafd0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): authenticate will time out at 1827.087612s 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x5650060eb920 auth_method 0 2024-09-12T00:47:53.913 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): get_auth_request con 0x5650060fafd0 auth_method 0 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.914 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:47:53.818+0000 7f89e2532640 10 monclient(hunting): get_auth_request con 0x5650060f6400 auth_method 0 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:47:53.818+0000 7f89e2532640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:47:53.818+0000 7f89e2532640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:47:53.818+0000 7f89e2532640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:47:53.818+0000 7f89e2d33640 1 monclient: found mon.noname-c 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: dump: 2024-09-12T00:47:53.915 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.916 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: dump: 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:47:53.819+0000 7f89e7125800 5 monclient: authenticate success, global_id 6029 2024-09-12T00:47:53.917 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:47:53.819+0000 7f88c67fc640 4 set_mon_vals no callback set 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:47:53.819+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:47:53.819+0000 7f89e7125800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:47:53.819+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:47:53.819+0000 7f89e7125800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:47:53.819+0000 7f89e7125800 1 librados: init done 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:47:53.819+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cr dump hook 0x5650060f6f78 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:47:53.820+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:47:53.821+0000 7f88c4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:47:53.821+0000 7f88c4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:47:53.821+0000 7f88c4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:47:53.821+0000 7f89e2532640 10 monclient: get_auth_request con 0x7f88ac076470 auth_method 0 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:47:53.821+0000 7f89e3534640 10 monclient: get_auth_request con 0x565006115550 auth_method 0 2024-09-12T00:47:53.918 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 realm 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:47:53.822+0000 7f89e7125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:47:53.823+0000 7f89e2d33640 10 monclient: get_auth_request con 0x5650061198c0 auth_method 0 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:47:53.823+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:47:53.823+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:47:53.823+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:47:53.823+0000 7f89e7125800 20 searching for the correct realm 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:47:53.824+0000 7f89e2532640 10 monclient: get_auth_request con 0x56500611ea30 auth_method 0 2024-09-12T00:47:53.919 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:47:53.824+0000 7f89e3534640 10 monclient: get_auth_request con 0x7f89d803d040 auth_method 0 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:47:53.825+0000 7f89e2d33640 10 monclient: get_auth_request con 0x7f89d4018070 auth_method 0 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:47:53.826+0000 7f89e2532640 10 monclient: get_auth_request con 0x7f89d8024040 auth_method 0 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:47:53.827+0000 7f89e2532640 0 -- 172.21.15.83:0/3586711154 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f89d8024040 msgr2=0x7f89d803c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:47:53.827+0000 7f88c4ff9640 1 client.6029.objecter ms_handle_reset 0x7f89d8024040 session 0x7f89d803ee70 osd.5 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:47:53.827+0000 7f88c4ff9640 10 monclient: _renew_subs 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:47:53.827+0000 7f88c4ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:47:53.827+0000 7f89e2532640 10 monclient: get_auth_request con 0x7f88ac086790 auth_method 0 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:47:53.828+0000 7f89e3534640 10 monclient: get_auth_request con 0x7f89d4073940 auth_method 0 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:47:53.829+0000 7f89e2d33640 10 monclient: get_auth_request con 0x7f89dc0b1160 auth_method 0 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:47:53.830+0000 7f89e2d33640 0 -- 172.21.15.83:0/3586711154 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f89dc0b1160 msgr2=0x7f89dc0a70e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:47:53.830+0000 7f88c4ff9640 1 client.6029.objecter ms_handle_reset 0x7f89dc0b1160 session 0x7f89dc068050 osd.3 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:47:53.830+0000 7f89e2d33640 10 monclient: get_auth_request con 0x7f89d8024040 auth_method 0 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:53.920 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 zone default found 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:47:53.834+0000 7f89e7125800 4 Realm: () 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:47:53.834+0000 7f89e7125800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:53.921 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:47:53.834+0000 7f89e7125800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:47:53.834+0000 7f89e7125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 zonegroup default 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 started sync module instance, tier type = 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=0 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=1 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=2 2024-09-12T00:47:53.922 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=3 2024-09-12T00:47:53.923 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=4 2024-09-12T00:47:53.923 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=5 2024-09-12T00:47:53.923 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=6 2024-09-12T00:47:53.923 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:47:53.844+0000 7f89e7125800 20 add_watcher() i=7 2024-09-12T00:47:53.923 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:47:53.844+0000 7f89e7125800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:53.923 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding auth protocol: cephx 2024-09-12T00:47:53.924 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding auth protocol: cephx 2024-09-12T00:47:53.924 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding auth protocol: cephx 2024-09-12T00:47:53.924 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:47:53.846+0000 7f88997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.925 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:47:53.847+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cache list hook 0x5650060f36f0 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cache inspect hook 0x5650060f36f0 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cache erase hook 0x5650060f36f0 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cache zap hook 0x5650060f36f0 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 note: GC not initialized 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:47:53.847+0000 7f8813fff640 20 reqs_thread_entry: start 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command sync trace show hook 0x7f89d4064050 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command sync trace history hook 0x7f89d4064050 2024-09-12T00:47:53.926 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command sync trace active hook 0x7f89d4064050 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command sync trace active_short hook 0x7f89d4064050 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 Filter name: none 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:47:53.847+0000 7f8811ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:47:53.847+0000 7f89e7125800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:47:53.848+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 : miss 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:47:53.848+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:47:53.848+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:47:53.927 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:47:53.850+0000 7f89e7125800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89e7125800 time 2024-09-12T00:47:53.850755+0000 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f89e878c71a] 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f89e878c8d8] 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565004ae3641] 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd877a4) [0x565004ff57a4] 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x565004af331d] 2024-09-12T00:47:53.928 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f89e7429590] 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:47:53.851+0000 7f89e7125800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f89e7125800 thread_name:radosgw-admin 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f89e743e6f0] 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f89e748b99c] 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f89e878c774] 2024-09-12T00:47:53.929 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f89e878c8d8] 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565004ae3641] 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd877a4) [0x565004ff57a4] 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x565004af331d] 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f89e7429590] 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:47:53.930 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:47:53.931 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:47:53.932 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:47:53.933 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:47:53.934 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:47:53.935 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:47:53.936 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8811ffb640 / http_manager 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8813fff640 / http_manager 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88997e2640 / rgw_dt_lg_renew 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88c4ff9640 / ms_dispatch 2024-09-12T00:47:53.937 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88c67fc640 / io_context_pool 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88cce01640 / ms_dispatch 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88cf606640 / ms_dispatch 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88d0e09640 / io_context_pool 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e2532640 / msgr-worker-2 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e2d33640 / msgr-worker-1 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e3534640 / msgr-worker-0 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e3d35640 / io_context_pool 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e7125800 / radosgw-admin 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.91891.log 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:47:53.938 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:47:53.803+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:47:53.803+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:47:53.803+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:47:53.803+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:47:53.803+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x565005ee1a10 auth_method 0 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:47:53.803+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:47:53.803+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:47:53.803+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:47:53.803+0000 7f89e2532640 10 monclient(hunting): handle_auth_done global_id 6017 payload 274 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:47:53.803+0000 7f89e2532640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:47:53.803+0000 7f89e2532640 1 monclient: found mon.noname-c 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:47:53.803+0000 7f89e2532640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.939 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: dump: 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.940 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:47:53.803+0000 7f88d0e09640 10 monclient: dump: 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.941 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:47:53.803+0000 7f89e7125800 5 monclient: authenticate success, global_id 6017 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:47:53.803+0000 7f89e7125800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:47:53.803+0000 7f89e7125800 4 set_mon_vals no callback set 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:47:53.804+0000 7f89e7125800 10 monclient: shutdown 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 asok(0x565005e0a630) unregister_commands rotate-key 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:47:53.804+0000 7f89e7125800 10 monclient: build_initial_monmap 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:47:53.804+0000 7f89e7125800 1 build_initial for_mkfs: 0 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:47:53.804+0000 7f89e7125800 10 monclient: monmap: 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:47:53.942 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding auth protocol: cephx 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding auth protocol: cephx 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding auth protocol: cephx 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.943 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: crc 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:47:53.804+0000 7f89e7125800 5 AuthRegistry(0x56500602f660) adding con mode: secure 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:47:53.805+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:47:53.805+0000 7f89e7125800 1 librados: starting msgr at 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:47:53.805+0000 7f89e7125800 1 librados: starting objecter 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 asok(0x565005e0a630) register_command objecter_requests hook 0x56500602ef40 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:47:53.805+0000 7f89e7125800 1 librados: setting wanted keys 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:47:53.805+0000 7f89e7125800 1 librados: calling monclient init 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient: init 2024-09-12T00:47:53.944 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding auth protocol: cephx 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding auth protocol: cephx 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding auth protocol: cephx 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: crc 2024-09-12T00:47:53.945 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 AuthRegistry(0x565006029a30) adding con mode: secure 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:47:53.805+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:47:53.805+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:47:53.805+0000 7f89e7125800 5 asok(0x565005e0a630) register_command rotate-key hook 0x565006029b78 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-a con 0x565005ee1a10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-b con 0x565005f6d140 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-c con 0x565005f6f880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:47:53.805+0000 7f89e7125800 10 monclient(hunting): authenticate will time out at 1827.074781s 2024-09-12T00:47:53.946 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x565005ee1a10 auth_method 0 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): get_auth_request con 0x565005f6f880 auth_method 0 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:47:53.805+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.947 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:47:53.805+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:47:53.806+0000 7f89e2d33640 10 monclient(hunting): handle_auth_done global_id 6390 payload 824 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:47:53.806+0000 7f89e2d33640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:47:53.806+0000 7f89e2d33640 1 monclient: found mon.noname-a 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:47:53.806+0000 7f89e2d33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: dump: 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.948 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:47:53.806+0000 7f88cf606640 10 monclient: dump: 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.949 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:47:53.806+0000 7f89e7125800 5 monclient: authenticate success, global_id 6390 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:47:53.806+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:47:53.806+0000 7f89e7125800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:47:53.806+0000 7f88d0e09640 4 set_mon_vals no callback set 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:47:53.806+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:47:53.806+0000 7f89e7125800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:47:53.806+0000 7f89e7125800 1 librados: init done 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:47:53.808+0000 7f88cf606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:47:53.808+0000 7f88cf606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.950 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:47:53.808+0000 7f88cf606640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:47:53.808+0000 7f89e2532640 10 monclient: get_auth_request con 0x7f88c8076470 auth_method 0 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:47:53.809+0000 7f89e3534640 10 monclient: get_auth_request con 0x565006052260 auth_method 0 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:47:53.809+0000 7f89e2d33640 10 monclient: get_auth_request con 0x565006075220 auth_method 0 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:47:53.810+0000 7f89e2532640 10 monclient: get_auth_request con 0x56500607a2b0 auth_method 0 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:47:53.811+0000 7f89e7125800 10 monclient: build_initial_monmap 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:47:53.811+0000 7f89e7125800 1 build_initial for_mkfs: 0 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:47:53.811+0000 7f89e7125800 10 monclient: monmap: 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.951 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding auth protocol: cephx 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding auth protocol: cephx 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding auth protocol: cephx 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.952 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: crc 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607e350) adding con mode: secure 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:47:53.811+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 asok(0x565005e0a630) register_command objecter_requests cmddesc objecter_requests hook 0x565006081d60 EEXIST 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:47:53.811+0000 7f89e7125800 10 monclient: init 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding auth protocol: cephx 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding auth protocol: cephx 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding auth protocol: cephx 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.953 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: crc 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:47:53.811+0000 7f89e7125800 5 AuthRegistry(0x56500607d2e8) adding con mode: secure 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:47:53.812+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:47:53.812+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:47:53.812+0000 7f89e7125800 5 asok(0x565005e0a630) register_command rotate-key cmddesc rotate-key hook 0x56500607d430 EEXIST 2024-09-12T00:47:53.954 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-b con 0x5650060ab9a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-c con 0x5650060a4390 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-a con 0x5650060a6ea0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:47:53.812+0000 7f89e7125800 10 monclient(hunting): authenticate will time out at 1827.081555s 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): get_auth_request con 0x5650060a4390 auth_method 0 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.955 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): get_auth_request con 0x5650060a6ea0 auth_method 0 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:47:53.812+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x5650060ab9a0 auth_method 0 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.956 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:47:53.812+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient(hunting): handle_auth_done global_id 6393 payload 824 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:47:53.812+0000 7f89e3534640 1 monclient: found mon.noname-a 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:47:53.812+0000 7f89e3534640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: dump: 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.957 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:47:53.813+0000 7f88cce01640 10 monclient: dump: 2024-09-12T00:47:53.958 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:47:53.813+0000 7f89e7125800 5 monclient: authenticate success, global_id 6393 2024-09-12T00:47:53.959 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:47:53.813+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:47:53.813+0000 7f89e7125800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:47:53.813+0000 7f89e3d35640 4 set_mon_vals no callback set 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:47:53.813+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:47:53.813+0000 7f89e7125800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:47:53.815+0000 7f88cce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:47:53.815+0000 7f88cce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:47:53.815+0000 7f88cce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:47:53.815+0000 7f89e2d33640 10 monclient: get_auth_request con 0x7f88bc0763b0 auth_method 0 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:47:53.815+0000 7f89e7125800 10 monclient: get_monmap_and_config 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:47:53.815+0000 7f89e7125800 10 monclient: build_initial_monmap 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:47:53.815+0000 7f89e7125800 1 build_initial for_mkfs: 0 2024-09-12T00:47:53.960 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:47:53.815+0000 7f89e7125800 10 monclient: monmap: 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding auth protocol: cephx 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding auth protocol: cephx 2024-09-12T00:47:53.961 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding auth protocol: cephx 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: crc 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x5650060c6a20) adding con mode: secure 2024-09-12T00:47:53.962 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:47:53.815+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:47:53.815+0000 7f89e7125800 10 monclient: init 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding auth protocol: cephx 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding auth protocol: cephx 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding auth protocol: cephx 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.963 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: crc 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:47:53.815+0000 7f89e7125800 5 AuthRegistry(0x7fff34b300c0) adding con mode: secure 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:47:53.816+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:47:53.816+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:47:53.816+0000 7f89e7125800 5 asok(0x565005e0a630) register_command rotate-key cmddesc rotate-key hook 0x7fff34b30208 EEXIST 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-a con 0x5650060fafd0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-c con 0x5650060eb920 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-b con 0x5650060f6400 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.964 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:47:53.816+0000 7f89e7125800 10 monclient(hunting): authenticate will time out at 1827.085446s 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x5650060fafd0 auth_method 0 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): get_auth_request con 0x5650060eb920 auth_method 0 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.965 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:47:53.816+0000 7f89e2532640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient(hunting): handle_auth_done global_id 6396 payload 274 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:47:53.816+0000 7f89e2d33640 1 monclient: found mon.noname-a 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:47:53.816+0000 7f89e2d33640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: dump: 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.966 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:47:53.816+0000 7f88c67fc640 10 monclient: dump: 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.967 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 monclient: authenticate success, global_id 6396 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:47:53.817+0000 7f89e7125800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:47:53.817+0000 7f89e7125800 4 set_mon_vals no callback set 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:47:53.817+0000 7f89e7125800 10 monclient: shutdown 2024-09-12T00:47:53.968 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:47:53.817+0000 7f89e7125800 10 monclient: build_initial_monmap 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:47:53.817+0000 7f89e7125800 1 build_initial for_mkfs: 0 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:47:53.817+0000 7f89e7125800 10 monclient: monmap: 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.969 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding auth protocol: cephx 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding auth protocol: cephx 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding auth protocol: cephx 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: crc 2024-09-12T00:47:53.970 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:47:53.817+0000 7f89e7125800 5 AuthRegistry(0x5650060ca530) adding con mode: secure 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:47:53.817+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:47:53.817+0000 7f89e7125800 1 librados: starting msgr at 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:47:53.817+0000 7f89e7125800 1 librados: starting objecter 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 asok(0x565005e0a630) register_command objecter_requests cmddesc objecter_requests hook 0x5650060cc710 EEXIST 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:47:53.818+0000 7f89e7125800 1 librados: setting wanted keys 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:47:53.818+0000 7f89e7125800 1 librados: calling monclient init 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient: init 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding auth protocol: cephx 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding auth protocol: cephx 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding auth protocol: cephx 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.971 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: crc 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 AuthRegistry(0x565005eb4530) adding con mode: secure 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:47:53.818+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:47:53.818+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:47:53.818+0000 7f89e7125800 5 asok(0x565005e0a630) register_command rotate-key cmddesc rotate-key hook 0x565005eb4678 EEXIST 2024-09-12T00:47:53.972 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-c con 0x5650060eb920 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-b con 0x5650060f6400 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): picked mon.noname-a con 0x5650060fafd0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:47:53.818+0000 7f89e7125800 10 monclient(hunting): authenticate will time out at 1827.087612s 2024-09-12T00:47:53.973 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): get_auth_request con 0x5650060eb920 auth_method 0 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): get_auth_request con 0x5650060fafd0 auth_method 0 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.974 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:47:53.818+0000 7f89e3534640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:47:53.818+0000 7f89e2532640 10 monclient(hunting): get_auth_request con 0x5650060f6400 auth_method 0 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:47:53.818+0000 7f89e2532640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:47:53.818+0000 7f89e2532640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:47:53.818+0000 7f89e2532640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient: _finish_hunting 0 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:47:53.818+0000 7f89e2d33640 1 monclient: found mon.noname-c 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:47:53.818+0000 7f89e2d33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: dump: 2024-09-12T00:47:53.975 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:53.976 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:47:53.819+0000 7f88c4ff9640 10 monclient: dump: 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:47:53.819+0000 7f89e7125800 5 monclient: authenticate success, global_id 6029 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:47:53.819+0000 7f88c67fc640 4 set_mon_vals no callback set 2024-09-12T00:47:53.977 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:47:53.819+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:47:53.819+0000 7f89e7125800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:47:53.819+0000 7f89e7125800 10 monclient: _renew_subs 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:47:53.819+0000 7f89e7125800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:47:53.819+0000 7f89e7125800 1 librados: init done 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:47:53.819+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cr dump hook 0x5650060f6f78 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:47:53.820+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:47:53.821+0000 7f88c4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:47:53.821+0000 7f88c4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:47:53.821+0000 7f88c4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:47:53.821+0000 7f89e2532640 10 monclient: get_auth_request con 0x7f88ac076470 auth_method 0 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:47:53.821+0000 7f89e3534640 10 monclient: get_auth_request con 0x565006115550 auth_method 0 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 realm 2024-09-12T00:47:53.978 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:47:53.822+0000 7f89e7125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:47:53.822+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:47:53.823+0000 7f89e2d33640 10 monclient: get_auth_request con 0x5650061198c0 auth_method 0 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:47:53.823+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:47:53.823+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:47:53.823+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:47:53.823+0000 7f89e7125800 20 searching for the correct realm 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:47:53.824+0000 7f89e2532640 10 monclient: get_auth_request con 0x56500611ea30 auth_method 0 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:47:53.824+0000 7f89e3534640 10 monclient: get_auth_request con 0x7f89d803d040 auth_method 0 2024-09-12T00:47:53.979 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:47:53.825+0000 7f89e2d33640 10 monclient: get_auth_request con 0x7f89d4018070 auth_method 0 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:47:53.826+0000 7f89e2532640 10 monclient: get_auth_request con 0x7f89d8024040 auth_method 0 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:47:53.827+0000 7f89e2532640 0 -- 172.21.15.83:0/3586711154 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f89d8024040 msgr2=0x7f89d803c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:47:53.827+0000 7f88c4ff9640 1 client.6029.objecter ms_handle_reset 0x7f89d8024040 session 0x7f89d803ee70 osd.5 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:47:53.827+0000 7f88c4ff9640 10 monclient: _renew_subs 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:47:53.827+0000 7f88c4ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:47:53.827+0000 7f89e2532640 10 monclient: get_auth_request con 0x7f88ac086790 auth_method 0 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:47:53.828+0000 7f89e3534640 10 monclient: get_auth_request con 0x7f89d4073940 auth_method 0 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:47:53.829+0000 7f89e2d33640 10 monclient: get_auth_request con 0x7f89dc0b1160 auth_method 0 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:47:53.830+0000 7f89e2d33640 0 -- 172.21.15.83:0/3586711154 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f89dc0b1160 msgr2=0x7f89dc0a70e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:47:53.830+0000 7f88c4ff9640 1 client.6029.objecter ms_handle_reset 0x7f89dc0b1160 session 0x7f89dc068050 osd.3 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:47:53.830+0000 7f89e2d33640 10 monclient: get_auth_request con 0x7f89d8024040 auth_method 0 2024-09-12T00:47:53.980 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 zone default found 2024-09-12T00:47:53.981 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:47:53.834+0000 7f89e7125800 4 Realm: () 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:47:53.834+0000 7f89e7125800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:47:53.834+0000 7f89e7125800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:47:53.834+0000 7f89e7125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 zonegroup default 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:47:53.834+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 started sync module instance, tier type = 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:47:53.835+0000 7f89e7125800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=0 2024-09-12T00:47:53.982 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=1 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=2 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=3 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=4 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=5 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:47:53.843+0000 7f89e7125800 20 add_watcher() i=6 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:47:53.844+0000 7f89e7125800 20 add_watcher() i=7 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:47:53.844+0000 7f89e7125800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding auth protocol: cephx 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding auth protocol: cephx 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding auth protocol: cephx 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.983 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:47:53.846+0000 7f88997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: crc 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:47:53.846+0000 7f89e7125800 5 AuthRegistry(0x7fff34b305a0) adding con mode: secure 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:47:53.847+0000 7f89e7125800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:53.984 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cache list hook 0x5650060f36f0 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cache inspect hook 0x5650060f36f0 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cache erase hook 0x5650060f36f0 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command cache zap hook 0x5650060f36f0 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 note: GC not initialized 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:47:53.847+0000 7f8813fff640 20 reqs_thread_entry: start 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command sync trace show hook 0x7f89d4064050 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command sync trace history hook 0x7f89d4064050 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command sync trace active hook 0x7f89d4064050 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:47:53.847+0000 7f89e7125800 5 asok(0x565005e0a630) register_command sync trace active_short hook 0x7f89d4064050 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 Filter name: none 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:47:53.847+0000 7f8811ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:53.985 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:47:53.847+0000 7f89e7125800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:47:53.847+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:47:53.848+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 : miss 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:47:53.848+0000 7f89e7125800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:47:53.848+0000 7f89e7125800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:47:53.848+0000 7f89e7125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:47:53.850+0000 7f89e7125800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89e7125800 time 2024-09-12T00:47:53.850755+0000 2024-09-12T00:47:53.986 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f89e878c71a] 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f89e878c8d8] 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565004ae3641] 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd877a4) [0x565004ff57a4] 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x565004af331d] 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f89e7429590] 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.987 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:47:53.851+0000 7f89e7125800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f89e7125800 thread_name:radosgw-admin 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f89e743e6f0] 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f89e748b99c] 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f89e878c774] 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f89e878c8d8] 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565004ae3641] 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd877a4) [0x565004ff57a4] 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x565004af331d] 2024-09-12T00:47:53.988 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f89e7429590] 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:47:53.989 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:47:53.990 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:47:53.991 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:47:53.992 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:47:53.993 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:47:53.994 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:47:53.995 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8811ffb640 / http_manager 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8813fff640 / http_manager 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88997e2640 / rgw_dt_lg_renew 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88c4ff9640 / ms_dispatch 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88c67fc640 / io_context_pool 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88cce01640 / ms_dispatch 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88cf606640 / ms_dispatch 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7f88d0e09640 / io_context_pool 2024-09-12T00:47:53.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e2532640 / msgr-worker-2 2024-09-12T00:47:53.997 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e2d33640 / msgr-worker-1 2024-09-12T00:47:53.997 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e3534640 / msgr-worker-0 2024-09-12T00:47:53.997 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e3d35640 / io_context_pool 2024-09-12T00:47:53.997 INFO:tasks.workunit.client.0.smithi083.stderr: 7f89e7125800 / radosgw-admin 2024-09-12T00:47:53.997 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:47:53.997 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:47:53.997 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:47:53.852386Z_317c583c-c151-4b48-8b7f-e5e70aeca384/log 2024-09-12T00:47:53.997 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:47:53.997 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:47:53.999 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:53.999 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:53.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.925+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.927+0000 7f50bc740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.927+0000 7f50bc740800 20 realm 2024-09-12T00:47:53.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.927+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:53.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.927+0000 7f50bc740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:53.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.927+0000 7f50bc740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:53.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.927+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.927+0000 7f50bc740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.927+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.928+0000 7f50bc740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:54.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.928+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.928+0000 7f50bc740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:54.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.928+0000 7f50bc740800 20 searching for the correct realm 2024-09-12T00:47:54.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:53.931+0000 7f50afcbf640 0 -- 172.21.15.83:0/162332260 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f50a0064920 msgr2=0x7f50a007a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:54.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.135+0000 7f50afcbf640 0 -- 172.21.15.83:0/162332260 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55c6ce2b22c0 msgr2=0x55c6ce2b4730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:54.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.139+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 20 zone default found 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 4 Realm: () 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 20 zonegroup default 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.140+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.141+0000 7f50bc740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.141+0000 7f50bc740800 20 started sync module instance, tier type = 2024-09-12T00:47:54.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.141+0000 7f50bc740800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:54.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.149+0000 7f50bc740800 20 add_watcher() i=0 2024-09-12T00:47:54.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.149+0000 7f50bc740800 20 add_watcher() i=1 2024-09-12T00:47:54.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.149+0000 7f50bc740800 20 add_watcher() i=2 2024-09-12T00:47:54.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.149+0000 7f50bc740800 20 add_watcher() i=3 2024-09-12T00:47:54.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.149+0000 7f50bc740800 20 add_watcher() i=4 2024-09-12T00:47:54.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.149+0000 7f50bc740800 20 add_watcher() i=5 2024-09-12T00:47:54.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.149+0000 7f50bc740800 20 add_watcher() i=6 2024-09-12T00:47:54.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.150+0000 7f50bc740800 20 add_watcher() i=7 2024-09-12T00:47:54.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.150+0000 7f50bc740800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:54.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.151+0000 7f4f6efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:54.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.151+0000 7f50bc740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:54.150 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.151+0000 7f50bc740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:54.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.151+0000 7f50bc740800 5 note: GC not initialized 2024-09-12T00:47:54.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.152+0000 7f4f6dfdb640 20 reqs_thread_entry: start 2024-09-12T00:47:54.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.152+0000 7f50bc740800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:54.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.152+0000 7f50bc740800 20 Filter name: none 2024-09-12T00:47:54.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.152+0000 7f4edf7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:54.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.152+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.153+0000 7f50bc740800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:47:54.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.153+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.153+0000 7f50bc740800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:47:54.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.153+0000 7f50bc740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:54.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.153+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.153+0000 7f50bc740800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:47:54.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.153+0000 7f50bc740800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.154+0000 7f50bc740800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:47:54.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.154+0000 7f50bc740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:54.153 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.155+0000 7f4f6efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:54.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.157+0000 7f50bc740800 20 remove_watcher() i=0 2024-09-12T00:47:54.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.157+0000 7f50bc740800 2 removed watcher, disabling cache 2024-09-12T00:47:54.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.158+0000 7f50bc740800 20 remove_watcher() i=1 2024-09-12T00:47:54.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.159+0000 7f50bc740800 20 remove_watcher() i=2 2024-09-12T00:47:54.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.160+0000 7f50bc740800 20 remove_watcher() i=3 2024-09-12T00:47:54.159 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.161+0000 7f50bc740800 20 remove_watcher() i=4 2024-09-12T00:47:54.160 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.162+0000 7f50bc740800 20 remove_watcher() i=5 2024-09-12T00:47:54.161 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.163+0000 7f50bc740800 20 remove_watcher() i=6 2024-09-12T00:47:54.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.164+0000 7f50bc740800 20 remove_watcher() i=7 2024-09-12T00:47:54.172 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:54.173 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:47:54.173 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-init-indext id: ad4424e4-de7c-4376-b125-e717016a3484.4511.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:47:54.173 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:47:54.174 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:54.174 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:54.181 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:54.181 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:47:54.224 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:47:54.255 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:54.255 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:54.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.293+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.295+0000 7f21caf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.295+0000 7f21caf17800 20 realm 2024-09-12T00:47:54.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.295+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.295+0000 7f21caf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.295+0000 7f21caf17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:54.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.295+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.295+0000 7f21caf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.295+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.296+0000 7f21caf17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:54.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.296+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.296+0000 7f21caf17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:54.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.296+0000 7f21caf17800 20 searching for the correct realm 2024-09-12T00:47:54.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.300+0000 7f21c8a01640 0 -- 172.21.15.83:0/4040524251 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f21bc090400 msgr2=0x7f21bc090860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:54.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.303+0000 7f21c8a01640 0 -- 172.21.15.83:0/4040524251 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x55d8170aaaa0 msgr2=0x55d8170ace90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:54.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.306+0000 7f21caf17800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:47:54.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.306+0000 7f21caf17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:54.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.306+0000 7f21caf17800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:47:54.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.306+0000 7f21caf17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.306+0000 7f21caf17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.306+0000 7f21caf17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.306+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.306+0000 7f21caf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.306+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 zone default found 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 4 Realm: () 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:47:54.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:54.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 zonegroup default 2024-09-12T00:47:54.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.307+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.308+0000 7f21caf17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:54.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.308+0000 7f21caf17800 20 started sync module instance, tier type = 2024-09-12T00:47:54.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.308+0000 7f21caf17800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:47:54.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.316+0000 7f21caf17800 20 add_watcher() i=0 2024-09-12T00:47:54.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.316+0000 7f21caf17800 20 add_watcher() i=1 2024-09-12T00:47:54.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.316+0000 7f21caf17800 20 add_watcher() i=2 2024-09-12T00:47:54.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.316+0000 7f21caf17800 20 add_watcher() i=3 2024-09-12T00:47:54.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.316+0000 7f21caf17800 20 add_watcher() i=4 2024-09-12T00:47:54.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.316+0000 7f21caf17800 20 add_watcher() i=5 2024-09-12T00:47:54.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.316+0000 7f21caf17800 20 add_watcher() i=6 2024-09-12T00:47:54.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.316+0000 7f21caf17800 20 add_watcher() i=7 2024-09-12T00:47:54.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.316+0000 7f21caf17800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:54.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.318+0000 7f207efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:54.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.318+0000 7f21caf17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:54.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.318+0000 7f21caf17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:54.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.318+0000 7f21caf17800 5 note: GC not initialized 2024-09-12T00:47:54.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f207dfe3640 20 reqs_thread_entry: start 2024-09-12T00:47:54.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f21caf17800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:54.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f21caf17800 20 Filter name: none 2024-09-12T00:47:54.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f1fef7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:54.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f21caf17800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:47:54.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f21caf17800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:47:54.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f21caf17800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:47:54.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f21caf17800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:47:54.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f21caf17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 : miss 2024-09-12T00:47:54.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.319+0000 7f21caf17800 20 rados->read ofs=0 len=0 2024-09-12T00:47:54.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.320+0000 7f21caf17800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:47:54.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.320+0000 7f21caf17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:47:54.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.320+0000 7f21caf17800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:47:54.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.320+0000 7f21caf17800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:54.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.320+0000 7f21caf17800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:47:54.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.320+0000 7f21caf17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 2024-09-12T00:47:54.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.321+0000 7f21caf17800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to be held by another RGW process; skipping for now 2024-09-12T00:47:54.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.321+0000 7f207efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:54.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.324+0000 7f21caf17800 20 remove_watcher() i=0 2024-09-12T00:47:54.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.324+0000 7f21caf17800 2 removed watcher, disabling cache 2024-09-12T00:47:54.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.325+0000 7f21caf17800 20 remove_watcher() i=1 2024-09-12T00:47:54.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.326+0000 7f21caf17800 20 remove_watcher() i=2 2024-09-12T00:47:54.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.327+0000 7f21caf17800 20 remove_watcher() i=3 2024-09-12T00:47:54.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.328+0000 7f21caf17800 20 remove_watcher() i=4 2024-09-12T00:47:54.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.329+0000 7f21caf17800 20 remove_watcher() i=5 2024-09-12T00:47:54.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.330+0000 7f21caf17800 20 remove_watcher() i=6 2024-09-12T00:47:54.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:47:54.331+0000 7f21caf17800 20 remove_watcher() i=7 2024-09-12T00:47:54.339 INFO:tasks.workunit.client.0.smithi083.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:48:24.353 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:24.387 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:24.387 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:24.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.430+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.432+0000 7f85eba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.432+0000 7f85eba10800 20 realm 2024-09-12T00:48:24.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.432+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.432+0000 7f85eba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.432+0000 7f85eba10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:24.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.432+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.432+0000 7f85eba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.432+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.433+0000 7f85eba10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:24.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.433+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.433+0000 7f85eba10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:24.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.433+0000 7f85eba10800 20 searching for the correct realm 2024-09-12T00:48:24.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.436+0000 7f85e71e0640 0 -- 172.21.15.83:0/1649261122 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f85d80e0b60 msgr2=0x7f85d80cdaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:24.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.440+0000 7f85e71e0640 0 -- 172.21.15.83:0/1649261122 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f85e0026400 msgr2=0x7f85e0026840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:24.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.647+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 20 zone default found 2024-09-12T00:48:24.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 4 Realm: () 2024-09-12T00:48:24.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:24.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:24.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:24.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 20 zonegroup default 2024-09-12T00:48:24.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.648+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.649+0000 7f85eba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.649+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.649+0000 7f85eba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.649+0000 7f85eba10800 20 started sync module instance, tier type = 2024-09-12T00:48:24.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.649+0000 7f85eba10800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:24.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.659+0000 7f85eba10800 20 add_watcher() i=0 2024-09-12T00:48:24.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.659+0000 7f85eba10800 20 add_watcher() i=1 2024-09-12T00:48:24.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.659+0000 7f85eba10800 20 add_watcher() i=2 2024-09-12T00:48:24.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.659+0000 7f85eba10800 20 add_watcher() i=3 2024-09-12T00:48:24.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.659+0000 7f85eba10800 20 add_watcher() i=4 2024-09-12T00:48:24.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.659+0000 7f85eba10800 20 add_watcher() i=5 2024-09-12T00:48:24.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.659+0000 7f85eba10800 20 add_watcher() i=6 2024-09-12T00:48:24.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.660+0000 7f85eba10800 20 add_watcher() i=7 2024-09-12T00:48:24.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.660+0000 7f85eba10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:24.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.662+0000 7f849dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:24.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.662+0000 7f85eba10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:24.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.662+0000 7f85eba10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:24.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.662+0000 7f85eba10800 5 note: GC not initialized 2024-09-12T00:48:24.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.662+0000 7f849cfe1640 20 reqs_thread_entry: start 2024-09-12T00:48:24.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.662+0000 7f85eba10800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:24.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.663+0000 7f85eba10800 20 Filter name: none 2024-09-12T00:48:24.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.663+0000 7f84167fc640 20 reqs_thread_entry: start 2024-09-12T00:48:24.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.663+0000 7f85eba10800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:48:24.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.663+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.663+0000 7f85eba10800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.663+0000 7f85eba10800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.663+0000 7f85eba10800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.663+0000 7f85eba10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 : miss 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.663+0000 7f85eba10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.664+0000 7f85eba10800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.664+0000 7f85eba10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.664+0000 7f85eba10800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.664+0000 7f85eba10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.664+0000 7f85eba10800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:24.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.664+0000 7f85eba10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 2024-09-12T00:48:24.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.668+0000 7f85eba10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:48:24.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.668+0000 7f85eba10800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:48:24.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.668+0000 7f85eba10800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:24.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.668+0000 7f85eba10800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22, ofs0, ns] 2024-09-12T00:48:24.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.668+0000 7f84caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464357 cookie 94573653280384 notifier 6083 bl.length()=997 2024-09-12T00:48:24.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.668+0000 7f84caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:48:24.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.668+0000 7f84caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:48:24.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.668+0000 7f84caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:24.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.669+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): orig_sources= new_sources= 2024-09-12T00:48:24.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.669+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): potential sources added=[] removed=[] 2024-09-12T00:48:24.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.669+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): orig_dests= new_dests= 2024-09-12T00:48:24.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.669+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): potential dests added=[] removed=[] 2024-09-12T00:48:24.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.671+0000 7f85eba10800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.22.1.0 2024-09-12T00:48:24.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.671+0000 7f85eba10800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.22.1.0 2024-09-12T00:48:24.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.671+0000 7f85eba10800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.22.1.1 2024-09-12T00:48:24.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.671+0000 7f85eba10800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.22.1.1 2024-09-12T00:48:24.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.671+0000 7f85eba10800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.22.0 2024-09-12T00:48:24.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.673+0000 7f85eba10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:24.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.673+0000 7f85eba10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 2024-09-12T00:48:24.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f85eba10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:48:24.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f85eba10800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:48:24.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f85eba10800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:24.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f85eba10800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22, ofs0, ns] 2024-09-12T00:48:24.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f84ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464358 cookie 94573653280384 notifier 6083 bl.length()=997 2024-09-12T00:48:24.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f84ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:48:24.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f84ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:48:24.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f84ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:24.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): orig_sources= new_sources= 2024-09-12T00:48:24.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): potential sources added=[] removed=[] 2024-09-12T00:48:24.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): orig_dests= new_dests= 2024-09-12T00:48:24.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.675+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): potential dests added=[] removed=[] 2024-09-12T00:48:24.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.677+0000 7f85eba10800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.22.0 2024-09-12T00:48:24.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.677+0000 7f85eba10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:24.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.677+0000 7f85eba10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 2024-09-12T00:48:24.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.678+0000 7f85eba10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:48:24.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.678+0000 7f85eba10800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:48:24.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.678+0000 7f85eba10800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:24.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.678+0000 7f85eba10800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22, ofs0, ns] 2024-09-12T00:48:24.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.679+0000 7f84caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464359 cookie 94573653280384 notifier 6083 bl.length()=965 2024-09-12T00:48:24.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.679+0000 7f84caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 info.flags=0x17 2024-09-12T00:48:24.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.679+0000 7f84caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ad4424e4-de7c-4376-b125-e717016a3484.4511.22 to cache LRU end 2024-09-12T00:48:24.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.679+0000 7f84caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:24.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.679+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): orig_sources= new_sources= 2024-09-12T00:48:24.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.679+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): potential sources added=[] removed=[] 2024-09-12T00:48:24.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.679+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): orig_dests= new_dests= 2024-09-12T00:48:24.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.679+0000 7f85eba10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ad4424e4-de7c-4376-b125-e717016a3484.4511.22]): potential dests added=[] removed=[] 2024-09-12T00:48:24.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.680+0000 7f85eba10800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T00:48:24.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.682+0000 7f849dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:24.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.685+0000 7f85eba10800 20 remove_watcher() i=0 2024-09-12T00:48:24.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.685+0000 7f85eba10800 2 removed watcher, disabling cache 2024-09-12T00:48:24.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.686+0000 7f85eba10800 20 remove_watcher() i=1 2024-09-12T00:48:24.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.687+0000 7f85eba10800 20 remove_watcher() i=2 2024-09-12T00:48:24.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.688+0000 7f85eba10800 20 remove_watcher() i=3 2024-09-12T00:48:24.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.689+0000 7f85eba10800 20 remove_watcher() i=4 2024-09-12T00:48:24.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.690+0000 7f85eba10800 20 remove_watcher() i=5 2024-09-12T00:48:24.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.691+0000 7f85eba10800 20 remove_watcher() i=6 2024-09-12T00:48:24.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.692+0000 7f85eba10800 20 remove_watcher() i=7 2024-09-12T00:48:24.704 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:48:24.733 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:24.733 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:24.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.772+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.777+0000 7f820d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.777+0000 7f820d724800 20 realm 2024-09-12T00:48:24.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.777+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.777+0000 7f820d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.778+0000 7f820d724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:24.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.778+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.778+0000 7f820d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.778+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.778+0000 7f820d724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:24.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.778+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.779+0000 7f820d724800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:24.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.779+0000 7f820d724800 20 searching for the correct realm 2024-09-12T00:48:24.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.782+0000 7f8208bd1640 0 -- 172.21.15.83:0/1337111169 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f82000c5b60 msgr2=0x7f82000b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:24.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.987+0000 7f8209bd3640 0 -- 172.21.15.83:0/1337111169 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x557efc3a92e0 msgr2=0x557efc3ab6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.992+0000 7f820d724800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.992+0000 7f820d724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.992+0000 7f820d724800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.992+0000 7f820d724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.992+0000 7f820d724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.992+0000 7f820d724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.992+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.992+0000 7f820d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.992+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:24.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 20 zone default found 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 4 Realm: () 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 20 zonegroup default 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.993+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.994+0000 7f820d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.994+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.994+0000 7f820d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.994+0000 7f820d724800 20 started sync module instance, tier type = 2024-09-12T00:48:24.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:24.994+0000 7f820d724800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:25.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.004+0000 7f820d724800 20 add_watcher() i=0 2024-09-12T00:48:25.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.004+0000 7f820d724800 20 add_watcher() i=1 2024-09-12T00:48:25.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.004+0000 7f820d724800 20 add_watcher() i=2 2024-09-12T00:48:25.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.004+0000 7f820d724800 20 add_watcher() i=3 2024-09-12T00:48:25.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.004+0000 7f820d724800 20 add_watcher() i=4 2024-09-12T00:48:25.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.004+0000 7f820d724800 20 add_watcher() i=5 2024-09-12T00:48:25.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.004+0000 7f820d724800 20 add_watcher() i=6 2024-09-12T00:48:25.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.005+0000 7f820d724800 20 add_watcher() i=7 2024-09-12T00:48:25.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.005+0000 7f820d724800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.007+0000 7f80bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.008+0000 7f820d724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.008+0000 7f820d724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.008+0000 7f820d724800 5 note: GC not initialized 2024-09-12T00:48:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.008+0000 7f80be7e4640 20 reqs_thread_entry: start 2024-09-12T00:48:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.008+0000 7f820d724800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.008+0000 7f820d724800 20 Filter name: none 2024-09-12T00:48:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.008+0000 7f802ffff640 20 reqs_thread_entry: start 2024-09-12T00:48:25.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.008+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.009+0000 7f820d724800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:48:25.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.009+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.009+0000 7f820d724800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:48:25.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.009+0000 7f820d724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:25.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.009+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.009+0000 7f820d724800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:48:25.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.009+0000 7f820d724800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.010+0000 7f820d724800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:48:25.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.010+0000 7f820d724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:25.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.011+0000 7f80bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:25.011 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.013+0000 7f820d724800 20 remove_watcher() i=0 2024-09-12T00:48:25.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.013+0000 7f820d724800 2 removed watcher, disabling cache 2024-09-12T00:48:25.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.014+0000 7f820d724800 20 remove_watcher() i=1 2024-09-12T00:48:25.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.015+0000 7f820d724800 20 remove_watcher() i=2 2024-09-12T00:48:25.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.016+0000 7f820d724800 20 remove_watcher() i=3 2024-09-12T00:48:25.015 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.017+0000 7f820d724800 20 remove_watcher() i=4 2024-09-12T00:48:25.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.018+0000 7f820d724800 20 remove_watcher() i=5 2024-09-12T00:48:25.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.019+0000 7f820d724800 20 remove_watcher() i=6 2024-09-12T00:48:25.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.020+0000 7f820d724800 20 remove_watcher() i=7 2024-09-12T00:48:25.029 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:25.029 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:48:25.029 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-init-indext id: ad4424e4-de7c-4376-b125-e717016a3484.4511.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:48:25.029 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:25.031 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.032 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.035 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.035 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.257 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.258 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.272 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:48:25.273 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:25.274 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.274 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.285 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.285 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.327 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.328 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.336 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.336 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.344 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.344 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.352 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.352 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.360 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.360 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.369 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.369 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.377 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.377 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.385 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.385 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.393 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.393 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.401 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.401 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.408 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.408 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.416 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.416 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.426 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.426 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.434 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.434 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.441 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.441 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.449 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.449 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.457 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.457 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.464 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.465 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.473 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.473 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.480 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:25.480 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:25.488 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:48:25.516 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:25.516 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:25.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.554+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.556+0000 7f96af00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.556+0000 7f96af00e800 20 realm 2024-09-12T00:48:25.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.556+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.556+0000 7f96af00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.556+0000 7f96af00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:25.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.556+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.556+0000 7f96af00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.556+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.557+0000 7f96af00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:25.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.557+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.557+0000 7f96af00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:25.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.557+0000 7f96af00e800 20 searching for the correct realm 2024-09-12T00:48:25.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.561+0000 7f96a3fff640 0 -- 172.21.15.83:0/3330775864 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f96940d8bf0 msgr2=0x7f96940c1a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:25.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.766+0000 7f96a3fff640 0 -- 172.21.15.83:0/3330775864 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56498d1af300 msgr2=0x56498d1b1770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:25.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.770+0000 7f96af00e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:25.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.770+0000 7f96af00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:25.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.770+0000 7f96af00e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:25.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.770+0000 7f96af00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:25.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.770+0000 7f96af00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:25.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.770+0000 7f96af00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:25.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.770+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 20 zone default found 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 4 Realm: () 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 20 zonegroup default 2024-09-12T00:48:25.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.771+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.772+0000 7f96af00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.772+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.772+0000 7f96af00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.772+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.772+0000 7f96af00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.772+0000 7f96af00e800 20 started sync module instance, tier type = 2024-09-12T00:48:25.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.772+0000 7f96af00e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:25.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.781+0000 7f96af00e800 20 add_watcher() i=0 2024-09-12T00:48:25.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.781+0000 7f96af00e800 20 add_watcher() i=1 2024-09-12T00:48:25.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.781+0000 7f96af00e800 20 add_watcher() i=2 2024-09-12T00:48:25.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.781+0000 7f96af00e800 20 add_watcher() i=3 2024-09-12T00:48:25.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.781+0000 7f96af00e800 20 add_watcher() i=4 2024-09-12T00:48:25.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.781+0000 7f96af00e800 20 add_watcher() i=5 2024-09-12T00:48:25.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.781+0000 7f96af00e800 20 add_watcher() i=6 2024-09-12T00:48:25.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.781+0000 7f96af00e800 20 add_watcher() i=7 2024-09-12T00:48:25.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.781+0000 7f96af00e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:25.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.783+0000 7f9560fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:25.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.784+0000 7f96af00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:25.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.784+0000 7f96af00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:25.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.784+0000 7f96af00e800 5 note: GC not initialized 2024-09-12T00:48:25.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.784+0000 7f94db7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:25.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.784+0000 7f96af00e800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:25.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.784+0000 7f96af00e800 20 Filter name: none 2024-09-12T00:48:25.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.784+0000 7f94d97fa640 20 reqs_thread_entry: start 2024-09-12T00:48:25.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.784+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.785+0000 7f96af00e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:25.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.785+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.785+0000 7f96af00e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:25.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.785+0000 7f96af00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:25.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.785+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.786+0000 7f96af00e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:25.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.786+0000 7f96af00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.786+0000 7f96af00e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:25.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.786+0000 7f96af00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:25.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.787+0000 7f9560fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:25.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.789+0000 7f96af00e800 20 remove_watcher() i=0 2024-09-12T00:48:25.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.789+0000 7f96af00e800 2 removed watcher, disabling cache 2024-09-12T00:48:25.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.790+0000 7f96af00e800 20 remove_watcher() i=1 2024-09-12T00:48:25.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.791+0000 7f96af00e800 20 remove_watcher() i=2 2024-09-12T00:48:25.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.792+0000 7f96af00e800 20 remove_watcher() i=3 2024-09-12T00:48:25.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.793+0000 7f96af00e800 20 remove_watcher() i=4 2024-09-12T00:48:25.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.794+0000 7f96af00e800 20 remove_watcher() i=5 2024-09-12T00:48:25.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.795+0000 7f96af00e800 20 remove_watcher() i=6 2024-09-12T00:48:25.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.796+0000 7f96af00e800 20 remove_watcher() i=7 2024-09-12T00:48:25.805 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:25.805 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:48:25.805 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:25.805 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:25.807 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:48:25.841 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:25.841 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:25.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.878+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.880+0000 7f0d80939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.880+0000 7f0d80939800 20 realm 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.880+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.880+0000 7f0d80939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.880+0000 7f0d80939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.880+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.881+0000 7f0d80939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.881+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.881+0000 7f0d80939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:25.882 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.881+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:25.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.882+0000 7f0d80939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:25.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.882+0000 7f0d80939800 20 searching for the correct realm 2024-09-12T00:48:25.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:25.885+0000 7f0d73fff640 0 -- 172.21.15.83:0/3563478480 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f0d64075d70 msgr2=0x7f0d64022910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:26.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.090+0000 7f0d7cdc8640 0 -- 172.21.15.83:0/3563478480 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55919a1e2a00 msgr2=0x55919a1e4df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:26.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:26.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:26.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:26.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:26.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:26.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:26.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.094+0000 7f0d80939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 20 zone default found 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 4 Realm: () 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 20 zonegroup default 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.095+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.096+0000 7f0d80939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.096+0000 7f0d80939800 20 started sync module instance, tier type = 2024-09-12T00:48:26.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.096+0000 7f0d80939800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:26.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.104+0000 7f0d80939800 20 add_watcher() i=0 2024-09-12T00:48:26.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.104+0000 7f0d80939800 20 add_watcher() i=1 2024-09-12T00:48:26.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.104+0000 7f0d80939800 20 add_watcher() i=2 2024-09-12T00:48:26.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.104+0000 7f0d80939800 20 add_watcher() i=3 2024-09-12T00:48:26.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.104+0000 7f0d80939800 20 add_watcher() i=4 2024-09-12T00:48:26.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.104+0000 7f0d80939800 20 add_watcher() i=5 2024-09-12T00:48:26.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.104+0000 7f0d80939800 20 add_watcher() i=6 2024-09-12T00:48:26.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.105+0000 7f0d80939800 20 add_watcher() i=7 2024-09-12T00:48:26.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.105+0000 7f0d80939800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:26.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.106+0000 7f0c32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:26.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.107+0000 7f0d80939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:26.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.107+0000 7f0d80939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:26.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.107+0000 7f0d80939800 5 note: GC not initialized 2024-09-12T00:48:26.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.107+0000 7f0c31fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.107+0000 7f0d80939800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.107+0000 7f0d80939800 20 Filter name: none 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.107+0000 7f0c2b7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.107+0000 7f0d80939800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.107+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 : miss 2024-09-12T00:48:26.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:26.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 info.flags=0x17 2024-09-12T00:48:26.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 to cache LRU end 2024-09-12T00:48:26.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:26.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:26.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.108+0000 7f0d80939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 2024-09-12T00:48:26.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.111+0000 7f0d80939800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:48:26.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.111+0000 7f0d80939800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:48:26.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.114+0000 7f0c32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:26.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.116+0000 7f0d80939800 20 remove_watcher() i=0 2024-09-12T00:48:26.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.116+0000 7f0d80939800 2 removed watcher, disabling cache 2024-09-12T00:48:26.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.117+0000 7f0d80939800 20 remove_watcher() i=1 2024-09-12T00:48:26.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.118+0000 7f0d80939800 20 remove_watcher() i=2 2024-09-12T00:48:26.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.119+0000 7f0d80939800 20 remove_watcher() i=3 2024-09-12T00:48:26.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.120+0000 7f0d80939800 20 remove_watcher() i=4 2024-09-12T00:48:26.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.121+0000 7f0d80939800 20 remove_watcher() i=5 2024-09-12T00:48:26.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.122+0000 7f0d80939800 20 remove_watcher() i=6 2024-09-12T00:48:26.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.122+0000 7f0d80939800 20 remove_watcher() i=7 2024-09-12T00:48:26.132 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:48:26.161 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:26.161 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:26.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.199+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.201+0000 7fcaf1931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.201+0000 7fcaf1931800 20 realm 2024-09-12T00:48:26.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.201+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.201+0000 7fcaf1931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.201+0000 7fcaf1931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:26.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.201+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.201+0000 7fcaf1931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.201+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.202+0000 7fcaf1931800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.202+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.202+0000 7fcaf1931800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:26.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.202+0000 7fcaf1931800 20 searching for the correct realm 2024-09-12T00:48:26.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.205+0000 7fcae4e75640 0 -- 172.21.15.83:0/3921717294 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fcad8093070 msgr2=0x7fcad8097040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:26.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.410+0000 7fcaede77640 0 -- 172.21.15.83:0/3921717294 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x562ae26e9820 msgr2=0x562ae26ebc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:26.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.414+0000 7fcaf1931800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:26.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.414+0000 7fcaf1931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:26.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.414+0000 7fcaf1931800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:26.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.414+0000 7fcaf1931800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:26.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.414+0000 7fcaf1931800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:26.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.414+0000 7fcaf1931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:26.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.414+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.414+0000 7fcaf1931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.414+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:26.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 zone default found 2024-09-12T00:48:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 4 Realm: () 2024-09-12T00:48:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 zonegroup default 2024-09-12T00:48:26.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.415+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.416+0000 7fcaf1931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.416+0000 7fcaf1931800 20 started sync module instance, tier type = 2024-09-12T00:48:26.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.416+0000 7fcaf1931800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.424+0000 7fcaf1931800 20 add_watcher() i=0 2024-09-12T00:48:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.424+0000 7fcaf1931800 20 add_watcher() i=1 2024-09-12T00:48:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.424+0000 7fcaf1931800 20 add_watcher() i=2 2024-09-12T00:48:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.424+0000 7fcaf1931800 20 add_watcher() i=3 2024-09-12T00:48:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.424+0000 7fcaf1931800 20 add_watcher() i=4 2024-09-12T00:48:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.424+0000 7fcaf1931800 20 add_watcher() i=5 2024-09-12T00:48:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.424+0000 7fcaf1931800 20 add_watcher() i=6 2024-09-12T00:48:26.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.425+0000 7fcaf1931800 20 add_watcher() i=7 2024-09-12T00:48:26.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.425+0000 7fcaf1931800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:26.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.427+0000 7fc9a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:26.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.427+0000 7fcaf1931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:26.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.427+0000 7fcaf1931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:26.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.427+0000 7fcaf1931800 5 note: GC not initialized 2024-09-12T00:48:26.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.427+0000 7fc9a27e4640 20 reqs_thread_entry: start 2024-09-12T00:48:26.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.427+0000 7fcaf1931800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:26.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.427+0000 7fcaf1931800 20 Filter name: none 2024-09-12T00:48:26.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.428+0000 7fc913fff640 20 reqs_thread_entry: start 2024-09-12T00:48:26.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.428+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.428+0000 7fcaf1931800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:26.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.428+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.429+0000 7fcaf1931800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:26.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.429+0000 7fcaf1931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:26.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.429+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.429+0000 7fcaf1931800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:26.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.429+0000 7fcaf1931800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.429+0000 7fcaf1931800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:26.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.429+0000 7fcaf1931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:26.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.431+0000 7fc9a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:26.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.433+0000 7fcaf1931800 20 remove_watcher() i=0 2024-09-12T00:48:26.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.433+0000 7fcaf1931800 2 removed watcher, disabling cache 2024-09-12T00:48:26.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.434+0000 7fcaf1931800 20 remove_watcher() i=1 2024-09-12T00:48:26.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.435+0000 7fcaf1931800 20 remove_watcher() i=2 2024-09-12T00:48:26.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.436+0000 7fcaf1931800 20 remove_watcher() i=3 2024-09-12T00:48:26.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.436+0000 7fcaf1931800 20 remove_watcher() i=4 2024-09-12T00:48:26.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.437+0000 7fcaf1931800 20 remove_watcher() i=5 2024-09-12T00:48:26.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.439+0000 7fcaf1931800 20 remove_watcher() i=6 2024-09-12T00:48:26.438 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.440+0000 7fcaf1931800 20 remove_watcher() i=7 2024-09-12T00:48:26.448 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:26.448 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:48:26.448 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:26.448 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:26.450 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:26.450 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:26.458 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:26.458 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:26.501 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:26.533 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:26.533 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:26.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.571+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.573+0000 7f23acb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.573+0000 7f23acb44800 20 realm 2024-09-12T00:48:26.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.573+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.573+0000 7f23acb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.573+0000 7f23acb44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:26.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.573+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.573+0000 7f23acb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.573+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.574+0000 7f23acb44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:26.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.574+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.574+0000 7f23acb44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:26.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.574+0000 7f23acb44800 20 searching for the correct realm 2024-09-12T00:48:26.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.577+0000 7f23a3fff640 0 -- 172.21.15.83:0/1796018668 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f23940619c0 msgr2=0x7f2394062a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:26.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.782+0000 7f23a3fff640 0 -- 172.21.15.83:0/1796018668 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x556347c129e0 msgr2=0x556347c14e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:26.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:26.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:26.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.786+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 20 zone default found 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 4 Realm: () 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:26.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 20 zonegroup default 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.787+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.788+0000 7f23acb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.788+0000 7f23acb44800 20 started sync module instance, tier type = 2024-09-12T00:48:26.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.788+0000 7f23acb44800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:26.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.796+0000 7f23acb44800 20 add_watcher() i=0 2024-09-12T00:48:26.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.796+0000 7f23acb44800 20 add_watcher() i=1 2024-09-12T00:48:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.796+0000 7f23acb44800 20 add_watcher() i=2 2024-09-12T00:48:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.796+0000 7f23acb44800 20 add_watcher() i=3 2024-09-12T00:48:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.796+0000 7f23acb44800 20 add_watcher() i=4 2024-09-12T00:48:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.796+0000 7f23acb44800 20 add_watcher() i=5 2024-09-12T00:48:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.796+0000 7f23acb44800 20 add_watcher() i=6 2024-09-12T00:48:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.797+0000 7f23acb44800 20 add_watcher() i=7 2024-09-12T00:48:26.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.797+0000 7f23acb44800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:26.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.798+0000 7f225efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:26.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.799+0000 7f23acb44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:26.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.799+0000 7f23acb44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:26.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.799+0000 7f23acb44800 5 note: GC not initialized 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.799+0000 7f225dfe3640 20 reqs_thread_entry: start 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.799+0000 7f23acb44800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.799+0000 7f23acb44800 20 Filter name: none 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.799+0000 7f21cf7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.799+0000 7f23acb44800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.799+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:48:26.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 : miss 2024-09-12T00:48:26.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:26.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 info.flags=0x17 2024-09-12T00:48:26.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 to cache LRU end 2024-09-12T00:48:26.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:26.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:26.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.800+0000 7f23acb44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 2024-09-12T00:48:26.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.803+0000 7f23acb44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 info.flags=0x17 2024-09-12T00:48:26.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.803+0000 7f23acb44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 to cache LRU end 2024-09-12T00:48:26.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.803+0000 7f23acb44800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:26.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.803+0000 7f23acb44800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23, ofs0, ns] 2024-09-12T00:48:26.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.804+0000 7f227ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464353 cookie 93884894023264 notifier 6543 bl.length()=1009 2024-09-12T00:48:26.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.804+0000 7f227ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 info.flags=0x17 2024-09-12T00:48:26.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.804+0000 7f227ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 to cache LRU end 2024-09-12T00:48:26.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.804+0000 7f227ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:26.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.804+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): orig_sources= new_sources= 2024-09-12T00:48:26.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.804+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): potential sources added=[] removed=[] 2024-09-12T00:48:26.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.804+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): orig_dests= new_dests= 2024-09-12T00:48:26.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.804+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): potential dests added=[] removed=[] 2024-09-12T00:48:26.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.806+0000 7f23acb44800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.23.1.0 2024-09-12T00:48:26.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.806+0000 7f23acb44800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.23.1.0 2024-09-12T00:48:26.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.806+0000 7f23acb44800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.23.1.1 2024-09-12T00:48:26.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.806+0000 7f23acb44800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.23.1.1 2024-09-12T00:48:26.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.806+0000 7f23acb44800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.23.0 2024-09-12T00:48:26.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.808+0000 7f23acb44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:26.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.808+0000 7f23acb44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 2024-09-12T00:48:26.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.809+0000 7f23acb44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 info.flags=0x17 2024-09-12T00:48:26.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.809+0000 7f23acb44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 to cache LRU end 2024-09-12T00:48:26.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.809+0000 7f23acb44800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:26.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.809+0000 7f23acb44800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23, ofs0, ns] 2024-09-12T00:48:26.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.810+0000 7f227f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 93884894023264 notifier 6543 bl.length()=1009 2024-09-12T00:48:26.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.810+0000 7f227f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 info.flags=0x17 2024-09-12T00:48:26.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.810+0000 7f227f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 to cache LRU end 2024-09-12T00:48:26.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.810+0000 7f227f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:26.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.810+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): orig_sources= new_sources= 2024-09-12T00:48:26.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.810+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): potential sources added=[] removed=[] 2024-09-12T00:48:26.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.810+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): orig_dests= new_dests= 2024-09-12T00:48:26.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.810+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): potential dests added=[] removed=[] 2024-09-12T00:48:26.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.811+0000 7f23acb44800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.23.0 2024-09-12T00:48:26.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.811+0000 7f23acb44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:26.810 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.811+0000 7f23acb44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 2024-09-12T00:48:26.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f23acb44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 info.flags=0x17 2024-09-12T00:48:26.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f23acb44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 to cache LRU end 2024-09-12T00:48:26.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f23acb44800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:26.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f23acb44800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23, ofs0, ns] 2024-09-12T00:48:26.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f227ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464355 cookie 93884894023264 notifier 6543 bl.length()=977 2024-09-12T00:48:26.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f227ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 info.flags=0x17 2024-09-12T00:48:26.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f227ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.23 to cache LRU end 2024-09-12T00:48:26.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f227ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:26.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): orig_sources= new_sources= 2024-09-12T00:48:26.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): potential sources added=[] removed=[] 2024-09-12T00:48:26.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): orig_dests= new_dests= 2024-09-12T00:48:26.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.813+0000 7f23acb44800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.23]): potential dests added=[] removed=[] 2024-09-12T00:48:26.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.814+0000 7f23acb44800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:48:26.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.816+0000 7f225efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:26.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.818+0000 7f23acb44800 20 remove_watcher() i=0 2024-09-12T00:48:26.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.818+0000 7f23acb44800 2 removed watcher, disabling cache 2024-09-12T00:48:26.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.819+0000 7f23acb44800 20 remove_watcher() i=1 2024-09-12T00:48:26.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.820+0000 7f23acb44800 20 remove_watcher() i=2 2024-09-12T00:48:26.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.821+0000 7f23acb44800 20 remove_watcher() i=3 2024-09-12T00:48:26.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.822+0000 7f23acb44800 20 remove_watcher() i=4 2024-09-12T00:48:26.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.823+0000 7f23acb44800 20 remove_watcher() i=5 2024-09-12T00:48:26.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.824+0000 7f23acb44800 20 remove_watcher() i=6 2024-09-12T00:48:26.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.825+0000 7f23acb44800 20 remove_watcher() i=7 2024-09-12T00:48:26.835 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:48:26.863 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:26.864 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:26.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.901+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.903+0000 7f866872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.903+0000 7f866872e800 20 realm 2024-09-12T00:48:26.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.903+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.903+0000 7f866872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.903+0000 7f866872e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:26.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.903+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.903+0000 7f866872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:26.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.903+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.904+0000 7f866872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:26.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.904+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:26.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.904+0000 7f866872e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:26.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.904+0000 7f866872e800 20 searching for the correct realm 2024-09-12T00:48:26.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:26.907+0000 7f865bfff640 0 -- 172.21.15.83:0/4040928093 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f864c047400 msgr2=0x7f864c047880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:27.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.112+0000 7f865bfff640 0 -- 172.21.15.83:0/4040928093 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x564301544ab0 msgr2=0x564301546f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.116+0000 7f866872e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.116+0000 7f866872e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.116+0000 7f866872e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.116+0000 7f866872e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.116+0000 7f866872e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.116+0000 7f866872e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.116+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.116+0000 7f866872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.116+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:27.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 zone default found 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 4 Realm: () 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 zonegroup default 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.117+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.118+0000 7f866872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.118+0000 7f866872e800 20 started sync module instance, tier type = 2024-09-12T00:48:27.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.118+0000 7f866872e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:27.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.126+0000 7f866872e800 20 add_watcher() i=0 2024-09-12T00:48:27.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.126+0000 7f866872e800 20 add_watcher() i=1 2024-09-12T00:48:27.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.126+0000 7f866872e800 20 add_watcher() i=2 2024-09-12T00:48:27.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.126+0000 7f866872e800 20 add_watcher() i=3 2024-09-12T00:48:27.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.126+0000 7f866872e800 20 add_watcher() i=4 2024-09-12T00:48:27.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.126+0000 7f866872e800 20 add_watcher() i=5 2024-09-12T00:48:27.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.126+0000 7f866872e800 20 add_watcher() i=6 2024-09-12T00:48:27.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.127+0000 7f866872e800 20 add_watcher() i=7 2024-09-12T00:48:27.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.127+0000 7f866872e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:27.127 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.129+0000 7f851afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:27.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.129+0000 7f866872e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:27.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.129+0000 7f866872e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:27.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.129+0000 7f866872e800 5 note: GC not initialized 2024-09-12T00:48:27.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.129+0000 7f8519fdb640 20 reqs_thread_entry: start 2024-09-12T00:48:27.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.129+0000 7f866872e800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:27.128 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.130+0000 7f866872e800 20 Filter name: none 2024-09-12T00:48:27.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.130+0000 7f848b7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:27.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.130+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.130+0000 7f866872e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:27.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.130+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.131+0000 7f866872e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:27.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.131+0000 7f866872e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:27.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.131+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.132+0000 7f866872e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:27.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.132+0000 7f866872e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.132+0000 7f866872e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:27.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.132+0000 7f866872e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:27.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.135+0000 7f851afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:27.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.138+0000 7f866872e800 20 remove_watcher() i=0 2024-09-12T00:48:27.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.138+0000 7f866872e800 2 removed watcher, disabling cache 2024-09-12T00:48:27.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.139+0000 7f866872e800 20 remove_watcher() i=1 2024-09-12T00:48:27.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.140+0000 7f866872e800 20 remove_watcher() i=2 2024-09-12T00:48:27.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.141+0000 7f866872e800 20 remove_watcher() i=3 2024-09-12T00:48:27.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.141+0000 7f866872e800 20 remove_watcher() i=4 2024-09-12T00:48:27.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.143+0000 7f866872e800 20 remove_watcher() i=5 2024-09-12T00:48:27.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.143+0000 7f866872e800 20 remove_watcher() i=6 2024-09-12T00:48:27.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.144+0000 7f866872e800 20 remove_watcher() i=7 2024-09-12T00:48:27.154 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:27.154 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:48:27.154 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.23 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:48:27.154 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:27.155 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.156 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.159 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.159 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.203 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.203 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.217 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:48:27.217 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:27.218 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.218 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.227 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.227 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.269 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.269 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.277 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.277 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.285 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.285 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.292 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.292 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.299 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.299 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.307 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.307 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.317 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.317 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.322 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.322 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.330 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.330 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.337 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.337 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.345 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.345 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.352 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.352 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.360 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.360 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.368 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.368 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.375 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.375 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.382 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.382 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.389 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.389 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.397 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.397 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.404 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.404 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.412 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:27.412 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:27.420 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:48:27.448 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:27.448 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:27.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.485+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.487+0000 7f58a67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.487+0000 7f58a67af800 20 realm 2024-09-12T00:48:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.487+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.487+0000 7f58a67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.487+0000 7f58a67af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.487+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.487+0000 7f58a67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.487+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.488+0000 7f58a67af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:27.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.488+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.488+0000 7f58a67af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:27.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.488+0000 7f58a67af800 20 searching for the correct realm 2024-09-12T00:48:27.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.492+0000 7f58a3a98640 0 -- 172.21.15.83:0/3931501619 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f589807a450 msgr2=0x7f589807a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:27.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.697+0000 7f58a3a98640 0 -- 172.21.15.83:0/3931501619 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55677653acd0 msgr2=0x55677653d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:27.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.701+0000 7f58a67af800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:27.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.701+0000 7f58a67af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:27.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.701+0000 7f58a67af800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:27.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.701+0000 7f58a67af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:27.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.701+0000 7f58a67af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:27.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.701+0000 7f58a67af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:27.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.701+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.701+0000 7f58a67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.701+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:27.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 zone default found 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 4 Realm: () 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 zonegroup default 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.702+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.703+0000 7f58a67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.703+0000 7f58a67af800 20 started sync module instance, tier type = 2024-09-12T00:48:27.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.703+0000 7f58a67af800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:27.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.711+0000 7f58a67af800 20 add_watcher() i=0 2024-09-12T00:48:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.711+0000 7f58a67af800 20 add_watcher() i=1 2024-09-12T00:48:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.711+0000 7f58a67af800 20 add_watcher() i=2 2024-09-12T00:48:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.711+0000 7f58a67af800 20 add_watcher() i=3 2024-09-12T00:48:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.711+0000 7f58a67af800 20 add_watcher() i=4 2024-09-12T00:48:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.711+0000 7f58a67af800 20 add_watcher() i=5 2024-09-12T00:48:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.711+0000 7f58a67af800 20 add_watcher() i=6 2024-09-12T00:48:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.712+0000 7f58a67af800 20 add_watcher() i=7 2024-09-12T00:48:27.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.712+0000 7f58a67af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:27.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.714+0000 7f575afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:27.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.714+0000 7f58a67af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:27.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.714+0000 7f58a67af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:27.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.714+0000 7f58a67af800 5 note: GC not initialized 2024-09-12T00:48:27.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.714+0000 7f5759fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:27.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.714+0000 7f58a67af800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:27.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.714+0000 7f58a67af800 20 Filter name: none 2024-09-12T00:48:27.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.715+0000 7f5752ffd640 20 reqs_thread_entry: start 2024-09-12T00:48:27.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.715+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.715+0000 7f58a67af800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.715+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.716+0000 7f58a67af800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.716+0000 7f58a67af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.716+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.716+0000 7f58a67af800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.716+0000 7f58a67af800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.716+0000 7f58a67af800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:27.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.716+0000 7f58a67af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:27.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.718+0000 7f575afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:27.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.720+0000 7f58a67af800 20 remove_watcher() i=0 2024-09-12T00:48:27.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.720+0000 7f58a67af800 2 removed watcher, disabling cache 2024-09-12T00:48:27.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.721+0000 7f58a67af800 20 remove_watcher() i=1 2024-09-12T00:48:27.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.722+0000 7f58a67af800 20 remove_watcher() i=2 2024-09-12T00:48:27.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.722+0000 7f58a67af800 20 remove_watcher() i=3 2024-09-12T00:48:27.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.723+0000 7f58a67af800 20 remove_watcher() i=4 2024-09-12T00:48:27.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.724+0000 7f58a67af800 20 remove_watcher() i=5 2024-09-12T00:48:27.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.725+0000 7f58a67af800 20 remove_watcher() i=6 2024-09-12T00:48:27.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.727+0000 7f58a67af800 20 remove_watcher() i=7 2024-09-12T00:48:27.735 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:27.735 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:48:27.735 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:27.735 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:27.736 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:48:27.772 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:27.772 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:27.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.810+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.812+0000 7f7cb9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.812+0000 7f7cb9420800 20 realm 2024-09-12T00:48:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.812+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.812+0000 7f7cb9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.812+0000 7f7cb9420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.812+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.812+0000 7f7cb9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.812+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.813+0000 7f7cb9420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.813+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.813+0000 7f7cb9420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:27.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.813+0000 7f7cb9420800 20 searching for the correct realm 2024-09-12T00:48:27.815 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.817+0000 7f7cb6f11640 0 -- 172.21.15.83:0/3372569650 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f7ca806b1b0 msgr2=0x7f7ca8061080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:27.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.820+0000 7f7cb6f11640 0 -- 172.21.15.83:0/3372569650 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f7cb001f040 msgr2=0x7f7cb0010440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:27.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.823+0000 7f7cb9420800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:27.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.823+0000 7f7cb9420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:27.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.823+0000 7f7cb9420800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:27.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.823+0000 7f7cb9420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:27.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.823+0000 7f7cb9420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:27.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.823+0000 7f7cb9420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:27.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.823+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:27.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:27.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 20 zone default found 2024-09-12T00:48:27.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 4 Realm: () 2024-09-12T00:48:27.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:27.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:27.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:27.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 20 zonegroup default 2024-09-12T00:48:27.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.824+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.825+0000 7f7cb9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.825+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.825+0000 7f7cb9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.825+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.825+0000 7f7cb9420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.825+0000 7f7cb9420800 20 started sync module instance, tier type = 2024-09-12T00:48:27.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.825+0000 7f7cb9420800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.833+0000 7f7cb9420800 20 add_watcher() i=0 2024-09-12T00:48:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.833+0000 7f7cb9420800 20 add_watcher() i=1 2024-09-12T00:48:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.833+0000 7f7cb9420800 20 add_watcher() i=2 2024-09-12T00:48:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.833+0000 7f7cb9420800 20 add_watcher() i=3 2024-09-12T00:48:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.833+0000 7f7cb9420800 20 add_watcher() i=4 2024-09-12T00:48:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.833+0000 7f7cb9420800 20 add_watcher() i=5 2024-09-12T00:48:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.833+0000 7f7cb9420800 20 add_watcher() i=6 2024-09-12T00:48:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.834+0000 7f7cb9420800 20 add_watcher() i=7 2024-09-12T00:48:27.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.834+0000 7f7cb9420800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:27.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.836+0000 7f7b6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:27.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.836+0000 7f7cb9420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:27.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.836+0000 7f7cb9420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:27.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.836+0000 7f7cb9420800 5 note: GC not initialized 2024-09-12T00:48:27.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.836+0000 7f7ae7fff640 20 reqs_thread_entry: start 2024-09-12T00:48:27.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.836+0000 7f7cb9420800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:27.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.836+0000 7f7cb9420800 20 Filter name: none 2024-09-12T00:48:27.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.836+0000 7f7ae5ffb640 20 reqs_thread_entry: start 2024-09-12T00:48:27.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:48:27.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 : miss 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 info.flags=0x17 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 to cache LRU end 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:27.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.837+0000 7f7cb9420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 2024-09-12T00:48:27.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.840+0000 7f7cb9420800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:48:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.841+0000 7f7cb9420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 info.flags=0x17 2024-09-12T00:48:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.841+0000 7f7cb9420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 to cache LRU end 2024-09-12T00:48:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.841+0000 7f7cb9420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.841+0000 7f7cb9420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24, ofs0, ns] 2024-09-12T00:48:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.841+0000 7f7b9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464358 cookie 93912510352320 notifier 6224 bl.length()=1009 2024-09-12T00:48:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.841+0000 7f7b9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 info.flags=0x17 2024-09-12T00:48:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.841+0000 7f7b9a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 to cache LRU end 2024-09-12T00:48:27.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.841+0000 7f7b9a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:27.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.842+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): orig_sources= new_sources= 2024-09-12T00:48:27.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.842+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): potential sources added=[] removed=[] 2024-09-12T00:48:27.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.842+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): orig_dests= new_dests= 2024-09-12T00:48:27.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.842+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): potential dests added=[] removed=[] 2024-09-12T00:48:27.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.844+0000 7f7cb9420800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.24.1.0 2024-09-12T00:48:27.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.844+0000 7f7cb9420800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.24.1.0 2024-09-12T00:48:27.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.844+0000 7f7cb9420800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.24.1.1 2024-09-12T00:48:27.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.844+0000 7f7cb9420800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.24.1.1 2024-09-12T00:48:27.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.844+0000 7f7cb9420800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.24.0 2024-09-12T00:48:27.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.846+0000 7f7cb9420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:27.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.846+0000 7f7cb9420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 2024-09-12T00:48:27.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7cb9420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 info.flags=0x17 2024-09-12T00:48:27.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7cb9420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 to cache LRU end 2024-09-12T00:48:27.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7cb9420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:27.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7cb9420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24, ofs0, ns] 2024-09-12T00:48:27.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7b99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464359 cookie 93912510352320 notifier 6224 bl.length()=1009 2024-09-12T00:48:27.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7b99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 info.flags=0x17 2024-09-12T00:48:27.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7b99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 to cache LRU end 2024-09-12T00:48:27.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7b99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:27.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): orig_sources= new_sources= 2024-09-12T00:48:27.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): potential sources added=[] removed=[] 2024-09-12T00:48:27.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): orig_dests= new_dests= 2024-09-12T00:48:27.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.848+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): potential dests added=[] removed=[] 2024-09-12T00:48:27.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.849+0000 7f7cb9420800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.24.0 2024-09-12T00:48:27.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.849+0000 7f7cb9420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:27.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.849+0000 7f7cb9420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7cb9420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 info.flags=0x17 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7cb9420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 to cache LRU end 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7cb9420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7cb9420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24, ofs0, ns] 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7b99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464360 cookie 93912510352320 notifier 6224 bl.length()=977 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7b99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 info.flags=0x17 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7b99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.24 to cache LRU end 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7b99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): orig_sources= new_sources= 2024-09-12T00:48:27.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): potential sources added=[] removed=[] 2024-09-12T00:48:27.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): orig_dests= new_dests= 2024-09-12T00:48:27.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.851+0000 7f7cb9420800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.24]): potential dests added=[] removed=[] 2024-09-12T00:48:27.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.852+0000 7f7cb9420800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:48:27.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.854+0000 7f7b6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:27.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.856+0000 7f7cb9420800 20 remove_watcher() i=0 2024-09-12T00:48:27.855 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.856+0000 7f7cb9420800 2 removed watcher, disabling cache 2024-09-12T00:48:27.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.857+0000 7f7cb9420800 20 remove_watcher() i=1 2024-09-12T00:48:27.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.858+0000 7f7cb9420800 20 remove_watcher() i=2 2024-09-12T00:48:27.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.859+0000 7f7cb9420800 20 remove_watcher() i=3 2024-09-12T00:48:27.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.860+0000 7f7cb9420800 20 remove_watcher() i=4 2024-09-12T00:48:27.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.861+0000 7f7cb9420800 20 remove_watcher() i=5 2024-09-12T00:48:27.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.862+0000 7f7cb9420800 20 remove_watcher() i=6 2024-09-12T00:48:27.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.863+0000 7f7cb9420800 20 remove_watcher() i=7 2024-09-12T00:48:27.873 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:48:27.902 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:27.902 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:27.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.940+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.942+0000 7f054af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.942+0000 7f054af2f800 20 realm 2024-09-12T00:48:27.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.942+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.942+0000 7f054af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.942+0000 7f054af2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:27.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.942+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.942+0000 7f054af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:27.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.942+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.943+0000 7f054af2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:27.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.943+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:27.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.943+0000 7f054af2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:27.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.943+0000 7f054af2f800 20 searching for the correct realm 2024-09-12T00:48:27.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:27.946+0000 7f0546419640 0 -- 172.21.15.83:0/2764734673 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f053c004050 msgr2=0x7f053c081a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:28.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.152+0000 7f054741b640 0 -- 172.21.15.83:0/2764734673 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5598d611e6a0 msgr2=0x5598d6120ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:28.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:28.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:28.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:28.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:28.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:28.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:28.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:28.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.156+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:28.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 20 zone default found 2024-09-12T00:48:28.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 4 Realm: () 2024-09-12T00:48:28.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:28.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:28.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 20 zonegroup default 2024-09-12T00:48:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.157+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.158+0000 7f054af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.158+0000 7f054af2f800 20 started sync module instance, tier type = 2024-09-12T00:48:28.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.158+0000 7f054af2f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:28.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.166+0000 7f054af2f800 20 add_watcher() i=0 2024-09-12T00:48:28.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.166+0000 7f054af2f800 20 add_watcher() i=1 2024-09-12T00:48:28.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.166+0000 7f054af2f800 20 add_watcher() i=2 2024-09-12T00:48:28.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.166+0000 7f054af2f800 20 add_watcher() i=3 2024-09-12T00:48:28.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.166+0000 7f054af2f800 20 add_watcher() i=4 2024-09-12T00:48:28.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.166+0000 7f054af2f800 20 add_watcher() i=5 2024-09-12T00:48:28.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.166+0000 7f054af2f800 20 add_watcher() i=6 2024-09-12T00:48:28.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.167+0000 7f054af2f800 20 add_watcher() i=7 2024-09-12T00:48:28.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.167+0000 7f054af2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:28.167 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.169+0000 7f03fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:28.168 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.169+0000 7f054af2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.169+0000 7f054af2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.169+0000 7f054af2f800 5 note: GC not initialized 2024-09-12T00:48:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.169+0000 7f0377fff640 20 reqs_thread_entry: start 2024-09-12T00:48:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.169+0000 7f054af2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.169+0000 7f054af2f800 20 Filter name: none 2024-09-12T00:48:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.170+0000 7f0375ffb640 20 reqs_thread_entry: start 2024-09-12T00:48:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.170+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.170+0000 7f054af2f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:28.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.170+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.170+0000 7f054af2f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:28.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.171+0000 7f054af2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:28.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.171+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.171+0000 7f054af2f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:28.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.171+0000 7f054af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.171+0000 7f054af2f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:28.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.171+0000 7f054af2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:28.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.172+0000 7f03fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:28.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.174+0000 7f054af2f800 20 remove_watcher() i=0 2024-09-12T00:48:28.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.174+0000 7f054af2f800 2 removed watcher, disabling cache 2024-09-12T00:48:28.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.176+0000 7f054af2f800 20 remove_watcher() i=1 2024-09-12T00:48:28.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.177+0000 7f054af2f800 20 remove_watcher() i=2 2024-09-12T00:48:28.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.177+0000 7f054af2f800 20 remove_watcher() i=3 2024-09-12T00:48:28.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.178+0000 7f054af2f800 20 remove_watcher() i=4 2024-09-12T00:48:28.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.180+0000 7f054af2f800 20 remove_watcher() i=5 2024-09-12T00:48:28.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.181+0000 7f054af2f800 20 remove_watcher() i=6 2024-09-12T00:48:28.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.182+0000 7f054af2f800 20 remove_watcher() i=7 2024-09-12T00:48:28.190 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:28.191 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:48:28.191 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-set-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.24 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:48:28.191 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:28.192 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.193 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.195 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.196 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.239 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.239 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.252 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:48:28.253 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:28.254 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.254 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.264 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.264 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.307 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.307 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.315 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.316 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.324 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.324 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.332 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.332 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.340 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.340 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.349 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.349 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.357 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.357 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.364 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.365 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.372 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.372 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.379 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.380 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.387 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.387 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.395 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.395 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.402 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.402 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.410 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.410 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.418 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.418 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.425 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.425 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.433 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.433 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.441 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.441 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.448 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.448 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.456 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:28.456 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:28.464 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:48:28.493 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:28.493 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:28.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.531+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.533+0000 7f133af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.533+0000 7f133af19800 20 realm 2024-09-12T00:48:28.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.533+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.533+0000 7f133af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.533+0000 7f133af19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:28.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.533+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.533+0000 7f133af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.533+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.534+0000 7f133af19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:28.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.534+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.534+0000 7f133af19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:28.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.534+0000 7f133af19800 20 searching for the correct realm 2024-09-12T00:48:28.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.537+0000 7f1338202640 0 -- 172.21.15.83:0/3059475447 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f1320050ba0 msgr2=0x7f1320014220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:28.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.742+0000 7f1339204640 0 -- 172.21.15.83:0/3059475447 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5573a4d547f0 msgr2=0x5573a4d56c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.746+0000 7f133af19800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.746+0000 7f133af19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.746+0000 7f133af19800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.746+0000 7f133af19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.746+0000 7f133af19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.746+0000 7f133af19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.746+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.746+0000 7f133af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.746+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 zone default found 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 4 Realm: () 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 zonegroup default 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.747+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.748+0000 7f133af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:28.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.748+0000 7f133af19800 20 started sync module instance, tier type = 2024-09-12T00:48:28.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.748+0000 7f133af19800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:28.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.756+0000 7f133af19800 20 add_watcher() i=0 2024-09-12T00:48:28.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.756+0000 7f133af19800 20 add_watcher() i=1 2024-09-12T00:48:28.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.756+0000 7f133af19800 20 add_watcher() i=2 2024-09-12T00:48:28.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.756+0000 7f133af19800 20 add_watcher() i=3 2024-09-12T00:48:28.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.756+0000 7f133af19800 20 add_watcher() i=4 2024-09-12T00:48:28.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.756+0000 7f133af19800 20 add_watcher() i=5 2024-09-12T00:48:28.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.756+0000 7f133af19800 20 add_watcher() i=6 2024-09-12T00:48:28.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.757+0000 7f133af19800 20 add_watcher() i=7 2024-09-12T00:48:28.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.757+0000 7f133af19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:28.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.759+0000 7f11eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:28.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.759+0000 7f133af19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:28.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.759+0000 7f133af19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:28.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.759+0000 7f133af19800 5 note: GC not initialized 2024-09-12T00:48:28.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.759+0000 7f11edfe3640 20 reqs_thread_entry: start 2024-09-12T00:48:28.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.760+0000 7f133af19800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:28.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.760+0000 7f133af19800 20 Filter name: none 2024-09-12T00:48:28.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.760+0000 7f115f7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:28.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.760+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.760+0000 7f133af19800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:28.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.760+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.761+0000 7f133af19800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:28.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.761+0000 7f133af19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:28.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.761+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.761+0000 7f133af19800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:28.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.761+0000 7f133af19800 20 rados->read ofs=0 len=0 2024-09-12T00:48:28.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.762+0000 7f133af19800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:28.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.762+0000 7f133af19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:28.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.763+0000 7f11eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:28.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.765+0000 7f133af19800 20 remove_watcher() i=0 2024-09-12T00:48:28.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.765+0000 7f133af19800 2 removed watcher, disabling cache 2024-09-12T00:48:28.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.766+0000 7f133af19800 20 remove_watcher() i=1 2024-09-12T00:48:28.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.767+0000 7f133af19800 20 remove_watcher() i=2 2024-09-12T00:48:28.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.768+0000 7f133af19800 20 remove_watcher() i=3 2024-09-12T00:48:28.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.769+0000 7f133af19800 20 remove_watcher() i=4 2024-09-12T00:48:28.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.770+0000 7f133af19800 20 remove_watcher() i=5 2024-09-12T00:48:28.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.771+0000 7f133af19800 20 remove_watcher() i=6 2024-09-12T00:48:28.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.771+0000 7f133af19800 20 remove_watcher() i=7 2024-09-12T00:48:28.781 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:28.782 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:48:28.782 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-set-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:28.782 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:28.783 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:48:28.816 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:28.817 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:28.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:28.854+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.058+0000 7f1a25937800 20 realm 2024-09-12T00:48:29.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.058+0000 7f1a25937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.059+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.059+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.060+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.060+0000 7f1a25937800 20 searching for the correct realm 2024-09-12T00:48:29.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.264+0000 7f1a21621640 0 -- 172.21.15.83:0/4178100620 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f1a14038030 msgr2=0x7f1a14038410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:29.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.469+0000 7f1a21621640 0 -- 172.21.15.83:0/4178100620 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f1a1c0ad220 msgr2=0x7f1a1c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:29.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:29.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.675+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 20 zone default found 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 4 Realm: () 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 20 zonegroup default 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.678+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.678+0000 7f1a25937800 20 started sync module instance, tier type = 2024-09-12T00:48:29.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.678+0000 7f1a25937800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:29.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=0 2024-09-12T00:48:29.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=1 2024-09-12T00:48:29.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=2 2024-09-12T00:48:29.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=3 2024-09-12T00:48:29.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=4 2024-09-12T00:48:29.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=5 2024-09-12T00:48:29.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=6 2024-09-12T00:48:29.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=7 2024-09-12T00:48:29.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.687+0000 7f1a25937800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:29.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.689+0000 7f18d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.689+0000 7f1a25937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.689+0000 7f1a25937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 5 note: GC not initialized 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f18d67e4640 20 reqs_thread_entry: start 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 20 Filter name: none 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1847fff640 20 reqs_thread_entry: start 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:48:29.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 : miss 2024-09-12T00:48:29.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.690+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.691+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:29.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.691+0000 7f1a25937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:48:29.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.691+0000 7f1a25937800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:48:29.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.691+0000 7f1a25937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:29.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.691+0000 7f1a25937800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:29.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.691+0000 7f1a25937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 2024-09-12T00:48:29.692 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a25937800 time 2024-09-12T00:48:29.694689+0000 2024-09-12T00:48:29.692 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a26f8c71a] 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a26f8c8d8] 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d5226f641] 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd878e8) [0x564d527818e8] 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d5227f31d] 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1a25c29590] 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:48:29.693 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f1a25937800 thread_name:radosgw-admin 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.694+0000 7f1a25937800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a25937800 time 2024-09-12T00:48:29.694689+0000 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a26f8c71a] 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a26f8c8d8] 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d5226f641] 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd878e8) [0x564d527818e8] 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d5227f31d] 2024-09-12T00:48:29.694 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:48:29.695 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1a25c29590] 2024-09-12T00:48:29.695 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:48:29.695 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:48:29.695 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.712 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:29.712 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1a25c3e6f0] 2024-09-12T00:48:29.712 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1a25c8b99c] 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a26f8c774] 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a26f8c8d8] 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d5226f641] 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd878e8) [0x564d527818e8] 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d5227f31d] 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1a25c29590] 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:48:29.713 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.695+0000 7f1a25937800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f1a25937800 thread_name:radosgw-admin 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1a25c3e6f0] 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1a25c8b99c] 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a26f8c774] 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a26f8c8d8] 2024-09-12T00:48:29.714 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d5226f641] 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd878e8) [0x564d527818e8] 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d5227f31d] 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1a25c29590] 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:48:28.837+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.715 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:48:28.837+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:48:28.837+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:48:28.837+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:48:28.837+0000 7f1a21e22640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:48:28.837+0000 7f1a21e22640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:48:28.837+0000 7f1a21e22640 1 monclient: found mon.noname-a 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:48:28.837+0000 7f1a21e22640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: dump: 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.716 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 monclient: authenticate success, global_id 6639 2024-09-12T00:48:29.717 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:48:28.838+0000 7f1a25937800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:48:28.838+0000 7f1a25937800 4 set_mon_vals no callback set 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: dump: 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.718 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:48:28.838+0000 7f1a25937800 10 monclient: shutdown 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 asok(0x564d53a5a630) unregister_commands rotate-key 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:48:28.838+0000 7f1a25937800 10 monclient: build_initial_monmap 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:48:28.838+0000 7f1a25937800 1 build_initial for_mkfs: 0 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:48:28.838+0000 7f1a25937800 10 monclient: monmap: 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:48:29.719 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding auth protocol: cephx 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding auth protocol: cephx 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding auth protocol: cephx 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.720 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:48:28.839+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:48:28.839+0000 7f1a25937800 1 librados: starting msgr at 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:48:28.839+0000 7f1a25937800 1 librados: starting objecter 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command objecter_requests hook 0x564d53ca78d0 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:48:28.839+0000 7f1a25937800 1 librados: setting wanted keys 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:48:28.839+0000 7f1a25937800 1 librados: calling monclient init 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient: init 2024-09-12T00:48:29.721 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding auth protocol: cephx 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding auth protocol: cephx 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding auth protocol: cephx 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.722 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:48:28.839+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:48:28.839+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command rotate-key hook 0x564d53c7cbd8 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-c con 0x564d53af1240 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-a con 0x564d53bc6560 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-b con 0x564d53bcc3a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:29.723 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): authenticate will time out at 1862.108896s 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:48:28.839+0000 7f1a21621640 10 monclient(hunting): get_auth_request con 0x564d53af1240 auth_method 0 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:48:28.839+0000 7f1a21621640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:48:28.839+0000 7f1a21621640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:48:28.839+0000 7f1a21621640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:48:28.839+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request con 0x564d53bc6560 auth_method 0 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:48:28.839+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:48:28.839+0000 7f1a1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:48:28.839+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:48:28.840+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:48:28.840+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.724 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:48:28.840+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_done global_id 6642 payload 824 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 1 monclient: found mon.noname-a 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: dump: 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.725 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: dump: 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.726 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:48:28.840+0000 7f1a25937800 5 monclient: authenticate success, global_id 6642 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:48:28.840+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:48:28.840+0000 7f1a25937800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:48:28.840+0000 7f190f606640 4 set_mon_vals no callback set 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:48:28.840+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:48:28.840+0000 7f1a25937800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:48:28.840+0000 7f1a25937800 1 librados: init done 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:48:28.842+0000 7f190de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:29.727 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:48:28.842+0000 7f190de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:48:28.842+0000 7f190de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:48:28.842+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f1908076470 auth_method 0 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:48:28.842+0000 7f1a21e22640 10 monclient: get_auth_request con 0x564d53ca5500 auth_method 0 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:48:28.843+0000 7f1a21621640 10 monclient: get_auth_request con 0x564d53cc8220 auth_method 0 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:48:28.844+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53ccbb00 auth_method 0 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:48:28.845+0000 7f1a25937800 10 monclient: build_initial_monmap 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:48:28.845+0000 7f1a25937800 1 build_initial for_mkfs: 0 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:48:28.845+0000 7f1a25937800 10 monclient: monmap: 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:48:29.728 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding auth protocol: cephx 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding auth protocol: cephx 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding auth protocol: cephx 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.729 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:48:28.845+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command objecter_requests cmddesc objecter_requests hook 0x564d53cd4fa0 EEXIST 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:48:28.845+0000 7f1a25937800 10 monclient: init 2024-09-12T00:48:29.730 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding auth protocol: cephx 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding auth protocol: cephx 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding auth protocol: cephx 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.731 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:48:28.846+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:48:28.846+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:48:28.846+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command rotate-key cmddesc rotate-key hook 0x564d53cd0690 EEXIST 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-b con 0x564d53cf8c90 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:48:29.732 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-c con 0x564d53cfaf60 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-a con 0x564d53cf7460 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): authenticate will time out at 1862.115430s 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request con 0x564d53cfaf60 auth_method 0 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): get_auth_request con 0x564d53cf7460 auth_method 0 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.733 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.734 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.734 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.734 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.734 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.734 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): get_auth_request con 0x564d53cf8c90 auth_method 0 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.735 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_done global_id 6269 payload 824 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 1 monclient: found mon.noname-c 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: dump: 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.736 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.737 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.737 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.737 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.737 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.737 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.737 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.737 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.737 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.737 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.738 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:29.738 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: dump: 2024-09-12T00:48:29.738 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.738 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.738 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.738 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.738 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:48:28.847+0000 7f1a25937800 5 monclient: authenticate success, global_id 6269 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:48:28.847+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:48:28.847+0000 7f1a25937800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:48:28.847+0000 7f1a22623640 4 set_mon_vals no callback set 2024-09-12T00:48:29.739 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:48:28.847+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.740 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:48:28.847+0000 7f1a25937800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:48:29.740 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:48:28.848+0000 7f1906ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:29.740 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:48:28.848+0000 7f1906ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.740 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:48:28.848+0000 7f1906ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.740 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:48:28.848+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f18fc076380 auth_method 0 2024-09-12T00:48:29.740 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: get_monmap_and_config 2024-09-12T00:48:29.740 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: build_initial_monmap 2024-09-12T00:48:29.740 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:48:28.849+0000 7f1a25937800 1 build_initial for_mkfs: 0 2024-09-12T00:48:29.740 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: monmap: 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:48:29.741 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding auth protocol: cephx 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding auth protocol: cephx 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding auth protocol: cephx 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.742 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:48:28.849+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: init 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding auth protocol: cephx 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding auth protocol: cephx 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding auth protocol: cephx 2024-09-12T00:48:29.743 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.744 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.745 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.745 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:48:28.849+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.745 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:48:28.849+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.745 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command rotate-key cmddesc rotate-key hook 0x7ffdf85a3548 EEXIST 2024-09-12T00:48:29.745 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:29.745 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:48:29.745 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-c con 0x564d53d4d070 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:48:29.745 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-b con 0x564d53d1cbd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:48:29.745 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-a con 0x564d53d19b00 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): authenticate will time out at 1862.119048s 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): get_auth_request con 0x564d53d4d070 auth_method 0 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.746 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): get_auth_request con 0x564d53d19b00 auth_method 0 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request con 0x564d53d1cbd0 auth_method 0 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.747 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.748 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.748 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.748 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.748 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.748 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.748 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.748 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): handle_auth_done global_id 6272 payload 274 2024-09-12T00:48:29.748 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.748 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:48:28.850+0000 7f1a21621640 1 monclient: found mon.noname-c 2024-09-12T00:48:29.749 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:48:29.749 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.749 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:29.749 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: dump: 2024-09-12T00:48:29.749 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.749 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.749 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.750 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.750 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.750 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.750 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.750 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.750 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.750 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.751 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.751 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.751 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.751 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.751 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:29.751 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: dump: 2024-09-12T00:48:29.752 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.752 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.752 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.752 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.752 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:48:28.850+0000 7f1a25937800 5 monclient: authenticate success, global_id 6272 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:48:28.850+0000 7f1a25937800 4 set_mon_vals no callback set 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:48:28.851+0000 7f1a25937800 10 monclient: shutdown 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:48:28.851+0000 7f1a25937800 10 monclient: build_initial_monmap 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 build_initial for_mkfs: 0 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:48:28.851+0000 7f1a25937800 10 monclient: monmap: 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:48:29.753 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding auth protocol: cephx 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding auth protocol: cephx 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding auth protocol: cephx 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.754 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.755 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.755 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.755 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.755 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.755 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.755 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.755 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.755 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.756 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.756 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.756 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:48:28.851+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.756 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 librados: starting msgr at 2024-09-12T00:48:29.756 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 librados: starting objecter 2024-09-12T00:48:29.756 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command objecter_requests cmddesc objecter_requests hook 0x564d53d46c50 EEXIST 2024-09-12T00:48:29.756 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 librados: setting wanted keys 2024-09-12T00:48:29.756 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 librados: calling monclient init 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:48:28.851+0000 7f1a25937800 10 monclient: init 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding auth protocol: cephx 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding auth protocol: cephx 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding auth protocol: cephx 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.757 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:48:28.852+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:48:28.852+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:48:28.852+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command rotate-key cmddesc rotate-key hook 0x564d53d10b88 EEXIST 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:29.758 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-b con 0x564d53d19b00 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-c con 0x564d53d1cbd0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-a con 0x564d53d4d070 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): authenticate will time out at 1862.121419s 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): get_auth_request con 0x564d53d4d070 auth_method 0 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.759 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request con 0x564d53d1cbd0 auth_method 0 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:48:28.852+0000 7f1a21621640 10 monclient(hunting): get_auth_request con 0x564d53d19b00 auth_method 0 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:48:28.852+0000 7f1a21621640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:48:28.852+0000 7f1a21621640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.760 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:48:28.852+0000 7f1a21621640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): handle_auth_done global_id 6651 payload 824 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:48:28.852+0000 7f1a21e22640 1 monclient: found mon.noname-a 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: dump: 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.761 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: dump: 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.762 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:48:28.853+0000 7f1a25937800 5 monclient: authenticate success, global_id 6651 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:48:28.853+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:48:28.853+0000 7f1a25937800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:48:28.853+0000 7f1904ff9640 4 set_mon_vals no callback set 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:48:28.853+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:48:28.853+0000 7f1a25937800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.763 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:48:28.853+0000 7f1a25937800 1 librados: init done 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:48:28.853+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cr dump hook 0x564d53d3b978 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:48:28.854+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:48:28.855+0000 7f18f2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:48:28.855+0000 7f18f2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:48:28.855+0000 7f18f2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:48:28.855+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f18ec076470 auth_method 0 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:48:28.856+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53d67d20 auth_method 0 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:48:29.058+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53d67d20 auth_method 0 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 realm 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.764 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:48:29.058+0000 7f1a25937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:48:29.059+0000 7f1a21621640 10 monclient: get_auth_request con 0x564d53d6bf30 auth_method 0 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:48:29.059+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:48:29.059+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:48:29.060+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:48:29.060+0000 7f1a25937800 20 searching for the correct realm 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:48:29.060+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53d71210 auth_method 0 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:48:29.262+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53d71210 auth_method 0 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:48:29.263+0000 7f1a21e22640 10 monclient: get_auth_request con 0x7f1a0c079050 auth_method 0 2024-09-12T00:48:29.765 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:48:29.264+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f1a14038030 auth_method 0 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:48:29.264+0000 7f1a21621640 0 -- 172.21.15.83:0/4178100620 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f1a14038030 msgr2=0x7f1a14038410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:48:29.466+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f1a14038030 auth_method 0 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:48:29.467+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x7f1a0c071050 auth_method 0 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:48:29.469+0000 7f1a21e22640 10 monclient: get_auth_request con 0x7f1a14061950 auth_method 0 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:48:29.469+0000 7f1a21621640 0 -- 172.21.15.83:0/4178100620 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f1a1c0ad220 msgr2=0x7f1a1c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:48:29.670+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f1a1c0ad220 auth_method 0 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:29.766 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 zone default found 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:48:29.677+0000 7f1a25937800 4 Realm: () 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:48:29.677+0000 7f1a25937800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:48:29.677+0000 7f1a25937800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:48:29.677+0000 7f1a25937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 zonegroup default 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.767 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:48:29.678+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:48:29.678+0000 7f1a25937800 20 started sync module instance, tier type = 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:48:29.678+0000 7f1a25937800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=0 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=1 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=2 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=3 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=4 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=5 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=6 2024-09-12T00:48:29.768 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=7 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:48:29.687+0000 7f1a25937800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding auth protocol: cephx 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding auth protocol: cephx 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding auth protocol: cephx 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.769 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:48:29.689+0000 7f18d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:48:29.689+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:48:29.689+0000 7f1a25937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:48:29.689+0000 7f1a25937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cache list hook 0x564d53d46850 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cache inspect hook 0x564d53d46850 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cache erase hook 0x564d53d46850 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cache zap hook 0x564d53d46850 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 note: GC not initialized 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:48:29.690+0000 7f18d67e4640 20 reqs_thread_entry: start 2024-09-12T00:48:29.770 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command sync trace show hook 0x7f1a14013070 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command sync trace history hook 0x7f1a14013070 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command sync trace active hook 0x7f1a14013070 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command sync trace active_short hook 0x7f1a14013070 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 Filter name: none 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:48:29.690+0000 7f1847fff640 20 reqs_thread_entry: start 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:48:29.690+0000 7f1a25937800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:48:29.690+0000 7f1a25937800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:48:29.690+0000 7f1a25937800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:48:29.690+0000 7f1a25937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 : miss 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.771 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:48:29.691+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:48:29.694+0000 7f1a25937800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a25937800 time 2024-09-12T00:48:29.694689+0000 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a26f8c71a] 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a26f8c8d8] 2024-09-12T00:48:29.772 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d5226f641] 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd878e8) [0x564d527818e8] 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d5227f31d] 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1a25c29590] 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:48:29.695+0000 7f1a25937800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f1a25937800 thread_name:radosgw-admin 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:29.773 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1a25c3e6f0] 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1a25c8b99c] 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a26f8c774] 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a26f8c8d8] 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d5226f641] 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd878e8) [0x564d527818e8] 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d5227f31d] 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1a25c29590] 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:48:29.774 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:48:29.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:48:29.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:48:29.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:48:29.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:48:29.776 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:48:29.776 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:48:29.776 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:48:29.776 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:48:29.776 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:48:29.777 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:48:29.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:48:29.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:48:29.780 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:48:29.781 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:48:29.781 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:48:29.781 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:48:29.781 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:48:29.781 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:48:29.781 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:48:29.781 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:48:29.781 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:48:29.781 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:48:29.782 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1847fff640 / http_manager 2024-09-12T00:48:29.783 INFO:tasks.workunit.client.0.smithi083.stderr: 7f18d67e4640 / http_manager 2024-09-12T00:48:29.784 INFO:tasks.workunit.client.0.smithi083.stderr: 7f18d77e6640 / rgw_dt_lg_renew 2024-09-12T00:48:29.784 INFO:tasks.workunit.client.0.smithi083.stderr: 7f18f2ffd640 / ms_dispatch 2024-09-12T00:48:29.784 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1904ff9640 / io_context_pool 2024-09-12T00:48:29.784 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1906ffd640 / ms_dispatch 2024-09-12T00:48:29.784 INFO:tasks.workunit.client.0.smithi083.stderr: 7f190de03640 / ms_dispatch 2024-09-12T00:48:29.784 INFO:tasks.workunit.client.0.smithi083.stderr: 7f190f606640 / io_context_pool 2024-09-12T00:48:29.784 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a1bfff640 / msgr-worker-2 2024-09-12T00:48:29.784 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a21621640 / msgr-worker-1 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a21e22640 / msgr-worker-0 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a22623640 / io_context_pool 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a25937800 / radosgw-admin 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.100137.log 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:48:28.837+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:48:28.837+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.785 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:48:28.837+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:48:28.837+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:48:28.837+0000 7f1a21e22640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:48:28.837+0000 7f1a21e22640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:48:28.837+0000 7f1a21e22640 1 monclient: found mon.noname-a 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:48:28.837+0000 7f1a21e22640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: dump: 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.786 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.787 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.787 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.787 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.787 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.787 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.787 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.787 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.787 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.787 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 monclient: authenticate success, global_id 6639 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:48:28.838+0000 7f1a25937800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:48:28.838+0000 7f1a25937800 4 set_mon_vals no callback set 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:48:28.838+0000 7f190f606640 10 monclient: dump: 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.788 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:48:28.838+0000 7f1a25937800 10 monclient: shutdown 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 asok(0x564d53a5a630) unregister_commands rotate-key 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:48:28.838+0000 7f1a25937800 10 monclient: build_initial_monmap 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:48:28.838+0000 7f1a25937800 1 build_initial for_mkfs: 0 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:48:28.838+0000 7f1a25937800 10 monclient: monmap: 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.789 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding auth protocol: cephx 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding auth protocol: cephx 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding auth protocol: cephx 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.790 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: crc 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:48:28.838+0000 7f1a25937800 5 AuthRegistry(0x564d53ca6d00) adding con mode: secure 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:48:28.839+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:48:28.839+0000 7f1a25937800 1 librados: starting msgr at 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:48:28.839+0000 7f1a25937800 1 librados: starting objecter 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command objecter_requests hook 0x564d53ca78d0 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:48:28.839+0000 7f1a25937800 1 librados: setting wanted keys 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:48:28.839+0000 7f1a25937800 1 librados: calling monclient init 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient: init 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding auth protocol: cephx 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding auth protocol: cephx 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding auth protocol: cephx 2024-09-12T00:48:29.791 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.792 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.792 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.792 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.792 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.792 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.792 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.792 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.792 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.792 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: crc 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 AuthRegistry(0x564d53c7ca90) adding con mode: secure 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:48:28.839+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:48:28.839+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:48:28.839+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command rotate-key hook 0x564d53c7cbd8 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-c con 0x564d53af1240 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-a con 0x564d53bc6560 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:48:29.793 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-b con 0x564d53bcc3a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:48:28.839+0000 7f1a25937800 10 monclient(hunting): authenticate will time out at 1862.108896s 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:48:28.839+0000 7f1a21621640 10 monclient(hunting): get_auth_request con 0x564d53af1240 auth_method 0 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:48:28.839+0000 7f1a21621640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:48:28.839+0000 7f1a21621640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:48:28.839+0000 7f1a21621640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:48:28.839+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request con 0x564d53bc6560 auth_method 0 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:48:28.839+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.794 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:48:28.839+0000 7f1a1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:48:28.839+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:48:28.840+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:48:28.840+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:48:28.840+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_done global_id 6642 payload 824 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 1 monclient: found mon.noname-a 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:48:28.840+0000 7f1a1bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.795 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: dump: 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.796 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:48:28.840+0000 7f190de03640 10 monclient: dump: 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.797 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:48:28.840+0000 7f1a25937800 5 monclient: authenticate success, global_id 6642 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:48:28.840+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:48:28.840+0000 7f1a25937800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:48:28.840+0000 7f190f606640 4 set_mon_vals no callback set 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:48:28.840+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:48:28.840+0000 7f1a25937800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:48:28.840+0000 7f1a25937800 1 librados: init done 2024-09-12T00:48:29.798 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:48:28.842+0000 7f190de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:48:28.842+0000 7f190de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:48:28.842+0000 7f190de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:48:28.842+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f1908076470 auth_method 0 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:48:28.842+0000 7f1a21e22640 10 monclient: get_auth_request con 0x564d53ca5500 auth_method 0 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:48:28.843+0000 7f1a21621640 10 monclient: get_auth_request con 0x564d53cc8220 auth_method 0 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:48:28.844+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53ccbb00 auth_method 0 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:48:28.845+0000 7f1a25937800 10 monclient: build_initial_monmap 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:48:28.845+0000 7f1a25937800 1 build_initial for_mkfs: 0 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:48:28.845+0000 7f1a25937800 10 monclient: monmap: 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:29.799 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding auth protocol: cephx 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding auth protocol: cephx 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding auth protocol: cephx 2024-09-12T00:48:29.800 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: crc 2024-09-12T00:48:29.801 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd1590) adding con mode: secure 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:48:28.845+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command objecter_requests cmddesc objecter_requests hook 0x564d53cd4fa0 EEXIST 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:48:28.845+0000 7f1a25937800 10 monclient: init 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding auth protocol: cephx 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding auth protocol: cephx 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding auth protocol: cephx 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.802 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.803 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.803 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.803 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.803 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.803 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: crc 2024-09-12T00:48:29.803 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:48:28.845+0000 7f1a25937800 5 AuthRegistry(0x564d53cd0548) adding con mode: secure 2024-09-12T00:48:29.803 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:48:28.846+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.803 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:48:28.846+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.803 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:48:28.846+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command rotate-key cmddesc rotate-key hook 0x564d53cd0690 EEXIST 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-b con 0x564d53cf8c90 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-c con 0x564d53cfaf60 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-a con 0x564d53cf7460 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:48:28.846+0000 7f1a25937800 10 monclient(hunting): authenticate will time out at 1862.115430s 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request con 0x564d53cfaf60 auth_method 0 2024-09-12T00:48:29.804 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): get_auth_request con 0x564d53cf7460 auth_method 0 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.805 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:48:28.846+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): get_auth_request con 0x564d53cf8c90 auth_method 0 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:48:28.846+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_done global_id 6269 payload 824 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.806 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 1 monclient: found mon.noname-c 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:48:28.846+0000 7f1a1bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: dump: 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.807 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:48:28.847+0000 7f1906ffd640 10 monclient: dump: 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.808 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.809 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.809 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.809 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.809 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.809 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.809 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.809 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.809 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.809 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:48:28.847+0000 7f1a25937800 5 monclient: authenticate success, global_id 6269 2024-09-12T00:48:29.810 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:48:28.847+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.810 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:48:28.847+0000 7f1a25937800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:48:29.810 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:48:28.847+0000 7f1a22623640 4 set_mon_vals no callback set 2024-09-12T00:48:29.810 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:48:28.847+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.810 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:48:28.847+0000 7f1a25937800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:48:29.810 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:48:28.848+0000 7f1906ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:29.810 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:48:28.848+0000 7f1906ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.810 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:48:28.848+0000 7f1906ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.810 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:48:28.848+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f18fc076380 auth_method 0 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: get_monmap_and_config 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: build_initial_monmap 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:48:28.849+0000 7f1a25937800 1 build_initial for_mkfs: 0 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: monmap: 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:29.811 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.812 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:48:29.812 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:48:29.812 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:48:29.812 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.812 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding auth protocol: cephx 2024-09-12T00:48:29.812 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding auth protocol: cephx 2024-09-12T00:48:29.812 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding auth protocol: cephx 2024-09-12T00:48:29.812 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.812 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.813 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.813 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.813 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.813 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.813 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.813 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.813 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.813 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.813 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: crc 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x564d53d18b20) adding con mode: secure 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:48:28.849+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: init 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding auth protocol: cephx 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding auth protocol: cephx 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding auth protocol: cephx 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.814 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: crc 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a3400) adding con mode: secure 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:48:28.849+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:48:28.849+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.815 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:48:28.849+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command rotate-key cmddesc rotate-key hook 0x7ffdf85a3548 EEXIST 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:48:28.849+0000 7f1a25937800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-c con 0x564d53d4d070 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-b con 0x564d53d1cbd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-a con 0x564d53d19b00 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient(hunting): authenticate will time out at 1862.119048s 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): get_auth_request con 0x564d53d4d070 auth_method 0 2024-09-12T00:48:29.816 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): get_auth_request con 0x564d53d19b00 auth_method 0 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request con 0x564d53d1cbd0 auth_method 0 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.817 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:48:28.850+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:48:28.850+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient(hunting): handle_auth_done global_id 6272 payload 274 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:48:28.850+0000 7f1a21621640 1 monclient: found mon.noname-c 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:48:28.850+0000 7f1a21621640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:48:29.818 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: dump: 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.819 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:48:28.850+0000 7f1904ff9640 10 monclient: dump: 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.820 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:48:28.850+0000 7f1a25937800 5 monclient: authenticate success, global_id 6272 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:48:28.850+0000 7f1a25937800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:48:28.850+0000 7f1a25937800 4 set_mon_vals no callback set 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:48:28.851+0000 7f1a25937800 10 monclient: shutdown 2024-09-12T00:48:29.821 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:48:28.851+0000 7f1a25937800 10 monclient: build_initial_monmap 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 build_initial for_mkfs: 0 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:48:28.851+0000 7f1a25937800 10 monclient: monmap: 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:48:29.822 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding auth protocol: cephx 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding auth protocol: cephx 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding auth protocol: cephx 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.823 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: crc 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d1a6a0) adding con mode: secure 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:48:28.851+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 librados: starting msgr at 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 librados: starting objecter 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command objecter_requests cmddesc objecter_requests hook 0x564d53d46c50 EEXIST 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 librados: setting wanted keys 2024-09-12T00:48:29.824 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:48:28.851+0000 7f1a25937800 1 librados: calling monclient init 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:48:28.851+0000 7f1a25937800 10 monclient: init 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding auth protocol: cephx 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding auth protocol: cephx 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding auth protocol: cephx 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.825 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: crc 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:48:28.851+0000 7f1a25937800 5 AuthRegistry(0x564d53d10a40) adding con mode: secure 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:48:28.852+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:48:28.852+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:48:28.852+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command rotate-key cmddesc rotate-key hook 0x564d53d10b88 EEXIST 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-b con 0x564d53d19b00 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:48:29.826 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-c con 0x564d53d1cbd0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): picked mon.noname-a con 0x564d53d4d070 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:48:28.852+0000 7f1a25937800 10 monclient(hunting): authenticate will time out at 1862.121419s 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): get_auth_request con 0x564d53d4d070 auth_method 0 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.827 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request con 0x564d53d1cbd0 auth_method 0 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:48:28.852+0000 7f1a1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:29.828 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:48:28.852+0000 7f1a21621640 10 monclient(hunting): get_auth_request con 0x564d53d19b00 auth_method 0 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:48:28.852+0000 7f1a21621640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:48:28.852+0000 7f1a21621640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:48:28.852+0000 7f1a21621640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient(hunting): handle_auth_done global_id 6651 payload 824 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient: _finish_hunting 0 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:48:28.852+0000 7f1a21e22640 1 monclient: found mon.noname-a 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:48:28.852+0000 7f1a21e22640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: dump: 2024-09-12T00:48:29.829 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:48:29.830 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:48:28.853+0000 7f18f2ffd640 10 monclient: dump: 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:48:29.831 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:48:28.853+0000 7f1a25937800 5 monclient: authenticate success, global_id 6651 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:48:28.853+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:48:28.853+0000 7f1a25937800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:48:28.853+0000 7f1904ff9640 4 set_mon_vals no callback set 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:48:28.853+0000 7f1a25937800 10 monclient: _renew_subs 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:48:28.853+0000 7f1a25937800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:48:28.853+0000 7f1a25937800 1 librados: init done 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:48:28.853+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cr dump hook 0x564d53d3b978 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:48:28.854+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.832 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:48:28.855+0000 7f18f2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:48:28.855+0000 7f18f2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:48:28.855+0000 7f18f2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:48:28.855+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f18ec076470 auth_method 0 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:48:28.856+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53d67d20 auth_method 0 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:48:29.058+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53d67d20 auth_method 0 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 realm 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:48:29.058+0000 7f1a25937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.833 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:48:29.058+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:48:29.059+0000 7f1a21621640 10 monclient: get_auth_request con 0x564d53d6bf30 auth_method 0 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:48:29.059+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:48:29.059+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:48:29.060+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:48:29.060+0000 7f1a25937800 20 searching for the correct realm 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:48:29.060+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53d71210 auth_method 0 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:48:29.262+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x564d53d71210 auth_method 0 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:48:29.263+0000 7f1a21e22640 10 monclient: get_auth_request con 0x7f1a0c079050 auth_method 0 2024-09-12T00:48:29.834 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:48:29.264+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f1a14038030 auth_method 0 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:48:29.264+0000 7f1a21621640 0 -- 172.21.15.83:0/4178100620 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f1a14038030 msgr2=0x7f1a14038410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:48:29.466+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f1a14038030 auth_method 0 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:48:29.467+0000 7f1a1bfff640 10 monclient: get_auth_request con 0x7f1a0c071050 auth_method 0 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:48:29.469+0000 7f1a21e22640 10 monclient: get_auth_request con 0x7f1a14061950 auth_method 0 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:48:29.469+0000 7f1a21621640 0 -- 172.21.15.83:0/4178100620 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f1a1c0ad220 msgr2=0x7f1a1c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:48:29.670+0000 7f1a21621640 10 monclient: get_auth_request con 0x7f1a1c0ad220 auth_method 0 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:29.835 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:48:29.675+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:48:29.676+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 zone default found 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:48:29.677+0000 7f1a25937800 4 Realm: () 2024-09-12T00:48:29.836 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:48:29.677+0000 7f1a25937800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:48:29.677+0000 7f1a25937800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:48:29.677+0000 7f1a25937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 zonegroup default 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:48:29.677+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:48:29.678+0000 7f1a25937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:48:29.678+0000 7f1a25937800 20 started sync module instance, tier type = 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:48:29.678+0000 7f1a25937800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:29.837 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=0 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=1 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=2 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=3 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=4 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=5 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=6 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:48:29.687+0000 7f1a25937800 20 add_watcher() i=7 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:48:29.687+0000 7f1a25937800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding auth protocol: cephx 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding auth protocol: cephx 2024-09-12T00:48:29.838 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding auth protocol: cephx 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.839 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: crc 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 AuthRegistry(0x7ffdf85a38e0) adding con mode: secure 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:48:29.689+0000 7f18d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:48:29.689+0000 7f1a25937800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:48:29.689+0000 7f1a25937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:48:29.689+0000 7f1a25937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cache list hook 0x564d53d46850 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cache inspect hook 0x564d53d46850 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cache erase hook 0x564d53d46850 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:48:29.689+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command cache zap hook 0x564d53d46850 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 note: GC not initialized 2024-09-12T00:48:29.840 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:48:29.690+0000 7f18d67e4640 20 reqs_thread_entry: start 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command sync trace show hook 0x7f1a14013070 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command sync trace history hook 0x7f1a14013070 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command sync trace active hook 0x7f1a14013070 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:48:29.690+0000 7f1a25937800 5 asok(0x564d53a5a630) register_command sync trace active_short hook 0x7f1a14013070 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 Filter name: none 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:48:29.690+0000 7f1847fff640 20 reqs_thread_entry: start 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:48:29.690+0000 7f1a25937800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:29.841 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:48:29.690+0000 7f1a25937800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:48:29.690+0000 7f1a25937800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:48:29.690+0000 7f1a25937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 : miss 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:48:29.690+0000 7f1a25937800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:48:29.691+0000 7f1a25937800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:48:29.691+0000 7f1a25937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:48:29.694+0000 7f1a25937800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a25937800 time 2024-09-12T00:48:29.694689+0000 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:29.842 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1a26f8c71a] 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a26f8c8d8] 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d5226f641] 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd878e8) [0x564d527818e8] 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d5227f31d] 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1a25c29590] 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:48:29.843 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:48:29.695+0000 7f1a25937800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f1a25937800 thread_name:radosgw-admin 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1a25c3e6f0] 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1a25c8b99c] 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1a26f8c774] 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1a26f8c8d8] 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564d5226f641] 2024-09-12T00:48:29.844 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd878e8) [0x564d527818e8] 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564d5227f31d] 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1a25c29590] 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:48:29.845 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:48:29.846 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:48:29.847 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:48:29.848 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:48:29.849 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:48:29.850 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:48:29.851 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:48:29.852 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1847fff640 / http_manager 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 7f18d67e4640 / http_manager 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 7f18d77e6640 / rgw_dt_lg_renew 2024-09-12T00:48:29.853 INFO:tasks.workunit.client.0.smithi083.stderr: 7f18f2ffd640 / ms_dispatch 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1904ff9640 / io_context_pool 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1906ffd640 / ms_dispatch 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7f190de03640 / ms_dispatch 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7f190f606640 / io_context_pool 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a1bfff640 / msgr-worker-2 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a21621640 / msgr-worker-1 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a21e22640 / msgr-worker-0 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a22623640 / io_context_pool 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7f1a25937800 / radosgw-admin 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:48:29.854 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:48:29.696347Z_6507e8ef-cc07-4edf-8b1f-29aef5cdbca1/log 2024-09-12T00:48:29.855 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:48:29.855 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:48:29.856 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:29.856 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:29.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.770+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.772+0000 7f101c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.772+0000 7f101c00e800 20 realm 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.772+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.772+0000 7f101c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.772+0000 7f101c00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.772+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.773+0000 7f101c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.773+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.773+0000 7f101c00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.773+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.774+0000 7f101c00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.774+0000 7f101c00e800 20 searching for the correct realm 2024-09-12T00:48:29.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.777+0000 7f1016e58640 0 -- 172.21.15.83:0/1223202501 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f100c076030 msgr2=0x7f100c0d40e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:29.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.982+0000 7f1017e5a640 0 -- 172.21.15.83:0/1223202501 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5626628f8e90 msgr2=0x5626628fb2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:29.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.986+0000 7f101c00e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:29.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.986+0000 7f101c00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:29.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.986+0000 7f101c00e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:29.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.986+0000 7f101c00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:29.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.986+0000 7f101c00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:29.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.986+0000 7f101c00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:29.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.986+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.986+0000 7f101c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.986+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 20 zone default found 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 4 Realm: () 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 20 zonegroup default 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.987+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.988+0000 7f101c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.988+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:29.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.988+0000 7f101c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:29.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.988+0000 7f101c00e800 20 started sync module instance, tier type = 2024-09-12T00:48:29.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.988+0000 7f101c00e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:29.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.996+0000 7f101c00e800 20 add_watcher() i=0 2024-09-12T00:48:29.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.996+0000 7f101c00e800 20 add_watcher() i=1 2024-09-12T00:48:29.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.996+0000 7f101c00e800 20 add_watcher() i=2 2024-09-12T00:48:29.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.996+0000 7f101c00e800 20 add_watcher() i=3 2024-09-12T00:48:29.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.996+0000 7f101c00e800 20 add_watcher() i=4 2024-09-12T00:48:29.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.996+0000 7f101c00e800 20 add_watcher() i=5 2024-09-12T00:48:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.996+0000 7f101c00e800 20 add_watcher() i=6 2024-09-12T00:48:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.997+0000 7f101c00e800 20 add_watcher() i=7 2024-09-12T00:48:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.997+0000 7f101c00e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:29.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.999+0000 7f0ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:29.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.999+0000 7f101c00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:29.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.999+0000 7f101c00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:29.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:29.999+0000 7f101c00e800 5 note: GC not initialized 2024-09-12T00:48:29.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.000+0000 7f0eccfe1640 20 reqs_thread_entry: start 2024-09-12T00:48:29.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.000+0000 7f101c00e800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:29.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.000+0000 7f101c00e800 20 Filter name: none 2024-09-12T00:48:29.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.000+0000 7f0e467fc640 20 reqs_thread_entry: start 2024-09-12T00:48:29.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.000+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.000+0000 7f101c00e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:30.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.000+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.001+0000 7f101c00e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:30.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.001+0000 7f101c00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:30.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.001+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.001+0000 7f101c00e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:30.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.001+0000 7f101c00e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.001+0000 7f101c00e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:30.000 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.001+0000 7f101c00e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:30.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.003+0000 7f0ecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:30.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.004+0000 7f101c00e800 20 remove_watcher() i=0 2024-09-12T00:48:30.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.004+0000 7f101c00e800 2 removed watcher, disabling cache 2024-09-12T00:48:30.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.006+0000 7f101c00e800 20 remove_watcher() i=1 2024-09-12T00:48:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.007+0000 7f101c00e800 20 remove_watcher() i=2 2024-09-12T00:48:30.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.008+0000 7f101c00e800 20 remove_watcher() i=3 2024-09-12T00:48:30.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.009+0000 7f101c00e800 20 remove_watcher() i=4 2024-09-12T00:48:30.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.010+0000 7f101c00e800 20 remove_watcher() i=5 2024-09-12T00:48:30.009 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.011+0000 7f101c00e800 20 remove_watcher() i=6 2024-09-12T00:48:30.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.012+0000 7f101c00e800 20 remove_watcher() i=7 2024-09-12T00:48:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:30.030 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:48:30.030 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-set-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:48:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:48:30.030 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:30.030 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:48:30.073 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:30.104 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:30.104 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:30.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.142+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.144+0000 7f2f2a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:30.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.144+0000 7f2f2a540800 20 realm 2024-09-12T00:48:30.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.144+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.144+0000 7f2f2a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:30.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.144+0000 7f2f2a540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:30.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.144+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.144+0000 7f2f2a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:30.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.144+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.145+0000 7f2f2a540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.145+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.145+0000 7f2f2a540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:30.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.145+0000 7f2f2a540800 20 searching for the correct realm 2024-09-12T00:48:30.146 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.148+0000 7f2f1ffff640 0 -- 172.21.15.83:0/500757241 >> [v2:172.21.15.120:6800/3447039892,v1:172.21.15.120:6801/3447039892] conn(0x5637ec01c1f0 msgr2=0x5637ec01e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:30.149 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.151+0000 7f2f262ed640 0 -- 172.21.15.83:0/500757241 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f2f2006f400 msgr2=0x7f2f2006f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:30.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:48:30.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:30.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.358+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 zone default found 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 4 Realm: () 2024-09-12T00:48:30.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:48:30.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:48:30.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:30.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 zonegroup default 2024-09-12T00:48:30.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:30.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:30.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:30.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 started sync module instance, tier type = 2024-09-12T00:48:30.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.359+0000 7f2f2a540800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:48:30.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.368+0000 7f2f2a540800 20 add_watcher() i=0 2024-09-12T00:48:30.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.368+0000 7f2f2a540800 20 add_watcher() i=1 2024-09-12T00:48:30.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.368+0000 7f2f2a540800 20 add_watcher() i=2 2024-09-12T00:48:30.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.368+0000 7f2f2a540800 20 add_watcher() i=3 2024-09-12T00:48:30.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.368+0000 7f2f2a540800 20 add_watcher() i=4 2024-09-12T00:48:30.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.368+0000 7f2f2a540800 20 add_watcher() i=5 2024-09-12T00:48:30.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.368+0000 7f2f2a540800 20 add_watcher() i=6 2024-09-12T00:48:30.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.369+0000 7f2f2a540800 20 add_watcher() i=7 2024-09-12T00:48:30.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.369+0000 7f2f2a540800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:30.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2ddcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:30.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2f2a540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:30.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2f2a540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:30.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2f2a540800 5 note: GC not initialized 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2d577fe640 20 reqs_thread_entry: start 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2f2a540800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2f2a540800 20 Filter name: none 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2d557fa640 20 reqs_thread_entry: start 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2f2a540800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.371+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 : miss 2024-09-12T00:48:30.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 20 rados->read ofs=0 len=0 2024-09-12T00:48:30.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:48:30.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:48:30.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:48:30.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:30.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:48:30.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.372+0000 7f2f2a540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 2024-09-12T00:48:30.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.374+0000 7f2f2a540800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to be held by another RGW process; skipping for now 2024-09-12T00:48:30.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.374+0000 7f2ddcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:30.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.376+0000 7f2f2a540800 20 remove_watcher() i=0 2024-09-12T00:48:30.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.376+0000 7f2f2a540800 2 removed watcher, disabling cache 2024-09-12T00:48:30.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.378+0000 7f2f2a540800 20 remove_watcher() i=1 2024-09-12T00:48:30.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.379+0000 7f2f2a540800 20 remove_watcher() i=2 2024-09-12T00:48:30.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.380+0000 7f2f2a540800 20 remove_watcher() i=3 2024-09-12T00:48:30.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.381+0000 7f2f2a540800 20 remove_watcher() i=4 2024-09-12T00:48:30.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.382+0000 7f2f2a540800 20 remove_watcher() i=5 2024-09-12T00:48:30.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.383+0000 7f2f2a540800 20 remove_watcher() i=6 2024-09-12T00:48:30.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:48:30.383+0000 7f2f2a540800 20 remove_watcher() i=7 2024-09-12T00:48:30.392 INFO:tasks.workunit.client.0.smithi083.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:49:00.416 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:00.452 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:00.452 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:00.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.494+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.495+0000 7f0e65a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.495+0000 7f0e65a40800 20 realm 2024-09-12T00:49:00.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.495+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.496+0000 7f0e65a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.496+0000 7f0e65a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:00.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.496+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.496+0000 7f0e65a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.496+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.497+0000 7f0e65a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:00.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.497+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.497+0000 7f0e65a40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:00.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.497+0000 7f0e65a40800 20 searching for the correct realm 2024-09-12T00:49:00.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.501+0000 7f0e5bfff640 0 -- 172.21.15.83:0/1066372061 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f0e4c07c440 msgr2=0x7f0e4c07c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:00.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.708+0000 7f0e63d2b640 0 -- 172.21.15.83:0/1066372061 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f875c7dba0 msgr2=0x55f875c80010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:00.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.712+0000 7f0e65a40800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:00.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.712+0000 7f0e65a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:00.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.712+0000 7f0e65a40800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:00.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.712+0000 7f0e65a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:00.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.712+0000 7f0e65a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:00.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.712+0000 7f0e65a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:00.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.712+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 20 zone default found 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 4 Realm: () 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 20 zonegroup default 2024-09-12T00:49:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.713+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.714+0000 7f0e65a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.714+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.714+0000 7f0e65a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.714+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.715+0000 7f0e65a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.715+0000 7f0e65a40800 20 started sync module instance, tier type = 2024-09-12T00:49:00.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.715+0000 7f0e65a40800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:00.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.724+0000 7f0e65a40800 20 add_watcher() i=0 2024-09-12T00:49:00.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.724+0000 7f0e65a40800 20 add_watcher() i=1 2024-09-12T00:49:00.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.724+0000 7f0e65a40800 20 add_watcher() i=2 2024-09-12T00:49:00.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.724+0000 7f0e65a40800 20 add_watcher() i=3 2024-09-12T00:49:00.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.724+0000 7f0e65a40800 20 add_watcher() i=4 2024-09-12T00:49:00.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.724+0000 7f0e65a40800 20 add_watcher() i=5 2024-09-12T00:49:00.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.724+0000 7f0e65a40800 20 add_watcher() i=6 2024-09-12T00:49:00.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.726+0000 7f0e65a40800 20 add_watcher() i=7 2024-09-12T00:49:00.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.726+0000 7f0e65a40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:00.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.728+0000 7f0d19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:00.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.728+0000 7f0e65a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:00.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.728+0000 7f0e65a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:00.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.728+0000 7f0e65a40800 5 note: GC not initialized 2024-09-12T00:49:00.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.728+0000 7f0d18fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:00.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.728+0000 7f0e65a40800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:00.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.728+0000 7f0e65a40800 20 Filter name: none 2024-09-12T00:49:00.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.729+0000 7f0c927fc640 20 reqs_thread_entry: start 2024-09-12T00:49:00.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.729+0000 7f0e65a40800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:49:00.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.729+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.729+0000 7f0e65a40800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:49:00.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.729+0000 7f0e65a40800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:49:00.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.729+0000 7f0e65a40800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:49:00.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.729+0000 7f0e65a40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 : miss 2024-09-12T00:49:00.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.729+0000 7f0e65a40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.729+0000 7f0e65a40800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:49:00.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.730+0000 7f0e65a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:49:00.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.730+0000 7f0e65a40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:49:00.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.730+0000 7f0e65a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:00.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.730+0000 7f0e65a40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:00.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.730+0000 7f0e65a40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 2024-09-12T00:49:00.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.733+0000 7f0e65a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:49:00.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.733+0000 7f0e65a40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:49:00.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.733+0000 7f0e65a40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:00.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.733+0000 7f0e65a40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25, ofs0, ns] 2024-09-12T00:49:00.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.734+0000 7f0d467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464363 cookie 94525616288320 notifier 6329 bl.length()=1009 2024-09-12T00:49:00.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.734+0000 7f0d467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:49:00.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.734+0000 7f0d467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:49:00.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.734+0000 7f0d467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:00.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.734+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): orig_sources= new_sources= 2024-09-12T00:49:00.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.734+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): potential sources added=[] removed=[] 2024-09-12T00:49:00.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.734+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): orig_dests= new_dests= 2024-09-12T00:49:00.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.734+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): potential dests added=[] removed=[] 2024-09-12T00:49:00.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.736+0000 7f0e65a40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.25.1.0 2024-09-12T00:49:00.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.736+0000 7f0e65a40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.25.1.0 2024-09-12T00:49:00.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.736+0000 7f0e65a40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.25.1.1 2024-09-12T00:49:00.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.736+0000 7f0e65a40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.25.1.1 2024-09-12T00:49:00.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.736+0000 7f0e65a40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.25.0 2024-09-12T00:49:00.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.739+0000 7f0e65a40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:00.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.739+0000 7f0e65a40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 2024-09-12T00:49:00.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.740+0000 7f0e65a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:49:00.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.740+0000 7f0e65a40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:49:00.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.740+0000 7f0e65a40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:00.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.740+0000 7f0e65a40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25, ofs0, ns] 2024-09-12T00:49:00.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.740+0000 7f0d467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464364 cookie 94525616288320 notifier 6329 bl.length()=1009 2024-09-12T00:49:00.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.740+0000 7f0d467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:49:00.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.740+0000 7f0d467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:49:00.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.740+0000 7f0d467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:00.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.741+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): orig_sources= new_sources= 2024-09-12T00:49:00.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.741+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): potential sources added=[] removed=[] 2024-09-12T00:49:00.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.741+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): orig_dests= new_dests= 2024-09-12T00:49:00.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.741+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): potential dests added=[] removed=[] 2024-09-12T00:49:00.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.742+0000 7f0e65a40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.25.0 2024-09-12T00:49:00.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.742+0000 7f0e65a40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:00.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.742+0000 7f0e65a40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 2024-09-12T00:49:00.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0e65a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:49:00.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0e65a40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:49:00.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0e65a40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:00.743 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0e65a40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25, ofs0, ns] 2024-09-12T00:49:00.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0d46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94525616288320 notifier 6329 bl.length()=977 2024-09-12T00:49:00.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0d46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 info.flags=0x17 2024-09-12T00:49:00.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0d46ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.25 to cache LRU end 2024-09-12T00:49:00.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0d46ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:00.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): orig_sources= new_sources= 2024-09-12T00:49:00.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): potential sources added=[] removed=[] 2024-09-12T00:49:00.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): orig_dests= new_dests= 2024-09-12T00:49:00.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.744+0000 7f0e65a40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.25]): potential dests added=[] removed=[] 2024-09-12T00:49:00.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.745+0000 7f0e65a40800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:00.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.747+0000 7f0d19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:00.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.750+0000 7f0e65a40800 20 remove_watcher() i=0 2024-09-12T00:49:00.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.750+0000 7f0e65a40800 2 removed watcher, disabling cache 2024-09-12T00:49:00.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.751+0000 7f0e65a40800 20 remove_watcher() i=1 2024-09-12T00:49:00.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.752+0000 7f0e65a40800 20 remove_watcher() i=2 2024-09-12T00:49:00.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.753+0000 7f0e65a40800 20 remove_watcher() i=3 2024-09-12T00:49:00.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.754+0000 7f0e65a40800 20 remove_watcher() i=4 2024-09-12T00:49:00.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.755+0000 7f0e65a40800 20 remove_watcher() i=5 2024-09-12T00:49:00.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.756+0000 7f0e65a40800 20 remove_watcher() i=6 2024-09-12T00:49:00.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.757+0000 7f0e65a40800 20 remove_watcher() i=7 2024-09-12T00:49:00.769 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:49:00.798 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:00.798 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:00.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.835+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.837+0000 7f641e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.837+0000 7f641e746800 20 realm 2024-09-12T00:49:00.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.837+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.837+0000 7f641e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.837+0000 7f641e746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:00.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.837+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.838+0000 7f641e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:00.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.838+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.838+0000 7f641e746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:00.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.838+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:00.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.839+0000 7f641e746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:00.838 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.839+0000 7f641e746800 20 searching for the correct realm 2024-09-12T00:49:00.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:00.842+0000 7f6413fff640 0 -- 172.21.15.83:0/2183666150 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f6404064410 msgr2=0x7f6404064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:01.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.048+0000 7f641ca38640 0 -- 172.21.15.83:0/2183666150 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55d4dda686c0 msgr2=0x55d4dda6aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:01.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.052+0000 7f641e746800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:01.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.052+0000 7f641e746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:01.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.052+0000 7f641e746800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:01.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.052+0000 7f641e746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:01.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.052+0000 7f641e746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:01.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.052+0000 7f641e746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.052+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.052+0000 7f641e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.052+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:01.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 20 zone default found 2024-09-12T00:49:01.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 4 Realm: () 2024-09-12T00:49:01.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:01.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 20 zonegroup default 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.053+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.054+0000 7f641e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.054+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.054+0000 7f641e746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.054+0000 7f641e746800 20 started sync module instance, tier type = 2024-09-12T00:49:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.054+0000 7f641e746800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:01.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.064+0000 7f641e746800 20 add_watcher() i=0 2024-09-12T00:49:01.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.064+0000 7f641e746800 20 add_watcher() i=1 2024-09-12T00:49:01.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.064+0000 7f641e746800 20 add_watcher() i=2 2024-09-12T00:49:01.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.064+0000 7f641e746800 20 add_watcher() i=3 2024-09-12T00:49:01.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.064+0000 7f641e746800 20 add_watcher() i=4 2024-09-12T00:49:01.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.064+0000 7f641e746800 20 add_watcher() i=5 2024-09-12T00:49:01.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.064+0000 7f641e746800 20 add_watcher() i=6 2024-09-12T00:49:01.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.065+0000 7f641e746800 20 add_watcher() i=7 2024-09-12T00:49:01.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.065+0000 7f641e746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:01.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.067+0000 7f62d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:01.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.068+0000 7f641e746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:01.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.068+0000 7f641e746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:01.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.068+0000 7f641e746800 5 note: GC not initialized 2024-09-12T00:49:01.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.068+0000 7f62d1fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:01.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.068+0000 7f641e746800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:01.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.068+0000 7f641e746800 20 Filter name: none 2024-09-12T00:49:01.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.068+0000 7f62437fe640 20 reqs_thread_entry: start 2024-09-12T00:49:01.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.068+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.069+0000 7f641e746800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:49:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.069+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.069+0000 7f641e746800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:49:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.069+0000 7f641e746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.069+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.070+0000 7f641e746800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:49:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.070+0000 7f641e746800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.070+0000 7f641e746800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:49:01.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.070+0000 7f641e746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:01.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.071+0000 7f62d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:01.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.074+0000 7f641e746800 20 remove_watcher() i=0 2024-09-12T00:49:01.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.074+0000 7f641e746800 2 removed watcher, disabling cache 2024-09-12T00:49:01.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.075+0000 7f641e746800 20 remove_watcher() i=1 2024-09-12T00:49:01.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.076+0000 7f641e746800 20 remove_watcher() i=2 2024-09-12T00:49:01.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.077+0000 7f641e746800 20 remove_watcher() i=3 2024-09-12T00:49:01.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.078+0000 7f641e746800 20 remove_watcher() i=4 2024-09-12T00:49:01.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.079+0000 7f641e746800 20 remove_watcher() i=5 2024-09-12T00:49:01.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.080+0000 7f641e746800 20 remove_watcher() i=6 2024-09-12T00:49:01.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.081+0000 7f641e746800 20 remove_watcher() i=7 2024-09-12T00:49:01.091 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:01.091 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:01.091 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-set-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:49:01.091 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:01.093 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.093 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.096 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.096 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.139 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.139 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.153 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:49:01.153 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:01.155 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.155 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.165 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.166 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.208 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.208 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.216 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.217 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.224 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.225 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.232 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.233 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.241 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.241 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.249 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.249 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.257 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.257 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.265 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.265 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.273 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.273 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.281 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.281 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.288 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.289 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.296 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.296 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.304 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.304 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.313 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.313 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.320 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.321 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.361 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.361 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.369 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.369 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.377 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.377 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.385 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.385 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.393 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.393 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.401 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:49:01.429 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:01.429 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:01.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.465+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.467+0000 7fb024f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.467+0000 7fb024f40800 20 realm 2024-09-12T00:49:01.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.467+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.467+0000 7fb024f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.467+0000 7fb024f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:01.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.467+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.467+0000 7fb024f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.467+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.468+0000 7fb024f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:01.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.468+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.469+0000 7fb024f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:01.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.469+0000 7fb024f40800 20 searching for the correct realm 2024-09-12T00:49:01.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.472+0000 7fb01bfff640 0 -- 172.21.15.83:0/3258332476 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fb00c0b8ff0 msgr2=0x7fb00c094180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:01.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.476+0000 7fb0214c1640 0 -- 172.21.15.83:0/3258332476 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55c0fa26afd0 msgr2=0x55c0fa26d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:01.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.479+0000 7fb024f40800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:01.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.479+0000 7fb024f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:01.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.479+0000 7fb024f40800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:01.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.479+0000 7fb024f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:01.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.479+0000 7fb024f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:01.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.479+0000 7fb024f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:01.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.479+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 20 zone default found 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 4 Realm: () 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 20 zonegroup default 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.480+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.481+0000 7fb024f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.481+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.481+0000 7fb024f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.481+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.481+0000 7fb024f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.481+0000 7fb024f40800 20 started sync module instance, tier type = 2024-09-12T00:49:01.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.481+0000 7fb024f40800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.490+0000 7fb024f40800 20 add_watcher() i=0 2024-09-12T00:49:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.490+0000 7fb024f40800 20 add_watcher() i=1 2024-09-12T00:49:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.490+0000 7fb024f40800 20 add_watcher() i=2 2024-09-12T00:49:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.490+0000 7fb024f40800 20 add_watcher() i=3 2024-09-12T00:49:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.490+0000 7fb024f40800 20 add_watcher() i=4 2024-09-12T00:49:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.490+0000 7fb024f40800 20 add_watcher() i=5 2024-09-12T00:49:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.490+0000 7fb024f40800 20 add_watcher() i=6 2024-09-12T00:49:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.491+0000 7fb024f40800 20 add_watcher() i=7 2024-09-12T00:49:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.491+0000 7fb024f40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:01.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.492+0000 7faed6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.493+0000 7fb024f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.493+0000 7fb024f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.493+0000 7fb024f40800 5 note: GC not initialized 2024-09-12T00:49:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.493+0000 7faed5fe3640 20 reqs_thread_entry: start 2024-09-12T00:49:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.493+0000 7fb024f40800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.493+0000 7fb024f40800 20 Filter name: none 2024-09-12T00:49:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.493+0000 7fae477fe640 20 reqs_thread_entry: start 2024-09-12T00:49:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.493+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.494+0000 7fb024f40800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.494+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.495+0000 7fb024f40800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.495+0000 7fb024f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.495+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.495+0000 7fb024f40800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.495+0000 7fb024f40800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.495+0000 7fb024f40800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.495+0000 7fb024f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:01.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.496+0000 7faed6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:01.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.498+0000 7fb024f40800 20 remove_watcher() i=0 2024-09-12T00:49:01.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.498+0000 7fb024f40800 2 removed watcher, disabling cache 2024-09-12T00:49:01.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.499+0000 7fb024f40800 20 remove_watcher() i=1 2024-09-12T00:49:01.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.501+0000 7fb024f40800 20 remove_watcher() i=2 2024-09-12T00:49:01.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.502+0000 7fb024f40800 20 remove_watcher() i=3 2024-09-12T00:49:01.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.502+0000 7fb024f40800 20 remove_watcher() i=4 2024-09-12T00:49:01.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.503+0000 7fb024f40800 20 remove_watcher() i=5 2024-09-12T00:49:01.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.504+0000 7fb024f40800 20 remove_watcher() i=6 2024-09-12T00:49:01.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.505+0000 7fb024f40800 20 remove_watcher() i=7 2024-09-12T00:49:01.515 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:01.515 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:01.515 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-trim-reshard-log-entries id: ad4424e4-de7c-4376-b125-e717016a3484.4511.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:01.515 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:01.517 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:49:01.550 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:01.551 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:01.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.587+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.589+0000 7fe8f4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.589+0000 7fe8f4f2a800 20 realm 2024-09-12T00:49:01.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.589+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.590+0000 7fe8f4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.590+0000 7fe8f4f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:01.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.590+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.590+0000 7fe8f4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.590+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.590+0000 7fe8f4f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:01.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.590+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.591+0000 7fe8f4f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:01.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.591+0000 7fe8f4f2a800 20 searching for the correct realm 2024-09-12T00:49:01.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.594+0000 7fe8ebfff640 0 -- 172.21.15.83:0/2133741660 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fe8dc07d960 msgr2=0x7fe8dc06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:01.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.798+0000 7fe8ebfff640 0 -- 172.21.15.83:0/2133741660 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55ad9e8e7b90 msgr2=0x55ad9e8e9fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:01.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.802+0000 7fe8f4f2a800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:01.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.802+0000 7fe8f4f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:01.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.802+0000 7fe8f4f2a800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:01.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.802+0000 7fe8f4f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:01.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.802+0000 7fe8f4f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:01.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.802+0000 7fe8f4f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:01.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.802+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:01.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:01.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 zone default found 2024-09-12T00:49:01.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 4 Realm: () 2024-09-12T00:49:01.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:01.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:01.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:01.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 zonegroup default 2024-09-12T00:49:01.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.803+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.804+0000 7fe8f4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.804+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.804+0000 7fe8f4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.804+0000 7fe8f4f2a800 20 started sync module instance, tier type = 2024-09-12T00:49:01.807 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.804+0000 7fe8f4f2a800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:01.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.814+0000 7fe8f4f2a800 20 add_watcher() i=0 2024-09-12T00:49:01.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.814+0000 7fe8f4f2a800 20 add_watcher() i=1 2024-09-12T00:49:01.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.814+0000 7fe8f4f2a800 20 add_watcher() i=2 2024-09-12T00:49:01.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.814+0000 7fe8f4f2a800 20 add_watcher() i=3 2024-09-12T00:49:01.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.814+0000 7fe8f4f2a800 20 add_watcher() i=4 2024-09-12T00:49:01.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.814+0000 7fe8f4f2a800 20 add_watcher() i=5 2024-09-12T00:49:01.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.814+0000 7fe8f4f2a800 20 add_watcher() i=6 2024-09-12T00:49:01.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.815+0000 7fe8f4f2a800 20 add_watcher() i=7 2024-09-12T00:49:01.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.815+0000 7fe8f4f2a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:01.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.816+0000 7fe7a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:01.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.817+0000 7fe8f4f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:01.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.817+0000 7fe8f4f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:01.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.817+0000 7fe8f4f2a800 5 note: GC not initialized 2024-09-12T00:49:01.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.817+0000 7fe7a67e4640 20 reqs_thread_entry: start 2024-09-12T00:49:01.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.817+0000 7fe8f4f2a800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:01.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.817+0000 7fe8f4f2a800 20 Filter name: none 2024-09-12T00:49:01.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.817+0000 7fe79ffff640 20 reqs_thread_entry: start 2024-09-12T00:49:01.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.817+0000 7fe8f4f2a800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:49:01.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.817+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:01.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:01.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 : miss 2024-09-12T00:49:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.818+0000 7fe8f4f2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 2024-09-12T00:49:01.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.822+0000 7fe8f4f2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:01.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.822+0000 7fe8f4f2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:01.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.822+0000 7fe8f4f2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:01.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.822+0000 7fe8f4f2a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26, ofs0, ns] 2024-09-12T00:49:01.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.822+0000 7fe7c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464285 cookie 94204177896064 notifier 6762 bl.length()=1023 2024-09-12T00:49:01.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.822+0000 7fe7c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:01.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.822+0000 7fe7c7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:01.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.822+0000 7fe7c7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:01.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.823+0000 7fe8f4f2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): orig_sources= new_sources= 2024-09-12T00:49:01.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.823+0000 7fe8f4f2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): potential sources added=[] removed=[] 2024-09-12T00:49:01.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.823+0000 7fe8f4f2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): orig_dests= new_dests= 2024-09-12T00:49:01.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.823+0000 7fe8f4f2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): potential dests added=[] removed=[] 2024-09-12T00:49:01.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.823+0000 7fe8f4f2a800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:49:01.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.823+0000 7fe8f4f2a800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:49:01.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.825+0000 7fe7a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:01.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.827+0000 7fe8f4f2a800 20 remove_watcher() i=0 2024-09-12T00:49:01.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.827+0000 7fe8f4f2a800 2 removed watcher, disabling cache 2024-09-12T00:49:01.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.828+0000 7fe8f4f2a800 20 remove_watcher() i=1 2024-09-12T00:49:01.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.829+0000 7fe8f4f2a800 20 remove_watcher() i=2 2024-09-12T00:49:01.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.830+0000 7fe8f4f2a800 20 remove_watcher() i=3 2024-09-12T00:49:01.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.831+0000 7fe8f4f2a800 20 remove_watcher() i=4 2024-09-12T00:49:01.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.832+0000 7fe8f4f2a800 20 remove_watcher() i=5 2024-09-12T00:49:01.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.833+0000 7fe8f4f2a800 20 remove_watcher() i=6 2024-09-12T00:49:01.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.834+0000 7fe8f4f2a800 20 remove_watcher() i=7 2024-09-12T00:49:01.845 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:49:01.874 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:01.874 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:01.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.910+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.912+0000 7f5fa4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.912+0000 7f5fa4925800 20 realm 2024-09-12T00:49:01.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.912+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.912+0000 7f5fa4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.912+0000 7f5fa4925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:01.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.912+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.912+0000 7f5fa4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.912+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.913+0000 7f5fa4925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:01.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.913+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.913+0000 7f5fa4925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:01.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.913+0000 7f5fa4925800 20 searching for the correct realm 2024-09-12T00:49:01.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.917+0000 7f5fa0d34640 0 -- 172.21.15.83:0/1682446229 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f5f88088070 msgr2=0x7f5f88089400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:01.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.920+0000 7f5fa0533640 0 -- 172.21.15.83:0/1682446229 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f5f98025040 msgr2=0x7f5f98016950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:01.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:01.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:01.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:01.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:01.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:01.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:01.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:01.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:01.925 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 zone default found 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 4 Realm: () 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 zonegroup default 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.924+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.925+0000 7f5fa4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.925+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.925+0000 7f5fa4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.925+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.925+0000 7f5fa4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.925+0000 7f5fa4925800 20 started sync module instance, tier type = 2024-09-12T00:49:01.926 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.925+0000 7f5fa4925800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:01.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.933+0000 7f5fa4925800 20 add_watcher() i=0 2024-09-12T00:49:01.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.933+0000 7f5fa4925800 20 add_watcher() i=1 2024-09-12T00:49:01.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.933+0000 7f5fa4925800 20 add_watcher() i=2 2024-09-12T00:49:01.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.933+0000 7f5fa4925800 20 add_watcher() i=3 2024-09-12T00:49:01.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.933+0000 7f5fa4925800 20 add_watcher() i=4 2024-09-12T00:49:01.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.933+0000 7f5fa4925800 20 add_watcher() i=5 2024-09-12T00:49:01.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.933+0000 7f5fa4925800 20 add_watcher() i=6 2024-09-12T00:49:01.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.934+0000 7f5fa4925800 20 add_watcher() i=7 2024-09-12T00:49:01.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.934+0000 7f5fa4925800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:01.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.936+0000 7f5e56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:01.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.937+0000 7f5fa4925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:01.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.937+0000 7f5fa4925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:01.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.937+0000 7f5fa4925800 5 note: GC not initialized 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.937+0000 7f5e55fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.937+0000 7f5fa4925800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.937+0000 7f5fa4925800 20 Filter name: none 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.937+0000 7f5dc77fe640 20 reqs_thread_entry: start 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.937+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.937+0000 7f5fa4925800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.938+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.938+0000 7f5fa4925800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.938+0000 7f5fa4925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:01.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.938+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.938+0000 7f5fa4925800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:01.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.938+0000 7f5fa4925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:01.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.939+0000 7f5fa4925800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:49:01.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.939+0000 7f5fa4925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:01.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.940+0000 7f5e56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:01.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.942+0000 7f5fa4925800 20 remove_watcher() i=0 2024-09-12T00:49:01.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.942+0000 7f5fa4925800 2 removed watcher, disabling cache 2024-09-12T00:49:01.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.943+0000 7f5fa4925800 20 remove_watcher() i=1 2024-09-12T00:49:01.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.944+0000 7f5fa4925800 20 remove_watcher() i=2 2024-09-12T00:49:01.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.945+0000 7f5fa4925800 20 remove_watcher() i=3 2024-09-12T00:49:01.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.946+0000 7f5fa4925800 20 remove_watcher() i=4 2024-09-12T00:49:01.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.947+0000 7f5fa4925800 20 remove_watcher() i=5 2024-09-12T00:49:01.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.948+0000 7f5fa4925800 20 remove_watcher() i=6 2024-09-12T00:49:01.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:01.949+0000 7f5fa4925800 20 remove_watcher() i=7 2024-09-12T00:49:01.958 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:01.958 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:01.958 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-trim-reshard-log-entries id: ad4424e4-de7c-4376-b125-e717016a3484.4511.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:01.958 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:01.960 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.960 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:01.967 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:01.967 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.010 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:02.042 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:02.042 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:02.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.079+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.080+0000 7f34bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.080+0000 7f34bd240800 20 realm 2024-09-12T00:49:02.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.080+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.080+0000 7f34bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.080+0000 7f34bd240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:02.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.080+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.081+0000 7f34bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.081+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.081+0000 7f34bd240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:02.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.081+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.082+0000 7f34bd240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:02.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.082+0000 7f34bd240800 20 searching for the correct realm 2024-09-12T00:49:02.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.084+0000 7f34b3fff640 0 -- 172.21.15.83:0/1001714853 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f34a40ac930 msgr2=0x7f34a407c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:02.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.289+0000 7f34b3fff640 0 -- 172.21.15.83:0/1001714853 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x562b78ecf2c0 msgr2=0x562b78ed1720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:02.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.292+0000 7f34bd240800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:02.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.292+0000 7f34bd240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:02.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.292+0000 7f34bd240800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:02.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.292+0000 7f34bd240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:02.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.292+0000 7f34bd240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:02.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.292+0000 7f34bd240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:02.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.292+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:02.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:02.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 zone default found 2024-09-12T00:49:02.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 4 Realm: () 2024-09-12T00:49:02.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:02.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:02.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:02.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 zonegroup default 2024-09-12T00:49:02.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.293+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.294+0000 7f34bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.294+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.294+0000 7f34bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.294+0000 7f34bd240800 20 started sync module instance, tier type = 2024-09-12T00:49:02.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.294+0000 7f34bd240800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:02.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.302+0000 7f34bd240800 20 add_watcher() i=0 2024-09-12T00:49:02.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.302+0000 7f34bd240800 20 add_watcher() i=1 2024-09-12T00:49:02.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.302+0000 7f34bd240800 20 add_watcher() i=2 2024-09-12T00:49:02.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.302+0000 7f34bd240800 20 add_watcher() i=3 2024-09-12T00:49:02.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.302+0000 7f34bd240800 20 add_watcher() i=4 2024-09-12T00:49:02.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.302+0000 7f34bd240800 20 add_watcher() i=5 2024-09-12T00:49:02.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.302+0000 7f34bd240800 20 add_watcher() i=6 2024-09-12T00:49:02.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.303+0000 7f34bd240800 20 add_watcher() i=7 2024-09-12T00:49:02.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.303+0000 7f34bd240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:02.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.305+0000 7f3371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:02.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.305+0000 7f34bd240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:02.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.305+0000 7f34bd240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:02.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.305+0000 7f34bd240800 5 note: GC not initialized 2024-09-12T00:49:02.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.305+0000 7f3370fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:02.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.305+0000 7f34bd240800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:02.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 20 Filter name: none 2024-09-12T00:49:02.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f3369ffb640 20 reqs_thread_entry: start 2024-09-12T00:49:02.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:49:02.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 : miss 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.306+0000 7f34bd240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 2024-09-12T00:49:02.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.307+0000 7f34bd240800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:49:02.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.311+0000 7f34bd240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:02.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.311+0000 7f34bd240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:02.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.311+0000 7f34bd240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:02.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.311+0000 7f34bd240800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26, ofs0, ns] 2024-09-12T00:49:02.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.311+0000 7f339dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94744712426496 notifier 6801 bl.length()=1023 2024-09-12T00:49:02.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.311+0000 7f339dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:02.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.311+0000 7f339dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:02.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.311+0000 7f339dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:02.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.312+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): orig_sources= new_sources= 2024-09-12T00:49:02.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.312+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): potential sources added=[] removed=[] 2024-09-12T00:49:02.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.312+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): orig_dests= new_dests= 2024-09-12T00:49:02.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.312+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): potential dests added=[] removed=[] 2024-09-12T00:49:02.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.314+0000 7f34bd240800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.26.2.0 2024-09-12T00:49:02.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.314+0000 7f34bd240800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.26.2.0 2024-09-12T00:49:02.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.314+0000 7f34bd240800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.26.2.1 2024-09-12T00:49:02.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.314+0000 7f34bd240800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.26.2.1 2024-09-12T00:49:02.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.314+0000 7f34bd240800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.26.0 2024-09-12T00:49:02.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.316+0000 7f34bd240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:02.316 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.316+0000 7f34bd240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 2024-09-12T00:49:02.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.317+0000 7f34bd240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:02.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.317+0000 7f34bd240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:02.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.317+0000 7f34bd240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:02.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.317+0000 7f34bd240800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26, ofs0, ns] 2024-09-12T00:49:02.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.318+0000 7f339dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94744712426496 notifier 6801 bl.length()=1023 2024-09-12T00:49:02.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.318+0000 7f339dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:02.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.318+0000 7f339dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:02.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.318+0000 7f339dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:02.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.318+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): orig_sources= new_sources= 2024-09-12T00:49:02.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.318+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): potential sources added=[] removed=[] 2024-09-12T00:49:02.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.318+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): orig_dests= new_dests= 2024-09-12T00:49:02.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.318+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): potential dests added=[] removed=[] 2024-09-12T00:49:02.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.319+0000 7f34bd240800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.26.0 2024-09-12T00:49:02.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.319+0000 7f34bd240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:02.319 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.319+0000 7f34bd240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.320+0000 7f34bd240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.320+0000 7f34bd240800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.320+0000 7f34bd240800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.320+0000 7f34bd240800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26, ofs0, ns] 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.321+0000 7f339dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94744712426496 notifier 6801 bl.length()=991 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.321+0000 7f339dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 info.flags=0x17 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.321+0000 7f339dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.26 to cache LRU end 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.321+0000 7f339dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.321+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): orig_sources= new_sources= 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.321+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): potential sources added=[] removed=[] 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.321+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): orig_dests= new_dests= 2024-09-12T00:49:02.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.321+0000 7f34bd240800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.26]): potential dests added=[] removed=[] 2024-09-12T00:49:02.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.322+0000 7f34bd240800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:02.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.324+0000 7f3371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:02.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.326+0000 7f34bd240800 20 remove_watcher() i=0 2024-09-12T00:49:02.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.326+0000 7f34bd240800 2 removed watcher, disabling cache 2024-09-12T00:49:02.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.327+0000 7f34bd240800 20 remove_watcher() i=1 2024-09-12T00:49:02.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.328+0000 7f34bd240800 20 remove_watcher() i=2 2024-09-12T00:49:02.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.329+0000 7f34bd240800 20 remove_watcher() i=3 2024-09-12T00:49:02.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.330+0000 7f34bd240800 20 remove_watcher() i=4 2024-09-12T00:49:02.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.331+0000 7f34bd240800 20 remove_watcher() i=5 2024-09-12T00:49:02.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.332+0000 7f34bd240800 20 remove_watcher() i=6 2024-09-12T00:49:02.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.333+0000 7f34bd240800 20 remove_watcher() i=7 2024-09-12T00:49:02.345 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:49:02.373 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:02.373 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:02.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.410+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.412+0000 7f139db15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.412+0000 7f139db15800 20 realm 2024-09-12T00:49:02.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.412+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.413+0000 7f139db15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.413+0000 7f139db15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:02.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.413+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.413+0000 7f139db15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.413+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.414+0000 7f139db15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:02.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.414+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.414+0000 7f139db15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:02.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.414+0000 7f139db15800 20 searching for the correct realm 2024-09-12T00:49:02.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.417+0000 7f1392dfe640 0 -- 172.21.15.83:0/604894954 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f138405ea00 msgr2=0x7f1384060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:02.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.621+0000 7f139be00640 0 -- 172.21.15.83:0/604894954 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f624a044d0 msgr2=0x55f624a068c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:02.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.625+0000 7f139db15800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:02.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.625+0000 7f139db15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:02.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.625+0000 7f139db15800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:02.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.625+0000 7f139db15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:02.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.625+0000 7f139db15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:02.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.625+0000 7f139db15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:02.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.625+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.625+0000 7f139db15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.625+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:02.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:02.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 zone default found 2024-09-12T00:49:02.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 4 Realm: () 2024-09-12T00:49:02.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:02.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:02.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:02.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 zonegroup default 2024-09-12T00:49:02.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.626+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.627+0000 7f139db15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:02.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.627+0000 7f139db15800 20 started sync module instance, tier type = 2024-09-12T00:49:02.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.627+0000 7f139db15800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:02.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.635+0000 7f139db15800 20 add_watcher() i=0 2024-09-12T00:49:02.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.635+0000 7f139db15800 20 add_watcher() i=1 2024-09-12T00:49:02.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.635+0000 7f139db15800 20 add_watcher() i=2 2024-09-12T00:49:02.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.635+0000 7f139db15800 20 add_watcher() i=3 2024-09-12T00:49:02.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.635+0000 7f139db15800 20 add_watcher() i=4 2024-09-12T00:49:02.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.635+0000 7f139db15800 20 add_watcher() i=5 2024-09-12T00:49:02.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.635+0000 7f139db15800 20 add_watcher() i=6 2024-09-12T00:49:02.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.636+0000 7f139db15800 20 add_watcher() i=7 2024-09-12T00:49:02.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.636+0000 7f139db15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:02.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.638+0000 7f1251fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:02.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.638+0000 7f139db15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:02.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.638+0000 7f139db15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:02.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.638+0000 7f139db15800 5 note: GC not initialized 2024-09-12T00:49:02.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.638+0000 7f1250fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:02.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.638+0000 7f139db15800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:02.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.638+0000 7f139db15800 20 Filter name: none 2024-09-12T00:49:02.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.638+0000 7f11ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:02.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.638+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.639+0000 7f139db15800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:02.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.639+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.639+0000 7f139db15800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:02.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.639+0000 7f139db15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:02.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.639+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.640+0000 7f139db15800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:02.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.640+0000 7f139db15800 20 rados->read ofs=0 len=0 2024-09-12T00:49:02.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.640+0000 7f139db15800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:02.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.640+0000 7f139db15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:02.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.641+0000 7f1251fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:02.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.643+0000 7f139db15800 20 remove_watcher() i=0 2024-09-12T00:49:02.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.643+0000 7f139db15800 2 removed watcher, disabling cache 2024-09-12T00:49:02.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.644+0000 7f139db15800 20 remove_watcher() i=1 2024-09-12T00:49:02.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.645+0000 7f139db15800 20 remove_watcher() i=2 2024-09-12T00:49:02.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.646+0000 7f139db15800 20 remove_watcher() i=3 2024-09-12T00:49:02.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.647+0000 7f139db15800 20 remove_watcher() i=4 2024-09-12T00:49:02.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.648+0000 7f139db15800 20 remove_watcher() i=5 2024-09-12T00:49:02.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.649+0000 7f139db15800 20 remove_watcher() i=6 2024-09-12T00:49:02.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:02.650+0000 7f139db15800 20 remove_watcher() i=7 2024-09-12T00:49:02.659 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:02.660 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:02.660 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-trim-reshard-log-entries id: ad4424e4-de7c-4376-b125-e717016a3484.4511.26 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:49:02.660 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:02.662 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.662 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.665 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.665 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.778 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.778 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.791 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:49:02.791 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:02.791 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.792 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.801 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.801 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.844 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.844 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.853 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.853 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.860 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.860 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.868 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.868 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.875 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.876 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.883 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.883 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.890 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.890 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.897 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.897 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.905 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.905 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.913 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.913 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.921 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.921 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.928 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.928 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.935 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.935 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.943 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.943 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.950 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.950 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.958 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.958 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.968 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.968 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.973 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.973 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.980 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.980 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.988 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:02.988 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:02.996 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:49:03.025 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:03.025 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:03.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.061+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.062+0000 7ff5e2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.062+0000 7ff5e2e13800 20 realm 2024-09-12T00:49:03.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.062+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.063+0000 7ff5e2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.063+0000 7ff5e2e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:03.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.063+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.063+0000 7ff5e2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.063+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.063+0000 7ff5e2e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:03.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.063+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.064+0000 7ff5e2e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:03.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.064+0000 7ff5e2e13800 20 searching for the correct realm 2024-09-12T00:49:03.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.067+0000 7ff5d7fff640 0 -- 172.21.15.83:0/1794637684 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff5c8008410 msgr2=0x7ff5c8008850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:03.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.070+0000 7ff5ded23640 0 -- 172.21.15.83:0/1794637684 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55acfe189720 msgr2=0x55acfe18bbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.074+0000 7ff5e2e13800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.074+0000 7ff5e2e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.074+0000 7ff5e2e13800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.074+0000 7ff5e2e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.074+0000 7ff5e2e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.074+0000 7ff5e2e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.074+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.074+0000 7ff5e2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.074+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:03.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 20 zone default found 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 4 Realm: () 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 20 zonegroup default 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.075+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.076+0000 7ff5e2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.076+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.076+0000 7ff5e2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.076+0000 7ff5e2e13800 20 started sync module instance, tier type = 2024-09-12T00:49:03.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.076+0000 7ff5e2e13800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:03.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.084+0000 7ff5e2e13800 20 add_watcher() i=0 2024-09-12T00:49:03.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.084+0000 7ff5e2e13800 20 add_watcher() i=1 2024-09-12T00:49:03.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.084+0000 7ff5e2e13800 20 add_watcher() i=2 2024-09-12T00:49:03.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.084+0000 7ff5e2e13800 20 add_watcher() i=3 2024-09-12T00:49:03.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.084+0000 7ff5e2e13800 20 add_watcher() i=4 2024-09-12T00:49:03.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.084+0000 7ff5e2e13800 20 add_watcher() i=5 2024-09-12T00:49:03.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.084+0000 7ff5e2e13800 20 add_watcher() i=6 2024-09-12T00:49:03.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.085+0000 7ff5e2e13800 20 add_watcher() i=7 2024-09-12T00:49:03.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.085+0000 7ff5e2e13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:03.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.087+0000 7ff494fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.088+0000 7ff5e2e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.088+0000 7ff5e2e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.088+0000 7ff5e2e13800 5 note: GC not initialized 2024-09-12T00:49:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.088+0000 7ff40f7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.088+0000 7ff5e2e13800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.088+0000 7ff5e2e13800 20 Filter name: none 2024-09-12T00:49:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.088+0000 7ff40d7fa640 20 reqs_thread_entry: start 2024-09-12T00:49:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.088+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.089+0000 7ff5e2e13800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.089+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.089+0000 7ff5e2e13800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.089+0000 7ff5e2e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.089+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.089+0000 7ff5e2e13800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.089+0000 7ff5e2e13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.089+0000 7ff5e2e13800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.089+0000 7ff5e2e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.091+0000 7ff494fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:03.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.093+0000 7ff5e2e13800 20 remove_watcher() i=0 2024-09-12T00:49:03.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.093+0000 7ff5e2e13800 2 removed watcher, disabling cache 2024-09-12T00:49:03.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.094+0000 7ff5e2e13800 20 remove_watcher() i=1 2024-09-12T00:49:03.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.095+0000 7ff5e2e13800 20 remove_watcher() i=2 2024-09-12T00:49:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.095+0000 7ff5e2e13800 20 remove_watcher() i=3 2024-09-12T00:49:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.096+0000 7ff5e2e13800 20 remove_watcher() i=4 2024-09-12T00:49:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.097+0000 7ff5e2e13800 20 remove_watcher() i=5 2024-09-12T00:49:03.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.098+0000 7ff5e2e13800 20 remove_watcher() i=6 2024-09-12T00:49:03.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.099+0000 7ff5e2e13800 20 remove_watcher() i=7 2024-09-12T00:49:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:03.109 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:03.109 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-trim-reshard-log-entries id: ad4424e4-de7c-4376-b125-e717016a3484.4511.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:03.110 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:49:03.146 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:03.146 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:03.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.381+0000 7fa43c500640 0 --2- 172.21.15.83:0/2729799515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bcbdb66fd0 0x55bcbdb61180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:49:03.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.385+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.387+0000 7fa43ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.387+0000 7fa43ea0f800 20 realm 2024-09-12T00:49:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.387+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.387+0000 7fa43ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.387+0000 7fa43ea0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.387+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.387+0000 7fa43ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.387+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.388+0000 7fa43ea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:03.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.388+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.388+0000 7fa43ea0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:03.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.388+0000 7fa43ea0f800 20 searching for the correct realm 2024-09-12T00:49:03.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.391+0000 7fa43c500640 0 -- 172.21.15.83:0/3180307166 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7fa42c099020 msgr2=0x7fa42c0c7a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:03.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.394+0000 7fa43c500640 0 -- 172.21.15.83:0/3180307166 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fa43408e060 msgr2=0x7fa43408cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:03.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:03.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:03.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.600+0000 7fa43ea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 20 zone default found 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 4 Realm: () 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:03.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:03.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:03.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 20 zonegroup default 2024-09-12T00:49:03.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.601+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.602+0000 7fa43ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.602+0000 7fa43ea0f800 20 started sync module instance, tier type = 2024-09-12T00:49:03.604 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.602+0000 7fa43ea0f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:03.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.610+0000 7fa43ea0f800 20 add_watcher() i=0 2024-09-12T00:49:03.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.610+0000 7fa43ea0f800 20 add_watcher() i=1 2024-09-12T00:49:03.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.610+0000 7fa43ea0f800 20 add_watcher() i=2 2024-09-12T00:49:03.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.610+0000 7fa43ea0f800 20 add_watcher() i=3 2024-09-12T00:49:03.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.610+0000 7fa43ea0f800 20 add_watcher() i=4 2024-09-12T00:49:03.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.610+0000 7fa43ea0f800 20 add_watcher() i=5 2024-09-12T00:49:03.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.610+0000 7fa43ea0f800 20 add_watcher() i=6 2024-09-12T00:49:03.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.612+0000 7fa43ea0f800 20 add_watcher() i=7 2024-09-12T00:49:03.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.612+0000 7fa43ea0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:03.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.613+0000 7fa2f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.613+0000 7fa43ea0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.613+0000 7fa43ea0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 5 note: GC not initialized 2024-09-12T00:49:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa2f1fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 20 Filter name: none 2024-09-12T00:49:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa2637fe640 20 reqs_thread_entry: start 2024-09-12T00:49:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:49:03.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:03.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:03.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:03.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 : miss 2024-09-12T00:49:03.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:03.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 info.flags=0x17 2024-09-12T00:49:03.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 to cache LRU end 2024-09-12T00:49:03.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:03.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:03.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.615+0000 7fa43ea0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 2024-09-12T00:49:03.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.618+0000 7fa43ea0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 info.flags=0x17 2024-09-12T00:49:03.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.618+0000 7fa43ea0f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 to cache LRU end 2024-09-12T00:49:03.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.618+0000 7fa43ea0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:03.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.618+0000 7fa43ea0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27, ofs0, ns] 2024-09-12T00:49:03.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa3137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 94269125229600 notifier 6855 bl.length()=1023 2024-09-12T00:49:03.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa3137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 info.flags=0x17 2024-09-12T00:49:03.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa3137fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 to cache LRU end 2024-09-12T00:49:03.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa3137fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:03.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa43ea0f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.27]): orig_sources= new_sources= 2024-09-12T00:49:03.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa43ea0f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.27]): potential sources added=[] removed=[] 2024-09-12T00:49:03.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa43ea0f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.27]): orig_dests= new_dests= 2024-09-12T00:49:03.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa43ea0f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.27]): potential dests added=[] removed=[] 2024-09-12T00:49:03.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa43ea0f800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:49:03.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.619+0000 7fa43ea0f800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:49:03.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.620+0000 7fa43ea0f800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.27.1.0 2024-09-12T00:49:03.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.620+0000 7fa43ea0f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.27.1.0 2024-09-12T00:49:03.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.620+0000 7fa43ea0f800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.27.1.1 2024-09-12T00:49:03.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.620+0000 7fa43ea0f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.27.1.1 2024-09-12T00:49:03.621 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.620+0000 7fa43ea0f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.27.0 2024-09-12T00:49:03.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.622+0000 7fa43ea0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:03.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.622+0000 7fa43ea0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 2024-09-12T00:49:03.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa43ea0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 info.flags=0x17 2024-09-12T00:49:03.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa43ea0f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 to cache LRU end 2024-09-12T00:49:03.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa43ea0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:03.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa43ea0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27, ofs0, ns] 2024-09-12T00:49:03.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa3137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94269125229600 notifier 6855 bl.length()=991 2024-09-12T00:49:03.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa3137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 info.flags=0x17 2024-09-12T00:49:03.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa3137fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.27 to cache LRU end 2024-09-12T00:49:03.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa3137fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:03.624 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa43ea0f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.27]): orig_sources= new_sources= 2024-09-12T00:49:03.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa43ea0f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.27]): potential sources added=[] removed=[] 2024-09-12T00:49:03.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa43ea0f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.27]): orig_dests= new_dests= 2024-09-12T00:49:03.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.624+0000 7fa43ea0f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.27]): potential dests added=[] removed=[] 2024-09-12T00:49:03.625 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.625+0000 7fa43ea0f800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:03.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.627+0000 7fa2f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:03.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.630+0000 7fa43ea0f800 20 remove_watcher() i=0 2024-09-12T00:49:03.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.630+0000 7fa43ea0f800 2 removed watcher, disabling cache 2024-09-12T00:49:03.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.631+0000 7fa43ea0f800 20 remove_watcher() i=1 2024-09-12T00:49:03.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.632+0000 7fa43ea0f800 20 remove_watcher() i=2 2024-09-12T00:49:03.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.633+0000 7fa43ea0f800 20 remove_watcher() i=3 2024-09-12T00:49:03.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.634+0000 7fa43ea0f800 20 remove_watcher() i=4 2024-09-12T00:49:03.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.635+0000 7fa43ea0f800 20 remove_watcher() i=5 2024-09-12T00:49:03.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.636+0000 7fa43ea0f800 20 remove_watcher() i=6 2024-09-12T00:49:03.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.637+0000 7fa43ea0f800 20 remove_watcher() i=7 2024-09-12T00:49:03.648 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:49:03.677 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:03.677 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:03.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.713+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.715+0000 7fa639240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.715+0000 7fa639240800 20 realm 2024-09-12T00:49:03.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.715+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.715+0000 7fa639240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.715+0000 7fa639240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:03.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.715+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.716+0000 7fa639240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.716+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.716+0000 7fa639240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:03.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.716+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.717+0000 7fa639240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:03.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.717+0000 7fa639240800 20 searching for the correct realm 2024-09-12T00:49:03.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.720+0000 7fa62e529640 0 -- 172.21.15.83:0/2920041537 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fa6200093c0 msgr2=0x7fa6200a58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:03.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.924+0000 7fa63752b640 0 -- 172.21.15.83:0/2920041537 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x560b31293d00 msgr2=0x560b31296110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:03.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:03.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:03.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:03.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:03.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:03.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:03.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:03.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.929+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:03.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 20 zone default found 2024-09-12T00:49:03.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 4 Realm: () 2024-09-12T00:49:03.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:03.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:03.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:03.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 20 zonegroup default 2024-09-12T00:49:03.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.930+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.931+0000 7fa639240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:03.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.931+0000 7fa639240800 20 started sync module instance, tier type = 2024-09-12T00:49:03.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.931+0000 7fa639240800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:03.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.939+0000 7fa639240800 20 add_watcher() i=0 2024-09-12T00:49:03.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.939+0000 7fa639240800 20 add_watcher() i=1 2024-09-12T00:49:03.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.939+0000 7fa639240800 20 add_watcher() i=2 2024-09-12T00:49:03.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.939+0000 7fa639240800 20 add_watcher() i=3 2024-09-12T00:49:03.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.939+0000 7fa639240800 20 add_watcher() i=4 2024-09-12T00:49:03.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.939+0000 7fa639240800 20 add_watcher() i=5 2024-09-12T00:49:03.938 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.939+0000 7fa639240800 20 add_watcher() i=6 2024-09-12T00:49:03.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.940+0000 7fa639240800 20 add_watcher() i=7 2024-09-12T00:49:03.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.940+0000 7fa639240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:03.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.942+0000 7fa4ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.942+0000 7fa639240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.942+0000 7fa639240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.942+0000 7fa639240800 5 note: GC not initialized 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.943+0000 7fa467fff640 20 reqs_thread_entry: start 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.943+0000 7fa639240800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.943+0000 7fa639240800 20 Filter name: none 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.943+0000 7fa465ffb640 20 reqs_thread_entry: start 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.943+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.943+0000 7fa639240800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:03.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.943+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.944+0000 7fa639240800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:03.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.944+0000 7fa639240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:03.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.944+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.944+0000 7fa639240800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:03.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.944+0000 7fa639240800 20 rados->read ofs=0 len=0 2024-09-12T00:49:03.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.944+0000 7fa639240800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:03.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.944+0000 7fa639240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:03.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.946+0000 7fa4ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:03.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.948+0000 7fa639240800 20 remove_watcher() i=0 2024-09-12T00:49:03.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.948+0000 7fa639240800 2 removed watcher, disabling cache 2024-09-12T00:49:03.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.950+0000 7fa639240800 20 remove_watcher() i=1 2024-09-12T00:49:03.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.951+0000 7fa639240800 20 remove_watcher() i=2 2024-09-12T00:49:03.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.951+0000 7fa639240800 20 remove_watcher() i=3 2024-09-12T00:49:03.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.953+0000 7fa639240800 20 remove_watcher() i=4 2024-09-12T00:49:03.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.954+0000 7fa639240800 20 remove_watcher() i=5 2024-09-12T00:49:03.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.954+0000 7fa639240800 20 remove_watcher() i=6 2024-09-12T00:49:03.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:03.955+0000 7fa639240800 20 remove_watcher() i=7 2024-09-12T00:49:03.964 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:03.964 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:03.964 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-trim-reshard-log-entries id: ad4424e4-de7c-4376-b125-e717016a3484.4511.27 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:49:03.964 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:03.966 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:03.966 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:03.969 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:03.969 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.012 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.012 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.026 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:49:04.026 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.027 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.027 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.037 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.037 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.080 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.080 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.089 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.089 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.097 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.098 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.106 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.106 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.113 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.114 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.121 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.121 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.129 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.129 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.137 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.137 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.145 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.145 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.152 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.152 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.160 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.160 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.167 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.167 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.175 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.175 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.183 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.183 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.192 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.192 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.200 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.200 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.208 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.208 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.217 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.217 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.225 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.225 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.233 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:04.233 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:04.241 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:49:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:04.270 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:04.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.308+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.309+0000 7f8618c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.309+0000 7f8618c16800 20 realm 2024-09-12T00:49:04.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.309+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.310+0000 7f8618c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.310+0000 7f8618c16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:04.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.310+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.310+0000 7f8618c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.310+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.311+0000 7f8618c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:04.310 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.311+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.311+0000 7f8618c16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:04.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.311+0000 7f8618c16800 20 searching for the correct realm 2024-09-12T00:49:04.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.314+0000 7f8613be6640 0 -- 172.21.15.83:0/3925969485 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f8608050610 msgr2=0x7f86080e7af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:04.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.519+0000 7f8614be8640 0 -- 172.21.15.83:0/3925969485 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5626abcc3e80 msgr2=0x5626abcc6340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:04.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.523+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 20 zone default found 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 4 Realm: () 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 20 zonegroup default 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.524+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.525+0000 7f8618c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.525+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.524 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.525+0000 7f8618c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.525+0000 7f8618c16800 20 started sync module instance, tier type = 2024-09-12T00:49:04.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.525+0000 7f8618c16800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:04.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.535+0000 7f8618c16800 20 add_watcher() i=0 2024-09-12T00:49:04.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.535+0000 7f8618c16800 20 add_watcher() i=1 2024-09-12T00:49:04.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.535+0000 7f8618c16800 20 add_watcher() i=2 2024-09-12T00:49:04.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.535+0000 7f8618c16800 20 add_watcher() i=3 2024-09-12T00:49:04.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.535+0000 7f8618c16800 20 add_watcher() i=4 2024-09-12T00:49:04.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.535+0000 7f8618c16800 20 add_watcher() i=5 2024-09-12T00:49:04.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.535+0000 7f8618c16800 20 add_watcher() i=6 2024-09-12T00:49:04.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.536+0000 7f8618c16800 20 add_watcher() i=7 2024-09-12T00:49:04.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.536+0000 7f8618c16800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.538+0000 7f84cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.538+0000 7f8618c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.538+0000 7f8618c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.538+0000 7f8618c16800 5 note: GC not initialized 2024-09-12T00:49:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.538+0000 7f84c9fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.538+0000 7f8618c16800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.538+0000 7f8618c16800 20 Filter name: none 2024-09-12T00:49:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.538+0000 7f843b7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:04.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.538+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.539+0000 7f8618c16800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:04.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.539+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.540+0000 7f8618c16800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.540+0000 7f8618c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.540+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.540+0000 7f8618c16800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.540+0000 7f8618c16800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.540+0000 7f8618c16800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:04.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.540+0000 7f8618c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:04.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.541+0000 7f84cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:04.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.543+0000 7f8618c16800 20 remove_watcher() i=0 2024-09-12T00:49:04.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.543+0000 7f8618c16800 2 removed watcher, disabling cache 2024-09-12T00:49:04.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.544+0000 7f8618c16800 20 remove_watcher() i=1 2024-09-12T00:49:04.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.546+0000 7f8618c16800 20 remove_watcher() i=2 2024-09-12T00:49:04.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.547+0000 7f8618c16800 20 remove_watcher() i=3 2024-09-12T00:49:04.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.548+0000 7f8618c16800 20 remove_watcher() i=4 2024-09-12T00:49:04.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.549+0000 7f8618c16800 20 remove_watcher() i=5 2024-09-12T00:49:04.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.550+0000 7f8618c16800 20 remove_watcher() i=6 2024-09-12T00:49:04.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.551+0000 7f8618c16800 20 remove_watcher() i=7 2024-09-12T00:49:04.560 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.560 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:04.560 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-trim-reshard-log-entries id: ad4424e4-de7c-4376-b125-e717016a3484.4511.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:04.560 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.561 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:49:04.595 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:04.595 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:04.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.633+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.635+0000 7fcb03525800 20 realm 2024-09-12T00:49:04.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.635+0000 7fcb03525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:04.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:04.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.637+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:04.636 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.637+0000 7fcb03525800 20 searching for the correct realm 2024-09-12T00:49:04.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.640+0000 7fcafe9ad640 0 -- 172.21.15.83:0/4131664742 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fcae806a690 msgr2=0x7fcae8065170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:04.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.846+0000 7fcaff9af640 0 -- 172.21.15.83:0/4131664742 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5565fd40b3d0 msgr2=0x5565fd40d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:04.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:04.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:04.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:04.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:04.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:04.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:04.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.849+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:04.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:04.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 zone default found 2024-09-12T00:49:04.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 4 Realm: () 2024-09-12T00:49:04.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:04.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:04.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:04.850 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 zonegroup default 2024-09-12T00:49:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.851+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.851+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.851+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.851+0000 7fcb03525800 20 started sync module instance, tier type = 2024-09-12T00:49:04.851 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.851+0000 7fcb03525800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:04.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=0 2024-09-12T00:49:04.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=1 2024-09-12T00:49:04.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=2 2024-09-12T00:49:04.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=3 2024-09-12T00:49:04.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=4 2024-09-12T00:49:04.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=5 2024-09-12T00:49:04.860 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=6 2024-09-12T00:49:04.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.862+0000 7fcb03525800 20 add_watcher() i=7 2024-09-12T00:49:04.861 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.862+0000 7fcb03525800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:04.863 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.864+0000 7fc9b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:04.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.865+0000 7fcb03525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:04.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.865+0000 7fcb03525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:04.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.865+0000 7fcb03525800 5 note: GC not initialized 2024-09-12T00:49:04.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.865+0000 7fc9b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:04.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.865+0000 7fcb03525800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:04.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.865+0000 7fcb03525800 20 Filter name: none 2024-09-12T00:49:04.864 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.865+0000 7fc92e7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:04.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.865+0000 7fcb03525800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:49:04.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.865+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:04.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:04.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:04.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 : miss 2024-09-12T00:49:04.865 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:04.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:04.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:04.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:04.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:04.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.866+0000 7fcb03525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fcb03525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fcb03525800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fcb03525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fcb03525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28, ofs0, ns] 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464368 cookie 93896528983808 notifier 6909 bl.length()=1023 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_sources= new_sources= 2024-09-12T00:49:04.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential sources added=[] removed=[] 2024-09-12T00:49:04.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_dests= new_dests= 2024-09-12T00:49:04.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential dests added=[] removed=[] 2024-09-12T00:49:04.870 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb03525800 time 2024-09-12T00:49:04.871610+0000 2024-09-12T00:49:04.870 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:04.884 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:04.884 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb04b8c71a] 2024-09-12T00:49:04.884 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb04b8c8d8] 2024-09-12T00:49:04.885 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565fb8fb641] 2024-09-12T00:49:04.885 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd884de) [0x5565fbe0e4de] 2024-09-12T00:49:04.885 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565fb90b31d] 2024-09-12T00:49:04.885 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:49:04.885 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcb03829590] 2024-09-12T00:49:04.885 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:49:04.885 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:49:04.885 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.871+0000 7fcb03525800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb03525800 time 2024-09-12T00:49:04.871610+0000 2024-09-12T00:49:04.885 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb04b8c71a] 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb04b8c8d8] 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565fb8fb641] 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd884de) [0x5565fbe0e4de] 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565fb90b31d] 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcb03829590] 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.886 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fcb03525800 thread_name:radosgw-admin 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb0383e6f0] 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb0388b99c] 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb04b8c774] 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb04b8c8d8] 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565fb8fb641] 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd884de) [0x5565fbe0e4de] 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565fb90b31d] 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:49:04.887 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcb03829590] 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.872+0000 7fcb03525800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fcb03525800 thread_name:radosgw-admin 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb0383e6f0] 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb0388b99c] 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:49:04.888 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb04b8c774] 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb04b8c8d8] 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565fb8fb641] 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd884de) [0x5565fbe0e4de] 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565fb90b31d] 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcb03829590] 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:49:04.889 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:49:04.617+0000 7fc9ed60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:49:04.617+0000 7fc9ed60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:49:04.617+0000 7fc9ed60a640 10 monclient: dump: 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.890 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 monclient: authenticate success, global_id 6897 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:49:04.617+0000 7fcb03525800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:49:04.617+0000 7fcb03525800 4 set_mon_vals no callback set 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:49:04.617+0000 7fcb03525800 10 monclient: shutdown 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 asok(0x5565fd100630) unregister_commands rotate-key 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:49:04.617+0000 7fcb03525800 10 monclient: build_initial_monmap 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:49:04.617+0000 7fcb03525800 1 build_initial for_mkfs: 0 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:49:04.617+0000 7fcb03525800 10 monclient: monmap: 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:04.891 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding auth protocol: cephx 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding auth protocol: cephx 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding auth protocol: cephx 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.892 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:49:04.618+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:49:04.618+0000 7fcb03525800 1 librados: starting msgr at 2024-09-12T00:49:04.893 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:49:04.618+0000 7fcb03525800 1 librados: starting objecter 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 asok(0x5565fd100630) register_command objecter_requests hook 0x5565fd323ba0 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:49:04.618+0000 7fcb03525800 1 librados: setting wanted keys 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:49:04.618+0000 7fcb03525800 1 librados: calling monclient init 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient: init 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding auth protocol: cephx 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding auth protocol: cephx 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding auth protocol: cephx 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.894 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:49:04.618+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:49:04.618+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 asok(0x5565fd100630) register_command rotate-key hook 0x5565fd320fa8 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-b con 0x5565fd1d58a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-c con 0x5565fd1d78c0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:04.895 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-a con 0x5565fd26a330 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): authenticate will time out at 1897.887913s 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request con 0x5565fd1d78c0 auth_method 0 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): get_auth_request con 0x5565fd26a330 auth_method 0 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.896 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request con 0x5565fd1d58a0 auth_method 0 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_done global_id 6509 payload 824 2024-09-12T00:49:04.897 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient: _finish_hunting 0 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 1 monclient: found mon.noname-c 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: dump: 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.898 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: _finish_auth 0 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: _check_auth_tickets 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: dump: 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.899 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:49:04.619+0000 7fcb03525800 5 monclient: authenticate success, global_id 6509 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:49:04.619+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:49:04.619+0000 7fcb03525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:49:04.619+0000 7fc9ed60a640 4 set_mon_vals no callback set 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:49:04.619+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:49:04.619+0000 7fcb03525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.900 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:49:04.619+0000 7fcb03525800 1 librados: init done 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:49:04.621+0000 7fc9ebe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:49:04.621+0000 7fc9ebe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:49:04.621+0000 7fc9ebe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:49:04.621+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x7fc9e4076470 auth_method 0 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:49:04.622+0000 7fcaff9af640 10 monclient: get_auth_request con 0x5565fd362d20 auth_method 0 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:49:04.622+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x5565fd36c250 auth_method 0 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:49:04.624+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x5565fd371790 auth_method 0 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:49:04.624+0000 7fcb03525800 10 monclient: build_initial_monmap 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:49:04.624+0000 7fcb03525800 1 build_initial for_mkfs: 0 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:49:04.624+0000 7fcb03525800 10 monclient: monmap: 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:04.901 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding auth protocol: cephx 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding auth protocol: cephx 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding auth protocol: cephx 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.902 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:49:04.624+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.903 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 asok(0x5565fd100630) register_command objecter_requests cmddesc objecter_requests hook 0x5565fd378fe0 EEXIST 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient: init 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding auth protocol: cephx 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding auth protocol: cephx 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding auth protocol: cephx 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.904 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:49:04.625+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:49:04.625+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 asok(0x5565fd100630) register_command rotate-key cmddesc rotate-key hook 0x5565fd3746d0 EEXIST 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-b con 0x5565fd39ccd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-c con 0x5565fd39efa0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:04.905 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-a con 0x5565fd39b4a0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): authenticate will time out at 1897.894735s 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request con 0x5565fd39efa0 auth_method 0 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): get_auth_request con 0x5565fd39b4a0 auth_method 0 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.906 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:49:04.625+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request con 0x5565fd39ccd0 auth_method 0 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:49:04.625+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:49:04.625+0000 7fcaff1ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:49:04.625+0000 7fcaff1ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:49:04.626+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:49:04.626+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:49:04.626+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:49:04.626+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_done global_id 6512 payload 824 2024-09-12T00:49:04.907 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:49:04.626+0000 7fcafe9ad640 10 monclient: _finish_hunting 0 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:49:04.626+0000 7fcafe9ad640 1 monclient: found mon.noname-c 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:49:04.626+0000 7fcafe9ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: dump: 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.908 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: _finish_auth 0 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: _check_auth_tickets 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: dump: 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.909 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:49:04.626+0000 7fcb03525800 5 monclient: authenticate success, global_id 6512 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:49:04.626+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:49:04.626+0000 7fcb03525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:49:04.626+0000 7fcb001b0640 4 set_mon_vals no callback set 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:49:04.626+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.910 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:49:04.626+0000 7fcb03525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:49:04.627+0000 7fc9e9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:49:04.627+0000 7fc9e9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:49:04.627+0000 7fc9e9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:49:04.628+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x7fc9d8076380 auth_method 0 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:49:04.628+0000 7fcb03525800 10 monclient: get_monmap_and_config 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:49:04.628+0000 7fcb03525800 10 monclient: build_initial_monmap 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:49:04.628+0000 7fcb03525800 1 build_initial for_mkfs: 0 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:49:04.628+0000 7fcb03525800 10 monclient: monmap: 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:04.911 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding auth protocol: cephx 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding auth protocol: cephx 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding auth protocol: cephx 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.912 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:49:04.628+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:49:04.628+0000 7fcb03525800 10 monclient: init 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding auth protocol: cephx 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding auth protocol: cephx 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding auth protocol: cephx 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.913 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:49:04.628+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:49:04.629+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:49:04.629+0000 7fcb03525800 5 asok(0x5565fd100630) register_command rotate-key cmddesc rotate-key hook 0x7ffed11ac2c8 EEXIST 2024-09-12T00:49:04.914 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-c con 0x5565fd3f1030 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-a con 0x5565fd3c1e50 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-b con 0x5565fd3ec460 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): authenticate will time out at 1897.898267s 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request con 0x5565fd3c1e50 auth_method 0 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.915 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request con 0x5565fd3f1030 auth_method 0 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_done global_id 6906 payload 274 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient: _finish_hunting 0 2024-09-12T00:49:04.916 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 1 monclient: found mon.noname-a 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: dump: 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.917 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: dump: 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.918 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:49:04.629+0000 7fcb03525800 5 monclient: authenticate success, global_id 6906 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:49:04.629+0000 7fcb03525800 4 set_mon_vals no callback set 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:49:04.630+0000 7fcb03525800 10 monclient: shutdown 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:49:04.630+0000 7fcb03525800 10 monclient: build_initial_monmap 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 build_initial for_mkfs: 0 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:49:04.630+0000 7fcb03525800 10 monclient: monmap: 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:04.919 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding auth protocol: cephx 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding auth protocol: cephx 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding auth protocol: cephx 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.920 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:49:04.630+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 librados: starting msgr at 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 librados: starting objecter 2024-09-12T00:49:04.921 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 asok(0x5565fd100630) register_command objecter_requests cmddesc objecter_requests hook 0x5565fd39eed0 EEXIST 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 librados: setting wanted keys 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 librados: calling monclient init 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:49:04.630+0000 7fcb03525800 10 monclient: init 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding auth protocol: cephx 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding auth protocol: cephx 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding auth protocol: cephx 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.922 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:49:04.631+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:49:04.631+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:49:04.631+0000 7fcb03525800 5 asok(0x5565fd100630) register_command rotate-key cmddesc rotate-key hook 0x5565fd3b4bc8 EEXIST 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-a con 0x5565fd3c1e50 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-c con 0x5565fd3ec460 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:04.923 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-b con 0x5565fd3f1030 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): authenticate will time out at 1897.900444s 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request con 0x5565fd3c1e50 auth_method 0 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request con 0x5565fd3ec460 auth_method 0 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.924 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:49:04.631+0000 7fcaff9af640 10 monclient(hunting): get_auth_request con 0x5565fd3f1030 auth_method 0 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:49:04.631+0000 7fcaff9af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:49:04.631+0000 7fcaff9af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:49:04.631+0000 7fcaff9af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_done global_id 6909 payload 824 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient: _finish_hunting 0 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 1 monclient: found mon.noname-a 2024-09-12T00:49:04.925 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: dump: 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.926 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: _finish_auth 0 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: dump: 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.927 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:49:04.632+0000 7fcb03525800 5 monclient: authenticate success, global_id 6909 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:49:04.632+0000 7fc9e2ffd640 4 set_mon_vals no callback set 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:49:04.632+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:49:04.632+0000 7fcb03525800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:49:04.632+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:49:04.632+0000 7fcb03525800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:49:04.632+0000 7fcb03525800 1 librados: init done 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:49:04.632+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cr dump hook 0x5565fd3e67f8 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:49:04.633+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:49:04.634+0000 7fc9e17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:04.928 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:49:04.634+0000 7fc9e17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:49:04.634+0000 7fc9e17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:49:04.634+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x7fc9c8076470 auth_method 0 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:49:04.635+0000 7fcaff9af640 10 monclient: get_auth_request con 0x5565fd40b3d0 auth_method 0 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 realm 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:49:04.635+0000 7fcb03525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:49:04.636+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x5565fd40f520 auth_method 0 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:04.929 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:49:04.637+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:49:04.637+0000 7fcb03525800 20 searching for the correct realm 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:49:04.637+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x5565fd4147b0 auth_method 0 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:49:04.638+0000 7fcaff9af640 10 monclient: get_auth_request con 0x7fcae8095060 auth_method 0 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:49:04.639+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x7fcaf0072040 auth_method 0 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:49:04.640+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x7fcae806a690 auth_method 0 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:49:04.640+0000 7fcafe9ad640 0 -- 172.21.15.83:0/4131664742 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fcae806a690 msgr2=0x7fcae8065170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:49:04.842+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x7fcae806a690 auth_method 0 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:49:04.844+0000 7fcaff9af640 10 monclient: get_auth_request con 0x7fcaf0036040 auth_method 0 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:49:04.845+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x7fcaf8060980 auth_method 0 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:49:04.846+0000 7fcaff9af640 0 -- 172.21.15.83:0/4131664742 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5565fd40b3d0 msgr2=0x5565fd40d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:49:04.846+0000 7fc9e17fa640 1 client.6909.objecter ms_handle_reset 0x5565fd40b3d0 session 0x5565fd40ad50 osd.6 2024-09-12T00:49:04.930 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:49:04.846+0000 7fc9e17fa640 10 monclient: _renew_subs 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:49:04.846+0000 7fc9e17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:49:04.846+0000 7fcaff9af640 10 monclient: get_auth_request con 0x7fc9c80867f0 auth_method 0 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:04.931 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 zone default found 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:49:04.850+0000 7fcb03525800 4 Realm: () 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:49:04.850+0000 7fcb03525800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:49:04.850+0000 7fcb03525800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:49:04.850+0000 7fcb03525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 zonegroup default 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.932 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 started sync module instance, tier type = 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=0 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=1 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=2 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=3 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=4 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=5 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=6 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:49:04.862+0000 7fcb03525800 20 add_watcher() i=7 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:49:04.862+0000 7fcb03525800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:04.933 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding auth protocol: cephx 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding auth protocol: cephx 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding auth protocol: cephx 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:49:04.864+0000 7fc9b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:04.934 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:49:04.865+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cache list hook 0x5565fd3e6710 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cache inspect hook 0x5565fd3e6710 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cache erase hook 0x5565fd3e6710 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cache zap hook 0x5565fd3e6710 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 note: GC not initialized 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:49:04.865+0000 7fc9b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command sync trace show hook 0x7fcaf806e040 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command sync trace history hook 0x7fcaf806e040 2024-09-12T00:49:04.935 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command sync trace active hook 0x7fcaf806e040 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command sync trace active_short hook 0x7fcaf806e040 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 Filter name: none 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:49:04.865+0000 7fc92e7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:49:04.865+0000 7fcb03525800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:49:04.866+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 : miss 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:49:04.866+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:49:04.866+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:04.936 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:49:04.870+0000 7fcb03525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:49:04.870+0000 7fcb03525800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:49:04.870+0000 7fcb03525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:49:04.870+0000 7fcb03525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28, ofs0, ns] 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464368 cookie 93896528983808 notifier 6909 bl.length()=1023 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_sources= new_sources= 2024-09-12T00:49:04.937 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential sources added=[] removed=[] 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_dests= new_dests= 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential dests added=[] removed=[] 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:49:04.871+0000 7fcb03525800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb03525800 time 2024-09-12T00:49:04.871610+0000 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb04b8c71a] 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb04b8c8d8] 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565fb8fb641] 2024-09-12T00:49:04.938 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd884de) [0x5565fbe0e4de] 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565fb90b31d] 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcb03829590] 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:49:04.872+0000 7fcb03525800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fcb03525800 thread_name:radosgw-admin 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb0383e6f0] 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb0388b99c] 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:49:04.939 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb04b8c774] 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb04b8c8d8] 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565fb8fb641] 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd884de) [0x5565fbe0e4de] 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565fb90b31d] 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcb03829590] 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:49:04.940 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:49:04.941 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:49:04.942 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:49:04.943 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:49:04.944 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:49:04.945 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:49:04.946 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:49:04.947 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc92e7fc640 / http_manager 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9b4fe1640 / http_manager 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9b5fe3640 / rgw_dt_lg_renew 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9e17fa640 / ms_dispatch 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9e2ffd640 / io_context_pool 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9e9602640 / ms_dispatch 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9ebe07640 / ms_dispatch 2024-09-12T00:49:04.948 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9ed60a640 / io_context_pool 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcafe9ad640 / msgr-worker-2 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcaff1ae640 / msgr-worker-1 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcaff9af640 / msgr-worker-0 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb001b0640 / io_context_pool 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb03525800 / radosgw-admin 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.108383.log 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:49:04.617+0000 7fc9ed60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.949 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:49:04.617+0000 7fc9ed60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:49:04.617+0000 7fc9ed60a640 10 monclient: dump: 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 monclient: authenticate success, global_id 6897 2024-09-12T00:49:04.950 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:49:04.617+0000 7fcb03525800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:49:04.617+0000 7fcb03525800 4 set_mon_vals no callback set 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:49:04.617+0000 7fcb03525800 10 monclient: shutdown 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 asok(0x5565fd100630) unregister_commands rotate-key 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:49:04.617+0000 7fcb03525800 10 monclient: build_initial_monmap 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:49:04.617+0000 7fcb03525800 1 build_initial for_mkfs: 0 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:49:04.617+0000 7fcb03525800 10 monclient: monmap: 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:04.951 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding auth protocol: cephx 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding auth protocol: cephx 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding auth protocol: cephx 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.952 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: crc 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:49:04.617+0000 7fcb03525800 5 AuthRegistry(0x5565fd326ad0) adding con mode: secure 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:49:04.618+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:49:04.618+0000 7fcb03525800 1 librados: starting msgr at 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:49:04.618+0000 7fcb03525800 1 librados: starting objecter 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 asok(0x5565fd100630) register_command objecter_requests hook 0x5565fd323ba0 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:49:04.618+0000 7fcb03525800 1 librados: setting wanted keys 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:49:04.618+0000 7fcb03525800 1 librados: calling monclient init 2024-09-12T00:49:04.953 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient: init 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding auth protocol: cephx 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding auth protocol: cephx 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding auth protocol: cephx 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.954 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: crc 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 AuthRegistry(0x5565fd320e60) adding con mode: secure 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:49:04.618+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:49:04.618+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:49:04.618+0000 7fcb03525800 5 asok(0x5565fd100630) register_command rotate-key hook 0x5565fd320fa8 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-b con 0x5565fd1d58a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-c con 0x5565fd1d78c0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-a con 0x5565fd26a330 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.955 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:49:04.618+0000 7fcb03525800 10 monclient(hunting): authenticate will time out at 1897.887913s 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request con 0x5565fd1d78c0 auth_method 0 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): get_auth_request con 0x5565fd26a330 auth_method 0 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.956 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:49:04.619+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request con 0x5565fd1d58a0 auth_method 0 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:49:04.619+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_done global_id 6509 payload 824 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient: _finish_hunting 0 2024-09-12T00:49:04.957 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 1 monclient: found mon.noname-c 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:49:04.619+0000 7fcafe9ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: dump: 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.958 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: _finish_auth 0 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: _check_auth_tickets 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:49:04.619+0000 7fc9ebe07640 10 monclient: dump: 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.959 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:49:04.619+0000 7fcb03525800 5 monclient: authenticate success, global_id 6509 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:49:04.619+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:49:04.619+0000 7fcb03525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:49:04.619+0000 7fc9ed60a640 4 set_mon_vals no callback set 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:49:04.619+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:49:04.619+0000 7fcb03525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:49:04.619+0000 7fcb03525800 1 librados: init done 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:49:04.621+0000 7fc9ebe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:49:04.621+0000 7fc9ebe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:49:04.621+0000 7fc9ebe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:49:04.621+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x7fc9e4076470 auth_method 0 2024-09-12T00:49:04.960 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:49:04.622+0000 7fcaff9af640 10 monclient: get_auth_request con 0x5565fd362d20 auth_method 0 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:49:04.622+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x5565fd36c250 auth_method 0 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:49:04.624+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x5565fd371790 auth_method 0 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:49:04.624+0000 7fcb03525800 10 monclient: build_initial_monmap 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:49:04.624+0000 7fcb03525800 1 build_initial for_mkfs: 0 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:49:04.624+0000 7fcb03525800 10 monclient: monmap: 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.961 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding auth protocol: cephx 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding auth protocol: cephx 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding auth protocol: cephx 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.962 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: crc 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:49:04.624+0000 7fcb03525800 5 AuthRegistry(0x5565fd3755d0) adding con mode: secure 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:49:04.624+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 asok(0x5565fd100630) register_command objecter_requests cmddesc objecter_requests hook 0x5565fd378fe0 EEXIST 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient: init 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding auth protocol: cephx 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding auth protocol: cephx 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding auth protocol: cephx 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.963 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: crc 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 AuthRegistry(0x5565fd374588) adding con mode: secure 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:49:04.625+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:49:04.625+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:49:04.625+0000 7fcb03525800 5 asok(0x5565fd100630) register_command rotate-key cmddesc rotate-key hook 0x5565fd3746d0 EEXIST 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-b con 0x5565fd39ccd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-c con 0x5565fd39efa0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:04.964 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-a con 0x5565fd39b4a0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:49:04.625+0000 7fcb03525800 10 monclient(hunting): authenticate will time out at 1897.894735s 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request con 0x5565fd39efa0 auth_method 0 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): get_auth_request con 0x5565fd39b4a0 auth_method 0 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.965 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:49:04.625+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:49:04.625+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request con 0x5565fd39ccd0 auth_method 0 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:49:04.625+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:49:04.625+0000 7fcaff1ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:49:04.625+0000 7fcaff1ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:49:04.625+0000 7fcaff9af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:49:04.626+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:49:04.626+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:49:04.626+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.966 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:49:04.626+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_done global_id 6512 payload 824 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:49:04.626+0000 7fcafe9ad640 10 monclient: _finish_hunting 0 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:49:04.626+0000 7fcafe9ad640 1 monclient: found mon.noname-c 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:49:04.626+0000 7fcafe9ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: dump: 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.967 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: _finish_auth 0 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: _check_auth_tickets 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:49:04.626+0000 7fc9e9602640 10 monclient: dump: 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.968 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:49:04.626+0000 7fcb03525800 5 monclient: authenticate success, global_id 6512 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:49:04.626+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:49:04.626+0000 7fcb03525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:49:04.626+0000 7fcb001b0640 4 set_mon_vals no callback set 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:49:04.626+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:49:04.626+0000 7fcb03525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:49:04.627+0000 7fc9e9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:49:04.627+0000 7fc9e9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.969 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:49:04.627+0000 7fc9e9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:49:04.628+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x7fc9d8076380 auth_method 0 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:49:04.628+0000 7fcb03525800 10 monclient: get_monmap_and_config 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:49:04.628+0000 7fcb03525800 10 monclient: build_initial_monmap 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:49:04.628+0000 7fcb03525800 1 build_initial for_mkfs: 0 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:49:04.628+0000 7fcb03525800 10 monclient: monmap: 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:04.970 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding auth protocol: cephx 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding auth protocol: cephx 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding auth protocol: cephx 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.971 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: crc 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x5565fd3bcb80) adding con mode: secure 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:49:04.628+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:49:04.628+0000 7fcb03525800 10 monclient: init 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding auth protocol: cephx 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding auth protocol: cephx 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding auth protocol: cephx 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.972 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: crc 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:49:04.628+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac180) adding con mode: secure 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:49:04.628+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:49:04.629+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:49:04.629+0000 7fcb03525800 5 asok(0x5565fd100630) register_command rotate-key cmddesc rotate-key hook 0x7ffed11ac2c8 EEXIST 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:49:04.973 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-c con 0x5565fd3f1030 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-a con 0x5565fd3c1e50 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-b con 0x5565fd3ec460 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient(hunting): authenticate will time out at 1897.898267s 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request con 0x5565fd3c1e50 auth_method 0 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request con 0x5565fd3f1030 auth_method 0 2024-09-12T00:49:04.974 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:49:04.629+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_done global_id 6906 payload 274 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient: _finish_hunting 0 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 1 monclient: found mon.noname-a 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:49:04.629+0000 7fcafe9ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.975 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: dump: 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:49:04.976 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:49:04.629+0000 7fc9e2ffd640 10 monclient: dump: 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.977 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:49:04.629+0000 7fcb03525800 5 monclient: authenticate success, global_id 6906 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:49:04.629+0000 7fcb03525800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:49:04.629+0000 7fcb03525800 4 set_mon_vals no callback set 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:49:04.630+0000 7fcb03525800 10 monclient: shutdown 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:49:04.630+0000 7fcb03525800 10 monclient: build_initial_monmap 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 build_initial for_mkfs: 0 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:49:04.630+0000 7fcb03525800 10 monclient: monmap: 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.978 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding auth protocol: cephx 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding auth protocol: cephx 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding auth protocol: cephx 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.979 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: crc 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3e2120) adding con mode: secure 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:49:04.630+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 librados: starting msgr at 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 librados: starting objecter 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 asok(0x5565fd100630) register_command objecter_requests cmddesc objecter_requests hook 0x5565fd39eed0 EEXIST 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 librados: setting wanted keys 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:49:04.630+0000 7fcb03525800 1 librados: calling monclient init 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:49:04.630+0000 7fcb03525800 10 monclient: init 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding auth protocol: cephx 2024-09-12T00:49:04.980 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding auth protocol: cephx 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding auth protocol: cephx 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: crc 2024-09-12T00:49:04.981 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:49:04.630+0000 7fcb03525800 5 AuthRegistry(0x5565fd3b4a80) adding con mode: secure 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:49:04.631+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:49:04.631+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:49:04.631+0000 7fcb03525800 5 asok(0x5565fd100630) register_command rotate-key cmddesc rotate-key hook 0x5565fd3b4bc8 EEXIST 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-a con 0x5565fd3c1e50 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-c con 0x5565fd3ec460 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): picked mon.noname-b con 0x5565fd3f1030 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:49:04.631+0000 7fcb03525800 10 monclient(hunting): authenticate will time out at 1897.900444s 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request con 0x5565fd3c1e50 auth_method 0 2024-09-12T00:49:04.982 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request con 0x5565fd3ec460 auth_method 0 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:49:04.631+0000 7fcafe9ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:49:04.631+0000 7fcaff9af640 10 monclient(hunting): get_auth_request con 0x5565fd3f1030 auth_method 0 2024-09-12T00:49:04.983 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:49:04.631+0000 7fcaff9af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:49:04.631+0000 7fcaff9af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:49:04.631+0000 7fcaff9af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient(hunting): handle_auth_done global_id 6909 payload 824 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient: _finish_hunting 0 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 1 monclient: found mon.noname-a 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:49:04.631+0000 7fcaff1ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: dump: 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.984 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: _finish_auth 0 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:49:04.632+0000 7fc9e17fa640 10 monclient: dump: 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:04.985 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:49:04.632+0000 7fcb03525800 5 monclient: authenticate success, global_id 6909 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:49:04.632+0000 7fc9e2ffd640 4 set_mon_vals no callback set 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:49:04.632+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:49:04.632+0000 7fcb03525800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:49:04.632+0000 7fcb03525800 10 monclient: _renew_subs 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:49:04.632+0000 7fcb03525800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.986 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:49:04.632+0000 7fcb03525800 1 librados: init done 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:49:04.632+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cr dump hook 0x5565fd3e67f8 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:49:04.633+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:49:04.634+0000 7fc9e17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:49:04.634+0000 7fc9e17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:49:04.634+0000 7fc9e17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:49:04.634+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x7fc9c8076470 auth_method 0 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:49:04.635+0000 7fcaff9af640 10 monclient: get_auth_request con 0x5565fd40b3d0 auth_method 0 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 realm 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:49:04.635+0000 7fcb03525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:04.987 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:49:04.635+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:49:04.636+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x5565fd40f520 auth_method 0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:49:04.636+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:49:04.637+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:49:04.637+0000 7fcb03525800 20 searching for the correct realm 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:49:04.637+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x5565fd4147b0 auth_method 0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:49:04.638+0000 7fcaff9af640 10 monclient: get_auth_request con 0x7fcae8095060 auth_method 0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:49:04.639+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x7fcaf0072040 auth_method 0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:49:04.640+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x7fcae806a690 auth_method 0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:49:04.640+0000 7fcafe9ad640 0 -- 172.21.15.83:0/4131664742 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fcae806a690 msgr2=0x7fcae8065170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:49:04.842+0000 7fcafe9ad640 10 monclient: get_auth_request con 0x7fcae806a690 auth_method 0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:49:04.844+0000 7fcaff9af640 10 monclient: get_auth_request con 0x7fcaf0036040 auth_method 0 2024-09-12T00:49:04.988 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:49:04.845+0000 7fcaff1ae640 10 monclient: get_auth_request con 0x7fcaf8060980 auth_method 0 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:49:04.846+0000 7fcaff9af640 0 -- 172.21.15.83:0/4131664742 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5565fd40b3d0 msgr2=0x5565fd40d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:49:04.846+0000 7fc9e17fa640 1 client.6909.objecter ms_handle_reset 0x5565fd40b3d0 session 0x5565fd40ad50 osd.6 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:49:04.846+0000 7fc9e17fa640 10 monclient: _renew_subs 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:49:04.846+0000 7fc9e17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:49:04.846+0000 7fcaff9af640 10 monclient: get_auth_request con 0x7fc9c80867f0 auth_method 0 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:49:04.849+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.989 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 zone default found 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:49:04.850+0000 7fcb03525800 4 Realm: () 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:49:04.850+0000 7fcb03525800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:49:04.850+0000 7fcb03525800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:49:04.850+0000 7fcb03525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 zonegroup default 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:49:04.850+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:04.990 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 started sync module instance, tier type = 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:49:04.851+0000 7fcb03525800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=0 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=1 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=2 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=3 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=4 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=5 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:49:04.861+0000 7fcb03525800 20 add_watcher() i=6 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:49:04.862+0000 7fcb03525800 20 add_watcher() i=7 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:49:04.862+0000 7fcb03525800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding auth protocol: cephx 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding auth protocol: cephx 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding auth protocol: cephx 2024-09-12T00:49:04.991 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:49:04.864+0000 7fc9b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: crc 2024-09-12T00:49:04.992 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:49:04.864+0000 7fcb03525800 5 AuthRegistry(0x7ffed11ac660) adding con mode: secure 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:49:04.865+0000 7fcb03525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cache list hook 0x5565fd3e6710 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cache inspect hook 0x5565fd3e6710 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cache erase hook 0x5565fd3e6710 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command cache zap hook 0x5565fd3e6710 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 note: GC not initialized 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:49:04.865+0000 7fc9b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command sync trace show hook 0x7fcaf806e040 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command sync trace history hook 0x7fcaf806e040 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command sync trace active hook 0x7fcaf806e040 2024-09-12T00:49:04.993 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:49:04.865+0000 7fcb03525800 5 asok(0x5565fd100630) register_command sync trace active_short hook 0x7fcaf806e040 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 Filter name: none 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:49:04.865+0000 7fc92e7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:49:04.865+0000 7fcb03525800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:49:04.865+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:49:04.866+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 : miss 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:49:04.866+0000 7fcb03525800 20 rados->read ofs=0 len=0 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:49:04.866+0000 7fcb03525800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:04.994 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:49:04.866+0000 7fcb03525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:49:04.870+0000 7fcb03525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:49:04.870+0000 7fcb03525800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:49:04.870+0000 7fcb03525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:49:04.870+0000 7fcb03525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28, ofs0, ns] 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464368 cookie 93896528983808 notifier 6909 bl.length()=1023 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:49:04.870+0000 7fc9e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_sources= new_sources= 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential sources added=[] removed=[] 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_dests= new_dests= 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:49:04.870+0000 7fcb03525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential dests added=[] removed=[] 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:49:04.871+0000 7fcb03525800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb03525800 time 2024-09-12T00:49:04.871610+0000 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:04.995 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb04b8c71a] 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb04b8c8d8] 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565fb8fb641] 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd884de) [0x5565fbe0e4de] 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565fb90b31d] 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcb03829590] 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:49:04.872+0000 7fcb03525800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:04.996 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fcb03525800 thread_name:radosgw-admin 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb0383e6f0] 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb0388b99c] 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb04b8c774] 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb04b8c8d8] 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565fb8fb641] 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd884de) [0x5565fbe0e4de] 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565fb90b31d] 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcb03829590] 2024-09-12T00:49:04.997 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:49:04.998 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:49:04.999 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:49:05.000 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:49:05.001 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:49:05.002 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:49:05.003 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:49:05.004 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc92e7fc640 / http_manager 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9b4fe1640 / http_manager 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9b5fe3640 / rgw_dt_lg_renew 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9e17fa640 / ms_dispatch 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9e2ffd640 / io_context_pool 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9e9602640 / ms_dispatch 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9ebe07640 / ms_dispatch 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9ed60a640 / io_context_pool 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcafe9ad640 / msgr-worker-2 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcaff1ae640 / msgr-worker-1 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcaff9af640 / msgr-worker-0 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb001b0640 / io_context_pool 2024-09-12T00:49:05.005 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb03525800 / radosgw-admin 2024-09-12T00:49:05.006 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:49:05.006 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:49:05.006 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:49:04.873317Z_7e0a2809-b040-4735-8166-3d49e3c65344/log 2024-09-12T00:49:05.006 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:49:05.006 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:49:05.007 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:05.007 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:05.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.947+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.949+0000 7f43f20b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.949+0000 7f43f20b9800 20 realm 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.949+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.949+0000 7f43f20b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.949+0000 7f43f20b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.949+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.950+0000 7f43f20b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.950+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.950+0000 7f43f20b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.950+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.951+0000 7f43f20b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.951+0000 7f43f20b9800 20 searching for the correct realm 2024-09-12T00:49:05.008 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:04.953+0000 7f43e73a2640 0 -- 172.21.15.83:0/4042385580 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f43d8029070 msgr2=0x7f43d8073e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:05.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.159+0000 7f43f03a4640 0 -- 172.21.15.83:0/4042385580 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55ec5ba26b20 msgr2=0x55ec5ba28f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.163+0000 7f43f20b9800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.163+0000 7f43f20b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.163+0000 7f43f20b9800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.163+0000 7f43f20b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.163+0000 7f43f20b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.163+0000 7f43f20b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.163+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.163+0000 7f43f20b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.163+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 20 zone default found 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 4 Realm: () 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 20 zonegroup default 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.164+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.165+0000 7f43f20b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.165+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.165+0000 7f43f20b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.165+0000 7f43f20b9800 20 started sync module instance, tier type = 2024-09-12T00:49:05.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.165+0000 7f43f20b9800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.173+0000 7f43f20b9800 20 add_watcher() i=0 2024-09-12T00:49:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.173+0000 7f43f20b9800 20 add_watcher() i=1 2024-09-12T00:49:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.173+0000 7f43f20b9800 20 add_watcher() i=2 2024-09-12T00:49:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.173+0000 7f43f20b9800 20 add_watcher() i=3 2024-09-12T00:49:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.173+0000 7f43f20b9800 20 add_watcher() i=4 2024-09-12T00:49:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.173+0000 7f43f20b9800 20 add_watcher() i=5 2024-09-12T00:49:05.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.173+0000 7f43f20b9800 20 add_watcher() i=6 2024-09-12T00:49:05.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.174+0000 7f43f20b9800 20 add_watcher() i=7 2024-09-12T00:49:05.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.174+0000 7f43f20b9800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:05.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.176+0000 7f42a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:05.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.176+0000 7f43f20b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:05.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.176+0000 7f43f20b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:05.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.176+0000 7f43f20b9800 5 note: GC not initialized 2024-09-12T00:49:05.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.177+0000 7f42a4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:05.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.177+0000 7f43f20b9800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:05.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.177+0000 7f43f20b9800 20 Filter name: none 2024-09-12T00:49:05.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.177+0000 7f421e7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:05.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.177+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.177+0000 7f43f20b9800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:05.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.177+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.178+0000 7f43f20b9800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:49:05.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.178+0000 7f43f20b9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:05.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.178+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.178+0000 7f43f20b9800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:05.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.178+0000 7f43f20b9800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.179+0000 7f43f20b9800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:49:05.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.179+0000 7f43f20b9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:05.179 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.181+0000 7f42a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:05.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.183+0000 7f43f20b9800 20 remove_watcher() i=0 2024-09-12T00:49:05.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.183+0000 7f43f20b9800 2 removed watcher, disabling cache 2024-09-12T00:49:05.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.184+0000 7f43f20b9800 20 remove_watcher() i=1 2024-09-12T00:49:05.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.185+0000 7f43f20b9800 20 remove_watcher() i=2 2024-09-12T00:49:05.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.186+0000 7f43f20b9800 20 remove_watcher() i=3 2024-09-12T00:49:05.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.187+0000 7f43f20b9800 20 remove_watcher() i=4 2024-09-12T00:49:05.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.188+0000 7f43f20b9800 20 remove_watcher() i=5 2024-09-12T00:49:05.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.189+0000 7f43f20b9800 20 remove_watcher() i=6 2024-09-12T00:49:05.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.190+0000 7f43f20b9800 20 remove_watcher() i=7 2024-09-12T00:49:05.198 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:05.198 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:05.198 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-trim-reshard-log-entries id: ad4424e4-de7c-4376-b125-e717016a3484.4511.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:05.199 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:05.200 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:05.200 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:05.208 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:05.208 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:05.251 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:05.284 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:05.284 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:05.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.322+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.323+0000 7fc6eb80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.323+0000 7fc6eb80e800 20 realm 2024-09-12T00:49:05.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.323+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.323+0000 7fc6eb80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.323+0000 7fc6eb80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:05.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.323+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.324+0000 7fc6eb80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.324+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.324+0000 7fc6eb80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:05.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.324+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.325+0000 7fc6eb80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:05.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.325+0000 7fc6eb80e800 20 searching for the correct realm 2024-09-12T00:49:05.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.327+0000 7fc6dffff640 0 -- 172.21.15.83:0/2746892477 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fc6d0071050 msgr2=0x7fc6d00a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:05.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.532+0000 7fc6e776c640 0 -- 172.21.15.83:0/2746892477 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x556a701eb3d0 msgr2=0x556a701ed7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:05.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.535+0000 7fc6eb80e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:05.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.535+0000 7fc6eb80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:05.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.535+0000 7fc6eb80e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.535+0000 7fc6eb80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.535+0000 7fc6eb80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.535+0000 7fc6eb80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.535+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.535+0000 7fc6eb80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.535+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 20 zone default found 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 4 Realm: () 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:05.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 20 zonegroup default 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.536+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.537+0000 7fc6eb80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.537+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.537+0000 7fc6eb80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.537+0000 7fc6eb80e800 20 started sync module instance, tier type = 2024-09-12T00:49:05.537 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.537+0000 7fc6eb80e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:05.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.545+0000 7fc6eb80e800 20 add_watcher() i=0 2024-09-12T00:49:05.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.545+0000 7fc6eb80e800 20 add_watcher() i=1 2024-09-12T00:49:05.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.545+0000 7fc6eb80e800 20 add_watcher() i=2 2024-09-12T00:49:05.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.545+0000 7fc6eb80e800 20 add_watcher() i=3 2024-09-12T00:49:05.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.545+0000 7fc6eb80e800 20 add_watcher() i=4 2024-09-12T00:49:05.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.545+0000 7fc6eb80e800 20 add_watcher() i=5 2024-09-12T00:49:05.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.545+0000 7fc6eb80e800 20 add_watcher() i=6 2024-09-12T00:49:05.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.546+0000 7fc6eb80e800 20 add_watcher() i=7 2024-09-12T00:49:05.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.546+0000 7fc6eb80e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:05.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.548+0000 7fc59d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:05.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.548+0000 7fc6eb80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:05.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.548+0000 7fc6eb80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:05.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.548+0000 7fc6eb80e800 5 note: GC not initialized 2024-09-12T00:49:05.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.548+0000 7fc517fff640 20 reqs_thread_entry: start 2024-09-12T00:49:05.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc6eb80e800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:05.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc6eb80e800 20 Filter name: none 2024-09-12T00:49:05.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc515ffb640 20 reqs_thread_entry: start 2024-09-12T00:49:05.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc6eb80e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:49:05.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc6eb80e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:05.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc6eb80e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:05.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc6eb80e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:05.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc6eb80e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 : miss 2024-09-12T00:49:05.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.549+0000 7fc6eb80e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:05.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.550+0000 7fc6eb80e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:49:05.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.550+0000 7fc6eb80e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:05.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.550+0000 7fc6eb80e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:05.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.550+0000 7fc6eb80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:05.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.550+0000 7fc6eb80e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:05.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.550+0000 7fc6eb80e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 2024-09-12T00:49:05.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.551+0000 7fc6eb80e800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to be held by another RGW process; skipping for now 2024-09-12T00:49:05.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.552+0000 7fc59d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:05.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.554+0000 7fc6eb80e800 20 remove_watcher() i=0 2024-09-12T00:49:05.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.554+0000 7fc6eb80e800 2 removed watcher, disabling cache 2024-09-12T00:49:05.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.555+0000 7fc6eb80e800 20 remove_watcher() i=1 2024-09-12T00:49:05.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.556+0000 7fc6eb80e800 20 remove_watcher() i=2 2024-09-12T00:49:05.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.557+0000 7fc6eb80e800 20 remove_watcher() i=3 2024-09-12T00:49:05.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.558+0000 7fc6eb80e800 20 remove_watcher() i=4 2024-09-12T00:49:05.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.559+0000 7fc6eb80e800 20 remove_watcher() i=5 2024-09-12T00:49:05.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.559+0000 7fc6eb80e800 20 remove_watcher() i=6 2024-09-12T00:49:05.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:05.560+0000 7fc6eb80e800 20 remove_watcher() i=7 2024-09-12T00:49:05.569 INFO:tasks.workunit.client.0.smithi083.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:49:35.591 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:35.626 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:35.626 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:35.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.668+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.669+0000 7f7d53321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.669+0000 7f7d53321800 20 realm 2024-09-12T00:49:35.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.669+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.670+0000 7f7d53321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.670+0000 7f7d53321800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:35.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.670+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.670+0000 7f7d53321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.670+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.671+0000 7f7d53321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:35.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.671+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.671+0000 7f7d53321800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:35.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.671+0000 7f7d53321800 20 searching for the correct realm 2024-09-12T00:49:35.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.675+0000 7f7d4f757640 0 -- 172.21.15.83:0/1614911095 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f7d44083070 msgr2=0x7f7d44084400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:35.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.679+0000 7f7d4ef56640 0 -- 172.21.15.83:0/1614911095 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f7d48025410 msgr2=0x7f7d48025870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:35.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.683+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 20 zone default found 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 4 Realm: () 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 20 zonegroup default 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.684+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.685+0000 7f7d53321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.685+0000 7f7d53321800 20 started sync module instance, tier type = 2024-09-12T00:49:35.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.685+0000 7f7d53321800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:35.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.694+0000 7f7d53321800 20 add_watcher() i=0 2024-09-12T00:49:35.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.694+0000 7f7d53321800 20 add_watcher() i=1 2024-09-12T00:49:35.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.694+0000 7f7d53321800 20 add_watcher() i=2 2024-09-12T00:49:35.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.694+0000 7f7d53321800 20 add_watcher() i=3 2024-09-12T00:49:35.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.694+0000 7f7d53321800 20 add_watcher() i=4 2024-09-12T00:49:35.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.694+0000 7f7d53321800 20 add_watcher() i=5 2024-09-12T00:49:35.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.694+0000 7f7d53321800 20 add_watcher() i=6 2024-09-12T00:49:35.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.695+0000 7f7d53321800 20 add_watcher() i=7 2024-09-12T00:49:35.695 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.695+0000 7f7d53321800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:35.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.697+0000 7f7c057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:35.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.697+0000 7f7d53321800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:35.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.697+0000 7f7d53321800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:35.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.697+0000 7f7d53321800 5 note: GC not initialized 2024-09-12T00:49:35.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7b7ffff640 20 reqs_thread_entry: start 2024-09-12T00:49:35.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7d53321800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:35.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7d53321800 20 Filter name: none 2024-09-12T00:49:35.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7b7dffb640 20 reqs_thread_entry: start 2024-09-12T00:49:35.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7d53321800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:49:35.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7d53321800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:35.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7d53321800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:49:35.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7d53321800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:49:35.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7d53321800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 : miss 2024-09-12T00:49:35.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.698+0000 7f7d53321800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.699+0000 7f7d53321800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:49:35.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.699+0000 7f7d53321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:35.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.699+0000 7f7d53321800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:35.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.699+0000 7f7d53321800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:35.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.699+0000 7f7d53321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:35.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.699+0000 7f7d53321800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 2024-09-12T00:49:35.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.700+0000 7f7d53321800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.704+0000 7f7d53321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.704+0000 7f7d53321800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.704+0000 7f7d53321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.704+0000 7f7d53321800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28, ofs0, ns] 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.704+0000 7f7c327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464369 cookie 94421027317424 notifier 6966 bl.length()=1023 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.704+0000 7f7c327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.704+0000 7f7c327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.704+0000 7f7c327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.705+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_sources= new_sources= 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.705+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential sources added=[] removed=[] 2024-09-12T00:49:35.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.705+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_dests= new_dests= 2024-09-12T00:49:35.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.705+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential dests added=[] removed=[] 2024-09-12T00:49:35.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.707+0000 7f7d53321800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.28.2.0 2024-09-12T00:49:35.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.707+0000 7f7d53321800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.28.2.0 2024-09-12T00:49:35.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.707+0000 7f7d53321800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.28.2.1 2024-09-12T00:49:35.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.707+0000 7f7d53321800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.28.2.1 2024-09-12T00:49:35.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.707+0000 7f7d53321800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.28.0 2024-09-12T00:49:35.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.709+0000 7f7d53321800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:35.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.709+0000 7f7d53321800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 2024-09-12T00:49:35.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.711+0000 7f7d53321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:35.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.711+0000 7f7d53321800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:35.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.711+0000 7f7d53321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:35.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.711+0000 7f7d53321800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28, ofs0, ns] 2024-09-12T00:49:35.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.712+0000 7f7c31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464370 cookie 94421027317424 notifier 6966 bl.length()=1023 2024-09-12T00:49:35.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.712+0000 7f7c31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:35.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.712+0000 7f7c31ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:35.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.712+0000 7f7c31ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:35.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.712+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_sources= new_sources= 2024-09-12T00:49:35.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.712+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential sources added=[] removed=[] 2024-09-12T00:49:35.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.712+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_dests= new_dests= 2024-09-12T00:49:35.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.712+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential dests added=[] removed=[] 2024-09-12T00:49:35.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.714+0000 7f7d53321800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.28.0 2024-09-12T00:49:35.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.714+0000 7f7d53321800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:35.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.714+0000 7f7d53321800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 2024-09-12T00:49:35.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.715+0000 7f7d53321800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:35.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.715+0000 7f7d53321800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:35.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.715+0000 7f7d53321800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:35.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.715+0000 7f7d53321800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28, ofs0, ns] 2024-09-12T00:49:35.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.716+0000 7f7c327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464371 cookie 94421027317424 notifier 6966 bl.length()=991 2024-09-12T00:49:35.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.716+0000 7f7c327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 info.flags=0x17 2024-09-12T00:49:35.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.716+0000 7f7c327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ad4424e4-de7c-4376-b125-e717016a3484.4511.28 to cache LRU end 2024-09-12T00:49:35.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.716+0000 7f7c327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:35.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.716+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_sources= new_sources= 2024-09-12T00:49:35.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.716+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential sources added=[] removed=[] 2024-09-12T00:49:35.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.716+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): orig_dests= new_dests= 2024-09-12T00:49:35.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.716+0000 7f7d53321800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ad4424e4-de7c-4376-b125-e717016a3484.4511.28]): potential dests added=[] removed=[] 2024-09-12T00:49:35.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.717+0000 7f7d53321800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:35.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.719+0000 7f7c057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:35.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.722+0000 7f7d53321800 20 remove_watcher() i=0 2024-09-12T00:49:35.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.722+0000 7f7d53321800 2 removed watcher, disabling cache 2024-09-12T00:49:35.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.723+0000 7f7d53321800 20 remove_watcher() i=1 2024-09-12T00:49:35.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.724+0000 7f7d53321800 20 remove_watcher() i=2 2024-09-12T00:49:35.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.725+0000 7f7d53321800 20 remove_watcher() i=3 2024-09-12T00:49:35.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.726+0000 7f7d53321800 20 remove_watcher() i=4 2024-09-12T00:49:35.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.727+0000 7f7d53321800 20 remove_watcher() i=5 2024-09-12T00:49:35.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.728+0000 7f7d53321800 20 remove_watcher() i=6 2024-09-12T00:49:35.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.729+0000 7f7d53321800 20 remove_watcher() i=7 2024-09-12T00:49:35.740 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:49:35.769 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:35.769 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:35.806 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.806+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.808+0000 7f016b932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.808+0000 7f016b932800 20 realm 2024-09-12T00:49:35.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.808+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.808+0000 7f016b932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.808+0000 7f016b932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:35.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.808+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.808+0000 7f016b932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.808+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.809+0000 7f016b932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:35.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.809+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.810+0000 7f016b932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:35.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.810+0000 7f016b932800 20 searching for the correct realm 2024-09-12T00:49:35.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.813+0000 7f015edbb640 0 -- 172.21.15.83:0/1072309776 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f0150009040 msgr2=0x7f0150032410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:35.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.817+0000 7f0167dbd640 0 -- 172.21.15.83:0/1072309776 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56371bcbaf30 msgr2=0x56371bcbd3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:35.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:35.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:35.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:35.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:35.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:35.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:35.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:35.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.821+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:35.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 20 zone default found 2024-09-12T00:49:35.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 4 Realm: () 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 20 zonegroup default 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.822+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.823+0000 7f016b932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.823+0000 7f016b932800 20 started sync module instance, tier type = 2024-09-12T00:49:35.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.823+0000 7f016b932800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:35.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.831+0000 7f016b932800 20 add_watcher() i=0 2024-09-12T00:49:35.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.831+0000 7f016b932800 20 add_watcher() i=1 2024-09-12T00:49:35.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.831+0000 7f016b932800 20 add_watcher() i=2 2024-09-12T00:49:35.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.831+0000 7f016b932800 20 add_watcher() i=3 2024-09-12T00:49:35.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.831+0000 7f016b932800 20 add_watcher() i=4 2024-09-12T00:49:35.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.831+0000 7f016b932800 20 add_watcher() i=5 2024-09-12T00:49:35.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.831+0000 7f016b932800 20 add_watcher() i=6 2024-09-12T00:49:35.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.832+0000 7f016b932800 20 add_watcher() i=7 2024-09-12T00:49:35.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.832+0000 7f016b932800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:35.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.833+0000 7f001dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:35.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.834+0000 7f016b932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:35.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.834+0000 7f016b932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:35.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.834+0000 7f016b932800 5 note: GC not initialized 2024-09-12T00:49:35.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.834+0000 7f001cfe1640 20 reqs_thread_entry: start 2024-09-12T00:49:35.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.834+0000 7f016b932800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:35.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.834+0000 7f016b932800 20 Filter name: none 2024-09-12T00:49:35.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.834+0000 7eff967fc640 20 reqs_thread_entry: start 2024-09-12T00:49:35.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.834+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.835+0000 7f016b932800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:35.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.835+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.836+0000 7f016b932800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:35.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.836+0000 7f016b932800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:35.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.836+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.836+0000 7f016b932800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:35.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.836+0000 7f016b932800 20 rados->read ofs=0 len=0 2024-09-12T00:49:35.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.836+0000 7f016b932800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:35.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.836+0000 7f016b932800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:35.837 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.838+0000 7f001dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:35.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.839+0000 7f016b932800 20 remove_watcher() i=0 2024-09-12T00:49:35.839 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.839+0000 7f016b932800 2 removed watcher, disabling cache 2024-09-12T00:49:35.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.840+0000 7f016b932800 20 remove_watcher() i=1 2024-09-12T00:49:35.841 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.841+0000 7f016b932800 20 remove_watcher() i=2 2024-09-12T00:49:35.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.842+0000 7f016b932800 20 remove_watcher() i=3 2024-09-12T00:49:35.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.843+0000 7f016b932800 20 remove_watcher() i=4 2024-09-12T00:49:35.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.844+0000 7f016b932800 20 remove_watcher() i=5 2024-09-12T00:49:35.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.845+0000 7f016b932800 20 remove_watcher() i=6 2024-09-12T00:49:35.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:35.846+0000 7f016b932800 20 remove_watcher() i=7 2024-09-12T00:49:35.856 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:35.856 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:35.856 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-trim-reshard-log-entries id: ad4424e4-de7c-4376-b125-e717016a3484.4511.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:49:35.856 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:35.858 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:35.858 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:35.862 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:35.862 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:35.905 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:35.905 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:35.919 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:49:35.919 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:35.920 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:35.920 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:35.930 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:35.930 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:35.973 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:35.973 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:35.980 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:35.981 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:35.988 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:35.989 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:35.997 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:35.997 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.005 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.006 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.014 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.014 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.021 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.022 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.030 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.030 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.038 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.038 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.045 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.045 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.054 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.055 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.062 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.062 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.070 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.070 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.078 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.078 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.086 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.086 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.094 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.094 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.101 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.102 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.109 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.109 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.117 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.117 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.125 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:36.125 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:36.133 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:49:36.161 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:36.161 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:36.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.197+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.199+0000 7f092d144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.199+0000 7f092d144800 20 realm 2024-09-12T00:49:36.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.199+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.200+0000 7f092d144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.200+0000 7f092d144800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:36.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.200+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.200+0000 7f092d144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.200+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.201+0000 7f092d144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:36.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.201+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.201+0000 7f092d144800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:36.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.201+0000 7f092d144800 20 searching for the correct realm 2024-09-12T00:49:36.203 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.204+0000 7f0923fff640 0 -- 172.21.15.83:0/414536830 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f09140b9db0 msgr2=0x7f09140c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:36.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.408+0000 7f09296f5640 0 -- 172.21.15.83:0/414536830 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56127013e220 msgr2=0x561270140610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:36.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.412+0000 7f092d144800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:36.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.412+0000 7f092d144800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:36.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.412+0000 7f092d144800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:36.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.412+0000 7f092d144800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:36.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.412+0000 7f092d144800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:36.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.412+0000 7f092d144800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:36.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.412+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:36.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:36.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 zone default found 2024-09-12T00:49:36.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 4 Realm: () 2024-09-12T00:49:36.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 zonegroup default 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.413+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.414+0000 7f092d144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.414+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.414+0000 7f092d144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.414+0000 7f092d144800 20 started sync module instance, tier type = 2024-09-12T00:49:36.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.414+0000 7f092d144800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:36.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.422+0000 7f092d144800 20 add_watcher() i=0 2024-09-12T00:49:36.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.422+0000 7f092d144800 20 add_watcher() i=1 2024-09-12T00:49:36.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.422+0000 7f092d144800 20 add_watcher() i=2 2024-09-12T00:49:36.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.422+0000 7f092d144800 20 add_watcher() i=3 2024-09-12T00:49:36.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.422+0000 7f092d144800 20 add_watcher() i=4 2024-09-12T00:49:36.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.422+0000 7f092d144800 20 add_watcher() i=5 2024-09-12T00:49:36.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.422+0000 7f092d144800 20 add_watcher() i=6 2024-09-12T00:49:36.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.423+0000 7f092d144800 20 add_watcher() i=7 2024-09-12T00:49:36.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.423+0000 7f092d144800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:36.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.425+0000 7f07defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:36.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.425+0000 7f092d144800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:36.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.425+0000 7f092d144800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:36.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.425+0000 7f092d144800 5 note: GC not initialized 2024-09-12T00:49:36.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.425+0000 7f07ddfe3640 20 reqs_thread_entry: start 2024-09-12T00:49:36.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.425+0000 7f092d144800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:36.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.425+0000 7f092d144800 20 Filter name: none 2024-09-12T00:49:36.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.426+0000 7f074f7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:36.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.426+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.426+0000 7f092d144800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:36.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.426+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.427+0000 7f092d144800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:36.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.427+0000 7f092d144800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:36.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.427+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.427+0000 7f092d144800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:36.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.427+0000 7f092d144800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.427+0000 7f092d144800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:36.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.427+0000 7f092d144800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:36.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.428+0000 7f07defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:36.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.431+0000 7f092d144800 20 remove_watcher() i=0 2024-09-12T00:49:36.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.431+0000 7f092d144800 2 removed watcher, disabling cache 2024-09-12T00:49:36.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.432+0000 7f092d144800 20 remove_watcher() i=1 2024-09-12T00:49:36.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.433+0000 7f092d144800 20 remove_watcher() i=2 2024-09-12T00:49:36.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.433+0000 7f092d144800 20 remove_watcher() i=3 2024-09-12T00:49:36.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.434+0000 7f092d144800 20 remove_watcher() i=4 2024-09-12T00:49:36.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.435+0000 7f092d144800 20 remove_watcher() i=5 2024-09-12T00:49:36.436 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.436+0000 7f092d144800 20 remove_watcher() i=6 2024-09-12T00:49:36.437 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.437+0000 7f092d144800 20 remove_watcher() i=7 2024-09-12T00:49:36.447 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:36.447 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:36.447 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-block-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:36.448 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:36.449 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:49:36.482 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:36.483 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:36.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.519+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.521+0000 7f43ff214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.521+0000 7f43ff214800 20 realm 2024-09-12T00:49:36.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.521+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.521+0000 7f43ff214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.521+0000 7f43ff214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:36.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.521+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.522+0000 7f43ff214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.522+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.522+0000 7f43ff214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:36.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.522+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.523+0000 7f43ff214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:36.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.523+0000 7f43ff214800 20 searching for the correct realm 2024-09-12T00:49:36.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.526+0000 7f43fa0ca640 0 -- 172.21.15.83:0/4145248865 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f43f007b450 msgr2=0x7f43f007b8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:36.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.732+0000 7f43fa0ca640 0 -- 172.21.15.83:0/4145248865 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55857e40cf10 msgr2=0x55857e40f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:36.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.735+0000 7f43ff214800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:36.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.735+0000 7f43ff214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:36.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.735+0000 7f43ff214800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:36.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.735+0000 7f43ff214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.735+0000 7f43ff214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.735+0000 7f43ff214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 20 zone default found 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 4 Realm: () 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:36.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:36.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 20 zonegroup default 2024-09-12T00:49:36.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.736+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.737+0000 7f43ff214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.737+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.737+0000 7f43ff214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.737+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.737+0000 7f43ff214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:36.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.737+0000 7f43ff214800 20 started sync module instance, tier type = 2024-09-12T00:49:36.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.737+0000 7f43ff214800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:36.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.745+0000 7f43ff214800 20 add_watcher() i=0 2024-09-12T00:49:36.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.745+0000 7f43ff214800 20 add_watcher() i=1 2024-09-12T00:49:36.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.745+0000 7f43ff214800 20 add_watcher() i=2 2024-09-12T00:49:36.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.745+0000 7f43ff214800 20 add_watcher() i=3 2024-09-12T00:49:36.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.745+0000 7f43ff214800 20 add_watcher() i=4 2024-09-12T00:49:36.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.745+0000 7f43ff214800 20 add_watcher() i=5 2024-09-12T00:49:36.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.745+0000 7f43ff214800 20 add_watcher() i=6 2024-09-12T00:49:36.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.746+0000 7f43ff214800 20 add_watcher() i=7 2024-09-12T00:49:36.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.746+0000 7f43ff214800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:36.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.748+0000 7f42b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:36.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.749+0000 7f43ff214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:36.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.749+0000 7f43ff214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:36.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.749+0000 7f43ff214800 5 note: GC not initialized 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.749+0000 7f422bfff640 20 reqs_thread_entry: start 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.749+0000 7f43ff214800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.749+0000 7f43ff214800 20 Filter name: none 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.749+0000 7f4229ffb640 20 reqs_thread_entry: start 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.749+0000 7f43ff214800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.749+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 : miss 2024-09-12T00:49:36.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 20 rados->read ofs=0 len=0 2024-09-12T00:49:36.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:36.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:36.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:36.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:36.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:36.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.750+0000 7f43ff214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 2024-09-12T00:49:36.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f43ff214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:36.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f43ff214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:36.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f43ff214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:36.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f43ff214800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29, ofs0, ns] 2024-09-12T00:49:36.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f42de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94031837239024 notifier 7017 bl.length()=999 2024-09-12T00:49:36.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f42de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:36.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f42de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:36.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f42de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:36.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_sources= new_sources= 2024-09-12T00:49:36.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential sources added=[] removed=[] 2024-09-12T00:49:36.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_dests= new_dests= 2024-09-12T00:49:36.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.754+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential dests added=[] removed=[] 2024-09-12T00:49:36.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.757+0000 7f43ff214800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.1.0 2024-09-12T00:49:36.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.757+0000 7f43ff214800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.1.0 2024-09-12T00:49:36.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.757+0000 7f43ff214800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.1.1 2024-09-12T00:49:36.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.757+0000 7f43ff214800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.1.1 2024-09-12T00:49:36.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.757+0000 7f43ff214800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.0 2024-09-12T00:49:36.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.759+0000 7f43ff214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:36.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.759+0000 7f43ff214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 2024-09-12T00:49:36.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.760+0000 7f43ff214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:36.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.760+0000 7f43ff214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:36.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.760+0000 7f43ff214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:36.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.760+0000 7f43ff214800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29, ofs0, ns] 2024-09-12T00:49:36.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.760+0000 7f42ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 94031837239024 notifier 7017 bl.length()=999 2024-09-12T00:49:36.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.760+0000 7f42ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:36.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.760+0000 7f42ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:36.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.760+0000 7f42ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.761+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_sources= new_sources= 2024-09-12T00:49:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.761+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential sources added=[] removed=[] 2024-09-12T00:49:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.761+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_dests= new_dests= 2024-09-12T00:49:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.761+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential dests added=[] removed=[] 2024-09-12T00:49:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.761+0000 7f43ff214800 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:49:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.761+0000 7f43ff214800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:49:36.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.762+0000 7f43ff214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:36.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.762+0000 7f43ff214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 2024-09-12T00:49:36.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f43ff214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:36.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f43ff214800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f43ff214800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f43ff214800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29, ofs0, ns] 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f42de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 94031837239024 notifier 7017 bl.length()=967 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f42de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f42de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f42de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_sources= new_sources= 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential sources added=[] removed=[] 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_dests= new_dests= 2024-09-12T00:49:36.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.764+0000 7f43ff214800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential dests added=[] removed=[] 2024-09-12T00:49:36.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.765+0000 7f43ff214800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:49:36.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.767+0000 7f42b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:36.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.769+0000 7f43ff214800 20 remove_watcher() i=0 2024-09-12T00:49:36.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.769+0000 7f43ff214800 2 removed watcher, disabling cache 2024-09-12T00:49:36.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.770+0000 7f43ff214800 20 remove_watcher() i=1 2024-09-12T00:49:36.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.771+0000 7f43ff214800 20 remove_watcher() i=2 2024-09-12T00:49:36.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.772+0000 7f43ff214800 20 remove_watcher() i=3 2024-09-12T00:49:36.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.773+0000 7f43ff214800 20 remove_watcher() i=4 2024-09-12T00:49:36.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.774+0000 7f43ff214800 20 remove_watcher() i=5 2024-09-12T00:49:36.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.775+0000 7f43ff214800 20 remove_watcher() i=6 2024-09-12T00:49:36.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:36.776+0000 7f43ff214800 20 remove_watcher() i=7 2024-09-12T00:49:36.787 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:49:36.816 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:36.816 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:37.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.054+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.056+0000 7f0f979ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.056+0000 7f0f979ad800 20 realm 2024-09-12T00:49:37.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.056+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.056+0000 7f0f979ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.056+0000 7f0f979ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:37.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.057+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.057+0000 7f0f979ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.057+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.057+0000 7f0f979ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:37.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.057+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.058+0000 7f0f979ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:37.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.058+0000 7f0f979ad800 20 searching for the correct realm 2024-09-12T00:49:37.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.060+0000 7f0f95497640 0 -- 172.21.15.83:0/3514735814 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f0f8806d030 msgr2=0x7f0f88065040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:37.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.063+0000 7f0f95497640 0 -- 172.21.15.83:0/3514735814 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f0f90098040 msgr2=0x7f0f90064090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:37.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:37.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:37.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:37.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:37.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:37.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:37.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:37.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.269+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:37.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 20 zone default found 2024-09-12T00:49:37.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 4 Realm: () 2024-09-12T00:49:37.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:37.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:37.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:37.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 20 zonegroup default 2024-09-12T00:49:37.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.270+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.271+0000 7f0f979ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.271+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.271+0000 7f0f979ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.271+0000 7f0f979ad800 20 started sync module instance, tier type = 2024-09-12T00:49:37.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.271+0000 7f0f979ad800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:37.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.279+0000 7f0f979ad800 20 add_watcher() i=0 2024-09-12T00:49:37.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.279+0000 7f0f979ad800 20 add_watcher() i=1 2024-09-12T00:49:37.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.279+0000 7f0f979ad800 20 add_watcher() i=2 2024-09-12T00:49:37.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.279+0000 7f0f979ad800 20 add_watcher() i=3 2024-09-12T00:49:37.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.279+0000 7f0f979ad800 20 add_watcher() i=4 2024-09-12T00:49:37.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.279+0000 7f0f979ad800 20 add_watcher() i=5 2024-09-12T00:49:37.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.279+0000 7f0f979ad800 20 add_watcher() i=6 2024-09-12T00:49:37.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.280+0000 7f0f979ad800 20 add_watcher() i=7 2024-09-12T00:49:37.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.280+0000 7f0f979ad800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:37.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.282+0000 7f0e4bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:37.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.282+0000 7f0f979ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:37.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.282+0000 7f0f979ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:37.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.282+0000 7f0f979ad800 5 note: GC not initialized 2024-09-12T00:49:37.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.283+0000 7f0e4afe5640 20 reqs_thread_entry: start 2024-09-12T00:49:37.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.283+0000 7f0f979ad800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:37.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.283+0000 7f0f979ad800 20 Filter name: none 2024-09-12T00:49:37.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.283+0000 7f0e48fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:37.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.283+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.283+0000 7f0f979ad800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:37.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.283+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.284+0000 7f0f979ad800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:37.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.284+0000 7f0f979ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:37.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.284+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.284+0000 7f0f979ad800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:37.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.284+0000 7f0f979ad800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.285+0000 7f0f979ad800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:37.284 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.285+0000 7f0f979ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:37.285 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.286+0000 7f0e4bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:37.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.288+0000 7f0f979ad800 20 remove_watcher() i=0 2024-09-12T00:49:37.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.288+0000 7f0f979ad800 2 removed watcher, disabling cache 2024-09-12T00:49:37.288 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.288+0000 7f0f979ad800 20 remove_watcher() i=1 2024-09-12T00:49:37.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.289+0000 7f0f979ad800 20 remove_watcher() i=2 2024-09-12T00:49:37.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.290+0000 7f0f979ad800 20 remove_watcher() i=3 2024-09-12T00:49:37.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.291+0000 7f0f979ad800 20 remove_watcher() i=4 2024-09-12T00:49:37.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.293+0000 7f0f979ad800 20 remove_watcher() i=5 2024-09-12T00:49:37.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.293+0000 7f0f979ad800 20 remove_watcher() i=6 2024-09-12T00:49:37.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.294+0000 7f0f979ad800 20 remove_watcher() i=7 2024-09-12T00:49:37.304 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:37.304 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:37.304 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-block-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:37.304 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:37.306 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:37.306 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:37.313 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:37.314 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:37.357 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:37.388 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:37.388 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:37.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.425+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.427+0000 7ff1f312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.427+0000 7ff1f312a800 20 realm 2024-09-12T00:49:37.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.427+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.427+0000 7ff1f312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.427+0000 7ff1f312a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:37.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.427+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.427+0000 7ff1f312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.427+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.428+0000 7ff1f312a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:37.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.428+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.428+0000 7ff1f312a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:37.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.428+0000 7ff1f312a800 20 searching for the correct realm 2024-09-12T00:49:37.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.432+0000 7ff1ee6ac640 0 -- 172.21.15.83:0/2653309803 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff1e4088950 msgr2=0x7ff1e4063400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:37.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.637+0000 7ff1ef6ae640 0 -- 172.21.15.83:0/2653309803 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55b14a80e290 msgr2=0x55b14a810710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:37.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.641+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 zone default found 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 4 Realm: () 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 zonegroup default 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 started sync module instance, tier type = 2024-09-12T00:49:37.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.642+0000 7ff1f312a800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:37.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.651+0000 7ff1f312a800 20 add_watcher() i=0 2024-09-12T00:49:37.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.651+0000 7ff1f312a800 20 add_watcher() i=1 2024-09-12T00:49:37.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.651+0000 7ff1f312a800 20 add_watcher() i=2 2024-09-12T00:49:37.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.651+0000 7ff1f312a800 20 add_watcher() i=3 2024-09-12T00:49:37.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.651+0000 7ff1f312a800 20 add_watcher() i=4 2024-09-12T00:49:37.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.651+0000 7ff1f312a800 20 add_watcher() i=5 2024-09-12T00:49:37.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.651+0000 7ff1f312a800 20 add_watcher() i=6 2024-09-12T00:49:37.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.651+0000 7ff1f312a800 20 add_watcher() i=7 2024-09-12T00:49:37.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.651+0000 7ff1f312a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:37.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.653+0000 7ff0a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:37.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:37.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:37.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 5 note: GC not initialized 2024-09-12T00:49:37.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff01ffff640 20 reqs_thread_entry: start 2024-09-12T00:49:37.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:37.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 20 Filter name: none 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff01dffb640 20 reqs_thread_entry: start 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.654+0000 7ff1f312a800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.655+0000 7ff1f312a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 : miss 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.655+0000 7ff1f312a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.655+0000 7ff1f312a800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.655+0000 7ff1f312a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.655+0000 7ff1f312a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.655+0000 7ff1f312a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.655+0000 7ff1f312a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:37.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.655+0000 7ff1f312a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 2024-09-12T00:49:37.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.658+0000 7ff1f312a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:37.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.658+0000 7ff1f312a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:37.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.658+0000 7ff1f312a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:37.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.658+0000 7ff1f312a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29, ofs0, ns] 2024-09-12T00:49:37.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.659+0000 7ff0d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94219947587920 notifier 7053 bl.length()=999 2024-09-12T00:49:37.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.659+0000 7ff0d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:37.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.659+0000 7ff0d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:37.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.659+0000 7ff0d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:37.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.659+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_sources= new_sources= 2024-09-12T00:49:37.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.659+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential sources added=[] removed=[] 2024-09-12T00:49:37.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.659+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_dests= new_dests= 2024-09-12T00:49:37.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.659+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential dests added=[] removed=[] 2024-09-12T00:49:37.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.661+0000 7ff1f312a800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.1.0 2024-09-12T00:49:37.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.661+0000 7ff1f312a800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.1.0 2024-09-12T00:49:37.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.661+0000 7ff1f312a800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.1.1 2024-09-12T00:49:37.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.661+0000 7ff1f312a800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.1.1 2024-09-12T00:49:37.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.661+0000 7ff1f312a800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.0 2024-09-12T00:49:37.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.663+0000 7ff1f312a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:37.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.663+0000 7ff1f312a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 2024-09-12T00:49:37.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff1f312a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:37.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff1f312a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:37.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff1f312a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:37.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff1f312a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29, ofs0, ns] 2024-09-12T00:49:37.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff0d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94219947587920 notifier 7053 bl.length()=999 2024-09-12T00:49:37.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff0d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:37.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff0d1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:37.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff0d1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:37.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_sources= new_sources= 2024-09-12T00:49:37.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential sources added=[] removed=[] 2024-09-12T00:49:37.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_dests= new_dests= 2024-09-12T00:49:37.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.665+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential dests added=[] removed=[] 2024-09-12T00:49:37.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.666+0000 7ff1f312a800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.29.0 2024-09-12T00:49:37.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.667+0000 7ff1f312a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:37.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.667+0000 7ff1f312a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 2024-09-12T00:49:37.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff1f312a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:37.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff1f312a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:37.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff1f312a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:37.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff1f312a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29, ofs0, ns] 2024-09-12T00:49:37.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff0d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94219947587920 notifier 7053 bl.length()=967 2024-09-12T00:49:37.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff0d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 info.flags=0x17 2024-09-12T00:49:37.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff0d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.29 to cache LRU end 2024-09-12T00:49:37.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff0d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:37.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_sources= new_sources= 2024-09-12T00:49:37.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential sources added=[] removed=[] 2024-09-12T00:49:37.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): orig_dests= new_dests= 2024-09-12T00:49:37.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.668+0000 7ff1f312a800 20 handle_bi_update(): bucket=:error-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.29]): potential dests added=[] removed=[] 2024-09-12T00:49:37.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.669+0000 7ff1f312a800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:49:37.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.671+0000 7ff0a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:37.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.673+0000 7ff1f312a800 20 remove_watcher() i=0 2024-09-12T00:49:37.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.673+0000 7ff1f312a800 2 removed watcher, disabling cache 2024-09-12T00:49:37.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.675+0000 7ff1f312a800 20 remove_watcher() i=1 2024-09-12T00:49:37.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.675+0000 7ff1f312a800 20 remove_watcher() i=2 2024-09-12T00:49:37.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.676+0000 7ff1f312a800 20 remove_watcher() i=3 2024-09-12T00:49:37.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.677+0000 7ff1f312a800 20 remove_watcher() i=4 2024-09-12T00:49:37.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.678+0000 7ff1f312a800 20 remove_watcher() i=5 2024-09-12T00:49:37.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.679+0000 7ff1f312a800 20 remove_watcher() i=6 2024-09-12T00:49:37.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.680+0000 7ff1f312a800 20 remove_watcher() i=7 2024-09-12T00:49:37.692 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:49:37.721 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:37.721 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:37.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.757+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.759+0000 7f88b8a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.759+0000 7f88b8a13800 20 realm 2024-09-12T00:49:37.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.759+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.759+0000 7f88b8a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.759+0000 7f88b8a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:37.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.759+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.759+0000 7f88b8a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:37.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.760+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.961+0000 7f88b8a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:37.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.961+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:37.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.962+0000 7f88b8a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:37.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.962+0000 7f88b8a13800 20 searching for the correct realm 2024-09-12T00:49:37.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:37.965+0000 7f88abfff640 0 -- 172.21.15.83:0/1046423826 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f889c020950 msgr2=0x7f889c01f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:38.169 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.169+0000 7f88b4949640 0 -- 172.21.15.83:0/1046423826 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55bd8eafb340 msgr2=0x55bd8eafd790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:38.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.173+0000 7f88b8a13800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:38.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.173+0000 7f88b8a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:38.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.173+0000 7f88b8a13800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:38.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.173+0000 7f88b8a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:38.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.173+0000 7f88b8a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:38.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.173+0000 7f88b8a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:38.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.173+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:38.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:38.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:38.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 20 zone default found 2024-09-12T00:49:38.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 4 Realm: () 2024-09-12T00:49:38.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:38.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:38.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:38.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 20 zonegroup default 2024-09-12T00:49:38.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.174+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.175+0000 7f88b8a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:38.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.175+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.175+0000 7f88b8a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:38.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.175+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.176+0000 7f88b8a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:38.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.176+0000 7f88b8a13800 20 started sync module instance, tier type = 2024-09-12T00:49:38.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.176+0000 7f88b8a13800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:38.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.184+0000 7f88b8a13800 20 add_watcher() i=0 2024-09-12T00:49:38.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.184+0000 7f88b8a13800 20 add_watcher() i=1 2024-09-12T00:49:38.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.184+0000 7f88b8a13800 20 add_watcher() i=2 2024-09-12T00:49:38.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.184+0000 7f88b8a13800 20 add_watcher() i=3 2024-09-12T00:49:38.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.184+0000 7f88b8a13800 20 add_watcher() i=4 2024-09-12T00:49:38.184 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.184+0000 7f88b8a13800 20 add_watcher() i=5 2024-09-12T00:49:38.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.184+0000 7f88b8a13800 20 add_watcher() i=6 2024-09-12T00:49:38.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.185+0000 7f88b8a13800 20 add_watcher() i=7 2024-09-12T00:49:38.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.185+0000 7f88b8a13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:38.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.187+0000 7f876afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:38.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.187+0000 7f88b8a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:38.190 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.187+0000 7f88b8a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.187+0000 7f88b8a13800 5 note: GC not initialized 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.188+0000 7f8769fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.188+0000 7f88b8a13800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.188+0000 7f88b8a13800 20 Filter name: none 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.188+0000 7f86db7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.188+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.188+0000 7f88b8a13800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.188+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.189+0000 7f88b8a13800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.189+0000 7f88b8a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.189+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.189+0000 7f88b8a13800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.189+0000 7f88b8a13800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.190+0000 7f88b8a13800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:38.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.190+0000 7f88b8a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:38.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.191+0000 7f876afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:38.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.193+0000 7f88b8a13800 20 remove_watcher() i=0 2024-09-12T00:49:38.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.193+0000 7f88b8a13800 2 removed watcher, disabling cache 2024-09-12T00:49:38.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.194+0000 7f88b8a13800 20 remove_watcher() i=1 2024-09-12T00:49:38.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.195+0000 7f88b8a13800 20 remove_watcher() i=2 2024-09-12T00:49:38.196 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.197+0000 7f88b8a13800 20 remove_watcher() i=3 2024-09-12T00:49:38.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.198+0000 7f88b8a13800 20 remove_watcher() i=4 2024-09-12T00:49:38.198 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.199+0000 7f88b8a13800 20 remove_watcher() i=5 2024-09-12T00:49:38.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.200+0000 7f88b8a13800 20 remove_watcher() i=6 2024-09-12T00:49:38.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.200+0000 7f88b8a13800 20 remove_watcher() i=7 2024-09-12T00:49:38.210 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:38.210 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:38.210 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-block-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:49:38.210 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:38.212 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.212 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.215 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.215 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.259 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.259 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.272 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:49:38.273 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:38.274 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.274 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.283 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.283 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.326 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.326 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.334 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.334 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.342 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.342 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.351 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.351 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.359 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.359 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.367 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.367 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.375 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.375 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.383 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.383 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.390 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.391 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.398 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.398 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.406 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.406 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.414 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.414 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.421 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.421 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.430 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.430 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.438 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.438 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.445 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.445 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.453 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.453 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.461 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.461 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.469 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.469 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.477 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:38.477 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:38.485 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:49:38.514 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:38.514 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:38.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.550+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.552+0000 7ff0e361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:38.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.552+0000 7ff0e361d800 20 realm 2024-09-12T00:49:38.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.552+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.553+0000 7ff0e361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:38.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.553+0000 7ff0e361d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:38.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.553+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.553+0000 7ff0e361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:38.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.553+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.554+0000 7ff0e361d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:38.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.554+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:38.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.554+0000 7ff0e361d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:38.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.554+0000 7ff0e361d800 20 searching for the correct realm 2024-09-12T00:49:38.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.556+0000 7ff0dedeb640 0 -- 172.21.15.83:0/3093166601 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7ff0d001e060 msgr2=0x7ff0d008a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:38.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:38.761+0000 7ff0dedeb640 0 -- 172.21.15.83:0/3093166601 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff0d80b39c0 msgr2=0x7ff0d80b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:39.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.370+0000 7ff0e361d800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:39.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.370+0000 7ff0e361d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:39.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.370+0000 7ff0e361d800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:39.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.370+0000 7ff0e361d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:39.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.370+0000 7ff0e361d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:39.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.370+0000 7ff0e361d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:39.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.370+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.370+0000 7ff0e361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.370+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 20 zone default found 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 4 Realm: () 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 20 zonegroup default 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.371+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.372+0000 7ff0e361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.372+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.372+0000 7ff0e361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.372+0000 7ff0e361d800 20 started sync module instance, tier type = 2024-09-12T00:49:39.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.372+0000 7ff0e361d800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:39.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.381+0000 7ff0e361d800 20 add_watcher() i=0 2024-09-12T00:49:39.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.381+0000 7ff0e361d800 20 add_watcher() i=1 2024-09-12T00:49:39.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.381+0000 7ff0e361d800 20 add_watcher() i=2 2024-09-12T00:49:39.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.381+0000 7ff0e361d800 20 add_watcher() i=3 2024-09-12T00:49:39.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.381+0000 7ff0e361d800 20 add_watcher() i=4 2024-09-12T00:49:39.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.381+0000 7ff0e361d800 20 add_watcher() i=5 2024-09-12T00:49:39.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.381+0000 7ff0e361d800 20 add_watcher() i=6 2024-09-12T00:49:39.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.382+0000 7ff0e361d800 20 add_watcher() i=7 2024-09-12T00:49:39.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.382+0000 7ff0e361d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:39.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.385+0000 7fef957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:39.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.385+0000 7ff0e361d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:39.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.385+0000 7ff0e361d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:39.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.385+0000 7ff0e361d800 5 note: GC not initialized 2024-09-12T00:49:39.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.385+0000 7fef0ffff640 20 reqs_thread_entry: start 2024-09-12T00:49:39.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.385+0000 7ff0e361d800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:39.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.385+0000 7ff0e361d800 20 Filter name: none 2024-09-12T00:49:39.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.385+0000 7fef0dffb640 20 reqs_thread_entry: start 2024-09-12T00:49:39.385 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.385+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.386+0000 7ff0e361d800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:39.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.386+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.387+0000 7ff0e361d800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:39.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.387+0000 7ff0e361d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:39.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.387+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.387+0000 7ff0e361d800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:39.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.387+0000 7ff0e361d800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.388+0000 7ff0e361d800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:39.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.388+0000 7ff0e361d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:39.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.389+0000 7fef957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:39.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.391+0000 7ff0e361d800 20 remove_watcher() i=0 2024-09-12T00:49:39.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.391+0000 7ff0e361d800 2 removed watcher, disabling cache 2024-09-12T00:49:39.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.392+0000 7ff0e361d800 20 remove_watcher() i=1 2024-09-12T00:49:39.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.393+0000 7ff0e361d800 20 remove_watcher() i=2 2024-09-12T00:49:39.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.394+0000 7ff0e361d800 20 remove_watcher() i=3 2024-09-12T00:49:39.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.395+0000 7ff0e361d800 20 remove_watcher() i=4 2024-09-12T00:49:39.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.396+0000 7ff0e361d800 20 remove_watcher() i=5 2024-09-12T00:49:39.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.397+0000 7ff0e361d800 20 remove_watcher() i=6 2024-09-12T00:49:39.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.398+0000 7ff0e361d800 20 remove_watcher() i=7 2024-09-12T00:49:39.408 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.408 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:39.408 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-block-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:39.408 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.410 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:49:39.444 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:39.444 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:39.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.481+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.483+0000 7fcb18925800 20 realm 2024-09-12T00:49:39.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.483+0000 7fcb18925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:39.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.485+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:39.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.485+0000 7fcb18925800 20 searching for the correct realm 2024-09-12T00:49:39.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.486+0000 7fcb14d34640 0 -- 172.21.15.83:0/2239620198 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7fcb0806dbc0 msgr2=0x7fcb08088400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:39.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.489+0000 7fcb14d34640 0 -- 172.21.15.83:0/2239620198 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f376b9cde0 msgr2=0x55f376b9f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:39.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:39.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:39.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:39.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:39.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:39.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:39.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.494+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:39.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 zone default found 2024-09-12T00:49:39.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 4 Realm: () 2024-09-12T00:49:39.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:39.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:39.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:39.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 zonegroup default 2024-09-12T00:49:39.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.496+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.496+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.496+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.496+0000 7fcb18925800 20 started sync module instance, tier type = 2024-09-12T00:49:39.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.496+0000 7fcb18925800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:39.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=0 2024-09-12T00:49:39.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=1 2024-09-12T00:49:39.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=2 2024-09-12T00:49:39.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=3 2024-09-12T00:49:39.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=4 2024-09-12T00:49:39.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=5 2024-09-12T00:49:39.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=6 2024-09-12T00:49:39.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.505+0000 7fcb18925800 20 add_watcher() i=7 2024-09-12T00:49:39.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.505+0000 7fcb18925800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:39.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.507+0000 7fc9cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:39.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.507+0000 7fcb18925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:39.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.507+0000 7fcb18925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:39.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.507+0000 7fcb18925800 5 note: GC not initialized 2024-09-12T00:49:39.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.507+0000 7fc9c9fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:39.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.507+0000 7fcb18925800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:39.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.507+0000 7fcb18925800 20 Filter name: none 2024-09-12T00:49:39.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.507+0000 7fc93b7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:39.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:49:39.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : miss 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.508+0000 7fcb18925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:49:39.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.512+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.512+0000 7fcb18925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.512+0000 7fcb18925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.512+0000 7fcb18925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30, ofs0, ns] 2024-09-12T00:49:39.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464374 cookie 94504157354320 notifier 6704 bl.length()=999 2024-09-12T00:49:39.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_sources= new_sources= 2024-09-12T00:49:39.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential sources added=[] removed=[] 2024-09-12T00:49:39.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_dests= new_dests= 2024-09-12T00:49:39.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential dests added=[] removed=[] 2024-09-12T00:49:39.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.515+0000 7fcb18925800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.0 2024-09-12T00:49:39.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.515+0000 7fcb18925800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.0 2024-09-12T00:49:39.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.515+0000 7fcb18925800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.1 2024-09-12T00:49:39.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.515+0000 7fcb18925800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.1 2024-09-12T00:49:39.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.515+0000 7fcb18925800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.0 2024-09-12T00:49:39.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.518+0000 7fcb18925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:39.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.518+0000 7fcb18925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:49:39.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.519+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.519+0000 7fcb18925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.519+0000 7fcb18925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.519+0000 7fcb18925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30, ofs0, ns] 2024-09-12T00:49:39.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 94504157354320 notifier 6704 bl.length()=999 2024-09-12T00:49:39.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_sources= new_sources= 2024-09-12T00:49:39.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential sources added=[] removed=[] 2024-09-12T00:49:39.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_dests= new_dests= 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb18925800 time 2024-09-12T00:49:39.522174+0000 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential dests added=[] removed=[] 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb19f8c71a] 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb19f8c8d8] 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3751c7641] 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55f3751d6582] 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f3751d73e4] 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcb18c29590] 2024-09-12T00:49:39.521 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.521+0000 7fcb18925800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb18925800 time 2024-09-12T00:49:39.522174+0000 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb19f8c71a] 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb19f8c8d8] 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3751c7641] 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55f3751d6582] 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f3751d73e4] 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcb18c29590] 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:49:39.522 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:49:39.523 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.523 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:49:39.523 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fcb18925800 thread_name:radosgw-admin 2024-09-12T00:49:39.538 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:39.538 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb18c3e6f0] 2024-09-12T00:49:39.538 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb18c8b99c] 2024-09-12T00:49:39.538 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:49:39.538 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:49:39.538 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb19f8c774] 2024-09-12T00:49:39.538 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb19f8c8d8] 2024-09-12T00:49:39.538 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3751c7641] 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55f3751d6582] 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f3751d73e4] 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcb18c29590] 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.522+0000 7fcb18925800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fcb18925800 thread_name:radosgw-admin 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb18c3e6f0] 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb18c8b99c] 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:49:39.539 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb19f8c774] 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb19f8c8d8] 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3751c7641] 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55f3751d6582] 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f3751d73e4] 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcb18c29590] 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.540 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:49:39.466+0000 7fcb18925800 1 librados: starting msgr at 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:49:39.466+0000 7fcb18925800 1 librados: starting objecter 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 asok(0x55f376891630) register_command objecter_requests hook 0x55f376ab36f0 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:49:39.466+0000 7fcb18925800 1 librados: setting wanted keys 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:49:39.466+0000 7fcb18925800 1 librados: calling monclient init 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:49:39.466+0000 7fcb18925800 10 monclient: init 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding auth protocol: cephx 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding auth protocol: cephx 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding auth protocol: cephx 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.541 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:49:39.466+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:49:39.467+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:49:39.467+0000 7fcb18925800 5 asok(0x55f376891630) register_command rotate-key hook 0x55f376ab09b8 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:39.542 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-c con 0x55f376ab3da0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-b con 0x55f376ae27c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-a con 0x7fcafc0030f0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): authenticate will time out at 1932.737266s 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): get_auth_request con 0x7fcafc0030f0 auth_method 0 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): get_auth_request con 0x55f376ab3da0 auth_method 0 2024-09-12T00:49:39.543 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): get_auth_request con 0x55f376ae27c0 auth_method 0 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.544 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): handle_auth_done global_id 7098 payload 824 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient: _finish_hunting 0 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:49:39.467+0000 7fcb14d34640 1 monclient: found mon.noname-a 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: dump: 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.545 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: _finish_auth 0 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: _check_auth_tickets 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:49:39.467+0000 7fcb18925800 5 monclient: authenticate success, global_id 7098 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.546 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: dump: 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:49:39.467+0000 7fca0260c640 4 set_mon_vals no callback set 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.547 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:49:39.467+0000 7fcb18925800 1 librados: init done 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:49:39.469+0000 7fca00e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:49:39.469+0000 7fca00e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:49:39.469+0000 7fca00e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:49:39.469+0000 7fcb14533640 10 monclient: get_auth_request con 0x7fc9fc076470 auth_method 0 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:49:39.470+0000 7fcb13d32640 10 monclient: get_auth_request con 0x55f376add140 auth_method 0 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:49:39.471+0000 7fcb14533640 10 monclient: get_auth_request con 0x55f376afdd10 auth_method 0 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:49:39.472+0000 7fcb13d32640 10 monclient: get_auth_request con 0x55f376b01570 auth_method 0 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:49:39.472+0000 7fcb18925800 10 monclient: build_initial_monmap 2024-09-12T00:49:39.548 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:49:39.472+0000 7fcb18925800 1 build_initial for_mkfs: 0 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:49:39.472+0000 7fcb18925800 10 monclient: monmap: 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding auth protocol: cephx 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding auth protocol: cephx 2024-09-12T00:49:39.549 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding auth protocol: cephx 2024-09-12T00:49:39.550 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.550 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.550 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.550 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.550 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.550 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.550 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.550 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.550 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:49:39.473+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 asok(0x55f376891630) register_command objecter_requests cmddesc objecter_requests hook 0x55f376b0a2a0 EEXIST 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient: init 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding auth protocol: cephx 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding auth protocol: cephx 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding auth protocol: cephx 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.551 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:49:39.473+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:49:39.473+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 asok(0x55f376891630) register_command rotate-key cmddesc rotate-key hook 0x55f376b05f40 EEXIST 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:39.552 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-a con 0x55f376b2e5c0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-c con 0x55f376b2e9a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-b con 0x55f376b2d2d0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): authenticate will time out at 1932.743992s 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): get_auth_request con 0x55f376b2e9a0 auth_method 0 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): get_auth_request con 0x55f376b2e5c0 auth_method 0 2024-09-12T00:49:39.553 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): get_auth_request con 0x55f376b2d2d0 auth_method 0 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.554 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): handle_auth_done global_id 7101 payload 824 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient: _finish_hunting 0 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:49:39.474+0000 7fcb14533640 1 monclient: found mon.noname-a 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: dump: 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.555 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: dump: 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.556 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:49:39.474+0000 7fcb18925800 5 monclient: authenticate success, global_id 7101 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:49:39.474+0000 7fcb15535640 4 set_mon_vals no callback set 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:49:39.474+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:49:39.474+0000 7fcb18925800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:49:39.474+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:49:39.474+0000 7fcb18925800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:49:39.476+0000 7fc9f9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:39.557 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:49:39.476+0000 7fc9f9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:49:39.476+0000 7fc9f9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:49:39.476+0000 7fcb13d32640 10 monclient: get_auth_request con 0x7fc9ec076380 auth_method 0 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:49:39.476+0000 7fcb18925800 10 monclient: get_monmap_and_config 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:49:39.476+0000 7fcb18925800 10 monclient: build_initial_monmap 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:49:39.476+0000 7fcb18925800 1 build_initial for_mkfs: 0 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:49:39.476+0000 7fcb18925800 10 monclient: monmap: 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:39.558 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding auth protocol: cephx 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding auth protocol: cephx 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding auth protocol: cephx 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.559 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:49:39.477+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient: init 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding auth protocol: cephx 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding auth protocol: cephx 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding auth protocol: cephx 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.560 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:49:39.477+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:49:39.477+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 asok(0x55f376891630) register_command rotate-key cmddesc rotate-key hook 0x7ffd3ff60d78 EEXIST 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:49:39.561 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-a con 0x55f376b82ac0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-b con 0x55f376b53ad0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-c con 0x55f376b7dfa0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): authenticate will time out at 1932.747705s 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): get_auth_request con 0x55f376b82ac0 auth_method 0 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): get_auth_request con 0x55f376b7dfa0 auth_method 0 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.562 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:49:39.477+0000 7fcb13d32640 10 monclient(hunting): get_auth_request con 0x55f376b53ad0 auth_method 0 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:49:39.477+0000 7fcb13d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:49:39.477+0000 7fcb13d32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:49:39.477+0000 7fcb13d32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): handle_auth_done global_id 7104 payload 274 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:49:39.478+0000 7fcb14533640 10 monclient: _finish_hunting 0 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:49:39.478+0000 7fcb14533640 1 monclient: found mon.noname-a 2024-09-12T00:49:39.563 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:49:39.478+0000 7fcb14533640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: dump: 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.564 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: _finish_auth 0 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: dump: 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.565 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:49:39.478+0000 7fcb18925800 5 monclient: authenticate success, global_id 7104 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:49:39.478+0000 7fcb18925800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:49:39.478+0000 7fcb18925800 4 set_mon_vals no callback set 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:49:39.478+0000 7fcb18925800 10 monclient: shutdown 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:49:39.478+0000 7fcb18925800 10 monclient: build_initial_monmap 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:49:39.478+0000 7fcb18925800 1 build_initial for_mkfs: 0 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:49:39.478+0000 7fcb18925800 10 monclient: monmap: 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:39.566 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding auth protocol: cephx 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding auth protocol: cephx 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding auth protocol: cephx 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.567 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:49:39.479+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:49:39.479+0000 7fcb18925800 1 librados: starting msgr at 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:49:39.479+0000 7fcb18925800 1 librados: starting objecter 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 asok(0x55f376891630) register_command objecter_requests cmddesc objecter_requests hook 0x55f376b79050 EEXIST 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:49:39.479+0000 7fcb18925800 1 librados: setting wanted keys 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:49:39.479+0000 7fcb18925800 1 librados: calling monclient init 2024-09-12T00:49:39.568 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient: init 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding auth protocol: cephx 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding auth protocol: cephx 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding auth protocol: cephx 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.569 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:49:39.479+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:49:39.479+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 asok(0x55f376891630) register_command rotate-key cmddesc rotate-key hook 0x55f376b42fc8 EEXIST 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-c con 0x55f376b53ad0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-a con 0x55f376b7dfa0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-b con 0x55f376b82ac0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:39.570 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): authenticate will time out at 1932.749924s 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): get_auth_request con 0x55f376b53ad0 auth_method 0 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): get_auth_request con 0x55f376b7dfa0 auth_method 0 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): get_auth_request con 0x55f376b82ac0 auth_method 0 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.571 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient: _finish_hunting 0 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:49:39.480+0000 7fcb14533640 1 monclient: found mon.noname-c 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:39.572 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: dump: 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:39.573 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: dump: 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:49:39.480+0000 7fcb18925800 5 monclient: authenticate success, global_id 6704 2024-09-12T00:49:39.574 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:49:39.480+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:49:39.480+0000 7fcb18925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:49:39.480+0000 7fc9eb7fe640 4 set_mon_vals no callback set 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:49:39.480+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:49:39.480+0000 7fcb18925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:49:39.480+0000 7fcb18925800 1 librados: init done 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:49:39.480+0000 7fcb18925800 5 asok(0x55f376891630) register_command cr dump hook 0x55f376b82eb8 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:49:39.481+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:49:39.482+0000 7fc9e9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:49:39.482+0000 7fc9e9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:49:39.482+0000 7fc9e9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:49:39.482+0000 7fcb13d32640 10 monclient: get_auth_request con 0x7fc9dc076470 auth_method 0 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:49:39.483+0000 7fcb14d34640 10 monclient: get_auth_request con 0x55f376b9cde0 auth_method 0 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.575 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 realm 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:49:39.483+0000 7fcb18925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:49:39.484+0000 7fcb14533640 10 monclient: get_auth_request con 0x55f376ba1010 auth_method 0 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:49:39.485+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:49:39.485+0000 7fcb18925800 20 searching for the correct realm 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:49:39.485+0000 7fcb13d32640 10 monclient: get_auth_request con 0x55f376ba6290 auth_method 0 2024-09-12T00:49:39.576 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:49:39.485+0000 7fcb14d34640 10 monclient: get_auth_request con 0x7fcb0806dbc0 auth_method 0 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:49:39.486+0000 7fcb14d34640 0 -- 172.21.15.83:0/2239620198 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7fcb0806dbc0 msgr2=0x7fcb08088400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:49:39.486+0000 7fc9e9ffb640 1 client.6704.objecter ms_handle_reset 0x7fcb0806dbc0 session 0x7fcb08080040 osd.2 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:49:39.486+0000 7fc9e9ffb640 10 monclient: _renew_subs 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:49:39.486+0000 7fc9e9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:49:39.486+0000 7fcb14d34640 10 monclient: get_auth_request con 0x7fc9dc086790 auth_method 0 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:49:39.487+0000 7fcb14533640 10 monclient: get_auth_request con 0x7fcafc002520 auth_method 0 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:49:39.488+0000 7fcb13d32640 10 monclient: get_auth_request con 0x7fcb08088910 auth_method 0 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:49:39.489+0000 7fcb14d34640 0 -- 172.21.15.83:0/2239620198 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f376b9cde0 msgr2=0x55f376b9f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:49:39.489+0000 7fc9e9ffb640 1 client.6704.objecter ms_handle_reset 0x55f376b9cde0 session 0x55f376b9c710 osd.6 2024-09-12T00:49:39.577 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:49:39.489+0000 7fcb14d34640 10 monclient: get_auth_request con 0x7fcb0806dbc0 auth_method 0 2024-09-12T00:49:39.580 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:49:39.490+0000 7fcb14d34640 10 monclient: get_auth_request con 0x7fcb04084900 auth_method 0 2024-09-12T00:49:39.580 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:49:39.490+0000 7fcb14533640 10 monclient: get_auth_request con 0x7fcb0c021060 auth_method 0 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.581 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 zone default found 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:49:39.495+0000 7fcb18925800 4 Realm: () 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:49:39.495+0000 7fcb18925800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:49:39.495+0000 7fcb18925800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:49:39.495+0000 7fcb18925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 zonegroup default 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 started sync module instance, tier type = 2024-09-12T00:49:39.582 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=0 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=1 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=2 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=3 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=4 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=5 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=6 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:49:39.505+0000 7fcb18925800 20 add_watcher() i=7 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:49:39.505+0000 7fcb18925800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding auth protocol: cephx 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding auth protocol: cephx 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding auth protocol: cephx 2024-09-12T00:49:39.583 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:49:39.507+0000 7fc9cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.584 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:49:39.507+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:49:39.507+0000 7fcb18925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:49:39.507+0000 7fcb18925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command cache list hook 0x55f376b791c0 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command cache inspect hook 0x55f376b791c0 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command cache erase hook 0x55f376b791c0 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command cache zap hook 0x55f376b791c0 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 note: GC not initialized 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:49:39.507+0000 7fc9c9fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command sync trace show hook 0x7fcb0c00e070 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command sync trace history hook 0x7fcb0c00e070 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command sync trace active hook 0x7fcb0c00e070 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command sync trace active_short hook 0x7fcb0c00e070 2024-09-12T00:49:39.585 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:49:39.507+0000 7fcb18925800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:49:39.507+0000 7fcb18925800 20 Filter name: none 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:49:39.507+0000 7fc93b7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : miss 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:39.586 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:49:39.512+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:49:39.512+0000 7fcb18925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:49:39.512+0000 7fcb18925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:49:39.512+0000 7fcb18925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30, ofs0, ns] 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464374 cookie 94504157354320 notifier 6704 bl.length()=999 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_sources= new_sources= 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential sources added=[] removed=[] 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_dests= new_dests= 2024-09-12T00:49:39.587 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential dests added=[] removed=[] 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:49:39.515+0000 7fcb18925800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.0 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:49:39.515+0000 7fcb18925800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.0 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:49:39.515+0000 7fcb18925800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.1 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:49:39.515+0000 7fcb18925800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.1 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:49:39.515+0000 7fcb18925800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.0 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:49:39.518+0000 7fcb18925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:49:39.518+0000 7fcb18925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:49:39.519+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:49:39.519+0000 7fcb18925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:49:39.519+0000 7fcb18925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:49:39.519+0000 7fcb18925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30, ofs0, ns] 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 94504157354320 notifier 6704 bl.length()=999 2024-09-12T00:49:39.588 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_sources= new_sources= 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential sources added=[] removed=[] 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_dests= new_dests= 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential dests added=[] removed=[] 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:49:39.521+0000 7fcb18925800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb18925800 time 2024-09-12T00:49:39.522174+0000 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb19f8c71a] 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb19f8c8d8] 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3751c7641] 2024-09-12T00:49:39.589 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55f3751d6582] 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f3751d73e4] 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcb18c29590] 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:49:39.522+0000 7fcb18925800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fcb18925800 thread_name:radosgw-admin 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb18c3e6f0] 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb18c8b99c] 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:49:39.590 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb19f8c774] 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb19f8c8d8] 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3751c7641] 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55f3751d6582] 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f3751d73e4] 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcb18c29590] 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:49:39.591 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:49:39.592 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:49:39.593 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:49:39.594 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:49:39.595 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:49:39.596 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:49:39.597 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc93b7fe640 / http_manager 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9c9fdb640 / http_manager 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9cafdd640 / rgw_dt_lg_renew 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9e9ffb640 / ms_dispatch 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9eb7fe640 / io_context_pool 2024-09-12T00:49:39.598 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9f9ffb640 / ms_dispatch 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: 7fca00e09640 / ms_dispatch 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: 7fca0260c640 / io_context_pool 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb13d32640 / msgr-worker-2 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb14533640 / msgr-worker-1 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb14d34640 / msgr-worker-0 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb15535640 / io_context_pool 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb18925800 / radosgw-admin 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.114862.log 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:49:39.466+0000 7fcb18925800 1 librados: starting msgr at 2024-09-12T00:49:39.599 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:49:39.466+0000 7fcb18925800 1 librados: starting objecter 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 asok(0x55f376891630) register_command objecter_requests hook 0x55f376ab36f0 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:49:39.466+0000 7fcb18925800 1 librados: setting wanted keys 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:49:39.466+0000 7fcb18925800 1 librados: calling monclient init 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:49:39.466+0000 7fcb18925800 10 monclient: init 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding auth protocol: cephx 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding auth protocol: cephx 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding auth protocol: cephx 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.600 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.601 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.601 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.601 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.601 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: crc 2024-09-12T00:49:39.601 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:49:39.466+0000 7fcb18925800 5 AuthRegistry(0x55f376ab0870) adding con mode: secure 2024-09-12T00:49:39.601 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:49:39.466+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.601 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:49:39.467+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.601 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:49:39.467+0000 7fcb18925800 5 asok(0x55f376891630) register_command rotate-key hook 0x55f376ab09b8 2024-09-12T00:49:39.601 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-c con 0x55f376ab3da0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-b con 0x55f376ae27c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-a con 0x7fcafc0030f0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient(hunting): authenticate will time out at 1932.737266s 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): get_auth_request con 0x7fcafc0030f0 auth_method 0 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.602 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): get_auth_request con 0x55f376ab3da0 auth_method 0 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): get_auth_request con 0x55f376ae27c0 auth_method 0 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.603 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:49:39.467+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:49:39.467+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient(hunting): handle_auth_done global_id 7098 payload 824 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient: _finish_hunting 0 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:49:39.467+0000 7fcb14d34640 1 monclient: found mon.noname-a 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:49:39.467+0000 7fcb14d34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: dump: 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.604 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: _finish_auth 0 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: _check_auth_tickets 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:49:39.467+0000 7fcb18925800 5 monclient: authenticate success, global_id 7098 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.605 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:49:39.467+0000 7fca00e09640 10 monclient: dump: 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.606 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:49:39.467+0000 7fca0260c640 4 set_mon_vals no callback set 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:49:39.467+0000 7fcb18925800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:49:39.467+0000 7fcb18925800 1 librados: init done 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:49:39.469+0000 7fca00e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:49:39.469+0000 7fca00e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:49:39.469+0000 7fca00e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:49:39.469+0000 7fcb14533640 10 monclient: get_auth_request con 0x7fc9fc076470 auth_method 0 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:49:39.470+0000 7fcb13d32640 10 monclient: get_auth_request con 0x55f376add140 auth_method 0 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:49:39.471+0000 7fcb14533640 10 monclient: get_auth_request con 0x55f376afdd10 auth_method 0 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:49:39.472+0000 7fcb13d32640 10 monclient: get_auth_request con 0x55f376b01570 auth_method 0 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:49:39.472+0000 7fcb18925800 10 monclient: build_initial_monmap 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:49:39.472+0000 7fcb18925800 1 build_initial for_mkfs: 0 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:49:39.472+0000 7fcb18925800 10 monclient: monmap: 2024-09-12T00:49:39.607 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding auth protocol: cephx 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding auth protocol: cephx 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding auth protocol: cephx 2024-09-12T00:49:39.608 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: crc 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:49:39.472+0000 7fcb18925800 5 AuthRegistry(0x55f376b06db0) adding con mode: secure 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:49:39.473+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 asok(0x55f376891630) register_command objecter_requests cmddesc objecter_requests hook 0x55f376b0a2a0 EEXIST 2024-09-12T00:49:39.609 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient: init 2024-09-12T00:49:39.610 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding auth protocol: cephx 2024-09-12T00:49:39.610 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding auth protocol: cephx 2024-09-12T00:49:39.610 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding auth protocol: cephx 2024-09-12T00:49:39.610 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.610 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.610 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.610 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.610 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.610 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: crc 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 AuthRegistry(0x55f376b05df8) adding con mode: secure 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:49:39.473+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:49:39.473+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:49:39.473+0000 7fcb18925800 5 asok(0x55f376891630) register_command rotate-key cmddesc rotate-key hook 0x55f376b05f40 EEXIST 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-a con 0x55f376b2e5c0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-c con 0x55f376b2e9a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:39.611 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-b con 0x55f376b2d2d0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:49:39.473+0000 7fcb18925800 10 monclient(hunting): authenticate will time out at 1932.743992s 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): get_auth_request con 0x55f376b2e9a0 auth_method 0 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): get_auth_request con 0x55f376b2e5c0 auth_method 0 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.612 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): get_auth_request con 0x55f376b2d2d0 auth_method 0 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:49:39.474+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:49:39.474+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.613 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient(hunting): handle_auth_done global_id 7101 payload 824 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient: _finish_hunting 0 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:49:39.474+0000 7fcb14533640 1 monclient: found mon.noname-a 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:49:39.474+0000 7fcb14533640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: dump: 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.614 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:49:39.474+0000 7fc9f9ffb640 10 monclient: dump: 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.615 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:49:39.474+0000 7fcb18925800 5 monclient: authenticate success, global_id 7101 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:49:39.474+0000 7fcb15535640 4 set_mon_vals no callback set 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:49:39.474+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:49:39.474+0000 7fcb18925800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:49:39.474+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:49:39.474+0000 7fcb18925800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:49:39.476+0000 7fc9f9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:49:39.476+0000 7fc9f9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:49:39.476+0000 7fc9f9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.616 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:49:39.476+0000 7fcb13d32640 10 monclient: get_auth_request con 0x7fc9ec076380 auth_method 0 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:49:39.476+0000 7fcb18925800 10 monclient: get_monmap_and_config 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:49:39.476+0000 7fcb18925800 10 monclient: build_initial_monmap 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:49:39.476+0000 7fcb18925800 1 build_initial for_mkfs: 0 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:49:39.476+0000 7fcb18925800 10 monclient: monmap: 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:39.617 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding auth protocol: cephx 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding auth protocol: cephx 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding auth protocol: cephx 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.618 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: crc 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:49:39.476+0000 7fcb18925800 5 AuthRegistry(0x55f376b4e480) adding con mode: secure 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:49:39.477+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient: init 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding auth protocol: cephx 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding auth protocol: cephx 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding auth protocol: cephx 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.619 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: crc 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff60c30) adding con mode: secure 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:49:39.477+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:49:39.477+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:49:39.477+0000 7fcb18925800 5 asok(0x55f376891630) register_command rotate-key cmddesc rotate-key hook 0x7ffd3ff60d78 EEXIST 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-a con 0x55f376b82ac0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:39.620 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-b con 0x55f376b53ad0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-c con 0x55f376b7dfa0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:49:39.477+0000 7fcb18925800 10 monclient(hunting): authenticate will time out at 1932.747705s 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): get_auth_request con 0x55f376b82ac0 auth_method 0 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): get_auth_request con 0x55f376b7dfa0 auth_method 0 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.621 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:49:39.477+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:49:39.477+0000 7fcb13d32640 10 monclient(hunting): get_auth_request con 0x55f376b53ad0 auth_method 0 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:49:39.477+0000 7fcb13d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:49:39.477+0000 7fcb13d32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:49:39.477+0000 7fcb13d32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:49:39.477+0000 7fcb14533640 10 monclient(hunting): handle_auth_done global_id 7104 payload 274 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:49:39.478+0000 7fcb14533640 10 monclient: _finish_hunting 0 2024-09-12T00:49:39.622 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:49:39.478+0000 7fcb14533640 1 monclient: found mon.noname-a 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:49:39.478+0000 7fcb14533640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: dump: 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.623 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: _finish_auth 0 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:49:39.478+0000 7fc9eb7fe640 10 monclient: dump: 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.624 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:49:39.478+0000 7fcb18925800 5 monclient: authenticate success, global_id 7104 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:49:39.478+0000 7fcb18925800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:49:39.478+0000 7fcb18925800 4 set_mon_vals no callback set 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:49:39.478+0000 7fcb18925800 10 monclient: shutdown 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:49:39.478+0000 7fcb18925800 10 monclient: build_initial_monmap 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:49:39.478+0000 7fcb18925800 1 build_initial for_mkfs: 0 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:49:39.478+0000 7fcb18925800 10 monclient: monmap: 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:39.625 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding auth protocol: cephx 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding auth protocol: cephx 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding auth protocol: cephx 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.626 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: crc 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b746f0) adding con mode: secure 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:49:39.479+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:49:39.479+0000 7fcb18925800 1 librados: starting msgr at 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:49:39.479+0000 7fcb18925800 1 librados: starting objecter 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 asok(0x55f376891630) register_command objecter_requests cmddesc objecter_requests hook 0x55f376b79050 EEXIST 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:49:39.479+0000 7fcb18925800 1 librados: setting wanted keys 2024-09-12T00:49:39.627 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:49:39.479+0000 7fcb18925800 1 librados: calling monclient init 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient: init 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding auth protocol: cephx 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding auth protocol: cephx 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding auth protocol: cephx 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.628 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: crc 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 AuthRegistry(0x55f376b42e80) adding con mode: secure 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:49:39.479+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:49:39.479+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:49:39.479+0000 7fcb18925800 5 asok(0x55f376891630) register_command rotate-key cmddesc rotate-key hook 0x55f376b42fc8 EEXIST 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-c con 0x55f376b53ad0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-a con 0x55f376b7dfa0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): picked mon.noname-b con 0x55f376b82ac0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:39.629 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:49:39.479+0000 7fcb18925800 10 monclient(hunting): authenticate will time out at 1932.749924s 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): get_auth_request con 0x55f376b53ad0 auth_method 0 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): get_auth_request con 0x55f376b7dfa0 auth_method 0 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): get_auth_request con 0x55f376b82ac0 auth_method 0 2024-09-12T00:49:39.630 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:49:39.480+0000 7fcb13d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:49:39.480+0000 7fcb14d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient: _finish_hunting 0 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:49:39.480+0000 7fcb14533640 1 monclient: found mon.noname-c 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:49:39.480+0000 7fcb14533640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.631 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: dump: 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:49:39.632 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:49:39.480+0000 7fc9e9ffb640 10 monclient: dump: 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:49:39.633 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:49:39.480+0000 7fcb18925800 5 monclient: authenticate success, global_id 6704 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:49:39.480+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:49:39.480+0000 7fcb18925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:49:39.480+0000 7fc9eb7fe640 4 set_mon_vals no callback set 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:49:39.480+0000 7fcb18925800 10 monclient: _renew_subs 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:49:39.480+0000 7fcb18925800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:49:39.480+0000 7fcb18925800 1 librados: init done 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:49:39.480+0000 7fcb18925800 5 asok(0x55f376891630) register_command cr dump hook 0x55f376b82eb8 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:49:39.481+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:49:39.482+0000 7fc9e9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:49:39.482+0000 7fc9e9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:49:39.482+0000 7fc9e9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:49:39.634 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:49:39.482+0000 7fcb13d32640 10 monclient: get_auth_request con 0x7fc9dc076470 auth_method 0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:49:39.483+0000 7fcb14d34640 10 monclient: get_auth_request con 0x55f376b9cde0 auth_method 0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 realm 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:49:39.483+0000 7fcb18925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:49:39.483+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:49:39.484+0000 7fcb14533640 10 monclient: get_auth_request con 0x55f376ba1010 auth_method 0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:49:39.484+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.635 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:49:39.485+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:49:39.485+0000 7fcb18925800 20 searching for the correct realm 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:49:39.485+0000 7fcb13d32640 10 monclient: get_auth_request con 0x55f376ba6290 auth_method 0 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:49:39.485+0000 7fcb14d34640 10 monclient: get_auth_request con 0x7fcb0806dbc0 auth_method 0 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:49:39.486+0000 7fcb14d34640 0 -- 172.21.15.83:0/2239620198 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7fcb0806dbc0 msgr2=0x7fcb08088400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:49:39.486+0000 7fc9e9ffb640 1 client.6704.objecter ms_handle_reset 0x7fcb0806dbc0 session 0x7fcb08080040 osd.2 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:49:39.486+0000 7fc9e9ffb640 10 monclient: _renew_subs 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:49:39.486+0000 7fc9e9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:49:39.486+0000 7fcb14d34640 10 monclient: get_auth_request con 0x7fc9dc086790 auth_method 0 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:49:39.487+0000 7fcb14533640 10 monclient: get_auth_request con 0x7fcafc002520 auth_method 0 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:49:39.488+0000 7fcb13d32640 10 monclient: get_auth_request con 0x7fcb08088910 auth_method 0 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:49:39.489+0000 7fcb14d34640 0 -- 172.21.15.83:0/2239620198 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f376b9cde0 msgr2=0x55f376b9f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:49:39.489+0000 7fc9e9ffb640 1 client.6704.objecter ms_handle_reset 0x55f376b9cde0 session 0x55f376b9c710 osd.6 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:49:39.489+0000 7fcb14d34640 10 monclient: get_auth_request con 0x7fcb0806dbc0 auth_method 0 2024-09-12T00:49:39.636 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:49:39.490+0000 7fcb14d34640 10 monclient: get_auth_request con 0x7fcb04084900 auth_method 0 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:49:39.490+0000 7fcb14533640 10 monclient: get_auth_request con 0x7fcb0c021060 auth_method 0 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:49:39.494+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.637 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 zone default found 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:49:39.495+0000 7fcb18925800 4 Realm: () 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:49:39.495+0000 7fcb18925800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:49:39.495+0000 7fcb18925800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:49:39.495+0000 7fcb18925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 zonegroup default 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:49:39.495+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 started sync module instance, tier type = 2024-09-12T00:49:39.638 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:49:39.496+0000 7fcb18925800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=0 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=1 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=2 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=3 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=4 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=5 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:49:39.504+0000 7fcb18925800 20 add_watcher() i=6 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:49:39.505+0000 7fcb18925800 20 add_watcher() i=7 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:49:39.505+0000 7fcb18925800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding auth protocol: cephx 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding auth protocol: cephx 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding auth protocol: cephx 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.639 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:49:39.507+0000 7fc9cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: crc 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 AuthRegistry(0x7ffd3ff61110) adding con mode: secure 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:49:39.507+0000 7fcb18925800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:49:39.507+0000 7fcb18925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:39.640 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:49:39.507+0000 7fcb18925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command cache list hook 0x55f376b791c0 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command cache inspect hook 0x55f376b791c0 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command cache erase hook 0x55f376b791c0 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command cache zap hook 0x55f376b791c0 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 note: GC not initialized 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:49:39.507+0000 7fc9c9fdb640 20 reqs_thread_entry: start 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command sync trace show hook 0x7fcb0c00e070 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command sync trace history hook 0x7fcb0c00e070 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command sync trace active hook 0x7fcb0c00e070 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:49:39.507+0000 7fcb18925800 5 asok(0x55f376891630) register_command sync trace active_short hook 0x7fcb0c00e070 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:49:39.507+0000 7fcb18925800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:49:39.507+0000 7fcb18925800 20 Filter name: none 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:49:39.507+0000 7fc93b7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:39.641 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : miss 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:49:39.508+0000 7fcb18925800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:49:39.508+0000 7fcb18925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:49:39.642 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:49:39.512+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:49:39.512+0000 7fcb18925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:49:39.512+0000 7fcb18925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:49:39.512+0000 7fcb18925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30, ofs0, ns] 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464374 cookie 94504157354320 notifier 6704 bl.length()=999 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:49:39.512+0000 7fc9eb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_sources= new_sources= 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential sources added=[] removed=[] 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_dests= new_dests= 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:49:39.513+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential dests added=[] removed=[] 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:49:39.515+0000 7fcb18925800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.0 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:49:39.515+0000 7fcb18925800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.0 2024-09-12T00:49:39.643 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:49:39.515+0000 7fcb18925800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.1 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:49:39.515+0000 7fcb18925800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.1.1 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:49:39.515+0000 7fcb18925800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.0 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:49:39.518+0000 7fcb18925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:49:39.518+0000 7fcb18925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:49:39.519+0000 7fcb18925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:49:39.519+0000 7fcb18925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:49:39.519+0000 7fcb18925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:49:39.519+0000 7fcb18925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30, ofs0, ns] 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 94504157354320 notifier 6704 bl.length()=999 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:49:39.520+0000 7fc9eb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:39.644 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_sources= new_sources= 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential sources added=[] removed=[] 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_dests= new_dests= 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:49:39.520+0000 7fcb18925800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential dests added=[] removed=[] 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:49:39.521+0000 7fcb18925800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcb18925800 time 2024-09-12T00:49:39.522174+0000 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcb19f8c71a] 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb19f8c8d8] 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3751c7641] 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55f3751d6582] 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f3751d73e4] 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:49:39.645 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcb18c29590] 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:49:39.522+0000 7fcb18925800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fcb18925800 thread_name:radosgw-admin 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcb18c3e6f0] 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcb18c8b99c] 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcb19f8c774] 2024-09-12T00:49:39.646 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcb19f8c8d8] 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3751c7641] 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55f3751d6582] 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f3751d73e4] 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcb18c29590] 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:49:39.647 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:49:39.648 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:49:39.649 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:49:39.650 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:49:39.651 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:49:39.652 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:49:39.653 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc93b7fe640 / http_manager 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9c9fdb640 / http_manager 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9cafdd640 / rgw_dt_lg_renew 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9e9ffb640 / ms_dispatch 2024-09-12T00:49:39.654 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9eb7fe640 / io_context_pool 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: 7fc9f9ffb640 / ms_dispatch 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: 7fca00e09640 / ms_dispatch 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: 7fca0260c640 / io_context_pool 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb13d32640 / msgr-worker-2 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb14533640 / msgr-worker-1 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb14d34640 / msgr-worker-0 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb15535640 / io_context_pool 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: 7fcb18925800 / radosgw-admin 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:49:39.523794Z_b383d409-7741-4f85-af4e-c8c2f620695c/log 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:49:39.655 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.595+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.597+0000 7fc3f4140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.597+0000 7fc3f4140800 20 realm 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.597+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.597+0000 7fc3f4140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.597+0000 7fc3f4140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.597+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.597+0000 7fc3f4140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.597+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.598+0000 7fc3f4140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.598+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.598+0000 7fc3f4140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.598+0000 7fc3f4140800 20 searching for the correct realm 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.602+0000 7fc3f0687640 0 -- 172.21.15.83:0/3214342460 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7fc3d80c4060 msgr2=0x7fc3d80c5880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.605+0000 7fc3efe86640 0 -- 172.21.15.83:0/3214342460 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fc3e803b900 msgr2=0x7fc3e8023430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.662 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 zone default found 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 4 Realm: () 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 zonegroup default 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.609+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.610+0000 7fc3f4140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.610+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.610+0000 7fc3f4140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.610+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.610+0000 7fc3f4140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.610+0000 7fc3f4140800 20 started sync module instance, tier type = 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.610+0000 7fc3f4140800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.618+0000 7fc3f4140800 20 add_watcher() i=0 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.618+0000 7fc3f4140800 20 add_watcher() i=1 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.618+0000 7fc3f4140800 20 add_watcher() i=2 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.618+0000 7fc3f4140800 20 add_watcher() i=3 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.618+0000 7fc3f4140800 20 add_watcher() i=4 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.618+0000 7fc3f4140800 20 add_watcher() i=5 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.618+0000 7fc3f4140800 20 add_watcher() i=6 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.619+0000 7fc3f4140800 20 add_watcher() i=7 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.619+0000 7fc3f4140800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.621+0000 7fc2a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.621+0000 7fc3f4140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:39.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.621+0000 7fc3f4140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.621+0000 7fc3f4140800 5 note: GC not initialized 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.621+0000 7fc2a4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.621+0000 7fc3f4140800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.621+0000 7fc3f4140800 20 Filter name: none 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.621+0000 7fc21e7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.622+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.622+0000 7fc3f4140800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.622+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.622+0000 7fc3f4140800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.622+0000 7fc3f4140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.622+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.623+0000 7fc3f4140800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.623+0000 7fc3f4140800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.623+0000 7fc3f4140800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.623+0000 7fc3f4140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.624+0000 7fc2a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.626+0000 7fc3f4140800 20 remove_watcher() i=0 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.626+0000 7fc3f4140800 2 removed watcher, disabling cache 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.627+0000 7fc3f4140800 20 remove_watcher() i=1 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.628+0000 7fc3f4140800 20 remove_watcher() i=2 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.629+0000 7fc3f4140800 20 remove_watcher() i=3 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.630+0000 7fc3f4140800 20 remove_watcher() i=4 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.631+0000 7fc3f4140800 20 remove_watcher() i=5 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.632+0000 7fc3f4140800 20 remove_watcher() i=6 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.633+0000 7fc3f4140800 20 remove_watcher() i=7 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:49:39.666 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-block-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:49:39.667 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:49:39.667 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:39.667 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:39.667 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:39.667 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:49:39.696 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:39.727 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:39.727 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:39.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.948+0000 7f607556b640 0 --2- 172.21.15.83:0/1306219290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a12cdf4890 0x55a12cf46520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:49:39.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.965+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.967+0000 7f6079e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.967+0000 7f6079e0e800 20 realm 2024-09-12T00:49:39.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.967+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.967+0000 7f6079e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.967+0000 7f6079e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:39.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.967+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.967+0000 7f6079e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:39.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.967+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.968+0000 7f6079e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:39.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.968+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:39.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.968+0000 7f6079e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:39.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.968+0000 7f6079e0e800 20 searching for the correct realm 2024-09-12T00:49:39.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:39.970+0000 7f607556b640 0 -- 172.21.15.83:0/1165687897 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f60680624e0 msgr2=0x7f60680921f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:40.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.175+0000 7f607556b640 0 -- 172.21.15.83:0/1165687897 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f6070079070 msgr2=0x7f60700a7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:40.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.381+0000 7f6079e0e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:49:40.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.381+0000 7f6079e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.381+0000 7f6079e0e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:49:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.381+0000 7f6079e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.381+0000 7f6079e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.381+0000 7f6079e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.381+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.381+0000 7f6079e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.381+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:40.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:40.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 20 zone default found 2024-09-12T00:49:40.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 4 Realm: () 2024-09-12T00:49:40.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:49:40.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 20 zonegroup default 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.382+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.383+0000 7f6079e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.383+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.383+0000 7f6079e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.383+0000 7f6079e0e800 20 started sync module instance, tier type = 2024-09-12T00:49:40.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.383+0000 7f6079e0e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:49:40.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.392+0000 7f6079e0e800 20 add_watcher() i=0 2024-09-12T00:49:40.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.392+0000 7f6079e0e800 20 add_watcher() i=1 2024-09-12T00:49:40.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.392+0000 7f6079e0e800 20 add_watcher() i=2 2024-09-12T00:49:40.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.392+0000 7f6079e0e800 20 add_watcher() i=3 2024-09-12T00:49:40.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.392+0000 7f6079e0e800 20 add_watcher() i=4 2024-09-12T00:49:40.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.392+0000 7f6079e0e800 20 add_watcher() i=5 2024-09-12T00:49:40.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.393+0000 7f6079e0e800 20 add_watcher() i=6 2024-09-12T00:49:40.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.393+0000 7f6079e0e800 20 add_watcher() i=7 2024-09-12T00:49:40.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.393+0000 7f6079e0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:40.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.395+0000 7f5f2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:40.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.396+0000 7f6079e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.396+0000 7f6079e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.396+0000 7f6079e0e800 5 note: GC not initialized 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.396+0000 7f5f2a7e4640 20 reqs_thread_entry: start 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.396+0000 7f6079e0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.396+0000 7f6079e0e800 20 Filter name: none 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.396+0000 7f5e9bfff640 20 reqs_thread_entry: start 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.396+0000 7f6079e0e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.396+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : miss 2024-09-12T00:49:40.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.397+0000 7f6079e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.398+0000 7f6079e0e800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to be held by another RGW process; skipping for now 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.399+0000 7f5f2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.402+0000 7f6079e0e800 20 remove_watcher() i=0 2024-09-12T00:49:40.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.402+0000 7f6079e0e800 2 removed watcher, disabling cache 2024-09-12T00:49:40.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.403+0000 7f6079e0e800 20 remove_watcher() i=1 2024-09-12T00:49:40.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.404+0000 7f6079e0e800 20 remove_watcher() i=2 2024-09-12T00:49:40.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.405+0000 7f6079e0e800 20 remove_watcher() i=3 2024-09-12T00:49:40.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.406+0000 7f6079e0e800 20 remove_watcher() i=4 2024-09-12T00:49:40.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.407+0000 7f6079e0e800 20 remove_watcher() i=5 2024-09-12T00:49:40.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.408+0000 7f6079e0e800 20 remove_watcher() i=6 2024-09-12T00:49:40.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:49:40.409+0000 7f6079e0e800 20 remove_watcher() i=7 2024-09-12T00:49:40.419 INFO:tasks.workunit.client.0.smithi083.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:50:10.443 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:10.479 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:10.479 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:10.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.523+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.524+0000 7ff557346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.524+0000 7ff557346800 20 realm 2024-09-12T00:50:10.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.524+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.525+0000 7ff557346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.525 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.525+0000 7ff557346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:10.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.525+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.525+0000 7ff557346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.525+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.526+0000 7ff557346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:10.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.526+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.526+0000 7ff557346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:10.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.526+0000 7ff557346800 20 searching for the correct realm 2024-09-12T00:50:10.528 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.530+0000 7ff54ffff640 0 -- 172.21.15.83:0/3902390236 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff540062970 msgr2=0x7ff540098a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:10.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.735+0000 7ff54ffff640 0 -- 172.21.15.83:0/3902390236 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f2939296d0 msgr2=0x55f29392bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:10.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.740+0000 7ff557346800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:10.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.740+0000 7ff557346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:10.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.740+0000 7ff557346800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:10.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.740+0000 7ff557346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:10.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.740+0000 7ff557346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:10.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.740+0000 7ff557346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:10.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.740+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:10.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:10.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 20 zone default found 2024-09-12T00:50:10.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 4 Realm: () 2024-09-12T00:50:10.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:10.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 20 zonegroup default 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.741+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.742+0000 7ff557346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.742+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.742+0000 7ff557346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.742+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.742+0000 7ff557346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.742+0000 7ff557346800 20 started sync module instance, tier type = 2024-09-12T00:50:10.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.742+0000 7ff557346800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:10.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.752+0000 7ff557346800 20 add_watcher() i=0 2024-09-12T00:50:10.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.752+0000 7ff557346800 20 add_watcher() i=1 2024-09-12T00:50:10.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.752+0000 7ff557346800 20 add_watcher() i=2 2024-09-12T00:50:10.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.752+0000 7ff557346800 20 add_watcher() i=3 2024-09-12T00:50:10.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.752+0000 7ff557346800 20 add_watcher() i=4 2024-09-12T00:50:10.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.752+0000 7ff557346800 20 add_watcher() i=5 2024-09-12T00:50:10.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.752+0000 7ff557346800 20 add_watcher() i=6 2024-09-12T00:50:10.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.754+0000 7ff557346800 20 add_watcher() i=7 2024-09-12T00:50:10.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.754+0000 7ff557346800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:10.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.756+0000 7ff40afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.756+0000 7ff557346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.756+0000 7ff557346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.756+0000 7ff557346800 5 note: GC not initialized 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.756+0000 7ff409fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.756+0000 7ff557346800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.756+0000 7ff557346800 20 Filter name: none 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff37b7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:50:10.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : miss 2024-09-12T00:50:10.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:50:10.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:50:10.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:50:10.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:10.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:10.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.757+0000 7ff557346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:50:10.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.759+0000 7ff557346800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:50:10.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.763+0000 7ff557346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:50:10.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.763+0000 7ff557346800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:50:10.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.763+0000 7ff557346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:10.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.763+0000 7ff557346800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30, ofs0, ns] 2024-09-12T00:50:10.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.763+0000 7ff42bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464376 cookie 94500346354368 notifier 7161 bl.length()=999 2024-09-12T00:50:10.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.763+0000 7ff42bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:50:10.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.763+0000 7ff42bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:50:10.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.763+0000 7ff42bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:10.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.764+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_sources= new_sources= 2024-09-12T00:50:10.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.764+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential sources added=[] removed=[] 2024-09-12T00:50:10.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.764+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_dests= new_dests= 2024-09-12T00:50:10.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.764+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential dests added=[] removed=[] 2024-09-12T00:50:10.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.767+0000 7ff557346800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.2.0 2024-09-12T00:50:10.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.767+0000 7ff557346800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.2.0 2024-09-12T00:50:10.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.767+0000 7ff557346800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.2.1 2024-09-12T00:50:10.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.767+0000 7ff557346800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.2.1 2024-09-12T00:50:10.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.767+0000 7ff557346800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.0 2024-09-12T00:50:10.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.770+0000 7ff557346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:10.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.770+0000 7ff557346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:50:10.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.771+0000 7ff557346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.771+0000 7ff557346800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.771+0000 7ff557346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.771+0000 7ff557346800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30, ofs0, ns] 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.772+0000 7ff42b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464377 cookie 94500346354368 notifier 7161 bl.length()=999 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.772+0000 7ff42b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.772+0000 7ff42b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.772+0000 7ff42b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.772+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_sources= new_sources= 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.772+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential sources added=[] removed=[] 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.772+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_dests= new_dests= 2024-09-12T00:50:10.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.772+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential dests added=[] removed=[] 2024-09-12T00:50:10.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.773+0000 7ff557346800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.30.0 2024-09-12T00:50:10.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.774+0000 7ff557346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:10.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.774+0000 7ff557346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 2024-09-12T00:50:10.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.775+0000 7ff557346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:50:10.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.775+0000 7ff557346800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:50:10.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.775+0000 7ff557346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:10.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.775+0000 7ff557346800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30, ofs0, ns] 2024-09-12T00:50:10.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.776+0000 7ff42bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464378 cookie 94500346354368 notifier 7161 bl.length()=967 2024-09-12T00:50:10.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.776+0000 7ff42bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 info.flags=0x17 2024-09-12T00:50:10.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.776+0000 7ff42bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.30 to cache LRU end 2024-09-12T00:50:10.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.776+0000 7ff42bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:10.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.776+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_sources= new_sources= 2024-09-12T00:50:10.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.776+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential sources added=[] removed=[] 2024-09-12T00:50:10.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.776+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): orig_dests= new_dests= 2024-09-12T00:50:10.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.776+0000 7ff557346800 20 handle_bi_update(): bucket=:abort-at-block-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.30]): potential dests added=[] removed=[] 2024-09-12T00:50:10.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.777+0000 7ff557346800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:10.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.779+0000 7ff40afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:10.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.782+0000 7ff557346800 20 remove_watcher() i=0 2024-09-12T00:50:10.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.782+0000 7ff557346800 2 removed watcher, disabling cache 2024-09-12T00:50:10.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.783+0000 7ff557346800 20 remove_watcher() i=1 2024-09-12T00:50:10.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.784+0000 7ff557346800 20 remove_watcher() i=2 2024-09-12T00:50:10.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.785+0000 7ff557346800 20 remove_watcher() i=3 2024-09-12T00:50:10.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.786+0000 7ff557346800 20 remove_watcher() i=4 2024-09-12T00:50:10.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.787+0000 7ff557346800 20 remove_watcher() i=5 2024-09-12T00:50:10.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.788+0000 7ff557346800 20 remove_watcher() i=6 2024-09-12T00:50:10.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.789+0000 7ff557346800 20 remove_watcher() i=7 2024-09-12T00:50:10.800 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:50:10.829 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:10.829 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:10.866 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.867+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.869+0000 7f9618f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.869+0000 7f9618f2c800 20 realm 2024-09-12T00:50:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.869+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.869+0000 7f9618f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.869+0000 7f9618f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.869+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.869+0000 7f9618f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.869+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.870+0000 7f9618f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:10.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.870+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.871+0000 7f9618f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:10.869 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.871+0000 7f9618f2c800 20 searching for the correct realm 2024-09-12T00:50:10.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:10.874+0000 7f961444e640 0 -- 172.21.15.83:0/139137350 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f95fc06e070 msgr2=0x7f95fc068880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:11.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.079+0000 7f961444e640 0 -- 172.21.15.83:0/139137350 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5641956f5550 msgr2=0x5641956f79a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:11.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.083+0000 7f9618f2c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:11.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.083+0000 7f9618f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:11.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.083+0000 7f9618f2c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:11.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.083+0000 7f9618f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:11.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.083+0000 7f9618f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.083+0000 7f9618f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.083+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 20 zone default found 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 4 Realm: () 2024-09-12T00:50:11.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 20 zonegroup default 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.084+0000 7f9618f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.085+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.085+0000 7f9618f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.085+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.085+0000 7f9618f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.085+0000 7f9618f2c800 20 started sync module instance, tier type = 2024-09-12T00:50:11.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.085+0000 7f9618f2c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:11.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.094+0000 7f9618f2c800 20 add_watcher() i=0 2024-09-12T00:50:11.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.094+0000 7f9618f2c800 20 add_watcher() i=1 2024-09-12T00:50:11.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.094+0000 7f9618f2c800 20 add_watcher() i=2 2024-09-12T00:50:11.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.094+0000 7f9618f2c800 20 add_watcher() i=3 2024-09-12T00:50:11.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.094+0000 7f9618f2c800 20 add_watcher() i=4 2024-09-12T00:50:11.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.094+0000 7f9618f2c800 20 add_watcher() i=5 2024-09-12T00:50:11.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.094+0000 7f9618f2c800 20 add_watcher() i=6 2024-09-12T00:50:11.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.095+0000 7f9618f2c800 20 add_watcher() i=7 2024-09-12T00:50:11.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.095+0000 7f9618f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:11.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.097+0000 7f94cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.098+0000 7f9618f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:11.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.098+0000 7f9618f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:11.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.098+0000 7f9618f2c800 5 note: GC not initialized 2024-09-12T00:50:11.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.098+0000 7f94ca7e4640 20 reqs_thread_entry: start 2024-09-12T00:50:11.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.098+0000 7f9618f2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:11.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.098+0000 7f9618f2c800 20 Filter name: none 2024-09-12T00:50:11.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.098+0000 7f94c37fe640 20 reqs_thread_entry: start 2024-09-12T00:50:11.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.098+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.099+0000 7f9618f2c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:50:11.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.099+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.100+0000 7f9618f2c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:50:11.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.100+0000 7f9618f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:11.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.100+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.100+0000 7f9618f2c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:50:11.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.100+0000 7f9618f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.101+0000 7f9618f2c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:50:11.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.101+0000 7f9618f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:11.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.102+0000 7f94cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.104+0000 7f9618f2c800 20 remove_watcher() i=0 2024-09-12T00:50:11.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.104+0000 7f9618f2c800 2 removed watcher, disabling cache 2024-09-12T00:50:11.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.105+0000 7f9618f2c800 20 remove_watcher() i=1 2024-09-12T00:50:11.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.106+0000 7f9618f2c800 20 remove_watcher() i=2 2024-09-12T00:50:11.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.107+0000 7f9618f2c800 20 remove_watcher() i=3 2024-09-12T00:50:11.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.108+0000 7f9618f2c800 20 remove_watcher() i=4 2024-09-12T00:50:11.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.109+0000 7f9618f2c800 20 remove_watcher() i=5 2024-09-12T00:50:11.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.110+0000 7f9618f2c800 20 remove_watcher() i=6 2024-09-12T00:50:11.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.111+0000 7f9618f2c800 20 remove_watcher() i=7 2024-09-12T00:50:11.120 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:11.120 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:11.120 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-block-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:11.120 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:11.122 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.122 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.125 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.125 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.168 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.168 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.181 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:50:11.181 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:11.183 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.183 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.192 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.192 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.235 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.235 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.243 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.243 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.251 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.251 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.258 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.259 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.267 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.267 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.275 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.275 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.283 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.284 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.292 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.292 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.300 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.300 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.308 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.308 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.316 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.316 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.325 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.325 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.333 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.333 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.341 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.341 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.349 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.349 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.357 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.357 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.365 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.365 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.374 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.374 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.381 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.381 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.389 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:11.389 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:11.397 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:50:11.426 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:11.426 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:11.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.463+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.465+0000 7f0e4c340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.465+0000 7f0e4c340800 20 realm 2024-09-12T00:50:11.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.465+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.465+0000 7f0e4c340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.465+0000 7f0e4c340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:11.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.465+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.465+0000 7f0e4c340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.465+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.466+0000 7f0e4c340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.466+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.467+0000 7f0e4c340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.467+0000 7f0e4c340800 20 searching for the correct realm 2024-09-12T00:50:11.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.470+0000 7f0e478bf640 0 -- 172.21.15.83:0/126946336 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f0e3c042b00 msgr2=0x7f0e3c00a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:11.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.474+0000 7f0e488c1640 0 -- 172.21.15.83:0/126946336 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x562157001470 msgr2=0x5621570038e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.478+0000 7f0e4c340800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.478+0000 7f0e4c340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.478+0000 7f0e4c340800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.478+0000 7f0e4c340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.478+0000 7f0e4c340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.478+0000 7f0e4c340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.478+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.478+0000 7f0e4c340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.478+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 zone default found 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 4 Realm: () 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 zonegroup default 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.479+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.480+0000 7f0e4c340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.480+0000 7f0e4c340800 20 started sync module instance, tier type = 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.480+0000 7f0e4c340800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:11.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.488+0000 7f0e4c340800 20 add_watcher() i=0 2024-09-12T00:50:11.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.488+0000 7f0e4c340800 20 add_watcher() i=1 2024-09-12T00:50:11.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.488+0000 7f0e4c340800 20 add_watcher() i=2 2024-09-12T00:50:11.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.488+0000 7f0e4c340800 20 add_watcher() i=3 2024-09-12T00:50:11.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.488+0000 7f0e4c340800 20 add_watcher() i=4 2024-09-12T00:50:11.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.488+0000 7f0e4c340800 20 add_watcher() i=5 2024-09-12T00:50:11.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.488+0000 7f0e4c340800 20 add_watcher() i=6 2024-09-12T00:50:11.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.489+0000 7f0e4c340800 20 add_watcher() i=7 2024-09-12T00:50:11.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.489+0000 7f0e4c340800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.490+0000 7f0cfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.491+0000 7f0e4c340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.491+0000 7f0e4c340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.491+0000 7f0e4c340800 5 note: GC not initialized 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.491+0000 7f0cfdfdb640 20 reqs_thread_entry: start 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.491+0000 7f0e4c340800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.491+0000 7f0e4c340800 20 Filter name: none 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.491+0000 7f0c6f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.491+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.492+0000 7f0e4c340800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:11.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.492+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.492+0000 7f0e4c340800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:11.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.492+0000 7f0e4c340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:11.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.492+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.492+0000 7f0e4c340800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:11.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.492+0000 7f0e4c340800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.493+0000 7f0e4c340800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:11.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.493+0000 7f0e4c340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:11.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.494+0000 7f0cfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.496+0000 7f0e4c340800 20 remove_watcher() i=0 2024-09-12T00:50:11.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.496+0000 7f0e4c340800 2 removed watcher, disabling cache 2024-09-12T00:50:11.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.497+0000 7f0e4c340800 20 remove_watcher() i=1 2024-09-12T00:50:11.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.498+0000 7f0e4c340800 20 remove_watcher() i=2 2024-09-12T00:50:11.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.499+0000 7f0e4c340800 20 remove_watcher() i=3 2024-09-12T00:50:11.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.500+0000 7f0e4c340800 20 remove_watcher() i=4 2024-09-12T00:50:11.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.501+0000 7f0e4c340800 20 remove_watcher() i=5 2024-09-12T00:50:11.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.502+0000 7f0e4c340800 20 remove_watcher() i=6 2024-09-12T00:50:11.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.503+0000 7f0e4c340800 20 remove_watcher() i=7 2024-09-12T00:50:11.512 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:11.512 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:11.512 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:11.512 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:11.513 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:50:11.547 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:11.547 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:11.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.584+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.586+0000 7f2b1b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.586+0000 7f2b1b935800 20 realm 2024-09-12T00:50:11.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.586+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.586+0000 7f2b1b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.586+0000 7f2b1b935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:11.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.586+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.586+0000 7f2b1b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.586+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.587+0000 7f2b1b935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.587+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.587+0000 7f2b1b935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:11.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.587+0000 7f2b1b935800 20 searching for the correct realm 2024-09-12T00:50:11.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.590+0000 7f2b0ffff640 0 -- 172.21.15.83:0/3346763117 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f2b0006d040 msgr2=0x7f2b000b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:11.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.795+0000 7f2b17ee5640 0 -- 172.21.15.83:0/3346763117 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x560fdd8404d0 msgr2=0x560fdd8428e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:11.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.799+0000 7f2b1b935800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:11.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.799+0000 7f2b1b935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:11.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.799+0000 7f2b1b935800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:11.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.799+0000 7f2b1b935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:11.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.799+0000 7f2b1b935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:11.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.799+0000 7f2b1b935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:11.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.799+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.799+0000 7f2b1b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.799+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 zone default found 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 4 Realm: () 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 zonegroup default 2024-09-12T00:50:11.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.800+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.801+0000 7f2b1b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.801+0000 7f2b1b935800 20 started sync module instance, tier type = 2024-09-12T00:50:11.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.801+0000 7f2b1b935800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:11.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.809+0000 7f2b1b935800 20 add_watcher() i=0 2024-09-12T00:50:11.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.809+0000 7f2b1b935800 20 add_watcher() i=1 2024-09-12T00:50:11.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.809+0000 7f2b1b935800 20 add_watcher() i=2 2024-09-12T00:50:11.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.809+0000 7f2b1b935800 20 add_watcher() i=3 2024-09-12T00:50:11.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.809+0000 7f2b1b935800 20 add_watcher() i=4 2024-09-12T00:50:11.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.809+0000 7f2b1b935800 20 add_watcher() i=5 2024-09-12T00:50:11.808 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.809+0000 7f2b1b935800 20 add_watcher() i=6 2024-09-12T00:50:11.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.810+0000 7f2b1b935800 20 add_watcher() i=7 2024-09-12T00:50:11.809 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.810+0000 7f2b1b935800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:11.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.812+0000 7f29cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.813+0000 7f2b1b935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.813+0000 7f2b1b935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.813+0000 7f2b1b935800 5 note: GC not initialized 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.813+0000 7f29ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.813+0000 7f2b1b935800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.813+0000 7f2b1b935800 20 Filter name: none 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.813+0000 7f29467fc640 20 reqs_thread_entry: start 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.813+0000 7f2b1b935800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.813+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:50:11.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:50:11.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 : miss 2024-09-12T00:50:11.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:11.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:11.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:11.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:11.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:11.814 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.814+0000 7f2b1b935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 2024-09-12T00:50:11.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f2b1b935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:11.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f2b1b935800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:11.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f2b1b935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:11.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f2b1b935800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31, ofs0, ns] 2024-09-12T00:50:11.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f29fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464362 cookie 94626140976192 notifier 6812 bl.length()=1015 2024-09-12T00:50:11.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f29fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:11.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f29fa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:11.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f29fa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:11.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f2b1b935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_sources= new_sources= 2024-09-12T00:50:11.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f2b1b935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential sources added=[] removed=[] 2024-09-12T00:50:11.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f2b1b935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_dests= new_dests= 2024-09-12T00:50:11.817 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.818+0000 7f2b1b935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential dests added=[] removed=[] 2024-09-12T00:50:11.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.820+0000 7f2b1b935800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.1.0 2024-09-12T00:50:11.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.820+0000 7f2b1b935800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.1.0 2024-09-12T00:50:11.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.820+0000 7f2b1b935800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.1.1 2024-09-12T00:50:11.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.820+0000 7f2b1b935800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.1.1 2024-09-12T00:50:11.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.820+0000 7f2b1b935800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.0 2024-09-12T00:50:11.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.823+0000 7f2b1b935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:11.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.823+0000 7f2b1b935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 2024-09-12T00:50:11.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.824+0000 7f2b1b935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:11.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.824+0000 7f2b1b935800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:11.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.824+0000 7f2b1b935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:11.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.824+0000 7f2b1b935800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31, ofs0, ns] 2024-09-12T00:50:11.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.825+0000 7f29fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464363 cookie 94626140976192 notifier 6812 bl.length()=1015 2024-09-12T00:50:11.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.825+0000 7f29fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:11.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.825+0000 7f29fa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:11.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.825+0000 7f29fa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:11.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.825+0000 7f2b1b935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_sources= new_sources= 2024-09-12T00:50:11.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.825+0000 7f2b1b935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential sources added=[] removed=[] 2024-09-12T00:50:11.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.825+0000 7f2b1b935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_dests= new_dests= 2024-09-12T00:50:11.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.825+0000 7f2b1b935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential dests added=[] removed=[] 2024-09-12T00:50:11.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.826+0000 7f2b1b935800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.0 2024-09-12T00:50:11.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.826+0000 7f2b1b935800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:50:11.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.826+0000 7f2b1b935800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:50:11.827 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.829+0000 7f29cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.831+0000 7f2b1b935800 20 remove_watcher() i=0 2024-09-12T00:50:11.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.831+0000 7f2b1b935800 2 removed watcher, disabling cache 2024-09-12T00:50:11.830 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.832+0000 7f2b1b935800 20 remove_watcher() i=1 2024-09-12T00:50:11.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.833+0000 7f2b1b935800 20 remove_watcher() i=2 2024-09-12T00:50:11.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.834+0000 7f2b1b935800 20 remove_watcher() i=3 2024-09-12T00:50:11.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.835+0000 7f2b1b935800 20 remove_watcher() i=4 2024-09-12T00:50:11.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.836+0000 7f2b1b935800 20 remove_watcher() i=5 2024-09-12T00:50:11.835 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.836+0000 7f2b1b935800 20 remove_watcher() i=6 2024-09-12T00:50:11.836 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.837+0000 7f2b1b935800 20 remove_watcher() i=7 2024-09-12T00:50:11.848 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:50:11.876 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:11.876 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:11.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.914+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.916+0000 7ff072d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.916+0000 7ff072d32800 20 realm 2024-09-12T00:50:11.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.916+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.916+0000 7ff072d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.915 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.916+0000 7ff072d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:11.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.916+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.916+0000 7ff072d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.916 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.916+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.917+0000 7ff072d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.917 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.917+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.918+0000 7ff072d32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:11.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:11.918+0000 7ff072d32800 20 searching for the correct realm 2024-09-12T00:50:12.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.123+0000 7ff06e1bb640 0 -- 172.21.15.83:0/347809911 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff05806f440 msgr2=0x7ff058086a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:12.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.329+0000 7ff06e1bb640 0 -- 172.21.15.83:0/347809911 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55940579f990 msgr2=0x5594057a1dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:12.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.333+0000 7ff072d32800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:12.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.333+0000 7ff072d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:12.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.333+0000 7ff072d32800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:12.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.333+0000 7ff072d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:12.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.333+0000 7ff072d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:12.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.333+0000 7ff072d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:12.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.333+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.333+0000 7ff072d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.333+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:12.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:12.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 20 zone default found 2024-09-12T00:50:12.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 4 Realm: () 2024-09-12T00:50:12.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:12.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:12.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:12.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 20 zonegroup default 2024-09-12T00:50:12.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.334+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.335+0000 7ff072d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.335+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.335+0000 7ff072d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.335+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.335+0000 7ff072d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.335+0000 7ff072d32800 20 started sync module instance, tier type = 2024-09-12T00:50:12.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.335+0000 7ff072d32800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:12.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.344+0000 7ff072d32800 20 add_watcher() i=0 2024-09-12T00:50:12.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.344+0000 7ff072d32800 20 add_watcher() i=1 2024-09-12T00:50:12.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.344+0000 7ff072d32800 20 add_watcher() i=2 2024-09-12T00:50:12.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.344+0000 7ff072d32800 20 add_watcher() i=3 2024-09-12T00:50:12.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.344+0000 7ff072d32800 20 add_watcher() i=4 2024-09-12T00:50:12.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.344+0000 7ff072d32800 20 add_watcher() i=5 2024-09-12T00:50:12.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.344+0000 7ff072d32800 20 add_watcher() i=6 2024-09-12T00:50:12.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.345+0000 7ff072d32800 20 add_watcher() i=7 2024-09-12T00:50:12.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.345+0000 7ff072d32800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:12.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.347+0000 7fef257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.347+0000 7ff072d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:12.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.347+0000 7ff072d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:12.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.347+0000 7ff072d32800 5 note: GC not initialized 2024-09-12T00:50:12.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.348+0000 7fee9ffff640 20 reqs_thread_entry: start 2024-09-12T00:50:12.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.348+0000 7ff072d32800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:12.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.348+0000 7ff072d32800 20 Filter name: none 2024-09-12T00:50:12.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.348+0000 7fee9dffb640 20 reqs_thread_entry: start 2024-09-12T00:50:12.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.348+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.348+0000 7ff072d32800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:12.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.348+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.349+0000 7ff072d32800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:50:12.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.349+0000 7ff072d32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:12.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.349+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.349+0000 7ff072d32800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:12.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.349+0000 7ff072d32800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.349+0000 7ff072d32800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:50:12.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.350+0000 7ff072d32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:12.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.351+0000 7fef257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.353+0000 7ff072d32800 20 remove_watcher() i=0 2024-09-12T00:50:12.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.353+0000 7ff072d32800 2 removed watcher, disabling cache 2024-09-12T00:50:12.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.354+0000 7ff072d32800 20 remove_watcher() i=1 2024-09-12T00:50:12.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.355+0000 7ff072d32800 20 remove_watcher() i=2 2024-09-12T00:50:12.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.356+0000 7ff072d32800 20 remove_watcher() i=3 2024-09-12T00:50:12.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.357+0000 7ff072d32800 20 remove_watcher() i=4 2024-09-12T00:50:12.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.358+0000 7ff072d32800 20 remove_watcher() i=5 2024-09-12T00:50:12.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.359+0000 7ff072d32800 20 remove_watcher() i=6 2024-09-12T00:50:12.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.360+0000 7ff072d32800 20 remove_watcher() i=7 2024-09-12T00:50:12.368 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:12.368 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:12.368 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:12.368 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:12.372 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:12.372 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:12.378 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:12.378 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:12.421 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:12.453 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:12.453 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:12.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.491+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.492+0000 7fde85917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.492+0000 7fde85917800 20 realm 2024-09-12T00:50:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.492+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.492+0000 7fde85917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.492+0000 7fde85917800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.492+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.492+0000 7fde85917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.492+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.493+0000 7fde85917800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:12.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.493+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.493+0000 7fde85917800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:12.492 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.494+0000 7fde85917800 20 searching for the correct realm 2024-09-12T00:50:12.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.699+0000 7fde7bfff640 0 -- 172.21.15.83:0/2128345445 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fde6c041440 msgr2=0x7fde6c0418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:12.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.904+0000 7fde83c02640 0 -- 172.21.15.83:0/2128345445 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55e3de81f7a0 msgr2=0x55e3de821c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:12.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:12.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:12.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:12.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:12.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:12.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:12.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:12.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.909+0000 7fde85917800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:12.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 zone default found 2024-09-12T00:50:12.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 4 Realm: () 2024-09-12T00:50:12.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:12.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 zonegroup default 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 started sync module instance, tier type = 2024-09-12T00:50:12.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.910+0000 7fde85917800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:12.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.919+0000 7fde85917800 20 add_watcher() i=0 2024-09-12T00:50:12.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.919+0000 7fde85917800 20 add_watcher() i=1 2024-09-12T00:50:12.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.919+0000 7fde85917800 20 add_watcher() i=2 2024-09-12T00:50:12.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.919+0000 7fde85917800 20 add_watcher() i=3 2024-09-12T00:50:12.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.919+0000 7fde85917800 20 add_watcher() i=4 2024-09-12T00:50:12.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.919+0000 7fde85917800 20 add_watcher() i=5 2024-09-12T00:50:12.918 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.919+0000 7fde85917800 20 add_watcher() i=6 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.920+0000 7fde85917800 20 add_watcher() i=7 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.920+0000 7fde85917800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:12.920 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.922+0000 7fdd39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.922+0000 7fde85917800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:12.921 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.922+0000 7fde85917800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:12.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.923+0000 7fde85917800 5 note: GC not initialized 2024-09-12T00:50:12.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.923+0000 7fdd38fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:12.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.923+0000 7fde85917800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:12.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.923+0000 7fde85917800 20 Filter name: none 2024-09-12T00:50:12.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.923+0000 7fde85917800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:50:12.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.923+0000 7fdcb27fc640 20 reqs_thread_entry: start 2024-09-12T00:50:12.922 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.923+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 : miss 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:12.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.924+0000 7fde85917800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 2024-09-12T00:50:12.924 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.925+0000 7fde85917800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:50:12.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.929+0000 7fde85917800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:12.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.929+0000 7fde85917800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:12.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.929+0000 7fde85917800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:12.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.929+0000 7fde85917800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31, ofs0, ns] 2024-09-12T00:50:12.928 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.930+0000 7fdd667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464364 cookie 94437179062688 notifier 6848 bl.length()=1015 2024-09-12T00:50:12.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.930+0000 7fdd667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:12.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.930+0000 7fdd667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:12.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.930+0000 7fdd667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:12.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.930+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_sources= new_sources= 2024-09-12T00:50:12.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.930+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential sources added=[] removed=[] 2024-09-12T00:50:12.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.930+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_dests= new_dests= 2024-09-12T00:50:12.929 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.930+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential dests added=[] removed=[] 2024-09-12T00:50:12.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.932+0000 7fde85917800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.2.0 2024-09-12T00:50:12.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.932+0000 7fde85917800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.2.0 2024-09-12T00:50:12.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.932+0000 7fde85917800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.2.1 2024-09-12T00:50:12.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.932+0000 7fde85917800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.2.1 2024-09-12T00:50:12.931 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.932+0000 7fde85917800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.0 2024-09-12T00:50:12.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.935+0000 7fde85917800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:12.933 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.935+0000 7fde85917800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 2024-09-12T00:50:12.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.936+0000 7fde85917800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:12.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.936+0000 7fde85917800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:12.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.936+0000 7fde85917800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:12.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.936+0000 7fde85917800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31, ofs0, ns] 2024-09-12T00:50:12.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.936+0000 7fdd667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94437179062688 notifier 6848 bl.length()=1015 2024-09-12T00:50:12.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.936+0000 7fdd667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:12.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.936+0000 7fdd667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:12.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.936+0000 7fdd667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:12.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.937+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_sources= new_sources= 2024-09-12T00:50:12.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.937+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential sources added=[] removed=[] 2024-09-12T00:50:12.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.937+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_dests= new_dests= 2024-09-12T00:50:12.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.937+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential dests added=[] removed=[] 2024-09-12T00:50:12.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.938+0000 7fde85917800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.31.0 2024-09-12T00:50:12.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.938+0000 7fde85917800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:12.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.938+0000 7fde85917800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 2024-09-12T00:50:12.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.939+0000 7fde85917800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:12.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.939+0000 7fde85917800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:12.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.939+0000 7fde85917800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:12.939 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.939+0000 7fde85917800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31, ofs0, ns] 2024-09-12T00:50:12.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.940+0000 7fdd66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94437179062688 notifier 6848 bl.length()=983 2024-09-12T00:50:12.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.940+0000 7fdd66ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 info.flags=0x17 2024-09-12T00:50:12.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.940+0000 7fdd66ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.31 to cache LRU end 2024-09-12T00:50:12.940 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.940+0000 7fdd66ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:12.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.940+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_sources= new_sources= 2024-09-12T00:50:12.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.940+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential sources added=[] removed=[] 2024-09-12T00:50:12.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.940+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): orig_dests= new_dests= 2024-09-12T00:50:12.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.940+0000 7fde85917800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.31]): potential dests added=[] removed=[] 2024-09-12T00:50:12.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.941+0000 7fde85917800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:12.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.943+0000 7fdd39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.946+0000 7fde85917800 20 remove_watcher() i=0 2024-09-12T00:50:12.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.946+0000 7fde85917800 2 removed watcher, disabling cache 2024-09-12T00:50:12.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.947+0000 7fde85917800 20 remove_watcher() i=1 2024-09-12T00:50:12.946 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.948+0000 7fde85917800 20 remove_watcher() i=2 2024-09-12T00:50:12.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.949+0000 7fde85917800 20 remove_watcher() i=3 2024-09-12T00:50:12.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.950+0000 7fde85917800 20 remove_watcher() i=4 2024-09-12T00:50:12.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.951+0000 7fde85917800 20 remove_watcher() i=5 2024-09-12T00:50:12.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.952+0000 7fde85917800 20 remove_watcher() i=6 2024-09-12T00:50:12.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:12.953+0000 7fde85917800 20 remove_watcher() i=7 2024-09-12T00:50:12.964 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:50:12.992 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:12.993 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:13.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.217+0000 7f109556b640 0 --2- 172.21.15.83:0/4249844326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e9c644bd0 0x562e9c7cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:50:13.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.232+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.235+0000 7f1099e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.235+0000 7f1099e0e800 20 realm 2024-09-12T00:50:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.235+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.235+0000 7f1099e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.235+0000 7f1099e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.235+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.235+0000 7f1099e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.235+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.236+0000 7f1099e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.236+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.236+0000 7f1099e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:13.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.236+0000 7f1099e0e800 20 searching for the correct realm 2024-09-12T00:50:13.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.238+0000 7f109556b640 0 -- 172.21.15.83:0/937204089 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f10880759e0 msgr2=0x7f1088009ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:13.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.443+0000 7f1095d6c640 0 -- 172.21.15.83:0/937204089 >> [v2:172.21.15.120:6816/3242240032,v1:172.21.15.120:6817/3242240032] conn(0x7f108809db30 msgr2=0x7f108809b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:13.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:13.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:13.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 zone default found 2024-09-12T00:50:13.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 4 Realm: () 2024-09-12T00:50:13.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:13.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:13.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:13.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.650+0000 7f1099e0e800 20 zonegroup default 2024-09-12T00:50:13.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.651+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.651+0000 7f1099e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.651+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.651 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.651+0000 7f1099e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.651+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.651+0000 7f1099e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.651+0000 7f1099e0e800 20 started sync module instance, tier type = 2024-09-12T00:50:13.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.651+0000 7f1099e0e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:13.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.661+0000 7f1099e0e800 20 add_watcher() i=0 2024-09-12T00:50:13.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.661+0000 7f1099e0e800 20 add_watcher() i=1 2024-09-12T00:50:13.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.661+0000 7f1099e0e800 20 add_watcher() i=2 2024-09-12T00:50:13.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.661+0000 7f1099e0e800 20 add_watcher() i=3 2024-09-12T00:50:13.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.661+0000 7f1099e0e800 20 add_watcher() i=4 2024-09-12T00:50:13.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.661+0000 7f1099e0e800 20 add_watcher() i=5 2024-09-12T00:50:13.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.661+0000 7f1099e0e800 20 add_watcher() i=6 2024-09-12T00:50:13.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.662+0000 7f1099e0e800 20 add_watcher() i=7 2024-09-12T00:50:13.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.662+0000 7f1099e0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:13.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.664+0000 7f0f4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.664+0000 7f1099e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.664+0000 7f1099e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.664+0000 7f1099e0e800 5 note: GC not initialized 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.664+0000 7f0f4a7e4640 20 reqs_thread_entry: start 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.665+0000 7f1099e0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.665+0000 7f1099e0e800 20 Filter name: none 2024-09-12T00:50:13.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.665+0000 7f0ebbfff640 20 reqs_thread_entry: start 2024-09-12T00:50:13.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.665+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.665+0000 7f1099e0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:13.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.665+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.665+0000 7f1099e0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:13.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.666+0000 7f1099e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:13.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.666+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.666+0000 7f1099e0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:13.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.666+0000 7f1099e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.666+0000 7f1099e0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:13.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.666+0000 7f1099e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:13.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.667+0000 7f0f4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:13.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.670+0000 7f1099e0e800 20 remove_watcher() i=0 2024-09-12T00:50:13.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.670+0000 7f1099e0e800 2 removed watcher, disabling cache 2024-09-12T00:50:13.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.671+0000 7f1099e0e800 20 remove_watcher() i=1 2024-09-12T00:50:13.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.672+0000 7f1099e0e800 20 remove_watcher() i=2 2024-09-12T00:50:13.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.673+0000 7f1099e0e800 20 remove_watcher() i=3 2024-09-12T00:50:13.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.674+0000 7f1099e0e800 20 remove_watcher() i=4 2024-09-12T00:50:13.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.675+0000 7f1099e0e800 20 remove_watcher() i=5 2024-09-12T00:50:13.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.676+0000 7f1099e0e800 20 remove_watcher() i=6 2024-09-12T00:50:13.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:13.677+0000 7f1099e0e800 20 remove_watcher() i=7 2024-09-12T00:50:13.686 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:13.687 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:13.687 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.31 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:13.687 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:13.688 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.688 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.691 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.691 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.734 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.734 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.748 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:50:13.748 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:13.749 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.749 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.758 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.758 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.801 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.801 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.809 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.809 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.816 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.816 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.824 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.825 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.832 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.832 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.841 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.841 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.848 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.849 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.856 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.856 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.864 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.864 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.871 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.871 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.878 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.879 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.886 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.886 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.893 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.893 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.901 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.901 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.908 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.908 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.915 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.915 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.923 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.923 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.930 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.930 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.937 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.938 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.945 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:13.945 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:13.954 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:50:13.982 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:13.983 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:14.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.019+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.021+0000 7f5efd93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.021+0000 7f5efd93d800 20 realm 2024-09-12T00:50:14.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.021+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.021+0000 7f5efd93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.021+0000 7f5efd93d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:14.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.021+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.021+0000 7f5efd93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.021+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.022+0000 7f5efd93d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:14.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.022+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.022+0000 7f5efd93d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:14.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.022+0000 7f5efd93d800 20 searching for the correct realm 2024-09-12T00:50:14.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.026+0000 7f5ef8e29640 0 -- 172.21.15.83:0/992443595 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f5ef007d960 msgr2=0x7f5ef008c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:14.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.230+0000 7f5ef8e29640 0 -- 172.21.15.83:0/992443595 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55e8bf8a8940 msgr2=0x55e8bf8aad30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:14.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.234+0000 7f5efd93d800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:14.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.234+0000 7f5efd93d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:14.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.234+0000 7f5efd93d800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:14.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.234+0000 7f5efd93d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:14.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.234+0000 7f5efd93d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:14.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.234+0000 7f5efd93d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:14.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.234+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.234+0000 7f5efd93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.234+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.236 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:14.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:14.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 zone default found 2024-09-12T00:50:14.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 4 Realm: () 2024-09-12T00:50:14.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:14.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:14.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:14.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 zonegroup default 2024-09-12T00:50:14.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.235+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.236+0000 7f5efd93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.236+0000 7f5efd93d800 20 started sync module instance, tier type = 2024-09-12T00:50:14.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.236+0000 7f5efd93d800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:14.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.244+0000 7f5efd93d800 20 add_watcher() i=0 2024-09-12T00:50:14.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.245+0000 7f5efd93d800 20 add_watcher() i=1 2024-09-12T00:50:14.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.245+0000 7f5efd93d800 20 add_watcher() i=2 2024-09-12T00:50:14.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.245+0000 7f5efd93d800 20 add_watcher() i=3 2024-09-12T00:50:14.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.245+0000 7f5efd93d800 20 add_watcher() i=4 2024-09-12T00:50:14.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.245+0000 7f5efd93d800 20 add_watcher() i=5 2024-09-12T00:50:14.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.245+0000 7f5efd93d800 20 add_watcher() i=6 2024-09-12T00:50:14.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.245+0000 7f5efd93d800 20 add_watcher() i=7 2024-09-12T00:50:14.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.245+0000 7f5efd93d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:14.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.247+0000 7f5daffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:14.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.248+0000 7f5efd93d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:14.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.248+0000 7f5efd93d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:14.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.248+0000 7f5efd93d800 5 note: GC not initialized 2024-09-12T00:50:14.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.248+0000 7f5daefe5640 20 reqs_thread_entry: start 2024-09-12T00:50:14.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.248+0000 7f5efd93d800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:14.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.248+0000 7f5efd93d800 20 Filter name: none 2024-09-12T00:50:14.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.248+0000 7f5dacfe1640 20 reqs_thread_entry: start 2024-09-12T00:50:14.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.248+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.249+0000 7f5efd93d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:14.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.249+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.249+0000 7f5efd93d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:14.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.249+0000 7f5efd93d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:14.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.249+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.249+0000 7f5efd93d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:14.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.249+0000 7f5efd93d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.250+0000 7f5efd93d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:14.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.250+0000 7f5efd93d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:14.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.251+0000 7f5daffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:14.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.253+0000 7f5efd93d800 20 remove_watcher() i=0 2024-09-12T00:50:14.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.253+0000 7f5efd93d800 2 removed watcher, disabling cache 2024-09-12T00:50:14.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.254+0000 7f5efd93d800 20 remove_watcher() i=1 2024-09-12T00:50:14.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.255+0000 7f5efd93d800 20 remove_watcher() i=2 2024-09-12T00:50:14.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.256+0000 7f5efd93d800 20 remove_watcher() i=3 2024-09-12T00:50:14.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.257+0000 7f5efd93d800 20 remove_watcher() i=4 2024-09-12T00:50:14.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.258+0000 7f5efd93d800 20 remove_watcher() i=5 2024-09-12T00:50:14.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.259+0000 7f5efd93d800 20 remove_watcher() i=6 2024-09-12T00:50:14.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.260+0000 7f5efd93d800 20 remove_watcher() i=7 2024-09-12T00:50:14.269 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:14.270 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:14.270 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:14.270 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:14.271 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:50:14.308 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:14.308 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:14.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.549+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.550+0000 7f2560f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.550+0000 7f2560f39800 20 realm 2024-09-12T00:50:14.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.550+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.550+0000 7f2560f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.550+0000 7f2560f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:14.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.550+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.551+0000 7f2560f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.551+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.551+0000 7f2560f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:14.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.551+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.552+0000 7f2560f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:14.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.552+0000 7f2560f39800 20 searching for the correct realm 2024-09-12T00:50:14.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.555+0000 7f2557fff640 0 -- 172.21.15.83:0/163894914 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f25480c7b30 msgr2=0x7f25480b1900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:14.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.760+0000 7f255d3c8640 0 -- 172.21.15.83:0/163894914 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x558c18dd3860 msgr2=0x558c18dd5cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:14.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.764+0000 7f2560f39800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:14.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.764+0000 7f2560f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:14.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.764+0000 7f2560f39800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:14.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.764+0000 7f2560f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.764+0000 7f2560f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.764+0000 7f2560f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.764+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 20 zone default found 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 4 Realm: () 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:14.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 20 zonegroup default 2024-09-12T00:50:14.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.765+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.766+0000 7f2560f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.766+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.766+0000 7f2560f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.766+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.766+0000 7f2560f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.766+0000 7f2560f39800 20 started sync module instance, tier type = 2024-09-12T00:50:14.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.766+0000 7f2560f39800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:14.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.775+0000 7f2560f39800 20 add_watcher() i=0 2024-09-12T00:50:14.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.775+0000 7f2560f39800 20 add_watcher() i=1 2024-09-12T00:50:14.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.775+0000 7f2560f39800 20 add_watcher() i=2 2024-09-12T00:50:14.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.775+0000 7f2560f39800 20 add_watcher() i=3 2024-09-12T00:50:14.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.775+0000 7f2560f39800 20 add_watcher() i=4 2024-09-12T00:50:14.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.775+0000 7f2560f39800 20 add_watcher() i=5 2024-09-12T00:50:14.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.775+0000 7f2560f39800 20 add_watcher() i=6 2024-09-12T00:50:14.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.776+0000 7f2560f39800 20 add_watcher() i=7 2024-09-12T00:50:14.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.776+0000 7f2560f39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:14.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.777+0000 7f2412fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.778+0000 7f2560f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.778+0000 7f2560f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.778+0000 7f2560f39800 5 note: GC not initialized 2024-09-12T00:50:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.778+0000 7f2411fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.778+0000 7f2560f39800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:14.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.778+0000 7f2560f39800 20 Filter name: none 2024-09-12T00:50:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.778+0000 7f23837fe640 20 reqs_thread_entry: start 2024-09-12T00:50:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.778+0000 7f2560f39800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:50:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.778+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:50:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:50:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 : miss 2024-09-12T00:50:14.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 info.flags=0x17 2024-09-12T00:50:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 to cache LRU end 2024-09-12T00:50:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:14.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.779+0000 7f2560f39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 2024-09-12T00:50:14.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.782+0000 7f2560f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 info.flags=0x17 2024-09-12T00:50:14.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.782+0000 7f2560f39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 to cache LRU end 2024-09-12T00:50:14.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.782+0000 7f2560f39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:14.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.782+0000 7f2560f39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32, ofs0, ns] 2024-09-12T00:50:14.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.783+0000 7f24337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464369 cookie 94060200997376 notifier 6899 bl.length()=1015 2024-09-12T00:50:14.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.783+0000 7f24337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 info.flags=0x17 2024-09-12T00:50:14.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.783+0000 7f24337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 to cache LRU end 2024-09-12T00:50:14.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.783+0000 7f24337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:14.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.783+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): orig_sources= new_sources= 2024-09-12T00:50:14.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.783+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): potential sources added=[] removed=[] 2024-09-12T00:50:14.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.783+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): orig_dests= new_dests= 2024-09-12T00:50:14.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.783+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): potential dests added=[] removed=[] 2024-09-12T00:50:14.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.785+0000 7f2560f39800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.32.1.0 2024-09-12T00:50:14.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.785+0000 7f2560f39800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.32.1.0 2024-09-12T00:50:14.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.785+0000 7f2560f39800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.32.1.1 2024-09-12T00:50:14.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.785+0000 7f2560f39800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.32.1.1 2024-09-12T00:50:14.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.785+0000 7f2560f39800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.32.0 2024-09-12T00:50:14.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.787+0000 7f2560f39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:14.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.787+0000 7f2560f39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 2024-09-12T00:50:14.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.788+0000 7f2560f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 info.flags=0x17 2024-09-12T00:50:14.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.788+0000 7f2560f39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 to cache LRU end 2024-09-12T00:50:14.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.788+0000 7f2560f39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:14.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.788+0000 7f2560f39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32, ofs0, ns] 2024-09-12T00:50:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.789+0000 7f24337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464370 cookie 94060200997376 notifier 6899 bl.length()=1015 2024-09-12T00:50:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.789+0000 7f24337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 info.flags=0x17 2024-09-12T00:50:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.789+0000 7f24337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 to cache LRU end 2024-09-12T00:50:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.789+0000 7f24337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.789+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): orig_sources= new_sources= 2024-09-12T00:50:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.789+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): potential sources added=[] removed=[] 2024-09-12T00:50:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.789+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): orig_dests= new_dests= 2024-09-12T00:50:14.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.789+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): potential dests added=[] removed=[] 2024-09-12T00:50:14.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.790+0000 7f2560f39800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.32.0 2024-09-12T00:50:14.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.790+0000 7f2560f39800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:50:14.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.790+0000 7f2560f39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:14.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.790+0000 7f2560f39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 2024-09-12T00:50:14.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f2560f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 info.flags=0x17 2024-09-12T00:50:14.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f2560f39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 to cache LRU end 2024-09-12T00:50:14.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f2560f39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:14.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f2560f39800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32, ofs0, ns] 2024-09-12T00:50:14.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f24337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464371 cookie 94060200997376 notifier 6899 bl.length()=983 2024-09-12T00:50:14.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f24337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 info.flags=0x17 2024-09-12T00:50:14.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f24337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.32 to cache LRU end 2024-09-12T00:50:14.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f24337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:14.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): orig_sources= new_sources= 2024-09-12T00:50:14.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): potential sources added=[] removed=[] 2024-09-12T00:50:14.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): orig_dests= new_dests= 2024-09-12T00:50:14.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.792+0000 7f2560f39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.32]): potential dests added=[] removed=[] 2024-09-12T00:50:14.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.793+0000 7f2560f39800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:14.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.795+0000 7f2412fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:14.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.797+0000 7f2560f39800 20 remove_watcher() i=0 2024-09-12T00:50:14.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.797+0000 7f2560f39800 2 removed watcher, disabling cache 2024-09-12T00:50:14.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.798+0000 7f2560f39800 20 remove_watcher() i=1 2024-09-12T00:50:14.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.799+0000 7f2560f39800 20 remove_watcher() i=2 2024-09-12T00:50:14.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.800+0000 7f2560f39800 20 remove_watcher() i=3 2024-09-12T00:50:14.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.802+0000 7f2560f39800 20 remove_watcher() i=4 2024-09-12T00:50:14.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.803+0000 7f2560f39800 20 remove_watcher() i=5 2024-09-12T00:50:14.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.804+0000 7f2560f39800 20 remove_watcher() i=6 2024-09-12T00:50:14.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.804+0000 7f2560f39800 20 remove_watcher() i=7 2024-09-12T00:50:14.815 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:50:14.843 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:14.844 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:14.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.881+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.883+0000 7fbde2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.883+0000 7fbde2d46800 20 realm 2024-09-12T00:50:14.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.883+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.883+0000 7fbde2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.883+0000 7fbde2d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:14.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.883+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.883+0000 7fbde2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.883+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.884+0000 7fbde2d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:14.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.884+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.884+0000 7fbde2d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:14.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.884+0000 7fbde2d46800 20 searching for the correct realm 2024-09-12T00:50:14.886 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:14.887+0000 7fbde0036640 0 -- 172.21.15.83:0/965115005 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fbdc806c920 msgr2=0x7fbdc8061400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:15.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.092+0000 7fbde1038640 0 -- 172.21.15.83:0/965115005 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x561551efc6e0 msgr2=0x561551efeaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:15.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.096+0000 7fbde2d46800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:15.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.096+0000 7fbde2d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:15.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.096+0000 7fbde2d46800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:15.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.096+0000 7fbde2d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:15.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.096+0000 7fbde2d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:15.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.096+0000 7fbde2d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:15.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.096+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.096+0000 7fbde2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.096+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 20 zone default found 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 4 Realm: () 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 20 zonegroup default 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.097+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.098+0000 7fbde2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.098+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.098+0000 7fbde2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.098+0000 7fbde2d46800 20 started sync module instance, tier type = 2024-09-12T00:50:15.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.098+0000 7fbde2d46800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:15.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.106+0000 7fbde2d46800 20 add_watcher() i=0 2024-09-12T00:50:15.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.106+0000 7fbde2d46800 20 add_watcher() i=1 2024-09-12T00:50:15.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.106+0000 7fbde2d46800 20 add_watcher() i=2 2024-09-12T00:50:15.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.106+0000 7fbde2d46800 20 add_watcher() i=3 2024-09-12T00:50:15.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.106+0000 7fbde2d46800 20 add_watcher() i=4 2024-09-12T00:50:15.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.106+0000 7fbde2d46800 20 add_watcher() i=5 2024-09-12T00:50:15.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.106+0000 7fbde2d46800 20 add_watcher() i=6 2024-09-12T00:50:15.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.107+0000 7fbde2d46800 20 add_watcher() i=7 2024-09-12T00:50:15.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.107+0000 7fbde2d46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:15.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.109+0000 7fbc977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:15.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.109+0000 7fbde2d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:15.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.109+0000 7fbde2d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:15.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.109+0000 7fbde2d46800 5 note: GC not initialized 2024-09-12T00:50:15.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.109+0000 7fbc967e4640 20 reqs_thread_entry: start 2024-09-12T00:50:15.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.109+0000 7fbde2d46800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:15.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.109+0000 7fbde2d46800 20 Filter name: none 2024-09-12T00:50:15.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.109+0000 7fbc8f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:15.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.109+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.110+0000 7fbde2d46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:15.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.110+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.110+0000 7fbde2d46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:15.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.110+0000 7fbde2d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:15.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.110+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.111+0000 7fbde2d46800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:15.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.111+0000 7fbde2d46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.111+0000 7fbde2d46800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:15.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.111+0000 7fbde2d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:15.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.112+0000 7fbc977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:15.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.115+0000 7fbde2d46800 20 remove_watcher() i=0 2024-09-12T00:50:15.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.115+0000 7fbde2d46800 2 removed watcher, disabling cache 2024-09-12T00:50:15.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.116+0000 7fbde2d46800 20 remove_watcher() i=1 2024-09-12T00:50:15.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.117+0000 7fbde2d46800 20 remove_watcher() i=2 2024-09-12T00:50:15.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.118+0000 7fbde2d46800 20 remove_watcher() i=3 2024-09-12T00:50:15.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.118+0000 7fbde2d46800 20 remove_watcher() i=4 2024-09-12T00:50:15.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.119+0000 7fbde2d46800 20 remove_watcher() i=5 2024-09-12T00:50:15.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.120+0000 7fbde2d46800 20 remove_watcher() i=6 2024-09-12T00:50:15.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.121+0000 7fbde2d46800 20 remove_watcher() i=7 2024-09-12T00:50:15.130 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:15.130 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:15.130 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-commit-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.32 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:50:15.130 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:15.131 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.132 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.135 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.135 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.178 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.178 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.191 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:50:15.191 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:15.193 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.193 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.203 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.203 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.246 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.246 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.254 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.254 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.262 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.262 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.270 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.270 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.278 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.278 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.287 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.287 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.294 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.295 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.302 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.302 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.310 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.310 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.318 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.318 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.326 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.327 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.334 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.335 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.342 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.342 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.351 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.351 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.359 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.359 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.367 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.367 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.374 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.374 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.382 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.382 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.390 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.390 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.398 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:15.398 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:15.406 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:50:15.435 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:15.435 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:15.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.472+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.474+0000 7f3df392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.474+0000 7f3df392a800 20 realm 2024-09-12T00:50:15.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.474+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.474+0000 7f3df392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.474+0000 7f3df392a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:15.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.474+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.475+0000 7f3df392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.475+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.475+0000 7f3df392a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:15.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.475+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.476+0000 7f3df392a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:15.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.476+0000 7f3df392a800 20 searching for the correct realm 2024-09-12T00:50:15.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.477+0000 7f3def6ad640 0 -- 172.21.15.83:0/1272314376 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x55d8f2590bf0 msgr2=0x55d8f2592fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:15.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.480+0000 7f3defeae640 0 -- 172.21.15.83:0/1272314376 >> [v2:172.21.15.120:6816/3242240032,v1:172.21.15.120:6817/3242240032] conn(0x55d8f2590bf0 msgr2=0x7f3de008f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:15.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 zone default found 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 4 Realm: () 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 zonegroup default 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.687+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.688+0000 7f3df392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.688+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.688+0000 7f3df392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.688+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.688+0000 7f3df392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.689+0000 7f3df392a800 20 started sync module instance, tier type = 2024-09-12T00:50:15.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.689+0000 7f3df392a800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:15.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.697+0000 7f3df392a800 20 add_watcher() i=0 2024-09-12T00:50:15.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.697+0000 7f3df392a800 20 add_watcher() i=1 2024-09-12T00:50:15.696 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.697+0000 7f3df392a800 20 add_watcher() i=2 2024-09-12T00:50:15.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.697+0000 7f3df392a800 20 add_watcher() i=3 2024-09-12T00:50:15.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.697+0000 7f3df392a800 20 add_watcher() i=4 2024-09-12T00:50:15.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.697+0000 7f3df392a800 20 add_watcher() i=5 2024-09-12T00:50:15.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.697+0000 7f3df392a800 20 add_watcher() i=6 2024-09-12T00:50:15.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.698+0000 7f3df392a800 20 add_watcher() i=7 2024-09-12T00:50:15.697 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.698+0000 7f3df392a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:15.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.700+0000 7f3ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:15.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.701+0000 7f3df392a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:15.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.701+0000 7f3df392a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:15.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.701+0000 7f3df392a800 5 note: GC not initialized 2024-09-12T00:50:15.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.701+0000 7f3ca4fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:15.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.701+0000 7f3df392a800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:15.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.701+0000 7f3df392a800 20 Filter name: none 2024-09-12T00:50:15.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.701+0000 7f3c1e7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:15.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.701+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.702+0000 7f3df392a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:15.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.702+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.702+0000 7f3df392a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:15.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.702+0000 7f3df392a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:15.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.702+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.703+0000 7f3df392a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:15.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.703+0000 7f3df392a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.703+0000 7f3df392a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:15.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.703+0000 7f3df392a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:15.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.704+0000 7f3ca5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:15.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.707+0000 7f3df392a800 20 remove_watcher() i=0 2024-09-12T00:50:15.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.707+0000 7f3df392a800 2 removed watcher, disabling cache 2024-09-12T00:50:15.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.708+0000 7f3df392a800 20 remove_watcher() i=1 2024-09-12T00:50:15.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.709+0000 7f3df392a800 20 remove_watcher() i=2 2024-09-12T00:50:15.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.710+0000 7f3df392a800 20 remove_watcher() i=3 2024-09-12T00:50:15.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.711+0000 7f3df392a800 20 remove_watcher() i=4 2024-09-12T00:50:15.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.712+0000 7f3df392a800 20 remove_watcher() i=5 2024-09-12T00:50:15.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.713+0000 7f3df392a800 20 remove_watcher() i=6 2024-09-12T00:50:15.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.714+0000 7f3df392a800 20 remove_watcher() i=7 2024-09-12T00:50:15.722 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:15.723 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:15.723 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-commit-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:15.723 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:15.724 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:50:15.758 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:15.759 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:15.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.796+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.798+0000 7f9b7df75800 20 realm 2024-09-12T00:50:15.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.798+0000 7f9b7df75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:15.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.799+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:15.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.799+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.799+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:15.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.799+0000 7f9b7df75800 20 searching for the correct realm 2024-09-12T00:50:15.801 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:15.802+0000 7f9b73fff640 0 -- 172.21.15.83:0/2583773492 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f9b64075e00 msgr2=0x7f9b64071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:16.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.007+0000 7f9b7c260640 0 -- 172.21.15.83:0/2583773492 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x559e122d5bd0 msgr2=0x559e122d8040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:16.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:16.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:16.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:16.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:16.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:16.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:16.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 20 zone default found 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 4 Realm: () 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 20 zonegroup default 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.013+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.013+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.013+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.013+0000 7f9b7df75800 20 started sync module instance, tier type = 2024-09-12T00:50:16.014 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.013+0000 7f9b7df75800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:16.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=0 2024-09-12T00:50:16.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=1 2024-09-12T00:50:16.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=2 2024-09-12T00:50:16.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=3 2024-09-12T00:50:16.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=4 2024-09-12T00:50:16.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=5 2024-09-12T00:50:16.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=6 2024-09-12T00:50:16.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.023+0000 7f9b7df75800 20 add_watcher() i=7 2024-09-12T00:50:16.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.023+0000 7f9b7df75800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:16.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.024+0000 7f9a31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:16.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.025+0000 7f9b7df75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:16.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.025+0000 7f9b7df75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:16.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.025+0000 7f9b7df75800 5 note: GC not initialized 2024-09-12T00:50:16.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.025+0000 7f9a30fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.025+0000 7f9b7df75800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.025+0000 7f9b7df75800 20 Filter name: none 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.025+0000 7f99aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.025+0000 7f9b7df75800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.025+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 : miss 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:16.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:16.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.026+0000 7f9b7df75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 2024-09-12T00:50:16.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.030+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.030+0000 7f9b7df75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.030+0000 7f9b7df75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.030+0000 7f9b7df75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33, ofs0, ns] 2024-09-12T00:50:16.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464386 cookie 94137398216080 notifier 6947 bl.length()=1015 2024-09-12T00:50:16.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_sources= new_sources= 2024-09-12T00:50:16.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential sources added=[] removed=[] 2024-09-12T00:50:16.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_dests= new_dests= 2024-09-12T00:50:16.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential dests added=[] removed=[] 2024-09-12T00:50:16.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.033+0000 7f9b7df75800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.0 2024-09-12T00:50:16.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.033+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.0 2024-09-12T00:50:16.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.033+0000 7f9b7df75800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.1 2024-09-12T00:50:16.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.033+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.1 2024-09-12T00:50:16.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.033+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.0 2024-09-12T00:50:16.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.036+0000 7f9b7df75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:16.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.036+0000 7f9b7df75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 2024-09-12T00:50:16.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.037+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.037+0000 7f9b7df75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.037+0000 7f9b7df75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.037+0000 7f9b7df75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33, ofs0, ns] 2024-09-12T00:50:16.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464387 cookie 94137398216080 notifier 6947 bl.length()=1015 2024-09-12T00:50:16.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_sources= new_sources= 2024-09-12T00:50:16.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential sources added=[] removed=[] 2024-09-12T00:50:16.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_dests= new_dests= 2024-09-12T00:50:16.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential dests added=[] removed=[] 2024-09-12T00:50:16.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.039+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.0 2024-09-12T00:50:16.038 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9b7df75800 time 2024-09-12T00:50:16.040420+0000 2024-09-12T00:50:16.038 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:16.038 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:16.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9b8158c71a] 2024-09-12T00:50:16.038 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9b8158c8d8] 2024-09-12T00:50:16.039 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559e0fff8641] 2024-09-12T00:50:16.039 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559e10008637] 2024-09-12T00:50:16.039 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:50:16.039 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9b80229590] 2024-09-12T00:50:16.039 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:50:16.040 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:50:16.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.040+0000 7f9b7df75800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9b7df75800 time 2024-09-12T00:50:16.040420+0000 2024-09-12T00:50:16.040 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:16.040 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.040 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:16.041 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9b8158c71a] 2024-09-12T00:50:16.041 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9b8158c8d8] 2024-09-12T00:50:16.041 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559e0fff8641] 2024-09-12T00:50:16.041 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559e10008637] 2024-09-12T00:50:16.041 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:50:16.042 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9b80229590] 2024-09-12T00:50:16.042 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:50:16.042 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:50:16.042 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.042 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:50:16.042 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f9b7df75800 thread_name:radosgw-admin 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9b8023e6f0] 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9b8028b99c] 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9b8158c774] 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9b8158c8d8] 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559e0fff8641] 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559e10008637] 2024-09-12T00:50:16.067 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:50:16.068 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9b80229590] 2024-09-12T00:50:16.068 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:50:16.068 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:50:16.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.041+0000 7f9b7df75800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:16.068 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f9b7df75800 thread_name:radosgw-admin 2024-09-12T00:50:16.068 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.068 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:16.068 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9b8023e6f0] 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9b8028b99c] 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9b8158c774] 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9b8158c8d8] 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559e0fff8641] 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559e10008637] 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9b80229590] 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:50:16.069 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command objecter_requests hook 0x559e1221d000 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:50:15.781+0000 7f9b7df75800 1 librados: setting wanted keys 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:50:15.781+0000 7f9b7df75800 1 librados: calling monclient init 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient: init 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding auth protocol: cephx 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding auth protocol: cephx 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding auth protocol: cephx 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.070 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.071 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:50:15.781+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.072 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:50:15.781+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.072 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command rotate-key hook 0x559e121eacd8 2024-09-12T00:50:16.072 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:16.072 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:16.072 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-b con 0x559e120a1a10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:16.072 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-c con 0x559e1212ca30 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:16.072 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-a con 0x559e1212f880 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:16.072 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.072 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): authenticate will time out at 1969.050917s 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): get_auth_request con 0x559e1212f880 auth_method 0 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): get_auth_request con 0x559e1212ca30 auth_method 0 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.073 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.074 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.074 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.074 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request con 0x559e120a1a10 auth_method 0 2024-09-12T00:50:16.074 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.074 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.074 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.074 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.074 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.074 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): handle_auth_done global_id 7353 payload 824 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient: _finish_hunting 0 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:50:15.782+0000 7f9b7c260640 1 monclient: found mon.noname-a 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: dump: 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.075 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: _finish_auth 0 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:16.076 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.077 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:16.077 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: dump: 2024-09-12T00:50:16.077 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.077 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.077 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.077 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.077 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.077 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.077 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:50:15.782+0000 7f9b7df75800 5 monclient: authenticate success, global_id 7353 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:50:15.782+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:50:15.782+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:50:15.782+0000 7f9a69e0b640 4 set_mon_vals no callback set 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:50:15.782+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:50:15.782+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:50:15.782+0000 7f9b7df75800 1 librados: init done 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:50:15.784+0000 7f9a63fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:50:15.784+0000 7f9a63fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:50:15.784+0000 7f9a63fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.078 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:50:15.784+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x7f9a64076470 auth_method 0 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:50:15.785+0000 7f9b73fff640 10 monclient: get_auth_request con 0x559e12213ee0 auth_method 0 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:50:15.785+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x559e12236670 auth_method 0 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:50:15.787+0000 7f9b73fff640 10 monclient: get_auth_request con 0x559e1223b750 auth_method 0 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:50:15.787+0000 7f9b7df75800 10 monclient: build_initial_monmap 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:50:15.787+0000 7f9b7df75800 1 build_initial for_mkfs: 0 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:50:15.787+0000 7f9b7df75800 10 monclient: monmap: 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.079 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding auth protocol: cephx 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding auth protocol: cephx 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding auth protocol: cephx 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.080 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:50:15.787+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command objecter_requests cmddesc objecter_requests hook 0x559e122430b0 EEXIST 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient: init 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding auth protocol: cephx 2024-09-12T00:50:16.081 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding auth protocol: cephx 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding auth protocol: cephx 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.082 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:50:15.788+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:50:15.788+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command rotate-key cmddesc rotate-key hook 0x559e1223e860 EEXIST 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-a con 0x559e12266da0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-c con 0x559e12269070 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-b con 0x559e12265570 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.083 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): authenticate will time out at 1969.057627s 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request con 0x559e12266da0 auth_method 0 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): get_auth_request con 0x559e12269070 auth_method 0 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.084 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:50:15.788+0000 7f9b7c260640 10 monclient(hunting): get_auth_request con 0x559e12265570 auth_method 0 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:50:15.788+0000 7f9b7c260640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:50:15.788+0000 7f9b7c260640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:50:15.788+0000 7f9b7c260640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_done global_id 7356 payload 824 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient: _finish_hunting 0 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 1 monclient: found mon.noname-a 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:16.085 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: dump: 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.086 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: _finish_auth 0 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: _check_auth_tickets 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: dump: 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.087 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:50:15.789+0000 7f9b7df75800 5 monclient: authenticate success, global_id 7356 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:50:15.789+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:50:15.789+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:50:15.789+0000 7f9b7ca61640 4 set_mon_vals no callback set 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:50:15.789+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:50:15.789+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:50:15.791+0000 7f9a617fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:50:15.791+0000 7f9a617fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:50:15.791+0000 7f9a617fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.088 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:50:15.791+0000 7f9b73fff640 10 monclient: get_auth_request con 0x7f9a54076380 auth_method 0 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:50:15.791+0000 7f9b7df75800 10 monclient: get_monmap_and_config 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:50:15.791+0000 7f9b7df75800 10 monclient: build_initial_monmap 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:50:15.791+0000 7f9b7df75800 1 build_initial for_mkfs: 0 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:50:15.791+0000 7f9b7df75800 10 monclient: monmap: 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:16.089 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding auth protocol: cephx 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding auth protocol: cephx 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding auth protocol: cephx 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.090 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.091 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.091 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.091 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.091 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.091 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.091 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:50:15.791+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.091 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:50:15.791+0000 7f9b7df75800 10 monclient: init 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding auth protocol: cephx 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding auth protocol: cephx 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding auth protocol: cephx 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.092 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:50:15.792+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:50:15.792+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:50:15.792+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command rotate-key cmddesc rotate-key hook 0x7ffe16c78448 EEXIST 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-c con 0x559e122bb330 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:16.093 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-a con 0x559e122abc80 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-b con 0x559e122b6760 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): authenticate will time out at 1969.061493s 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request con 0x559e122bb330 auth_method 0 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): get_auth_request con 0x559e122abc80 auth_method 0 2024-09-12T00:50:16.094 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): get_auth_request con 0x559e122b6760 auth_method 0 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.095 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_done global_id 6944 payload 274 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient: _finish_hunting 0 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 1 monclient: found mon.noname-c 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: dump: 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.096 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: _finish_auth 0 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:16.097 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 monclient: authenticate success, global_id 6944 2024-09-12T00:50:16.098 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:16.098 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.098 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:16.098 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: dump: 2024-09-12T00:50:16.098 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.098 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:50:15.793+0000 7f9b7df75800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:50:15.793+0000 7f9b7df75800 4 set_mon_vals no callback set 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:50:15.793+0000 7f9b7df75800 10 monclient: shutdown 2024-09-12T00:50:16.099 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:50:15.793+0000 7f9b7df75800 10 monclient: build_initial_monmap 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:50:15.793+0000 7f9b7df75800 1 build_initial for_mkfs: 0 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:50:15.793+0000 7f9b7df75800 10 monclient: monmap: 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.100 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding auth protocol: cephx 2024-09-12T00:50:16.101 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding auth protocol: cephx 2024-09-12T00:50:16.101 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding auth protocol: cephx 2024-09-12T00:50:16.101 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.101 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.101 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.101 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.101 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.101 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.101 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:50:15.793+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:50:15.793+0000 7f9b7df75800 1 librados: starting msgr at 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:50:15.793+0000 7f9b7df75800 1 librados: starting objecter 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command objecter_requests cmddesc objecter_requests hook 0x559e1228cad0 EEXIST 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:50:15.794+0000 7f9b7df75800 1 librados: setting wanted keys 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:50:15.794+0000 7f9b7df75800 1 librados: calling monclient init 2024-09-12T00:50:16.102 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient: init 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding auth protocol: cephx 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding auth protocol: cephx 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding auth protocol: cephx 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.103 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:50:15.794+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:50:15.794+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command rotate-key cmddesc rotate-key hook 0x559e1227ec98 EEXIST 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-a con 0x559e122abc80 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-c con 0x559e122b6760 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:16.104 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-b con 0x559e122bb330 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): authenticate will time out at 1969.063675s 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request con 0x559e122abc80 auth_method 0 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.105 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): get_auth_request con 0x559e122b6760 auth_method 0 2024-09-12T00:50:16.106 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.106 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.106 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.106 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.106 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.106 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): get_auth_request con 0x559e122bb330 auth_method 0 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.107 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): handle_auth_done global_id 6947 payload 824 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:50:15.795+0000 7f9b73fff640 10 monclient: _finish_hunting 0 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:50:15.795+0000 7f9b73fff640 1 monclient: found mon.noname-c 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:50:15.795+0000 7f9b73fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: dump: 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.108 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: _finish_auth 0 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: _check_auth_tickets 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: dump: 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.109 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:50:15.795+0000 7f9b7df75800 5 monclient: authenticate success, global_id 6947 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:50:15.795+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:50:15.795+0000 7f9a5affd640 4 set_mon_vals no callback set 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:50:15.795+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:50:15.795+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.110 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:50:15.795+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:50:15.795+0000 7f9b7df75800 1 librados: init done 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:50:15.795+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cr dump hook 0x559e122b39d8 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:50:15.796+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:50:15.797+0000 7f9a597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:50:15.797+0000 7f9a597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:50:15.797+0000 7f9a597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:50:15.797+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x7f9a44076470 auth_method 0 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:50:15.797+0000 7f9b7c260640 10 monclient: get_auth_request con 0x559e122d5bd0 auth_method 0 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 realm 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.111 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:50:15.798+0000 7f9b7df75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:50:15.798+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x559e122d9f30 auth_method 0 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:50:15.799+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:50:15.799+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:50:15.799+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:50:15.799+0000 7f9b7df75800 20 searching for the correct realm 2024-09-12T00:50:16.112 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:50:15.800+0000 7f9b73fff640 10 monclient: get_auth_request con 0x559e122df040 auth_method 0 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:50:15.800+0000 7f9b7c260640 10 monclient: get_auth_request con 0x7f9b6406d310 auth_method 0 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:50:15.801+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x7f9b6c085060 auth_method 0 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:50:15.802+0000 7f9b73fff640 10 monclient: get_auth_request con 0x7f9b64075e00 auth_method 0 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:50:15.802+0000 7f9b73fff640 0 -- 172.21.15.83:0/2583773492 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f9b64075e00 msgr2=0x7f9b64071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:50:16.003+0000 7f9b73fff640 10 monclient: get_auth_request con 0x7f9b64075e00 auth_method 0 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:50:16.005+0000 7f9b7c260640 10 monclient: get_auth_request con 0x7f9b6c063070 auth_method 0 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:50:16.006+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x7f9b74015030 auth_method 0 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:50:16.007+0000 7f9b7c260640 0 -- 172.21.15.83:0/2583773492 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x559e122d5bd0 msgr2=0x559e122d8040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:50:16.007+0000 7f9a597fa640 1 client.6947.objecter ms_handle_reset 0x559e122d5bd0 session 0x559e122d5500 osd.6 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:50:16.007+0000 7f9a597fa640 10 monclient: _renew_subs 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:50:16.007+0000 7f9a597fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.113 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:50:16.007+0000 7f9b7c260640 10 monclient: get_auth_request con 0x7f9a44086790 auth_method 0 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:50:16.010+0000 7f9a597fa640 1 client.6947.objecter ms_handle_reset 0x7f9b74015030 session 0x7f9b74095040 osd.3 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:50:16.010+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x559e122d5bd0 auth_method 0 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.114 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 zone default found 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:50:16.012+0000 7f9b7df75800 4 Realm: () 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:50:16.012+0000 7f9b7df75800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:50:16.012+0000 7f9b7df75800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:50:16.012+0000 7f9b7df75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 zonegroup default 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.115 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.116 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.116 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.116 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 started sync module instance, tier type = 2024-09-12T00:50:16.116 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:16.116 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=0 2024-09-12T00:50:16.116 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=1 2024-09-12T00:50:16.116 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=2 2024-09-12T00:50:16.116 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=3 2024-09-12T00:50:16.116 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=4 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=5 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=6 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:50:16.023+0000 7f9b7df75800 20 add_watcher() i=7 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:50:16.023+0000 7f9b7df75800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding auth protocol: cephx 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding auth protocol: cephx 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding auth protocol: cephx 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.117 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.118 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:50:16.024+0000 7f9a31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:50:16.025+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cache list hook 0x559e122c9040 2024-09-12T00:50:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cache inspect hook 0x559e122c9040 2024-09-12T00:50:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cache erase hook 0x559e122c9040 2024-09-12T00:50:16.119 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cache zap hook 0x559e122c9040 2024-09-12T00:50:16.120 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 note: GC not initialized 2024-09-12T00:50:16.120 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:50:16.025+0000 7f9a30fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:16.120 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command sync trace show hook 0x7f9b6c004040 2024-09-12T00:50:16.120 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command sync trace history hook 0x7f9b6c004040 2024-09-12T00:50:16.120 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command sync trace active hook 0x7f9b6c004040 2024-09-12T00:50:16.120 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command sync trace active_short hook 0x7f9b6c004040 2024-09-12T00:50:16.120 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:16.120 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 Filter name: none 2024-09-12T00:50:16.120 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:50:16.025+0000 7f99aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:50:16.025+0000 7f9b7df75800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:50:16.026+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 : miss 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:50:16.026+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:50:16.026+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.121 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:50:16.030+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:50:16.030+0000 7f9b7df75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:50:16.030+0000 7f9b7df75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:50:16.030+0000 7f9b7df75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33, ofs0, ns] 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464386 cookie 94137398216080 notifier 6947 bl.length()=1015 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.122 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_sources= new_sources= 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential sources added=[] removed=[] 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_dests= new_dests= 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential dests added=[] removed=[] 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:50:16.033+0000 7f9b7df75800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.0 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:50:16.033+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.0 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:50:16.033+0000 7f9b7df75800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.1 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:50:16.033+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.1 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:50:16.033+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.0 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:50:16.036+0000 7f9b7df75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:16.123 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:50:16.036+0000 7f9b7df75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 2024-09-12T00:50:16.124 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:50:16.037+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.124 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:50:16.037+0000 7f9b7df75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.124 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:50:16.037+0000 7f9b7df75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.124 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:50:16.037+0000 7f9b7df75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33, ofs0, ns] 2024-09-12T00:50:16.124 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464387 cookie 94137398216080 notifier 6947 bl.length()=1015 2024-09-12T00:50:16.124 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.124 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.124 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.125 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_sources= new_sources= 2024-09-12T00:50:16.125 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential sources added=[] removed=[] 2024-09-12T00:50:16.125 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_dests= new_dests= 2024-09-12T00:50:16.125 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential dests added=[] removed=[] 2024-09-12T00:50:16.125 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:50:16.039+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.0 2024-09-12T00:50:16.125 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:50:16.040+0000 7f9b7df75800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9b7df75800 time 2024-09-12T00:50:16.040420+0000 2024-09-12T00:50:16.125 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:16.125 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.126 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:16.126 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9b8158c71a] 2024-09-12T00:50:16.126 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9b8158c8d8] 2024-09-12T00:50:16.126 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559e0fff8641] 2024-09-12T00:50:16.126 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559e10008637] 2024-09-12T00:50:16.126 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:50:16.126 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9b80229590] 2024-09-12T00:50:16.126 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:50:16.126 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:50:16.041+0000 7f9b7df75800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f9b7df75800 thread_name:radosgw-admin 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9b8023e6f0] 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9b8028b99c] 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9b8158c774] 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9b8158c8d8] 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559e0fff8641] 2024-09-12T00:50:16.127 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559e10008637] 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9b80229590] 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:50:16.128 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:50:16.129 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:50:16.130 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:50:16.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:50:16.132 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:16.133 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:16.134 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 7f99aa7fc640 / http_manager 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a30fe1640 / http_manager 2024-09-12T00:50:16.135 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a31fe3640 / rgw_dt_lg_renew 2024-09-12T00:50:16.136 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a597fa640 / ms_dispatch 2024-09-12T00:50:16.136 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a5a7fc640 / io_context_pool 2024-09-12T00:50:16.136 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a5affd640 / io_context_pool 2024-09-12T00:50:16.136 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a617fa640 / ms_dispatch 2024-09-12T00:50:16.136 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a63fff640 / ms_dispatch 2024-09-12T00:50:16.136 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a69e0b640 / io_context_pool 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b73fff640 / msgr-worker-2 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b7ba5f640 / msgr-worker-1 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b7c260640 / msgr-worker-0 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b7ca61640 / io_context_pool 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b7df75800 / radosgw-admin 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.123108.log 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:50:16.137 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command objecter_requests hook 0x559e1221d000 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:50:15.781+0000 7f9b7df75800 1 librados: setting wanted keys 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:50:15.781+0000 7f9b7df75800 1 librados: calling monclient init 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient: init 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding auth protocol: cephx 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding auth protocol: cephx 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding auth protocol: cephx 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.138 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: crc 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 AuthRegistry(0x559e121eab90) adding con mode: secure 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:50:15.781+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:50:15.781+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:50:15.781+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command rotate-key hook 0x559e121eacd8 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-b con 0x559e120a1a10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-c con 0x559e1212ca30 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-a con 0x559e1212f880 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.139 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:50:15.781+0000 7f9b7df75800 10 monclient(hunting): authenticate will time out at 1969.050917s 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): get_auth_request con 0x559e1212f880 auth_method 0 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): get_auth_request con 0x559e1212ca30 auth_method 0 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.140 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request con 0x559e120a1a10 auth_method 0 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:50:15.782+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.141 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:50:15.782+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient(hunting): handle_auth_done global_id 7353 payload 824 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient: _finish_hunting 0 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:50:15.782+0000 7f9b7c260640 1 monclient: found mon.noname-a 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:50:15.782+0000 7f9b7c260640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: dump: 2024-09-12T00:50:16.142 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: _finish_auth 0 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.143 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:50:15.782+0000 7f9a63fff640 10 monclient: dump: 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:50:15.782+0000 7f9b7df75800 5 monclient: authenticate success, global_id 7353 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:50:15.782+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.144 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:50:15.782+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.145 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:50:15.782+0000 7f9a69e0b640 4 set_mon_vals no callback set 2024-09-12T00:50:16.145 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:50:15.782+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.145 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:50:15.782+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.145 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:50:15.782+0000 7f9b7df75800 1 librados: init done 2024-09-12T00:50:16.145 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:50:15.784+0000 7f9a63fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:16.145 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:50:15.784+0000 7f9a63fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.145 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:50:15.784+0000 7f9a63fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.146 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:50:15.784+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x7f9a64076470 auth_method 0 2024-09-12T00:50:16.146 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:50:15.785+0000 7f9b73fff640 10 monclient: get_auth_request con 0x559e12213ee0 auth_method 0 2024-09-12T00:50:16.146 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:50:15.785+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x559e12236670 auth_method 0 2024-09-12T00:50:16.146 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:50:15.787+0000 7f9b73fff640 10 monclient: get_auth_request con 0x559e1223b750 auth_method 0 2024-09-12T00:50:16.146 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:50:15.787+0000 7f9b7df75800 10 monclient: build_initial_monmap 2024-09-12T00:50:16.146 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:50:15.787+0000 7f9b7df75800 1 build_initial for_mkfs: 0 2024-09-12T00:50:16.146 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:50:15.787+0000 7f9b7df75800 10 monclient: monmap: 2024-09-12T00:50:16.146 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:16.146 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:16.147 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:16.147 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:16.147 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:16.147 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding auth protocol: cephx 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding auth protocol: cephx 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding auth protocol: cephx 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.148 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.149 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.149 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.149 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.149 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.149 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.149 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.149 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.149 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: crc 2024-09-12T00:50:16.150 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:50:15.787+0000 7f9b7df75800 5 AuthRegistry(0x559e1223f790) adding con mode: secure 2024-09-12T00:50:16.150 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:50:15.787+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.150 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command objecter_requests cmddesc objecter_requests hook 0x559e122430b0 EEXIST 2024-09-12T00:50:16.150 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient: init 2024-09-12T00:50:16.150 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding auth protocol: cephx 2024-09-12T00:50:16.150 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding auth protocol: cephx 2024-09-12T00:50:16.150 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding auth protocol: cephx 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: crc 2024-09-12T00:50:16.151 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 AuthRegistry(0x559e1223e718) adding con mode: secure 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:50:15.788+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:50:15.788+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:50:15.788+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command rotate-key cmddesc rotate-key hook 0x559e1223e860 EEXIST 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-a con 0x559e12266da0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-c con 0x559e12269070 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-b con 0x559e12265570 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.152 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:50:15.788+0000 7f9b7df75800 10 monclient(hunting): authenticate will time out at 1969.057627s 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request con 0x559e12266da0 auth_method 0 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): get_auth_request con 0x559e12269070 auth_method 0 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.153 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.154 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.154 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.154 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.154 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.154 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.154 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:50:15.788+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.154 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:50:15.788+0000 7f9b7c260640 10 monclient(hunting): get_auth_request con 0x559e12265570 auth_method 0 2024-09-12T00:50:16.154 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:50:15.788+0000 7f9b7c260640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.154 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:50:15.788+0000 7f9b7c260640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:50:15.788+0000 7f9b7c260640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_done global_id 7356 payload 824 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient: _finish_hunting 0 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 1 monclient: found mon.noname-a 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:50:15.788+0000 7f9b7ba5f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: dump: 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.155 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: _finish_auth 0 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: _check_auth_tickets 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.156 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:16.157 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:50:15.789+0000 7f9a617fa640 10 monclient: dump: 2024-09-12T00:50:16.157 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.157 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.157 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.157 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.157 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.157 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.157 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:50:15.789+0000 7f9b7df75800 5 monclient: authenticate success, global_id 7356 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:50:15.789+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:50:15.789+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:50:15.789+0000 7f9b7ca61640 4 set_mon_vals no callback set 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:50:15.789+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:50:15.789+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:50:15.791+0000 7f9a617fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:50:15.791+0000 7f9a617fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.158 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:50:15.791+0000 7f9a617fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:50:15.791+0000 7f9b73fff640 10 monclient: get_auth_request con 0x7f9a54076380 auth_method 0 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:50:15.791+0000 7f9b7df75800 10 monclient: get_monmap_and_config 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:50:15.791+0000 7f9b7df75800 10 monclient: build_initial_monmap 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:50:15.791+0000 7f9b7df75800 1 build_initial for_mkfs: 0 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:50:15.791+0000 7f9b7df75800 10 monclient: monmap: 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:16.159 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding auth protocol: cephx 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding auth protocol: cephx 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding auth protocol: cephx 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.160 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: crc 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x559e12286d10) adding con mode: secure 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:50:15.791+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:50:15.791+0000 7f9b7df75800 10 monclient: init 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding auth protocol: cephx 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding auth protocol: cephx 2024-09-12T00:50:16.161 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding auth protocol: cephx 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: crc 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:50:15.791+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c78300) adding con mode: secure 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:50:15.792+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.162 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:50:15.792+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:50:15.792+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command rotate-key cmddesc rotate-key hook 0x7ffe16c78448 EEXIST 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-c con 0x559e122bb330 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-a con 0x559e122abc80 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-b con 0x559e122b6760 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:50:15.792+0000 7f9b7df75800 10 monclient(hunting): authenticate will time out at 1969.061493s 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request con 0x559e122bb330 auth_method 0 2024-09-12T00:50:16.163 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): get_auth_request con 0x559e122abc80 auth_method 0 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): get_auth_request con 0x559e122b6760 auth_method 0 2024-09-12T00:50:16.164 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:50:15.792+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:50:15.792+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_done global_id 6944 payload 274 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient: _finish_hunting 0 2024-09-12T00:50:16.165 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 1 monclient: found mon.noname-c 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:50:15.792+0000 7f9b7ba5f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: dump: 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.166 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: _finish_auth 0 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 monclient: authenticate success, global_id 6944 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:50:15.793+0000 7f9a5affd640 10 monclient: dump: 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.167 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.168 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.168 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.168 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.168 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.168 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:50:15.793+0000 7f9b7df75800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:16.168 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:50:15.793+0000 7f9b7df75800 4 set_mon_vals no callback set 2024-09-12T00:50:16.168 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:50:15.793+0000 7f9b7df75800 10 monclient: shutdown 2024-09-12T00:50:16.168 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:50:15.793+0000 7f9b7df75800 10 monclient: build_initial_monmap 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:50:15.793+0000 7f9b7df75800 1 build_initial for_mkfs: 0 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:50:15.793+0000 7f9b7df75800 10 monclient: monmap: 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:16.169 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding auth protocol: cephx 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding auth protocol: cephx 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding auth protocol: cephx 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.170 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: crc 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:50:15.793+0000 7f9b7df75800 5 AuthRegistry(0x559e1228a890) adding con mode: secure 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:50:15.793+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:50:15.793+0000 7f9b7df75800 1 librados: starting msgr at 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:50:15.793+0000 7f9b7df75800 1 librados: starting objecter 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command objecter_requests cmddesc objecter_requests hook 0x559e1228cad0 EEXIST 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:50:15.794+0000 7f9b7df75800 1 librados: setting wanted keys 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:50:15.794+0000 7f9b7df75800 1 librados: calling monclient init 2024-09-12T00:50:16.171 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient: init 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding auth protocol: cephx 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding auth protocol: cephx 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding auth protocol: cephx 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.172 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: crc 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 AuthRegistry(0x559e1227eb50) adding con mode: secure 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:50:15.794+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:50:15.794+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:50:15.794+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command rotate-key cmddesc rotate-key hook 0x559e1227ec98 EEXIST 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-a con 0x559e122abc80 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-c con 0x559e122b6760 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): picked mon.noname-b con 0x559e122bb330 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:16.173 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:50:15.794+0000 7f9b7df75800 10 monclient(hunting): authenticate will time out at 1969.063675s 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request con 0x559e122abc80 auth_method 0 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): get_auth_request con 0x559e122b6760 auth_method 0 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:50:15.794+0000 7f9b7ba5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.174 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): get_auth_request con 0x559e122bb330 auth_method 0 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:50:15.794+0000 7f9b7c260640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:16.175 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:50:15.794+0000 7f9b73fff640 10 monclient(hunting): handle_auth_done global_id 6947 payload 824 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:50:15.795+0000 7f9b73fff640 10 monclient: _finish_hunting 0 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:50:15.795+0000 7f9b73fff640 1 monclient: found mon.noname-c 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:50:15.795+0000 7f9b73fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: dump: 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.176 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: _finish_auth 0 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: _check_auth_tickets 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:16.177 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:50:15.795+0000 7f9a597fa640 10 monclient: dump: 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.178 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:50:15.795+0000 7f9b7df75800 5 monclient: authenticate success, global_id 6947 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:50:15.795+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:50:15.795+0000 7f9a5affd640 4 set_mon_vals no callback set 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:50:15.795+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:50:15.795+0000 7f9b7df75800 10 monclient: _renew_subs 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:50:15.795+0000 7f9b7df75800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:50:15.795+0000 7f9b7df75800 1 librados: init done 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:50:15.795+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cr dump hook 0x559e122b39d8 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:50:15.796+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:50:15.797+0000 7f9a597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:16.179 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:50:15.797+0000 7f9a597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.180 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:50:15.797+0000 7f9a597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:16.180 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:50:15.797+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x7f9a44076470 auth_method 0 2024-09-12T00:50:16.180 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:50:15.797+0000 7f9b7c260640 10 monclient: get_auth_request con 0x559e122d5bd0 auth_method 0 2024-09-12T00:50:16.180 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.180 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 realm 2024-09-12T00:50:16.180 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.180 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.180 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:50:15.798+0000 7f9b7df75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:50:15.798+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:50:15.798+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x559e122d9f30 auth_method 0 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:50:15.799+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:50:15.799+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:50:15.799+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:50:15.799+0000 7f9b7df75800 20 searching for the correct realm 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:50:15.800+0000 7f9b73fff640 10 monclient: get_auth_request con 0x559e122df040 auth_method 0 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:50:15.800+0000 7f9b7c260640 10 monclient: get_auth_request con 0x7f9b6406d310 auth_method 0 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:50:15.801+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x7f9b6c085060 auth_method 0 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:50:15.802+0000 7f9b73fff640 10 monclient: get_auth_request con 0x7f9b64075e00 auth_method 0 2024-09-12T00:50:16.181 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:50:15.802+0000 7f9b73fff640 0 -- 172.21.15.83:0/2583773492 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f9b64075e00 msgr2=0x7f9b64071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:50:16.003+0000 7f9b73fff640 10 monclient: get_auth_request con 0x7f9b64075e00 auth_method 0 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:50:16.005+0000 7f9b7c260640 10 monclient: get_auth_request con 0x7f9b6c063070 auth_method 0 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:50:16.006+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x7f9b74015030 auth_method 0 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:50:16.007+0000 7f9b7c260640 0 -- 172.21.15.83:0/2583773492 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x559e122d5bd0 msgr2=0x559e122d8040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:50:16.007+0000 7f9a597fa640 1 client.6947.objecter ms_handle_reset 0x559e122d5bd0 session 0x559e122d5500 osd.6 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:50:16.007+0000 7f9a597fa640 10 monclient: _renew_subs 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:50:16.007+0000 7f9a597fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:50:16.007+0000 7f9b7c260640 10 monclient: get_auth_request con 0x7f9a44086790 auth_method 0 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:50:16.010+0000 7f9a597fa640 1 client.6947.objecter ms_handle_reset 0x7f9b74015030 session 0x7f9b74095040 osd.3 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:50:16.010+0000 7f9b7ba5f640 10 monclient: get_auth_request con 0x559e122d5bd0 auth_method 0 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:16.182 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:50:16.011+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.183 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 zone default found 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:50:16.012+0000 7f9b7df75800 4 Realm: () 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:50:16.012+0000 7f9b7df75800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:50:16.012+0000 7f9b7df75800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:50:16.012+0000 7f9b7df75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 zonegroup default 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:50:16.012+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.184 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 started sync module instance, tier type = 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:50:16.013+0000 7f9b7df75800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=0 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=1 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=2 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=3 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=4 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=5 2024-09-12T00:50:16.185 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:50:16.022+0000 7f9b7df75800 20 add_watcher() i=6 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:50:16.023+0000 7f9b7df75800 20 add_watcher() i=7 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:50:16.023+0000 7f9b7df75800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding auth protocol: cephx 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding auth protocol: cephx 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding auth protocol: cephx 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.186 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: crc 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:50:16.024+0000 7f9b7df75800 5 AuthRegistry(0x7ffe16c787e0) adding con mode: secure 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:50:16.024+0000 7f9a31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:50:16.025+0000 7f9b7df75800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cache list hook 0x559e122c9040 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cache inspect hook 0x559e122c9040 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cache erase hook 0x559e122c9040 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command cache zap hook 0x559e122c9040 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 note: GC not initialized 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:50:16.025+0000 7f9a30fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:16.187 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command sync trace show hook 0x7f9b6c004040 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command sync trace history hook 0x7f9b6c004040 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command sync trace active hook 0x7f9b6c004040 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:50:16.025+0000 7f9b7df75800 5 asok(0x559e11fca630) register_command sync trace active_short hook 0x7f9b6c004040 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 Filter name: none 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:50:16.025+0000 7f99aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:50:16.025+0000 7f9b7df75800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:50:16.025+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:50:16.026+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 : miss 2024-09-12T00:50:16.188 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:50:16.026+0000 7f9b7df75800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.189 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:50:16.026+0000 7f9b7df75800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:16.189 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.189 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.189 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:16.189 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.189 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:50:16.026+0000 7f9b7df75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 2024-09-12T00:50:16.189 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:50:16.030+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:50:16.030+0000 7f9b7df75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:50:16.030+0000 7f9b7df75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:50:16.030+0000 7f9b7df75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33, ofs0, ns] 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464386 cookie 94137398216080 notifier 6947 bl.length()=1015 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:50:16.031+0000 7f9a5affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_sources= new_sources= 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential sources added=[] removed=[] 2024-09-12T00:50:16.190 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_dests= new_dests= 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:50:16.031+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential dests added=[] removed=[] 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:50:16.033+0000 7f9b7df75800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.0 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:50:16.033+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.0 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:50:16.033+0000 7f9b7df75800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.1 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:50:16.033+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.1 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:50:16.033+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.0 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:50:16.036+0000 7f9b7df75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:50:16.036+0000 7f9b7df75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:50:16.037+0000 7f9b7df75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:50:16.037+0000 7f9b7df75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:50:16.037+0000 7f9b7df75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:50:16.037+0000 7f9b7df75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33, ofs0, ns] 2024-09-12T00:50:16.191 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464387 cookie 94137398216080 notifier 6947 bl.length()=1015 2024-09-12T00:50:16.192 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:16.192 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:16.192 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:50:16.037+0000 7f9a5a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:16.192 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_sources= new_sources= 2024-09-12T00:50:16.192 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential sources added=[] removed=[] 2024-09-12T00:50:16.192 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_dests= new_dests= 2024-09-12T00:50:16.192 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:50:16.038+0000 7f9b7df75800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential dests added=[] removed=[] 2024-09-12T00:50:16.192 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:50:16.039+0000 7f9b7df75800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.0 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:50:16.040+0000 7f9b7df75800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9b7df75800 time 2024-09-12T00:50:16.040420+0000 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9b8158c71a] 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9b8158c8d8] 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559e0fff8641] 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559e10008637] 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9b80229590] 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:50:16.193 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:50:16.041+0000 7f9b7df75800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f9b7df75800 thread_name:radosgw-admin 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9b8023e6f0] 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9b8028b99c] 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9b8158c774] 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9b8158c8d8] 2024-09-12T00:50:16.194 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559e0fff8641] 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x559e10008637] 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9b80229590] 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:50:16.195 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:50:16.196 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:50:16.197 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:50:16.198 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:50:16.199 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:50:16.200 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:50:16.201 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:50:16.202 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 7f99aa7fc640 / http_manager 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a30fe1640 / http_manager 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a31fe3640 / rgw_dt_lg_renew 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a597fa640 / ms_dispatch 2024-09-12T00:50:16.203 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a5a7fc640 / io_context_pool 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a5affd640 / io_context_pool 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a617fa640 / ms_dispatch 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a63fff640 / ms_dispatch 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9a69e0b640 / io_context_pool 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b73fff640 / msgr-worker-2 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b7ba5f640 / msgr-worker-1 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b7c260640 / msgr-worker-0 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b7ca61640 / io_context_pool 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9b7df75800 / radosgw-admin 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:50:16.204 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:50:16.041851Z_6a617104-b632-453d-bbb9-ad7eb7f7c0f8/log 2024-09-12T00:50:16.205 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:50:16.205 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:50:16.206 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:16.206 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.116+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.118+0000 7fc5222bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.118+0000 7fc5222bb800 20 realm 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.118+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.118+0000 7fc5222bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.118+0000 7fc5222bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.118+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.118+0000 7fc5222bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.118+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.119+0000 7fc5222bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.119+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.119+0000 7fc5222bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.119+0000 7fc5222bb800 20 searching for the correct realm 2024-09-12T00:50:16.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.121+0000 7fc51fdac640 0 -- 172.21.15.83:0/1660986644 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7fc51001a020 msgr2=0x7fc51006e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:16.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.326+0000 7fc51fdac640 0 -- 172.21.15.83:0/1660986644 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fc51802f040 msgr2=0x7fc5180079d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:16.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.531+0000 7fc5222bb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:16.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.531+0000 7fc5222bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:16.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.531+0000 7fc5222bb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:16.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.531+0000 7fc5222bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:16.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.531+0000 7fc5222bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:16.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.531+0000 7fc5222bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:16.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.531+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 20 zone default found 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 4 Realm: () 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 20 zonegroup default 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.532+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.533+0000 7fc5222bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.533+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.533+0000 7fc5222bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.533+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.533+0000 7fc5222bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.533+0000 7fc5222bb800 20 started sync module instance, tier type = 2024-09-12T00:50:16.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.533+0000 7fc5222bb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:16.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.542+0000 7fc5222bb800 20 add_watcher() i=0 2024-09-12T00:50:16.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.542+0000 7fc5222bb800 20 add_watcher() i=1 2024-09-12T00:50:16.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.542+0000 7fc5222bb800 20 add_watcher() i=2 2024-09-12T00:50:16.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.542+0000 7fc5222bb800 20 add_watcher() i=3 2024-09-12T00:50:16.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.542+0000 7fc5222bb800 20 add_watcher() i=4 2024-09-12T00:50:16.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.542+0000 7fc5222bb800 20 add_watcher() i=5 2024-09-12T00:50:16.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.542+0000 7fc5222bb800 20 add_watcher() i=6 2024-09-12T00:50:16.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.543+0000 7fc5222bb800 20 add_watcher() i=7 2024-09-12T00:50:16.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.543+0000 7fc5222bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:16.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.544+0000 7fc3d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:16.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.545+0000 7fc5222bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:16.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.545+0000 7fc5222bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:16.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.545+0000 7fc5222bb800 5 note: GC not initialized 2024-09-12T00:50:16.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.545+0000 7fc3d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:16.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.545+0000 7fc5222bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:16.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.545+0000 7fc5222bb800 20 Filter name: none 2024-09-12T00:50:16.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.545+0000 7fc34e7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:16.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.545+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.546+0000 7fc5222bb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:16.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.546+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.546+0000 7fc5222bb800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:50:16.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.546+0000 7fc5222bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:16.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.546+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.547+0000 7fc5222bb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:16.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.547+0000 7fc5222bb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.547+0000 7fc5222bb800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:50:16.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.547+0000 7fc5222bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:16.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.548+0000 7fc3d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:16.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.550+0000 7fc5222bb800 20 remove_watcher() i=0 2024-09-12T00:50:16.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.550+0000 7fc5222bb800 2 removed watcher, disabling cache 2024-09-12T00:50:16.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.551+0000 7fc5222bb800 20 remove_watcher() i=1 2024-09-12T00:50:16.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.552+0000 7fc5222bb800 20 remove_watcher() i=2 2024-09-12T00:50:16.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.553+0000 7fc5222bb800 20 remove_watcher() i=3 2024-09-12T00:50:16.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.554+0000 7fc5222bb800 20 remove_watcher() i=4 2024-09-12T00:50:16.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.555+0000 7fc5222bb800 20 remove_watcher() i=5 2024-09-12T00:50:16.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.556+0000 7fc5222bb800 20 remove_watcher() i=6 2024-09-12T00:50:16.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:16.557+0000 7fc5222bb800 20 remove_watcher() i=7 2024-09-12T00:50:16.565 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.565 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:16.565 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-commit-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:16.565 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:16.567 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:16.567 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:46.607 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:46.607 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:46.651 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:46.686 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:46.686 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:46.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.728+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.730+0000 7fe6cd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.730+0000 7fe6cd12c800 20 realm 2024-09-12T00:50:46.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.730+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.730+0000 7fe6cd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.730+0000 7fe6cd12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:46.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.730+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.731+0000 7fe6cd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.731+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.731+0000 7fe6cd12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:46.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.731+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.732+0000 7fe6cd12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:46.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.732+0000 7fe6cd12c800 20 searching for the correct realm 2024-09-12T00:50:46.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.736+0000 7fe6c853d640 0 -- 172.21.15.83:0/4040640989 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fe6bc015900 msgr2=0x7fe6bc0073a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:46.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.740+0000 7fe6c8d3e640 0 -- 172.21.15.83:0/4040640989 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fe6c0033930 msgr2=0x7fe6c000e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.744+0000 7fe6cd12c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.744+0000 7fe6cd12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.744+0000 7fe6cd12c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.744+0000 7fe6cd12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.744+0000 7fe6cd12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.744+0000 7fe6cd12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.744+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:46.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 20 zone default found 2024-09-12T00:50:46.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 4 Realm: () 2024-09-12T00:50:46.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:46.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:46.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:46.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 20 zonegroup default 2024-09-12T00:50:46.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.745+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.746+0000 7fe6cd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.746+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.746+0000 7fe6cd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.746+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.746+0000 7fe6cd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.746+0000 7fe6cd12c800 20 started sync module instance, tier type = 2024-09-12T00:50:46.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.746+0000 7fe6cd12c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:46.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.756+0000 7fe6cd12c800 20 add_watcher() i=0 2024-09-12T00:50:46.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.756+0000 7fe6cd12c800 20 add_watcher() i=1 2024-09-12T00:50:46.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.756+0000 7fe6cd12c800 20 add_watcher() i=2 2024-09-12T00:50:46.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.756+0000 7fe6cd12c800 20 add_watcher() i=3 2024-09-12T00:50:46.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.756+0000 7fe6cd12c800 20 add_watcher() i=4 2024-09-12T00:50:46.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.756+0000 7fe6cd12c800 20 add_watcher() i=5 2024-09-12T00:50:46.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.756+0000 7fe6cd12c800 20 add_watcher() i=6 2024-09-12T00:50:46.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.757+0000 7fe6cd12c800 20 add_watcher() i=7 2024-09-12T00:50:46.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.757+0000 7fe6cd12c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:46.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.759+0000 7fe57efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:46.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.760+0000 7fe6cd12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:46.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.760+0000 7fe6cd12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:46.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.760+0000 7fe6cd12c800 5 note: GC not initialized 2024-09-12T00:50:46.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.760+0000 7fe57dfe3640 20 reqs_thread_entry: start 2024-09-12T00:50:46.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.760+0000 7fe6cd12c800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:46.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.760+0000 7fe6cd12c800 20 Filter name: none 2024-09-12T00:50:46.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.760+0000 7fe4ef7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:46.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.760+0000 7fe6cd12c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:50:46.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.760+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.761+0000 7fe6cd12c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:46.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.761+0000 7fe6cd12c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:50:46.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.761+0000 7fe6cd12c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:50:46.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.761+0000 7fe6cd12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 : miss 2024-09-12T00:50:46.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.761+0000 7fe6cd12c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.762+0000 7fe6cd12c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:46.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.762+0000 7fe6cd12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:46.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.762+0000 7fe6cd12c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:46.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.762+0000 7fe6cd12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:46.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.762+0000 7fe6cd12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:46.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.762+0000 7fe6cd12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 2024-09-12T00:50:46.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.765+0000 7fe6cd12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:46.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.765+0000 7fe6cd12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:46.764 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.765+0000 7fe6cd12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:46.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.765+0000 7fe6cd12c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33, ofs0, ns] 2024-09-12T00:50:46.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.766+0000 7fe59ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464389 cookie 93854770895712 notifier 6980 bl.length()=1015 2024-09-12T00:50:46.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.766+0000 7fe59ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:46.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.766+0000 7fe59ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:46.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.766+0000 7fe59ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:46.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.766+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_sources= new_sources= 2024-09-12T00:50:46.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.766+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential sources added=[] removed=[] 2024-09-12T00:50:46.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.766+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_dests= new_dests= 2024-09-12T00:50:46.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.766+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential dests added=[] removed=[] 2024-09-12T00:50:46.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.769+0000 7fe6cd12c800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.0 2024-09-12T00:50:46.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.769+0000 7fe6cd12c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.0 2024-09-12T00:50:46.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.769+0000 7fe6cd12c800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.1 2024-09-12T00:50:46.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.769+0000 7fe6cd12c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.1.1 2024-09-12T00:50:46.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.769+0000 7fe6cd12c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.0 2024-09-12T00:50:46.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.771+0000 7fe6cd12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:46.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.771+0000 7fe6cd12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 2024-09-12T00:50:46.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.773+0000 7fe6cd12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:46.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.773+0000 7fe6cd12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:46.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.773+0000 7fe6cd12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:46.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.773+0000 7fe6cd12c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33, ofs0, ns] 2024-09-12T00:50:46.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.773+0000 7fe59f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464390 cookie 93854770895712 notifier 6980 bl.length()=1015 2024-09-12T00:50:46.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.773+0000 7fe59f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:46.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.773+0000 7fe59f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:46.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.773+0000 7fe59f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:46.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.774+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_sources= new_sources= 2024-09-12T00:50:46.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.774+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential sources added=[] removed=[] 2024-09-12T00:50:46.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.774+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_dests= new_dests= 2024-09-12T00:50:46.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.774+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential dests added=[] removed=[] 2024-09-12T00:50:46.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.775+0000 7fe6cd12c800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.33.0 2024-09-12T00:50:46.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.775+0000 7fe6cd12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:46.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.775+0000 7fe6cd12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe6cd12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe6cd12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe6cd12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe6cd12c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33, ofs0, ns] 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe59ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464391 cookie 93854770895712 notifier 6980 bl.length()=983 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe59ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 info.flags=0x17 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe59ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ad4424e4-de7c-4376-b125-e717016a3484.4511.33 to cache LRU end 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe59ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_sources= new_sources= 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential sources added=[] removed=[] 2024-09-12T00:50:46.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): orig_dests= new_dests= 2024-09-12T00:50:46.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.777+0000 7fe6cd12c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ad4424e4-de7c-4376-b125-e717016a3484.4511.33]): potential dests added=[] removed=[] 2024-09-12T00:50:46.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.779+0000 7fe6cd12c800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:46.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.780+0000 7fe57efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:46.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.783+0000 7fe6cd12c800 20 remove_watcher() i=0 2024-09-12T00:50:46.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.783+0000 7fe6cd12c800 2 removed watcher, disabling cache 2024-09-12T00:50:46.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.784+0000 7fe6cd12c800 20 remove_watcher() i=1 2024-09-12T00:50:46.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.785+0000 7fe6cd12c800 20 remove_watcher() i=2 2024-09-12T00:50:46.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.786+0000 7fe6cd12c800 20 remove_watcher() i=3 2024-09-12T00:50:46.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.787+0000 7fe6cd12c800 20 remove_watcher() i=4 2024-09-12T00:50:46.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.788+0000 7fe6cd12c800 20 remove_watcher() i=5 2024-09-12T00:50:46.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.790+0000 7fe6cd12c800 20 remove_watcher() i=6 2024-09-12T00:50:46.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.791+0000 7fe6cd12c800 20 remove_watcher() i=7 2024-09-12T00:50:46.802 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:50:46.831 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:46.831 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:46.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.870+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.871+0000 7f9a1a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.871+0000 7f9a1a60f800 20 realm 2024-09-12T00:50:46.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.871+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.872+0000 7f9a1a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.872+0000 7f9a1a60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:46.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.872+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.872+0000 7f9a1a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:46.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.872+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.873+0000 7f9a1a60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:46.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.873+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:46.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.873+0000 7f9a1a60f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:46.872 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.873+0000 7f9a1a60f800 20 searching for the correct realm 2024-09-12T00:50:46.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:46.876+0000 7f9a0ffff640 0 -- 172.21.15.83:0/1519943750 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f9a00055b60 msgr2=0x7f9a00077890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:47.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.081+0000 7f9a16593640 0 -- 172.21.15.83:0/1519943750 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55d11f4e1d20 msgr2=0x55d11f4e4170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.085+0000 7f9a1a60f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.085+0000 7f9a1a60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.085+0000 7f9a1a60f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.085+0000 7f9a1a60f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.085+0000 7f9a1a60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.085+0000 7f9a1a60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.085+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 20 zone default found 2024-09-12T00:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 4 Realm: () 2024-09-12T00:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:47.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 20 zonegroup default 2024-09-12T00:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.086+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.087+0000 7f9a1a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.087+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.087+0000 7f9a1a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.087+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.087+0000 7f9a1a60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.087+0000 7f9a1a60f800 20 started sync module instance, tier type = 2024-09-12T00:50:47.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.087+0000 7f9a1a60f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.097+0000 7f9a1a60f800 20 add_watcher() i=0 2024-09-12T00:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.097+0000 7f9a1a60f800 20 add_watcher() i=1 2024-09-12T00:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.097+0000 7f9a1a60f800 20 add_watcher() i=2 2024-09-12T00:50:47.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.097+0000 7f9a1a60f800 20 add_watcher() i=3 2024-09-12T00:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.097+0000 7f9a1a60f800 20 add_watcher() i=4 2024-09-12T00:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.097+0000 7f9a1a60f800 20 add_watcher() i=5 2024-09-12T00:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.097+0000 7f9a1a60f800 20 add_watcher() i=6 2024-09-12T00:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.098+0000 7f9a1a60f800 20 add_watcher() i=7 2024-09-12T00:50:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.098+0000 7f9a1a60f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:47.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.100+0000 7f98b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.100+0000 7f9a1a60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.100+0000 7f9a1a60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.100+0000 7f9a1a60f800 5 note: GC not initialized 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.100+0000 7f98b67fc640 20 reqs_thread_entry: start 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.100+0000 7f9a1a60f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.100+0000 7f9a1a60f800 20 Filter name: none 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.101+0000 7f9837fff640 20 reqs_thread_entry: start 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.101+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.101+0000 7f9a1a60f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.101+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.102+0000 7f9a1a60f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.102+0000 7f9a1a60f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.102+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.102+0000 7f9a1a60f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.102+0000 7f9a1a60f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.102+0000 7f9a1a60f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.102+0000 7f9a1a60f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:47.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.104+0000 7f98b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:47.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.106+0000 7f9a1a60f800 20 remove_watcher() i=0 2024-09-12T00:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.106+0000 7f9a1a60f800 2 removed watcher, disabling cache 2024-09-12T00:50:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.107+0000 7f9a1a60f800 20 remove_watcher() i=1 2024-09-12T00:50:47.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.108+0000 7f9a1a60f800 20 remove_watcher() i=2 2024-09-12T00:50:47.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.109+0000 7f9a1a60f800 20 remove_watcher() i=3 2024-09-12T00:50:47.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.110+0000 7f9a1a60f800 20 remove_watcher() i=4 2024-09-12T00:50:47.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.112+0000 7f9a1a60f800 20 remove_watcher() i=5 2024-09-12T00:50:47.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.113+0000 7f9a1a60f800 20 remove_watcher() i=6 2024-09-12T00:50:47.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.114+0000 7f9a1a60f800 20 remove_watcher() i=7 2024-09-12T00:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-commit-target-layout id: ad4424e4-de7c-4376-b125-e717016a3484.4511.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:47.123 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.125 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.128 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.171 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:50:47.185 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.186 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.196 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.240 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.240 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.247 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.247 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.255 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.255 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.263 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.263 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.271 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.271 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.279 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.279 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.287 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.288 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.295 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.295 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.337 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.338 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.345 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.345 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.353 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.353 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.361 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.361 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.368 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.368 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.376 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.376 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.384 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.384 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.391 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.391 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.399 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.399 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.406 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.406 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.414 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.414 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.422 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:47.422 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:47.430 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:50:47.458 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:47.458 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:47.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.496+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.498+0000 7fdeff719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.498+0000 7fdeff719800 20 realm 2024-09-12T00:50:47.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.498+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.498+0000 7fdeff719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.498+0000 7fdeff719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:47.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.498+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.498+0000 7fdeff719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.498+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.499+0000 7fdeff719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:47.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.499+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.500+0000 7fdeff719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:47.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.500+0000 7fdeff719800 20 searching for the correct realm 2024-09-12T00:50:47.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.503+0000 7fdef7fff640 0 -- 172.21.15.83:0/339040571 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fdee806c980 msgr2=0x7fdee8056470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:47.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.709+0000 7fdefda0b640 0 -- 172.21.15.83:0/339040571 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55d8825ac290 msgr2=0x55d8825ae680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:47.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:47.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 zone default found 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 4 Realm: () 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 zonegroup default 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.713+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.714+0000 7fdeff719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.714+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.714+0000 7fdeff719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.714+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.714+0000 7fdeff719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.714+0000 7fdeff719800 20 started sync module instance, tier type = 2024-09-12T00:50:47.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.714+0000 7fdeff719800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:47.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.723+0000 7fdeff719800 20 add_watcher() i=0 2024-09-12T00:50:47.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.723+0000 7fdeff719800 20 add_watcher() i=1 2024-09-12T00:50:47.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.723+0000 7fdeff719800 20 add_watcher() i=2 2024-09-12T00:50:47.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.723+0000 7fdeff719800 20 add_watcher() i=3 2024-09-12T00:50:47.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.723+0000 7fdeff719800 20 add_watcher() i=4 2024-09-12T00:50:47.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.723+0000 7fdeff719800 20 add_watcher() i=5 2024-09-12T00:50:47.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.723+0000 7fdeff719800 20 add_watcher() i=6 2024-09-12T00:50:47.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.724+0000 7fdeff719800 20 add_watcher() i=7 2024-09-12T00:50:47.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.724+0000 7fdeff719800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:47.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.725+0000 7fddb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:47.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.725+0000 7fdeff719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:47.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.725+0000 7fdeff719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:47.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.725+0000 7fdeff719800 5 note: GC not initialized 2024-09-12T00:50:47.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.726+0000 7fddb27e4640 20 reqs_thread_entry: start 2024-09-12T00:50:47.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.726+0000 7fdeff719800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:47.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.726+0000 7fdeff719800 20 Filter name: none 2024-09-12T00:50:47.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.726+0000 7fdd23fff640 20 reqs_thread_entry: start 2024-09-12T00:50:47.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.726+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.726+0000 7fdeff719800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:47.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.726+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.727+0000 7fdeff719800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:47.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.727+0000 7fdeff719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:47.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.727+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.727+0000 7fdeff719800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:47.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.727+0000 7fdeff719800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.728+0000 7fdeff719800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:47.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.728+0000 7fdeff719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:47.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.729+0000 7fddb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:47.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.731+0000 7fdeff719800 20 remove_watcher() i=0 2024-09-12T00:50:47.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.731+0000 7fdeff719800 2 removed watcher, disabling cache 2024-09-12T00:50:47.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.732+0000 7fdeff719800 20 remove_watcher() i=1 2024-09-12T00:50:47.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.733+0000 7fdeff719800 20 remove_watcher() i=2 2024-09-12T00:50:47.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.734+0000 7fdeff719800 20 remove_watcher() i=3 2024-09-12T00:50:47.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.735+0000 7fdeff719800 20 remove_watcher() i=4 2024-09-12T00:50:47.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.736+0000 7fdeff719800 20 remove_watcher() i=5 2024-09-12T00:50:47.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.737+0000 7fdeff719800 20 remove_watcher() i=6 2024-09-12T00:50:47.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.738+0000 7fdeff719800 20 remove_watcher() i=7 2024-09-12T00:50:47.746 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:47.746 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:47.746 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-do-reshard id: ad4424e4-de7c-4376-b125-e717016a3484.4511.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:47.746 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:47.748 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:50:47.782 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:47.782 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:47.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.820+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.822+0000 7f6c18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.822+0000 7f6c18746800 20 realm 2024-09-12T00:50:47.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.822+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.822+0000 7f6c18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.822+0000 7f6c18746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:47.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.822+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.822+0000 7f6c18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:47.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.822+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.823+0000 7f6c18746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:47.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.823+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:47.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.823+0000 7f6c18746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:47.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.823+0000 7f6c18746800 20 searching for the correct realm 2024-09-12T00:50:47.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:47.826+0000 7f6c0da36640 0 -- 172.21.15.83:0/1907302368 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f6c000687a0 msgr2=0x7f6c0006a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:48.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.030+0000 7f6c0da36640 0 -- 172.21.15.83:0/1907302368 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56382f928720 msgr2=0x56382f92ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.034+0000 7f6c18746800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.034+0000 7f6c18746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.034+0000 7f6c18746800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.034+0000 7f6c18746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.034+0000 7f6c18746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.034+0000 7f6c18746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.034+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 zone default found 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 4 Realm: () 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 zonegroup default 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.035+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.036+0000 7f6c18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.036+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.036+0000 7f6c18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.036+0000 7f6c18746800 20 started sync module instance, tier type = 2024-09-12T00:50:48.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.036+0000 7f6c18746800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:48.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.044+0000 7f6c18746800 20 add_watcher() i=0 2024-09-12T00:50:48.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.044+0000 7f6c18746800 20 add_watcher() i=1 2024-09-12T00:50:48.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.044+0000 7f6c18746800 20 add_watcher() i=2 2024-09-12T00:50:48.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.044+0000 7f6c18746800 20 add_watcher() i=3 2024-09-12T00:50:48.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.044+0000 7f6c18746800 20 add_watcher() i=4 2024-09-12T00:50:48.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.044+0000 7f6c18746800 20 add_watcher() i=5 2024-09-12T00:50:48.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.044+0000 7f6c18746800 20 add_watcher() i=6 2024-09-12T00:50:48.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.045+0000 7f6c18746800 20 add_watcher() i=7 2024-09-12T00:50:48.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.045+0000 7f6c18746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:48.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.047+0000 7f6accfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:48.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.047+0000 7f6c18746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:48.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.047+0000 7f6c18746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:48.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.048+0000 7f6c18746800 5 note: GC not initialized 2024-09-12T00:50:48.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.048+0000 7f6a477fe640 20 reqs_thread_entry: start 2024-09-12T00:50:48.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.048+0000 7f6c18746800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:48.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.048+0000 7f6c18746800 20 Filter name: none 2024-09-12T00:50:48.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.048+0000 7f6a457fa640 20 reqs_thread_entry: start 2024-09-12T00:50:48.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.048+0000 7f6c18746800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:50:48.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.048+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:48.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:50:48.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:50:48.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 : miss 2024-09-12T00:50:48.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:48.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:48.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.049+0000 7f6c18746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6c18746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6c18746800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6c18746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6c18746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34, ofs0, ns] 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6af9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464395 cookie 94799316339744 notifier 7034 bl.length()=995 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6af9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6af9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6af9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6c18746800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_sources= new_sources= 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6c18746800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential sources added=[] removed=[] 2024-09-12T00:50:48.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6c18746800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_dests= new_dests= 2024-09-12T00:50:48.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.053+0000 7f6c18746800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential dests added=[] removed=[] 2024-09-12T00:50:48.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.055+0000 7f6c18746800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:50:48.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.059+0000 7f6c18746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:48.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.059+0000 7f6c18746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 2024-09-12T00:50:48.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.061+0000 7f6c18746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.061+0000 7f6c18746800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.061+0000 7f6c18746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.061+0000 7f6c18746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34, ofs0, ns] 2024-09-12T00:50:48.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.062+0000 7f6af9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464396 cookie 94799316339744 notifier 7034 bl.length()=963 2024-09-12T00:50:48.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.062+0000 7f6af9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.062+0000 7f6af9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.062+0000 7f6af9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.062+0000 7f6c18746800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_sources= new_sources= 2024-09-12T00:50:48.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.062+0000 7f6c18746800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential sources added=[] removed=[] 2024-09-12T00:50:48.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.062+0000 7f6c18746800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_dests= new_dests= 2024-09-12T00:50:48.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.062+0000 7f6c18746800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential dests added=[] removed=[] 2024-09-12T00:50:48.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.062+0000 7f6c18746800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:50:48.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.064+0000 7f6accfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:48.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.066+0000 7f6c18746800 20 remove_watcher() i=0 2024-09-12T00:50:48.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.066+0000 7f6c18746800 2 removed watcher, disabling cache 2024-09-12T00:50:48.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.067+0000 7f6c18746800 20 remove_watcher() i=1 2024-09-12T00:50:48.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.068+0000 7f6c18746800 20 remove_watcher() i=2 2024-09-12T00:50:48.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.069+0000 7f6c18746800 20 remove_watcher() i=3 2024-09-12T00:50:48.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.070+0000 7f6c18746800 20 remove_watcher() i=4 2024-09-12T00:50:48.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.071+0000 7f6c18746800 20 remove_watcher() i=5 2024-09-12T00:50:48.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.072+0000 7f6c18746800 20 remove_watcher() i=6 2024-09-12T00:50:48.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.073+0000 7f6c18746800 20 remove_watcher() i=7 2024-09-12T00:50:48.083 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:50:48.112 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:48.112 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:48.148 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.150+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.152+0000 7f78ce325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.152+0000 7f78ce325800 20 realm 2024-09-12T00:50:48.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.152+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.152+0000 7f78ce325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.152+0000 7f78ce325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:48.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.152+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.152+0000 7f78ce325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.151 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.152+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.153+0000 7f78ce325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:48.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.153+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.153+0000 7f78ce325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:48.152 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.153+0000 7f78ce325800 20 searching for the correct realm 2024-09-12T00:50:48.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.157+0000 7f78c3fff640 0 -- 172.21.15.83:0/3168596240 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f78b408f040 msgr2=0x7f78b408f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:48.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.160+0000 7f78c3fff640 0 -- 172.21.15.83:0/3168596240 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55875f64d1e0 msgr2=0x55875f64f5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:48.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.163+0000 7f78ce325800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:48.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.163+0000 7f78ce325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:48.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.163+0000 7f78ce325800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:48.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.163+0000 7f78ce325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:48.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.163+0000 7f78ce325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:48.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.163+0000 7f78ce325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:48.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.163+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.163 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 zone default found 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 4 Realm: () 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 zonegroup default 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.164 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.164+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.165+0000 7f78ce325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.165+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.165+0000 7f78ce325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.165+0000 7f78ce325800 20 started sync module instance, tier type = 2024-09-12T00:50:48.165 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.165+0000 7f78ce325800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:48.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.173+0000 7f78ce325800 20 add_watcher() i=0 2024-09-12T00:50:48.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.173+0000 7f78ce325800 20 add_watcher() i=1 2024-09-12T00:50:48.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.173+0000 7f78ce325800 20 add_watcher() i=2 2024-09-12T00:50:48.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.173+0000 7f78ce325800 20 add_watcher() i=3 2024-09-12T00:50:48.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.173+0000 7f78ce325800 20 add_watcher() i=4 2024-09-12T00:50:48.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.173+0000 7f78ce325800 20 add_watcher() i=5 2024-09-12T00:50:48.172 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.173+0000 7f78ce325800 20 add_watcher() i=6 2024-09-12T00:50:48.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.174+0000 7f78ce325800 20 add_watcher() i=7 2024-09-12T00:50:48.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.174+0000 7f78ce325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:48.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.176+0000 7f777b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:48.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.176+0000 7f78ce325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:48.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.176+0000 7f78ce325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:48.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.176+0000 7f78ce325800 5 note: GC not initialized 2024-09-12T00:50:48.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.176+0000 7f777a7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:48.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.176+0000 7f78ce325800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:48.175 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.177+0000 7f78ce325800 20 Filter name: none 2024-09-12T00:50:48.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.177+0000 7f76ebfff640 20 reqs_thread_entry: start 2024-09-12T00:50:48.176 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.177+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.177+0000 7f78ce325800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:48.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.177+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.178+0000 7f78ce325800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:48.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.178+0000 7f78ce325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:48.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.178+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.178+0000 7f78ce325800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:48.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.178+0000 7f78ce325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.178+0000 7f78ce325800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:48.177 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.178+0000 7f78ce325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:48.178 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.179+0000 7f777b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:48.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.181+0000 7f78ce325800 20 remove_watcher() i=0 2024-09-12T00:50:48.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.181+0000 7f78ce325800 2 removed watcher, disabling cache 2024-09-12T00:50:48.180 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.182+0000 7f78ce325800 20 remove_watcher() i=1 2024-09-12T00:50:48.181 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.183+0000 7f78ce325800 20 remove_watcher() i=2 2024-09-12T00:50:48.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.184+0000 7f78ce325800 20 remove_watcher() i=3 2024-09-12T00:50:48.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.185+0000 7f78ce325800 20 remove_watcher() i=4 2024-09-12T00:50:48.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.186+0000 7f78ce325800 20 remove_watcher() i=5 2024-09-12T00:50:48.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.187+0000 7f78ce325800 20 remove_watcher() i=6 2024-09-12T00:50:48.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.188+0000 7f78ce325800 20 remove_watcher() i=7 2024-09-12T00:50:48.197 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:48.197 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:48.197 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-do-reshard id: ad4424e4-de7c-4376-b125-e717016a3484.4511.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:48.197 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:48.200 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.200 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.206 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.206 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.249 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:48.282 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:48.282 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:48.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.320+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.322+0000 7f559932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.322+0000 7f559932f800 20 realm 2024-09-12T00:50:48.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.322+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.322+0000 7f559932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.322+0000 7f559932f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:48.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.322+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.322+0000 7f559932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.322+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.323+0000 7f559932f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:48.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.323+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.323+0000 7f559932f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:48.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.323+0000 7f559932f800 20 searching for the correct realm 2024-09-12T00:50:48.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.326+0000 7f5594819640 0 -- 172.21.15.83:0/4212870384 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f558c03a040 msgr2=0x7f558c047930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:48.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.530+0000 7f559581b640 0 -- 172.21.15.83:0/4212870384 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x559990074580 msgr2=0x559990076a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:48.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.534+0000 7f559932f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:48.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.534+0000 7f559932f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:48.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.534+0000 7f559932f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:48.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.534+0000 7f559932f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:48.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.534+0000 7f559932f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:48.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.534+0000 7f559932f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:48.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.534+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.534+0000 7f559932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.534+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:48.534 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:48.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 20 zone default found 2024-09-12T00:50:48.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 4 Realm: () 2024-09-12T00:50:48.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:48.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:48.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:48.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 20 zonegroup default 2024-09-12T00:50:48.535 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.535+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.536+0000 7f559932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.536+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.536+0000 7f559932f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.536+0000 7f559932f800 20 started sync module instance, tier type = 2024-09-12T00:50:48.536 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.536+0000 7f559932f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.544+0000 7f559932f800 20 add_watcher() i=0 2024-09-12T00:50:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.544+0000 7f559932f800 20 add_watcher() i=1 2024-09-12T00:50:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.544+0000 7f559932f800 20 add_watcher() i=2 2024-09-12T00:50:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.544+0000 7f559932f800 20 add_watcher() i=3 2024-09-12T00:50:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.544+0000 7f559932f800 20 add_watcher() i=4 2024-09-12T00:50:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.544+0000 7f559932f800 20 add_watcher() i=5 2024-09-12T00:50:48.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.544+0000 7f559932f800 20 add_watcher() i=6 2024-09-12T00:50:48.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.546+0000 7f559932f800 20 add_watcher() i=7 2024-09-12T00:50:48.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.546+0000 7f559932f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:48.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.547+0000 7f544bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:48.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.548+0000 7f559932f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:48.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.548+0000 7f559932f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:48.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.548+0000 7f559932f800 5 note: GC not initialized 2024-09-12T00:50:48.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.548+0000 7f544afe5640 20 reqs_thread_entry: start 2024-09-12T00:50:48.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.548+0000 7f559932f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:48.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.548+0000 7f559932f800 20 Filter name: none 2024-09-12T00:50:48.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.548+0000 7f5448fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:48.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.548+0000 7f559932f800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:50:48.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.548+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:48.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:50:48.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:50:48.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 : miss 2024-09-12T00:50:48.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:48.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:48.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.549+0000 7f559932f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 2024-09-12T00:50:48.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f559932f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f559932f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f559932f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f559932f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34, ofs0, ns] 2024-09-12T00:50:48.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f5478ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464397 cookie 94118034759392 notifier 7070 bl.length()=995 2024-09-12T00:50:48.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f5478ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f5478ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f5478ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_sources= new_sources= 2024-09-12T00:50:48.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential sources added=[] removed=[] 2024-09-12T00:50:48.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_dests= new_dests= 2024-09-12T00:50:48.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.553+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential dests added=[] removed=[] 2024-09-12T00:50:48.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.556+0000 7f559932f800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.34.1.0 2024-09-12T00:50:48.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.556+0000 7f559932f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.34.1.0 2024-09-12T00:50:48.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.556+0000 7f559932f800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.34.1.1 2024-09-12T00:50:48.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.556+0000 7f559932f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.34.1.1 2024-09-12T00:50:48.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.556+0000 7f559932f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.34.0 2024-09-12T00:50:48.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.558+0000 7f559932f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:48.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.558+0000 7f559932f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 2024-09-12T00:50:48.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f559932f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f559932f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f559932f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f559932f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34, ofs0, ns] 2024-09-12T00:50:48.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f5478ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464398 cookie 94118034759392 notifier 7070 bl.length()=995 2024-09-12T00:50:48.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f5478ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f5478ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f5478ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_sources= new_sources= 2024-09-12T00:50:48.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential sources added=[] removed=[] 2024-09-12T00:50:48.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_dests= new_dests= 2024-09-12T00:50:48.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.559+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential dests added=[] removed=[] 2024-09-12T00:50:48.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.560+0000 7f559932f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.34.0 2024-09-12T00:50:48.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.561+0000 7f559932f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:48.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.561+0000 7f559932f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 2024-09-12T00:50:48.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.562+0000 7f559932f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.562+0000 7f559932f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.562+0000 7f559932f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.562+0000 7f559932f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34, ofs0, ns] 2024-09-12T00:50:48.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.562+0000 7f5478ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464399 cookie 94118034759392 notifier 7070 bl.length()=963 2024-09-12T00:50:48.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.562+0000 7f5478ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 info.flags=0x17 2024-09-12T00:50:48.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.562+0000 7f5478ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.34 to cache LRU end 2024-09-12T00:50:48.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.562+0000 7f5478ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:48.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.563+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_sources= new_sources= 2024-09-12T00:50:48.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.563+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential sources added=[] removed=[] 2024-09-12T00:50:48.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.563+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): orig_dests= new_dests= 2024-09-12T00:50:48.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.563+0000 7f559932f800 20 handle_bi_update(): bucket=:error-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.34]): potential dests added=[] removed=[] 2024-09-12T00:50:48.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.564+0000 7f559932f800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:48.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.566+0000 7f544bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:48.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.568+0000 7f559932f800 20 remove_watcher() i=0 2024-09-12T00:50:48.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.568+0000 7f559932f800 2 removed watcher, disabling cache 2024-09-12T00:50:48.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.569+0000 7f559932f800 20 remove_watcher() i=1 2024-09-12T00:50:48.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.570+0000 7f559932f800 20 remove_watcher() i=2 2024-09-12T00:50:48.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.571+0000 7f559932f800 20 remove_watcher() i=3 2024-09-12T00:50:48.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.572+0000 7f559932f800 20 remove_watcher() i=4 2024-09-12T00:50:48.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.573+0000 7f559932f800 20 remove_watcher() i=5 2024-09-12T00:50:48.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.575+0000 7f559932f800 20 remove_watcher() i=6 2024-09-12T00:50:48.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.576+0000 7f559932f800 20 remove_watcher() i=7 2024-09-12T00:50:48.586 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:50:48.614 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:48.614 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:48.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.652+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.654+0000 7fe069737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.654+0000 7fe069737800 20 realm 2024-09-12T00:50:48.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.654+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.654+0000 7fe069737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.654+0000 7fe069737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:48.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.654+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.654+0000 7fe069737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.654+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.655+0000 7fe069737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:48.653 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.655+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.655+0000 7fe069737800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:48.654 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.655+0000 7fe069737800 20 searching for the correct realm 2024-09-12T00:50:48.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.659+0000 7fe0653c3640 0 -- 172.21.15.83:0/3375083216 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7fe0580c1be0 msgr2=0x7fe058006af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:48.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.662+0000 7fe0653c3640 0 -- 172.21.15.83:0/3375083216 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fe06001f040 msgr2=0x7fe06001f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:48.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.665+0000 7fe069737800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:48.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.665+0000 7fe069737800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:48.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.665+0000 7fe069737800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:48.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.665+0000 7fe069737800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:48.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.665+0000 7fe069737800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:48.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.665+0000 7fe069737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:48.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.665+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:48.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:48.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 zone default found 2024-09-12T00:50:48.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 4 Realm: () 2024-09-12T00:50:48.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:48.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 zonegroup default 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.666+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.667+0000 7fe069737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.667+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.667+0000 7fe069737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.667+0000 7fe069737800 20 started sync module instance, tier type = 2024-09-12T00:50:48.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.667+0000 7fe069737800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:48.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.676+0000 7fe069737800 20 add_watcher() i=0 2024-09-12T00:50:48.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.676+0000 7fe069737800 20 add_watcher() i=1 2024-09-12T00:50:48.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.676+0000 7fe069737800 20 add_watcher() i=2 2024-09-12T00:50:48.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.676+0000 7fe069737800 20 add_watcher() i=3 2024-09-12T00:50:48.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.676+0000 7fe069737800 20 add_watcher() i=4 2024-09-12T00:50:48.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.676+0000 7fe069737800 20 add_watcher() i=5 2024-09-12T00:50:48.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.677+0000 7fe069737800 20 add_watcher() i=6 2024-09-12T00:50:48.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.677+0000 7fe069737800 20 add_watcher() i=7 2024-09-12T00:50:48.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.677+0000 7fe069737800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:48.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.679+0000 7fdf1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:48.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.679+0000 7fe069737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:48.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.679+0000 7fe069737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:48.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.679+0000 7fe069737800 5 note: GC not initialized 2024-09-12T00:50:48.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.679+0000 7fdf1a7e4640 20 reqs_thread_entry: start 2024-09-12T00:50:48.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.680+0000 7fe069737800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:48.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.680+0000 7fe069737800 20 Filter name: none 2024-09-12T00:50:48.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.680+0000 7fde8bfff640 20 reqs_thread_entry: start 2024-09-12T00:50:48.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.680+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.680+0000 7fe069737800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:48.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.680+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.681+0000 7fe069737800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:48.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.681+0000 7fe069737800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:48.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.681+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.681+0000 7fe069737800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:48.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.681+0000 7fe069737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.681+0000 7fe069737800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:48.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.682+0000 7fe069737800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:48.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.683+0000 7fdf1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:48.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.685+0000 7fe069737800 20 remove_watcher() i=0 2024-09-12T00:50:48.683 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.685+0000 7fe069737800 2 removed watcher, disabling cache 2024-09-12T00:50:48.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.686+0000 7fe069737800 20 remove_watcher() i=1 2024-09-12T00:50:48.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.687+0000 7fe069737800 20 remove_watcher() i=2 2024-09-12T00:50:48.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.688+0000 7fe069737800 20 remove_watcher() i=3 2024-09-12T00:50:48.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.689+0000 7fe069737800 20 remove_watcher() i=4 2024-09-12T00:50:48.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.690+0000 7fe069737800 20 remove_watcher() i=5 2024-09-12T00:50:48.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.691+0000 7fe069737800 20 remove_watcher() i=6 2024-09-12T00:50:48.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:48.692+0000 7fe069737800 20 remove_watcher() i=7 2024-09-12T00:50:48.700 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:48.700 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:48.701 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-do-reshard id: ad4424e4-de7c-4376-b125-e717016a3484.4511.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:48.701 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:48.702 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.702 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.705 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.706 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.748 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.749 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.762 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:50:48.762 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:48.764 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.764 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.775 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.775 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.818 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.818 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.826 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.826 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.834 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.834 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.841 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.842 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.850 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.850 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.858 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.858 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.866 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.866 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.874 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.874 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.882 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.882 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.890 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.891 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.898 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.898 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.907 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.907 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.915 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.915 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.923 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.923 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.931 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.931 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.939 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.939 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.948 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.948 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.956 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.956 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.964 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.964 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.971 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:48.971 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:48.980 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:50:49.008 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:49.008 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:49.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.046+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.047+0000 7f420af08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.047+0000 7f420af08800 20 realm 2024-09-12T00:50:49.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.047+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.047+0000 7f420af08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.047+0000 7f420af08800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:49.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.047+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.048+0000 7f420af08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.048+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.048+0000 7f420af08800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.048+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.048+0000 7f420af08800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:49.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.048+0000 7f420af08800 20 searching for the correct realm 2024-09-12T00:50:49.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.051+0000 7f4203fff640 0 -- 172.21.15.83:0/334824514 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f41f4018070 msgr2=0x7f41f4068930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:49.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.256+0000 7f42091f3640 0 -- 172.21.15.83:0/334824514 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56168f7612b0 msgr2=0x56168f7636a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.259+0000 7f420af08800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:49.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.259+0000 7f420af08800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:49.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.259+0000 7f420af08800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:49.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.259+0000 7f420af08800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.259+0000 7f420af08800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.259+0000 7f420af08800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.259+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 zone default found 2024-09-12T00:50:49.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 4 Realm: () 2024-09-12T00:50:49.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:49.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:49.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:49.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 zonegroup default 2024-09-12T00:50:49.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.260+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.261+0000 7f420af08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.261+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.261+0000 7f420af08800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.261+0000 7f420af08800 20 started sync module instance, tier type = 2024-09-12T00:50:49.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.261+0000 7f420af08800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:49.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.270+0000 7f420af08800 20 add_watcher() i=0 2024-09-12T00:50:49.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.270+0000 7f420af08800 20 add_watcher() i=1 2024-09-12T00:50:49.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.270+0000 7f420af08800 20 add_watcher() i=2 2024-09-12T00:50:49.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.270+0000 7f420af08800 20 add_watcher() i=3 2024-09-12T00:50:49.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.270+0000 7f420af08800 20 add_watcher() i=4 2024-09-12T00:50:49.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.270+0000 7f420af08800 20 add_watcher() i=5 2024-09-12T00:50:49.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.270+0000 7f420af08800 20 add_watcher() i=6 2024-09-12T00:50:49.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.271+0000 7f420af08800 20 add_watcher() i=7 2024-09-12T00:50:49.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.271+0000 7f420af08800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:49.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.272+0000 7f40befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:49.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.273+0000 7f420af08800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:49.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.273+0000 7f420af08800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:49.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.273+0000 7f420af08800 5 note: GC not initialized 2024-09-12T00:50:49.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.273+0000 7f40bdfe3640 20 reqs_thread_entry: start 2024-09-12T00:50:49.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.273+0000 7f420af08800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:49.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.273+0000 7f420af08800 20 Filter name: none 2024-09-12T00:50:49.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.273+0000 7f402f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:49.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.273+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.274+0000 7f420af08800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:49.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.274+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.274+0000 7f420af08800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:49.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.274+0000 7f420af08800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:49.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.274+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.274+0000 7f420af08800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:49.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.274+0000 7f420af08800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.275+0000 7f420af08800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:49.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.275+0000 7f420af08800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:49.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.276+0000 7f40befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:49.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.278+0000 7f420af08800 20 remove_watcher() i=0 2024-09-12T00:50:49.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.278+0000 7f420af08800 2 removed watcher, disabling cache 2024-09-12T00:50:49.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.279+0000 7f420af08800 20 remove_watcher() i=1 2024-09-12T00:50:49.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.280+0000 7f420af08800 20 remove_watcher() i=2 2024-09-12T00:50:49.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.281+0000 7f420af08800 20 remove_watcher() i=3 2024-09-12T00:50:49.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.282+0000 7f420af08800 20 remove_watcher() i=4 2024-09-12T00:50:49.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.283+0000 7f420af08800 20 remove_watcher() i=5 2024-09-12T00:50:49.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.284+0000 7f420af08800 20 remove_watcher() i=6 2024-09-12T00:50:49.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.284+0000 7f420af08800 20 remove_watcher() i=7 2024-09-12T00:50:49.293 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.293 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:49.293 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-do-reshard id: ad4424e4-de7c-4376-b125-e717016a3484.4511.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:49.293 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.295 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:50:49.328 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:49.328 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:49.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.366+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.367+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.367+0000 7f9023abb800 20 realm 2024-09-12T00:50:49.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.367+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.368+0000 7f9023abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:49.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.369+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.369+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:49.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.369+0000 7f9023abb800 20 searching for the correct realm 2024-09-12T00:50:49.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.372+0000 7f9020da4640 0 -- 172.21.15.83:0/1605406971 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f90180b11d0 msgr2=0x7f90180ad550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.375+0000 7f90215a5640 0 -- 172.21.15.83:0/1605406971 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f901c01f040 msgr2=0x7f901c010aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 zone default found 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 4 Realm: () 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 zonegroup default 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 started sync module instance, tier type = 2024-09-12T00:50:49.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.380+0000 7f9023abb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:49.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=0 2024-09-12T00:50:49.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=1 2024-09-12T00:50:49.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=2 2024-09-12T00:50:49.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=3 2024-09-12T00:50:49.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=4 2024-09-12T00:50:49.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=5 2024-09-12T00:50:49.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=6 2024-09-12T00:50:49.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.389+0000 7f9023abb800 20 add_watcher() i=7 2024-09-12T00:50:49.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.389+0000 7f9023abb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.391+0000 7f8ed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.392+0000 7f9023abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.392+0000 7f9023abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.392+0000 7f9023abb800 5 note: GC not initialized 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.392+0000 7f8ed67e4640 20 reqs_thread_entry: start 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.392+0000 7f9023abb800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.392+0000 7f9023abb800 20 Filter name: none 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.392+0000 7f8e47fff640 20 reqs_thread_entry: start 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.392+0000 7f9023abb800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:50:49.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.392+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:49.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:50:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:50:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 : miss 2024-09-12T00:50:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.393+0000 7f9023abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 2024-09-12T00:50:49.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f9023abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:49.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f9023abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:49.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f9023abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:49.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f9023abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35, ofs0, ns] 2024-09-12T00:50:49.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94166292623424 notifier 7121 bl.length()=995 2024-09-12T00:50:49.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:49.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:49.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:49.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_sources= new_sources= 2024-09-12T00:50:49.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential sources added=[] removed=[] 2024-09-12T00:50:49.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_dests= new_dests= 2024-09-12T00:50:49.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential dests added=[] removed=[] 2024-09-12T00:50:49.398 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9023abb800 time 2024-09-12T00:50:49.400815+0000 2024-09-12T00:50:49.398 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:49.399 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:49.399 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9026f8c71a] 2024-09-12T00:50:49.399 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9026f8c8d8] 2024-09-12T00:50:49.399 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4cb047641] 2024-09-12T00:50:49.399 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a4cb05738a] 2024-09-12T00:50:49.399 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:50:49.399 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9025c29590] 2024-09-12T00:50:49.399 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.400+0000 7f9023abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9023abb800 time 2024-09-12T00:50:49.400815+0000 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9026f8c71a] 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9026f8c8d8] 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4cb047641] 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a4cb05738a] 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9025c29590] 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:50:49.400 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:50:49.401 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.401 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:50:49.401 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f9023abb800 thread_name:radosgw-admin 2024-09-12T00:50:49.414 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:49.414 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9025c3e6f0] 2024-09-12T00:50:49.414 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9025c8b99c] 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9026f8c774] 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9026f8c8d8] 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4cb047641] 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a4cb05738a] 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9025c29590] 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.401+0000 7f9023abb800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f9023abb800 thread_name:radosgw-admin 2024-09-12T00:50:49.415 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9025c3e6f0] 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9025c8b99c] 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9026f8c774] 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9026f8c8d8] 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4cb047641] 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a4cb05738a] 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9025c29590] 2024-09-12T00:50:49.416 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:50:49.349+0000 7f9023abb800 5 monclient: authenticate success, global_id 7524 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:50:49.349+0000 7f8f0f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:50:49.349+0000 7f8f0f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:50:49.349+0000 7f8f0f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:50:49.349+0000 7f8f0f606640 10 monclient: dump: 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.417 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:50:49.349+0000 7f9023abb800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:50:49.349+0000 7f9023abb800 4 set_mon_vals no callback set 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:50:49.350+0000 7f9023abb800 10 monclient: shutdown 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 asok(0x55a4cc3a6630) unregister_commands rotate-key 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:50:49.350+0000 7f9023abb800 10 monclient: build_initial_monmap 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:50:49.350+0000 7f9023abb800 1 build_initial for_mkfs: 0 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:50:49.350+0000 7f9023abb800 10 monclient: monmap: 2024-09-12T00:50:49.418 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding auth protocol: cephx 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding auth protocol: cephx 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding auth protocol: cephx 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.419 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:50:49.350+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:50:49.350+0000 7f9023abb800 1 librados: starting msgr at 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:50:49.350+0000 7f9023abb800 1 librados: starting objecter 2024-09-12T00:50:49.420 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command objecter_requests hook 0x55a4cc5f8d60 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:50:49.351+0000 7f9023abb800 1 librados: setting wanted keys 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:50:49.351+0000 7f9023abb800 1 librados: calling monclient init 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient: init 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding auth protocol: cephx 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding auth protocol: cephx 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding auth protocol: cephx 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.421 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:50:49.351+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:50:49.351+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command rotate-key hook 0x55a4cc5c6a88 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-a con 0x55a4cc43d1e0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-c con 0x55a4cc471f50 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-b con 0x55a4cc50c940 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:49.422 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): authenticate will time out at 2002.620542s 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): get_auth_request con 0x55a4cc43d1e0 auth_method 0 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): get_auth_request con 0x55a4cc471f50 auth_method 0 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.423 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:50:49.351+0000 7f9021da6640 10 monclient(hunting): get_auth_request con 0x55a4cc50c940 auth_method 0 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:50:49.351+0000 7f9021da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:50:49.351+0000 7f9021da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:50:49.351+0000 7f9021da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): handle_auth_done global_id 7527 payload 824 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient: _finish_hunting 0 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:50:49.351+0000 7f90215a5640 1 monclient: found mon.noname-a 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.424 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: dump: 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: _finish_auth 0 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: _check_auth_tickets 2024-09-12T00:50:49.425 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:50:49.352+0000 7f9023abb800 5 monclient: authenticate success, global_id 7527 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: dump: 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.426 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:50:49.352+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:50:49.352+0000 7f9023abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:50:49.352+0000 7f8f0f606640 4 set_mon_vals no callback set 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:50:49.352+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:50:49.352+0000 7f9023abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:50:49.352+0000 7f9023abb800 1 librados: init done 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:50:49.354+0000 7f8f0de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:50:49.354+0000 7f8f0de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:50:49.354+0000 7f8f0de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:50:49.354+0000 7f9020da4640 10 monclient: get_auth_request con 0x7f8f08076470 auth_method 0 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:50:49.354+0000 7f9021da6640 10 monclient: get_auth_request con 0x55a4cc5ef680 auth_method 0 2024-09-12T00:50:49.427 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:50:49.355+0000 7f90215a5640 10 monclient: get_auth_request con 0x55a4cc611f30 auth_method 0 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:50:49.356+0000 7f9020da4640 10 monclient: get_auth_request con 0x55a4cc6157b0 auth_method 0 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:50:49.357+0000 7f9023abb800 10 monclient: build_initial_monmap 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:50:49.357+0000 7f9023abb800 1 build_initial for_mkfs: 0 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:50:49.357+0000 7f9023abb800 10 monclient: monmap: 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:49.428 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding auth protocol: cephx 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding auth protocol: cephx 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding auth protocol: cephx 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.429 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:50:49.357+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command objecter_requests cmddesc objecter_requests hook 0x55a4cc61e640 EEXIST 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:50:49.357+0000 7f9023abb800 10 monclient: init 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding auth protocol: cephx 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding auth protocol: cephx 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding auth protocol: cephx 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.430 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:50:49.357+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:50:49.358+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:50:49.358+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command rotate-key cmddesc rotate-key hook 0x55a4cc61a280 EEXIST 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-b con 0x55a4cc642960 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-c con 0x55a4cc642d40 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-a con 0x55a4cc641670 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:49.431 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): authenticate will time out at 2002.627119s 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): get_auth_request con 0x55a4cc642d40 auth_method 0 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): get_auth_request con 0x55a4cc641670 auth_method 0 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.432 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): get_auth_request con 0x55a4cc642960 auth_method 0 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): handle_auth_done global_id 7115 payload 824 2024-09-12T00:50:49.433 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient: _finish_hunting 0 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:50:49.358+0000 7f9020da4640 1 monclient: found mon.noname-c 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: dump: 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.434 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: _finish_auth 0 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: dump: 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.435 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:50:49.358+0000 7f9023abb800 5 monclient: authenticate success, global_id 7115 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:50:49.358+0000 7f90225a7640 4 set_mon_vals no callback set 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:50:49.360+0000 7f8f06ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:50:49.360+0000 7f8f06ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:50:49.360+0000 7f8f06ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.436 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:50:49.360+0000 7f90215a5640 10 monclient: get_auth_request con 0x7f8efc076380 auth_method 0 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:50:49.360+0000 7f9023abb800 10 monclient: get_monmap_and_config 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:50:49.360+0000 7f9023abb800 10 monclient: build_initial_monmap 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:50:49.360+0000 7f9023abb800 1 build_initial for_mkfs: 0 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:50:49.360+0000 7f9023abb800 10 monclient: monmap: 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:49.437 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding auth protocol: cephx 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding auth protocol: cephx 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding auth protocol: cephx 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.438 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:50:49.361+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient: init 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding auth protocol: cephx 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding auth protocol: cephx 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding auth protocol: cephx 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.439 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:50:49.361+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:50:49.361+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command rotate-key cmddesc rotate-key hook 0x7ffe38a19f18 EEXIST 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-b con 0x55a4cc696bd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-a con 0x55a4cc667be0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-c con 0x55a4cc6920b0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:49.440 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): authenticate will time out at 2002.630905s 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): get_auth_request con 0x55a4cc667be0 auth_method 0 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): get_auth_request con 0x55a4cc6920b0 auth_method 0 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.441 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): handle_auth_done global_id 7533 payload 274 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient: _finish_hunting 0 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:50:49.362+0000 7f9020da4640 1 monclient: found mon.noname-a 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:50:49.362+0000 7f90215a5640 10 monclient: get_auth_request con 0x55a4cc696bd0 auth_method 0 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: dump: 2024-09-12T00:50:49.442 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: _finish_auth 0 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:50:49.362+0000 7f9023abb800 5 monclient: authenticate success, global_id 7533 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.443 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: dump: 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:50:49.362+0000 7f9023abb800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:50:49.362+0000 7f9023abb800 4 set_mon_vals no callback set 2024-09-12T00:50:49.444 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:50:49.362+0000 7f9023abb800 10 monclient: shutdown 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:50:49.363+0000 7f9023abb800 10 monclient: build_initial_monmap 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 build_initial for_mkfs: 0 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:50:49.363+0000 7f9023abb800 10 monclient: monmap: 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:49.445 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding auth protocol: cephx 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding auth protocol: cephx 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding auth protocol: cephx 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.446 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:50:49.363+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 librados: starting msgr at 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 librados: starting objecter 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command objecter_requests cmddesc objecter_requests hook 0x55a4cc6447b0 EEXIST 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 librados: setting wanted keys 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 librados: calling monclient init 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:50:49.363+0000 7f9023abb800 10 monclient: init 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding auth protocol: cephx 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding auth protocol: cephx 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding auth protocol: cephx 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.447 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:50:49.363+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:50:49.363+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:50:49.364+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command rotate-key cmddesc rotate-key hook 0x55a4cc657368 EEXIST 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:49.448 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-c con 0x55a4cc667be0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-b con 0x55a4cc6920b0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-a con 0x55a4cc696bd0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): authenticate will time out at 2002.633066s 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): get_auth_request con 0x55a4cc667be0 auth_method 0 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): get_auth_request con 0x55a4cc696bd0 auth_method 0 2024-09-12T00:50:49.449 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:50:49.364+0000 7f9020da4640 10 monclient(hunting): get_auth_request con 0x55a4cc6920b0 auth_method 0 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:50:49.364+0000 7f9020da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:50:49.364+0000 7f9020da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:50:49.364+0000 7f9020da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-12T00:50:49.450 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient: _finish_hunting 0 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:50:49.364+0000 7f90215a5640 1 monclient: found mon.noname-c 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: dump: 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.451 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: dump: 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.452 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:50:49.364+0000 7f9023abb800 5 monclient: authenticate success, global_id 7121 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:50:49.364+0000 7f8f04ff9640 4 set_mon_vals no callback set 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:50:49.364+0000 7f9023abb800 1 librados: init done 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:50:49.364+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cr dump hook 0x55a4cc682988 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:50:49.366+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.453 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:50:49.366+0000 7f8ef2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:50:49.366+0000 7f8ef2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:50:49.366+0000 7f8ef2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:50:49.366+0000 7f9020da4640 10 monclient: get_auth_request con 0x7f8eec0764a0 auth_method 0 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:50:49.367+0000 7f9021da6640 10 monclient: get_auth_request con 0x55a4cc6b1070 auth_method 0 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:50:49.367+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:50:49.367+0000 7f9023abb800 20 realm 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:50:49.367+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:50:49.368+0000 7f9023abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.454 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:50:49.368+0000 7f90215a5640 10 monclient: get_auth_request con 0x55a4cc6b5280 auth_method 0 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:50:49.369+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:50:49.369+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:50:49.369+0000 7f9023abb800 20 searching for the correct realm 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:50:49.369+0000 7f9020da4640 10 monclient: get_auth_request con 0x55a4cc6ba540 auth_method 0 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:50:49.370+0000 7f9021da6640 10 monclient: get_auth_request con 0x7f901806d070 auth_method 0 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:50:49.371+0000 7f90215a5640 10 monclient: get_auth_request con 0x7f901403dba0 auth_method 0 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:50:49.372+0000 7f9020da4640 10 monclient: get_auth_request con 0x7f90180b11d0 auth_method 0 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:50:49.372+0000 7f9020da4640 0 -- 172.21.15.83:0/1605406971 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f90180b11d0 msgr2=0x7f90180ad550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:50:49.372+0000 7f8ef2ffd640 1 client.7121.objecter ms_handle_reset 0x7f90180b11d0 session 0x7f90180e2c20 osd.5 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:50:49.372+0000 7f8ef2ffd640 10 monclient: _renew_subs 2024-09-12T00:50:49.455 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:50:49.372+0000 7f8ef2ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:50:49.372+0000 7f9020da4640 10 monclient: get_auth_request con 0x7f8eec0867c0 auth_method 0 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:50:49.373+0000 7f9021da6640 10 monclient: get_auth_request con 0x7f901404fba0 auth_method 0 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:50:49.374+0000 7f90215a5640 10 monclient: get_auth_request con 0x7f901c01f040 auth_method 0 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:50:49.375+0000 7f90215a5640 0 -- 172.21.15.83:0/1605406971 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f901c01f040 msgr2=0x7f901c010aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:50:49.375+0000 7f8ef2ffd640 1 client.7121.objecter ms_handle_reset 0x7f901c01f040 session 0x7f901c016040 osd.3 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:50:49.375+0000 7f90215a5640 10 monclient: get_auth_request con 0x7f90180b11d0 auth_method 0 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.456 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 zone default found 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:50:49.380+0000 7f9023abb800 4 Realm: () 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:50:49.380+0000 7f9023abb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:50:49.380+0000 7f9023abb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:50:49.380+0000 7f9023abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 zonegroup default 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.457 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 started sync module instance, tier type = 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=0 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=1 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=2 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=3 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=4 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=5 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=6 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:50:49.389+0000 7f9023abb800 20 add_watcher() i=7 2024-09-12T00:50:49.458 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:50:49.389+0000 7f9023abb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding auth protocol: cephx 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding auth protocol: cephx 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding auth protocol: cephx 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.459 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:50:49.391+0000 7f8ed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:50:49.392+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cache list hook 0x55a4cc695f30 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cache inspect hook 0x55a4cc695f30 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cache erase hook 0x55a4cc695f30 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cache zap hook 0x55a4cc695f30 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 note: GC not initialized 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:50:49.392+0000 7f8ed67e4640 20 reqs_thread_entry: start 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command sync trace show hook 0x7f901c002830 2024-09-12T00:50:49.460 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command sync trace history hook 0x7f901c002830 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command sync trace active hook 0x7f901c002830 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command sync trace active_short hook 0x7f901c002830 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 Filter name: none 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:50:49.392+0000 7f8e47fff640 20 reqs_thread_entry: start 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:50:49.392+0000 7f9023abb800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:50:49.393+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 : miss 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:50:49.393+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.461 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:50:49.393+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:50:49.397+0000 7f9023abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:50:49.397+0000 7f9023abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:50:49.397+0000 7f9023abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:50:49.397+0000 7f9023abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35, ofs0, ns] 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94166292623424 notifier 7121 bl.length()=995 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:49.462 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_sources= new_sources= 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential sources added=[] removed=[] 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_dests= new_dests= 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential dests added=[] removed=[] 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:50:49.400+0000 7f9023abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9023abb800 time 2024-09-12T00:50:49.400815+0000 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9026f8c71a] 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9026f8c8d8] 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4cb047641] 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a4cb05738a] 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:50:49.463 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9025c29590] 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:50:49.401+0000 7f9023abb800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f9023abb800 thread_name:radosgw-admin 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9025c3e6f0] 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9025c8b99c] 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9026f8c774] 2024-09-12T00:50:49.464 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9026f8c8d8] 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4cb047641] 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a4cb05738a] 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9025c29590] 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:50:49.465 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:50:49.466 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:50:49.467 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:49.468 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:50:49.469 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:49.470 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:50:49.471 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8e47fff640 / http_manager 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8ed67e4640 / http_manager 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8ed77e6640 / rgw_dt_lg_renew 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8ef2ffd640 / ms_dispatch 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8f04ff9640 / io_context_pool 2024-09-12T00:50:49.472 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8f06ffd640 / ms_dispatch 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8f0de03640 / ms_dispatch 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8f0f606640 / io_context_pool 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9020da4640 / msgr-worker-2 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: 7f90215a5640 / msgr-worker-1 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9021da6640 / msgr-worker-0 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: 7f90225a7640 / io_context_pool 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9023abb800 / radosgw-admin 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.129001.log 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:50:49.349+0000 7f9023abb800 5 monclient: authenticate success, global_id 7524 2024-09-12T00:50:49.473 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:50:49.349+0000 7f8f0f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:50:49.349+0000 7f8f0f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:50:49.349+0000 7f8f0f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:50:49.349+0000 7f8f0f606640 10 monclient: dump: 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.474 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:50:49.349+0000 7f9023abb800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:50:49.349+0000 7f9023abb800 4 set_mon_vals no callback set 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:50:49.350+0000 7f9023abb800 10 monclient: shutdown 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 asok(0x55a4cc3a6630) unregister_commands rotate-key 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:50:49.350+0000 7f9023abb800 10 monclient: build_initial_monmap 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:50:49.350+0000 7f9023abb800 1 build_initial for_mkfs: 0 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:50:49.350+0000 7f9023abb800 10 monclient: monmap: 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:49.475 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding auth protocol: cephx 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding auth protocol: cephx 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding auth protocol: cephx 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.476 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: crc 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5cc570) adding con mode: secure 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:50:49.350+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:50:49.350+0000 7f9023abb800 1 librados: starting msgr at 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:50:49.350+0000 7f9023abb800 1 librados: starting objecter 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:50:49.350+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command objecter_requests hook 0x55a4cc5f8d60 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:50:49.351+0000 7f9023abb800 1 librados: setting wanted keys 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:50:49.351+0000 7f9023abb800 1 librados: calling monclient init 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient: init 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding auth protocol: cephx 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding auth protocol: cephx 2024-09-12T00:50:49.477 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding auth protocol: cephx 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: crc 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 AuthRegistry(0x55a4cc5c6940) adding con mode: secure 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:50:49.351+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:50:49.351+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.478 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:50:49.351+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command rotate-key hook 0x55a4cc5c6a88 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-a con 0x55a4cc43d1e0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-c con 0x55a4cc471f50 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-b con 0x55a4cc50c940 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:49.479 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:50:49.351+0000 7f9023abb800 10 monclient(hunting): authenticate will time out at 2002.620542s 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): get_auth_request con 0x55a4cc43d1e0 auth_method 0 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): get_auth_request con 0x55a4cc471f50 auth_method 0 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.480 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:50:49.351+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:50:49.351+0000 7f9021da6640 10 monclient(hunting): get_auth_request con 0x55a4cc50c940 auth_method 0 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:50:49.351+0000 7f9021da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:50:49.351+0000 7f9021da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:50:49.351+0000 7f9021da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient(hunting): handle_auth_done global_id 7527 payload 824 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient: _finish_hunting 0 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:50:49.351+0000 7f90215a5640 1 monclient: found mon.noname-a 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:50:49.351+0000 7f90215a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: dump: 2024-09-12T00:50:49.481 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: _finish_auth 0 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: _check_auth_tickets 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:50:49.352+0000 7f9023abb800 5 monclient: authenticate success, global_id 7527 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.482 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:50:49.352+0000 7f8f0de03640 10 monclient: dump: 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:50:49.352+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.483 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:50:49.352+0000 7f9023abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:50:49.352+0000 7f8f0f606640 4 set_mon_vals no callback set 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:50:49.352+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:50:49.352+0000 7f9023abb800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:50:49.352+0000 7f9023abb800 1 librados: init done 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:50:49.354+0000 7f8f0de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:50:49.354+0000 7f8f0de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:50:49.354+0000 7f8f0de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:50:49.354+0000 7f9020da4640 10 monclient: get_auth_request con 0x7f8f08076470 auth_method 0 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:50:49.354+0000 7f9021da6640 10 monclient: get_auth_request con 0x55a4cc5ef680 auth_method 0 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:50:49.355+0000 7f90215a5640 10 monclient: get_auth_request con 0x55a4cc611f30 auth_method 0 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:50:49.356+0000 7f9020da4640 10 monclient: get_auth_request con 0x55a4cc6157b0 auth_method 0 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:50:49.357+0000 7f9023abb800 10 monclient: build_initial_monmap 2024-09-12T00:50:49.484 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:50:49.357+0000 7f9023abb800 1 build_initial for_mkfs: 0 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:50:49.357+0000 7f9023abb800 10 monclient: monmap: 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding auth protocol: cephx 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding auth protocol: cephx 2024-09-12T00:50:49.485 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding auth protocol: cephx 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: crc 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61b180) adding con mode: secure 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:50:49.357+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command objecter_requests cmddesc objecter_requests hook 0x55a4cc61e640 EEXIST 2024-09-12T00:50:49.486 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:50:49.357+0000 7f9023abb800 10 monclient: init 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding auth protocol: cephx 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding auth protocol: cephx 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding auth protocol: cephx 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.487 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: crc 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:50:49.357+0000 7f9023abb800 5 AuthRegistry(0x55a4cc61a138) adding con mode: secure 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:50:49.357+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:50:49.358+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:50:49.358+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command rotate-key cmddesc rotate-key hook 0x55a4cc61a280 EEXIST 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-b con 0x55a4cc642960 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-c con 0x55a4cc642d40 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-a con 0x55a4cc641670 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.488 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient(hunting): authenticate will time out at 2002.627119s 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): get_auth_request con 0x55a4cc642d40 auth_method 0 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): get_auth_request con 0x55a4cc641670 auth_method 0 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): get_auth_request con 0x55a4cc642960 auth_method 0 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.489 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:50:49.358+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:50:49.358+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient(hunting): handle_auth_done global_id 7115 payload 824 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient: _finish_hunting 0 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:50:49.358+0000 7f9020da4640 1 monclient: found mon.noname-c 2024-09-12T00:50:49.490 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:50:49.358+0000 7f9020da4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: dump: 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.491 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: _finish_auth 0 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:50:49.358+0000 7f8f06ffd640 10 monclient: dump: 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.492 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:50:49.358+0000 7f9023abb800 5 monclient: authenticate success, global_id 7115 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:50:49.358+0000 7f90225a7640 4 set_mon_vals no callback set 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:50:49.358+0000 7f9023abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:50:49.360+0000 7f8f06ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:50:49.360+0000 7f8f06ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:50:49.360+0000 7f8f06ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:50:49.360+0000 7f90215a5640 10 monclient: get_auth_request con 0x7f8efc076380 auth_method 0 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:50:49.360+0000 7f9023abb800 10 monclient: get_monmap_and_config 2024-09-12T00:50:49.493 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:50:49.360+0000 7f9023abb800 10 monclient: build_initial_monmap 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:50:49.360+0000 7f9023abb800 1 build_initial for_mkfs: 0 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:50:49.360+0000 7f9023abb800 10 monclient: monmap: 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding auth protocol: cephx 2024-09-12T00:50:49.494 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding auth protocol: cephx 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding auth protocol: cephx 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:50:49.360+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: crc 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x55a4cc662590) adding con mode: secure 2024-09-12T00:50:49.495 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:50:49.361+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient: init 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding auth protocol: cephx 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding auth protocol: cephx 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding auth protocol: cephx 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.496 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: crc 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a19dd0) adding con mode: secure 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:50:49.361+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:50:49.361+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:50:49.361+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command rotate-key cmddesc rotate-key hook 0x7ffe38a19f18 EEXIST 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-b con 0x55a4cc696bd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-a con 0x55a4cc667be0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-c con 0x55a4cc6920b0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.497 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:50:49.361+0000 7f9023abb800 10 monclient(hunting): authenticate will time out at 2002.630905s 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): get_auth_request con 0x55a4cc667be0 auth_method 0 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): get_auth_request con 0x55a4cc6920b0 auth_method 0 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.498 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:50:49.362+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient(hunting): handle_auth_done global_id 7533 payload 274 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient: _finish_hunting 0 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:50:49.362+0000 7f9020da4640 1 monclient: found mon.noname-a 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:50:49.362+0000 7f9020da4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:50:49.362+0000 7f90215a5640 10 monclient: get_auth_request con 0x55a4cc696bd0 auth_method 0 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: dump: 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.499 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: _finish_auth 0 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:50:49.362+0000 7f9023abb800 5 monclient: authenticate success, global_id 7533 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.500 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:50:49.362+0000 7f8f04ff9640 10 monclient: dump: 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:50:49.362+0000 7f9023abb800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:50:49.362+0000 7f9023abb800 4 set_mon_vals no callback set 2024-09-12T00:50:49.501 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:50:49.362+0000 7f9023abb800 10 monclient: shutdown 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:50:49.363+0000 7f9023abb800 10 monclient: build_initial_monmap 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 build_initial for_mkfs: 0 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:50:49.363+0000 7f9023abb800 10 monclient: monmap: 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.502 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding auth protocol: cephx 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding auth protocol: cephx 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding auth protocol: cephx 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: crc 2024-09-12T00:50:49.503 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc692c90) adding con mode: secure 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:50:49.363+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 librados: starting msgr at 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 librados: starting objecter 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command objecter_requests cmddesc objecter_requests hook 0x55a4cc6447b0 EEXIST 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 librados: setting wanted keys 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:50:49.363+0000 7f9023abb800 1 librados: calling monclient init 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:50:49.363+0000 7f9023abb800 10 monclient: init 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding auth protocol: cephx 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding auth protocol: cephx 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding auth protocol: cephx 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.504 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: crc 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:50:49.363+0000 7f9023abb800 5 AuthRegistry(0x55a4cc657220) adding con mode: secure 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:50:49.363+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:50:49.363+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:50:49.364+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command rotate-key cmddesc rotate-key hook 0x55a4cc657368 EEXIST 2024-09-12T00:50:49.505 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-c con 0x55a4cc667be0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-b con 0x55a4cc6920b0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): picked mon.noname-a con 0x55a4cc696bd0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient(hunting): authenticate will time out at 2002.633066s 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): get_auth_request con 0x55a4cc667be0 auth_method 0 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.506 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): get_auth_request con 0x55a4cc696bd0 auth_method 0 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:50:49.364+0000 7f9021da6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:50:49.364+0000 7f9020da4640 10 monclient(hunting): get_auth_request con 0x55a4cc6920b0 auth_method 0 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:50:49.364+0000 7f9020da4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:50:49.364+0000 7f9020da4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:49.507 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:50:49.364+0000 7f9020da4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient: _finish_hunting 0 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:50:49.364+0000 7f90215a5640 1 monclient: found mon.noname-c 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:50:49.364+0000 7f90215a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: dump: 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.508 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:50:49.364+0000 7f8ef2ffd640 10 monclient: dump: 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:50:49.509 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:50:49.364+0000 7f9023abb800 5 monclient: authenticate success, global_id 7121 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:50:49.364+0000 7f8f04ff9640 4 set_mon_vals no callback set 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _renew_subs 2024-09-12T00:50:49.510 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:50:49.364+0000 7f9023abb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:50:49.364+0000 7f9023abb800 1 librados: init done 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:50:49.364+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cr dump hook 0x55a4cc682988 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:50:49.366+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:50:49.366+0000 7f8ef2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:50:49.366+0000 7f8ef2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:50:49.366+0000 7f8ef2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:50:49.366+0000 7f9020da4640 10 monclient: get_auth_request con 0x7f8eec0764a0 auth_method 0 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:50:49.367+0000 7f9021da6640 10 monclient: get_auth_request con 0x55a4cc6b1070 auth_method 0 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:50:49.367+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:50:49.367+0000 7f9023abb800 20 realm 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:50:49.367+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.511 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:50:49.368+0000 7f9023abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:50:49.368+0000 7f90215a5640 10 monclient: get_auth_request con 0x55a4cc6b5280 auth_method 0 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:50:49.368+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:50:49.369+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:50:49.369+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:50:49.369+0000 7f9023abb800 20 searching for the correct realm 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:50:49.369+0000 7f9020da4640 10 monclient: get_auth_request con 0x55a4cc6ba540 auth_method 0 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:50:49.370+0000 7f9021da6640 10 monclient: get_auth_request con 0x7f901806d070 auth_method 0 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:50:49.371+0000 7f90215a5640 10 monclient: get_auth_request con 0x7f901403dba0 auth_method 0 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:50:49.372+0000 7f9020da4640 10 monclient: get_auth_request con 0x7f90180b11d0 auth_method 0 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:50:49.372+0000 7f9020da4640 0 -- 172.21.15.83:0/1605406971 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f90180b11d0 msgr2=0x7f90180ad550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.512 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:50:49.372+0000 7f8ef2ffd640 1 client.7121.objecter ms_handle_reset 0x7f90180b11d0 session 0x7f90180e2c20 osd.5 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:50:49.372+0000 7f8ef2ffd640 10 monclient: _renew_subs 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:50:49.372+0000 7f8ef2ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:50:49.372+0000 7f9020da4640 10 monclient: get_auth_request con 0x7f8eec0867c0 auth_method 0 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:50:49.373+0000 7f9021da6640 10 monclient: get_auth_request con 0x7f901404fba0 auth_method 0 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:50:49.374+0000 7f90215a5640 10 monclient: get_auth_request con 0x7f901c01f040 auth_method 0 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:50:49.375+0000 7f90215a5640 0 -- 172.21.15.83:0/1605406971 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f901c01f040 msgr2=0x7f901c010aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:50:49.375+0000 7f8ef2ffd640 1 client.7121.objecter ms_handle_reset 0x7f901c01f040 session 0x7f901c016040 osd.3 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:50:49.375+0000 7f90215a5640 10 monclient: get_auth_request con 0x7f90180b11d0 auth_method 0 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:49.513 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:50:49.379+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 zone default found 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:50:49.380+0000 7f9023abb800 4 Realm: () 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:50:49.380+0000 7f9023abb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:50:49.380+0000 7f9023abb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:50:49.380+0000 7f9023abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:49.514 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 zonegroup default 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 started sync module instance, tier type = 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:50:49.380+0000 7f9023abb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=0 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=1 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=2 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=3 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=4 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=5 2024-09-12T00:50:49.515 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:50:49.388+0000 7f9023abb800 20 add_watcher() i=6 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:50:49.389+0000 7f9023abb800 20 add_watcher() i=7 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:50:49.389+0000 7f9023abb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding auth protocol: cephx 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding auth protocol: cephx 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding auth protocol: cephx 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.516 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: crc 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:50:49.391+0000 7f9023abb800 5 AuthRegistry(0x7ffe38a1a2b0) adding con mode: secure 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:50:49.391+0000 7f8ed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:50:49.392+0000 7f9023abb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cache list hook 0x55a4cc695f30 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cache inspect hook 0x55a4cc695f30 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cache erase hook 0x55a4cc695f30 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command cache zap hook 0x55a4cc695f30 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 note: GC not initialized 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:50:49.392+0000 7f8ed67e4640 20 reqs_thread_entry: start 2024-09-12T00:50:49.517 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command sync trace show hook 0x7f901c002830 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command sync trace history hook 0x7f901c002830 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command sync trace active hook 0x7f901c002830 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:50:49.392+0000 7f9023abb800 5 asok(0x55a4cc3a6630) register_command sync trace active_short hook 0x7f901c002830 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 Filter name: none 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:50:49.392+0000 7f8e47fff640 20 reqs_thread_entry: start 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:50:49.392+0000 7f9023abb800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:50:49.392+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:50:49.393+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 : miss 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:50:49.393+0000 7f9023abb800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:50:49.393+0000 7f9023abb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:50:49.518 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:50:49.393+0000 7f9023abb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:50:49.397+0000 7f9023abb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:50:49.397+0000 7f9023abb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:50:49.397+0000 7f9023abb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:50:49.397+0000 7f9023abb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35, ofs0, ns] 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94166292623424 notifier 7121 bl.length()=995 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:50:49.397+0000 7f8f04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_sources= new_sources= 2024-09-12T00:50:49.519 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential sources added=[] removed=[] 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_dests= new_dests= 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:50:49.397+0000 7f9023abb800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential dests added=[] removed=[] 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:50:49.400+0000 7f9023abb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9023abb800 time 2024-09-12T00:50:49.400815+0000 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9026f8c71a] 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9026f8c8d8] 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4cb047641] 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a4cb05738a] 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9025c29590] 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:50:49.520 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:50:49.401+0000 7f9023abb800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f9023abb800 thread_name:radosgw-admin 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9025c3e6f0] 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9025c8b99c] 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9026f8c774] 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9026f8c8d8] 2024-09-12T00:50:49.521 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a4cb047641] 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a4cb05738a] 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9025c29590] 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:50:49.526 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:49.527 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:50:49.528 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8e47fff640 / http_manager 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8ed67e4640 / http_manager 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8ed77e6640 / rgw_dt_lg_renew 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8ef2ffd640 / ms_dispatch 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8f04ff9640 / io_context_pool 2024-09-12T00:50:49.529 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8f06ffd640 / ms_dispatch 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8f0de03640 / ms_dispatch 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: 7f8f0f606640 / io_context_pool 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9020da4640 / msgr-worker-2 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: 7f90215a5640 / msgr-worker-1 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9021da6640 / msgr-worker-0 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: 7f90225a7640 / io_context_pool 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: 7f9023abb800 / radosgw-admin 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:50:49.402224Z_e2dabe79-1a45-413b-9a54-4c7e6f827cbf/log 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:50:49.530 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:50:49.531 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:49.531 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:49.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.677+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.679+0000 7ff46ca19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.679+0000 7ff46ca19800 20 realm 2024-09-12T00:50:49.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.679+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.679+0000 7ff46ca19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.679+0000 7ff46ca19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:49.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.679+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.679+0000 7ff46ca19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.679+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.680+0000 7ff46ca19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.680+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.680+0000 7ff46ca19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:49.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.680+0000 7ff46ca19800 20 searching for the correct realm 2024-09-12T00:50:49.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.683+0000 7ff4679ea640 0 -- 172.21.15.83:0/3004323972 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff45c046400 msgr2=0x7ff45c046880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.887 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.889+0000 7ff4679ea640 0 -- 172.21.15.83:0/3004323972 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5618d66f0f10 msgr2=0x5618d66f33d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.893+0000 7ff46ca19800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:49.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.893+0000 7ff46ca19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:49.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.893+0000 7ff46ca19800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:49.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.893+0000 7ff46ca19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:49.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.893+0000 7ff46ca19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:49.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.893+0000 7ff46ca19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:49.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:49.893+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.091+0000 7ff46ca19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.091+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.090 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:50.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 20 zone default found 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 4 Realm: () 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 20 zonegroup default 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.092+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.093+0000 7ff46ca19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.093+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.093+0000 7ff46ca19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.093+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.093+0000 7ff46ca19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.093+0000 7ff46ca19800 20 started sync module instance, tier type = 2024-09-12T00:50:50.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.093+0000 7ff46ca19800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:50.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.102+0000 7ff46ca19800 20 add_watcher() i=0 2024-09-12T00:50:50.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.102+0000 7ff46ca19800 20 add_watcher() i=1 2024-09-12T00:50:50.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.102+0000 7ff46ca19800 20 add_watcher() i=2 2024-09-12T00:50:50.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.102+0000 7ff46ca19800 20 add_watcher() i=3 2024-09-12T00:50:50.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.102+0000 7ff46ca19800 20 add_watcher() i=4 2024-09-12T00:50:50.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.102+0000 7ff46ca19800 20 add_watcher() i=5 2024-09-12T00:50:50.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.102+0000 7ff46ca19800 20 add_watcher() i=6 2024-09-12T00:50:50.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.103+0000 7ff46ca19800 20 add_watcher() i=7 2024-09-12T00:50:50.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.103+0000 7ff46ca19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:50.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.105+0000 7ff31efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:50.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.105+0000 7ff46ca19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:50.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.105+0000 7ff46ca19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:50.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.105+0000 7ff46ca19800 5 note: GC not initialized 2024-09-12T00:50:50.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.105+0000 7ff31dfdb640 20 reqs_thread_entry: start 2024-09-12T00:50:50.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.106+0000 7ff46ca19800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:50.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.106+0000 7ff46ca19800 20 Filter name: none 2024-09-12T00:50:50.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.106+0000 7ff28f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:50.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.106+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.106+0000 7ff46ca19800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.106+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.107+0000 7ff46ca19800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:50:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.107+0000 7ff46ca19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.107+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.107+0000 7ff46ca19800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.107+0000 7ff46ca19800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.107+0000 7ff46ca19800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:50:50.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.107+0000 7ff46ca19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:50.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.108+0000 7ff31efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:50.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.110+0000 7ff46ca19800 20 remove_watcher() i=0 2024-09-12T00:50:50.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.110+0000 7ff46ca19800 2 removed watcher, disabling cache 2024-09-12T00:50:50.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.111+0000 7ff46ca19800 20 remove_watcher() i=1 2024-09-12T00:50:50.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.112+0000 7ff46ca19800 20 remove_watcher() i=2 2024-09-12T00:50:50.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.113+0000 7ff46ca19800 20 remove_watcher() i=3 2024-09-12T00:50:50.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.114+0000 7ff46ca19800 20 remove_watcher() i=4 2024-09-12T00:50:50.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.115+0000 7ff46ca19800 20 remove_watcher() i=5 2024-09-12T00:50:50.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.116+0000 7ff46ca19800 20 remove_watcher() i=6 2024-09-12T00:50:50.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.117+0000 7ff46ca19800 20 remove_watcher() i=7 2024-09-12T00:50:50.125 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:50.125 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:50:50.125 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-do-reshard id: ad4424e4-de7c-4376-b125-e717016a3484.4511.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:50.125 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:50:50.127 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:50.127 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:50.135 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:50.135 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:50:50.178 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:50.209 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:50.209 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:50.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.247+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.249+0000 7fc262d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.249+0000 7fc262d2a800 20 realm 2024-09-12T00:50:50.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.249+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.249+0000 7fc262d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.249+0000 7fc262d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:50.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.249+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.249+0000 7fc262d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.249+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.250+0000 7fc262d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:50.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.250+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.250+0000 7fc262d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:50.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.250+0000 7fc262d2a800 20 searching for the correct realm 2024-09-12T00:50:50.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.253+0000 7fc257fff640 0 -- 172.21.15.83:0/2556531369 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fc24803fbd0 msgr2=0x7fc248031910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:50.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.457+0000 7fc25f2ae640 0 -- 172.21.15.83:0/2556531369 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55b0b7a294b0 msgr2=0x55b0b7a2b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:50.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.461+0000 7fc262d2a800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:50:50.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.461+0000 7fc262d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:50.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.461+0000 7fc262d2a800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:50:50.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.461+0000 7fc262d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:50.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.461+0000 7fc262d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:50.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.461+0000 7fc262d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:50.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.461+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.461+0000 7fc262d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.461+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:50.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 zone default found 2024-09-12T00:50:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 4 Realm: () 2024-09-12T00:50:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:50:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:50:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 zonegroup default 2024-09-12T00:50:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.462+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.463+0000 7fc262d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.463+0000 7fc262d2a800 20 started sync module instance, tier type = 2024-09-12T00:50:50.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.463+0000 7fc262d2a800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:50:50.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.471+0000 7fc262d2a800 20 add_watcher() i=0 2024-09-12T00:50:50.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.471+0000 7fc262d2a800 20 add_watcher() i=1 2024-09-12T00:50:50.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.471+0000 7fc262d2a800 20 add_watcher() i=2 2024-09-12T00:50:50.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.471+0000 7fc262d2a800 20 add_watcher() i=3 2024-09-12T00:50:50.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.471+0000 7fc262d2a800 20 add_watcher() i=4 2024-09-12T00:50:50.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.471+0000 7fc262d2a800 20 add_watcher() i=5 2024-09-12T00:50:50.470 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.471+0000 7fc262d2a800 20 add_watcher() i=6 2024-09-12T00:50:50.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.472+0000 7fc262d2a800 20 add_watcher() i=7 2024-09-12T00:50:50.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.472+0000 7fc262d2a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:50.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc1157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:50.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc262d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:50.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc262d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:50.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc262d2a800 5 note: GC not initialized 2024-09-12T00:50:50.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc08ffff640 20 reqs_thread_entry: start 2024-09-12T00:50:50.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc262d2a800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:50.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc262d2a800 20 Filter name: none 2024-09-12T00:50:50.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc08dffb640 20 reqs_thread_entry: start 2024-09-12T00:50:50.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc262d2a800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:50:50.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.474+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:50:50.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:50:50.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:50:50.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 : miss 2024-09-12T00:50:50.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:50:50.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:50:50.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:50:50.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:50.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:50:50.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.475+0000 7fc262d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 2024-09-12T00:50:50.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.476+0000 7fc262d2a800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to be held by another RGW process; skipping for now 2024-09-12T00:50:50.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.477+0000 7fc1157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:50.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.480+0000 7fc262d2a800 20 remove_watcher() i=0 2024-09-12T00:50:50.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.480+0000 7fc262d2a800 2 removed watcher, disabling cache 2024-09-12T00:50:50.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.481+0000 7fc262d2a800 20 remove_watcher() i=1 2024-09-12T00:50:50.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.482+0000 7fc262d2a800 20 remove_watcher() i=2 2024-09-12T00:50:50.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.482+0000 7fc262d2a800 20 remove_watcher() i=3 2024-09-12T00:50:50.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.484+0000 7fc262d2a800 20 remove_watcher() i=4 2024-09-12T00:50:50.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.485+0000 7fc262d2a800 20 remove_watcher() i=5 2024-09-12T00:50:50.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.485+0000 7fc262d2a800 20 remove_watcher() i=6 2024-09-12T00:50:50.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:50:50.486+0000 7fc262d2a800 20 remove_watcher() i=7 2024-09-12T00:50:50.495 INFO:tasks.workunit.client.0.smithi083.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:51:20.507 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:20.541 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:20.541 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:20.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.584+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.587+0000 7f021d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.587+0000 7f021d540800 20 realm 2024-09-12T00:51:20.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.587+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.587+0000 7f021d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.587+0000 7f021d540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:20.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.587+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.587+0000 7f021d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.587+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.588+0000 7f021d540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:20.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.588+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.588+0000 7f021d540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:20.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.588+0000 7f021d540800 20 searching for the correct realm 2024-09-12T00:51:20.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.592+0000 7f0219ac1640 0 -- 172.21.15.83:0/1144057162 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f0204031040 msgr2=0x7f0204024920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:20.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.596+0000 7f02192c0640 0 -- 172.21.15.83:0/1144057162 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f0214065d00 msgr2=0x7f0214064770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:20.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:20.599 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.600 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:20.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.601+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:20.601 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 20 zone default found 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 4 Realm: () 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 20 zonegroup default 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.602+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.603+0000 7f021d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.603+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.603+0000 7f021d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.603+0000 7f021d540800 20 started sync module instance, tier type = 2024-09-12T00:51:20.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.603+0000 7f021d540800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.613+0000 7f021d540800 20 add_watcher() i=0 2024-09-12T00:51:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.613+0000 7f021d540800 20 add_watcher() i=1 2024-09-12T00:51:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.613+0000 7f021d540800 20 add_watcher() i=2 2024-09-12T00:51:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.613+0000 7f021d540800 20 add_watcher() i=3 2024-09-12T00:51:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.613+0000 7f021d540800 20 add_watcher() i=4 2024-09-12T00:51:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.613+0000 7f021d540800 20 add_watcher() i=5 2024-09-12T00:51:20.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.613+0000 7f021d540800 20 add_watcher() i=6 2024-09-12T00:51:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.614+0000 7f021d540800 20 add_watcher() i=7 2024-09-12T00:51:20.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.614+0000 7f021d540800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:20.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.616+0000 7f00cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.616+0000 7f021d540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.616+0000 7f021d540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.616+0000 7f021d540800 5 note: GC not initialized 2024-09-12T00:51:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.616+0000 7f00cefe5640 20 reqs_thread_entry: start 2024-09-12T00:51:20.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f021d540800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f021d540800 20 Filter name: none 2024-09-12T00:51:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f00ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f021d540800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:51:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f021d540800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:51:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f021d540800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:51:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f021d540800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:51:20.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f021d540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 : miss 2024-09-12T00:51:20.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.617+0000 7f021d540800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.618+0000 7f021d540800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:51:20.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.618+0000 7f021d540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:51:20.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.618+0000 7f021d540800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:51:20.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.618+0000 7f021d540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:20.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.618+0000 7f021d540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:20.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.618+0000 7f021d540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 2024-09-12T00:51:20.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.619+0000 7f021d540800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:51:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.623+0000 7f021d540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:51:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.623+0000 7f021d540800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:51:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.623+0000 7f021d540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.623+0000 7f021d540800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35, ofs0, ns] 2024-09-12T00:51:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.623+0000 7f00ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94644173379680 notifier 7587 bl.length()=995 2024-09-12T00:51:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.623+0000 7f00ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:51:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.623+0000 7f00ebfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:51:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.623+0000 7f00ebfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:20.622 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.624+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_sources= new_sources= 2024-09-12T00:51:20.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.624+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential sources added=[] removed=[] 2024-09-12T00:51:20.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.624+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_dests= new_dests= 2024-09-12T00:51:20.623 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.624+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential dests added=[] removed=[] 2024-09-12T00:51:20.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.628+0000 7f021d540800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.35.2.0 2024-09-12T00:51:20.626 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.628+0000 7f021d540800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.35.2.0 2024-09-12T00:51:20.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.628+0000 7f021d540800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.35.2.1 2024-09-12T00:51:20.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.628+0000 7f021d540800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.35.2.1 2024-09-12T00:51:20.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.628+0000 7f021d540800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.35.0 2024-09-12T00:51:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.630+0000 7f021d540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:20.629 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.630+0000 7f021d540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 2024-09-12T00:51:20.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f021d540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f021d540800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f021d540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f021d540800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35, ofs0, ns] 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f00fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464285 cookie 94644173379680 notifier 7587 bl.length()=995 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f00fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f00fcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f00fcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_sources= new_sources= 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential sources added=[] removed=[] 2024-09-12T00:51:20.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_dests= new_dests= 2024-09-12T00:51:20.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.632+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential dests added=[] removed=[] 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.633+0000 7f021d540800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.35.0 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.634+0000 7f021d540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.634+0000 7f021d540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.635+0000 7f021d540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.635+0000 7f021d540800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.635+0000 7f021d540800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.635+0000 7f021d540800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35, ofs0, ns] 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.635+0000 7f00fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94644173379680 notifier 7587 bl.length()=963 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.635+0000 7f00fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 info.flags=0x17 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.635+0000 7f00fcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ad4424e4-de7c-4376-b125-e717016a3484.4511.35 to cache LRU end 2024-09-12T00:51:20.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.635+0000 7f00fcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:20.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.636+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_sources= new_sources= 2024-09-12T00:51:20.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.636+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential sources added=[] removed=[] 2024-09-12T00:51:20.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.636+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): orig_dests= new_dests= 2024-09-12T00:51:20.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.636+0000 7f021d540800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ad4424e4-de7c-4376-b125-e717016a3484.4511.35]): potential dests added=[] removed=[] 2024-09-12T00:51:20.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.637+0000 7f021d540800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:20.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.639+0000 7f00cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:20.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.641+0000 7f021d540800 20 remove_watcher() i=0 2024-09-12T00:51:20.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.641+0000 7f021d540800 2 removed watcher, disabling cache 2024-09-12T00:51:20.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.642+0000 7f021d540800 20 remove_watcher() i=1 2024-09-12T00:51:20.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.643+0000 7f021d540800 20 remove_watcher() i=2 2024-09-12T00:51:20.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.644+0000 7f021d540800 20 remove_watcher() i=3 2024-09-12T00:51:20.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.645+0000 7f021d540800 20 remove_watcher() i=4 2024-09-12T00:51:20.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.646+0000 7f021d540800 20 remove_watcher() i=5 2024-09-12T00:51:20.645 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.647+0000 7f021d540800 20 remove_watcher() i=6 2024-09-12T00:51:20.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.648+0000 7f021d540800 20 remove_watcher() i=7 2024-09-12T00:51:20.659 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:51:20.687 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:20.687 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:20.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.724+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.726+0000 7f0e05413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.726+0000 7f0e05413800 20 realm 2024-09-12T00:51:20.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.726+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.727+0000 7f0e05413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.727+0000 7f0e05413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:20.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.727+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.727+0000 7f0e05413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.727+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.728+0000 7f0e05413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:20.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.728+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.728+0000 7f0e05413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:20.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.728+0000 7f0e05413800 20 searching for the correct realm 2024-09-12T00:51:20.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.731+0000 7f0e00347640 0 -- 172.21.15.83:0/3318669707 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f0de80616d0 msgr2=0x7f0de8069410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:20.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.936+0000 7f0e01349640 0 -- 172.21.15.83:0/3318669707 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x555acdb71af0 msgr2=0x555acdb73f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.940+0000 7f0e05413800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.940+0000 7f0e05413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.940+0000 7f0e05413800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.940+0000 7f0e05413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.940+0000 7f0e05413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.940+0000 7f0e05413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.940+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.940+0000 7f0e05413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.940+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:20.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 20 zone default found 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 4 Realm: () 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 20 zonegroup default 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.941+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.942+0000 7f0e05413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.942+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.942+0000 7f0e05413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:20.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.942+0000 7f0e05413800 20 started sync module instance, tier type = 2024-09-12T00:51:20.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.942+0000 7f0e05413800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:20.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.951+0000 7f0e05413800 20 add_watcher() i=0 2024-09-12T00:51:20.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.951+0000 7f0e05413800 20 add_watcher() i=1 2024-09-12T00:51:20.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.951+0000 7f0e05413800 20 add_watcher() i=2 2024-09-12T00:51:20.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.951+0000 7f0e05413800 20 add_watcher() i=3 2024-09-12T00:51:20.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.951+0000 7f0e05413800 20 add_watcher() i=4 2024-09-12T00:51:20.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.951+0000 7f0e05413800 20 add_watcher() i=5 2024-09-12T00:51:20.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.951+0000 7f0e05413800 20 add_watcher() i=6 2024-09-12T00:51:20.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.952+0000 7f0e05413800 20 add_watcher() i=7 2024-09-12T00:51:20.950 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.952+0000 7f0e05413800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:20.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.953+0000 7f0cb6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:20.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.954+0000 7f0e05413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:20.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.954+0000 7f0e05413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:20.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.954+0000 7f0e05413800 5 note: GC not initialized 2024-09-12T00:51:20.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.954+0000 7f0cb5fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:20.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.954+0000 7f0e05413800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:20.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.954+0000 7f0e05413800 20 Filter name: none 2024-09-12T00:51:20.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.954+0000 7f0c277fe640 20 reqs_thread_entry: start 2024-09-12T00:51:20.953 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.954+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.955+0000 7f0e05413800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:51:20.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.955+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.955+0000 7f0e05413800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:51:20.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.955+0000 7f0e05413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:20.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.955+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.956+0000 7f0e05413800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:51:20.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.956+0000 7f0e05413800 20 rados->read ofs=0 len=0 2024-09-12T00:51:20.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.956+0000 7f0e05413800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:51:20.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.956+0000 7f0e05413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:20.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.957+0000 7f0cb6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:20.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.959+0000 7f0e05413800 20 remove_watcher() i=0 2024-09-12T00:51:20.958 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.959+0000 7f0e05413800 2 removed watcher, disabling cache 2024-09-12T00:51:20.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.960+0000 7f0e05413800 20 remove_watcher() i=1 2024-09-12T00:51:20.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.961+0000 7f0e05413800 20 remove_watcher() i=2 2024-09-12T00:51:20.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.962+0000 7f0e05413800 20 remove_watcher() i=3 2024-09-12T00:51:20.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.963+0000 7f0e05413800 20 remove_watcher() i=4 2024-09-12T00:51:20.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.964+0000 7f0e05413800 20 remove_watcher() i=5 2024-09-12T00:51:20.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.965+0000 7f0e05413800 20 remove_watcher() i=6 2024-09-12T00:51:20.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:20.966+0000 7f0e05413800 20 remove_watcher() i=7 2024-09-12T00:51:20.975 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:20.975 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:20.975 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-do-reshard id: ad4424e4-de7c-4376-b125-e717016a3484.4511.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:20.976 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:20.977 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:20.977 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:20.981 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:20.981 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.025 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.025 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.040 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:51:21.040 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:21.041 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.041 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.050 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.051 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.094 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.094 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.102 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.102 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.110 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.110 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.118 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.118 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.126 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.126 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.134 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.134 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.142 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.143 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.150 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.150 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.158 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.158 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.167 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.167 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.175 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.175 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.184 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.184 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.192 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.192 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.200 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.200 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.208 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.208 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.215 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.215 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.223 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.223 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.231 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.231 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.239 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.239 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.247 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:21.247 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:21.255 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:51:21.284 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:21.284 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:21.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.322+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.323+0000 7fe6ba887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.323+0000 7fe6ba887800 20 realm 2024-09-12T00:51:21.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.323+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.324+0000 7fe6ba887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.324+0000 7fe6ba887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:21.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.324+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.324+0000 7fe6ba887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.324+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.325+0000 7fe6ba887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:21.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.325+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.325+0000 7fe6ba887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:21.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.325+0000 7fe6ba887800 20 searching for the correct realm 2024-09-12T00:51:21.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.328+0000 7fe6affff640 0 -- 172.21.15.83:0/3336547381 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fe6a004cb40 msgr2=0x7fe6a000ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:21.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.331+0000 7fe6b8b72640 0 -- 172.21.15.83:0/3336547381 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x562eb9231b50 msgr2=0x562eb9233ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:21.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.334+0000 7fe6ba887800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:21.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.334+0000 7fe6ba887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:21.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.334+0000 7fe6ba887800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:21.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.334+0000 7fe6ba887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:21.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.334+0000 7fe6ba887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:21.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.334+0000 7fe6ba887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.334+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 zone default found 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 4 Realm: () 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 zonegroup default 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.335+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.336+0000 7fe6ba887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.336+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.336+0000 7fe6ba887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.336+0000 7fe6ba887800 20 started sync module instance, tier type = 2024-09-12T00:51:21.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.336+0000 7fe6ba887800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:21.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.344+0000 7fe6ba887800 20 add_watcher() i=0 2024-09-12T00:51:21.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.344+0000 7fe6ba887800 20 add_watcher() i=1 2024-09-12T00:51:21.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.344+0000 7fe6ba887800 20 add_watcher() i=2 2024-09-12T00:51:21.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.344+0000 7fe6ba887800 20 add_watcher() i=3 2024-09-12T00:51:21.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.344+0000 7fe6ba887800 20 add_watcher() i=4 2024-09-12T00:51:21.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.344+0000 7fe6ba887800 20 add_watcher() i=5 2024-09-12T00:51:21.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.344+0000 7fe6ba887800 20 add_watcher() i=6 2024-09-12T00:51:21.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.345+0000 7fe6ba887800 20 add_watcher() i=7 2024-09-12T00:51:21.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.345+0000 7fe6ba887800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:21.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.347+0000 7fe56efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:21.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.347+0000 7fe6ba887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:21.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.347+0000 7fe6ba887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:21.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.347+0000 7fe6ba887800 5 note: GC not initialized 2024-09-12T00:51:21.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.347+0000 7fe56dfdb640 20 reqs_thread_entry: start 2024-09-12T00:51:21.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.348+0000 7fe6ba887800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:21.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.348+0000 7fe6ba887800 20 Filter name: none 2024-09-12T00:51:21.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.348+0000 7fe4df7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:21.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.348+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.348+0000 7fe6ba887800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:21.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.348+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.349+0000 7fe6ba887800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:21.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.349+0000 7fe6ba887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:21.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.349+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.349+0000 7fe6ba887800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:21.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.349+0000 7fe6ba887800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.350+0000 7fe6ba887800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:21.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.350+0000 7fe6ba887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:21.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.351+0000 7fe56efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:21.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.353+0000 7fe6ba887800 20 remove_watcher() i=0 2024-09-12T00:51:21.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.353+0000 7fe6ba887800 2 removed watcher, disabling cache 2024-09-12T00:51:21.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.354+0000 7fe6ba887800 20 remove_watcher() i=1 2024-09-12T00:51:21.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.354+0000 7fe6ba887800 20 remove_watcher() i=2 2024-09-12T00:51:21.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.355+0000 7fe6ba887800 20 remove_watcher() i=3 2024-09-12T00:51:21.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.356+0000 7fe6ba887800 20 remove_watcher() i=4 2024-09-12T00:51:21.356 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.357+0000 7fe6ba887800 20 remove_watcher() i=5 2024-09-12T00:51:21.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.358+0000 7fe6ba887800 20 remove_watcher() i=6 2024-09-12T00:51:21.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.359+0000 7fe6ba887800 20 remove_watcher() i=7 2024-09-12T00:51:21.368 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:21.368 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:21.368 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-logrecord-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:21.368 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:21.369 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:51:21.403 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:21.403 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:21.439 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.440+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.442+0000 7fc37d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.442+0000 7fc37d12a800 20 realm 2024-09-12T00:51:21.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.442+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.442+0000 7fc37d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.442+0000 7fc37d12a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:21.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.442+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.442+0000 7fc37d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.441 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.442+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.443+0000 7fc37d12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:21.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.443+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.443+0000 7fc37d12a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:21.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.443+0000 7fc37d12a800 20 searching for the correct realm 2024-09-12T00:51:21.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.446+0000 7fc3706d9640 0 -- 172.21.15.83:0/3918425282 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fc360064410 msgr2=0x7fc360064870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:21.650 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.651+0000 7fc3796db640 0 -- 172.21.15.83:0/3918425282 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x563d12ed4510 msgr2=0x563d12ed69b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.655+0000 7fc37d12a800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.655+0000 7fc37d12a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.655+0000 7fc37d12a800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.655+0000 7fc37d12a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.655+0000 7fc37d12a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.655+0000 7fc37d12a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.655+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:21.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:21.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 20 zone default found 2024-09-12T00:51:21.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 4 Realm: () 2024-09-12T00:51:21.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:21.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:21.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:21.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 20 zonegroup default 2024-09-12T00:51:21.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.656+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.657+0000 7fc37d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.657+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.657+0000 7fc37d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.657+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.657+0000 7fc37d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.657+0000 7fc37d12a800 20 started sync module instance, tier type = 2024-09-12T00:51:21.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.657+0000 7fc37d12a800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:21.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.666+0000 7fc37d12a800 20 add_watcher() i=0 2024-09-12T00:51:21.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.666+0000 7fc37d12a800 20 add_watcher() i=1 2024-09-12T00:51:21.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.666+0000 7fc37d12a800 20 add_watcher() i=2 2024-09-12T00:51:21.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.666+0000 7fc37d12a800 20 add_watcher() i=3 2024-09-12T00:51:21.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.666+0000 7fc37d12a800 20 add_watcher() i=4 2024-09-12T00:51:21.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.666+0000 7fc37d12a800 20 add_watcher() i=5 2024-09-12T00:51:21.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.666+0000 7fc37d12a800 20 add_watcher() i=6 2024-09-12T00:51:21.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.667+0000 7fc37d12a800 20 add_watcher() i=7 2024-09-12T00:51:21.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.667+0000 7fc37d12a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:21.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.668+0000 7fc22f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:21.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.669+0000 7fc37d12a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:21.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.669+0000 7fc37d12a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:21.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.669+0000 7fc37d12a800 5 note: GC not initialized 2024-09-12T00:51:21.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.669+0000 7fc22e7e4640 20 reqs_thread_entry: start 2024-09-12T00:51:21.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.669+0000 7fc37d12a800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:21.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.669+0000 7fc37d12a800 20 Filter name: none 2024-09-12T00:51:21.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.669+0000 7fc2277fe640 20 reqs_thread_entry: start 2024-09-12T00:51:21.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.669+0000 7fc37d12a800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:51:21.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.669+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:21.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:51:21.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:51:21.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 : miss 2024-09-12T00:51:21.669 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:21.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:21.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:21.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:21.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:21.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.670+0000 7fc37d12a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 2024-09-12T00:51:21.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc37d12a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc37d12a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc37d12a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc37d12a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36, ofs0, ns] 2024-09-12T00:51:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc24ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464403 cookie 94820310595472 notifier 7641 bl.length()=1007 2024-09-12T00:51:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc24ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc24ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc24ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc37d12a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_sources= new_sources= 2024-09-12T00:51:21.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc37d12a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential sources added=[] removed=[] 2024-09-12T00:51:21.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc37d12a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_dests= new_dests= 2024-09-12T00:51:21.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.674+0000 7fc37d12a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential dests added=[] removed=[] 2024-09-12T00:51:21.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.675+0000 7fc37d12a800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:51:21.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.675+0000 7fc37d12a800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:51:21.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.677+0000 7fc37d12a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:21.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.677+0000 7fc37d12a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 2024-09-12T00:51:21.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc37d12a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:21.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc37d12a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:21.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc37d12a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:21.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc37d12a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36, ofs0, ns] 2024-09-12T00:51:21.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc24ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464404 cookie 94820310595472 notifier 7641 bl.length()=975 2024-09-12T00:51:21.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc24ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:21.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc24ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:21.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc24ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:21.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc37d12a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_sources= new_sources= 2024-09-12T00:51:21.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc37d12a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential sources added=[] removed=[] 2024-09-12T00:51:21.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc37d12a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_dests= new_dests= 2024-09-12T00:51:21.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.679+0000 7fc37d12a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential dests added=[] removed=[] 2024-09-12T00:51:21.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.681+0000 7fc22f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:21.681 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.683+0000 7fc37d12a800 20 remove_watcher() i=0 2024-09-12T00:51:21.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.683+0000 7fc37d12a800 2 removed watcher, disabling cache 2024-09-12T00:51:21.682 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.684+0000 7fc37d12a800 20 remove_watcher() i=1 2024-09-12T00:51:21.684 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.685+0000 7fc37d12a800 20 remove_watcher() i=2 2024-09-12T00:51:21.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.686+0000 7fc37d12a800 20 remove_watcher() i=3 2024-09-12T00:51:21.686 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.687+0000 7fc37d12a800 20 remove_watcher() i=4 2024-09-12T00:51:21.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.688+0000 7fc37d12a800 20 remove_watcher() i=5 2024-09-12T00:51:21.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.689+0000 7fc37d12a800 20 remove_watcher() i=6 2024-09-12T00:51:21.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.690+0000 7fc37d12a800 20 remove_watcher() i=7 2024-09-12T00:51:21.701 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:51:21.729 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:21.729 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:21.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.767+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.769+0000 7f8820e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.769+0000 7f8820e31800 20 realm 2024-09-12T00:51:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.769+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.769+0000 7f8820e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.769+0000 7f8820e31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.769+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.770+0000 7f8820e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.770+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.770+0000 7f8820e31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:21.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.770+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.770+0000 7f8820e31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:21.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.770+0000 7f8820e31800 20 searching for the correct realm 2024-09-12T00:51:21.772 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.773+0000 7f8813fff640 0 -- 172.21.15.83:0/573007841 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f8804026040 msgr2=0x7f88040726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:21.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.980+0000 7f881c98c640 0 -- 172.21.15.83:0/573007841 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x564c9c413440 msgr2=0x564c9c4158d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:21.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.983+0000 7f8820e31800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:21.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.983+0000 7f8820e31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:21.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.983+0000 7f8820e31800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:21.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.983+0000 7f8820e31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:21.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.983+0000 7f8820e31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:21.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.983+0000 7f8820e31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:21.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:21.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:21.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 20 zone default found 2024-09-12T00:51:21.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 4 Realm: () 2024-09-12T00:51:21.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:21.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:21.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 20 zonegroup default 2024-09-12T00:51:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.984+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.985+0000 7f8820e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.985+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.985+0000 7f8820e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.985+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.985+0000 7f8820e31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.985+0000 7f8820e31800 20 started sync module instance, tier type = 2024-09-12T00:51:21.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.985+0000 7f8820e31800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:21.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.994+0000 7f8820e31800 20 add_watcher() i=0 2024-09-12T00:51:21.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.994+0000 7f8820e31800 20 add_watcher() i=1 2024-09-12T00:51:21.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.994+0000 7f8820e31800 20 add_watcher() i=2 2024-09-12T00:51:21.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.994+0000 7f8820e31800 20 add_watcher() i=3 2024-09-12T00:51:21.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.994+0000 7f8820e31800 20 add_watcher() i=4 2024-09-12T00:51:21.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.994+0000 7f8820e31800 20 add_watcher() i=5 2024-09-12T00:51:21.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.994+0000 7f8820e31800 20 add_watcher() i=6 2024-09-12T00:51:21.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.994+0000 7f8820e31800 20 add_watcher() i=7 2024-09-12T00:51:21.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.994+0000 7f8820e31800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:21.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.996+0000 7f86d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.997+0000 7f8820e31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.997+0000 7f8820e31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.997+0000 7f8820e31800 5 note: GC not initialized 2024-09-12T00:51:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.997+0000 7f86d1fdb640 20 reqs_thread_entry: start 2024-09-12T00:51:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.997+0000 7f8820e31800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.997+0000 7f8820e31800 20 Filter name: none 2024-09-12T00:51:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.997+0000 7f86437fe640 20 reqs_thread_entry: start 2024-09-12T00:51:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.997+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.998+0000 7f8820e31800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:21.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.998+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.999+0000 7f8820e31800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:21.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.999+0000 7f8820e31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:21.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.999+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.999+0000 7f8820e31800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:21.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.999+0000 7f8820e31800 20 rados->read ofs=0 len=0 2024-09-12T00:51:21.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.999+0000 7f8820e31800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:21.998 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:21.999+0000 7f8820e31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:21.999 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.000+0000 7f86d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:22.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.002+0000 7f8820e31800 20 remove_watcher() i=0 2024-09-12T00:51:22.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.002+0000 7f8820e31800 2 removed watcher, disabling cache 2024-09-12T00:51:22.001 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.003+0000 7f8820e31800 20 remove_watcher() i=1 2024-09-12T00:51:22.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.004+0000 7f8820e31800 20 remove_watcher() i=2 2024-09-12T00:51:22.003 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.005+0000 7f8820e31800 20 remove_watcher() i=3 2024-09-12T00:51:22.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.006+0000 7f8820e31800 20 remove_watcher() i=4 2024-09-12T00:51:22.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.007+0000 7f8820e31800 20 remove_watcher() i=5 2024-09-12T00:51:22.006 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.008+0000 7f8820e31800 20 remove_watcher() i=6 2024-09-12T00:51:22.007 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.009+0000 7f8820e31800 20 remove_watcher() i=7 2024-09-12T00:51:22.018 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:22.018 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:22.018 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-logrecord-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:22.018 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:22.019 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:22.019 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:22.027 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:22.027 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:22.070 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:22.102 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:22.102 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:22.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.139+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.141+0000 7ff12e5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.141+0000 7ff12e5a9800 20 realm 2024-09-12T00:51:22.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.141+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.141+0000 7ff12e5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.141+0000 7ff12e5a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:22.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.141+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.141+0000 7ff12e5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.141+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.142+0000 7ff12e5a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:22.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.142+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.142+0000 7ff12e5a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:22.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.142+0000 7ff12e5a9800 20 searching for the correct realm 2024-09-12T00:51:22.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.145+0000 7ff123fff640 0 -- 172.21.15.83:0/820298866 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff114076a00 msgr2=0x7ff1140a3210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:22.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.551+0000 7ff12c093640 0 -- 172.21.15.83:0/820298866 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff124019410 msgr2=0x7ff124019870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:22.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.556+0000 7ff12e5a9800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:22.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.556+0000 7ff12e5a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.556+0000 7ff12e5a9800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.556+0000 7ff12e5a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.556+0000 7ff12e5a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.556+0000 7ff12e5a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.556+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 20 zone default found 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 4 Realm: () 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 20 zonegroup default 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.557+0000 7ff12e5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.558+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.558+0000 7ff12e5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.558+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.558+0000 7ff12e5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.558+0000 7ff12e5a9800 20 started sync module instance, tier type = 2024-09-12T00:51:22.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.558+0000 7ff12e5a9800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:22.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.567+0000 7ff12e5a9800 20 add_watcher() i=0 2024-09-12T00:51:22.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.567+0000 7ff12e5a9800 20 add_watcher() i=1 2024-09-12T00:51:22.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.567+0000 7ff12e5a9800 20 add_watcher() i=2 2024-09-12T00:51:22.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.567+0000 7ff12e5a9800 20 add_watcher() i=3 2024-09-12T00:51:22.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.567+0000 7ff12e5a9800 20 add_watcher() i=4 2024-09-12T00:51:22.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.567+0000 7ff12e5a9800 20 add_watcher() i=5 2024-09-12T00:51:22.566 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.567+0000 7ff12e5a9800 20 add_watcher() i=6 2024-09-12T00:51:22.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.568+0000 7ff12e5a9800 20 add_watcher() i=7 2024-09-12T00:51:22.567 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.568+0000 7ff12e5a9800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:22.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.570+0000 7fefe2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:22.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.571+0000 7ff12e5a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:22.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.571+0000 7ff12e5a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:22.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.571+0000 7ff12e5a9800 5 note: GC not initialized 2024-09-12T00:51:22.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.571+0000 7fefe1fdb640 20 reqs_thread_entry: start 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.571+0000 7ff12e5a9800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.571+0000 7ff12e5a9800 20 Filter name: none 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.571+0000 7fef537fe640 20 reqs_thread_entry: start 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.571+0000 7ff12e5a9800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.571+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 : miss 2024-09-12T00:51:22.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:22.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:22.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:22.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:22.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:22.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.572+0000 7ff12e5a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 2024-09-12T00:51:22.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.575+0000 7ff12e5a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:22.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.575+0000 7ff12e5a9800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:22.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.575+0000 7ff12e5a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:22.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.575+0000 7ff12e5a9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36, ofs0, ns] 2024-09-12T00:51:22.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.576+0000 7ff0037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464405 cookie 94842760625488 notifier 7677 bl.length()=1007 2024-09-12T00:51:22.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.576+0000 7ff0037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:22.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.576+0000 7ff0037fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:22.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.576+0000 7ff0037fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:22.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.576+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_sources= new_sources= 2024-09-12T00:51:22.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.576+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential sources added=[] removed=[] 2024-09-12T00:51:22.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.576+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_dests= new_dests= 2024-09-12T00:51:22.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.576+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential dests added=[] removed=[] 2024-09-12T00:51:22.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.578+0000 7ff12e5a9800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.36.1.0 2024-09-12T00:51:22.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.578+0000 7ff12e5a9800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.36.1.0 2024-09-12T00:51:22.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.578+0000 7ff12e5a9800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.36.1.1 2024-09-12T00:51:22.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.578+0000 7ff12e5a9800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.36.1.1 2024-09-12T00:51:22.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.578+0000 7ff12e5a9800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.36.0 2024-09-12T00:51:22.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.580+0000 7ff12e5a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:22.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.580+0000 7ff12e5a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 2024-09-12T00:51:22.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.581+0000 7ff12e5a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:22.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.581+0000 7ff12e5a9800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:22.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.581+0000 7ff12e5a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:22.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.581+0000 7ff12e5a9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36, ofs0, ns] 2024-09-12T00:51:22.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.582+0000 7ff0037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464406 cookie 94842760625488 notifier 7677 bl.length()=1007 2024-09-12T00:51:22.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.582+0000 7ff0037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:22.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.582+0000 7ff0037fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:22.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.582+0000 7ff0037fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:22.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.582+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_sources= new_sources= 2024-09-12T00:51:22.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.582+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential sources added=[] removed=[] 2024-09-12T00:51:22.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.582+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_dests= new_dests= 2024-09-12T00:51:22.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.582+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential dests added=[] removed=[] 2024-09-12T00:51:22.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.583+0000 7ff12e5a9800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.36.0 2024-09-12T00:51:22.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.583+0000 7ff12e5a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:22.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.583+0000 7ff12e5a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 2024-09-12T00:51:22.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.585+0000 7ff12e5a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:22.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.585+0000 7ff12e5a9800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:22.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.585+0000 7ff12e5a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:22.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.585+0000 7ff12e5a9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36, ofs0, ns] 2024-09-12T00:51:22.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.585+0000 7ff002ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464407 cookie 94842760625488 notifier 7677 bl.length()=975 2024-09-12T00:51:22.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.585+0000 7ff002ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 info.flags=0x17 2024-09-12T00:51:22.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.585+0000 7ff002ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.36 to cache LRU end 2024-09-12T00:51:22.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.585+0000 7ff002ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:22.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.586+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_sources= new_sources= 2024-09-12T00:51:22.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.586+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential sources added=[] removed=[] 2024-09-12T00:51:22.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.586+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): orig_dests= new_dests= 2024-09-12T00:51:22.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.586+0000 7ff12e5a9800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.36]): potential dests added=[] removed=[] 2024-09-12T00:51:22.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.587+0000 7ff12e5a9800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:22.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.588+0000 7fefe2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:22.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.590+0000 7ff12e5a9800 20 remove_watcher() i=0 2024-09-12T00:51:22.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.590+0000 7ff12e5a9800 2 removed watcher, disabling cache 2024-09-12T00:51:22.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.591+0000 7ff12e5a9800 20 remove_watcher() i=1 2024-09-12T00:51:22.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.592+0000 7ff12e5a9800 20 remove_watcher() i=2 2024-09-12T00:51:22.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.593+0000 7ff12e5a9800 20 remove_watcher() i=3 2024-09-12T00:51:22.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.594+0000 7ff12e5a9800 20 remove_watcher() i=4 2024-09-12T00:51:22.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.595+0000 7ff12e5a9800 20 remove_watcher() i=5 2024-09-12T00:51:22.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.596+0000 7ff12e5a9800 20 remove_watcher() i=6 2024-09-12T00:51:22.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.597+0000 7ff12e5a9800 20 remove_watcher() i=7 2024-09-12T00:51:22.607 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:51:22.636 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:22.637 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:22.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.674+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.676+0000 7f06a8d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.676+0000 7f06a8d44800 20 realm 2024-09-12T00:51:22.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.676+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.677+0000 7f06a8d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.677+0000 7f06a8d44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:22.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.677+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.677+0000 7f06a8d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.677+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.678+0000 7f06a8d44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:22.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.678+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.678+0000 7f06a8d44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:22.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.678+0000 7f06a8d44800 20 searching for the correct realm 2024-09-12T00:51:22.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.681+0000 7f069c2f3640 0 -- 172.21.15.83:0/47780838 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f068c0c6980 msgr2=0x7f068c0c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:22.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.886+0000 7f069c2f3640 0 -- 172.21.15.83:0/47780838 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55700f0b44c0 msgr2=0x55700f0b68b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:22.888 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:22.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.890+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:22.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 zone default found 2024-09-12T00:51:22.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 4 Realm: () 2024-09-12T00:51:22.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:22.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:22.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:22.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 zonegroup default 2024-09-12T00:51:22.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:22.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 started sync module instance, tier type = 2024-09-12T00:51:22.892 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.891+0000 7f06a8d44800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:22.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.899+0000 7f06a8d44800 20 add_watcher() i=0 2024-09-12T00:51:22.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.899+0000 7f06a8d44800 20 add_watcher() i=1 2024-09-12T00:51:22.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.899+0000 7f06a8d44800 20 add_watcher() i=2 2024-09-12T00:51:22.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.899+0000 7f06a8d44800 20 add_watcher() i=3 2024-09-12T00:51:22.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.899+0000 7f06a8d44800 20 add_watcher() i=4 2024-09-12T00:51:22.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.899+0000 7f06a8d44800 20 add_watcher() i=5 2024-09-12T00:51:22.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.900+0000 7f06a8d44800 20 add_watcher() i=6 2024-09-12T00:51:22.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.900+0000 7f06a8d44800 20 add_watcher() i=7 2024-09-12T00:51:22.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.900+0000 7f06a8d44800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:22.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.902+0000 7f055afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.903+0000 7f06a8d44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.903+0000 7f06a8d44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.903+0000 7f06a8d44800 5 note: GC not initialized 2024-09-12T00:51:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.903+0000 7f0559fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.903+0000 7f06a8d44800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.903+0000 7f06a8d44800 20 Filter name: none 2024-09-12T00:51:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.903+0000 7f04cb7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:22.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.903+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.904+0000 7f06a8d44800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:22.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.904+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.904+0000 7f06a8d44800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:22.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.904+0000 7f06a8d44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:22.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.904+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.904+0000 7f06a8d44800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:22.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.904+0000 7f06a8d44800 20 rados->read ofs=0 len=0 2024-09-12T00:51:22.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.905+0000 7f06a8d44800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:22.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.905+0000 7f06a8d44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:22.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.906+0000 7f055afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:22.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.908+0000 7f06a8d44800 20 remove_watcher() i=0 2024-09-12T00:51:22.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.908+0000 7f06a8d44800 2 removed watcher, disabling cache 2024-09-12T00:51:22.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.909+0000 7f06a8d44800 20 remove_watcher() i=1 2024-09-12T00:51:22.908 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.910+0000 7f06a8d44800 20 remove_watcher() i=2 2024-09-12T00:51:22.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.911+0000 7f06a8d44800 20 remove_watcher() i=3 2024-09-12T00:51:22.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.912+0000 7f06a8d44800 20 remove_watcher() i=4 2024-09-12T00:51:22.911 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.913+0000 7f06a8d44800 20 remove_watcher() i=5 2024-09-12T00:51:22.912 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.913+0000 7f06a8d44800 20 remove_watcher() i=6 2024-09-12T00:51:22.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:22.914+0000 7f06a8d44800 20 remove_watcher() i=7 2024-09-12T00:51:22.923 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:22.923 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:22.923 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-logrecord-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:22.923 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:22.925 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:22.926 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:22.929 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:22.929 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:22.972 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:22.972 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:22.985 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:51:22.985 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:22.986 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:22.987 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:22.996 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:22.996 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.039 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.039 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.047 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.047 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.055 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.055 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.065 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.065 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.074 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.074 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.082 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.083 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.090 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.090 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.097 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.098 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.105 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.105 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.113 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.113 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.120 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.120 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.128 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.128 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.136 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.136 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.147 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.147 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.155 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.155 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.163 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.163 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.171 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.171 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.179 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.179 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.187 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.187 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.196 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.197 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.204 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:51:23.233 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:23.233 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:23.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.270+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.272+0000 7f199431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.272+0000 7f199431f800 20 realm 2024-09-12T00:51:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.272+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.272+0000 7f199431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.272+0000 7f199431f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.272+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.272+0000 7f199431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.272+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.474+0000 7f199431f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.474+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.475+0000 7f199431f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:23.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.475+0000 7f199431f800 20 searching for the correct realm 2024-09-12T00:51:23.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.478+0000 7f198f8a8640 0 -- 172.21.15.83:0/933224066 >> [v2:172.21.15.120:6800/3447039892,v1:172.21.15.120:6801/3447039892] conn(0x55be86b52780 msgr2=0x55be86b54b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:23.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.481+0000 7f19900a9640 0 -- 172.21.15.83:0/933224066 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f1988073040 msgr2=0x7f1988073930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:23.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.688+0000 7f199431f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:23.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.688+0000 7f199431f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:23.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.688+0000 7f199431f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:23.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.688+0000 7f199431f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:23.687 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.688+0000 7f199431f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:23.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.688+0000 7f199431f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:23.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.688+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.688+0000 7f199431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.688+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.688 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.689 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 20 zone default found 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 4 Realm: () 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 20 zonegroup default 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.689+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.690+0000 7f199431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.690+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.690+0000 7f199431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.690+0000 7f199431f800 20 started sync module instance, tier type = 2024-09-12T00:51:23.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.690+0000 7f199431f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:23.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.699+0000 7f199431f800 20 add_watcher() i=0 2024-09-12T00:51:23.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.699+0000 7f199431f800 20 add_watcher() i=1 2024-09-12T00:51:23.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.699+0000 7f199431f800 20 add_watcher() i=2 2024-09-12T00:51:23.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.699+0000 7f199431f800 20 add_watcher() i=3 2024-09-12T00:51:23.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.699+0000 7f199431f800 20 add_watcher() i=4 2024-09-12T00:51:23.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.699+0000 7f199431f800 20 add_watcher() i=5 2024-09-12T00:51:23.698 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.699+0000 7f199431f800 20 add_watcher() i=6 2024-09-12T00:51:23.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.700+0000 7f199431f800 20 add_watcher() i=7 2024-09-12T00:51:23.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.700+0000 7f199431f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:23.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.702+0000 7f18467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:23.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.702+0000 7f199431f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:23.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.702+0000 7f199431f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:23.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.702+0000 7f199431f800 5 note: GC not initialized 2024-09-12T00:51:23.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.702+0000 7f18457e2640 20 reqs_thread_entry: start 2024-09-12T00:51:23.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.702+0000 7f199431f800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:23.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.702+0000 7f199431f800 20 Filter name: none 2024-09-12T00:51:23.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.703+0000 7f17b6ffd640 20 reqs_thread_entry: start 2024-09-12T00:51:23.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.703+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.703+0000 7f199431f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:23.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.703+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.704+0000 7f199431f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:23.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.704+0000 7f199431f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:23.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.704+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.704+0000 7f199431f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:23.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.704+0000 7f199431f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.705+0000 7f199431f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:23.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.705+0000 7f199431f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:23.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.706+0000 7f18467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:23.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.708+0000 7f199431f800 20 remove_watcher() i=0 2024-09-12T00:51:23.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.708+0000 7f199431f800 2 removed watcher, disabling cache 2024-09-12T00:51:23.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.709+0000 7f199431f800 20 remove_watcher() i=1 2024-09-12T00:51:23.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.710+0000 7f199431f800 20 remove_watcher() i=2 2024-09-12T00:51:23.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.711+0000 7f199431f800 20 remove_watcher() i=3 2024-09-12T00:51:23.710 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.712+0000 7f199431f800 20 remove_watcher() i=4 2024-09-12T00:51:23.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.713+0000 7f199431f800 20 remove_watcher() i=5 2024-09-12T00:51:23.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.714+0000 7f199431f800 20 remove_watcher() i=6 2024-09-12T00:51:23.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.715+0000 7f199431f800 20 remove_watcher() i=7 2024-09-12T00:51:23.724 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.724 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:23.724 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-logrecord-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:23.724 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.725 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:51:23.759 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:23.759 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:23.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.797+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.799+0000 7fb0b4546800 20 realm 2024-09-12T00:51:23.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.799+0000 7fb0b4546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:23.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.798 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.800+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.800+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.800+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:23.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.800+0000 7fb0b4546800 20 searching for the correct realm 2024-09-12T00:51:23.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.804+0000 7fb0a9836640 0 -- 172.21.15.83:0/3420729216 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fb09c018400 msgr2=0x7fb09c018860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:23.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.807+0000 7fb0a9836640 0 -- 172.21.15.83:0/3420729216 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55af6b769de0 msgr2=0x55af6b76c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:23.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:23.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:23.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:23.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:23.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:23.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:23.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.811 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 zone default found 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 4 Realm: () 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 zonegroup default 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.812 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 started sync module instance, tier type = 2024-09-12T00:51:23.813 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.812+0000 7fb0b4546800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:23.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=0 2024-09-12T00:51:23.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=1 2024-09-12T00:51:23.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=2 2024-09-12T00:51:23.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=3 2024-09-12T00:51:23.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=4 2024-09-12T00:51:23.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=5 2024-09-12T00:51:23.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=6 2024-09-12T00:51:23.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.821+0000 7fb0b4546800 20 add_watcher() i=7 2024-09-12T00:51:23.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.821+0000 7fb0b4546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:23.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.823+0000 7faf68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:23.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.823+0000 7fb0b4546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:23.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.823+0000 7fb0b4546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.823+0000 7fb0b4546800 5 note: GC not initialized 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.823+0000 7faee37fe640 20 reqs_thread_entry: start 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.823+0000 7fb0b4546800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.823+0000 7fb0b4546800 20 Filter name: none 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.824+0000 7faee17fa640 20 reqs_thread_entry: start 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.824+0000 7fb0b4546800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.824+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.824+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.824+0000 7fb0b4546800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.824+0000 7fb0b4546800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.824+0000 7fb0b4546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 : miss 2024-09-12T00:51:23.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.824+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.825+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:23.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.825+0000 7fb0b4546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:23.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.825+0000 7fb0b4546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:23.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.825+0000 7fb0b4546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:23.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.825+0000 7fb0b4546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:23.825 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.825+0000 7fb0b4546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 2024-09-12T00:51:23.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7fb0b4546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:23.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7fb0b4546800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:23.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7fb0b4546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:23.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7fb0b4546800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37, ofs0, ns] 2024-09-12T00:51:23.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94211910578192 notifier 7737 bl.length()=1007 2024-09-12T00:51:23.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:23.828 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:23.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:23.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_sources= new_sources= 2024-09-12T00:51:23.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential sources added=[] removed=[] 2024-09-12T00:51:23.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_dests= new_dests= 2024-09-12T00:51:23.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential dests added=[] removed=[] 2024-09-12T00:51:23.829 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb0b4546800 time 2024-09-12T00:51:23.831756+0000 2024-09-12T00:51:23.829 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb0b7b8c71a] 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb0b7b8c8d8] 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af68aee641] 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd8854c) [0x55af6900154c] 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af68afe31d] 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb0b6829590] 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:51:23.830 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.831+0000 7fb0b4546800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb0b4546800 time 2024-09-12T00:51:23.831756+0000 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb0b7b8c71a] 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb0b7b8c8d8] 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af68aee641] 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd8854c) [0x55af6900154c] 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af68afe31d] 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb0b6829590] 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:51:23.831 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.832 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:51:23.832 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fb0b4546800 thread_name:radosgw-admin 2024-09-12T00:51:23.852 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:23.852 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb0b683e6f0] 2024-09-12T00:51:23.852 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb0b688b99c] 2024-09-12T00:51:23.852 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:51:23.852 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:51:23.852 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb0b7b8c774] 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb0b7b8c8d8] 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af68aee641] 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd8854c) [0x55af6900154c] 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af68afe31d] 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb0b6829590] 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.832+0000 7fb0b4546800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fb0b4546800 thread_name:radosgw-admin 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:23.853 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb0b683e6f0] 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb0b688b99c] 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb0b7b8c774] 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb0b7b8c8d8] 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af68aee641] 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd8854c) [0x55af6900154c] 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af68afe31d] 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb0b6829590] 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:51:23.854 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: dump: 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.855 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7725 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:51:23.781+0000 7fb0b4546800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:51:23.781+0000 7fb0b4546800 4 set_mon_vals no callback set 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:51:23.781+0000 7fb0b4546800 10 monclient: shutdown 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 asok(0x55af6b45f630) unregister_commands rotate-key 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:51:23.781+0000 7fb0b4546800 10 monclient: build_initial_monmap 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:51:23.781+0000 7fb0b4546800 1 build_initial for_mkfs: 0 2024-09-12T00:51:23.856 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:51:23.781+0000 7fb0b4546800 10 monclient: monmap: 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding auth protocol: cephx 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding auth protocol: cephx 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding auth protocol: cephx 2024-09-12T00:51:23.857 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:51:23.782+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.858 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:51:23.782+0000 7fb0b4546800 1 librados: starting msgr at 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:51:23.782+0000 7fb0b4546800 1 librados: starting objecter 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command objecter_requests hook 0x55af6b6aafd0 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:51:23.782+0000 7fb0b4546800 1 librados: setting wanted keys 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:51:23.782+0000 7fb0b4546800 1 librados: calling monclient init 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient: init 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding auth protocol: cephx 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding auth protocol: cephx 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding auth protocol: cephx 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.859 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:51:23.782+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:51:23.782+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command rotate-key hook 0x55af6b67fc08 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-a con 0x55af6b5366e0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:23.860 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-b con 0x55af6b5c9430 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-c con 0x55af6b6aa280 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): authenticate will time out at 2037.051924s 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): get_auth_request con 0x55af6b5366e0 auth_method 0 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): get_auth_request con 0x55af6b6aa280 auth_method 0 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.861 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): handle_auth_done global_id 7295 payload 824 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient: _finish_hunting 0 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:51:23.783+0000 7fb0b2838640 1 monclient: found mon.noname-c 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:23.862 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: dump: 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.863 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: dump: 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.864 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:51:23.783+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7295 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:51:23.783+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:51:23.783+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:51:23.783+0000 7fafa0608640 4 set_mon_vals no callback set 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:51:23.783+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:51:23.783+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:51:23.783+0000 7fb0b4546800 1 librados: init done 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:51:23.785+0000 7faf9ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:51:23.785+0000 7faf9ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:51:23.785+0000 7faf9ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:51:23.785+0000 7fb0b2037640 10 monclient: get_auth_request con 0x7faf980764a0 auth_method 0 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:51:23.786+0000 7fb0a9836640 10 monclient: get_auth_request con 0x55af6b6c85e0 auth_method 0 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:51:23.786+0000 7fb0b2037640 10 monclient: get_auth_request con 0x55af6b6cb7c0 auth_method 0 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:51:23.788+0000 7fb0a9836640 10 monclient: get_auth_request con 0x55af6b6d0850 auth_method 0 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:51:23.788+0000 7fb0b4546800 10 monclient: build_initial_monmap 2024-09-12T00:51:23.865 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:51:23.788+0000 7fb0b4546800 1 build_initial for_mkfs: 0 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:51:23.788+0000 7fb0b4546800 10 monclient: monmap: 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding auth protocol: cephx 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding auth protocol: cephx 2024-09-12T00:51:23.866 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding auth protocol: cephx 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.867 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:51:23.788+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command objecter_requests cmddesc objecter_requests hook 0x55af6b6d8100 EEXIST 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient: init 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding auth protocol: cephx 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding auth protocol: cephx 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding auth protocol: cephx 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.868 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:51:23.789+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:51:23.789+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command rotate-key cmddesc rotate-key hook 0x55af6b6d38c0 EEXIST 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-a con 0x55af6b6fbdf0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-c con 0x55af6b6fe0c0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-b con 0x55af6b6fa5c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.869 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): authenticate will time out at 2037.058763s 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): get_auth_request con 0x55af6b6fbdf0 auth_method 0 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): get_auth_request con 0x55af6b6fe0c0 auth_method 0 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.870 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:51:23.790+0000 7fb0b2037640 10 monclient(hunting): handle_auth_done global_id 7731 payload 824 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:51:23.790+0000 7fb0b2037640 10 monclient: _finish_hunting 0 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:51:23.790+0000 7fb0b2037640 1 monclient: found mon.noname-a 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:51:23.790+0000 7fb0b2037640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: dump: 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.871 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: dump: 2024-09-12T00:51:23.872 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:51:23.790+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7731 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:51:23.790+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:51:23.790+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.873 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:51:23.790+0000 7fb0b3039640 4 set_mon_vals no callback set 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:51:23.790+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:51:23.790+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:51:23.792+0000 7faf97fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:51:23.792+0000 7faf97fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:51:23.792+0000 7faf97fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:51:23.792+0000 7fb0a9836640 10 monclient: get_auth_request con 0x7faf8c076380 auth_method 0 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:51:23.792+0000 7fb0b4546800 10 monclient: get_monmap_and_config 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:51:23.792+0000 7fb0b4546800 10 monclient: build_initial_monmap 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:51:23.792+0000 7fb0b4546800 1 build_initial for_mkfs: 0 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:51:23.792+0000 7fb0b4546800 10 monclient: monmap: 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:23.874 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding auth protocol: cephx 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding auth protocol: cephx 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding auth protocol: cephx 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.875 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:51:23.792+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:51:23.792+0000 7fb0b4546800 10 monclient: init 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding auth protocol: cephx 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding auth protocol: cephx 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding auth protocol: cephx 2024-09-12T00:51:23.876 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:51:23.793+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.877 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:51:23.793+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:51:23.793+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command rotate-key cmddesc rotate-key hook 0x7fff453a6418 EEXIST 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-b con 0x55af6b74ffd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-c con 0x55af6b720f20 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-a con 0x55af6b74b870 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): authenticate will time out at 2037.062425s 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): get_auth_request con 0x55af6b720f20 auth_method 0 2024-09-12T00:51:23.878 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): get_auth_request con 0x55af6b74b870 auth_method 0 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.879 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): get_auth_request con 0x55af6b74ffd0 auth_method 0 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): handle_auth_done global_id 7734 payload 274 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient: _finish_hunting 0 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:51:23.793+0000 7fb0b2838640 1 monclient: found mon.noname-a 2024-09-12T00:51:23.880 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:51:23.793+0000 7faf95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:51:23.793+0000 7faf95ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:51:23.793+0000 7faf95ffb640 10 monclient: dump: 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.881 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7734 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: dump: 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.882 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:51:23.794+0000 7fb0b4546800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:51:23.794+0000 7fb0b4546800 4 set_mon_vals no callback set 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:51:23.794+0000 7fb0b4546800 10 monclient: shutdown 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:51:23.794+0000 7fb0b4546800 10 monclient: build_initial_monmap 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:51:23.794+0000 7fb0b4546800 1 build_initial for_mkfs: 0 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:51:23.794+0000 7fb0b4546800 10 monclient: monmap: 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:23.883 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding auth protocol: cephx 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding auth protocol: cephx 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding auth protocol: cephx 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.884 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:51:23.794+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:51:23.794+0000 7fb0b4546800 1 librados: starting msgr at 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:51:23.794+0000 7fb0b4546800 1 librados: starting objecter 2024-09-12T00:51:23.885 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command objecter_requests cmddesc objecter_requests hook 0x55af6b71f110 EEXIST 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:51:23.795+0000 7fb0b4546800 1 librados: setting wanted keys 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:51:23.795+0000 7fb0b4546800 1 librados: calling monclient init 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient: init 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding auth protocol: cephx 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding auth protocol: cephx 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding auth protocol: cephx 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.886 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:51:23.795+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:51:23.795+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command rotate-key cmddesc rotate-key hook 0x55af6b713ce8 EEXIST 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-c con 0x55af6b720f20 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-b con 0x55af6b74b870 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-a con 0x55af6b74ffd0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:23.887 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): authenticate will time out at 2037.064622s 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): get_auth_request con 0x55af6b74ffd0 auth_method 0 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): get_auth_request con 0x55af6b720f20 auth_method 0 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.888 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): get_auth_request con 0x55af6b74b870 auth_method 0 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.889 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): handle_auth_done global_id 7737 payload 824 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient: _finish_hunting 0 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:51:23.795+0000 7fb0b2838640 1 monclient: found mon.noname-a 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: dump: 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.890 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: dump: 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.891 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:51:23.796+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7737 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:51:23.796+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:51:23.796+0000 7faf95ffb640 4 set_mon_vals no callback set 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:51:23.796+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:51:23.796+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:51:23.796+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:51:23.796+0000 7fb0b4546800 1 librados: init done 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:51:23.796+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cr dump hook 0x55af6b746348 2024-09-12T00:51:23.892 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:51:23.797+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:51:23.798+0000 7faf83fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:51:23.798+0000 7faf83fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:51:23.798+0000 7faf83fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:51:23.798+0000 7fb0b2037640 10 monclient: get_auth_request con 0x7faf7c076470 auth_method 0 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:51:23.798+0000 7fb0a9836640 10 monclient: get_auth_request con 0x55af6b769de0 auth_method 0 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 realm 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:51:23.799+0000 7fb0b4546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.893 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:51:23.799+0000 7fb0b2037640 10 monclient: get_auth_request con 0x55af6b76e140 auth_method 0 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:51:23.800+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:51:23.800+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:51:23.800+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:51:23.800+0000 7fb0b4546800 20 searching for the correct realm 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:51:23.801+0000 7fb0a9836640 10 monclient: get_auth_request con 0x55af6b773290 auth_method 0 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:51:23.801+0000 7fb0b2838640 10 monclient: get_auth_request con 0x7fb09c026990 auth_method 0 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:51:23.802+0000 7fb0b2037640 10 monclient: get_auth_request con 0x7fb0a408f060 auth_method 0 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:51:23.803+0000 7fb0a9836640 10 monclient: get_auth_request con 0x7fb09c018400 auth_method 0 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:51:23.804+0000 7fb0a9836640 0 -- 172.21.15.83:0/3420729216 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fb09c018400 msgr2=0x7fb09c018860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:51:23.804+0000 7faf83fff640 1 client.7737.objecter ms_handle_reset 0x7fb09c018400 session 0x7fb09c008e00 osd.5 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:51:23.804+0000 7faf83fff640 10 monclient: _renew_subs 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:51:23.804+0000 7faf83fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:51:23.804+0000 7fb0a9836640 10 monclient: get_auth_request con 0x7faf7c086790 auth_method 0 2024-09-12T00:51:23.894 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:51:23.805+0000 7fb0b2838640 10 monclient: get_auth_request con 0x7fb0a40b4760 auth_method 0 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:51:23.806+0000 7fb0b2037640 10 monclient: get_auth_request con 0x7fb0ac015030 auth_method 0 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:51:23.807+0000 7fb0a9836640 0 -- 172.21.15.83:0/3420729216 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55af6b769de0 msgr2=0x55af6b76c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:51:23.807+0000 7faf83fff640 1 client.7737.objecter ms_handle_reset 0x55af6b769de0 session 0x55af6b769710 osd.6 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:51:23.807+0000 7fb0a9836640 10 monclient: get_auth_request con 0x7fb09c018400 auth_method 0 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.895 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 zone default found 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:51:23.812+0000 7fb0b4546800 4 Realm: () 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:51:23.812+0000 7fb0b4546800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:51:23.812+0000 7fb0b4546800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:51:23.812+0000 7fb0b4546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 zonegroup default 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.896 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 started sync module instance, tier type = 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=0 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=1 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=2 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=3 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=4 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=5 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=6 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:51:23.821+0000 7fb0b4546800 20 add_watcher() i=7 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:51:23.821+0000 7fb0b4546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding auth protocol: cephx 2024-09-12T00:51:23.897 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding auth protocol: cephx 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding auth protocol: cephx 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:51:23.823+0000 7faf68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.898 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:51:23.823+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:51:23.823+0000 7fb0b4546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:51:23.823+0000 7fb0b4546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cache list hook 0x55af6b73d380 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cache inspect hook 0x55af6b73d380 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cache erase hook 0x55af6b73d380 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cache zap hook 0x55af6b73d380 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 note: GC not initialized 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:51:23.823+0000 7faee37fe640 20 reqs_thread_entry: start 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command sync trace show hook 0x7fb0ac005430 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command sync trace history hook 0x7fb0ac005430 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command sync trace active hook 0x7fb0ac005430 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command sync trace active_short hook 0x7fb0ac005430 2024-09-12T00:51:23.899 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:51:23.823+0000 7fb0b4546800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:51:23.823+0000 7fb0b4546800 20 Filter name: none 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:51:23.824+0000 7faee17fa640 20 reqs_thread_entry: start 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:51:23.824+0000 7fb0b4546800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:51:23.824+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:51:23.824+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:51:23.824+0000 7fb0b4546800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:51:23.824+0000 7fb0b4546800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:51:23.824+0000 7fb0b4546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 : miss 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:51:23.824+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:51:23.825+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:23.900 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:51:23.829+0000 7fb0b4546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:51:23.829+0000 7fb0b4546800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:51:23.829+0000 7fb0b4546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:51:23.829+0000 7fb0b4546800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37, ofs0, ns] 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94211910578192 notifier 7737 bl.length()=1007 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_sources= new_sources= 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential sources added=[] removed=[] 2024-09-12T00:51:23.901 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_dests= new_dests= 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential dests added=[] removed=[] 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:51:23.831+0000 7fb0b4546800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb0b4546800 time 2024-09-12T00:51:23.831756+0000 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb0b7b8c71a] 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb0b7b8c8d8] 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af68aee641] 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd8854c) [0x55af6900154c] 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af68afe31d] 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb0b6829590] 2024-09-12T00:51:23.902 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:51:23.832+0000 7fb0b4546800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fb0b4546800 thread_name:radosgw-admin 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb0b683e6f0] 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb0b688b99c] 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb0b7b8c774] 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb0b7b8c8d8] 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af68aee641] 2024-09-12T00:51:23.903 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd8854c) [0x55af6900154c] 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af68afe31d] 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb0b6829590] 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:51:23.904 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:23.905 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:51:23.906 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:23.907 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:51:23.908 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:23.909 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:23.910 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 7faee17fa640 / http_manager 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 7faee37fe640 / http_manager 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf68fe1640 / rgw_dt_lg_renew 2024-09-12T00:51:23.911 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf83fff640 / ms_dispatch 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf95ffb640 / io_context_pool 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf97fff640 / ms_dispatch 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf9ee05640 / ms_dispatch 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: 7fafa0608640 / io_context_pool 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0a9836640 / msgr-worker-2 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0b2037640 / msgr-worker-1 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0b2838640 / msgr-worker-0 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0b3039640 / io_context_pool 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0b4546800 / radosgw-admin 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.135481.log 2024-09-12T00:51:23.912 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:51:23.781+0000 7fafa0608640 10 monclient: dump: 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.913 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7725 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:51:23.781+0000 7fb0b4546800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:51:23.781+0000 7fb0b4546800 4 set_mon_vals no callback set 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:51:23.781+0000 7fb0b4546800 10 monclient: shutdown 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 asok(0x55af6b45f630) unregister_commands rotate-key 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:51:23.781+0000 7fb0b4546800 10 monclient: build_initial_monmap 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:51:23.781+0000 7fb0b4546800 1 build_initial for_mkfs: 0 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:51:23.781+0000 7fb0b4546800 10 monclient: monmap: 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:23.914 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding auth protocol: cephx 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding auth protocol: cephx 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding auth protocol: cephx 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.915 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:51:23.781+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: crc 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b685730) adding con mode: secure 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:51:23.782+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:51:23.782+0000 7fb0b4546800 1 librados: starting msgr at 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:51:23.782+0000 7fb0b4546800 1 librados: starting objecter 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command objecter_requests hook 0x55af6b6aafd0 2024-09-12T00:51:23.916 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:51:23.782+0000 7fb0b4546800 1 librados: setting wanted keys 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:51:23.782+0000 7fb0b4546800 1 librados: calling monclient init 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient: init 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding auth protocol: cephx 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding auth protocol: cephx 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding auth protocol: cephx 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.917 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: crc 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 AuthRegistry(0x55af6b67fac0) adding con mode: secure 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:51:23.782+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:51:23.782+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:51:23.782+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command rotate-key hook 0x55af6b67fc08 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-a con 0x55af6b5366e0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-b con 0x55af6b5c9430 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-c con 0x55af6b6aa280 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.918 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:51:23.782+0000 7fb0b4546800 10 monclient(hunting): authenticate will time out at 2037.051924s 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): get_auth_request con 0x55af6b5366e0 auth_method 0 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): get_auth_request con 0x55af6b6aa280 auth_method 0 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.919 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:51:23.783+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient(hunting): handle_auth_done global_id 7295 payload 824 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient: _finish_hunting 0 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:51:23.783+0000 7fb0b2838640 1 monclient: found mon.noname-c 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:51:23.783+0000 7fb0b2838640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: dump: 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.920 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:51:23.783+0000 7faf9ee05640 10 monclient: dump: 2024-09-12T00:51:23.921 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:51:23.783+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7295 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:51:23.783+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:51:23.783+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:51:23.783+0000 7fafa0608640 4 set_mon_vals no callback set 2024-09-12T00:51:23.922 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:51:23.783+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:51:23.783+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:51:23.783+0000 7fb0b4546800 1 librados: init done 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:51:23.785+0000 7faf9ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:51:23.785+0000 7faf9ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:51:23.785+0000 7faf9ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:51:23.785+0000 7fb0b2037640 10 monclient: get_auth_request con 0x7faf980764a0 auth_method 0 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:51:23.786+0000 7fb0a9836640 10 monclient: get_auth_request con 0x55af6b6c85e0 auth_method 0 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:51:23.786+0000 7fb0b2037640 10 monclient: get_auth_request con 0x55af6b6cb7c0 auth_method 0 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:51:23.788+0000 7fb0a9836640 10 monclient: get_auth_request con 0x55af6b6d0850 auth_method 0 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:51:23.788+0000 7fb0b4546800 10 monclient: build_initial_monmap 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:51:23.788+0000 7fb0b4546800 1 build_initial for_mkfs: 0 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:51:23.788+0000 7fb0b4546800 10 monclient: monmap: 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:23.923 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding auth protocol: cephx 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding auth protocol: cephx 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding auth protocol: cephx 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.924 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: crc 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:51:23.788+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d4730) adding con mode: secure 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:51:23.788+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command objecter_requests cmddesc objecter_requests hook 0x55af6b6d8100 EEXIST 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient: init 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding auth protocol: cephx 2024-09-12T00:51:23.925 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding auth protocol: cephx 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding auth protocol: cephx 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: crc 2024-09-12T00:51:23.926 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 AuthRegistry(0x55af6b6d3778) adding con mode: secure 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:51:23.789+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:51:23.789+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:51:23.789+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command rotate-key cmddesc rotate-key hook 0x55af6b6d38c0 EEXIST 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-a con 0x55af6b6fbdf0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-c con 0x55af6b6fe0c0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-b con 0x55af6b6fa5c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:51:23.789+0000 7fb0b4546800 10 monclient(hunting): authenticate will time out at 2037.058763s 2024-09-12T00:51:23.927 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): get_auth_request con 0x55af6b6fbdf0 auth_method 0 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): get_auth_request con 0x55af6b6fe0c0 auth_method 0 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:51:23.789+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:51:23.789+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.928 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:51:23.790+0000 7fb0b2037640 10 monclient(hunting): handle_auth_done global_id 7731 payload 824 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:51:23.790+0000 7fb0b2037640 10 monclient: _finish_hunting 0 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:51:23.790+0000 7fb0b2037640 1 monclient: found mon.noname-a 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:51:23.790+0000 7fb0b2037640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: dump: 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.929 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:51:23.790+0000 7faf97fff640 10 monclient: dump: 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.930 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:51:23.790+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7731 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:51:23.790+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:51:23.790+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:51:23.790+0000 7fb0b3039640 4 set_mon_vals no callback set 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:51:23.790+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:51:23.790+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:51:23.792+0000 7faf97fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:51:23.792+0000 7faf97fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:51:23.792+0000 7faf97fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.931 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:51:23.792+0000 7fb0a9836640 10 monclient: get_auth_request con 0x7faf8c076380 auth_method 0 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:51:23.792+0000 7fb0b4546800 10 monclient: get_monmap_and_config 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:51:23.792+0000 7fb0b4546800 10 monclient: build_initial_monmap 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:51:23.792+0000 7fb0b4546800 1 build_initial for_mkfs: 0 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:51:23.792+0000 7fb0b4546800 10 monclient: monmap: 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:23.932 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding auth protocol: cephx 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding auth protocol: cephx 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding auth protocol: cephx 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.933 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: crc 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x55af6b71b930) adding con mode: secure 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:51:23.792+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:51:23.792+0000 7fb0b4546800 10 monclient: init 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding auth protocol: cephx 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding auth protocol: cephx 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding auth protocol: cephx 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.934 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: crc 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:51:23.792+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a62d0) adding con mode: secure 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:51:23.793+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:51:23.793+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:51:23.793+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command rotate-key cmddesc rotate-key hook 0x7fff453a6418 EEXIST 2024-09-12T00:51:23.935 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-b con 0x55af6b74ffd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-c con 0x55af6b720f20 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-a con 0x55af6b74b870 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:51:23.793+0000 7fb0b4546800 10 monclient(hunting): authenticate will time out at 2037.062425s 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): get_auth_request con 0x55af6b720f20 auth_method 0 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.936 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): get_auth_request con 0x55af6b74b870 auth_method 0 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:51:23.793+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): get_auth_request con 0x55af6b74ffd0 auth_method 0 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.937 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:51:23.793+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient(hunting): handle_auth_done global_id 7734 payload 274 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient: _finish_hunting 0 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:51:23.793+0000 7fb0b2838640 1 monclient: found mon.noname-a 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:51:23.793+0000 7fb0b2838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:51:23.793+0000 7faf95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:51:23.793+0000 7faf95ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:51:23.793+0000 7faf95ffb640 10 monclient: dump: 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.938 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7734 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:23.939 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:51:23.794+0000 7faf95ffb640 10 monclient: dump: 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:51:23.794+0000 7fb0b4546800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:51:23.794+0000 7fb0b4546800 4 set_mon_vals no callback set 2024-09-12T00:51:23.940 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:51:23.794+0000 7fb0b4546800 10 monclient: shutdown 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:51:23.794+0000 7fb0b4546800 10 monclient: build_initial_monmap 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:51:23.794+0000 7fb0b4546800 1 build_initial for_mkfs: 0 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:51:23.794+0000 7fb0b4546800 10 monclient: monmap: 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.941 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding auth protocol: cephx 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding auth protocol: cephx 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding auth protocol: cephx 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: crc 2024-09-12T00:51:23.942 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:51:23.794+0000 7fb0b4546800 5 AuthRegistry(0x55af6b7424a0) adding con mode: secure 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:51:23.794+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:51:23.794+0000 7fb0b4546800 1 librados: starting msgr at 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:51:23.794+0000 7fb0b4546800 1 librados: starting objecter 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command objecter_requests cmddesc objecter_requests hook 0x55af6b71f110 EEXIST 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:51:23.795+0000 7fb0b4546800 1 librados: setting wanted keys 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:51:23.795+0000 7fb0b4546800 1 librados: calling monclient init 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient: init 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding auth protocol: cephx 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding auth protocol: cephx 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding auth protocol: cephx 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.943 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: crc 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 AuthRegistry(0x55af6b713ba0) adding con mode: secure 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:51:23.795+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:51:23.795+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:51:23.795+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command rotate-key cmddesc rotate-key hook 0x55af6b713ce8 EEXIST 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:23.944 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-c con 0x55af6b720f20 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-b con 0x55af6b74b870 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): picked mon.noname-a con 0x55af6b74ffd0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:51:23.795+0000 7fb0b4546800 10 monclient(hunting): authenticate will time out at 2037.064622s 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): get_auth_request con 0x55af6b74ffd0 auth_method 0 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): get_auth_request con 0x55af6b720f20 auth_method 0 2024-09-12T00:51:23.945 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:51:23.795+0000 7fb0b2037640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): get_auth_request con 0x55af6b74b870 auth_method 0 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:23.946 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:51:23.795+0000 7fb0a9836640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient(hunting): handle_auth_done global_id 7737 payload 824 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient: _finish_hunting 0 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:51:23.795+0000 7fb0b2838640 1 monclient: found mon.noname-a 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:51:23.795+0000 7fb0b2838640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: dump: 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.947 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: _finish_auth 0 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:51:23.796+0000 7faf83fff640 10 monclient: dump: 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:23.948 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:51:23.796+0000 7fb0b4546800 5 monclient: authenticate success, global_id 7737 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:51:23.796+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:51:23.796+0000 7faf95ffb640 4 set_mon_vals no callback set 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:51:23.796+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:51:23.796+0000 7fb0b4546800 10 monclient: _renew_subs 2024-09-12T00:51:23.949 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:51:23.796+0000 7fb0b4546800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:51:23.796+0000 7fb0b4546800 1 librados: init done 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:51:23.796+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cr dump hook 0x55af6b746348 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:51:23.797+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:51:23.798+0000 7faf83fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:51:23.798+0000 7faf83fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:51:23.798+0000 7faf83fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:51:23.798+0000 7fb0b2037640 10 monclient: get_auth_request con 0x7faf7c076470 auth_method 0 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:51:23.798+0000 7fb0a9836640 10 monclient: get_auth_request con 0x55af6b769de0 auth_method 0 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 realm 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.950 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:51:23.799+0000 7fb0b4546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:51:23.799+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:51:23.799+0000 7fb0b2037640 10 monclient: get_auth_request con 0x55af6b76e140 auth_method 0 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:51:23.800+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:51:23.800+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:51:23.800+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:51:23.800+0000 7fb0b4546800 20 searching for the correct realm 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:51:23.801+0000 7fb0a9836640 10 monclient: get_auth_request con 0x55af6b773290 auth_method 0 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:51:23.801+0000 7fb0b2838640 10 monclient: get_auth_request con 0x7fb09c026990 auth_method 0 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:51:23.802+0000 7fb0b2037640 10 monclient: get_auth_request con 0x7fb0a408f060 auth_method 0 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:51:23.803+0000 7fb0a9836640 10 monclient: get_auth_request con 0x7fb09c018400 auth_method 0 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:51:23.804+0000 7fb0a9836640 0 -- 172.21.15.83:0/3420729216 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fb09c018400 msgr2=0x7fb09c018860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:23.951 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:51:23.804+0000 7faf83fff640 1 client.7737.objecter ms_handle_reset 0x7fb09c018400 session 0x7fb09c008e00 osd.5 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:51:23.804+0000 7faf83fff640 10 monclient: _renew_subs 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:51:23.804+0000 7faf83fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:51:23.804+0000 7fb0a9836640 10 monclient: get_auth_request con 0x7faf7c086790 auth_method 0 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:51:23.805+0000 7fb0b2838640 10 monclient: get_auth_request con 0x7fb0a40b4760 auth_method 0 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:51:23.806+0000 7fb0b2037640 10 monclient: get_auth_request con 0x7fb0ac015030 auth_method 0 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:51:23.807+0000 7fb0a9836640 0 -- 172.21.15.83:0/3420729216 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55af6b769de0 msgr2=0x55af6b76c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:51:23.807+0000 7faf83fff640 1 client.7737.objecter ms_handle_reset 0x55af6b769de0 session 0x55af6b769710 osd.6 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:51:23.807+0000 7fb0a9836640 10 monclient: get_auth_request con 0x7fb09c018400 auth_method 0 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:23.952 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:51:23.811+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 zone default found 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:51:23.812+0000 7fb0b4546800 4 Realm: () 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:51:23.812+0000 7fb0b4546800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:51:23.812+0000 7fb0b4546800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:51:23.812+0000 7fb0b4546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 zonegroup default 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.953 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 started sync module instance, tier type = 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:51:23.812+0000 7fb0b4546800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=0 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=1 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=2 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=3 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=4 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=5 2024-09-12T00:51:23.954 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:51:23.820+0000 7fb0b4546800 20 add_watcher() i=6 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:51:23.821+0000 7fb0b4546800 20 add_watcher() i=7 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:51:23.821+0000 7fb0b4546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding auth protocol: cephx 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding auth protocol: cephx 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding auth protocol: cephx 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.955 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:51:23.823+0000 7faf68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: crc 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 AuthRegistry(0x7fff453a67b0) adding con mode: secure 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:51:23.823+0000 7fb0b4546800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:51:23.823+0000 7fb0b4546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:51:23.823+0000 7fb0b4546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cache list hook 0x55af6b73d380 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cache inspect hook 0x55af6b73d380 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cache erase hook 0x55af6b73d380 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command cache zap hook 0x55af6b73d380 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 note: GC not initialized 2024-09-12T00:51:23.956 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:51:23.823+0000 7faee37fe640 20 reqs_thread_entry: start 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command sync trace show hook 0x7fb0ac005430 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command sync trace history hook 0x7fb0ac005430 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command sync trace active hook 0x7fb0ac005430 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:51:23.823+0000 7fb0b4546800 5 asok(0x55af6b45f630) register_command sync trace active_short hook 0x7fb0ac005430 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:51:23.823+0000 7fb0b4546800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:51:23.823+0000 7fb0b4546800 20 Filter name: none 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:51:23.824+0000 7faee17fa640 20 reqs_thread_entry: start 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:51:23.824+0000 7fb0b4546800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:51:23.824+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:51:23.824+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:51:23.824+0000 7fb0b4546800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:51:23.824+0000 7fb0b4546800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:51:23.824+0000 7fb0b4546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 : miss 2024-09-12T00:51:23.957 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:51:23.824+0000 7fb0b4546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:51:23.825+0000 7fb0b4546800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:51:23.825+0000 7fb0b4546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:51:23.829+0000 7fb0b4546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:51:23.829+0000 7fb0b4546800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:51:23.829+0000 7fb0b4546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:51:23.829+0000 7fb0b4546800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37, ofs0, ns] 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94211910578192 notifier 7737 bl.length()=1007 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:23.958 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:51:23.829+0000 7faf95ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_sources= new_sources= 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential sources added=[] removed=[] 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_dests= new_dests= 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:51:23.829+0000 7fb0b4546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential dests added=[] removed=[] 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:51:23.831+0000 7fb0b4546800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb0b4546800 time 2024-09-12T00:51:23.831756+0000 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb0b7b8c71a] 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb0b7b8c8d8] 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af68aee641] 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd8854c) [0x55af6900154c] 2024-09-12T00:51:23.959 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af68afe31d] 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb0b6829590] 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:51:23.832+0000 7fb0b4546800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fb0b4546800 thread_name:radosgw-admin 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb0b683e6f0] 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb0b688b99c] 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:51:23.960 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb0b7b8c774] 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fb0b7b8c8d8] 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55af68aee641] 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd8854c) [0x55af6900154c] 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55af68afe31d] 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb0b6829590] 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:51:23.961 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:51:23.962 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:51:23.963 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:23.964 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:51:23.965 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:23.966 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:51:23.967 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 7faee17fa640 / http_manager 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 7faee37fe640 / http_manager 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf68fe1640 / rgw_dt_lg_renew 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf83fff640 / ms_dispatch 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf95ffb640 / io_context_pool 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf97fff640 / ms_dispatch 2024-09-12T00:51:23.968 INFO:tasks.workunit.client.0.smithi083.stderr: 7faf9ee05640 / ms_dispatch 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr: 7fafa0608640 / io_context_pool 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0a9836640 / msgr-worker-2 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0b2037640 / msgr-worker-1 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0b2838640 / msgr-worker-0 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0b3039640 / io_context_pool 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr: 7fb0b4546800 / radosgw-admin 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:51:23.833406Z_542c6072-170d-46a6-8a83-859df5922ef8/log 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:51:23.969 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.908+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.910+0000 7f6d9c339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.910+0000 7f6d9c339800 20 realm 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.910+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.910+0000 7f6d9c339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.910+0000 7f6d9c339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.910+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.910+0000 7f6d9c339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.910+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.911+0000 7f6d9c339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.911+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.911+0000 7f6d9c339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.911+0000 7f6d9c339800 20 searching for the correct realm 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.915+0000 7f6d8f7c6640 0 -- 172.21.15.83:0/1243536487 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f6d800843f0 msgr2=0x7f6d80084830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.918+0000 7f6d97fc7640 0 -- 172.21.15.83:0/1243536487 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f6d9000f940 msgr2=0x7f6d90034400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.922+0000 7f6d9c339800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.922+0000 7f6d9c339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.922+0000 7f6d9c339800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.922+0000 7f6d9c339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.922+0000 7f6d9c339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.922+0000 7f6d9c339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.922+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 zone default found 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 4 Realm: () 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 zonegroup default 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.977 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.923+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.924+0000 7f6d9c339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.924+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.924+0000 7f6d9c339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.924+0000 7f6d9c339800 20 started sync module instance, tier type = 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.924+0000 7f6d9c339800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.932+0000 7f6d9c339800 20 add_watcher() i=0 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.932+0000 7f6d9c339800 20 add_watcher() i=1 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.932+0000 7f6d9c339800 20 add_watcher() i=2 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.932+0000 7f6d9c339800 20 add_watcher() i=3 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.932+0000 7f6d9c339800 20 add_watcher() i=4 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.932+0000 7f6d9c339800 20 add_watcher() i=5 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.932+0000 7f6d9c339800 20 add_watcher() i=6 2024-09-12T00:51:23.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.933+0000 7f6d9c339800 20 add_watcher() i=7 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.933+0000 7f6d9c339800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.935+0000 7f6c4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.935+0000 7f6d9c339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.935+0000 7f6d9c339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.935+0000 7f6d9c339800 5 note: GC not initialized 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.935+0000 7f6c4cfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.935+0000 7f6d9c339800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.936+0000 7f6d9c339800 20 Filter name: none 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.936+0000 7f6bc67fc640 20 reqs_thread_entry: start 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.936+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.936+0000 7f6d9c339800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.936+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.937+0000 7f6d9c339800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:51:23.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.937+0000 7f6d9c339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.937+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.937+0000 7f6d9c339800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.937+0000 7f6d9c339800 20 rados->read ofs=0 len=0 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.937+0000 7f6d9c339800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.937+0000 7f6d9c339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.939+0000 7f6c4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.940+0000 7f6d9c339800 20 remove_watcher() i=0 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.940+0000 7f6d9c339800 2 removed watcher, disabling cache 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.941+0000 7f6d9c339800 20 remove_watcher() i=1 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.942+0000 7f6d9c339800 20 remove_watcher() i=2 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.943+0000 7f6d9c339800 20 remove_watcher() i=3 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.944+0000 7f6d9c339800 20 remove_watcher() i=4 2024-09-12T00:51:23.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.945+0000 7f6d9c339800 20 remove_watcher() i=5 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.946+0000 7f6d9c339800 20 remove_watcher() i=6 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:23.947+0000 7f6d9c339800 20 remove_watcher() i=7 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-logrecord-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:23.981 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:24.008 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:24.040 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:24.040 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:24.076 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.077+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.079+0000 7f7567e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:24.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.079+0000 7f7567e2f800 20 realm 2024-09-12T00:51:24.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.079+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.079+0000 7f7567e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:24.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.079+0000 7f7567e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:24.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.079+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.080+0000 7f7567e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:24.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.080+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.080+0000 7f7567e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:24.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.080+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.080+0000 7f7567e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:24.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.080+0000 7f7567e2f800 20 searching for the correct realm 2024-09-12T00:51:24.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.084+0000 7f7565919640 0 -- 172.21.15.83:0/399813047 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f755801e070 msgr2=0x7f755806a990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:24.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.087+0000 7f7565919640 0 -- 172.21.15.83:0/399813047 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x55b8ab618f30 msgr2=0x55b8ab61b360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:24.091 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 zone default found 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 4 Realm: () 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 zonegroup default 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.091+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.092+0000 7f7567e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.092+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.092+0000 7f7567e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:24.092 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.092+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.092+0000 7f7567e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:24.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.092+0000 7f7567e2f800 20 started sync module instance, tier type = 2024-09-12T00:51:24.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.092+0000 7f7567e2f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:24.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.100+0000 7f7567e2f800 20 add_watcher() i=0 2024-09-12T00:51:24.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.100+0000 7f7567e2f800 20 add_watcher() i=1 2024-09-12T00:51:24.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.100+0000 7f7567e2f800 20 add_watcher() i=2 2024-09-12T00:51:24.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.100+0000 7f7567e2f800 20 add_watcher() i=3 2024-09-12T00:51:24.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.100+0000 7f7567e2f800 20 add_watcher() i=4 2024-09-12T00:51:24.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.100+0000 7f7567e2f800 20 add_watcher() i=5 2024-09-12T00:51:24.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.100+0000 7f7567e2f800 20 add_watcher() i=6 2024-09-12T00:51:24.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.101+0000 7f7567e2f800 20 add_watcher() i=7 2024-09-12T00:51:24.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.101+0000 7f7567e2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:24.102 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7417fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:24.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7567e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:24.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7567e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:24.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7567e2f800 5 note: GC not initialized 2024-09-12T00:51:24.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7416ffd640 20 reqs_thread_entry: start 2024-09-12T00:51:24.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7567e2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:24.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7567e2f800 20 Filter name: none 2024-09-12T00:51:24.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7414ff9640 20 reqs_thread_entry: start 2024-09-12T00:51:24.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7567e2f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:51:24.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.104+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:24.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:51:24.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:51:24.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 : miss 2024-09-12T00:51:24.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:24.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:51:24.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:24.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:24.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:24.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:24.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.105+0000 7f7567e2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 2024-09-12T00:51:24.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.107+0000 7f7567e2f800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to be held by another RGW process; skipping for now 2024-09-12T00:51:24.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.108+0000 7f7417fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:24.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.109+0000 7f7567e2f800 20 remove_watcher() i=0 2024-09-12T00:51:24.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.109+0000 7f7567e2f800 2 removed watcher, disabling cache 2024-09-12T00:51:24.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.110+0000 7f7567e2f800 20 remove_watcher() i=1 2024-09-12T00:51:24.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.112+0000 7f7567e2f800 20 remove_watcher() i=2 2024-09-12T00:51:24.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.113+0000 7f7567e2f800 20 remove_watcher() i=3 2024-09-12T00:51:24.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.114+0000 7f7567e2f800 20 remove_watcher() i=4 2024-09-12T00:51:24.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.115+0000 7f7567e2f800 20 remove_watcher() i=5 2024-09-12T00:51:24.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.116+0000 7f7567e2f800 20 remove_watcher() i=6 2024-09-12T00:51:24.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:24.117+0000 7f7567e2f800 20 remove_watcher() i=7 2024-09-12T00:51:24.125 INFO:tasks.workunit.client.0.smithi083.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:51:54.135 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:54.170 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:54.170 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:54.212 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.214+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.216+0000 7f7e47546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.216+0000 7f7e47546800 20 realm 2024-09-12T00:51:54.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.216+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.216+0000 7f7e47546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.216+0000 7f7e47546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:54.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.216+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.217+0000 7f7e47546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.217+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.217+0000 7f7e47546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.217+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.218+0000 7f7e47546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:54.216 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.218+0000 7f7e47546800 20 searching for the correct realm 2024-09-12T00:51:54.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.221+0000 7f7e44836640 0 -- 172.21.15.83:0/1161049000 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f7e3c04d400 msgr2=0x7f7e3c04d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:54.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.428+0000 7f7e44836640 0 -- 172.21.15.83:0/1161049000 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x559716292100 msgr2=0x5597162945c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:54.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.432+0000 7f7e47546800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:54.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.432+0000 7f7e47546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:54.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.432+0000 7f7e47546800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:54.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.432+0000 7f7e47546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:54.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.432+0000 7f7e47546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:54.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.432+0000 7f7e47546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:54.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.432+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.433+0000 7f7e47546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.432 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.433+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.433 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.433+0000 7f7e47546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.433+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.433+0000 7f7e47546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.433+0000 7f7e47546800 20 zone default found 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.433+0000 7f7e47546800 4 Realm: () 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.433+0000 7f7e47546800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.433+0000 7f7e47546800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 20 zonegroup default 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.434 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 20 started sync module instance, tier type = 2024-09-12T00:51:54.435 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.434+0000 7f7e47546800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:54.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.444+0000 7f7e47546800 20 add_watcher() i=0 2024-09-12T00:51:54.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.444+0000 7f7e47546800 20 add_watcher() i=1 2024-09-12T00:51:54.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.444+0000 7f7e47546800 20 add_watcher() i=2 2024-09-12T00:51:54.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.444+0000 7f7e47546800 20 add_watcher() i=3 2024-09-12T00:51:54.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.444+0000 7f7e47546800 20 add_watcher() i=4 2024-09-12T00:51:54.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.444+0000 7f7e47546800 20 add_watcher() i=5 2024-09-12T00:51:54.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.445+0000 7f7e47546800 20 add_watcher() i=6 2024-09-12T00:51:54.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.446+0000 7f7e47546800 20 add_watcher() i=7 2024-09-12T00:51:54.445 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.446+0000 7f7e47546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:54.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.447+0000 7f7cfbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.448+0000 7f7e47546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:54.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.448+0000 7f7e47546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:54.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.448+0000 7f7e47546800 5 note: GC not initialized 2024-09-12T00:51:54.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.448+0000 7f7cfafe5640 20 reqs_thread_entry: start 2024-09-12T00:51:54.449 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.448+0000 7f7e47546800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:54.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.448+0000 7f7e47546800 20 Filter name: none 2024-09-12T00:51:54.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.448+0000 7f7cf8fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:54.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.448+0000 7f7e47546800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:51:54.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.448+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:54.450 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:51:54.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:51:54.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 : miss 2024-09-12T00:51:54.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:51:54.451 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:54.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:54.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:54.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.449+0000 7f7e47546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:54.452 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.450+0000 7f7e47546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 2024-09-12T00:51:54.453 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.451+0000 7f7e47546800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:51:54.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.455+0000 7f7e47546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:54.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.455+0000 7f7e47546800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:54.454 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.455+0000 7f7e47546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:54.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.455+0000 7f7e47546800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37, ofs0, ns] 2024-09-12T00:51:54.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.455+0000 7f7d28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94107400272768 notifier 7788 bl.length()=1007 2024-09-12T00:51:54.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.455+0000 7f7d28ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:54.455 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.455+0000 7f7d28ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:54.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.455+0000 7f7d28ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:54.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.456+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_sources= new_sources= 2024-09-12T00:51:54.456 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.456+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential sources added=[] removed=[] 2024-09-12T00:51:54.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.456+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_dests= new_dests= 2024-09-12T00:51:54.457 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.456+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential dests added=[] removed=[] 2024-09-12T00:51:54.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.458+0000 7f7e47546800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.37.2.0 2024-09-12T00:51:54.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.458+0000 7f7e47546800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.37.2.0 2024-09-12T00:51:54.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.458+0000 7f7e47546800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.37.2.1 2024-09-12T00:51:54.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.458+0000 7f7e47546800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.37.2.1 2024-09-12T00:51:54.458 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.458+0000 7f7e47546800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.37.0 2024-09-12T00:51:54.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.461+0000 7f7e47546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:54.460 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.461+0000 7f7e47546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 2024-09-12T00:51:54.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.462+0000 7f7e47546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:54.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.462+0000 7f7e47546800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:54.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.462+0000 7f7e47546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:54.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.462+0000 7f7e47546800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37, ofs0, ns] 2024-09-12T00:51:54.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.463+0000 7f7d28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94107400272768 notifier 7788 bl.length()=1007 2024-09-12T00:51:54.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.463+0000 7f7d28ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:54.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.463+0000 7f7d28ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:54.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.463+0000 7f7d28ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:54.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.463+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_sources= new_sources= 2024-09-12T00:51:54.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.463+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential sources added=[] removed=[] 2024-09-12T00:51:54.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.463+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_dests= new_dests= 2024-09-12T00:51:54.462 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.463+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential dests added=[] removed=[] 2024-09-12T00:51:54.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.465+0000 7f7e47546800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.37.0 2024-09-12T00:51:54.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.465+0000 7f7e47546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:54.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.465+0000 7f7e47546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 2024-09-12T00:51:54.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.466+0000 7f7e47546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:54.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.466+0000 7f7e47546800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:54.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.466+0000 7f7e47546800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:54.465 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.466+0000 7f7e47546800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37, ofs0, ns] 2024-09-12T00:51:54.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.467+0000 7f7d28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94107400272768 notifier 7788 bl.length()=975 2024-09-12T00:51:54.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.467+0000 7f7d28ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 info.flags=0x17 2024-09-12T00:51:54.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.467+0000 7f7d28ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ad4424e4-de7c-4376-b125-e717016a3484.4511.37 to cache LRU end 2024-09-12T00:51:54.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.467+0000 7f7d28ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:54.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.467+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_sources= new_sources= 2024-09-12T00:51:54.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.467+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential sources added=[] removed=[] 2024-09-12T00:51:54.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.467+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): orig_dests= new_dests= 2024-09-12T00:51:54.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.467+0000 7f7e47546800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ad4424e4-de7c-4376-b125-e717016a3484.4511.37]): potential dests added=[] removed=[] 2024-09-12T00:51:54.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.468+0000 7f7e47546800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:54.469 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.470+0000 7f7cfbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.472+0000 7f7e47546800 20 remove_watcher() i=0 2024-09-12T00:51:54.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.472+0000 7f7e47546800 2 removed watcher, disabling cache 2024-09-12T00:51:54.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.474+0000 7f7e47546800 20 remove_watcher() i=1 2024-09-12T00:51:54.473 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.475+0000 7f7e47546800 20 remove_watcher() i=2 2024-09-12T00:51:54.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.476+0000 7f7e47546800 20 remove_watcher() i=3 2024-09-12T00:51:54.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.477+0000 7f7e47546800 20 remove_watcher() i=4 2024-09-12T00:51:54.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.478+0000 7f7e47546800 20 remove_watcher() i=5 2024-09-12T00:51:54.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.479+0000 7f7e47546800 20 remove_watcher() i=6 2024-09-12T00:51:54.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.480+0000 7f7e47546800 20 remove_watcher() i=7 2024-09-12T00:51:54.491 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:51:54.520 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:54.520 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:54.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.558+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.560+0000 7fbd7920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.560+0000 7fbd7920f800 20 realm 2024-09-12T00:51:54.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.560+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.560+0000 7fbd7920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.560+0000 7fbd7920f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:54.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.560+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.561+0000 7fbd7920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.561+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.561+0000 7fbd7920f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.561+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.562+0000 7fbd7920f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:54.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.562+0000 7fbd7920f800 20 searching for the correct realm 2024-09-12T00:51:54.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.566+0000 7fbd774fa640 0 -- 172.21.15.83:0/627971814 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x563eba386670 msgr2=0x563eba388a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:54.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.569+0000 7fbd6e4f8640 0 -- 172.21.15.83:0/627971814 >> [v2:172.21.15.120:6800/3447039892,v1:172.21.15.120:6801/3447039892] conn(0x563eba38fa80 msgr2=0x563eba391eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:54.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.573+0000 7fbd7920f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:54.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.573+0000 7fbd7920f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:54.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.573+0000 7fbd7920f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:54.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.573+0000 7fbd7920f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:54.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.573+0000 7fbd7920f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:54.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.573+0000 7fbd7920f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:54.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.573+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.573+0000 7fbd7920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.573+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 20 zone default found 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 4 Realm: () 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:54.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 20 zonegroup default 2024-09-12T00:51:54.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.574+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.575+0000 7fbd7920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.575+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.575+0000 7fbd7920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.575+0000 7fbd7920f800 20 started sync module instance, tier type = 2024-09-12T00:51:54.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.575+0000 7fbd7920f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:54.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.584+0000 7fbd7920f800 20 add_watcher() i=0 2024-09-12T00:51:54.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.584+0000 7fbd7920f800 20 add_watcher() i=1 2024-09-12T00:51:54.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.584+0000 7fbd7920f800 20 add_watcher() i=2 2024-09-12T00:51:54.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.584+0000 7fbd7920f800 20 add_watcher() i=3 2024-09-12T00:51:54.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.584+0000 7fbd7920f800 20 add_watcher() i=4 2024-09-12T00:51:54.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.584+0000 7fbd7920f800 20 add_watcher() i=5 2024-09-12T00:51:54.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.584+0000 7fbd7920f800 20 add_watcher() i=6 2024-09-12T00:51:54.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.585+0000 7fbd7920f800 20 add_watcher() i=7 2024-09-12T00:51:54.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.585+0000 7fbd7920f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:54.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.586+0000 7fbc2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.586+0000 7fbd7920f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:54.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.586+0000 7fbd7920f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:54.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.586+0000 7fbd7920f800 5 note: GC not initialized 2024-09-12T00:51:54.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.587+0000 7fbba7fff640 20 reqs_thread_entry: start 2024-09-12T00:51:54.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.587+0000 7fbd7920f800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:54.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.587+0000 7fbd7920f800 20 Filter name: none 2024-09-12T00:51:54.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.587+0000 7fbba5ffb640 20 reqs_thread_entry: start 2024-09-12T00:51:54.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.587+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.587+0000 7fbd7920f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:54.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.587+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.588+0000 7fbd7920f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:54.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.588+0000 7fbd7920f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:54.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.588+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.588+0000 7fbd7920f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:51:54.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.588+0000 7fbd7920f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.589+0000 7fbd7920f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:51:54.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.589+0000 7fbd7920f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:54.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.590+0000 7fbc2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:54.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.592+0000 7fbd7920f800 20 remove_watcher() i=0 2024-09-12T00:51:54.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.592+0000 7fbd7920f800 2 removed watcher, disabling cache 2024-09-12T00:51:54.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.593+0000 7fbd7920f800 20 remove_watcher() i=1 2024-09-12T00:51:54.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.594+0000 7fbd7920f800 20 remove_watcher() i=2 2024-09-12T00:51:54.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.596+0000 7fbd7920f800 20 remove_watcher() i=3 2024-09-12T00:51:54.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.597+0000 7fbd7920f800 20 remove_watcher() i=4 2024-09-12T00:51:54.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.598+0000 7fbd7920f800 20 remove_watcher() i=5 2024-09-12T00:51:54.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.599+0000 7fbd7920f800 20 remove_watcher() i=6 2024-09-12T00:51:54.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.600+0000 7fbd7920f800 20 remove_watcher() i=7 2024-09-12T00:51:54.608 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:54.609 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:54.609 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-logrecord-writes id: ad4424e4-de7c-4376-b125-e717016a3484.4511.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:54.609 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:54.610 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.610 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.614 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.614 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.657 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.657 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.672 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:51:54.672 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:54.673 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.673 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.683 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.684 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.727 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.727 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.735 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.735 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.743 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.743 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.751 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.751 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.759 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.759 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.767 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.767 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.776 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.776 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.784 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.784 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.792 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.792 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.807 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.807 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.815 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.815 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.823 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.823 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.831 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.831 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.839 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.839 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.847 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.847 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.855 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.855 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.866 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.866 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.874 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.874 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.883 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.883 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.891 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:54.891 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:54.899 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:51:54.927 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:54.927 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:54.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.965+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.967+0000 7f918edab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.967+0000 7f918edab800 20 realm 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.967+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.967+0000 7f918edab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.967+0000 7f918edab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.967+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.967+0000 7f918edab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:54.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.967+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.968+0000 7f918edab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.968+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.968+0000 7f918edab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:54.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.968+0000 7f918edab800 20 searching for the correct realm 2024-09-12T00:51:54.969 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:54.970+0000 7f918c895640 0 -- 172.21.15.83:0/3344695772 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f9180046040 msgr2=0x7f9180046420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:55.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.175+0000 7f918c895640 0 -- 172.21.15.83:0/3344695772 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f9188084060 msgr2=0x7f91880b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 zone default found 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 4 Realm: () 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 zonegroup default 2024-09-12T00:51:55.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.382+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.383+0000 7f918edab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.383+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.383+0000 7f918edab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.383+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.383+0000 7f918edab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.383+0000 7f918edab800 20 started sync module instance, tier type = 2024-09-12T00:51:55.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.383+0000 7f918edab800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:55.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.392+0000 7f918edab800 20 add_watcher() i=0 2024-09-12T00:51:55.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.392+0000 7f918edab800 20 add_watcher() i=1 2024-09-12T00:51:55.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.392+0000 7f918edab800 20 add_watcher() i=2 2024-09-12T00:51:55.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.392+0000 7f918edab800 20 add_watcher() i=3 2024-09-12T00:51:55.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.392+0000 7f918edab800 20 add_watcher() i=4 2024-09-12T00:51:55.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.392+0000 7f918edab800 20 add_watcher() i=5 2024-09-12T00:51:55.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.392+0000 7f918edab800 20 add_watcher() i=6 2024-09-12T00:51:55.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.393+0000 7f918edab800 20 add_watcher() i=7 2024-09-12T00:51:55.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.393+0000 7f918edab800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:55.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.394+0000 7f9042fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:55.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.395+0000 7f918edab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:55.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.395+0000 7f918edab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:55.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.395+0000 7f918edab800 5 note: GC not initialized 2024-09-12T00:51:55.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.395+0000 7f9041fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:55.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.395+0000 7f918edab800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:55.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.395+0000 7f918edab800 20 Filter name: none 2024-09-12T00:51:55.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.395+0000 7f8fb37fe640 20 reqs_thread_entry: start 2024-09-12T00:51:55.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.395+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.396+0000 7f918edab800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:55.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.396+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.396+0000 7f918edab800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:55.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.396+0000 7f918edab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:55.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.396+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.397+0000 7f918edab800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:55.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.397+0000 7f918edab800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.397+0000 7f918edab800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:55.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.397+0000 7f918edab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:55.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.398+0000 7f9042fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:55.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.400+0000 7f918edab800 20 remove_watcher() i=0 2024-09-12T00:51:55.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.400+0000 7f918edab800 2 removed watcher, disabling cache 2024-09-12T00:51:55.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.402+0000 7f918edab800 20 remove_watcher() i=1 2024-09-12T00:51:55.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.402+0000 7f918edab800 20 remove_watcher() i=2 2024-09-12T00:51:55.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.403+0000 7f918edab800 20 remove_watcher() i=3 2024-09-12T00:51:55.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.404+0000 7f918edab800 20 remove_watcher() i=4 2024-09-12T00:51:55.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.405+0000 7f918edab800 20 remove_watcher() i=5 2024-09-12T00:51:55.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.406+0000 7f918edab800 20 remove_watcher() i=6 2024-09-12T00:51:55.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.407+0000 7f918edab800 20 remove_watcher() i=7 2024-09-12T00:51:55.416 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:55.416 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:55.416 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-change-reshard-state id: ad4424e4-de7c-4376-b125-e717016a3484.4511.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:55.416 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:55.417 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:51:55.451 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:55.451 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:55.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.489+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.490+0000 7f64eb12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.490+0000 7f64eb12e800 20 realm 2024-09-12T00:51:55.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.490+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.491+0000 7f64eb12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.491+0000 7f64eb12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:55.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.491+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.491+0000 7f64eb12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.491+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.491+0000 7f64eb12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:55.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.491+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.492+0000 7f64eb12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:55.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.492+0000 7f64eb12e800 20 searching for the correct realm 2024-09-12T00:51:55.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.495+0000 7f64dffff640 0 -- 172.21.15.83:0/1729148526 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f64d009c0a0 msgr2=0x7f64d0081090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:55.699 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.700+0000 7f64e7565640 0 -- 172.21.15.83:0/1729148526 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x561cf94ed980 msgr2=0x561cf94efd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:55.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.704+0000 7f64eb12e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:55.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.704+0000 7f64eb12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:55.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.704+0000 7f64eb12e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:55.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.704+0000 7f64eb12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:55.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.704+0000 7f64eb12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:55.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.704+0000 7f64eb12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:55.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.704+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.704+0000 7f64eb12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.704+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:55.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:55.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 20 zone default found 2024-09-12T00:51:55.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 4 Realm: () 2024-09-12T00:51:55.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:55.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:55.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:55.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 20 zonegroup default 2024-09-12T00:51:55.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.705+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.706+0000 7f64eb12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.706+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.706+0000 7f64eb12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.706+0000 7f64eb12e800 20 started sync module instance, tier type = 2024-09-12T00:51:55.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.706+0000 7f64eb12e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:55.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.714+0000 7f64eb12e800 20 add_watcher() i=0 2024-09-12T00:51:55.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.714+0000 7f64eb12e800 20 add_watcher() i=1 2024-09-12T00:51:55.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.714+0000 7f64eb12e800 20 add_watcher() i=2 2024-09-12T00:51:55.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.714+0000 7f64eb12e800 20 add_watcher() i=3 2024-09-12T00:51:55.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.714+0000 7f64eb12e800 20 add_watcher() i=4 2024-09-12T00:51:55.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.714+0000 7f64eb12e800 20 add_watcher() i=5 2024-09-12T00:51:55.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.714+0000 7f64eb12e800 20 add_watcher() i=6 2024-09-12T00:51:55.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.715+0000 7f64eb12e800 20 add_watcher() i=7 2024-09-12T00:51:55.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.715+0000 7f64eb12e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:55.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.717+0000 7f639d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:55.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.717+0000 7f64eb12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:55.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.717+0000 7f64eb12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:55.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.717+0000 7f64eb12e800 5 note: GC not initialized 2024-09-12T00:51:55.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.717+0000 7f6317fff640 20 reqs_thread_entry: start 2024-09-12T00:51:55.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f64eb12e800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:55.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f64eb12e800 20 Filter name: none 2024-09-12T00:51:55.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f6315ffb640 20 reqs_thread_entry: start 2024-09-12T00:51:55.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f64eb12e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:51:55.717 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f64eb12e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f64eb12e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f64eb12e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f64eb12e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 : miss 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.718+0000 7f64eb12e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.719+0000 7f64eb12e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.719+0000 7f64eb12e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.719+0000 7f64eb12e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.719+0000 7f64eb12e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:55.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.719+0000 7f64eb12e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:55.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.719+0000 7f64eb12e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 2024-09-12T00:51:55.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.722+0000 7f64eb12e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:55.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.722+0000 7f64eb12e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:55.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.722+0000 7f64eb12e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:55.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.722+0000 7f64eb12e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38, ofs0, ns] 2024-09-12T00:51:55.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.722+0000 7f63ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464412 cookie 94682441824576 notifier 7409 bl.length()=1015 2024-09-12T00:51:55.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.722+0000 7f63ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:55.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.722+0000 7f63ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:55.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.722+0000 7f63ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:55.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.723+0000 7f64eb12e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_sources= new_sources= 2024-09-12T00:51:55.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.723+0000 7f64eb12e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential sources added=[] removed=[] 2024-09-12T00:51:55.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.723+0000 7f64eb12e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_dests= new_dests= 2024-09-12T00:51:55.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.723+0000 7f64eb12e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential dests added=[] removed=[] 2024-09-12T00:51:55.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.725+0000 7f64eb12e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.1.0 2024-09-12T00:51:55.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.725+0000 7f64eb12e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.1.0 2024-09-12T00:51:55.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.725+0000 7f64eb12e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.1.1 2024-09-12T00:51:55.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.725+0000 7f64eb12e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.1.1 2024-09-12T00:51:55.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.725+0000 7f64eb12e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.0 2024-09-12T00:51:55.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.727+0000 7f64eb12e800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:51:55.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.727+0000 7f64eb12e800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:51:55.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.731+0000 7f64eb12e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:55.729 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.731+0000 7f64eb12e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 2024-09-12T00:51:55.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.732+0000 7f64eb12e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:55.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.732+0000 7f64eb12e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:55.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.732+0000 7f64eb12e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:55.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.732+0000 7f64eb12e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38, ofs0, ns] 2024-09-12T00:51:55.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.732+0000 7f63c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464413 cookie 94682441824576 notifier 7409 bl.length()=983 2024-09-12T00:51:55.731 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.732+0000 7f63c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:55.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.732+0000 7f63c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:55.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.732+0000 7f63c9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:55.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.733+0000 7f64eb12e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_sources= new_sources= 2024-09-12T00:51:55.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.733+0000 7f64eb12e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential sources added=[] removed=[] 2024-09-12T00:51:55.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.733+0000 7f64eb12e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_dests= new_dests= 2024-09-12T00:51:55.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.733+0000 7f64eb12e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential dests added=[] removed=[] 2024-09-12T00:51:55.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.733+0000 7f64eb12e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:51:55.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.734+0000 7f639d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:55.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.736+0000 7f64eb12e800 20 remove_watcher() i=0 2024-09-12T00:51:55.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.736+0000 7f64eb12e800 2 removed watcher, disabling cache 2024-09-12T00:51:55.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.737+0000 7f64eb12e800 20 remove_watcher() i=1 2024-09-12T00:51:55.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.739+0000 7f64eb12e800 20 remove_watcher() i=2 2024-09-12T00:51:55.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.739+0000 7f64eb12e800 20 remove_watcher() i=3 2024-09-12T00:51:55.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.740+0000 7f64eb12e800 20 remove_watcher() i=4 2024-09-12T00:51:55.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.741+0000 7f64eb12e800 20 remove_watcher() i=5 2024-09-12T00:51:55.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.742+0000 7f64eb12e800 20 remove_watcher() i=6 2024-09-12T00:51:55.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.743+0000 7f64eb12e800 20 remove_watcher() i=7 2024-09-12T00:51:55.754 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:51:55.782 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:55.782 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:55.818 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.819+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.821+0000 7f455652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.821+0000 7f455652c800 20 realm 2024-09-12T00:51:55.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.821+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.821+0000 7f455652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.821+0000 7f455652c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:55.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.821+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.821+0000 7f455652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:55.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.822+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.822+0000 7f455652c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:55.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.822+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:55.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.822+0000 7f455652c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:55.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.822+0000 7f455652c800 20 searching for the correct realm 2024-09-12T00:51:55.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:55.826+0000 7f454bfff640 0 -- 172.21.15.83:0/2501624498 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f453c082380 msgr2=0x7f453c067480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:56.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.031+0000 7f454bfff640 0 -- 172.21.15.83:0/2501624498 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x563d3a87ca90 msgr2=0x563d3a87ef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:56.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:56.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:56.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:56.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:56.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:56.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:56.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:56.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.035+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 20 zone default found 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 4 Realm: () 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 20 zonegroup default 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.036 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.036+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.037+0000 7f455652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.037+0000 7f455652c800 20 started sync module instance, tier type = 2024-09-12T00:51:56.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.037+0000 7f455652c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:56.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.045+0000 7f455652c800 20 add_watcher() i=0 2024-09-12T00:51:56.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.045+0000 7f455652c800 20 add_watcher() i=1 2024-09-12T00:51:56.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.045+0000 7f455652c800 20 add_watcher() i=2 2024-09-12T00:51:56.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.045+0000 7f455652c800 20 add_watcher() i=3 2024-09-12T00:51:56.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.045+0000 7f455652c800 20 add_watcher() i=4 2024-09-12T00:51:56.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.045+0000 7f455652c800 20 add_watcher() i=5 2024-09-12T00:51:56.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.045+0000 7f455652c800 20 add_watcher() i=6 2024-09-12T00:51:56.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.046+0000 7f455652c800 20 add_watcher() i=7 2024-09-12T00:51:56.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.046+0000 7f455652c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:56.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.048+0000 7f4408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:56.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.048+0000 7f455652c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:56.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.048+0000 7f455652c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:56.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.048+0000 7f455652c800 5 note: GC not initialized 2024-09-12T00:51:56.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.048+0000 7f43837fe640 20 reqs_thread_entry: start 2024-09-12T00:51:56.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.048+0000 7f455652c800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:56.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.048+0000 7f455652c800 20 Filter name: none 2024-09-12T00:51:56.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.049+0000 7f43817fa640 20 reqs_thread_entry: start 2024-09-12T00:51:56.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.049+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.049+0000 7f455652c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:56.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.049+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.049+0000 7f455652c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:56.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.049+0000 7f455652c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:56.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.049+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.050+0000 7f455652c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:56.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.050+0000 7f455652c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.050+0000 7f455652c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:56.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.050+0000 7f455652c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:56.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.051+0000 7f4408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:56.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.053+0000 7f455652c800 20 remove_watcher() i=0 2024-09-12T00:51:56.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.053+0000 7f455652c800 2 removed watcher, disabling cache 2024-09-12T00:51:56.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.054+0000 7f455652c800 20 remove_watcher() i=1 2024-09-12T00:51:56.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.055+0000 7f455652c800 20 remove_watcher() i=2 2024-09-12T00:51:56.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.056+0000 7f455652c800 20 remove_watcher() i=3 2024-09-12T00:51:56.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.057+0000 7f455652c800 20 remove_watcher() i=4 2024-09-12T00:51:56.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.058+0000 7f455652c800 20 remove_watcher() i=5 2024-09-12T00:51:56.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.059+0000 7f455652c800 20 remove_watcher() i=6 2024-09-12T00:51:56.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.060+0000 7f455652c800 20 remove_watcher() i=7 2024-09-12T00:51:56.068 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:56.069 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:56.069 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-change-reshard-state id: ad4424e4-de7c-4376-b125-e717016a3484.4511.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:56.069 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:56.070 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.070 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.078 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.079 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.122 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:56.154 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:56.155 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:56.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.192+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.194+0000 7f93880bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.194+0000 7f93880bb800 20 realm 2024-09-12T00:51:56.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.194+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.194+0000 7f93880bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.194+0000 7f93880bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:56.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.194+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.194+0000 7f93880bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.194+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.195+0000 7f93880bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:56.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.195+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.195+0000 7f93880bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:56.194 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.195+0000 7f93880bb800 20 searching for the correct realm 2024-09-12T00:51:56.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.199+0000 7f937ffff640 0 -- 172.21.15.83:0/4159191264 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f9370090020 msgr2=0x7f93700ca120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:56.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.202+0000 7f93863a6640 0 -- 172.21.15.83:0/4159191264 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f156ba0900 msgr2=0x55f156ba2d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:56.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.206+0000 7f93880bb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:56.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.206+0000 7f93880bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:56.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.206+0000 7f93880bb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:56.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.206+0000 7f93880bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:56.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.206+0000 7f93880bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:56.205 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.206+0000 7f93880bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:56.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.206+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:56.206 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:56.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 zone default found 2024-09-12T00:51:56.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 4 Realm: () 2024-09-12T00:51:56.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:56.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:56.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:56.207 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 zonegroup default 2024-09-12T00:51:56.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.207+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.208+0000 7f93880bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.208+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.208+0000 7f93880bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.208+0000 7f93880bb800 20 started sync module instance, tier type = 2024-09-12T00:51:56.208 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.208+0000 7f93880bb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:56.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.216+0000 7f93880bb800 20 add_watcher() i=0 2024-09-12T00:51:56.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.216+0000 7f93880bb800 20 add_watcher() i=1 2024-09-12T00:51:56.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.216+0000 7f93880bb800 20 add_watcher() i=2 2024-09-12T00:51:56.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.216+0000 7f93880bb800 20 add_watcher() i=3 2024-09-12T00:51:56.214 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.216+0000 7f93880bb800 20 add_watcher() i=4 2024-09-12T00:51:56.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.216+0000 7f93880bb800 20 add_watcher() i=5 2024-09-12T00:51:56.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.216+0000 7f93880bb800 20 add_watcher() i=6 2024-09-12T00:51:56.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.216+0000 7f93880bb800 20 add_watcher() i=7 2024-09-12T00:51:56.215 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.216+0000 7f93880bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:56.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.218+0000 7f923bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:56.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.219+0000 7f93880bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:56.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.219+0000 7f93880bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:56.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.219+0000 7f93880bb800 5 note: GC not initialized 2024-09-12T00:51:56.218 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.219+0000 7f923afe5640 20 reqs_thread_entry: start 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.219+0000 7f93880bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.219+0000 7f93880bb800 20 Filter name: none 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.219+0000 7f9238fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.219+0000 7f93880bb800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.219+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 : miss 2024-09-12T00:51:56.219 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:56.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:56.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:56.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:56.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:56.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.220+0000 7f93880bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 2024-09-12T00:51:56.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f93880bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:56.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f93880bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:56.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f93880bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:56.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f93880bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38, ofs0, ns] 2024-09-12T00:51:56.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f92697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464414 cookie 94495030572704 notifier 7875 bl.length()=1015 2024-09-12T00:51:56.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f92697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:56.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f92697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:56.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f92697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:56.223 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_sources= new_sources= 2024-09-12T00:51:56.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential sources added=[] removed=[] 2024-09-12T00:51:56.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_dests= new_dests= 2024-09-12T00:51:56.224 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.224+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential dests added=[] removed=[] 2024-09-12T00:51:56.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.226+0000 7f93880bb800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.1.0 2024-09-12T00:51:56.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.226+0000 7f93880bb800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.1.0 2024-09-12T00:51:56.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.226+0000 7f93880bb800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.1.1 2024-09-12T00:51:56.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.226+0000 7f93880bb800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.1.1 2024-09-12T00:51:56.225 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.226+0000 7f93880bb800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.0 2024-09-12T00:51:56.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.229+0000 7f93880bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:56.227 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.229+0000 7f93880bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 2024-09-12T00:51:56.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.230+0000 7f93880bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:56.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.230+0000 7f93880bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:56.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.230+0000 7f93880bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:56.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.230+0000 7f93880bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38, ofs0, ns] 2024-09-12T00:51:56.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.230+0000 7f92697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464415 cookie 94495030572704 notifier 7875 bl.length()=1015 2024-09-12T00:51:56.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.230+0000 7f92697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:56.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.230+0000 7f92697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:56.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.230+0000 7f92697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:56.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.231+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_sources= new_sources= 2024-09-12T00:51:56.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.231+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential sources added=[] removed=[] 2024-09-12T00:51:56.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.231+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_dests= new_dests= 2024-09-12T00:51:56.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.231+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential dests added=[] removed=[] 2024-09-12T00:51:56.230 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.232+0000 7f93880bb800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.38.0 2024-09-12T00:51:56.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.232+0000 7f93880bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:56.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.232+0000 7f93880bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 2024-09-12T00:51:56.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.233+0000 7f93880bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:56.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.233+0000 7f93880bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:56.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.233+0000 7f93880bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:56.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.233+0000 7f93880bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38, ofs0, ns] 2024-09-12T00:51:56.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.233+0000 7f9268ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464416 cookie 94495030572704 notifier 7875 bl.length()=983 2024-09-12T00:51:56.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.233+0000 7f9268ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 info.flags=0x17 2024-09-12T00:51:56.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.233+0000 7f9268ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.38 to cache LRU end 2024-09-12T00:51:56.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.233+0000 7f9268ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:56.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.234+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_sources= new_sources= 2024-09-12T00:51:56.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.234+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential sources added=[] removed=[] 2024-09-12T00:51:56.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.234+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): orig_dests= new_dests= 2024-09-12T00:51:56.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.234+0000 7f93880bb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.38]): potential dests added=[] removed=[] 2024-09-12T00:51:56.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.235+0000 7f93880bb800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:56.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.236+0000 7f923bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:56.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.238+0000 7f93880bb800 20 remove_watcher() i=0 2024-09-12T00:51:56.237 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.238+0000 7f93880bb800 2 removed watcher, disabling cache 2024-09-12T00:51:56.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.239+0000 7f93880bb800 20 remove_watcher() i=1 2024-09-12T00:51:56.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.240+0000 7f93880bb800 20 remove_watcher() i=2 2024-09-12T00:51:56.240 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.241+0000 7f93880bb800 20 remove_watcher() i=3 2024-09-12T00:51:56.241 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.242+0000 7f93880bb800 20 remove_watcher() i=4 2024-09-12T00:51:56.242 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.243+0000 7f93880bb800 20 remove_watcher() i=5 2024-09-12T00:51:56.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.244+0000 7f93880bb800 20 remove_watcher() i=6 2024-09-12T00:51:56.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.245+0000 7f93880bb800 20 remove_watcher() i=7 2024-09-12T00:51:56.256 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:51:56.285 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:56.285 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:56.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.323+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.325+0000 7f242a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.325+0000 7f242a614800 20 realm 2024-09-12T00:51:56.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.325+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.325+0000 7f242a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.325+0000 7f242a614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:56.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.325+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.325+0000 7f242a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.325+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.326+0000 7f242a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:56.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.326+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.326+0000 7f242a614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:56.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.326+0000 7f242a614800 20 searching for the correct realm 2024-09-12T00:51:56.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.329+0000 7f241ffff640 0 -- 172.21.15.83:0/379490921 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f24100d4640 msgr2=0x7f24100d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:56.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.534+0000 7f24264cc640 0 -- 172.21.15.83:0/379490921 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5578f3a8d360 msgr2=0x5578f3a8f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:56.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:56.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:56.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:56.538 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.538+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 zone default found 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 4 Realm: () 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:56.539 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:56.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 zonegroup default 2024-09-12T00:51:56.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 started sync module instance, tier type = 2024-09-12T00:51:56.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.539+0000 7f242a614800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:56.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.548+0000 7f242a614800 20 add_watcher() i=0 2024-09-12T00:51:56.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.548+0000 7f242a614800 20 add_watcher() i=1 2024-09-12T00:51:56.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.548+0000 7f242a614800 20 add_watcher() i=2 2024-09-12T00:51:56.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.548+0000 7f242a614800 20 add_watcher() i=3 2024-09-12T00:51:56.547 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.548+0000 7f242a614800 20 add_watcher() i=4 2024-09-12T00:51:56.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.548+0000 7f242a614800 20 add_watcher() i=5 2024-09-12T00:51:56.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.548+0000 7f242a614800 20 add_watcher() i=6 2024-09-12T00:51:56.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.550+0000 7f242a614800 20 add_watcher() i=7 2024-09-12T00:51:56.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.550+0000 7f242a614800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:56.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.551+0000 7f22d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:56.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.552+0000 7f242a614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:56.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.552+0000 7f242a614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:56.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.552+0000 7f242a614800 5 note: GC not initialized 2024-09-12T00:51:56.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.552+0000 7f22d67fc640 20 reqs_thread_entry: start 2024-09-12T00:51:56.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.552+0000 7f242a614800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:56.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.552+0000 7f242a614800 20 Filter name: none 2024-09-12T00:51:56.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.552+0000 7f2247fff640 20 reqs_thread_entry: start 2024-09-12T00:51:56.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.552+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.553+0000 7f242a614800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:56.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.553+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.553+0000 7f242a614800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:56.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.553+0000 7f242a614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:56.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.553+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.554+0000 7f242a614800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:56.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.554+0000 7f242a614800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.554+0000 7f242a614800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:56.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.554+0000 7f242a614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:56.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.555+0000 7f22d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:56.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.557+0000 7f242a614800 20 remove_watcher() i=0 2024-09-12T00:51:56.556 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.557+0000 7f242a614800 2 removed watcher, disabling cache 2024-09-12T00:51:56.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.558+0000 7f242a614800 20 remove_watcher() i=1 2024-09-12T00:51:56.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.559+0000 7f242a614800 20 remove_watcher() i=2 2024-09-12T00:51:56.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.560+0000 7f242a614800 20 remove_watcher() i=3 2024-09-12T00:51:56.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.561+0000 7f242a614800 20 remove_watcher() i=4 2024-09-12T00:51:56.560 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.562+0000 7f242a614800 20 remove_watcher() i=5 2024-09-12T00:51:56.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.563+0000 7f242a614800 20 remove_watcher() i=6 2024-09-12T00:51:56.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.564+0000 7f242a614800 20 remove_watcher() i=7 2024-09-12T00:51:56.573 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:56.573 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:56.573 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-change-reshard-state id: ad4424e4-de7c-4376-b125-e717016a3484.4511.38 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:56.573 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:56.575 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.575 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.578 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.578 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.621 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.621 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.635 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:51:56.635 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:56.635 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.636 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.645 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.645 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.687 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.687 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.695 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.695 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.702 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.702 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.710 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.710 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.719 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.719 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.726 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.726 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.734 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.734 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.741 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.741 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.748 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.748 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.755 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.756 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.763 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.763 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.770 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.770 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.777 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.777 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.784 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.784 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.792 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.792 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.799 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.799 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.806 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.806 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.813 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.813 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.821 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.821 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.829 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:56.829 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:56.837 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:51:56.865 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:56.865 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:56.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.903+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.905+0000 7fd135f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.905+0000 7fd135f2a800 20 realm 2024-09-12T00:51:56.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.905+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.905+0000 7fd135f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.905+0000 7fd135f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:56.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.905+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.905+0000 7fd135f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:56.904 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.905+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.906+0000 7fd135f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:56.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.906+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:56.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.906+0000 7fd135f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:56.905 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.906+0000 7fd135f2a800 20 searching for the correct realm 2024-09-12T00:51:56.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.908+0000 7fd131b61640 0 -- 172.21.15.83:0/1584047982 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x563ea7af4640 msgr2=0x563ea7af6a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:56.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:56.912+0000 7fd132362640 0 -- 172.21.15.83:0/1584047982 >> [v2:172.21.15.120:6816/3242240032,v1:172.21.15.120:6817/3242240032] conn(0x7fd12404e280 msgr2=0x7fd124050aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:57.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.120+0000 7fd135f2a800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:57.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.120+0000 7fd135f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:57.122 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.120+0000 7fd135f2a800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:57.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.120+0000 7fd135f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:57.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.120+0000 7fd135f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:57.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.120+0000 7fd135f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:57.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.120+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.120+0000 7fd135f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.123 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.120+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:57.124 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 zone default found 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 4 Realm: () 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 zonegroup default 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.125 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.121+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.122+0000 7fd135f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.122+0000 7fd135f2a800 20 started sync module instance, tier type = 2024-09-12T00:51:57.126 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.122+0000 7fd135f2a800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:57.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.130+0000 7fd135f2a800 20 add_watcher() i=0 2024-09-12T00:51:57.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.130+0000 7fd135f2a800 20 add_watcher() i=1 2024-09-12T00:51:57.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.130+0000 7fd135f2a800 20 add_watcher() i=2 2024-09-12T00:51:57.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.130+0000 7fd135f2a800 20 add_watcher() i=3 2024-09-12T00:51:57.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.130+0000 7fd135f2a800 20 add_watcher() i=4 2024-09-12T00:51:57.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.130+0000 7fd135f2a800 20 add_watcher() i=5 2024-09-12T00:51:57.129 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.130+0000 7fd135f2a800 20 add_watcher() i=6 2024-09-12T00:51:57.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.131+0000 7fd135f2a800 20 add_watcher() i=7 2024-09-12T00:51:57.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.131+0000 7fd135f2a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:57.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.133+0000 7fcfdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:57.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.133+0000 7fd135f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:57.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.133+0000 7fd135f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:57.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.133+0000 7fd135f2a800 5 note: GC not initialized 2024-09-12T00:51:57.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.133+0000 7fcfda7fc640 20 reqs_thread_entry: start 2024-09-12T00:51:57.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.133+0000 7fd135f2a800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:57.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.133+0000 7fd135f2a800 20 Filter name: none 2024-09-12T00:51:57.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.133+0000 7fcf53fff640 20 reqs_thread_entry: start 2024-09-12T00:51:57.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.134+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.134+0000 7fd135f2a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:57.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.134+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.135+0000 7fd135f2a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:57.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.135+0000 7fd135f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:57.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.135+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.135+0000 7fd135f2a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:57.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.135+0000 7fd135f2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.135+0000 7fd135f2a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:57.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.135+0000 7fd135f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:57.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.137+0000 7fcfdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:57.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.139+0000 7fd135f2a800 20 remove_watcher() i=0 2024-09-12T00:51:57.137 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.139+0000 7fd135f2a800 2 removed watcher, disabling cache 2024-09-12T00:51:57.138 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.140+0000 7fd135f2a800 20 remove_watcher() i=1 2024-09-12T00:51:57.139 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.141+0000 7fd135f2a800 20 remove_watcher() i=2 2024-09-12T00:51:57.140 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.142+0000 7fd135f2a800 20 remove_watcher() i=3 2024-09-12T00:51:57.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.143+0000 7fd135f2a800 20 remove_watcher() i=4 2024-09-12T00:51:57.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.144+0000 7fd135f2a800 20 remove_watcher() i=5 2024-09-12T00:51:57.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.144+0000 7fd135f2a800 20 remove_watcher() i=6 2024-09-12T00:51:57.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.145+0000 7fd135f2a800 20 remove_watcher() i=7 2024-09-12T00:51:57.154 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:57.154 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:57.154 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-change-reshard-state id: ad4424e4-de7c-4376-b125-e717016a3484.4511.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:57.154 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:57.155 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:51:57.193 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:57.193 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:57.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.232+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.234+0000 7f4e6c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.234+0000 7f4e6c126800 20 realm 2024-09-12T00:51:57.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.234+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.234+0000 7f4e6c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.234+0000 7f4e6c126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:57.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.234+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.234+0000 7f4e6c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.233 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.234+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.235+0000 7f4e6c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:57.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.235+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.235+0000 7f4e6c126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:57.234 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.235+0000 7f4e6c126800 20 searching for the correct realm 2024-09-12T00:51:57.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.236+0000 7f4e6855e640 0 -- 172.21.15.83:0/3861317481 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f4e540030f0 msgr2=0x7f4e50039970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:57.238 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.239+0000 7f4e67d5d640 0 -- 172.21.15.83:0/3861317481 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x5591128b7780 msgr2=0x5591128b9bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:57.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:57.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:57.243 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:57.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:57.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:57.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:57.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.245+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 20 zone default found 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 4 Realm: () 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:57.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 20 zonegroup default 2024-09-12T00:51:57.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.246+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.247+0000 7f4e6c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.247+0000 7f4e6c126800 20 started sync module instance, tier type = 2024-09-12T00:51:57.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.247+0000 7f4e6c126800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:57.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.255+0000 7f4e6c126800 20 add_watcher() i=0 2024-09-12T00:51:57.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.255+0000 7f4e6c126800 20 add_watcher() i=1 2024-09-12T00:51:57.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.255+0000 7f4e6c126800 20 add_watcher() i=2 2024-09-12T00:51:57.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.255+0000 7f4e6c126800 20 add_watcher() i=3 2024-09-12T00:51:57.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.255+0000 7f4e6c126800 20 add_watcher() i=4 2024-09-12T00:51:57.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.255+0000 7f4e6c126800 20 add_watcher() i=5 2024-09-12T00:51:57.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.255+0000 7f4e6c126800 20 add_watcher() i=6 2024-09-12T00:51:57.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.256+0000 7f4e6c126800 20 add_watcher() i=7 2024-09-12T00:51:57.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.256+0000 7f4e6c126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:57.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.257+0000 7f4d1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:57.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.257+0000 7f4e6c126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:57.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.257+0000 7f4e6c126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:57.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.257+0000 7f4e6c126800 5 note: GC not initialized 2024-09-12T00:51:57.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4d1cfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:57.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4e6c126800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:57.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4e6c126800 20 Filter name: none 2024-09-12T00:51:57.257 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4c967fc640 20 reqs_thread_entry: start 2024-09-12T00:51:57.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4e6c126800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:51:57.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4e6c126800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:57.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4e6c126800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:51:57.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4e6c126800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:51:57.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4e6c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 : miss 2024-09-12T00:51:57.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.258+0000 7f4e6c126800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.259+0000 7f4e6c126800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:57.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.259+0000 7f4e6c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 info.flags=0x17 2024-09-12T00:51:57.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.259+0000 7f4e6c126800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 to cache LRU end 2024-09-12T00:51:57.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.259+0000 7f4e6c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:57.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.259+0000 7f4e6c126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:57.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.259+0000 7f4e6c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 2024-09-12T00:51:57.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.262+0000 7f4e6c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 info.flags=0x17 2024-09-12T00:51:57.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.262+0000 7f4e6c126800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 to cache LRU end 2024-09-12T00:51:57.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.262+0000 7f4e6c126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:57.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.262+0000 7f4e6c126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39, ofs0, ns] 2024-09-12T00:51:57.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.262+0000 7f4d46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464421 cookie 94081569791584 notifier 7490 bl.length()=1015 2024-09-12T00:51:57.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.262+0000 7f4d46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 info.flags=0x17 2024-09-12T00:51:57.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.262+0000 7f4d46ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 to cache LRU end 2024-09-12T00:51:57.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.262+0000 7f4d46ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:57.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.263+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): orig_sources= new_sources= 2024-09-12T00:51:57.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.263+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): potential sources added=[] removed=[] 2024-09-12T00:51:57.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.263+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): orig_dests= new_dests= 2024-09-12T00:51:57.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.263+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): potential dests added=[] removed=[] 2024-09-12T00:51:57.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.265+0000 7f4e6c126800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.39.1.0 2024-09-12T00:51:57.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.265+0000 7f4e6c126800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.39.1.0 2024-09-12T00:51:57.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.265+0000 7f4e6c126800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.39.1.1 2024-09-12T00:51:57.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.265+0000 7f4e6c126800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.39.1.1 2024-09-12T00:51:57.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.265+0000 7f4e6c126800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.39.0 2024-09-12T00:51:57.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.267+0000 7f4e6c126800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:51:57.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.267+0000 7f4e6c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:57.266 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.267+0000 7f4e6c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 2024-09-12T00:51:57.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.268+0000 7f4e6c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 info.flags=0x17 2024-09-12T00:51:57.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.268+0000 7f4e6c126800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 to cache LRU end 2024-09-12T00:51:57.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.268+0000 7f4e6c126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:57.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.268+0000 7f4e6c126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39, ofs0, ns] 2024-09-12T00:51:57.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.268+0000 7f4d467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464422 cookie 94081569791584 notifier 7490 bl.length()=1015 2024-09-12T00:51:57.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.268+0000 7f4d467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 info.flags=0x17 2024-09-12T00:51:57.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.268+0000 7f4d467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 to cache LRU end 2024-09-12T00:51:57.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.268+0000 7f4d467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:57.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.269+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): orig_sources= new_sources= 2024-09-12T00:51:57.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.269+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): potential sources added=[] removed=[] 2024-09-12T00:51:57.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.269+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): orig_dests= new_dests= 2024-09-12T00:51:57.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.269+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): potential dests added=[] removed=[] 2024-09-12T00:51:57.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.270+0000 7f4e6c126800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.39.0 2024-09-12T00:51:57.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.270+0000 7f4e6c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:57.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.270+0000 7f4e6c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 2024-09-12T00:51:57.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.271+0000 7f4e6c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 info.flags=0x17 2024-09-12T00:51:57.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.271+0000 7f4e6c126800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 to cache LRU end 2024-09-12T00:51:57.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.271+0000 7f4e6c126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:57.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.271+0000 7f4e6c126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39, ofs0, ns] 2024-09-12T00:51:57.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.272+0000 7f4d467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464423 cookie 94081569791584 notifier 7490 bl.length()=983 2024-09-12T00:51:57.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.272+0000 7f4d467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 info.flags=0x17 2024-09-12T00:51:57.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.272+0000 7f4d467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.39 to cache LRU end 2024-09-12T00:51:57.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.272+0000 7f4d467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:57.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.272+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): orig_sources= new_sources= 2024-09-12T00:51:57.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.272+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): potential sources added=[] removed=[] 2024-09-12T00:51:57.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.272+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): orig_dests= new_dests= 2024-09-12T00:51:57.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.272+0000 7f4e6c126800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.39]): potential dests added=[] removed=[] 2024-09-12T00:51:57.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.273+0000 7f4e6c126800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:57.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.275+0000 7f4d1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:57.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.277+0000 7f4e6c126800 20 remove_watcher() i=0 2024-09-12T00:51:57.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.277+0000 7f4e6c126800 2 removed watcher, disabling cache 2024-09-12T00:51:57.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.278+0000 7f4e6c126800 20 remove_watcher() i=1 2024-09-12T00:51:57.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.279+0000 7f4e6c126800 20 remove_watcher() i=2 2024-09-12T00:51:57.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.280+0000 7f4e6c126800 20 remove_watcher() i=3 2024-09-12T00:51:57.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.281+0000 7f4e6c126800 20 remove_watcher() i=4 2024-09-12T00:51:57.281 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.282+0000 7f4e6c126800 20 remove_watcher() i=5 2024-09-12T00:51:57.282 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.283+0000 7f4e6c126800 20 remove_watcher() i=6 2024-09-12T00:51:57.283 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.284+0000 7f4e6c126800 20 remove_watcher() i=7 2024-09-12T00:51:57.294 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:51:57.323 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:57.323 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:57.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.361+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.363+0000 7f5b8882f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.363+0000 7f5b8882f800 20 realm 2024-09-12T00:51:57.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.363+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.363+0000 7f5b8882f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.363+0000 7f5b8882f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:57.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.363+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.363+0000 7f5b8882f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.363+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.364+0000 7f5b8882f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:57.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.364+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.364+0000 7f5b8882f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:57.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.364+0000 7f5b8882f800 20 searching for the correct realm 2024-09-12T00:51:57.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.367+0000 7f5b86b1a640 0 -- 172.21.15.83:0/2631473982 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f5b7c06d060 msgr2=0x7f5b7c0a3550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:57.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.371+0000 7f5b86319640 0 -- 172.21.15.83:0/2631473982 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f5b80033040 msgr2=0x7f5b80017450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.374+0000 7f5b8882f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.374+0000 7f5b8882f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.374+0000 7f5b8882f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.374+0000 7f5b8882f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.374+0000 7f5b8882f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.374+0000 7f5b8882f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.374+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 zone default found 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 4 Realm: () 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 zonegroup default 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.375+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.376+0000 7f5b8882f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.376+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.376+0000 7f5b8882f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.376+0000 7f5b8882f800 20 started sync module instance, tier type = 2024-09-12T00:51:57.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.376+0000 7f5b8882f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:57.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.384+0000 7f5b8882f800 20 add_watcher() i=0 2024-09-12T00:51:57.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.384+0000 7f5b8882f800 20 add_watcher() i=1 2024-09-12T00:51:57.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.384+0000 7f5b8882f800 20 add_watcher() i=2 2024-09-12T00:51:57.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.384+0000 7f5b8882f800 20 add_watcher() i=3 2024-09-12T00:51:57.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.384+0000 7f5b8882f800 20 add_watcher() i=4 2024-09-12T00:51:57.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.384+0000 7f5b8882f800 20 add_watcher() i=5 2024-09-12T00:51:57.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.385+0000 7f5b8882f800 20 add_watcher() i=6 2024-09-12T00:51:57.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.385+0000 7f5b8882f800 20 add_watcher() i=7 2024-09-12T00:51:57.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.385+0000 7f5b8882f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:57.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.387+0000 7f5a3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:57.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.387+0000 7f5b8882f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:57.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.387+0000 7f5b8882f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:57.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.387+0000 7f5b8882f800 5 note: GC not initialized 2024-09-12T00:51:57.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.388+0000 7f59b77fe640 20 reqs_thread_entry: start 2024-09-12T00:51:57.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.388+0000 7f5b8882f800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:57.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.388+0000 7f5b8882f800 20 Filter name: none 2024-09-12T00:51:57.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.388+0000 7f59b57fa640 20 reqs_thread_entry: start 2024-09-12T00:51:57.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.388+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.388+0000 7f5b8882f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:57.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.388+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.389+0000 7f5b8882f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:57.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.389+0000 7f5b8882f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:57.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.389+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.388 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.389+0000 7f5b8882f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:57.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.389+0000 7f5b8882f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.390+0000 7f5b8882f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:57.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.390+0000 7f5b8882f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:57.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.391+0000 7f5a3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:57.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.393+0000 7f5b8882f800 20 remove_watcher() i=0 2024-09-12T00:51:57.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.393+0000 7f5b8882f800 2 removed watcher, disabling cache 2024-09-12T00:51:57.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.394+0000 7f5b8882f800 20 remove_watcher() i=1 2024-09-12T00:51:57.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.395+0000 7f5b8882f800 20 remove_watcher() i=2 2024-09-12T00:51:57.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.396+0000 7f5b8882f800 20 remove_watcher() i=3 2024-09-12T00:51:57.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.396+0000 7f5b8882f800 20 remove_watcher() i=4 2024-09-12T00:51:57.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.397+0000 7f5b8882f800 20 remove_watcher() i=5 2024-09-12T00:51:57.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.398+0000 7f5b8882f800 20 remove_watcher() i=6 2024-09-12T00:51:57.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.399+0000 7f5b8882f800 20 remove_watcher() i=7 2024-09-12T00:51:57.407 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:57.408 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:57.408 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: error-at-change-reshard-state id: ad4424e4-de7c-4376-b125-e717016a3484.4511.39 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:51:57.408 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:57.410 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.410 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.413 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.413 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.456 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.456 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.471 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:51:57.471 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:57.472 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.472 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.482 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.482 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.525 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.525 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.533 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.533 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.540 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.540 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.548 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.548 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.555 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.556 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.563 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.563 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.571 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.571 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.579 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.579 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.586 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.586 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.594 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.594 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.602 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.602 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.609 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.609 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.618 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.618 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.626 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.626 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.633 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.633 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.641 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.641 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.649 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.649 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.657 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.657 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.665 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.665 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.672 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:57.672 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:57.681 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:51:57.709 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:57.710 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:57.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.747+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.749+0000 7fbccd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.749+0000 7fbccd40f800 20 realm 2024-09-12T00:51:57.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.749+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.749+0000 7fbccd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.749+0000 7fbccd40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:57.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.750+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.750+0000 7fbccd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.750+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.750+0000 7fbccd40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:57.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.750+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.751+0000 7fbccd40f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:57.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.751+0000 7fbccd40f800 20 searching for the correct realm 2024-09-12T00:51:57.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.754+0000 7fbcc8391640 0 -- 172.21.15.83:0/888652143 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fbcbc021800 msgr2=0x7fbcbc0233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:57.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.758+0000 7fbcc8391640 0 -- 172.21.15.83:0/888652143 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x563bbafee4a0 msgr2=0x563bbaff0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:57.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:57.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 zone default found 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 4 Realm: () 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 zonegroup default 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.762+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.763+0000 7fbccd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.763+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.763+0000 7fbccd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.763+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.763+0000 7fbccd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.763+0000 7fbccd40f800 20 started sync module instance, tier type = 2024-09-12T00:51:57.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.763+0000 7fbccd40f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:57.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.772+0000 7fbccd40f800 20 add_watcher() i=0 2024-09-12T00:51:57.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.772+0000 7fbccd40f800 20 add_watcher() i=1 2024-09-12T00:51:57.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.772+0000 7fbccd40f800 20 add_watcher() i=2 2024-09-12T00:51:57.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.772+0000 7fbccd40f800 20 add_watcher() i=3 2024-09-12T00:51:57.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.772+0000 7fbccd40f800 20 add_watcher() i=4 2024-09-12T00:51:57.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.772+0000 7fbccd40f800 20 add_watcher() i=5 2024-09-12T00:51:57.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.772+0000 7fbccd40f800 20 add_watcher() i=6 2024-09-12T00:51:57.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.772+0000 7fbccd40f800 20 add_watcher() i=7 2024-09-12T00:51:57.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.772+0000 7fbccd40f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:57.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.774+0000 7fbb7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:57.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.775+0000 7fbccd40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:57.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.775+0000 7fbccd40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:57.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.775+0000 7fbccd40f800 5 note: GC not initialized 2024-09-12T00:51:57.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.775+0000 7fbb7dfe3640 20 reqs_thread_entry: start 2024-09-12T00:51:57.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.775+0000 7fbccd40f800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:57.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.775+0000 7fbccd40f800 20 Filter name: none 2024-09-12T00:51:57.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.775+0000 7fbaef7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:57.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.775+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.776+0000 7fbccd40f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:57.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.776+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.776+0000 7fbccd40f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:57.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.776+0000 7fbccd40f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:57.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.776+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.777+0000 7fbccd40f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:57.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.777+0000 7fbccd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.777+0000 7fbccd40f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:57.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.777+0000 7fbccd40f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:57.776 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.778+0000 7fbb7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:57.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.780+0000 7fbccd40f800 20 remove_watcher() i=0 2024-09-12T00:51:57.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.780+0000 7fbccd40f800 2 removed watcher, disabling cache 2024-09-12T00:51:57.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.781+0000 7fbccd40f800 20 remove_watcher() i=1 2024-09-12T00:51:57.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.782+0000 7fbccd40f800 20 remove_watcher() i=2 2024-09-12T00:51:57.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.783+0000 7fbccd40f800 20 remove_watcher() i=3 2024-09-12T00:51:57.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.784+0000 7fbccd40f800 20 remove_watcher() i=4 2024-09-12T00:51:57.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.785+0000 7fbccd40f800 20 remove_watcher() i=5 2024-09-12T00:51:57.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.786+0000 7fbccd40f800 20 remove_watcher() i=6 2024-09-12T00:51:57.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.787+0000 7fbccd40f800 20 remove_watcher() i=7 2024-09-12T00:51:57.795 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:57.795 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:57.795 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-change-reshard-state id: ad4424e4-de7c-4376-b125-e717016a3484.4511.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:57.795 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:57.797 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:51:57.831 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:57.831 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:57.868 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.869+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.871+0000 7f4790b26800 20 realm 2024-09-12T00:51:57.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.871+0000 7f4790b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:57.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:57.870 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.872+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:57.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.872+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:57.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.872+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:57.871 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.872+0000 7f4790b26800 20 searching for the correct realm 2024-09-12T00:51:57.874 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:57.876+0000 7f4787fff640 0 -- 172.21.15.83:0/725552133 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f477801a040 msgr2=0x7f477801a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:58.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.081+0000 7f478d070640 0 -- 172.21.15.83:0/725552133 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5612660dc900 msgr2=0x5612660ded80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.085+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:58.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:58.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 zone default found 2024-09-12T00:51:58.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 4 Realm: () 2024-09-12T00:51:58.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:58.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:58.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:58.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 zonegroup default 2024-09-12T00:51:58.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.087+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.087+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.087+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.087+0000 7f4790b26800 20 started sync module instance, tier type = 2024-09-12T00:51:58.087 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.087+0000 7f4790b26800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:58.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=0 2024-09-12T00:51:58.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=1 2024-09-12T00:51:58.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=2 2024-09-12T00:51:58.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=3 2024-09-12T00:51:58.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=4 2024-09-12T00:51:58.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=5 2024-09-12T00:51:58.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=6 2024-09-12T00:51:58.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.097+0000 7f4790b26800 20 add_watcher() i=7 2024-09-12T00:51:58.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.097+0000 7f4790b26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:58.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.099+0000 7f46437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:58.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.099+0000 7f4790b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:58.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.099+0000 7f4790b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.099+0000 7f4790b26800 5 note: GC not initialized 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.099+0000 7f46427e4640 20 reqs_thread_entry: start 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.099+0000 7f4790b26800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.099+0000 7f4790b26800 20 Filter name: none 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.099+0000 7f463bfff640 20 reqs_thread_entry: start 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 : miss 2024-09-12T00:51:58.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:58.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:58.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.100+0000 7f4790b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 2024-09-12T00:51:58.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.104+0000 7f4790b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.104+0000 7f4790b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.104+0000 7f4790b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.104+0000 7f4790b26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40, ofs0, ns] 2024-09-12T00:51:58.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94637021636128 notifier 7986 bl.length()=1015 2024-09-12T00:51:58.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_sources= new_sources= 2024-09-12T00:51:58.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential sources added=[] removed=[] 2024-09-12T00:51:58.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_dests= new_dests= 2024-09-12T00:51:58.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential dests added=[] removed=[] 2024-09-12T00:51:58.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.107+0000 7f4790b26800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.0 2024-09-12T00:51:58.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.107+0000 7f4790b26800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.0 2024-09-12T00:51:58.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.107+0000 7f4790b26800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.1 2024-09-12T00:51:58.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.107+0000 7f4790b26800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.1 2024-09-12T00:51:58.106 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.107+0000 7f4790b26800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.0 2024-09-12T00:51:58.108 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4790b26800 time 2024-09-12T00:51:58.110661+0000 2024-09-12T00:51:58.108 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f479238c71a] 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f479238c8d8] 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561264fba641] 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x561264fc951b] 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561264fca3e4] 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4791029590] 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:51:58.109 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f4790b26800 thread_name:radosgw-admin 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.110+0000 7f4790b26800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4790b26800 time 2024-09-12T00:51:58.110661+0000 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f479238c71a] 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f479238c8d8] 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561264fba641] 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x561264fc951b] 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561264fca3e4] 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4791029590] 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:51:58.110 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:51:58.111 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.129 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f479103e6f0] 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f479108b99c] 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f479238c774] 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f479238c8d8] 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561264fba641] 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x561264fc951b] 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561264fca3e4] 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:51:58.130 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4791029590] 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.111+0000 7f4790b26800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f4790b26800 thread_name:radosgw-admin 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f479103e6f0] 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f479108b99c] 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f479238c774] 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f479238c8d8] 2024-09-12T00:51:58.131 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561264fba641] 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x561264fc951b] 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561264fca3e4] 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4791029590] 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:51:57.853+0000 7f4790b26800 4 set_mon_vals no callback set 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:51:57.853+0000 7f4790b26800 10 monclient: shutdown 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 asok(0x561265dd0630) unregister_commands rotate-key 2024-09-12T00:51:58.132 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:51:57.853+0000 7f4790b26800 10 monclient: build_initial_monmap 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:51:57.853+0000 7f4790b26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:51:57.853+0000 7f4790b26800 10 monclient: monmap: 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding auth protocol: cephx 2024-09-12T00:51:58.133 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding auth protocol: cephx 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding auth protocol: cephx 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.134 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:51:57.854+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:51:57.854+0000 7f4790b26800 1 librados: starting msgr at 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:51:57.854+0000 7f4790b26800 1 librados: starting objecter 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 asok(0x561265dd0630) register_command objecter_requests hook 0x56126601d160 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:51:57.854+0000 7f4790b26800 1 librados: setting wanted keys 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:51:57.854+0000 7f4790b26800 1 librados: calling monclient init 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient: init 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding auth protocol: cephx 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding auth protocol: cephx 2024-09-12T00:51:58.135 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding auth protocol: cephx 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.136 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:51:57.854+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:51:57.854+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 asok(0x561265dd0630) register_command rotate-key hook 0x561265ff2ba8 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-c con 0x561265ea7620 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-b con 0x561265f3c720 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-a con 0x56126601d200 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): authenticate will time out at 2071.123942s 2024-09-12T00:51:58.137 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): get_auth_request con 0x561265ea7620 auth_method 0 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): get_auth_request con 0x56126601d200 auth_method 0 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.138 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): get_auth_request con 0x561265f3c720 auth_method 0 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): handle_auth_done global_id 7532 payload 824 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient: _finish_hunting 0 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:51:57.855+0000 7f478c86f640 1 monclient: found mon.noname-c 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: dump: 2024-09-12T00:51:58.139 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: _finish_auth 0 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: _check_auth_tickets 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:51:57.855+0000 7f4790b26800 5 monclient: authenticate success, global_id 7532 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:51:57.855+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.140 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:51:57.855+0000 7f4790b26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: dump: 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.141 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:51:57.855+0000 7f467ae05640 4 set_mon_vals no callback set 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:51:57.855+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:51:57.855+0000 7f4790b26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:51:57.855+0000 7f4790b26800 1 librados: init done 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:51:57.857+0000 7f4679602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:51:57.857+0000 7f4679602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:51:57.857+0000 7f4679602640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:51:57.857+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f46740764a0 auth_method 0 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:51:57.858+0000 7f478d070640 10 monclient: get_auth_request con 0x56126601faf0 auth_method 0 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:51:57.858+0000 7f478c86f640 10 monclient: get_auth_request con 0x56126603e480 auth_method 0 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:51:57.860+0000 7f4787fff640 10 monclient: get_auth_request con 0x561266043610 auth_method 0 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:51:57.860+0000 7f4790b26800 10 monclient: build_initial_monmap 2024-09-12T00:51:58.142 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:51:57.860+0000 7f4790b26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:51:57.860+0000 7f4790b26800 10 monclient: monmap: 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding auth protocol: cephx 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding auth protocol: cephx 2024-09-12T00:51:58.143 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding auth protocol: cephx 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.144 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:51:57.861+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 asok(0x561265dd0630) register_command objecter_requests cmddesc objecter_requests hook 0x56126604b0a0 EEXIST 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient: init 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding auth protocol: cephx 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding auth protocol: cephx 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding auth protocol: cephx 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.145 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:51:57.861+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:51:57.861+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 asok(0x561265dd0630) register_command rotate-key cmddesc rotate-key hook 0x561266046750 EEXIST 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-c con 0x56126606ed90 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-a con 0x561266071060 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-b con 0x56126606d560 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.146 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): authenticate will time out at 2071.130883s 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:51:57.861+0000 7f478c86f640 10 monclient(hunting): get_auth_request con 0x56126606ed90 auth_method 0 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:51:57.861+0000 7f478c86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:51:57.861+0000 7f478c86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:51:57.861+0000 7f478c86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): get_auth_request con 0x561266071060 auth_method 0 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.147 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:51:57.862+0000 7f478d070640 10 monclient(hunting): get_auth_request con 0x56126606d560 auth_method 0 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:51:57.862+0000 7f478d070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:51:57.862+0000 7f478d070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:51:57.862+0000 7f478d070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient(hunting): handle_auth_done global_id 7535 payload 824 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient: _finish_hunting 0 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:51:57.862+0000 7f478c86f640 1 monclient: found mon.noname-c 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: dump: 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.148 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: _finish_auth 0 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: _check_auth_tickets 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.149 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: dump: 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:51:57.862+0000 7f478d871640 4 set_mon_vals no callback set 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:51:57.862+0000 7f4790b26800 5 monclient: authenticate success, global_id 7535 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:51:57.862+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.150 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:51:57.862+0000 7f4790b26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:51:57.862+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:51:57.862+0000 7f4790b26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:51:57.864+0000 7f46727fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:51:57.864+0000 7f46727fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:51:57.864+0000 7f46727fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:51:57.864+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f4664076380 auth_method 0 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:51:57.864+0000 7f4790b26800 10 monclient: get_monmap_and_config 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:51:57.864+0000 7f4790b26800 10 monclient: build_initial_monmap 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:51:57.864+0000 7f4790b26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:51:57.864+0000 7f4790b26800 10 monclient: monmap: 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:58.151 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding auth protocol: cephx 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding auth protocol: cephx 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding auth protocol: cephx 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.152 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:51:57.864+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient: init 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding auth protocol: cephx 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding auth protocol: cephx 2024-09-12T00:51:58.153 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding auth protocol: cephx 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.154 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:51:57.865+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:51:57.865+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 asok(0x561265dd0630) register_command rotate-key cmddesc rotate-key hook 0x7fffc35163f8 EEXIST 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-b con 0x5612660c2d10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-a con 0x561266093c60 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-c con 0x5612660be5b0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): authenticate will time out at 2071.134585s 2024-09-12T00:51:58.155 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): get_auth_request con 0x561266093c60 auth_method 0 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): get_auth_request con 0x5612660be5b0 auth_method 0 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.156 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): handle_auth_done global_id 7983 payload 274 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient: _finish_hunting 0 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:51:57.865+0000 7f4787fff640 1 monclient: found mon.noname-a 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: dump: 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.157 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: _finish_auth 0 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: dump: 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.158 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 monclient: authenticate success, global_id 7983 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:51:57.866+0000 7f4790b26800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:51:57.866+0000 7f4790b26800 4 set_mon_vals no callback set 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:51:57.866+0000 7f4790b26800 10 monclient: shutdown 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:51:57.866+0000 7f4790b26800 10 monclient: build_initial_monmap 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:51:57.866+0000 7f4790b26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:51:57.866+0000 7f4790b26800 10 monclient: monmap: 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:58.159 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding auth protocol: cephx 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding auth protocol: cephx 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding auth protocol: cephx 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.160 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:51:57.867+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:51:57.867+0000 7f4790b26800 1 librados: starting msgr at 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:51:57.867+0000 7f4790b26800 1 librados: starting objecter 2024-09-12T00:51:58.161 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 asok(0x561265dd0630) register_command objecter_requests cmddesc objecter_requests hook 0x561266093720 EEXIST 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:51:57.867+0000 7f4790b26800 1 librados: setting wanted keys 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:51:57.867+0000 7f4790b26800 1 librados: calling monclient init 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient: init 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding auth protocol: cephx 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding auth protocol: cephx 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding auth protocol: cephx 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.162 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:51:57.867+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:51:57.867+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 asok(0x561265dd0630) register_command rotate-key cmddesc rotate-key hook 0x561266086c88 EEXIST 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:58.163 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-a con 0x561266093c60 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-b con 0x5612660be5b0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-c con 0x5612660c2d10 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): authenticate will time out at 2071.136895s 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:51:57.867+0000 7f478c86f640 10 monclient(hunting): get_auth_request con 0x561266093c60 auth_method 0 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:51:57.867+0000 7f478c86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:51:57.867+0000 7f478c86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:51:57.867+0000 7f478c86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.164 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): get_auth_request con 0x5612660c2d10 auth_method 0 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): get_auth_request con 0x5612660be5b0 auth_method 0 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.165 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient(hunting): handle_auth_done global_id 7986 payload 824 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient: _finish_hunting 0 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:51:57.868+0000 7f478c86f640 1 monclient: found mon.noname-a 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: dump: 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.166 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: _finish_auth 0 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: _check_auth_tickets 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:58.167 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: dump: 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.168 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:51:57.868+0000 7f4790b26800 5 monclient: authenticate success, global_id 7986 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:51:57.868+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:51:57.868+0000 7f4790b26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:51:57.868+0000 7f4663fff640 4 set_mon_vals no callback set 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:51:57.868+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:51:57.868+0000 7f4790b26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:51:57.868+0000 7f4790b26800 1 librados: init done 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:51:57.868+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cr dump hook 0x5612660bbd98 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:51:57.869+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:51:57.870+0000 7f46627fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:51:57.870+0000 7f46627fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.169 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:51:57.870+0000 7f46627fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:51:57.870+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f46580764a0 auth_method 0 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:51:57.870+0000 7f478d070640 10 monclient: get_auth_request con 0x5612660dc900 auth_method 0 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 realm 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:51:57.871+0000 7f4790b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:51:57.871+0000 7f478c86f640 10 monclient: get_auth_request con 0x5612660e0c70 auth_method 0 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:51:57.872+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:58.170 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:51:57.872+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:51:57.872+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:51:57.872+0000 7f4790b26800 20 searching for the correct realm 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:51:57.873+0000 7f4787fff640 10 monclient: get_auth_request con 0x5612660e5dc0 auth_method 0 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:51:57.873+0000 7f478d070640 10 monclient: get_auth_request con 0x7f4778039070 auth_method 0 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:51:57.874+0000 7f478c86f640 10 monclient: get_auth_request con 0x7f4780085040 auth_method 0 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:51:57.876+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f477801a040 auth_method 0 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:51:57.876+0000 7f4787fff640 0 -- 172.21.15.83:0/725552133 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f477801a040 msgr2=0x7f477801a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:51:58.077+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f477801a040 auth_method 0 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:51:58.080+0000 7f478d070640 10 monclient: get_auth_request con 0x7f4780021030 auth_method 0 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:51:58.081+0000 7f478c86f640 10 monclient: get_auth_request con 0x7f4788061040 auth_method 0 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:51:58.081+0000 7f478d070640 0 -- 172.21.15.83:0/725552133 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5612660dc900 msgr2=0x5612660ded80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:51:58.081+0000 7f46627fc640 1 client.7986.objecter ms_handle_reset 0x5612660dc900 session 0x5612660dc280 osd.6 2024-09-12T00:51:58.171 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:51:58.082+0000 7f46627fc640 10 monclient: _renew_subs 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:51:58.082+0000 7f46627fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:51:58.082+0000 7f478d070640 10 monclient: get_auth_request con 0x7f4658086740 auth_method 0 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:58.172 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 zone default found 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:51:58.086+0000 7f4790b26800 4 Realm: () 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:51:58.086+0000 7f4790b26800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:51:58.086+0000 7f4790b26800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:51:58.086+0000 7f4790b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 zonegroup default 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.173 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 started sync module instance, tier type = 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=0 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=1 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=2 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=3 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=4 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=5 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=6 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:51:58.097+0000 7f4790b26800 20 add_watcher() i=7 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:51:58.097+0000 7f4790b26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding auth protocol: cephx 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding auth protocol: cephx 2024-09-12T00:51:58.174 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding auth protocol: cephx 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:51:58.099+0000 7f46437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.175 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:51:58.099+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:51:58.099+0000 7f4790b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:51:58.099+0000 7f4790b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cache list hook 0x5612660b23f0 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cache inspect hook 0x5612660b23f0 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cache erase hook 0x5612660b23f0 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cache zap hook 0x5612660b23f0 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 note: GC not initialized 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:51:58.099+0000 7f46427e4640 20 reqs_thread_entry: start 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command sync trace show hook 0x7f477800ded0 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command sync trace history hook 0x7f477800ded0 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command sync trace active hook 0x7f477800ded0 2024-09-12T00:51:58.176 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command sync trace active_short hook 0x7f477800ded0 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:51:58.099+0000 7f4790b26800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:51:58.099+0000 7f4790b26800 20 Filter name: none 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:51:58.099+0000 7f463bfff640 20 reqs_thread_entry: start 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 : miss 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.177 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:51:58.104+0000 7f4790b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:51:58.104+0000 7f4790b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:51:58.104+0000 7f4790b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:51:58.104+0000 7f4790b26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40, ofs0, ns] 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94637021636128 notifier 7986 bl.length()=1015 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_sources= new_sources= 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential sources added=[] removed=[] 2024-09-12T00:51:58.178 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_dests= new_dests= 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential dests added=[] removed=[] 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:51:58.107+0000 7f4790b26800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.0 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:51:58.107+0000 7f4790b26800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.0 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:51:58.107+0000 7f4790b26800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.1 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:51:58.107+0000 7f4790b26800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.1 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:51:58.107+0000 7f4790b26800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.0 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:51:58.110+0000 7f4790b26800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4790b26800 time 2024-09-12T00:51:58.110661+0000 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f479238c71a] 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f479238c8d8] 2024-09-12T00:51:58.179 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561264fba641] 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x561264fc951b] 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561264fca3e4] 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4791029590] 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:51:58.111+0000 7f4790b26800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f4790b26800 thread_name:radosgw-admin 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f479103e6f0] 2024-09-12T00:51:58.180 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f479108b99c] 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f479238c774] 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f479238c8d8] 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561264fba641] 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x561264fc951b] 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561264fca3e4] 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4791029590] 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:58.181 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:58.182 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:58.183 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:51:58.184 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:51:58.185 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:51:58.186 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:58.187 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 7f463bfff640 / http_manager 2024-09-12T00:51:58.188 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46427e4640 / http_manager 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46437e6640 / rgw_dt_lg_renew 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46627fc640 / ms_dispatch 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46637fe640 / io_context_pool 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f4663fff640 / io_context_pool 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46727fc640 / ms_dispatch 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f4679602640 / ms_dispatch 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f467ae05640 / io_context_pool 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f4787fff640 / msgr-worker-2 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f478c86f640 / msgr-worker-1 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f478d070640 / msgr-worker-0 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f478d871640 / io_context_pool 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: 7f4790b26800 / radosgw-admin 2024-09-12T00:51:58.189 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.143727.log 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:51:57.853+0000 7f4790b26800 4 set_mon_vals no callback set 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:51:57.853+0000 7f4790b26800 10 monclient: shutdown 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 asok(0x561265dd0630) unregister_commands rotate-key 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:51:57.853+0000 7f4790b26800 10 monclient: build_initial_monmap 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:51:57.853+0000 7f4790b26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:51:57.853+0000 7f4790b26800 10 monclient: monmap: 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:58.190 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding auth protocol: cephx 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding auth protocol: cephx 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding auth protocol: cephx 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:51:57.853+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.191 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.192 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.192 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.192 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.192 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.192 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.192 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.192 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: crc 2024-09-12T00:51:58.192 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff86b0) adding con mode: secure 2024-09-12T00:51:58.192 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:51:57.854+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:51:57.854+0000 7f4790b26800 1 librados: starting msgr at 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:51:57.854+0000 7f4790b26800 1 librados: starting objecter 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 asok(0x561265dd0630) register_command objecter_requests hook 0x56126601d160 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:51:57.854+0000 7f4790b26800 1 librados: setting wanted keys 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:51:57.854+0000 7f4790b26800 1 librados: calling monclient init 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient: init 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding auth protocol: cephx 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding auth protocol: cephx 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding auth protocol: cephx 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.193 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: crc 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 AuthRegistry(0x561265ff2a60) adding con mode: secure 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:51:57.854+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:51:57.854+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:51:57.854+0000 7f4790b26800 5 asok(0x561265dd0630) register_command rotate-key hook 0x561265ff2ba8 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:58.194 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-c con 0x561265ea7620 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-b con 0x561265f3c720 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-a con 0x56126601d200 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:51:57.854+0000 7f4790b26800 10 monclient(hunting): authenticate will time out at 2071.123942s 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): get_auth_request con 0x561265ea7620 auth_method 0 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.195 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): get_auth_request con 0x56126601d200 auth_method 0 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:51:57.855+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): get_auth_request con 0x561265f3c720 auth_method 0 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.196 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:51:57.855+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient(hunting): handle_auth_done global_id 7532 payload 824 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient: _finish_hunting 0 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:51:57.855+0000 7f478c86f640 1 monclient: found mon.noname-c 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:51:57.855+0000 7f478c86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: dump: 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.197 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: _finish_auth 0 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: _check_auth_tickets 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:51:57.855+0000 7f4790b26800 5 monclient: authenticate success, global_id 7532 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:51:57.855+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:51:57.855+0000 7f4790b26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:51:57.855+0000 7f4679602640 10 monclient: dump: 2024-09-12T00:51:58.198 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:51:57.855+0000 7f467ae05640 4 set_mon_vals no callback set 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:51:57.855+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:51:57.855+0000 7f4790b26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:51:57.855+0000 7f4790b26800 1 librados: init done 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:51:57.857+0000 7f4679602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:58.199 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:51:57.857+0000 7f4679602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:51:57.857+0000 7f4679602640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:51:57.857+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f46740764a0 auth_method 0 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:51:57.858+0000 7f478d070640 10 monclient: get_auth_request con 0x56126601faf0 auth_method 0 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:51:57.858+0000 7f478c86f640 10 monclient: get_auth_request con 0x56126603e480 auth_method 0 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:51:57.860+0000 7f4787fff640 10 monclient: get_auth_request con 0x561266043610 auth_method 0 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:51:57.860+0000 7f4790b26800 10 monclient: build_initial_monmap 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:51:57.860+0000 7f4790b26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:51:57.860+0000 7f4790b26800 10 monclient: monmap: 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:58.200 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding auth protocol: cephx 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding auth protocol: cephx 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding auth protocol: cephx 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.201 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: crc 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:51:57.860+0000 7f4790b26800 5 AuthRegistry(0x561266047650) adding con mode: secure 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:51:57.861+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 asok(0x561265dd0630) register_command objecter_requests cmddesc objecter_requests hook 0x56126604b0a0 EEXIST 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient: init 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding auth protocol: cephx 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding auth protocol: cephx 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding auth protocol: cephx 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.202 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: crc 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 AuthRegistry(0x561266046608) adding con mode: secure 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:51:57.861+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:51:57.861+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.203 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:51:57.861+0000 7f4790b26800 5 asok(0x561265dd0630) register_command rotate-key cmddesc rotate-key hook 0x561266046750 EEXIST 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-c con 0x56126606ed90 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-a con 0x561266071060 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-b con 0x56126606d560 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:51:57.861+0000 7f4790b26800 10 monclient(hunting): authenticate will time out at 2071.130883s 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:51:57.861+0000 7f478c86f640 10 monclient(hunting): get_auth_request con 0x56126606ed90 auth_method 0 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:51:57.861+0000 7f478c86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.204 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:51:57.861+0000 7f478c86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:51:57.861+0000 7f478c86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): get_auth_request con 0x561266071060 auth_method 0 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:51:57.862+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:51:57.862+0000 7f478d070640 10 monclient(hunting): get_auth_request con 0x56126606d560 auth_method 0 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:51:57.862+0000 7f478d070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.205 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:51:57.862+0000 7f478d070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:51:57.862+0000 7f478d070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient(hunting): handle_auth_done global_id 7535 payload 824 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient: _finish_hunting 0 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:51:57.862+0000 7f478c86f640 1 monclient: found mon.noname-c 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:51:57.862+0000 7f478c86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: dump: 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.206 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: _finish_auth 0 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: _check_auth_tickets 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:51:57.862+0000 7f46727fc640 10 monclient: dump: 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.207 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:51:57.862+0000 7f478d871640 4 set_mon_vals no callback set 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:51:57.862+0000 7f4790b26800 5 monclient: authenticate success, global_id 7535 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:51:57.862+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:51:57.862+0000 7f4790b26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:51:57.862+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:51:57.862+0000 7f4790b26800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:51:58.208 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:51:57.864+0000 7f46727fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:51:57.864+0000 7f46727fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:51:57.864+0000 7f46727fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:51:57.864+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f4664076380 auth_method 0 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:51:57.864+0000 7f4790b26800 10 monclient: get_monmap_and_config 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:51:57.864+0000 7f4790b26800 10 monclient: build_initial_monmap 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:51:57.864+0000 7f4790b26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:51:57.864+0000 7f4790b26800 10 monclient: monmap: 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.209 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding auth protocol: cephx 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding auth protocol: cephx 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding auth protocol: cephx 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.210 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: crc 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:51:57.864+0000 7f4790b26800 5 AuthRegistry(0x56126608e6d0) adding con mode: secure 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:51:57.864+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient: init 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding auth protocol: cephx 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding auth protocol: cephx 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding auth protocol: cephx 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.211 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: crc 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 AuthRegistry(0x7fffc35162b0) adding con mode: secure 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:51:57.865+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:51:57.865+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:51:57.865+0000 7f4790b26800 5 asok(0x561265dd0630) register_command rotate-key cmddesc rotate-key hook 0x7fffc35163f8 EEXIST 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-b con 0x5612660c2d10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-a con 0x561266093c60 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:58.212 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-c con 0x5612660be5b0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:51:57.865+0000 7f4790b26800 10 monclient(hunting): authenticate will time out at 2071.134585s 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): get_auth_request con 0x561266093c60 auth_method 0 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): get_auth_request con 0x5612660be5b0 auth_method 0 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.213 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:51:57.865+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient(hunting): handle_auth_done global_id 7983 payload 274 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient: _finish_hunting 0 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:51:57.865+0000 7f4787fff640 1 monclient: found mon.noname-a 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:51:57.865+0000 7f4787fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: dump: 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.214 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: _finish_auth 0 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:51:57.866+0000 7f4663fff640 10 monclient: dump: 2024-09-12T00:51:58.215 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 monclient: authenticate success, global_id 7983 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:51:57.866+0000 7f4790b26800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:51:57.866+0000 7f4790b26800 4 set_mon_vals no callback set 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:51:57.866+0000 7f4790b26800 10 monclient: shutdown 2024-09-12T00:51:58.216 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:51:57.866+0000 7f4790b26800 10 monclient: build_initial_monmap 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:51:57.866+0000 7f4790b26800 1 build_initial for_mkfs: 0 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:51:57.866+0000 7f4790b26800 10 monclient: monmap: 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding auth protocol: cephx 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding auth protocol: cephx 2024-09-12T00:51:58.217 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding auth protocol: cephx 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: crc 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:51:57.866+0000 7f4790b26800 5 AuthRegistry(0x5612660beee0) adding con mode: secure 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:51:57.867+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.218 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:51:57.867+0000 7f4790b26800 1 librados: starting msgr at 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:51:57.867+0000 7f4790b26800 1 librados: starting objecter 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 asok(0x561265dd0630) register_command objecter_requests cmddesc objecter_requests hook 0x561266093720 EEXIST 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:51:57.867+0000 7f4790b26800 1 librados: setting wanted keys 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:51:57.867+0000 7f4790b26800 1 librados: calling monclient init 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient: init 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding auth protocol: cephx 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding auth protocol: cephx 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding auth protocol: cephx 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.219 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: crc 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 AuthRegistry(0x561266086b40) adding con mode: secure 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:51:57.867+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:51:57.867+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:51:57.867+0000 7f4790b26800 5 asok(0x561265dd0630) register_command rotate-key cmddesc rotate-key hook 0x561266086c88 EEXIST 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-a con 0x561266093c60 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-b con 0x5612660be5b0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:51:58.220 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): picked mon.noname-c con 0x5612660c2d10 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:51:57.867+0000 7f4790b26800 10 monclient(hunting): authenticate will time out at 2071.136895s 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:51:57.867+0000 7f478c86f640 10 monclient(hunting): get_auth_request con 0x561266093c60 auth_method 0 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:51:57.867+0000 7f478c86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:51:57.867+0000 7f478c86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:51:57.867+0000 7f478c86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): get_auth_request con 0x5612660c2d10 auth_method 0 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.221 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:51:57.868+0000 7f478d070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): get_auth_request con 0x5612660be5b0 auth_method 0 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:51:57.868+0000 7f4787fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:58.222 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient(hunting): handle_auth_done global_id 7986 payload 824 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient: _finish_hunting 0 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:51:57.868+0000 7f478c86f640 1 monclient: found mon.noname-a 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:51:57.868+0000 7f478c86f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: dump: 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.223 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: _finish_auth 0 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: _check_auth_tickets 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:51:57.868+0000 7f46627fc640 10 monclient: dump: 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:51:58.224 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:51:57.868+0000 7f4790b26800 5 monclient: authenticate success, global_id 7986 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:51:57.868+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:51:57.868+0000 7f4790b26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:51:57.868+0000 7f4663fff640 4 set_mon_vals no callback set 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:51:57.868+0000 7f4790b26800 10 monclient: _renew_subs 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:51:57.868+0000 7f4790b26800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:51:57.868+0000 7f4790b26800 1 librados: init done 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:51:57.868+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cr dump hook 0x5612660bbd98 2024-09-12T00:51:58.225 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:51:57.869+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:51:57.870+0000 7f46627fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:51:57.870+0000 7f46627fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:51:57.870+0000 7f46627fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:51:57.870+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f46580764a0 auth_method 0 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:51:57.870+0000 7f478d070640 10 monclient: get_auth_request con 0x5612660dc900 auth_method 0 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 realm 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:51:57.871+0000 7f4790b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.226 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:51:57.871+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:51:57.871+0000 7f478c86f640 10 monclient: get_auth_request con 0x5612660e0c70 auth_method 0 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:51:57.872+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:51:57.872+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:51:57.872+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:51:57.872+0000 7f4790b26800 20 searching for the correct realm 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:51:57.873+0000 7f4787fff640 10 monclient: get_auth_request con 0x5612660e5dc0 auth_method 0 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:51:57.873+0000 7f478d070640 10 monclient: get_auth_request con 0x7f4778039070 auth_method 0 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:51:57.874+0000 7f478c86f640 10 monclient: get_auth_request con 0x7f4780085040 auth_method 0 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:51:57.876+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f477801a040 auth_method 0 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:51:57.876+0000 7f4787fff640 0 -- 172.21.15.83:0/725552133 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f477801a040 msgr2=0x7f477801a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:51:58.077+0000 7f4787fff640 10 monclient: get_auth_request con 0x7f477801a040 auth_method 0 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:51:58.080+0000 7f478d070640 10 monclient: get_auth_request con 0x7f4780021030 auth_method 0 2024-09-12T00:51:58.227 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:51:58.081+0000 7f478c86f640 10 monclient: get_auth_request con 0x7f4788061040 auth_method 0 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:51:58.081+0000 7f478d070640 0 -- 172.21.15.83:0/725552133 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5612660dc900 msgr2=0x5612660ded80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:51:58.081+0000 7f46627fc640 1 client.7986.objecter ms_handle_reset 0x5612660dc900 session 0x5612660dc280 osd.6 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:51:58.082+0000 7f46627fc640 10 monclient: _renew_subs 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:51:58.082+0000 7f46627fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:51:58.082+0000 7f478d070640 10 monclient: get_auth_request con 0x7f4658086740 auth_method 0 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:58.228 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:51:58.085+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 zone default found 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:51:58.086+0000 7f4790b26800 4 Realm: () 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:51:58.086+0000 7f4790b26800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:51:58.086+0000 7f4790b26800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:51:58.086+0000 7f4790b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 zonegroup default 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.229 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:51:58.086+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 started sync module instance, tier type = 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:51:58.087+0000 7f4790b26800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=0 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=1 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=2 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=3 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=4 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=5 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:51:58.096+0000 7f4790b26800 20 add_watcher() i=6 2024-09-12T00:51:58.230 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:51:58.097+0000 7f4790b26800 20 add_watcher() i=7 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:51:58.097+0000 7f4790b26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding auth protocol: cephx 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding auth protocol: cephx 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding auth protocol: cephx 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:51:58.099+0000 7f46437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:58.231 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: crc 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 AuthRegistry(0x7fffc3516790) adding con mode: secure 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:51:58.099+0000 7f4790b26800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:51:58.099+0000 7f4790b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:51:58.099+0000 7f4790b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cache list hook 0x5612660b23f0 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cache inspect hook 0x5612660b23f0 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cache erase hook 0x5612660b23f0 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command cache zap hook 0x5612660b23f0 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 note: GC not initialized 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:51:58.099+0000 7f46427e4640 20 reqs_thread_entry: start 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command sync trace show hook 0x7f477800ded0 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command sync trace history hook 0x7f477800ded0 2024-09-12T00:51:58.232 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command sync trace active hook 0x7f477800ded0 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:51:58.099+0000 7f4790b26800 5 asok(0x561265dd0630) register_command sync trace active_short hook 0x7f477800ded0 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:51:58.099+0000 7f4790b26800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:51:58.099+0000 7f4790b26800 20 Filter name: none 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:51:58.099+0000 7f463bfff640 20 reqs_thread_entry: start 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 : miss 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:51:58.100+0000 7f4790b26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.233 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:51:58.100+0000 7f4790b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:51:58.104+0000 7f4790b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:51:58.104+0000 7f4790b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:51:58.104+0000 7f4790b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:51:58.104+0000 7f4790b26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40, ofs0, ns] 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94637021636128 notifier 7986 bl.length()=1015 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:51:58.104+0000 7f46637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_sources= new_sources= 2024-09-12T00:51:58.234 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential sources added=[] removed=[] 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_dests= new_dests= 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:51:58.105+0000 7f4790b26800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential dests added=[] removed=[] 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:51:58.107+0000 7f4790b26800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.0 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:51:58.107+0000 7f4790b26800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.0 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:51:58.107+0000 7f4790b26800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.1 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:51:58.107+0000 7f4790b26800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.1.1 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:51:58.107+0000 7f4790b26800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.0 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:51:58.110+0000 7f4790b26800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4790b26800 time 2024-09-12T00:51:58.110661+0000 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:58.235 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f479238c71a] 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f479238c8d8] 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561264fba641] 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x561264fc951b] 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561264fca3e4] 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4791029590] 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:51:58.111+0000 7f4790b26800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f4790b26800 thread_name:radosgw-admin 2024-09-12T00:51:58.236 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f479103e6f0] 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f479108b99c] 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f479238c774] 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f479238c8d8] 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561264fba641] 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x561264fc951b] 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561264fca3e4] 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4791029590] 2024-09-12T00:51:58.237 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:58.238 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:51:58.239 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:51:58.240 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:51:58.241 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:58.242 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:51:58.243 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 7f463bfff640 / http_manager 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46427e4640 / http_manager 2024-09-12T00:51:58.244 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46437e6640 / rgw_dt_lg_renew 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46627fc640 / ms_dispatch 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46637fe640 / io_context_pool 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f4663fff640 / io_context_pool 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f46727fc640 / ms_dispatch 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f4679602640 / ms_dispatch 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f467ae05640 / io_context_pool 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f4787fff640 / msgr-worker-2 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f478c86f640 / msgr-worker-1 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f478d070640 / msgr-worker-0 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f478d871640 / io_context_pool 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: 7f4790b26800 / radosgw-admin 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:51:58.112281Z_1cb2bf1e-39a5-4ffc-9f70-76074b456b8b/log 2024-09-12T00:51:58.245 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:51:58.246 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:51:58.247 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:58.247 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:58.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.185+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.187+0000 7f3672840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.187+0000 7f3672840800 20 realm 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.187+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.187+0000 7f3672840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.187+0000 7f3672840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.187+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.187+0000 7f3672840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.187+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.188+0000 7f3672840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.188+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.188+0000 7f3672840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.188+0000 7f3672840800 20 searching for the correct realm 2024-09-12T00:51:58.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.191+0000 7f3667b29640 0 -- 172.21.15.83:0/717672908 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f3658075070 msgr2=0x7f36580db2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:58.395 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.397+0000 7f3670b2b640 0 -- 172.21.15.83:0/717672908 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x563df9e772d0 msgr2=0x563df9e796c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:58.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.400+0000 7f3672840800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:58.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.400+0000 7f3672840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:58.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.400+0000 7f3672840800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:58.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.400+0000 7f3672840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:58.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.400+0000 7f3672840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:58.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.400+0000 7f3672840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:58.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.400+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:58.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:58.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 20 zone default found 2024-09-12T00:51:58.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 4 Realm: () 2024-09-12T00:51:58.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:58.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:58.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:58.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 20 zonegroup default 2024-09-12T00:51:58.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.401+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.402+0000 7f3672840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.402+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.402+0000 7f3672840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.402+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.402+0000 7f3672840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.402+0000 7f3672840800 20 started sync module instance, tier type = 2024-09-12T00:51:58.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.402+0000 7f3672840800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:58.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.411+0000 7f3672840800 20 add_watcher() i=0 2024-09-12T00:51:58.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.411+0000 7f3672840800 20 add_watcher() i=1 2024-09-12T00:51:58.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.411+0000 7f3672840800 20 add_watcher() i=2 2024-09-12T00:51:58.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.411+0000 7f3672840800 20 add_watcher() i=3 2024-09-12T00:51:58.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.411+0000 7f3672840800 20 add_watcher() i=4 2024-09-12T00:51:58.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.411+0000 7f3672840800 20 add_watcher() i=5 2024-09-12T00:51:58.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.411+0000 7f3672840800 20 add_watcher() i=6 2024-09-12T00:51:58.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.412+0000 7f3672840800 20 add_watcher() i=7 2024-09-12T00:51:58.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.412+0000 7f3672840800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:58.412 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.414+0000 7f3526fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:58.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.414+0000 7f3672840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:58.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.414+0000 7f3672840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:58.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.414+0000 7f3672840800 5 note: GC not initialized 2024-09-12T00:51:58.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.414+0000 7f3525fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:58.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.414+0000 7f3672840800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:58.413 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.415+0000 7f3672840800 20 Filter name: none 2024-09-12T00:51:58.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.415+0000 7f351effd640 20 reqs_thread_entry: start 2024-09-12T00:51:58.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.415+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.415+0000 7f3672840800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:58.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.415+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.416+0000 7f3672840800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:51:58.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.416+0000 7f3672840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:58.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.416+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.416+0000 7f3672840800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:58.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.416+0000 7f3672840800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.416+0000 7f3672840800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:51:58.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.416+0000 7f3672840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:58.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.418+0000 7f3526fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:58.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.420+0000 7f3672840800 20 remove_watcher() i=0 2024-09-12T00:51:58.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.420+0000 7f3672840800 2 removed watcher, disabling cache 2024-09-12T00:51:58.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.421+0000 7f3672840800 20 remove_watcher() i=1 2024-09-12T00:51:58.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.422+0000 7f3672840800 20 remove_watcher() i=2 2024-09-12T00:51:58.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.424+0000 7f3672840800 20 remove_watcher() i=3 2024-09-12T00:51:58.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.425+0000 7f3672840800 20 remove_watcher() i=4 2024-09-12T00:51:58.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.426+0000 7f3672840800 20 remove_watcher() i=5 2024-09-12T00:51:58.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.427+0000 7f3672840800 20 remove_watcher() i=6 2024-09-12T00:51:58.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.428+0000 7f3672840800 20 remove_watcher() i=7 2024-09-12T00:51:58.436 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.436 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:51:58.436 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-change-reshard-state id: ad4424e4-de7c-4376-b125-e717016a3484.4511.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:58.436 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:51:58.438 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:58.438 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:58.445 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:58.445 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:51:58.488 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:58.519 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:58.519 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:58.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.557+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.558+0000 7f5ba1e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.558+0000 7f5ba1e0e800 20 realm 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.558+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.559+0000 7f5ba1e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.559+0000 7f5ba1e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.559+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.559+0000 7f5ba1e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.559+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.559+0000 7f5ba1e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:58.558 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.559+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.560+0000 7f5ba1e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:58.559 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.560+0000 7f5ba1e0e800 20 searching for the correct realm 2024-09-12T00:51:58.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.563+0000 7f5b94cca640 0 -- 172.21.15.83:0/1156694838 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f5b88067480 msgr2=0x7f5b8807b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:58.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.566+0000 7f5b9dccc640 0 -- 172.21.15.83:0/1156694838 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55be293e5740 msgr2=0x55be293e7bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:58.568 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:58.569 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:58.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 zone default found 2024-09-12T00:51:58.570 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 4 Realm: () 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 zonegroup default 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.570+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.571+0000 7f5ba1e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.571+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.571+0000 7f5ba1e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.571+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.571+0000 7f5ba1e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.571+0000 7f5ba1e0e800 20 started sync module instance, tier type = 2024-09-12T00:51:58.571 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.571+0000 7f5ba1e0e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:51:58.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.580+0000 7f5ba1e0e800 20 add_watcher() i=0 2024-09-12T00:51:58.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.580+0000 7f5ba1e0e800 20 add_watcher() i=1 2024-09-12T00:51:58.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.580+0000 7f5ba1e0e800 20 add_watcher() i=2 2024-09-12T00:51:58.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.580+0000 7f5ba1e0e800 20 add_watcher() i=3 2024-09-12T00:51:58.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.580+0000 7f5ba1e0e800 20 add_watcher() i=4 2024-09-12T00:51:58.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.580+0000 7f5ba1e0e800 20 add_watcher() i=5 2024-09-12T00:51:58.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.580+0000 7f5ba1e0e800 20 add_watcher() i=6 2024-09-12T00:51:58.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.581+0000 7f5ba1e0e800 20 add_watcher() i=7 2024-09-12T00:51:58.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.581+0000 7f5ba1e0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:58.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.582+0000 7f5a53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:58.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.583+0000 7f5ba1e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:58.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.583+0000 7f5ba1e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:58.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.583+0000 7f5ba1e0e800 5 note: GC not initialized 2024-09-12T00:51:58.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.583+0000 7f5a52fe5640 20 reqs_thread_entry: start 2024-09-12T00:51:58.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.583+0000 7f5ba1e0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:58.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.583+0000 7f5ba1e0e800 20 Filter name: none 2024-09-12T00:51:58.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.583+0000 7f5a50fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:58.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.583+0000 7f5ba1e0e800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:51:58.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.583+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.584+0000 7f5ba1e0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:51:58.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.584+0000 7f5ba1e0e800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:51:58.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.584+0000 7f5ba1e0e800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:51:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.584+0000 7f5ba1e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 : miss 2024-09-12T00:51:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.584+0000 7f5ba1e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.585+0000 7f5ba1e0e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:51:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.585+0000 7f5ba1e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:51:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.585+0000 7f5ba1e0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:51:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.585+0000 7f5ba1e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.585+0000 7f5ba1e0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:51:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.585+0000 7f5ba1e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 2024-09-12T00:51:58.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.586+0000 7f5ba1e0e800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to be held by another RGW process; skipping for now 2024-09-12T00:51:58.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.586+0000 7f5a53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:58.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.588+0000 7f5ba1e0e800 20 remove_watcher() i=0 2024-09-12T00:51:58.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.588+0000 7f5ba1e0e800 2 removed watcher, disabling cache 2024-09-12T00:51:58.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.589+0000 7f5ba1e0e800 20 remove_watcher() i=1 2024-09-12T00:51:58.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.590+0000 7f5ba1e0e800 20 remove_watcher() i=2 2024-09-12T00:51:58.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.591+0000 7f5ba1e0e800 20 remove_watcher() i=3 2024-09-12T00:51:58.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.592+0000 7f5ba1e0e800 20 remove_watcher() i=4 2024-09-12T00:51:58.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.593+0000 7f5ba1e0e800 20 remove_watcher() i=5 2024-09-12T00:51:58.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.594+0000 7f5ba1e0e800 20 remove_watcher() i=6 2024-09-12T00:51:58.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:51:58.595+0000 7f5ba1e0e800 20 remove_watcher() i=7 2024-09-12T00:51:58.604 INFO:tasks.workunit.client.0.smithi083.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:52:28.623 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:52:28.658 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:28.658 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:28.700 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.700+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.702+0000 7f346fd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.702+0000 7f346fd42800 20 realm 2024-09-12T00:52:28.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.702+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.703+0000 7f346fd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.703+0000 7f346fd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:28.703 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.703+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.703+0000 7f346fd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.704 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.703+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.704+0000 7f346fd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.704+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.705 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.704+0000 7f346fd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:28.706 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.704+0000 7f346fd42800 20 searching for the correct realm 2024-09-12T00:52:28.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.708+0000 7f346b285640 0 -- 172.21.15.83:0/4186772599 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f34600752d0 msgr2=0x7f346006a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:28.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.712+0000 7f346ba86640 0 -- 172.21.15.83:0/4186772599 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f3464017070 msgr2=0x7f3464032400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:28.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:52:28.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:28.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:52:28.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:28.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:28.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:28.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.720 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:28.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.716+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:28.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 20 zone default found 2024-09-12T00:52:28.721 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 4 Realm: () 2024-09-12T00:52:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:52:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:52:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 20 zonegroup default 2024-09-12T00:52:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.722 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.717+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.718+0000 7f346fd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.718+0000 7f346fd42800 20 started sync module instance, tier type = 2024-09-12T00:52:28.724 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.718+0000 7f346fd42800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:52:28.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.727+0000 7f346fd42800 20 add_watcher() i=0 2024-09-12T00:52:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.727+0000 7f346fd42800 20 add_watcher() i=1 2024-09-12T00:52:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.727+0000 7f346fd42800 20 add_watcher() i=2 2024-09-12T00:52:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.727+0000 7f346fd42800 20 add_watcher() i=3 2024-09-12T00:52:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.727+0000 7f346fd42800 20 add_watcher() i=4 2024-09-12T00:52:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.727+0000 7f346fd42800 20 add_watcher() i=5 2024-09-12T00:52:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.727+0000 7f346fd42800 20 add_watcher() i=6 2024-09-12T00:52:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.728+0000 7f346fd42800 20 add_watcher() i=7 2024-09-12T00:52:28.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.728+0000 7f346fd42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:28.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.730+0000 7f3321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:28.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.730+0000 7f346fd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:28.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.730+0000 7f346fd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:28.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.730+0000 7f346fd42800 5 note: GC not initialized 2024-09-12T00:52:28.732 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f3320fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:28.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f346fd42800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:28.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f346fd42800 20 Filter name: none 2024-09-12T00:52:28.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f329a7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:28.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f346fd42800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:52:28.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f346fd42800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:52:28.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f346fd42800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:52:28.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f346fd42800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:52:28.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f346fd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 : miss 2024-09-12T00:52:28.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.731+0000 7f346fd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.732+0000 7f346fd42800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:52:28.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.732+0000 7f346fd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:52:28.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.732+0000 7f346fd42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:52:28.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.732+0000 7f346fd42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:28.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.732+0000 7f346fd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:52:28.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.732+0000 7f346fd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 2024-09-12T00:52:28.735 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.733+0000 7f346fd42800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:28.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.737+0000 7f346fd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:52:28.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.737+0000 7f346fd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:52:28.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.737+0000 7f346fd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:52:28.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.737+0000 7f346fd42800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40, ofs0, ns] 2024-09-12T00:52:28.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.738+0000 7f334affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94188584157936 notifier 8046 bl.length()=1015 2024-09-12T00:52:28.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.738+0000 7f334affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:52:28.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.738+0000 7f334affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:52:28.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.738+0000 7f334affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:52:28.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.738+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_sources= new_sources= 2024-09-12T00:52:28.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.738+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential sources added=[] removed=[] 2024-09-12T00:52:28.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.738+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_dests= new_dests= 2024-09-12T00:52:28.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.738+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential dests added=[] removed=[] 2024-09-12T00:52:28.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.742+0000 7f346fd42800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.2.0 2024-09-12T00:52:28.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.742+0000 7f346fd42800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.2.0 2024-09-12T00:52:28.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.742+0000 7f346fd42800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.2.1 2024-09-12T00:52:28.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.742+0000 7f346fd42800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.2.1 2024-09-12T00:52:28.742 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.742+0000 7f346fd42800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.0 2024-09-12T00:52:28.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.745+0000 7f346fd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:28.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.745+0000 7f346fd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 2024-09-12T00:52:28.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.746+0000 7f346fd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:52:28.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.746+0000 7f346fd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:52:28.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.746+0000 7f346fd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:52:28.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.746+0000 7f346fd42800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40, ofs0, ns] 2024-09-12T00:52:28.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.746+0000 7f334affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94188584157936 notifier 8046 bl.length()=1015 2024-09-12T00:52:28.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.746+0000 7f334affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:52:28.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.746+0000 7f334affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:52:28.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.746+0000 7f334affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:52:28.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.747+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_sources= new_sources= 2024-09-12T00:52:28.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.747+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential sources added=[] removed=[] 2024-09-12T00:52:28.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.747+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_dests= new_dests= 2024-09-12T00:52:28.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.747+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential dests added=[] removed=[] 2024-09-12T00:52:28.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.748+0000 7f346fd42800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.40.0 2024-09-12T00:52:28.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.748+0000 7f346fd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:28.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.748+0000 7f346fd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 2024-09-12T00:52:28.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.749+0000 7f346fd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:52:28.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.749+0000 7f346fd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:52:28.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.749+0000 7f346fd42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:52:28.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.749+0000 7f346fd42800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40, ofs0, ns] 2024-09-12T00:52:28.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.750+0000 7f334affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94188584157936 notifier 8046 bl.length()=983 2024-09-12T00:52:28.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.750+0000 7f334affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 info.flags=0x17 2024-09-12T00:52:28.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.750+0000 7f334affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ad4424e4-de7c-4376-b125-e717016a3484.4511.40 to cache LRU end 2024-09-12T00:52:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.750+0000 7f334affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:52:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.750+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_sources= new_sources= 2024-09-12T00:52:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.750+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential sources added=[] removed=[] 2024-09-12T00:52:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.750+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): orig_dests= new_dests= 2024-09-12T00:52:28.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.750+0000 7f346fd42800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ad4424e4-de7c-4376-b125-e717016a3484.4511.40]): potential dests added=[] removed=[] 2024-09-12T00:52:28.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.751+0000 7f346fd42800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:52:28.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.753+0000 7f3321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:28.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.755+0000 7f346fd42800 20 remove_watcher() i=0 2024-09-12T00:52:28.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.755+0000 7f346fd42800 2 removed watcher, disabling cache 2024-09-12T00:52:28.756 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.756+0000 7f346fd42800 20 remove_watcher() i=1 2024-09-12T00:52:28.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.758+0000 7f346fd42800 20 remove_watcher() i=2 2024-09-12T00:52:28.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.758+0000 7f346fd42800 20 remove_watcher() i=3 2024-09-12T00:52:28.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.759+0000 7f346fd42800 20 remove_watcher() i=4 2024-09-12T00:52:28.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.761+0000 7f346fd42800 20 remove_watcher() i=5 2024-09-12T00:52:28.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.762+0000 7f346fd42800 20 remove_watcher() i=6 2024-09-12T00:52:28.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.763+0000 7f346fd42800 20 remove_watcher() i=7 2024-09-12T00:52:28.774 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:52:28.803 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:28.803 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:28.840 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.840+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.842+0000 7f76c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.842 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.842+0000 7f76c102f800 20 realm 2024-09-12T00:52:28.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.842+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.842+0000 7f76c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.842+0000 7f76c102f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:28.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.842+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.842+0000 7f76c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:28.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.842+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.843+0000 7f76c102f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:28.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.843+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:28.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.844+0000 7f76c102f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:28.845 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.844+0000 7f76c102f800 20 searching for the correct realm 2024-09-12T00:52:28.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:28.847+0000 7f76be318640 0 -- 172.21.15.83:0/2376007441 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f76b4064460 msgr2=0x7f76b40648e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:29.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.052+0000 7f76bf31a640 0 -- 172.21.15.83:0/2376007441 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5643677a8350 msgr2=0x5643677aa7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:29.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.056+0000 7f76c102f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:52:29.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.056+0000 7f76c102f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:29.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.056+0000 7f76c102f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:52:29.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.056+0000 7f76c102f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:29.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.056+0000 7f76c102f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:29.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.056+0000 7f76c102f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:29.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.056+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 20 zone default found 2024-09-12T00:52:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 4 Realm: () 2024-09-12T00:52:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:52:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:52:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:29.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 20 zonegroup default 2024-09-12T00:52:29.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.057+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.058+0000 7f76c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.058+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.058+0000 7f76c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.058+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.058+0000 7f76c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.058+0000 7f76c102f800 20 started sync module instance, tier type = 2024-09-12T00:52:29.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.058+0000 7f76c102f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:52:29.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.068+0000 7f76c102f800 20 add_watcher() i=0 2024-09-12T00:52:29.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.068+0000 7f76c102f800 20 add_watcher() i=1 2024-09-12T00:52:29.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.068+0000 7f76c102f800 20 add_watcher() i=2 2024-09-12T00:52:29.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.068+0000 7f76c102f800 20 add_watcher() i=3 2024-09-12T00:52:29.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.068+0000 7f76c102f800 20 add_watcher() i=4 2024-09-12T00:52:29.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.068+0000 7f76c102f800 20 add_watcher() i=5 2024-09-12T00:52:29.068 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.068+0000 7f76c102f800 20 add_watcher() i=6 2024-09-12T00:52:29.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.069+0000 7f76c102f800 20 add_watcher() i=7 2024-09-12T00:52:29.069 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.069+0000 7f76c102f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:29.071 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.071+0000 7f75757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:29.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.072+0000 7f76c102f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:29.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.072+0000 7f76c102f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:29.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.072+0000 7f76c102f800 5 note: GC not initialized 2024-09-12T00:52:29.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.072+0000 7f74effff640 20 reqs_thread_entry: start 2024-09-12T00:52:29.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.072+0000 7f76c102f800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:29.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.072+0000 7f76c102f800 20 Filter name: none 2024-09-12T00:52:29.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.072+0000 7f74edffb640 20 reqs_thread_entry: start 2024-09-12T00:52:29.072 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.072+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.073+0000 7f76c102f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:52:29.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.073+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.073+0000 7f76c102f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:52:29.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.073+0000 7f76c102f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:29.073 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.073+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.074+0000 7f76c102f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:52:29.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.074+0000 7f76c102f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.074+0000 7f76c102f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:52:29.074 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.074+0000 7f76c102f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:29.075 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.076+0000 7f75757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:29.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.079+0000 7f76c102f800 20 remove_watcher() i=0 2024-09-12T00:52:29.078 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.079+0000 7f76c102f800 2 removed watcher, disabling cache 2024-09-12T00:52:29.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.080+0000 7f76c102f800 20 remove_watcher() i=1 2024-09-12T00:52:29.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.081+0000 7f76c102f800 20 remove_watcher() i=2 2024-09-12T00:52:29.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.082+0000 7f76c102f800 20 remove_watcher() i=3 2024-09-12T00:52:29.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.083+0000 7f76c102f800 20 remove_watcher() i=4 2024-09-12T00:52:29.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.084+0000 7f76c102f800 20 remove_watcher() i=5 2024-09-12T00:52:29.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.086+0000 7f76c102f800 20 remove_watcher() i=6 2024-09-12T00:52:29.086 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.087+0000 7f76c102f800 20 remove_watcher() i=7 2024-09-12T00:52:29.097 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.097 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:52:29.097 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: abort-at-change-reshard-state id: ad4424e4-de7c-4376-b125-e717016a3484.4511.40 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:52:29.097 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.098 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.099 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:52:29.102 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.102 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:52:29.146 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:29.146 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:52:29.160 INFO:tasks.workunit.client.0.smithi083.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:52:29.163 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:52:29.191 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:29.192 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:29.229 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.229+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.231+0000 7f1383d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.231+0000 7f1383d46800 20 realm 2024-09-12T00:52:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.231+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.231+0000 7f1383d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.231+0000 7f1383d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.231+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.231+0000 7f1383d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.231 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.231+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.232+0000 7f1383d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:29.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.232+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.232+0000 7f1383d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:29.232 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.232+0000 7f1383d46800 20 searching for the correct realm 2024-09-12T00:52:29.235 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.236+0000 7f137bfff640 0 -- 172.21.15.83:0/1117191187 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f136c02b3a0 msgr2=0x7f136c02b820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:29.239 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.240+0000 7f137bfff640 0 -- 172.21.15.83:0/1117191187 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55bd71696c50 msgr2=0x55bd716990f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:29.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.243+0000 7f1383d46800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:52:29.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.243+0000 7f1383d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:29.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.243+0000 7f1383d46800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:52:29.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.243+0000 7f1383d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:29.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.243+0000 7f1383d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:29.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.243+0000 7f1383d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:29.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.243+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.244 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 zone default found 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 4 Realm: () 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 zonegroup default 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.245 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.244+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.245+0000 7f1383d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.246 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.245+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.245+0000 7f1383d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.245+0000 7f1383d46800 20 started sync module instance, tier type = 2024-09-12T00:52:29.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.245+0000 7f1383d46800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:52:29.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.253+0000 7f1383d46800 20 add_watcher() i=0 2024-09-12T00:52:29.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.253+0000 7f1383d46800 20 add_watcher() i=1 2024-09-12T00:52:29.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.253+0000 7f1383d46800 20 add_watcher() i=2 2024-09-12T00:52:29.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.253+0000 7f1383d46800 20 add_watcher() i=3 2024-09-12T00:52:29.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.253+0000 7f1383d46800 20 add_watcher() i=4 2024-09-12T00:52:29.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.253+0000 7f1383d46800 20 add_watcher() i=5 2024-09-12T00:52:29.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.253+0000 7f1383d46800 20 add_watcher() i=6 2024-09-12T00:52:29.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.255+0000 7f1383d46800 20 add_watcher() i=7 2024-09-12T00:52:29.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.255+0000 7f1383d46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:29.256 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.257+0000 7f12337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:29.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.257+0000 7f1383d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:29.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.257+0000 7f1383d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:29.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.257+0000 7f1383d46800 5 note: GC not initialized 2024-09-12T00:52:29.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.257+0000 7f12327fc640 20 reqs_thread_entry: start 2024-09-12T00:52:29.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.257+0000 7f1383d46800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:29.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.257+0000 7f1383d46800 20 Filter name: none 2024-09-12T00:52:29.258 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.257+0000 7f11a3fff640 20 reqs_thread_entry: start 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.258+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.258+0000 7f1383d46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.258+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.258+0000 7f1383d46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.258+0000 7f1383d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.258+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.258+0000 7f1383d46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.258+0000 7f1383d46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.259+0000 7f1383d46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:52:29.259 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.259+0000 7f1383d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:29.260 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.260+0000 7f12337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:29.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.262+0000 7f1383d46800 20 remove_watcher() i=0 2024-09-12T00:52:29.261 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.262+0000 7f1383d46800 2 removed watcher, disabling cache 2024-09-12T00:52:29.262 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.263+0000 7f1383d46800 20 remove_watcher() i=1 2024-09-12T00:52:29.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.264+0000 7f1383d46800 20 remove_watcher() i=2 2024-09-12T00:52:29.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.265+0000 7f1383d46800 20 remove_watcher() i=3 2024-09-12T00:52:29.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.266+0000 7f1383d46800 20 remove_watcher() i=4 2024-09-12T00:52:29.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.268+0000 7f1383d46800 20 remove_watcher() i=5 2024-09-12T00:52:29.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.270+0000 7f1383d46800 20 remove_watcher() i=6 2024-09-12T00:52:29.270 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.271+0000 7f1383d46800 20 remove_watcher() i=7 2024-09-12T00:52:29.280 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.280 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:52:29.281 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: ad4424e4-de7c-4376-b125-e717016a3484.4511.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:52:29.281 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.282 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:52:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:29.310 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:29.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.347+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.349+0000 7f46b840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.349+0000 7f46b840e800 20 realm 2024-09-12T00:52:29.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.349+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.349+0000 7f46b840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.349+0000 7f46b840e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:29.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.349+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.349+0000 7f46b840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.349+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.350+0000 7f46b840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:29.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.350+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.350+0000 7f46b840e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:29.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.350+0000 7f46b840e800 20 searching for the correct realm 2024-09-12T00:52:29.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.353+0000 7f46b336a640 0 -- 172.21.15.83:0/2798752367 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f469c0e3790 msgr2=0x7f469c0823c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:29.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.558+0000 7f46b436c640 0 -- 172.21.15.83:0/2798752367 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x564f66338280 msgr2=0x564f6633a700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:29.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.561+0000 7f46b840e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:52:29.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.561+0000 7f46b840e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:29.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.561+0000 7f46b840e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:52:29.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.561+0000 7f46b840e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:29.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.561+0000 7f46b840e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:29.561 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.561+0000 7f46b840e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:29.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.562 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:29.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:29.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 20 zone default found 2024-09-12T00:52:29.563 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 4 Realm: () 2024-09-12T00:52:29.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:52:29.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:52:29.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:29.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 20 zonegroup default 2024-09-12T00:52:29.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.562+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.563+0000 7f46b840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.563+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.563+0000 7f46b840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.564 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.563+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.564+0000 7f46b840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.564+0000 7f46b840e800 20 started sync module instance, tier type = 2024-09-12T00:52:29.565 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.564+0000 7f46b840e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:52:29.572 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.573+0000 7f46b840e800 20 add_watcher() i=0 2024-09-12T00:52:29.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.573+0000 7f46b840e800 20 add_watcher() i=1 2024-09-12T00:52:29.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.573+0000 7f46b840e800 20 add_watcher() i=2 2024-09-12T00:52:29.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.573+0000 7f46b840e800 20 add_watcher() i=3 2024-09-12T00:52:29.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.573+0000 7f46b840e800 20 add_watcher() i=4 2024-09-12T00:52:29.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.573+0000 7f46b840e800 20 add_watcher() i=5 2024-09-12T00:52:29.573 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.573+0000 7f46b840e800 20 add_watcher() i=6 2024-09-12T00:52:29.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.574+0000 7f46b840e800 20 add_watcher() i=7 2024-09-12T00:52:29.574 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.574+0000 7f46b840e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:29.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.575+0000 7f456a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:29.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.576+0000 7f46b840e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:29.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.576+0000 7f46b840e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:29.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.576+0000 7f46b840e800 5 note: GC not initialized 2024-09-12T00:52:29.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.576+0000 7f45697e2640 20 reqs_thread_entry: start 2024-09-12T00:52:29.576 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.576+0000 7f46b840e800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:29.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.576+0000 7f46b840e800 20 Filter name: none 2024-09-12T00:52:29.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.576+0000 7f45627fc640 20 reqs_thread_entry: start 2024-09-12T00:52:29.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.576+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.577+0000 7f46b840e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:29.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.577+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.577+0000 7f46b840e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:52:29.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.577+0000 7f46b840e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:29.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.577+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.577+0000 7f46b840e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:29.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.577+0000 7f46b840e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.577+0000 7f46b840e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:52:29.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.577+0000 7f46b840e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:29.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.579+0000 7f456a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:29.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.581+0000 7f46b840e800 20 remove_watcher() i=0 2024-09-12T00:52:29.581 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.581+0000 7f46b840e800 2 removed watcher, disabling cache 2024-09-12T00:52:29.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.583+0000 7f46b840e800 20 remove_watcher() i=1 2024-09-12T00:52:29.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.584+0000 7f46b840e800 20 remove_watcher() i=2 2024-09-12T00:52:29.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.585+0000 7f46b840e800 20 remove_watcher() i=3 2024-09-12T00:52:29.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.587+0000 7f46b840e800 20 remove_watcher() i=4 2024-09-12T00:52:29.587 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.588+0000 7f46b840e800 20 remove_watcher() i=5 2024-09-12T00:52:29.589 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.589+0000 7f46b840e800 20 remove_watcher() i=6 2024-09-12T00:52:29.590 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.590+0000 7f46b840e800 20 remove_watcher() i=7 2024-09-12T00:52:29.601 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:52:29.635 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:29.635 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:29.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.672+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 realm 2024-09-12T00:52:29.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.674+0000 7f2ee7a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.675+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:29.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.675+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.675+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:29.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.676+0000 7f2ee7a16800 20 searching for the correct realm 2024-09-12T00:52:29.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.679+0000 7f2ee29e6640 0 -- 172.21.15.83:0/435854245 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f2ed807e450 msgr2=0x7f2ed807e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:29.884 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.884+0000 7f2ee29e6640 0 -- 172.21.15.83:0/435854245 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55c3e6c1a5c0 msgr2=0x55c3e6c1ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:29.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.888+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:52:29.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:29.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:52:29.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:29.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:29.889 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 zone default found 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 4 Realm: () 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 zonegroup default 2024-09-12T00:52:29.890 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 started sync module instance, tier type = 2024-09-12T00:52:29.891 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:52:29.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=0 2024-09-12T00:52:29.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=1 2024-09-12T00:52:29.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=2 2024-09-12T00:52:29.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=3 2024-09-12T00:52:29.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=4 2024-09-12T00:52:29.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=5 2024-09-12T00:52:29.898 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=6 2024-09-12T00:52:29.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.900+0000 7f2ee7a16800 20 add_watcher() i=7 2024-09-12T00:52:29.899 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.900+0000 7f2ee7a16800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:29.900 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.901+0000 7f2d99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:29.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.901+0000 7f2ee7a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:29.901 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.901+0000 7f2ee7a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:29.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 note: GC not initialized 2024-09-12T00:52:29.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2d98fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:29.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:29.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 Filter name: none 2024-09-12T00:52:29.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2d127fc640 20 reqs_thread_entry: start 2024-09-12T00:52:29.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:29.902 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.903+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:29.903 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:52:29.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:29.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:29.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:29.906 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:52:29.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464426 cookie 94299878495952 notifier 8121 bl.length()=911 2024-09-12T00:52:29.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:29.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:29.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:29.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:52:29.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:52:29.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:52:29.907 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:52:29.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:52:29.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:52:29.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.1 2024-09-12T00:52:29.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.1 2024-09-12T00:52:29.909 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.2 2024-09-12T00:52:29.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.2 2024-09-12T00:52:29.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.3 2024-09-12T00:52:29.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.3 2024-09-12T00:52:29.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:52:29.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:52:29.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:52:29.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:52:29.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.911+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:52:29.910 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.911+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:52:29.912 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ee7a16800 time 2024-09-12T00:52:29.914542+0000 2024-09-12T00:52:29.912 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2ee8b8c71a] 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2ee8b8c8d8] 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3e49c3641] 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55c3e49d251b] 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c3e49d33e4] 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2ee7829590] 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.913+0000 7f2ee7a16800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ee7a16800 time 2024-09-12T00:52:29.914542+0000 2024-09-12T00:52:29.913 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2ee8b8c71a] 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2ee8b8c8d8] 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3e49c3641] 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55c3e49d251b] 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c3e49d33e4] 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2ee7829590] 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:52:29.914 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f2ee7a16800 thread_name:radosgw-admin 2024-09-12T00:52:29.929 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:29.929 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2ee783e6f0] 2024-09-12T00:52:29.929 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2ee788b99c] 2024-09-12T00:52:29.929 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:52:29.929 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:52:29.929 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2ee8b8c774] 2024-09-12T00:52:29.929 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2ee8b8c8d8] 2024-09-12T00:52:29.929 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3e49c3641] 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55c3e49d251b] 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c3e49d33e4] 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2ee7829590] 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.914+0000 7f2ee7a16800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f2ee7a16800 thread_name:radosgw-admin 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2ee783e6f0] 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2ee788b99c] 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:52:29.930 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2ee8b8c774] 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2ee8b8c8d8] 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3e49c3641] 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55c3e49d251b] 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c3e49d33e4] 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2ee7829590] 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:52:29.931 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 1 librados: starting msgr at 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 1 librados: starting objecter 2024-09-12T00:52:29.932 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command objecter_requests hook 0x55c3e6b33a70 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 1 librados: setting wanted keys 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 1 librados: calling monclient init 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient: init 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding auth protocol: cephx 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding auth protocol: cephx 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding auth protocol: cephx 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.933 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command rotate-key hook 0x55c3e6b2f9d8 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-a con 0x55c3e69e7a10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-b con 0x55c3e6a72a30 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-c con 0x55c3e6a75880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.934 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): authenticate will time out at 2102.927658s 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request con 0x55c3e69e7a10 auth_method 0 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request con 0x55c3e6a75880 auth_method 0 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.935 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:52:29.657+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request con 0x55c3e6a72a30 auth_method 0 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:52:29.657+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:52:29.657+0000 7f2ee29e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:52:29.657+0000 7f2ee29e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_done global_id 8112 payload 824 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:52:29.658+0000 7f2ee31e7640 10 monclient: _finish_hunting 0 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:52:29.658+0000 7f2ee31e7640 1 monclient: found mon.noname-a 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:52:29.658+0000 7f2ee31e7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.936 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: dump: 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: _finish_auth 0 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: _check_auth_tickets 2024-09-12T00:52:29.937 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: dump: 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 5 monclient: authenticate success, global_id 8112 2024-09-12T00:52:29.938 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:52:29.658+0000 7f2dd160a640 4 set_mon_vals no callback set 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 1 librados: init done 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:52:29.660+0000 7f2dcfe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:52:29.660+0000 7f2dcfe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:52:29.660+0000 7f2dcfe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:52:29.660+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x7f2dc8076470 auth_method 0 2024-09-12T00:52:29.939 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:52:29.660+0000 7f2ee39e8640 10 monclient: get_auth_request con 0x55c3e6b77f40 auth_method 0 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:52:29.661+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x55c3e6b7b120 auth_method 0 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:52:29.663+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x55c3e6b801b0 auth_method 0 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 10 monclient: build_initial_monmap 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 1 build_initial for_mkfs: 0 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 10 monclient: monmap: 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:52:29.940 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding auth protocol: cephx 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding auth protocol: cephx 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding auth protocol: cephx 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.941 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command objecter_requests cmddesc objecter_requests hook 0x55c3e6b87c40 EEXIST 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient: init 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding auth protocol: cephx 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding auth protocol: cephx 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding auth protocol: cephx 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.942 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command rotate-key cmddesc rotate-key hook 0x55c3e6b83330 EEXIST 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-c con 0x55c3e6bb1880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:52:29.943 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-b con 0x55c3e6baa270 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-a con 0x55c3e6bacd80 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): authenticate will time out at 2102.934793s 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request con 0x55c3e6bacd80 auth_method 0 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request con 0x55c3e6bb1880 auth_method 0 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.944 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:52:29.664+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request con 0x55c3e6baa270 auth_method 0 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.945 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:52:29.665+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_done global_id 8115 payload 824 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:52:29.665+0000 7f2ee39e8640 10 monclient: _finish_hunting 0 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:52:29.665+0000 7f2ee39e8640 1 monclient: found mon.noname-a 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:52:29.665+0000 7f2ee39e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: dump: 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.946 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: _finish_auth 0 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: _check_auth_tickets 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 5 monclient: authenticate success, global_id 8115 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: dump: 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.947 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:52:29.665+0000 7f2ee41e9640 4 set_mon_vals no callback set 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:52:29.667+0000 7f2dcd602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:52:29.667+0000 7f2dcd602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:29.948 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:52:29.667+0000 7f2dcd602640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:52:29.667+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x7f2dbc0763b0 auth_method 0 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 10 monclient: get_monmap_and_config 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 10 monclient: build_initial_monmap 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 1 build_initial for_mkfs: 0 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 10 monclient: monmap: 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:52:29.949 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding auth protocol: cephx 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding auth protocol: cephx 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding auth protocol: cephx 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:29.950 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient: init 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding auth protocol: cephx 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding auth protocol: cephx 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding auth protocol: cephx 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:29.951 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:29.952 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:29.952 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:29.952 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:29.952 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:29.952 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:29.952 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:29.952 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.952 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.952 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command rotate-key cmddesc rotate-key hook 0x7fff018616c8 EEXIST 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-b con 0x55c3e6c00de0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-c con 0x55c3e6bfc1d0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-a con 0x55c3e6bf29e0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): authenticate will time out at 2102.938624s 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request con 0x55c3e6bf29e0 auth_method 0 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.953 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request con 0x55c3e6bfc1d0 auth_method 0 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:52:29.668+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request con 0x55c3e6c00de0 auth_method 0 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:52:29.668+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:52:29.668+0000 7f2ee31e7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.954 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:52:29.668+0000 7f2ee31e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_done global_id 8118 payload 274 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient: _finish_hunting 0 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 1 monclient: found mon.noname-a 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: dump: 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.955 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: dump: 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.956 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 monclient: authenticate success, global_id 8118 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 4 set_mon_vals no callback set 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 10 monclient: shutdown 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 10 monclient: build_initial_monmap 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 1 build_initial for_mkfs: 0 2024-09-12T00:52:29.957 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 10 monclient: monmap: 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding auth protocol: cephx 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding auth protocol: cephx 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding auth protocol: cephx 2024-09-12T00:52:29.958 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 1 librados: starting msgr at 2024-09-12T00:52:29.959 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 1 librados: starting objecter 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command objecter_requests cmddesc objecter_requests hook 0x55c3e6c01390 EEXIST 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 1 librados: setting wanted keys 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 1 librados: calling monclient init 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient: init 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding auth protocol: cephx 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding auth protocol: cephx 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding auth protocol: cephx 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:29.960 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command rotate-key cmddesc rotate-key hook 0x55c3e69ba678 EEXIST 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:29.961 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-b con 0x55c3e6bf29e0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-c con 0x55c3e6bfc1d0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-a con 0x55c3e6c00de0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): authenticate will time out at 2102.940932s 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request con 0x55c3e6c00de0 auth_method 0 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.962 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request con 0x55c3e6bfc1d0 auth_method 0 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:52:29.671+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request con 0x55c3e6bf29e0 auth_method 0 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:52:29.671+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:52:29.671+0000 7f2ee31e7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.963 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:52:29.671+0000 7f2ee31e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_done global_id 8121 payload 824 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient: _finish_hunting 0 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 1 monclient: found mon.noname-a 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: dump: 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.964 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: dump: 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.965 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 5 monclient: authenticate success, global_id 8121 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:52:29.671+0000 7f2dc6ffd640 4 set_mon_vals no callback set 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.966 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 1 librados: init done 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cr dump hook 0x55c3e6bd0cc8 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:52:29.672+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:52:29.673+0000 7f2dc57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:52:29.673+0000 7f2dc57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:52:29.673+0000 7f2dc57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:52:29.673+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x7f2dac076470 auth_method 0 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:52:29.673+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x55c3e6c1a5c0 auth_method 0 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 realm 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.967 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:52:29.674+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x55c3e6c1e9a0 auth_method 0 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:52:29.675+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:52:29.675+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:52:29.675+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:52:29.676+0000 7f2ee7a16800 20 searching for the correct realm 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:52:29.676+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x55c3e6c23ab0 auth_method 0 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:52:29.676+0000 7f2ee39e8640 10 monclient: get_auth_request con 0x7f2ed806ba10 auth_method 0 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:52:29.678+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x7f2ed4020060 auth_method 0 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:52:29.678+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x7f2ed807e450 auth_method 0 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:52:29.679+0000 7f2ee29e6640 0 -- 172.21.15.83:0/435854245 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f2ed807e450 msgr2=0x7f2ed807e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:52:29.880+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x7f2ed807e450 auth_method 0 2024-09-12T00:52:29.968 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:52:29.883+0000 7f2ee39e8640 10 monclient: get_auth_request con 0x7f2ed407bbb0 auth_method 0 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:52:29.884+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x7f2edc09e040 auth_method 0 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:52:29.884+0000 7f2ee29e6640 0 -- 172.21.15.83:0/435854245 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55c3e6c1a5c0 msgr2=0x55c3e6c1ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:52:29.885+0000 7f2dc57fa640 1 client.8121.objecter ms_handle_reset 0x55c3e6c1a5c0 session 0x55c3e6c19f40 osd.6 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:52:29.885+0000 7f2dc57fa640 10 monclient: _renew_subs 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:52:29.885+0000 7f2dc57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:52:29.885+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x7f2dac086790 auth_method 0 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:52:29.888+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:29.969 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 zone default found 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 4 Realm: () 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:29.970 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 zonegroup default 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 started sync module instance, tier type = 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=0 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=1 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=2 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=3 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=4 2024-09-12T00:52:29.971 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=5 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=6 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:52:29.900+0000 7f2ee7a16800 20 add_watcher() i=7 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:52:29.900+0000 7f2ee7a16800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding auth protocol: cephx 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding auth protocol: cephx 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding auth protocol: cephx 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:29.972 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:52:29.901+0000 7f2d99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cache list hook 0x55c3e6bf7150 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cache inspect hook 0x55c3e6bf7150 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cache erase hook 0x55c3e6bf7150 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cache zap hook 0x55c3e6bf7150 2024-09-12T00:52:29.973 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 note: GC not initialized 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:52:29.902+0000 7f2d98fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command sync trace show hook 0x7f2ed40043a0 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command sync trace history hook 0x7f2ed40043a0 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command sync trace active hook 0x7f2ed40043a0 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command sync trace active_short hook 0x7f2ed40043a0 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 Filter name: none 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:52:29.902+0000 7f2d127fc640 20 reqs_thread_entry: start 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:52:29.974 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464426 cookie 94299878495952 notifier 8121 bl.length()=911 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:29.975 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.1 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.1 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.2 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.2 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.3 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.3 2024-09-12T00:52:29.976 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:52:29.911+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:52:29.911+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:52:29.913+0000 7f2ee7a16800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ee7a16800 time 2024-09-12T00:52:29.914542+0000 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2ee8b8c71a] 2024-09-12T00:52:29.977 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2ee8b8c8d8] 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3e49c3641] 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55c3e49d251b] 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c3e49d33e4] 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2ee7829590] 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:52:29.914+0000 7f2ee7a16800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f2ee7a16800 thread_name:radosgw-admin 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.978 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2ee783e6f0] 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2ee788b99c] 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2ee8b8c774] 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2ee8b8c8d8] 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3e49c3641] 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55c3e49d251b] 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c3e49d33e4] 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2ee7829590] 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:52:29.979 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:29.980 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:29.981 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:52:29.982 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:52:29.983 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:29.984 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:29.985 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2d127fc640 / http_manager 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2d98fe1640 / http_manager 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2d99fe3640 / rgw_dt_lg_renew 2024-09-12T00:52:29.986 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dc57fa640 / ms_dispatch 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dc6ffd640 / io_context_pool 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dcd602640 / ms_dispatch 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dcfe07640 / ms_dispatch 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dd160a640 / io_context_pool 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee29e6640 / msgr-worker-2 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee31e7640 / msgr-worker-1 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee39e8640 / msgr-worker-0 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee41e9640 / io_context_pool 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee7a16800 / radosgw-admin 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.147850.log 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:52:29.987 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: crc 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b352c0) adding con mode: secure 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 1 librados: starting msgr at 2024-09-12T00:52:29.988 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:52:29.656+0000 7f2ee7a16800 1 librados: starting objecter 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command objecter_requests hook 0x55c3e6b33a70 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 1 librados: setting wanted keys 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 1 librados: calling monclient init 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient: init 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding auth protocol: cephx 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding auth protocol: cephx 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding auth protocol: cephx 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.989 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: crc 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b2f890) adding con mode: secure 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command rotate-key hook 0x55c3e6b2f9d8 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-a con 0x55c3e69e7a10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-b con 0x55c3e6a72a30 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-c con 0x55c3e6a75880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:52:29.990 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:52:29.657+0000 7f2ee7a16800 10 monclient(hunting): authenticate will time out at 2102.927658s 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request con 0x55c3e69e7a10 auth_method 0 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request con 0x55c3e6a75880 auth_method 0 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.991 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:52:29.657+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:52:29.657+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request con 0x55c3e6a72a30 auth_method 0 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:52:29.657+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:52:29.657+0000 7f2ee29e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:52:29.657+0000 7f2ee29e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:52:29.657+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_done global_id 8112 payload 824 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:52:29.658+0000 7f2ee31e7640 10 monclient: _finish_hunting 0 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:52:29.658+0000 7f2ee31e7640 1 monclient: found mon.noname-a 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:52:29.658+0000 7f2ee31e7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.992 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: dump: 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: _finish_auth 0 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: _check_auth_tickets 2024-09-12T00:52:29.993 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:52:29.658+0000 7f2dcfe07640 10 monclient: dump: 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.994 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 5 monclient: authenticate success, global_id 8112 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:52:29.658+0000 7f2dd160a640 4 set_mon_vals no callback set 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:52:29.658+0000 7f2ee7a16800 1 librados: init done 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:52:29.660+0000 7f2dcfe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:52:29.660+0000 7f2dcfe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:52:29.660+0000 7f2dcfe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:52:29.660+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x7f2dc8076470 auth_method 0 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:52:29.660+0000 7f2ee39e8640 10 monclient: get_auth_request con 0x55c3e6b77f40 auth_method 0 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:52:29.661+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x55c3e6b7b120 auth_method 0 2024-09-12T00:52:29.995 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:52:29.663+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x55c3e6b801b0 auth_method 0 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 10 monclient: build_initial_monmap 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 1 build_initial for_mkfs: 0 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 10 monclient: monmap: 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:29.996 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding auth protocol: cephx 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding auth protocol: cephx 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding auth protocol: cephx 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: crc 2024-09-12T00:52:29.997 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:52:29.663+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b84230) adding con mode: secure 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command objecter_requests cmddesc objecter_requests hook 0x55c3e6b87c40 EEXIST 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient: init 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding auth protocol: cephx 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding auth protocol: cephx 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding auth protocol: cephx 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.998 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: crc 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6b831e8) adding con mode: secure 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command rotate-key cmddesc rotate-key hook 0x55c3e6b83330 EEXIST 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-c con 0x55c3e6bb1880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-b con 0x55c3e6baa270 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-a con 0x55c3e6bacd80 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:52:29.999 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:52:29.664+0000 7f2ee7a16800 10 monclient(hunting): authenticate will time out at 2102.934793s 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request con 0x55c3e6bacd80 auth_method 0 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request con 0x55c3e6bb1880 auth_method 0 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.000 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:52:29.664+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:52:29.664+0000 7f2ee31e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:52:29.664+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request con 0x55c3e6baa270 auth_method 0 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:52:29.665+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:52:29.665+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_done global_id 8115 payload 824 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:52:29.665+0000 7f2ee39e8640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.001 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:52:29.665+0000 7f2ee39e8640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:52:29.665+0000 7f2ee39e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: dump: 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:30.002 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 5 monclient: authenticate success, global_id 8115 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:52:29.665+0000 7f2dcd602640 10 monclient: dump: 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.003 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:52:29.665+0000 7f2ee41e9640 4 set_mon_vals no callback set 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:52:29.665+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:52:29.667+0000 7f2dcd602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:52:29.667+0000 7f2dcd602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:52:29.667+0000 7f2dcd602640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:52:29.667+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x7f2dbc0763b0 auth_method 0 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 10 monclient: get_monmap_and_config 2024-09-12T00:52:30.004 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 10 monclient: monmap: 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding auth protocol: cephx 2024-09-12T00:52:30.005 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding auth protocol: cephx 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding auth protocol: cephx 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: crc 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:52:29.667+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bcc8a0) adding con mode: secure 2024-09-12T00:52:30.006 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient: init 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding auth protocol: cephx 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding auth protocol: cephx 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding auth protocol: cephx 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:30.007 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: crc 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861580) adding con mode: secure 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command rotate-key cmddesc rotate-key hook 0x7fff018616c8 EEXIST 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-b con 0x55c3e6c00de0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-c con 0x55c3e6bfc1d0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-a con 0x55c3e6bf29e0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.008 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:52:29.668+0000 7f2ee7a16800 10 monclient(hunting): authenticate will time out at 2102.938624s 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request con 0x55c3e6bf29e0 auth_method 0 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request con 0x55c3e6bfc1d0 auth_method 0 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.009 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:52:29.668+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:52:29.668+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request con 0x55c3e6c00de0 auth_method 0 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:52:29.668+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:52:29.668+0000 7f2ee31e7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:52:29.668+0000 7f2ee31e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_done global_id 8118 payload 274 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:52:29.668+0000 7f2ee39e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: dump: 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:30.010 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.011 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:52:29.669+0000 7f2dc6ffd640 10 monclient: dump: 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:30.012 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 monclient: authenticate success, global_id 8118 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 4 set_mon_vals no callback set 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 10 monclient: shutdown 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 10 monclient: build_initial_monmap 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 1 build_initial for_mkfs: 0 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 10 monclient: monmap: 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:30.013 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding auth protocol: cephx 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding auth protocol: cephx 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding auth protocol: cephx 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:30.014 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: crc 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:52:29.669+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e6bf2e90) adding con mode: secure 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 1 librados: starting msgr at 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 1 librados: starting objecter 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command objecter_requests cmddesc objecter_requests hook 0x55c3e6c01390 EEXIST 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 1 librados: setting wanted keys 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 1 librados: calling monclient init 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient: init 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding auth protocol: cephx 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding auth protocol: cephx 2024-09-12T00:52:30.015 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding auth protocol: cephx 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: crc 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 AuthRegistry(0x55c3e69ba530) adding con mode: secure 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.016 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command rotate-key cmddesc rotate-key hook 0x55c3e69ba678 EEXIST 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-b con 0x55c3e6bf29e0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-c con 0x55c3e6bfc1d0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): picked mon.noname-a con 0x55c3e6c00de0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:52:29.670+0000 7f2ee7a16800 10 monclient(hunting): authenticate will time out at 2102.940932s 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request con 0x55c3e6c00de0 auth_method 0 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.017 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request con 0x55c3e6bfc1d0 auth_method 0 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:52:29.671+0000 7f2ee29e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:52:29.671+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request con 0x55c3e6bf29e0 auth_method 0 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:52:29.671+0000 7f2ee31e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:30.018 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:52:29.671+0000 7f2ee31e7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:52:29.671+0000 7f2ee31e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient(hunting): handle_auth_done global_id 8121 payload 824 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient: _finish_hunting 0 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 1 monclient: found mon.noname-a 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:52:29.671+0000 7f2ee39e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: dump: 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.019 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:52:29.671+0000 7f2dc57fa640 10 monclient: dump: 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.020 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 5 monclient: authenticate success, global_id 8121 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:52:29.671+0000 7f2dc6ffd640 4 set_mon_vals no callback set 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 10 monclient: _renew_subs 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 1 librados: init done 2024-09-12T00:52:30.021 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:52:29.671+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cr dump hook 0x55c3e6bd0cc8 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:52:29.672+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:52:29.673+0000 7f2dc57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:52:29.673+0000 7f2dc57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:52:29.673+0000 7f2dc57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:52:29.673+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x7f2dac076470 auth_method 0 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:52:29.673+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x55c3e6c1a5c0 auth_method 0 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 realm 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.022 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:52:29.674+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:52:29.674+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x55c3e6c1e9a0 auth_method 0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:52:29.675+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:52:29.675+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:52:29.675+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:52:29.676+0000 7f2ee7a16800 20 searching for the correct realm 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:52:29.676+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x55c3e6c23ab0 auth_method 0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:52:29.676+0000 7f2ee39e8640 10 monclient: get_auth_request con 0x7f2ed806ba10 auth_method 0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:52:29.678+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x7f2ed4020060 auth_method 0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:52:29.678+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x7f2ed807e450 auth_method 0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:52:29.679+0000 7f2ee29e6640 0 -- 172.21.15.83:0/435854245 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f2ed807e450 msgr2=0x7f2ed807e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:52:29.880+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x7f2ed807e450 auth_method 0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:52:29.883+0000 7f2ee39e8640 10 monclient: get_auth_request con 0x7f2ed407bbb0 auth_method 0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:52:29.884+0000 7f2ee31e7640 10 monclient: get_auth_request con 0x7f2edc09e040 auth_method 0 2024-09-12T00:52:30.023 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:52:29.884+0000 7f2ee29e6640 0 -- 172.21.15.83:0/435854245 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55c3e6c1a5c0 msgr2=0x55c3e6c1ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:52:29.885+0000 7f2dc57fa640 1 client.8121.objecter ms_handle_reset 0x55c3e6c1a5c0 session 0x55c3e6c19f40 osd.6 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:52:29.885+0000 7f2dc57fa640 10 monclient: _renew_subs 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:52:29.885+0000 7f2dc57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:52:29.885+0000 7f2ee29e6640 10 monclient: get_auth_request con 0x7f2dac086790 auth_method 0 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:52:29.888+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.024 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 zone default found 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 4 Realm: () 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 zonegroup default 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:52:29.889+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.025 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 started sync module instance, tier type = 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:52:29.890+0000 7f2ee7a16800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=0 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=1 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=2 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=3 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=4 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=5 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:52:29.899+0000 7f2ee7a16800 20 add_watcher() i=6 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:52:29.900+0000 7f2ee7a16800 20 add_watcher() i=7 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:52:29.900+0000 7f2ee7a16800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding auth protocol: cephx 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding auth protocol: cephx 2024-09-12T00:52:30.026 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding auth protocol: cephx 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: crc 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 AuthRegistry(0x7fff01861a60) adding con mode: secure 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:52:29.901+0000 7f2d99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.027 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cache list hook 0x55c3e6bf7150 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cache inspect hook 0x55c3e6bf7150 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cache erase hook 0x55c3e6bf7150 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command cache zap hook 0x55c3e6bf7150 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:52:29.901+0000 7f2ee7a16800 5 note: GC not initialized 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:52:29.902+0000 7f2d98fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command sync trace show hook 0x7f2ed40043a0 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command sync trace history hook 0x7f2ed40043a0 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command sync trace active hook 0x7f2ed40043a0 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 5 asok(0x55c3e6910630) register_command sync trace active_short hook 0x7f2ed40043a0 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:30.028 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 Filter name: none 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:52:29.902+0000 7f2d127fc640 20 reqs_thread_entry: start 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:52:29.902+0000 7f2ee7a16800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:30.029 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:52:29.903+0000 7f2ee7a16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:52:29.906+0000 7f2ee7a16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464426 cookie 94299878495952 notifier 8121 bl.length()=911 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:52:29.907+0000 7f2dc6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:52:29.907+0000 7f2ee7a16800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:52:30.030 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.1 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.1 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.2 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.2 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.3 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.3 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:52:29.910+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:52:29.911+0000 7f2ee7a16800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:52:29.911+0000 7f2ee7a16800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:52:29.913+0000 7f2ee7a16800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ee7a16800 time 2024-09-12T00:52:29.914542+0000 2024-09-12T00:52:30.031 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2ee8b8c71a] 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2ee8b8c8d8] 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3e49c3641] 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55c3e49d251b] 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c3e49d33e4] 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2ee7829590] 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:52:29.914+0000 7f2ee7a16800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:30.032 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f2ee7a16800 thread_name:radosgw-admin 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2ee783e6f0] 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2ee788b99c] 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2ee8b8c774] 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2ee8b8c8d8] 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c3e49c3641] 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55c3e49d251b] 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55c3e49d33e4] 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2ee7829590] 2024-09-12T00:52:30.033 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:30.034 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:30.035 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:52:30.036 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:52:30.037 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:30.038 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:30.039 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2d127fc640 / http_manager 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2d98fe1640 / http_manager 2024-09-12T00:52:30.040 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2d99fe3640 / rgw_dt_lg_renew 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dc57fa640 / ms_dispatch 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dc6ffd640 / io_context_pool 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dcd602640 / ms_dispatch 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dcfe07640 / ms_dispatch 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2dd160a640 / io_context_pool 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee29e6640 / msgr-worker-2 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee31e7640 / msgr-worker-1 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee39e8640 / msgr-worker-0 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee41e9640 / io_context_pool 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: 7f2ee7a16800 / radosgw-admin 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:52:29.916166Z_27c27863-1bf8-49dd-a2e2-c0a8c2f2a093/log 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:52:30.041 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:52:30.046 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.988+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.990+0000 7fd86eb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.990+0000 7fd86eb1f800 20 realm 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.990+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.990+0000 7fd86eb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.990+0000 7fd86eb1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.990+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.990+0000 7fd86eb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.990+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.991+0000 7fd86eb1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.991+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.991+0000 7fd86eb1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:30.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.991+0000 7fd86eb1f800 20 searching for the correct realm 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.995+0000 7fd86a80c640 0 -- 172.21.15.83:0/2695144439 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7fd85c0890c0 msgr2=0x7fd85c082910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:29.998+0000 7fd86a80c640 0 -- 172.21.15.83:0/2695144439 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x5568f9848ab0 msgr2=0x5568f984aea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.001+0000 7fd86eb1f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.001+0000 7fd86eb1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.001+0000 7fd86eb1f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.001+0000 7fd86eb1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.001+0000 7fd86eb1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.001+0000 7fd86eb1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.001+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.001+0000 7fd86eb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.001+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 zone default found 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 4 Realm: () 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 zonegroup default 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.002+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.003+0000 7fd86eb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.003+0000 7fd86eb1f800 20 started sync module instance, tier type = 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.003+0000 7fd86eb1f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.012+0000 7fd86eb1f800 20 add_watcher() i=0 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.012+0000 7fd86eb1f800 20 add_watcher() i=1 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.012+0000 7fd86eb1f800 20 add_watcher() i=2 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.012+0000 7fd86eb1f800 20 add_watcher() i=3 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.012+0000 7fd86eb1f800 20 add_watcher() i=4 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.012+0000 7fd86eb1f800 20 add_watcher() i=5 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.012+0000 7fd86eb1f800 20 add_watcher() i=6 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.013+0000 7fd86eb1f800 20 add_watcher() i=7 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.013+0000 7fd86eb1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.015+0000 7fd7217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.015+0000 7fd86eb1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.015+0000 7fd86eb1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:30.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.015+0000 7fd86eb1f800 5 note: GC not initialized 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.015+0000 7fd69bfff640 20 reqs_thread_entry: start 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.015+0000 7fd86eb1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.015+0000 7fd86eb1f800 20 Filter name: none 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.015+0000 7fd699ffb640 20 reqs_thread_entry: start 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.016+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.016+0000 7fd86eb1f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.016+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.016+0000 7fd86eb1f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.016+0000 7fd86eb1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.016+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.017+0000 7fd86eb1f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.017+0000 7fd86eb1f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.017+0000 7fd86eb1f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.017+0000 7fd86eb1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:30.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.018+0000 7fd7217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.020+0000 7fd86eb1f800 20 remove_watcher() i=0 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.020+0000 7fd86eb1f800 2 removed watcher, disabling cache 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.021+0000 7fd86eb1f800 20 remove_watcher() i=1 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.022+0000 7fd86eb1f800 20 remove_watcher() i=2 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.023+0000 7fd86eb1f800 20 remove_watcher() i=3 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.024+0000 7fd86eb1f800 20 remove_watcher() i=4 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.024+0000 7fd86eb1f800 20 remove_watcher() i=5 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.025+0000 7fd86eb1f800 20 remove_watcher() i=6 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.026+0000 7fd86eb1f800 20 remove_watcher() i=7 2024-09-12T00:52:30.052 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:30.053 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:52:30.053 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:52:30.077 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:30.077 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:30.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.114+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.116+0000 7f4e31e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.116+0000 7f4e31e20800 20 realm 2024-09-12T00:52:30.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.116+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.116+0000 7f4e31e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.116+0000 7f4e31e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:30.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.116+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.116+0000 7f4e31e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.116+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.117+0000 7f4e31e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.117+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.117+0000 7f4e31e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:30.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.117+0000 7f4e31e20800 20 searching for the correct realm 2024-09-12T00:52:30.121 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.120+0000 7f4e27fff640 0 -- 172.21.15.83:0/4026551497 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f4e18095e40 msgr2=0x7f4e18056760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.325+0000 7f4e3010b640 0 -- 172.21.15.83:0/4026551497 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56106c0463a0 msgr2=0x56106c048790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:30.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.329+0000 7f4e31e20800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:52:30.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.329+0000 7f4e31e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:30.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.329+0000 7f4e31e20800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:52:30.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.329+0000 7f4e31e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:30.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.329+0000 7f4e31e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:30.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.329+0000 7f4e31e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:30.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.329+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.330 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:30.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:30.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 20 zone default found 2024-09-12T00:52:30.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 4 Realm: () 2024-09-12T00:52:30.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:52:30.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:52:30.331 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:30.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 20 zonegroup default 2024-09-12T00:52:30.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.330+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.331+0000 7f4e31e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.331+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.331+0000 7f4e31e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.331+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.331+0000 7f4e31e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:30.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.331+0000 7f4e31e20800 20 started sync module instance, tier type = 2024-09-12T00:52:30.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.331+0000 7f4e31e20800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:52:30.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.339+0000 7f4e31e20800 20 add_watcher() i=0 2024-09-12T00:52:30.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.339+0000 7f4e31e20800 20 add_watcher() i=1 2024-09-12T00:52:30.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.339+0000 7f4e31e20800 20 add_watcher() i=2 2024-09-12T00:52:30.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.339+0000 7f4e31e20800 20 add_watcher() i=3 2024-09-12T00:52:30.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.339+0000 7f4e31e20800 20 add_watcher() i=4 2024-09-12T00:52:30.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.339+0000 7f4e31e20800 20 add_watcher() i=5 2024-09-12T00:52:30.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.339+0000 7f4e31e20800 20 add_watcher() i=6 2024-09-12T00:52:30.339 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.340+0000 7f4e31e20800 20 add_watcher() i=7 2024-09-12T00:52:30.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.340+0000 7f4e31e20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:30.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.342+0000 7f4ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.342+0000 7f4e31e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:30.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.342+0000 7f4e31e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:30.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.342+0000 7f4e31e20800 5 note: GC not initialized 2024-09-12T00:52:30.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.342+0000 7f4ce4fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:30.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.342+0000 7f4e31e20800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:30.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.342+0000 7f4e31e20800 20 Filter name: none 2024-09-12T00:52:30.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4c5e7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:30.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:30.343 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:30.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:52:30.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:52:30.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:52:30.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.343+0000 7f4e31e20800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:52:30.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.344+0000 7f4e31e20800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:52:30.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.344+0000 7f4e31e20800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:52:30.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.344+0000 7f4e31e20800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:52:30.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.344+0000 7f4e31e20800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:52:30.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.345+0000 7f4ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:30.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.347+0000 7f4e31e20800 20 remove_watcher() i=0 2024-09-12T00:52:30.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.347+0000 7f4e31e20800 2 removed watcher, disabling cache 2024-09-12T00:52:30.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.348+0000 7f4e31e20800 20 remove_watcher() i=1 2024-09-12T00:52:30.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.349+0000 7f4e31e20800 20 remove_watcher() i=2 2024-09-12T00:52:30.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.350+0000 7f4e31e20800 20 remove_watcher() i=3 2024-09-12T00:52:30.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.351+0000 7f4e31e20800 20 remove_watcher() i=4 2024-09-12T00:52:30.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.352+0000 7f4e31e20800 20 remove_watcher() i=5 2024-09-12T00:52:30.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.353+0000 7f4e31e20800 20 remove_watcher() i=6 2024-09-12T00:52:30.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:52:30.354+0000 7f4e31e20800 20 remove_watcher() i=7 2024-09-12T00:53:00.397 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:53:00.429 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:00.429 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:00.472 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.473+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.475+0000 7f462db35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.475+0000 7f462db35800 20 realm 2024-09-12T00:53:00.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.475+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.475+0000 7f462db35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.475+0000 7f462db35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:00.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.475+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.476+0000 7f462db35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.476+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.476+0000 7f462db35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:00.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.476+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.477+0000 7f462db35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:00.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.477+0000 7f462db35800 20 searching for the correct realm 2024-09-12T00:53:00.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.480+0000 7f4623fff640 0 -- 172.21.15.83:0/2029899897 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f4614085540 msgr2=0x7f461409a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:00.685 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.686+0000 7f462a0e5640 0 -- 172.21.15.83:0/2029899897 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5614ba539070 msgr2=0x5614ba53b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:00.690 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:00.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:00.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:00.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:00.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:00.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:00.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.691 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:00.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.691+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:00.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 20 zone default found 2024-09-12T00:53:00.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 4 Realm: () 2024-09-12T00:53:00.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:00.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:00.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:00.692 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 20 zonegroup default 2024-09-12T00:53:00.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.693 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.692+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.693+0000 7f462db35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.693+0000 7f462db35800 20 started sync module instance, tier type = 2024-09-12T00:53:00.694 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.693+0000 7f462db35800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:00.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.702+0000 7f462db35800 20 add_watcher() i=0 2024-09-12T00:53:00.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.702+0000 7f462db35800 20 add_watcher() i=1 2024-09-12T00:53:00.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.702+0000 7f462db35800 20 add_watcher() i=2 2024-09-12T00:53:00.701 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.702+0000 7f462db35800 20 add_watcher() i=3 2024-09-12T00:53:00.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.702+0000 7f462db35800 20 add_watcher() i=4 2024-09-12T00:53:00.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.702+0000 7f462db35800 20 add_watcher() i=5 2024-09-12T00:53:00.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.702+0000 7f462db35800 20 add_watcher() i=6 2024-09-12T00:53:00.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.704+0000 7f462db35800 20 add_watcher() i=7 2024-09-12T00:53:00.702 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.704+0000 7f462db35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:00.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.706+0000 7f44db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:00.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.706+0000 7f462db35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:00.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.706+0000 7f462db35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:00.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.706+0000 7f462db35800 5 note: GC not initialized 2024-09-12T00:53:00.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.707+0000 7f44da7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:00.707 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.707+0000 7f462db35800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:00.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.707+0000 7f462db35800 20 Filter name: none 2024-09-12T00:53:00.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.707+0000 7f444ffff640 20 reqs_thread_entry: start 2024-09-12T00:53:00.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.707+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.707+0000 7f462db35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:00.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.707+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.708+0000 7f462db35800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:53:00.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.708+0000 7f462db35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:00.708 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.708+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.708+0000 7f462db35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:00.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.708+0000 7f462db35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.708+0000 7f462db35800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:53:00.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.708+0000 7f462db35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:00.709 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.710+0000 7f44db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:00.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.712+0000 7f462db35800 20 remove_watcher() i=0 2024-09-12T00:53:00.711 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.712+0000 7f462db35800 2 removed watcher, disabling cache 2024-09-12T00:53:00.712 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.714+0000 7f462db35800 20 remove_watcher() i=1 2024-09-12T00:53:00.713 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.715+0000 7f462db35800 20 remove_watcher() i=2 2024-09-12T00:53:00.714 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.716+0000 7f462db35800 20 remove_watcher() i=3 2024-09-12T00:53:00.715 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.717+0000 7f462db35800 20 remove_watcher() i=4 2024-09-12T00:53:00.716 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.718+0000 7f462db35800 20 remove_watcher() i=5 2024-09-12T00:53:00.718 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.719+0000 7f462db35800 20 remove_watcher() i=6 2024-09-12T00:53:00.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.720+0000 7f462db35800 20 remove_watcher() i=7 2024-09-12T00:53:00.734 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:00.734 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:53:00.755 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:53:00.783 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:00.784 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:00.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.822+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.824+0000 7f4bce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.824+0000 7f4bce4bb800 20 realm 2024-09-12T00:53:00.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.824+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.824+0000 7f4bce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.824+0000 7f4bce4bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:00.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.824+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.825+0000 7f4bce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.823 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.825+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.825+0000 7f4bce4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:00.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.825+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.826+0000 7f4bce4bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:00.824 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.826+0000 7f4bce4bb800 20 searching for the correct realm 2024-09-12T00:53:00.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.828+0000 7f4bcbfa5640 0 -- 172.21.15.83:0/1292447725 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x55feb876f0b0 msgr2=0x55feb87714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:00.829 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:00.831+0000 7f4bcc7a6640 0 -- 172.21.15.83:0/1292447725 >> [v2:172.21.15.120:6816/3242240032,v1:172.21.15.120:6817/3242240032] conn(0x7f4bbc060040 msgr2=0x7f4bbc060930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.039 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.039+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:01.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 20 zone default found 2024-09-12T00:53:01.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 4 Realm: () 2024-09-12T00:53:01.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:01.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:01.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:01.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 20 zonegroup default 2024-09-12T00:53:01.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.040+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.041+0000 7f4bce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.041+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.041+0000 7f4bce4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.041+0000 7f4bce4bb800 20 started sync module instance, tier type = 2024-09-12T00:53:01.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.041+0000 7f4bce4bb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:01.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.051+0000 7f4bce4bb800 20 add_watcher() i=0 2024-09-12T00:53:01.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.051+0000 7f4bce4bb800 20 add_watcher() i=1 2024-09-12T00:53:01.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.051+0000 7f4bce4bb800 20 add_watcher() i=2 2024-09-12T00:53:01.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.051+0000 7f4bce4bb800 20 add_watcher() i=3 2024-09-12T00:53:01.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.051+0000 7f4bce4bb800 20 add_watcher() i=4 2024-09-12T00:53:01.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.051+0000 7f4bce4bb800 20 add_watcher() i=5 2024-09-12T00:53:01.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.051+0000 7f4bce4bb800 20 add_watcher() i=6 2024-09-12T00:53:01.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.052+0000 7f4bce4bb800 20 add_watcher() i=7 2024-09-12T00:53:01.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.052+0000 7f4bce4bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:01.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.054+0000 7f4a81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.054+0000 7f4bce4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.054+0000 7f4bce4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.054+0000 7f4bce4bb800 5 note: GC not initialized 2024-09-12T00:53:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.054+0000 7f4a80fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.054+0000 7f4bce4bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.054+0000 7f4bce4bb800 20 Filter name: none 2024-09-12T00:53:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f49fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:01.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:01.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.055+0000 7f4bce4bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.056+0000 7f4bce4bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:53:01.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.056+0000 7f4bce4bb800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:53:01.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.056+0000 7f4bce4bb800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:53:01.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.056+0000 7f4bce4bb800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:53:01.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.056+0000 7f4bce4bb800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:53:01.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.056+0000 7f4bce4bb800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:53:01.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.056+0000 7f4bce4bb800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:53:01.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.057+0000 7f4a81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.059+0000 7f4bce4bb800 20 remove_watcher() i=0 2024-09-12T00:53:01.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.059+0000 7f4bce4bb800 2 removed watcher, disabling cache 2024-09-12T00:53:01.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.060+0000 7f4bce4bb800 20 remove_watcher() i=1 2024-09-12T00:53:01.060 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.061+0000 7f4bce4bb800 20 remove_watcher() i=2 2024-09-12T00:53:01.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.062+0000 7f4bce4bb800 20 remove_watcher() i=3 2024-09-12T00:53:01.061 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.063+0000 7f4bce4bb800 20 remove_watcher() i=4 2024-09-12T00:53:01.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.064+0000 7f4bce4bb800 20 remove_watcher() i=5 2024-09-12T00:53:01.064 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.065+0000 7f4bce4bb800 20 remove_watcher() i=6 2024-09-12T00:53:01.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.066+0000 7f4bce4bb800 20 remove_watcher() i=7 2024-09-12T00:53:01.076 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:53:01.105 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:01.105 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:01.141 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.142+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.144+0000 7fa9c4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.144+0000 7fa9c4e40800 20 realm 2024-09-12T00:53:01.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.144+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.145+0000 7fa9c4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.143 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.145+0000 7fa9c4e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.145+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.145+0000 7fa9c4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.145+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.145+0000 7fa9c4e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.144 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.145+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.146+0000 7fa9c4e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.145 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.146+0000 7fa9c4e40800 20 searching for the correct realm 2024-09-12T00:53:01.147 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.149+0000 7fa9bbfff640 0 -- 172.21.15.83:0/3536458600 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fa9ac02dc10 msgr2=0x7fa9ac067450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:01.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.355+0000 7fa9c312b640 0 -- 172.21.15.83:0/3536458600 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55cc0e638e10 msgr2=0x55cc0e63b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:01.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:01.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:01.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:01.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:01.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:01.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:01.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 zone default found 2024-09-12T00:53:01.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 4 Realm: () 2024-09-12T00:53:01.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.359+0000 7fa9c4e40800 20 zonegroup default 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.360+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.360+0000 7fa9c4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.360+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.360+0000 7fa9c4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.360+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.360+0000 7fa9c4e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.360+0000 7fa9c4e40800 20 started sync module instance, tier type = 2024-09-12T00:53:01.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.360+0000 7fa9c4e40800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:01.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.369+0000 7fa9c4e40800 20 add_watcher() i=0 2024-09-12T00:53:01.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.369+0000 7fa9c4e40800 20 add_watcher() i=1 2024-09-12T00:53:01.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.369+0000 7fa9c4e40800 20 add_watcher() i=2 2024-09-12T00:53:01.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.369+0000 7fa9c4e40800 20 add_watcher() i=3 2024-09-12T00:53:01.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.369+0000 7fa9c4e40800 20 add_watcher() i=4 2024-09-12T00:53:01.368 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.369+0000 7fa9c4e40800 20 add_watcher() i=5 2024-09-12T00:53:01.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.369+0000 7fa9c4e40800 20 add_watcher() i=6 2024-09-12T00:53:01.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.370+0000 7fa9c4e40800 20 add_watcher() i=7 2024-09-12T00:53:01.369 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.370+0000 7fa9c4e40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:01.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.372+0000 7fa8797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.373+0000 7fa9c4e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:01.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.373+0000 7fa9c4e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:01.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.373+0000 7fa9c4e40800 5 note: GC not initialized 2024-09-12T00:53:01.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.373+0000 7fa7f3fff640 20 reqs_thread_entry: start 2024-09-12T00:53:01.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.373+0000 7fa9c4e40800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:01.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.373+0000 7fa9c4e40800 20 Filter name: none 2024-09-12T00:53:01.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.373+0000 7fa7f1ffb640 20 reqs_thread_entry: start 2024-09-12T00:53:01.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.373+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.374+0000 7fa9c4e40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.374+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.374+0000 7fa9c4e40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:53:01.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.374+0000 7fa9c4e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:01.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.374+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.374+0000 7fa9c4e40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.374+0000 7fa9c4e40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.375+0000 7fa9c4e40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:53:01.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.375+0000 7fa9c4e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:01.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.376+0000 7fa8797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.378+0000 7fa9c4e40800 20 remove_watcher() i=0 2024-09-12T00:53:01.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.378+0000 7fa9c4e40800 2 removed watcher, disabling cache 2024-09-12T00:53:01.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.379+0000 7fa9c4e40800 20 remove_watcher() i=1 2024-09-12T00:53:01.379 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.381+0000 7fa9c4e40800 20 remove_watcher() i=2 2024-09-12T00:53:01.380 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.382+0000 7fa9c4e40800 20 remove_watcher() i=3 2024-09-12T00:53:01.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.383+0000 7fa9c4e40800 20 remove_watcher() i=4 2024-09-12T00:53:01.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.384+0000 7fa9c4e40800 20 remove_watcher() i=5 2024-09-12T00:53:01.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.385+0000 7fa9c4e40800 20 remove_watcher() i=6 2024-09-12T00:53:01.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.386+0000 7fa9c4e40800 20 remove_watcher() i=7 2024-09-12T00:53:01.395 INFO:tasks.workunit.client.0.smithi083.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:53:01.396 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:53:01.425 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:01.425 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:01.461 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.462+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.464+0000 7f4cd5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.464+0000 7f4cd5746800 20 realm 2024-09-12T00:53:01.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.464+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.464+0000 7f4cd5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.464+0000 7f4cd5746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.464+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.464+0000 7f4cd5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.463 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.464+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.465+0000 7f4cd5746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.465+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.465+0000 7f4cd5746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.464 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.465+0000 7f4cd5746800 20 searching for the correct realm 2024-09-12T00:53:01.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.469+0000 7f4cd3a31640 0 -- 172.21.15.83:0/512582027 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f4cc802e070 msgr2=0x7f4cc8046430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:01.471 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.472+0000 7f4cd3230640 0 -- 172.21.15.83:0/512582027 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f4ccc020040 msgr2=0x7f4ccc020420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.476+0000 7f4cd5746800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:01.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.476+0000 7f4cd5746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:01.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.476+0000 7f4cd5746800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:01.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.476+0000 7f4cd5746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:01.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.476+0000 7f4cd5746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:01.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.476+0000 7f4cd5746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:01.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.476+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.476 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 zone default found 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 4 Realm: () 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 zonegroup default 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.477 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.477+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.478+0000 7f4cd5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.478+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.478+0000 7f4cd5746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.478+0000 7f4cd5746800 20 started sync module instance, tier type = 2024-09-12T00:53:01.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.478+0000 7f4cd5746800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:01.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.487+0000 7f4cd5746800 20 add_watcher() i=0 2024-09-12T00:53:01.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.487+0000 7f4cd5746800 20 add_watcher() i=1 2024-09-12T00:53:01.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.487+0000 7f4cd5746800 20 add_watcher() i=2 2024-09-12T00:53:01.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.487+0000 7f4cd5746800 20 add_watcher() i=3 2024-09-12T00:53:01.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.487+0000 7f4cd5746800 20 add_watcher() i=4 2024-09-12T00:53:01.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.487+0000 7f4cd5746800 20 add_watcher() i=5 2024-09-12T00:53:01.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.487+0000 7f4cd5746800 20 add_watcher() i=6 2024-09-12T00:53:01.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.488+0000 7f4cd5746800 20 add_watcher() i=7 2024-09-12T00:53:01.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.488+0000 7f4cd5746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:01.488 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.489+0000 7f4b89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.490+0000 7f4cd5746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.490+0000 7f4cd5746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.490+0000 7f4cd5746800 5 note: GC not initialized 2024-09-12T00:53:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.490+0000 7f4b88fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.490+0000 7f4cd5746800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.490+0000 7f4cd5746800 20 Filter name: none 2024-09-12T00:53:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.490+0000 7f4b027fc640 20 reqs_thread_entry: start 2024-09-12T00:53:01.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.490+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.491+0000 7f4cd5746800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.491+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.491+0000 7f4cd5746800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:53:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.491+0000 7f4cd5746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.491+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.491+0000 7f4cd5746800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.491+0000 7f4cd5746800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.492+0000 7f4cd5746800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:53:01.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.492+0000 7f4cd5746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:01.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.493+0000 7f4b89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.495+0000 7f4cd5746800 20 remove_watcher() i=0 2024-09-12T00:53:01.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.495+0000 7f4cd5746800 2 removed watcher, disabling cache 2024-09-12T00:53:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.496+0000 7f4cd5746800 20 remove_watcher() i=1 2024-09-12T00:53:01.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.497+0000 7f4cd5746800 20 remove_watcher() i=2 2024-09-12T00:53:01.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.498+0000 7f4cd5746800 20 remove_watcher() i=3 2024-09-12T00:53:01.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.499+0000 7f4cd5746800 20 remove_watcher() i=4 2024-09-12T00:53:01.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.500+0000 7f4cd5746800 20 remove_watcher() i=5 2024-09-12T00:53:01.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.501+0000 7f4cd5746800 20 remove_watcher() i=6 2024-09-12T00:53:01.500 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.502+0000 7f4cd5746800 20 remove_watcher() i=7 2024-09-12T00:53:01.511 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.511 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:53:01.511 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: ad4424e4-de7c-4376-b125-e717016a3484.4511.18 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T00:53:01.511 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.512 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:53:01.545 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:01.546 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:01.582 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.583+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.585+0000 7fddacd35800 20 realm 2024-09-12T00:53:01.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.585+0000 7fddacd35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.584 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.587+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.585 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.587+0000 7fddacd35800 20 searching for the correct realm 2024-09-12T00:53:01.588 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.590+0000 7fdda3fff640 0 -- 172.21.15.83:0/3762241296 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fdd940a5900 msgr2=0x7fdd940e60b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.593+0000 7fdda92e5640 0 -- 172.21.15.83:0/3762241296 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f1257e99e0 msgr2=0x55f1257ebe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:01.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:01.595 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:01.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:01.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:01.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:01.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.596+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.596 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:01.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 20 zone default found 2024-09-12T00:53:01.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 4 Realm: () 2024-09-12T00:53:01.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:01.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:01.597 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:01.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 20 zonegroup default 2024-09-12T00:53:01.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.598+0000 7fddacd35800 20 started sync module instance, tier type = 2024-09-12T00:53:01.598 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.598+0000 7fddacd35800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:01.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=0 2024-09-12T00:53:01.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=1 2024-09-12T00:53:01.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=2 2024-09-12T00:53:01.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=3 2024-09-12T00:53:01.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=4 2024-09-12T00:53:01.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=5 2024-09-12T00:53:01.605 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=6 2024-09-12T00:53:01.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.607+0000 7fddacd35800 20 add_watcher() i=7 2024-09-12T00:53:01.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.607+0000 7fddacd35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:01.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.609+0000 7fdc5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.609+0000 7fddacd35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:01.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.609+0000 7fddacd35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:01.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.609+0000 7fddacd35800 5 note: GC not initialized 2024-09-12T00:53:01.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.609+0000 7fdc5e7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:01.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.609+0000 7fddacd35800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:01.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 20 Filter name: none 2024-09-12T00:53:01.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fdc57fff640 20 reqs_thread_entry: start 2024-09-12T00:53:01.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:01.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.610+0000 7fddacd35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:53:01.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fddacd35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fddacd35800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fddacd35800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fddacd35800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:53:01.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464428 cookie 94494204592448 notifier 8250 bl.length()=911 2024-09-12T00:53:01.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:53:01.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:53:01.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:53:01.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:53:01.615 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fddacd35800 time 2024-09-12T00:53:01.618233+0000 2024-09-12T00:53:01.615 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:01.616 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:01.616 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fddae58c71a] 2024-09-12T00:53:01.616 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fddae58c8d8] 2024-09-12T00:53:01.616 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f12349a641] 2024-09-12T00:53:01.616 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1234aa38a] 2024-09-12T00:53:01.616 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:53:01.617 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fddad229590] 2024-09-12T00:53:01.617 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:53:01.617 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:53:01.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.618+0000 7fddacd35800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fddacd35800 time 2024-09-12T00:53:01.618233+0000 2024-09-12T00:53:01.617 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:01.617 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.617 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:01.617 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fddae58c71a] 2024-09-12T00:53:01.617 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fddae58c8d8] 2024-09-12T00:53:01.618 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f12349a641] 2024-09-12T00:53:01.618 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1234aa38a] 2024-09-12T00:53:01.618 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:53:01.618 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fddad229590] 2024-09-12T00:53:01.618 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:53:01.618 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:53:01.618 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.618 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:53:01.618 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fddacd35800 thread_name:radosgw-admin 2024-09-12T00:53:01.637 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:01.637 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fddad23e6f0] 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fddad28b99c] 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fddae58c774] 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fddae58c8d8] 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f12349a641] 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1234aa38a] 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fddad229590] 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:53:01.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.618+0000 7fddacd35800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:01.639 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fddacd35800 thread_name:radosgw-admin 2024-09-12T00:53:01.639 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.639 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:01.639 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fddad23e6f0] 2024-09-12T00:53:01.639 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fddad28b99c] 2024-09-12T00:53:01.639 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:53:01.639 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fddae58c774] 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fddae58c8d8] 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f12349a641] 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1234aa38a] 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fddad229590] 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:53:01.640 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:53:01.567+0000 7fddacd35800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:53:01.567+0000 7fddacd35800 4 set_mon_vals no callback set 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:53:01.567+0000 7fdc96e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:53:01.567+0000 7fdc96e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:53:01.567+0000 7fdc96e05640 10 monclient: dump: 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.641 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:53:01.567+0000 7fddacd35800 10 monclient: shutdown 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:53:01.567+0000 7fddacd35800 5 asok(0x55f1254de630) unregister_commands rotate-key 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:53:01.568+0000 7fddacd35800 10 monclient: build_initial_monmap 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 build_initial for_mkfs: 0 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:53:01.568+0000 7fddacd35800 10 monclient: monmap: 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:01.642 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:01.643 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:01.643 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.643 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:01.643 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:01.643 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:01.643 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.643 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding auth protocol: cephx 2024-09-12T00:53:01.643 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding auth protocol: cephx 2024-09-12T00:53:01.643 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding auth protocol: cephx 2024-09-12T00:53:01.644 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.644 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.644 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.644 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.644 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.644 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.644 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.644 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.645 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.645 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.645 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.645 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.645 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:53:01.568+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.645 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 librados: starting msgr at 2024-09-12T00:53:01.645 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 librados: starting objecter 2024-09-12T00:53:01.646 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 asok(0x55f1254de630) register_command objecter_requests hook 0x55f125700170 2024-09-12T00:53:01.646 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 librados: setting wanted keys 2024-09-12T00:53:01.646 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 librados: calling monclient init 2024-09-12T00:53:01.646 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:53:01.568+0000 7fddacd35800 10 monclient: init 2024-09-12T00:53:01.646 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding auth protocol: cephx 2024-09-12T00:53:01.646 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding auth protocol: cephx 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding auth protocol: cephx 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.647 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:53:01.568+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.648 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:53:01.568+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.648 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 asok(0x55f1254de630) register_command rotate-key hook 0x55f1256fdc78 2024-09-12T00:53:01.648 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:53:01.568+0000 7fddacd35800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:01.648 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:53:01.648 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-b con 0x55f1255b5a10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:01.648 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-a con 0x55f125641140 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:01.649 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-c con 0x55f125643880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:01.649 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.649 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.649 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.649 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:01.649 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): authenticate will time out at 2134.838045s 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): get_auth_request con 0x55f125641140 auth_method 0 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): get_auth_request con 0x55f125643880 auth_method 0 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.650 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:53:01.569+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request con 0x55f1255b5a10 auth_method 0 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:53:01.569+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:53:01.569+0000 7fdda8ae4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:53:01.569+0000 7fdda8ae4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): handle_auth_done global_id 8241 payload 824 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient: _finish_hunting 0 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:53:01.569+0000 7fdda3fff640 1 monclient: found mon.noname-a 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.651 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: dump: 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.652 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: _finish_auth 0 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: _check_auth_tickets 2024-09-12T00:53:01.653 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:01.654 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.654 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:01.654 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: dump: 2024-09-12T00:53:01.654 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.654 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.654 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.654 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:53:01.569+0000 7fddacd35800 5 monclient: authenticate success, global_id 8241 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:53:01.569+0000 7fdc96e05640 4 set_mon_vals no callback set 2024-09-12T00:53:01.655 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:53:01.569+0000 7fddacd35800 1 librados: init done 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:53:01.571+0000 7fdc95602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:53:01.571+0000 7fdc95602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:53:01.571+0000 7fdc95602640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:53:01.571+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x7fdc90076470 auth_method 0 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:53:01.572+0000 7fdda92e5640 10 monclient: get_auth_request con 0x55f1257272b0 auth_method 0 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:53:01.572+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x55f12574a3f0 auth_method 0 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:53:01.574+0000 7fdda3fff640 10 monclient: get_auth_request con 0x55f12574dc50 auth_method 0 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:53:01.574+0000 7fddacd35800 10 monclient: build_initial_monmap 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:53:01.574+0000 7fddacd35800 1 build_initial for_mkfs: 0 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:53:01.574+0000 7fddacd35800 10 monclient: monmap: 2024-09-12T00:53:01.656 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:01.657 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:01.657 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:01.657 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:01.657 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:01.657 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.657 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:01.657 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:01.657 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:01.657 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding auth protocol: cephx 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding auth protocol: cephx 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding auth protocol: cephx 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.658 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.659 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.659 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.659 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:53:01.574+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.659 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 asok(0x55f1254de630) register_command objecter_requests cmddesc objecter_requests hook 0x55f125756a00 EEXIST 2024-09-12T00:53:01.659 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient: init 2024-09-12T00:53:01.659 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding auth protocol: cephx 2024-09-12T00:53:01.659 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding auth protocol: cephx 2024-09-12T00:53:01.659 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding auth protocol: cephx 2024-09-12T00:53:01.660 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.660 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.660 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.660 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.660 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.660 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.661 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.661 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.661 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.661 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.661 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.661 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.661 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:53:01.575+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.661 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:53:01.575+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.662 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 asok(0x55f1254de630) register_command rotate-key cmddesc rotate-key hook 0x55f1257525f0 EEXIST 2024-09-12T00:53:01.662 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:01.662 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:53:01.662 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-b con 0x55f12577ad20 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:01.662 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-c con 0x55f12577b100 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:01.662 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-a con 0x55f125779a30 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:01.662 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.662 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.662 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.663 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:01.663 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): authenticate will time out at 2134.844739s 2024-09-12T00:53:01.663 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): get_auth_request con 0x55f12577b100 auth_method 0 2024-09-12T00:53:01.663 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.663 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.663 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): get_auth_request con 0x55f125779a30 auth_method 0 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:53:01.575+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request con 0x55f12577ad20 auth_method 0 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:53:01.575+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:53:01.575+0000 7fdda8ae4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:53:01.575+0000 7fdda8ae4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.664 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.665 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:53:01.576+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.665 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:53:01.576+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.665 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:53:01.576+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.665 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:53:01.576+0000 7fdda3fff640 10 monclient(hunting): handle_auth_done global_id 7766 payload 824 2024-09-12T00:53:01.665 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:53:01.576+0000 7fdda3fff640 10 monclient: _finish_hunting 0 2024-09-12T00:53:01.665 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:53:01.576+0000 7fdda3fff640 1 monclient: found mon.noname-c 2024-09-12T00:53:01.665 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:53:01.576+0000 7fdda3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:01.665 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.666 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:01.666 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: dump: 2024-09-12T00:53:01.666 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.666 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.666 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.666 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.666 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.666 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.667 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.667 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.667 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.667 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.667 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:53:01.667 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:53:01.667 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:01.667 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.667 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:01.668 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: dump: 2024-09-12T00:53:01.668 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.668 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.668 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.668 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.668 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.669 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.669 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.669 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.669 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.669 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.669 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:53:01.576+0000 7fddacd35800 5 monclient: authenticate success, global_id 7766 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:53:01.576+0000 7fdda9ae6640 4 set_mon_vals no callback set 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:53:01.576+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:53:01.576+0000 7fddacd35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:53:01.576+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:53:01.576+0000 7fddacd35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:53:01.578+0000 7fdc8e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:53:01.578+0000 7fdc8e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:53:01.578+0000 7fdc8e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:53:01.578+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x7fdc80076380 auth_method 0 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:53:01.578+0000 7fddacd35800 10 monclient: get_monmap_and_config 2024-09-12T00:53:01.670 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:53:01.578+0000 7fddacd35800 10 monclient: build_initial_monmap 2024-09-12T00:53:01.671 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:53:01.578+0000 7fddacd35800 1 build_initial for_mkfs: 0 2024-09-12T00:53:01.671 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:53:01.578+0000 7fddacd35800 10 monclient: monmap: 2024-09-12T00:53:01.671 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:01.671 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:01.671 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:01.671 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:01.671 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:01.671 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.671 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:01.672 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:01.672 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:01.672 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.672 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding auth protocol: cephx 2024-09-12T00:53:01.672 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding auth protocol: cephx 2024-09-12T00:53:01.672 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding auth protocol: cephx 2024-09-12T00:53:01.672 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.672 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.672 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:53:01.578+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:53:01.578+0000 7fddacd35800 10 monclient: init 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding auth protocol: cephx 2024-09-12T00:53:01.673 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding auth protocol: cephx 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding auth protocol: cephx 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:53:01.579+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.674 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:53:01.579+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.675 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:53:01.579+0000 7fddacd35800 5 asok(0x55f1254de630) register_command rotate-key cmddesc rotate-key hook 0x7ffe3178b8d8 EEXIST 2024-09-12T00:53:01.675 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:01.675 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:53:01.675 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-b con 0x55f12579e980 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:01.675 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-a con 0x55f1257c93f0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:01.675 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-c con 0x55f1257ca7a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:01.675 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.675 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.676 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.676 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:01.676 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): authenticate will time out at 2134.848424s 2024-09-12T00:53:01.676 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): get_auth_request con 0x55f1257ca7a0 auth_method 0 2024-09-12T00:53:01.676 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.677 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.677 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.677 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): get_auth_request con 0x55f1257c93f0 auth_method 0 2024-09-12T00:53:01.677 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.677 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.677 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.677 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.677 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.677 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.678 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.678 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.678 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.678 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): handle_auth_done global_id 7769 payload 274 2024-09-12T00:53:01.678 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient: _finish_hunting 0 2024-09-12T00:53:01.678 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:53:01.579+0000 7fdda92e5640 1 monclient: found mon.noname-c 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: dump: 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.679 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: _finish_auth 0 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:53:01.580+0000 7fdc7ffff640 10 monclient: dump: 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.680 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 monclient: authenticate success, global_id 7769 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:53:01.580+0000 7fddacd35800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:53:01.580+0000 7fddacd35800 4 set_mon_vals no callback set 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:53:01.580+0000 7fddacd35800 10 monclient: shutdown 2024-09-12T00:53:01.681 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:53:01.580+0000 7fddacd35800 10 monclient: build_initial_monmap 2024-09-12T00:53:01.682 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:53:01.580+0000 7fddacd35800 1 build_initial for_mkfs: 0 2024-09-12T00:53:01.682 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:53:01.580+0000 7fddacd35800 10 monclient: monmap: 2024-09-12T00:53:01.682 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:01.682 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:01.682 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:01.682 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding auth protocol: cephx 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding auth protocol: cephx 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding auth protocol: cephx 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.683 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.684 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.684 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.684 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.684 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.684 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.684 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.684 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:53:01.580+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:53:01.580+0000 7fddacd35800 1 librados: starting msgr at 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:53:01.580+0000 7fddacd35800 1 librados: starting objecter 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 asok(0x55f1254de630) register_command objecter_requests cmddesc objecter_requests hook 0x55f125779160 EEXIST 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:53:01.581+0000 7fddacd35800 1 librados: setting wanted keys 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:53:01.581+0000 7fddacd35800 1 librados: calling monclient init 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient: init 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding auth protocol: cephx 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding auth protocol: cephx 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding auth protocol: cephx 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.685 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:53:01.581+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:53:01.581+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 asok(0x55f1254de630) register_command rotate-key cmddesc rotate-key hook 0x55f12578f728 EEXIST 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:53:01.686 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-a con 0x55f12579e980 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-b con 0x55f1257ca7a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-c con 0x55f1257bcba0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): authenticate will time out at 2134.850675s 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request con 0x55f12579e980 auth_method 0 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): get_auth_request con 0x55f1257bcba0 auth_method 0 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.687 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.688 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.688 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.688 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.688 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): get_auth_request con 0x55f1257ca7a0 auth_method 0 2024-09-12T00:53:01.688 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.688 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.688 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:53:01.582+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:53:01.582+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:53:01.582+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_done global_id 8250 payload 824 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:53:01.582+0000 7fdda8ae4640 10 monclient: _finish_hunting 0 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:53:01.582+0000 7fdda8ae4640 1 monclient: found mon.noname-a 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:53:01.582+0000 7fdda8ae4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.689 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: dump: 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.690 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.691 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.691 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.691 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:53:01.691 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:53:01.691 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:53:01.582+0000 7fddacd35800 5 monclient: authenticate success, global_id 8250 2024-09-12T00:53:01.691 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:01.691 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: dump: 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:53:01.582+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.692 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:53:01.582+0000 7fdc7ffff640 4 set_mon_vals no callback set 2024-09-12T00:53:01.693 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:53:01.582+0000 7fddacd35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.693 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:53:01.582+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.693 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:53:01.582+0000 7fddacd35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.693 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:53:01.582+0000 7fddacd35800 1 librados: init done 2024-09-12T00:53:01.693 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:53:01.582+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cr dump hook 0x55f1257bd038 2024-09-12T00:53:01.693 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:53:01.583+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.693 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:53:01.584+0000 7fdc7e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:01.693 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:53:01.584+0000 7fdc7e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.693 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:53:01.584+0000 7fdc7e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.694 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:53:01.584+0000 7fdda3fff640 10 monclient: get_auth_request con 0x7fdc74076470 auth_method 0 2024-09-12T00:53:01.694 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:53:01.585+0000 7fdda92e5640 10 monclient: get_auth_request con 0x55f1257e99e0 auth_method 0 2024-09-12T00:53:01.694 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.694 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 realm 2024-09-12T00:53:01.694 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.694 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.694 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:53:01.585+0000 7fddacd35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.694 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.694 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.695 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.695 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:53:01.586+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x55f1257edd50 auth_method 0 2024-09-12T00:53:01.695 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.695 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.695 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:53:01.587+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.695 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:53:01.587+0000 7fddacd35800 20 searching for the correct realm 2024-09-12T00:53:01.695 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:53:01.587+0000 7fdda3fff640 10 monclient: get_auth_request con 0x55f1257f2ea0 auth_method 0 2024-09-12T00:53:01.695 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:53:01.587+0000 7fdda92e5640 10 monclient: get_auth_request con 0x7fdd940cfa50 auth_method 0 2024-09-12T00:53:01.695 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:53:01.589+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x7fdd9c027040 auth_method 0 2024-09-12T00:53:01.696 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:53:01.589+0000 7fdda3fff640 10 monclient: get_auth_request con 0x7fdd940a5900 auth_method 0 2024-09-12T00:53:01.696 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:53:01.590+0000 7fdda3fff640 0 -- 172.21.15.83:0/3762241296 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fdd940a5900 msgr2=0x7fdd940e60b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.696 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:53:01.590+0000 7fdc7e7fc640 1 client.8250.objecter ms_handle_reset 0x7fdd940a5900 session 0x7fdd94005040 osd.5 2024-09-12T00:53:01.696 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:53:01.590+0000 7fdc7e7fc640 10 monclient: _renew_subs 2024-09-12T00:53:01.696 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:53:01.590+0000 7fdc7e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.696 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:53:01.590+0000 7fdda3fff640 10 monclient: get_auth_request con 0x7fdc74086710 auth_method 0 2024-09-12T00:53:01.696 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:53:01.591+0000 7fdda92e5640 10 monclient: get_auth_request con 0x7fdd9c074990 auth_method 0 2024-09-12T00:53:01.696 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:53:01.592+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x7fdda4021070 auth_method 0 2024-09-12T00:53:01.697 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:53:01.593+0000 7fdda92e5640 0 -- 172.21.15.83:0/3762241296 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f1257e99e0 msgr2=0x55f1257ebe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.697 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:53:01.593+0000 7fdc7e7fc640 1 client.8250.objecter ms_handle_reset 0x55f1257e99e0 session 0x55f1257e9360 osd.6 2024-09-12T00:53:01.697 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:53:01.593+0000 7fdda92e5640 10 monclient: get_auth_request con 0x7fdd940a5900 auth_method 0 2024-09-12T00:53:01.697 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:01.697 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:01.697 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:01.697 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:01.697 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:01.698 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:01.698 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.698 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.698 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.698 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.698 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.698 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:01.698 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 zone default found 2024-09-12T00:53:01.698 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:53:01.597+0000 7fddacd35800 4 Realm: () 2024-09-12T00:53:01.699 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:53:01.597+0000 7fddacd35800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:01.699 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:53:01.597+0000 7fddacd35800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:01.699 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:53:01.597+0000 7fddacd35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:01.699 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 zonegroup default 2024-09-12T00:53:01.699 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.699 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.699 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.699 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.699 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.700 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.700 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 started sync module instance, tier type = 2024-09-12T00:53:01.700 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:01.700 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=0 2024-09-12T00:53:01.700 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=1 2024-09-12T00:53:01.700 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=2 2024-09-12T00:53:01.700 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=3 2024-09-12T00:53:01.700 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=4 2024-09-12T00:53:01.701 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=5 2024-09-12T00:53:01.701 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=6 2024-09-12T00:53:01.701 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:53:01.607+0000 7fddacd35800 20 add_watcher() i=7 2024-09-12T00:53:01.701 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:53:01.607+0000 7fddacd35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:01.701 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding auth protocol: cephx 2024-09-12T00:53:01.701 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding auth protocol: cephx 2024-09-12T00:53:01.701 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding auth protocol: cephx 2024-09-12T00:53:01.701 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.701 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.702 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.702 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.702 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.702 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.702 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:53:01.609+0000 7fdc5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.702 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.702 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.702 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.703 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.703 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.703 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.703 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:53:01.609+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.703 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:53:01.609+0000 7fddacd35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:01.703 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:53:01.609+0000 7fddacd35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:01.703 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cache list hook 0x55f1257bd000 2024-09-12T00:53:01.703 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cache inspect hook 0x55f1257bd000 2024-09-12T00:53:01.703 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cache erase hook 0x55f1257bd000 2024-09-12T00:53:01.704 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cache zap hook 0x55f1257bd000 2024-09-12T00:53:01.704 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 note: GC not initialized 2024-09-12T00:53:01.704 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:53:01.609+0000 7fdc5e7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:01.704 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command sync trace show hook 0x7fdda40048c0 2024-09-12T00:53:01.704 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command sync trace history hook 0x7fdda40048c0 2024-09-12T00:53:01.704 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command sync trace active hook 0x7fdda40048c0 2024-09-12T00:53:01.704 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command sync trace active_short hook 0x7fdda40048c0 2024-09-12T00:53:01.704 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:53:01.609+0000 7fddacd35800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:01.705 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 Filter name: none 2024-09-12T00:53:01.705 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:53:01.610+0000 7fdc57fff640 20 reqs_thread_entry: start 2024-09-12T00:53:01.705 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:01.705 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.705 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.705 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:01.705 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:01.706 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:53:01.706 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.706 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:53:01.706 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.706 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.706 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:01.706 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.706 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:53:01.707 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:53:01.614+0000 7fddacd35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.707 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:53:01.614+0000 7fddacd35800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.707 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:53:01.614+0000 7fddacd35800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.707 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:53:01.614+0000 7fddacd35800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:53:01.707 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464428 cookie 94494204592448 notifier 8250 bl.length()=911 2024-09-12T00:53:01.707 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.707 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.707 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.707 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:53:01.618+0000 7fddacd35800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fddacd35800 time 2024-09-12T00:53:01.618233+0000 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fddae58c71a] 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fddae58c8d8] 2024-09-12T00:53:01.708 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f12349a641] 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1234aa38a] 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fddad229590] 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:53:01.618+0000 7fddacd35800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fddacd35800 thread_name:radosgw-admin 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fddad23e6f0] 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fddad28b99c] 2024-09-12T00:53:01.709 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fddae58c774] 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fddae58c8d8] 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f12349a641] 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1234aa38a] 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fddad229590] 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:53:01.710 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:53:01.711 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:53:01.712 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:01.713 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:53:01.714 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:01.715 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:53:01.716 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc57fff640 / http_manager 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc5e7e4640 / http_manager 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc5f7e6640 / rgw_dt_lg_renew 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc7e7fc640 / ms_dispatch 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc7ffff640 / io_context_pool 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc8e7fc640 / ms_dispatch 2024-09-12T00:53:01.717 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc95602640 / ms_dispatch 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc96e05640 / io_context_pool 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdda3fff640 / msgr-worker-2 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdda8ae4640 / msgr-worker-1 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdda92e5640 / msgr-worker-0 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdda9ae6640 / io_context_pool 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: 7fddacd35800 / radosgw-admin 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.151973.log 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:53:01.567+0000 7fddacd35800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:53:01.567+0000 7fddacd35800 4 set_mon_vals no callback set 2024-09-12T00:53:01.718 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:53:01.567+0000 7fdc96e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:53:01.567+0000 7fdc96e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:53:01.567+0000 7fdc96e05640 10 monclient: dump: 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:53:01.567+0000 7fddacd35800 10 monclient: shutdown 2024-09-12T00:53:01.719 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:53:01.567+0000 7fddacd35800 5 asok(0x55f1254de630) unregister_commands rotate-key 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:53:01.568+0000 7fddacd35800 10 monclient: build_initial_monmap 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 build_initial for_mkfs: 0 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:53:01.568+0000 7fddacd35800 10 monclient: monmap: 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.720 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding auth protocol: cephx 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding auth protocol: cephx 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding auth protocol: cephx 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.721 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: crc 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f125703860) adding con mode: secure 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:53:01.568+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 librados: starting msgr at 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 librados: starting objecter 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 asok(0x55f1254de630) register_command objecter_requests hook 0x55f125700170 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 librados: setting wanted keys 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:53:01.568+0000 7fddacd35800 1 librados: calling monclient init 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:53:01.568+0000 7fddacd35800 10 monclient: init 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding auth protocol: cephx 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding auth protocol: cephx 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding auth protocol: cephx 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.722 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.723 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.723 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.723 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.723 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.723 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.723 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: crc 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 AuthRegistry(0x55f1256fdb30) adding con mode: secure 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:53:01.568+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:53:01.568+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:53:01.568+0000 7fddacd35800 5 asok(0x55f1254de630) register_command rotate-key hook 0x55f1256fdc78 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:53:01.568+0000 7fddacd35800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-b con 0x55f1255b5a10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-a con 0x55f125641140 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-c con 0x55f125643880 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:01.724 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient(hunting): authenticate will time out at 2134.838045s 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): get_auth_request con 0x55f125641140 auth_method 0 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): get_auth_request con 0x55f125643880 auth_method 0 2024-09-12T00:53:01.725 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:53:01.569+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:53:01.569+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request con 0x55f1255b5a10 auth_method 0 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:53:01.569+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:53:01.569+0000 7fdda8ae4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:53:01.569+0000 7fdda8ae4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient(hunting): handle_auth_done global_id 8241 payload 824 2024-09-12T00:53:01.726 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient: _finish_hunting 0 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:53:01.569+0000 7fdda3fff640 1 monclient: found mon.noname-a 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:53:01.569+0000 7fdda3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: dump: 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.727 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: _finish_auth 0 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: _check_auth_tickets 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:53:01.569+0000 7fdc95602640 10 monclient: dump: 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.728 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:53:01.569+0000 7fddacd35800 5 monclient: authenticate success, global_id 8241 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:53:01.569+0000 7fdc96e05640 4 set_mon_vals no callback set 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:53:01.569+0000 7fddacd35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:53:01.569+0000 7fddacd35800 1 librados: init done 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:53:01.571+0000 7fdc95602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:01.729 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:53:01.571+0000 7fdc95602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:53:01.571+0000 7fdc95602640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:53:01.571+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x7fdc90076470 auth_method 0 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:53:01.572+0000 7fdda92e5640 10 monclient: get_auth_request con 0x55f1257272b0 auth_method 0 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:53:01.572+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x55f12574a3f0 auth_method 0 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:53:01.574+0000 7fdda3fff640 10 monclient: get_auth_request con 0x55f12574dc50 auth_method 0 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:53:01.574+0000 7fddacd35800 10 monclient: build_initial_monmap 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:53:01.574+0000 7fddacd35800 1 build_initial for_mkfs: 0 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:53:01.574+0000 7fddacd35800 10 monclient: monmap: 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:01.730 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding auth protocol: cephx 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding auth protocol: cephx 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding auth protocol: cephx 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.731 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: crc 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:53:01.574+0000 7fddacd35800 5 AuthRegistry(0x55f1257534f0) adding con mode: secure 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:53:01.574+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 asok(0x55f1254de630) register_command objecter_requests cmddesc objecter_requests hook 0x55f125756a00 EEXIST 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient: init 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding auth protocol: cephx 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding auth protocol: cephx 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding auth protocol: cephx 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.732 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: crc 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 AuthRegistry(0x55f1257524a8) adding con mode: secure 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:53:01.575+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:53:01.575+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:53:01.575+0000 7fddacd35800 5 asok(0x55f1254de630) register_command rotate-key cmddesc rotate-key hook 0x55f1257525f0 EEXIST 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:53:01.733 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-b con 0x55f12577ad20 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-c con 0x55f12577b100 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-a con 0x55f125779a30 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:53:01.575+0000 7fddacd35800 10 monclient(hunting): authenticate will time out at 2134.844739s 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): get_auth_request con 0x55f12577b100 auth_method 0 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): get_auth_request con 0x55f125779a30 auth_method 0 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.734 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:53:01.575+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request con 0x55f12577ad20 auth_method 0 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:53:01.575+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:53:01.575+0000 7fdda8ae4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:53:01.575+0000 7fdda8ae4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:53:01.575+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.735 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:53:01.575+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:53:01.576+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:53:01.576+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:53:01.576+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:53:01.576+0000 7fdda3fff640 10 monclient(hunting): handle_auth_done global_id 7766 payload 824 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:53:01.576+0000 7fdda3fff640 10 monclient: _finish_hunting 0 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:53:01.576+0000 7fdda3fff640 1 monclient: found mon.noname-c 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:53:01.576+0000 7fdda3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: dump: 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.736 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:53:01.576+0000 7fdc8e7fc640 10 monclient: dump: 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.737 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:53:01.576+0000 7fddacd35800 5 monclient: authenticate success, global_id 7766 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:53:01.576+0000 7fdda9ae6640 4 set_mon_vals no callback set 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:53:01.576+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:53:01.576+0000 7fddacd35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:01.738 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:53:01.576+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:53:01.576+0000 7fddacd35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:53:01.578+0000 7fdc8e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:53:01.578+0000 7fdc8e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:53:01.578+0000 7fdc8e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:53:01.578+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x7fdc80076380 auth_method 0 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:53:01.578+0000 7fddacd35800 10 monclient: get_monmap_and_config 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:53:01.578+0000 7fddacd35800 10 monclient: build_initial_monmap 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:53:01.578+0000 7fddacd35800 1 build_initial for_mkfs: 0 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:53:01.578+0000 7fddacd35800 10 monclient: monmap: 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:01.739 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding auth protocol: cephx 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding auth protocol: cephx 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding auth protocol: cephx 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.740 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: crc 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x55f12579a7f0) adding con mode: secure 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:53:01.578+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:53:01.578+0000 7fddacd35800 10 monclient: init 2024-09-12T00:53:01.741 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding auth protocol: cephx 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding auth protocol: cephx 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding auth protocol: cephx 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: crc 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:53:01.578+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178b790) adding con mode: secure 2024-09-12T00:53:01.742 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:53:01.579+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:53:01.579+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:53:01.579+0000 7fddacd35800 5 asok(0x55f1254de630) register_command rotate-key cmddesc rotate-key hook 0x7ffe3178b8d8 EEXIST 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-b con 0x55f12579e980 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-a con 0x55f1257c93f0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-c con 0x55f1257ca7a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:53:01.579+0000 7fddacd35800 10 monclient(hunting): authenticate will time out at 2134.848424s 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): get_auth_request con 0x55f1257ca7a0 auth_method 0 2024-09-12T00:53:01.743 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): get_auth_request con 0x55f1257c93f0 auth_method 0 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:53:01.579+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient(hunting): handle_auth_done global_id 7769 payload 274 2024-09-12T00:53:01.744 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient: _finish_hunting 0 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:53:01.579+0000 7fdda92e5640 1 monclient: found mon.noname-c 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:53:01.579+0000 7fdda92e5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: dump: 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.745 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: _finish_auth 0 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:53:01.579+0000 7fdc7ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:53:01.580+0000 7fdc7ffff640 10 monclient: dump: 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.746 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 monclient: authenticate success, global_id 7769 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:53:01.580+0000 7fddacd35800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:53:01.580+0000 7fddacd35800 4 set_mon_vals no callback set 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:53:01.580+0000 7fddacd35800 10 monclient: shutdown 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:53:01.580+0000 7fddacd35800 10 monclient: build_initial_monmap 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:53:01.580+0000 7fddacd35800 1 build_initial for_mkfs: 0 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:53:01.580+0000 7fddacd35800 10 monclient: monmap: 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:01.747 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding auth protocol: cephx 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding auth protocol: cephx 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding auth protocol: cephx 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.748 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: crc 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:53:01.580+0000 7fddacd35800 5 AuthRegistry(0x55f12579f560) adding con mode: secure 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:53:01.580+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:53:01.580+0000 7fddacd35800 1 librados: starting msgr at 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:53:01.580+0000 7fddacd35800 1 librados: starting objecter 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 asok(0x55f1254de630) register_command objecter_requests cmddesc objecter_requests hook 0x55f125779160 EEXIST 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:53:01.581+0000 7fddacd35800 1 librados: setting wanted keys 2024-09-12T00:53:01.749 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:53:01.581+0000 7fddacd35800 1 librados: calling monclient init 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient: init 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding auth protocol: cephx 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding auth protocol: cephx 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding auth protocol: cephx 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.750 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: crc 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 AuthRegistry(0x55f12578f5e0) adding con mode: secure 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:53:01.581+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:53:01.581+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:53:01.581+0000 7fddacd35800 5 asok(0x55f1254de630) register_command rotate-key cmddesc rotate-key hook 0x55f12578f728 EEXIST 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-a con 0x55f12579e980 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-b con 0x55f1257ca7a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): picked mon.noname-c con 0x55f1257bcba0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:01.751 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:53:01.581+0000 7fddacd35800 10 monclient(hunting): authenticate will time out at 2134.850675s 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request con 0x55f12579e980 auth_method 0 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): get_auth_request con 0x55f1257bcba0 auth_method 0 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:53:01.581+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.752 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): get_auth_request con 0x55f1257ca7a0 auth_method 0 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:53:01.581+0000 7fdda92e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:53:01.581+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:53:01.582+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:53:01.582+0000 7fdda3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:53:01.582+0000 7fdda8ae4640 10 monclient(hunting): handle_auth_done global_id 8250 payload 824 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:53:01.582+0000 7fdda8ae4640 10 monclient: _finish_hunting 0 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:53:01.582+0000 7fdda8ae4640 1 monclient: found mon.noname-a 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:53:01.582+0000 7fdda8ae4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.753 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: dump: 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:53:01.754 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:53:01.582+0000 7fddacd35800 5 monclient: authenticate success, global_id 8250 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:53:01.582+0000 7fdc7e7fc640 10 monclient: dump: 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:01.755 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:53:01.582+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:53:01.582+0000 7fdc7ffff640 4 set_mon_vals no callback set 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:53:01.582+0000 7fddacd35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:53:01.582+0000 7fddacd35800 10 monclient: _renew_subs 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:53:01.582+0000 7fddacd35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:53:01.582+0000 7fddacd35800 1 librados: init done 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:53:01.582+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cr dump hook 0x55f1257bd038 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:53:01.583+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:53:01.584+0000 7fdc7e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:01.756 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:53:01.584+0000 7fdc7e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:53:01.584+0000 7fdc7e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:53:01.584+0000 7fdda3fff640 10 monclient: get_auth_request con 0x7fdc74076470 auth_method 0 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:53:01.585+0000 7fdda92e5640 10 monclient: get_auth_request con 0x55f1257e99e0 auth_method 0 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 realm 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:53:01.585+0000 7fddacd35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:53:01.585+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:53:01.586+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x55f1257edd50 auth_method 0 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.757 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:53:01.586+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:53:01.587+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:53:01.587+0000 7fddacd35800 20 searching for the correct realm 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:53:01.587+0000 7fdda3fff640 10 monclient: get_auth_request con 0x55f1257f2ea0 auth_method 0 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:53:01.587+0000 7fdda92e5640 10 monclient: get_auth_request con 0x7fdd940cfa50 auth_method 0 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:53:01.589+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x7fdd9c027040 auth_method 0 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:53:01.589+0000 7fdda3fff640 10 monclient: get_auth_request con 0x7fdd940a5900 auth_method 0 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:53:01.590+0000 7fdda3fff640 0 -- 172.21.15.83:0/3762241296 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fdd940a5900 msgr2=0x7fdd940e60b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:53:01.590+0000 7fdc7e7fc640 1 client.8250.objecter ms_handle_reset 0x7fdd940a5900 session 0x7fdd94005040 osd.5 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:53:01.590+0000 7fdc7e7fc640 10 monclient: _renew_subs 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:53:01.590+0000 7fdc7e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:53:01.590+0000 7fdda3fff640 10 monclient: get_auth_request con 0x7fdc74086710 auth_method 0 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:53:01.591+0000 7fdda92e5640 10 monclient: get_auth_request con 0x7fdd9c074990 auth_method 0 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:53:01.592+0000 7fdda8ae4640 10 monclient: get_auth_request con 0x7fdda4021070 auth_method 0 2024-09-12T00:53:01.758 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:53:01.593+0000 7fdda92e5640 0 -- 172.21.15.83:0/3762241296 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f1257e99e0 msgr2=0x55f1257ebe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:53:01.593+0000 7fdc7e7fc640 1 client.8250.objecter ms_handle_reset 0x55f1257e99e0 session 0x55f1257e9360 osd.6 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:53:01.593+0000 7fdda92e5640 10 monclient: get_auth_request con 0x7fdd940a5900 auth_method 0 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:53:01.596+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.759 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 zone default found 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:53:01.597+0000 7fddacd35800 4 Realm: () 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:53:01.597+0000 7fddacd35800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:53:01.597+0000 7fddacd35800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:53:01.597+0000 7fddacd35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 zonegroup default 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:53:01.597+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.760 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 started sync module instance, tier type = 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:53:01.598+0000 7fddacd35800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=0 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=1 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=2 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=3 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=4 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=5 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:53:01.606+0000 7fddacd35800 20 add_watcher() i=6 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:53:01.607+0000 7fddacd35800 20 add_watcher() i=7 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:53:01.607+0000 7fddacd35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding auth protocol: cephx 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding auth protocol: cephx 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding auth protocol: cephx 2024-09-12T00:53:01.761 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.762 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.762 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.762 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.762 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.762 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.762 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:53:01.609+0000 7fdc5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.762 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.763 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.763 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.763 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.763 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: crc 2024-09-12T00:53:01.763 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 AuthRegistry(0x7ffe3178bc70) adding con mode: secure 2024-09-12T00:53:01.763 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:53:01.609+0000 7fddacd35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:01.763 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:53:01.609+0000 7fddacd35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:01.763 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:53:01.609+0000 7fddacd35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:01.763 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cache list hook 0x55f1257bd000 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cache inspect hook 0x55f1257bd000 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cache erase hook 0x55f1257bd000 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command cache zap hook 0x55f1257bd000 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 note: GC not initialized 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:53:01.609+0000 7fdc5e7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command sync trace show hook 0x7fdda40048c0 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command sync trace history hook 0x7fdda40048c0 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command sync trace active hook 0x7fdda40048c0 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:53:01.609+0000 7fddacd35800 5 asok(0x55f1254de630) register_command sync trace active_short hook 0x7fdda40048c0 2024-09-12T00:53:01.764 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:53:01.609+0000 7fddacd35800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:01.765 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 Filter name: none 2024-09-12T00:53:01.765 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:53:01.610+0000 7fdc57fff640 20 reqs_thread_entry: start 2024-09-12T00:53:01.765 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:01.765 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.765 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.765 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:01.765 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:01.765 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:53:01.766 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.766 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:53:01.610+0000 7fddacd35800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:53:01.766 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.766 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.766 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:01.766 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.767 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:53:01.610+0000 7fddacd35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:53:01.767 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:53:01.614+0000 7fddacd35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.767 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:53:01.614+0000 7fddacd35800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.767 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:53:01.614+0000 7fddacd35800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.767 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:53:01.614+0000 7fddacd35800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:53:01.767 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464428 cookie 94494204592448 notifier 8250 bl.length()=911 2024-09-12T00:53:01.767 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:01.767 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:53:01.614+0000 7fdc7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:53:01.614+0000 7fddacd35800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:53:01.618+0000 7fddacd35800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fddacd35800 time 2024-09-12T00:53:01.618233+0000 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fddae58c71a] 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fddae58c8d8] 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f12349a641] 2024-09-12T00:53:01.768 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1234aa38a] 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fddad229590] 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:53:01.618+0000 7fddacd35800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7fddacd35800 thread_name:radosgw-admin 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:01.769 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fddad23e6f0] 2024-09-12T00:53:01.770 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fddad28b99c] 2024-09-12T00:53:01.770 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:53:01.770 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:53:01.770 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fddae58c774] 2024-09-12T00:53:01.770 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fddae58c8d8] 2024-09-12T00:53:01.770 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f12349a641] 2024-09-12T00:53:01.770 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1234aa38a] 2024-09-12T00:53:01.770 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:53:01.770 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fddad229590] 2024-09-12T00:53:01.771 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:53:01.771 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:53:01.771 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:01.771 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:01.771 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:53:01.771 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:53:01.771 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:53:01.771 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:53:01.772 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:53:01.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:53:01.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:53:01.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:53:01.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:01.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:01.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:01.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:53:01.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:53:01.773 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:01.774 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:53:01.774 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:53:01.774 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:53:01.774 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:53:01.774 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:53:01.774 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:53:01.775 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:53:01.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:53:01.775 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:53:01.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:53:01.775 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:53:01.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:53:01.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:53:01.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:53:01.775 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:53:01.776 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:53:01.777 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:53:01.777 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:53:01.777 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:53:01.777 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:53:01.777 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:53:01.777 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:53:01.777 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:53:01.777 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:01.778 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:53:01.779 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc57fff640 / http_manager 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc5e7e4640 / http_manager 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc5f7e6640 / rgw_dt_lg_renew 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc7e7fc640 / ms_dispatch 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc7ffff640 / io_context_pool 2024-09-12T00:53:01.780 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc8e7fc640 / ms_dispatch 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc95602640 / ms_dispatch 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdc96e05640 / io_context_pool 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdda3fff640 / msgr-worker-2 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdda8ae4640 / msgr-worker-1 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdda92e5640 / msgr-worker-0 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: 7fdda9ae6640 / io_context_pool 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: 7fddacd35800 / radosgw-admin 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:53:01.781 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:53:01.619621Z_632e27c2-4bb5-465a-8d82-11ac4f7f54eb/log 2024-09-12T00:53:01.782 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:53:01.782 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:53:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.692+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.695+0000 7f18673a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.695+0000 7f18673a9800 20 realm 2024-09-12T00:53:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.695+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.695+0000 7f18673a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.695+0000 7f18673a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.695+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.695+0000 7f18673a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.695+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.696+0000 7f18673a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.696+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.696+0000 7f18673a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.696+0000 7f18673a9800 20 searching for the correct realm 2024-09-12T00:53:01.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.700+0000 7f1864e93640 0 -- 172.21.15.83:0/4208919155 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f185400b040 msgr2=0x7f185406db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.703+0000 7f1864e93640 0 -- 172.21.15.83:0/4208919155 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x55b9ac972d90 msgr2=0x55b9ac975180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.706+0000 7f18673a9800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:01.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.706+0000 7f18673a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:01.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.706+0000 7f18673a9800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.706+0000 7f18673a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.706+0000 7f18673a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.706+0000 7f18673a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.706+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 zone default found 2024-09-12T00:53:01.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 4 Realm: () 2024-09-12T00:53:01.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:01.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:01.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:01.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 zonegroup default 2024-09-12T00:53:01.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.707+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.708+0000 7f18673a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.708+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.708+0000 7f18673a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.708+0000 7f18673a9800 20 started sync module instance, tier type = 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.708+0000 7f18673a9800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.716+0000 7f18673a9800 20 add_watcher() i=0 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.716+0000 7f18673a9800 20 add_watcher() i=1 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.716+0000 7f18673a9800 20 add_watcher() i=2 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.716+0000 7f18673a9800 20 add_watcher() i=3 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.716+0000 7f18673a9800 20 add_watcher() i=4 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.716+0000 7f18673a9800 20 add_watcher() i=5 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.716+0000 7f18673a9800 20 add_watcher() i=6 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.717+0000 7f18673a9800 20 add_watcher() i=7 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.717+0000 7f18673a9800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:01.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.719+0000 7f171b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.719+0000 7f18673a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.719+0000 7f18673a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.719+0000 7f18673a9800 5 note: GC not initialized 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.719+0000 7f171a7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.719+0000 7f18673a9800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.719+0000 7f18673a9800 20 Filter name: none 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.720+0000 7f1713fff640 20 reqs_thread_entry: start 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.720+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.720+0000 7f18673a9800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.720+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.720+0000 7f18673a9800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.720+0000 7f18673a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:01.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.720+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.721+0000 7f18673a9800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:01.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.721+0000 7f18673a9800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.721+0000 7f18673a9800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:53:01.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.721+0000 7f18673a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:01.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.722+0000 7f171b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.724+0000 7f18673a9800 20 remove_watcher() i=0 2024-09-12T00:53:01.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.724+0000 7f18673a9800 2 removed watcher, disabling cache 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.725+0000 7f18673a9800 20 remove_watcher() i=1 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.726+0000 7f18673a9800 20 remove_watcher() i=2 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.727+0000 7f18673a9800 20 remove_watcher() i=3 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.728+0000 7f18673a9800 20 remove_watcher() i=4 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.729+0000 7f18673a9800 20 remove_watcher() i=5 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.730+0000 7f18673a9800 20 remove_watcher() i=6 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.731+0000 7f18673a9800 20 remove_watcher() i=7 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:01.796 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:01.816 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.818+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.819+0000 7f0ac3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.819+0000 7f0ac3d32800 20 realm 2024-09-12T00:53:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.819+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.820+0000 7f0ac3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.820+0000 7f0ac3d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.820+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.819 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.820+0000 7f0ac3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.820+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.820+0000 7f0ac3d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.820+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.821+0000 7f0ac3d32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.821 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.821+0000 7f0ac3d32800 20 searching for the correct realm 2024-09-12T00:53:01.822 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:01.824+0000 7f0abf1bb640 0 -- 172.21.15.83:0/2756018331 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f0ab4084410 msgr2=0x7f0ab402a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:02.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.028+0000 7f0ac01bd640 0 -- 172.21.15.83:0/2756018331 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5642614d2bf0 msgr2=0x5642614d5070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.032+0000 7f0ac3d32800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.032+0000 7f0ac3d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.032+0000 7f0ac3d32800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.032+0000 7f0ac3d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.032+0000 7f0ac3d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.032+0000 7f0ac3d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.032+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.032+0000 7f0ac3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.032+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:02.032 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 zone default found 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 4 Realm: () 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 zonegroup default 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.033 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.033+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.034+0000 7f0ac3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.034+0000 7f0ac3d32800 20 started sync module instance, tier type = 2024-09-12T00:53:02.034 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.034+0000 7f0ac3d32800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:02.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.042+0000 7f0ac3d32800 20 add_watcher() i=0 2024-09-12T00:53:02.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.042+0000 7f0ac3d32800 20 add_watcher() i=1 2024-09-12T00:53:02.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.042+0000 7f0ac3d32800 20 add_watcher() i=2 2024-09-12T00:53:02.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.042+0000 7f0ac3d32800 20 add_watcher() i=3 2024-09-12T00:53:02.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.042+0000 7f0ac3d32800 20 add_watcher() i=4 2024-09-12T00:53:02.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.042+0000 7f0ac3d32800 20 add_watcher() i=5 2024-09-12T00:53:02.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.042+0000 7f0ac3d32800 20 add_watcher() i=6 2024-09-12T00:53:02.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.043+0000 7f0ac3d32800 20 add_watcher() i=7 2024-09-12T00:53:02.042 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.043+0000 7f0ac3d32800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:02.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.045+0000 7f0975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:02.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.045+0000 7f0ac3d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:02.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.045+0000 7f0ac3d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:02.044 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.045+0000 7f0ac3d32800 5 note: GC not initialized 2024-09-12T00:53:02.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0974fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0ac3d32800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0ac3d32800 20 Filter name: none 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f08ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0ac3d32800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0ac3d32800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0ac3d32800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0ac3d32800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0ac3d32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.046+0000 7f0ac3d32800 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:02.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:02.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:02.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:02.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:53:02.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:53:02.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:53:02.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:53:02.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:53:02.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:53:02.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.047+0000 7f0ac3d32800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:53:02.048 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.048+0000 7f0975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:02.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.051+0000 7f0ac3d32800 20 remove_watcher() i=0 2024-09-12T00:53:02.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.051+0000 7f0ac3d32800 2 removed watcher, disabling cache 2024-09-12T00:53:02.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.052+0000 7f0ac3d32800 20 remove_watcher() i=1 2024-09-12T00:53:02.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.053+0000 7f0ac3d32800 20 remove_watcher() i=2 2024-09-12T00:53:02.052 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.054+0000 7f0ac3d32800 20 remove_watcher() i=3 2024-09-12T00:53:02.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.055+0000 7f0ac3d32800 20 remove_watcher() i=4 2024-09-12T00:53:02.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.056+0000 7f0ac3d32800 20 remove_watcher() i=5 2024-09-12T00:53:02.055 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.057+0000 7f0ac3d32800 20 remove_watcher() i=6 2024-09-12T00:53:02.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:02.058+0000 7f0ac3d32800 20 remove_watcher() i=7 2024-09-12T00:53:32.076 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:53:32.113 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:32.113 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:32.155 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.156+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 realm 2024-09-12T00:53:32.156 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.158+0000 7ff6a80bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:32.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.157 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.159+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:32.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.159+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.160+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:32.158 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.160+0000 7ff6a80bb800 20 searching for the correct realm 2024-09-12T00:53:32.162 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.164+0000 7ff6a53a4640 0 -- 172.21.15.83:0/4068512223 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff690039b60 msgr2=0x7ff690046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:32.166 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.167+0000 7ff6a5ba5640 0 -- 172.21.15.83:0/4068512223 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff6a0092040 msgr2=0x7ff6a0060010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:32.170 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:32.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:32.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:32.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:32.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:32.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:32.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 zone default found 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 4 Realm: () 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 zonegroup default 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.173 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.174+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.174+0000 7ff6a80bb800 20 started sync module instance, tier type = 2024-09-12T00:53:32.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.174+0000 7ff6a80bb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:32.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=0 2024-09-12T00:53:32.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=1 2024-09-12T00:53:32.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=2 2024-09-12T00:53:32.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=3 2024-09-12T00:53:32.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=4 2024-09-12T00:53:32.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=5 2024-09-12T00:53:32.182 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=6 2024-09-12T00:53:32.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.184+0000 7ff6a80bb800 20 add_watcher() i=7 2024-09-12T00:53:32.183 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.184+0000 7ff6a80bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:32.185 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.186+0000 7ff557fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:32.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:32.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:32.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 note: GC not initialized 2024-09-12T00:53:32.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.187+0000 7ff556ffd640 20 reqs_thread_entry: start 2024-09-12T00:53:32.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:32.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 Filter name: none 2024-09-12T00:53:32.186 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.187+0000 7ff554ff9640 20 reqs_thread_entry: start 2024-09-12T00:53:32.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.187+0000 7ff6a80bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:32.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:32.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:32.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:32.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:53:32.187 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:53:32.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:32.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:53:32.188 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.190+0000 7ff6a80bb800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:53:32.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:53:32.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464429 cookie 94451139136592 notifier 7826 bl.length()=911 2024-09-12T00:53:32.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:53:32.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:53:32.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:53:32.193 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:53:32.195 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff6a80bb800 time 2024-09-12T00:53:32.197703+0000 2024-09-12T00:53:32.195 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:32.196 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:32.196 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff6ab58c71a] 2024-09-12T00:53:32.196 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff6ab58c8d8] 2024-09-12T00:53:32.196 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e71c911641] 2024-09-12T00:53:32.196 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd8854c) [0x55e71ce2454c] 2024-09-12T00:53:32.196 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e71c92131d] 2024-09-12T00:53:32.196 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:53:32.196 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff6aa229590] 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.197+0000 7ff6a80bb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff6a80bb800 time 2024-09-12T00:53:32.197703+0000 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff6ab58c71a] 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff6ab58c8d8] 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e71c911641] 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd8854c) [0x55e71ce2454c] 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e71c92131d] 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff6aa229590] 2024-09-12T00:53:32.197 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:53:32.198 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:53:32.198 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.198 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:53:32.198 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7ff6a80bb800 thread_name:radosgw-admin 2024-09-12T00:53:32.219 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:32.219 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff6aa23e6f0] 2024-09-12T00:53:32.219 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff6aa28b99c] 2024-09-12T00:53:32.219 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:53:32.219 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:53:32.219 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff6ab58c774] 2024-09-12T00:53:32.219 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff6ab58c8d8] 2024-09-12T00:53:32.219 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e71c911641] 2024-09-12T00:53:32.219 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd8854c) [0x55e71ce2454c] 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e71c92131d] 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff6aa229590] 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.198+0000 7ff6a80bb800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7ff6a80bb800 thread_name:radosgw-admin 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff6aa23e6f0] 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff6aa28b99c] 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:53:32.220 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff6ab58c774] 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff6ab58c8d8] 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e71c911641] 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd8854c) [0x55e71ce2454c] 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e71c92131d] 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff6aa229590] 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:53:32.221 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:53:32.138+0000 7ff593e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:53:32.138+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7814 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:53:32.138+0000 7ff6a80bb800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:53:32.138+0000 7ff6a80bb800 4 set_mon_vals no callback set 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:53:32.138+0000 7ff593e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:53:32.138+0000 7ff593e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:53:32.138+0000 7ff593e07640 10 monclient: dump: 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.222 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 10 monclient: shutdown 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 asok(0x55e71e670630) unregister_commands rotate-key 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 10 monclient: build_initial_monmap 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 build_initial for_mkfs: 0 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 10 monclient: monmap: 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.223 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding auth protocol: cephx 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding auth protocol: cephx 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding auth protocol: cephx 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.224 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 librados: starting msgr at 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 librados: starting objecter 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command objecter_requests hook 0x55e71e8c2c30 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 librados: setting wanted keys 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 librados: calling monclient init 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 10 monclient: init 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding auth protocol: cephx 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding auth protocol: cephx 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding auth protocol: cephx 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.225 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command rotate-key hook 0x55e71e890cf8 2024-09-12T00:53:32.226 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-a con 0x55e71e7da430 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-b con 0x55e71e8bab60 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-c con 0x55e71e8c1f40 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): authenticate will time out at 2165.409294s 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request con 0x55e71e7da430 auth_method 0 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.227 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request con 0x55e71e8c1f40 auth_method 0 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_done global_id 7817 payload 824 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient: _finish_hunting 0 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 1 monclient: found mon.noname-c 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.228 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: dump: 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: _finish_auth 0 2024-09-12T00:53:32.229 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: _check_auth_tickets 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: dump: 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.230 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7817 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:53:32.140+0000 7ff593e07640 4 set_mon_vals no callback set 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:53:32.141+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:53:32.141+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:53:32.141+0000 7ff6a80bb800 1 librados: init done 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:53:32.143+0000 7ff592604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:53:32.143+0000 7ff592604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:53:32.143+0000 7ff592604640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:53:32.143+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x7ff58c0764a0 auth_method 0 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:53:32.143+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x55e71e8b9cf0 auth_method 0 2024-09-12T00:53:32.231 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:53:32.144+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x55e71e8dc940 auth_method 0 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:53:32.146+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x55e71e8e1e80 auth_method 0 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 10 monclient: build_initial_monmap 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 1 build_initial for_mkfs: 0 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 10 monclient: monmap: 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:32.232 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding auth protocol: cephx 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding auth protocol: cephx 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding auth protocol: cephx 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.233 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command objecter_requests cmddesc objecter_requests hook 0x55e71e8e9150 EEXIST 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 10 monclient: init 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding auth protocol: cephx 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding auth protocol: cephx 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding auth protocol: cephx 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.234 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command rotate-key cmddesc rotate-key hook 0x55e71e8e4d80 EEXIST 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-c con 0x55e71e90d470 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-a con 0x55e71e90d850 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:32.235 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-b con 0x55e71e90c180 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): authenticate will time out at 2165.417049s 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request con 0x55e71e90d470 auth_method 0 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request con 0x55e71e90d850 auth_method 0 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.236 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request con 0x55e71e90c180 auth_method 0 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.237 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient: _finish_hunting 0 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 1 monclient: found mon.noname-c 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: dump: 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.238 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: dump: 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.239 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7820 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:53:32.148+0000 7ff6a6ba7640 4 set_mon_vals no callback set 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:53:32.150+0000 7ff58b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:53:32.150+0000 7ff58b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.240 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:53:32.150+0000 7ff58b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:53:32.150+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x7ff580076380 auth_method 0 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: get_monmap_and_config 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: build_initial_monmap 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 1 build_initial for_mkfs: 0 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: monmap: 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:32.241 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding auth protocol: cephx 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding auth protocol: cephx 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding auth protocol: cephx 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.242 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: init 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding auth protocol: cephx 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding auth protocol: cephx 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding auth protocol: cephx 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.243 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command rotate-key cmddesc rotate-key hook 0x7ffcaf6a07d8 EEXIST 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-a con 0x55e71e9617e0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-b con 0x55e71e952130 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:32.244 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-c con 0x55e71e95cc10 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): authenticate will time out at 2165.421061s 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request con 0x55e71e95cc10 auth_method 0 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request con 0x55e71e9617e0 auth_method 0 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.245 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:53:32.152+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request con 0x55e71e952130 auth_method 0 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:53:32.152+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:53:32.152+0000 7ff6a53a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.246 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:53:32.152+0000 7ff6a53a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_done global_id 7823 payload 274 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient: _finish_hunting 0 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 1 monclient: found mon.noname-c 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: dump: 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.247 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: _finish_auth 0 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: _check_auth_tickets 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7823 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 4 set_mon_vals no callback set 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: dump: 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.248 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 10 monclient: shutdown 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 10 monclient: build_initial_monmap 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 build_initial for_mkfs: 0 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 10 monclient: monmap: 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:32.249 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding auth protocol: cephx 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding auth protocol: cephx 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding auth protocol: cephx 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.250 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 librados: starting msgr at 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 librados: starting objecter 2024-09-12T00:53:32.251 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command objecter_requests cmddesc objecter_requests hook 0x55e71e90f2a0 EEXIST 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 librados: setting wanted keys 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 librados: calling monclient init 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 10 monclient: init 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding auth protocol: cephx 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding auth protocol: cephx 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding auth protocol: cephx 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.252 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command rotate-key cmddesc rotate-key hook 0x55e71e921e78 EEXIST 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-c con 0x55e71e952130 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-a con 0x55e71e95cc10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-b con 0x55e71e9617e0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:32.253 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): authenticate will time out at 2165.423407s 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request con 0x55e71e952130 auth_method 0 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request con 0x55e71e95cc10 auth_method 0 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.254 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:53:32.154+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request con 0x55e71e9617e0 auth_method 0 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:53:32.154+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:53:32.154+0000 7ff6a63a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:53:32.154+0000 7ff6a63a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient: _finish_hunting 0 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 1 monclient: found mon.noname-c 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: dump: 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.255 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: _finish_auth 0 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: _check_auth_tickets 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.256 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: dump: 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7826 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:53:32.155+0000 7ff5897fa640 4 set_mon_vals no callback set 2024-09-12T00:53:32.257 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 1 librados: init done 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cr dump hook 0x55e71e955468 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:53:32.156+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:53:32.157+0000 7ff5777fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:53:32.157+0000 7ff5777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:53:32.157+0000 7ff5777fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:53:32.157+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x7ff570076470 auth_method 0 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:53:32.157+0000 7ff6a63a6640 10 monclient: get_auth_request con 0x55e71e97bca0 auth_method 0 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 realm 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.258 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:53:32.159+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x55e71e97ff10 auth_method 0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:53:32.159+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:53:32.159+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:53:32.160+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:53:32.160+0000 7ff6a80bb800 20 searching for the correct realm 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:53:32.160+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x55e71e9851a0 auth_method 0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:53:32.161+0000 7ff6a63a6640 10 monclient: get_auth_request con 0x7ff69002a070 auth_method 0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:53:32.162+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x7ff6980aac20 auth_method 0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:53:32.163+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x7ff690039b60 auth_method 0 2024-09-12T00:53:32.259 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:53:32.164+0000 7ff6a53a4640 0 -- 172.21.15.83:0/4068512223 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff690039b60 msgr2=0x7ff690046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:53:32.164+0000 7ff5777fe640 1 client.7826.objecter ms_handle_reset 0x7ff690039b60 session 0x7ff690008e60 osd.5 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:53:32.164+0000 7ff5777fe640 10 monclient: _renew_subs 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:53:32.164+0000 7ff5777fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:53:32.164+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x7ff570086790 auth_method 0 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:53:32.165+0000 7ff6a63a6640 10 monclient: get_auth_request con 0x7ff6980cc040 auth_method 0 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:53:32.166+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x7ff6a0092040 auth_method 0 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:53:32.167+0000 7ff6a5ba5640 0 -- 172.21.15.83:0/4068512223 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff6a0092040 msgr2=0x7ff6a0060010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:53:32.167+0000 7ff5777fe640 1 client.7826.objecter ms_handle_reset 0x7ff6a0092040 session 0x7ff6a005d5b0 osd.3 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:53:32.167+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x7ff690039b60 auth_method 0 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:32.260 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 zone default found 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 4 Realm: () 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:32.261 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 zonegroup default 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:53:32.174+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:53:32.174+0000 7ff6a80bb800 20 started sync module instance, tier type = 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:53:32.174+0000 7ff6a80bb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=0 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=1 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=2 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=3 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=4 2024-09-12T00:53:32.262 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=5 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=6 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:53:32.184+0000 7ff6a80bb800 20 add_watcher() i=7 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:53:32.184+0000 7ff6a80bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding auth protocol: cephx 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding auth protocol: cephx 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding auth protocol: cephx 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:53:32.186+0000 7ff557fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.263 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cache list hook 0x55e71e959fb0 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cache inspect hook 0x55e71e959fb0 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cache erase hook 0x55e71e959fb0 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cache zap hook 0x55e71e959fb0 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 note: GC not initialized 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:53:32.187+0000 7ff556ffd640 20 reqs_thread_entry: start 2024-09-12T00:53:32.264 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command sync trace show hook 0x7ff6a0004320 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command sync trace history hook 0x7ff6a0004320 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command sync trace active hook 0x7ff6a0004320 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command sync trace active_short hook 0x7ff6a0004320 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 Filter name: none 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:53:32.187+0000 7ff554ff9640 20 reqs_thread_entry: start 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.265 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:53:32.190+0000 7ff6a80bb800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464429 cookie 94451139136592 notifier 7826 bl.length()=911 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.266 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:53:32.197+0000 7ff6a80bb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff6a80bb800 time 2024-09-12T00:53:32.197703+0000 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff6ab58c71a] 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff6ab58c8d8] 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e71c911641] 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd8854c) [0x55e71ce2454c] 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e71c92131d] 2024-09-12T00:53:32.267 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff6aa229590] 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:53:32.198+0000 7ff6a80bb800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7ff6a80bb800 thread_name:radosgw-admin 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff6aa23e6f0] 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff6aa28b99c] 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff6ab58c774] 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff6ab58c8d8] 2024-09-12T00:53:32.268 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e71c911641] 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd8854c) [0x55e71ce2454c] 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e71c92131d] 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff6aa229590] 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:53:32.269 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:53:32.270 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:53:32.271 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:53:32.272 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:53:32.273 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:32.274 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:53:32.275 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff554ff9640 / http_manager 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff556ffd640 / http_manager 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff557fff640 / rgw_dt_lg_renew 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff5777fe640 / ms_dispatch 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff588ff9640 / io_context_pool 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff5897fa640 / io_context_pool 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff58b7fe640 / ms_dispatch 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff592604640 / ms_dispatch 2024-09-12T00:53:32.276 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff593e07640 / io_context_pool 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a53a4640 / msgr-worker-2 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a5ba5640 / msgr-worker-1 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a63a6640 / msgr-worker-0 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a6ba7640 / io_context_pool 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a80bb800 / radosgw-admin 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.153741.log 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:53:32.138+0000 7ff593e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:53:32.138+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7814 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:53:32.138+0000 7ff6a80bb800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:53:32.138+0000 7ff6a80bb800 4 set_mon_vals no callback set 2024-09-12T00:53:32.277 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:53:32.138+0000 7ff593e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:53:32.138+0000 7ff593e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:53:32.138+0000 7ff593e07640 10 monclient: dump: 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 10 monclient: shutdown 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 asok(0x55e71e670630) unregister_commands rotate-key 2024-09-12T00:53:32.278 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 10 monclient: build_initial_monmap 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 build_initial for_mkfs: 0 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 10 monclient: monmap: 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding auth protocol: cephx 2024-09-12T00:53:32.279 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding auth protocol: cephx 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding auth protocol: cephx 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: crc 2024-09-12T00:53:32.280 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e893ea0) adding con mode: secure 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 librados: starting msgr at 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 librados: starting objecter 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command objecter_requests hook 0x55e71e8c2c30 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 librados: setting wanted keys 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 1 librados: calling monclient init 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 10 monclient: init 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding auth protocol: cephx 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding auth protocol: cephx 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding auth protocol: cephx 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.281 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: crc 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e890bb0) adding con mode: secure 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:53:32.139+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command rotate-key hook 0x55e71e890cf8 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:53:32.282 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-a con 0x55e71e7da430 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-b con 0x55e71e8bab60 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-c con 0x55e71e8c1f40 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient(hunting): authenticate will time out at 2165.409294s 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request con 0x55e71e7da430 auth_method 0 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request con 0x55e71e8c1f40 auth_method 0 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.283 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:53:32.140+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_done global_id 7817 payload 824 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient: _finish_hunting 0 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 1 monclient: found mon.noname-c 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:53:32.140+0000 7ff6a63a6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.284 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: dump: 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: _finish_auth 0 2024-09-12T00:53:32.285 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: _check_auth_tickets 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:53:32.140+0000 7ff592604640 10 monclient: dump: 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.286 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7817 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:53:32.140+0000 7ff593e07640 4 set_mon_vals no callback set 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:53:32.140+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:53:32.141+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:53:32.141+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:53:32.141+0000 7ff6a80bb800 1 librados: init done 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:53:32.143+0000 7ff592604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:53:32.143+0000 7ff592604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:53:32.143+0000 7ff592604640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:53:32.143+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x7ff58c0764a0 auth_method 0 2024-09-12T00:53:32.287 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:53:32.143+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x55e71e8b9cf0 auth_method 0 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:53:32.144+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x55e71e8dc940 auth_method 0 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:53:32.146+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x55e71e8e1e80 auth_method 0 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 10 monclient: build_initial_monmap 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 1 build_initial for_mkfs: 0 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 10 monclient: monmap: 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:32.288 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding auth protocol: cephx 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding auth protocol: cephx 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding auth protocol: cephx 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.289 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: crc 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:53:32.146+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e5ca0) adding con mode: secure 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command objecter_requests cmddesc objecter_requests hook 0x55e71e8e9150 EEXIST 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 10 monclient: init 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding auth protocol: cephx 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding auth protocol: cephx 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding auth protocol: cephx 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.290 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: crc 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e8e4c38) adding con mode: secure 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command rotate-key cmddesc rotate-key hook 0x55e71e8e4d80 EEXIST 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:53:32.147+0000 7ff6a80bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-c con 0x55e71e90d470 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-a con 0x55e71e90d850 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:32.291 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-b con 0x55e71e90c180 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient(hunting): authenticate will time out at 2165.417049s 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request con 0x55e71e90d470 auth_method 0 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request con 0x55e71e90d850 auth_method 0 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.292 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:53:32.148+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request con 0x55e71e90c180 auth_method 0 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:53:32.148+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.293 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient: _finish_hunting 0 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 1 monclient: found mon.noname-c 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:53:32.148+0000 7ff6a5ba5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: dump: 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.294 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:53:32.148+0000 7ff58b7fe640 10 monclient: dump: 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.295 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7820 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:53:32.148+0000 7ff6a6ba7640 4 set_mon_vals no callback set 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:53:32.148+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:53:32.150+0000 7ff58b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:53:32.150+0000 7ff58b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.296 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:53:32.150+0000 7ff58b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:53:32.150+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x7ff580076380 auth_method 0 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: get_monmap_and_config 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: build_initial_monmap 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 1 build_initial for_mkfs: 0 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: monmap: 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:32.297 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding auth protocol: cephx 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding auth protocol: cephx 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding auth protocol: cephx 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.298 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: crc 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e92d1c0) adding con mode: secure 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: init 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding auth protocol: cephx 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding auth protocol: cephx 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding auth protocol: cephx 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.299 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: crc 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0690) adding con mode: secure 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command rotate-key cmddesc rotate-key hook 0x7ffcaf6a07d8 EEXIST 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:53:32.151+0000 7ff6a80bb800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-a con 0x55e71e9617e0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-b con 0x55e71e952130 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:32.300 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-c con 0x55e71e95cc10 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient(hunting): authenticate will time out at 2165.421061s 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request con 0x55e71e95cc10 auth_method 0 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request con 0x55e71e9617e0 auth_method 0 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.301 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:53:32.152+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:53:32.152+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request con 0x55e71e952130 auth_method 0 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:53:32.152+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:53:32.152+0000 7ff6a53a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:53:32.152+0000 7ff6a53a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient(hunting): handle_auth_done global_id 7823 payload 274 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient: _finish_hunting 0 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 1 monclient: found mon.noname-c 2024-09-12T00:53:32.302 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:53:32.152+0000 7ff6a63a6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: dump: 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.303 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: _finish_auth 0 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: _check_auth_tickets 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7823 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:53:32.152+0000 7ff6a80bb800 4 set_mon_vals no callback set 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:53:32.152+0000 7ff5897fa640 10 monclient: dump: 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.304 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 10 monclient: shutdown 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 10 monclient: build_initial_monmap 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 build_initial for_mkfs: 0 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 10 monclient: monmap: 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:53:32.305 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding auth protocol: cephx 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding auth protocol: cephx 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding auth protocol: cephx 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.306 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: crc 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e931f70) adding con mode: secure 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 librados: starting msgr at 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 librados: starting objecter 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command objecter_requests cmddesc objecter_requests hook 0x55e71e90f2a0 EEXIST 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 librados: setting wanted keys 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 1 librados: calling monclient init 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 10 monclient: init 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding auth protocol: cephx 2024-09-12T00:53:32.307 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding auth protocol: cephx 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding auth protocol: cephx 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: crc 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:53:32.153+0000 7ff6a80bb800 5 AuthRegistry(0x55e71e921d30) adding con mode: secure 2024-09-12T00:53:32.308 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command rotate-key cmddesc rotate-key hook 0x55e71e921e78 EEXIST 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-c con 0x55e71e952130 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-a con 0x55e71e95cc10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): picked mon.noname-b con 0x55e71e9617e0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:53:32.154+0000 7ff6a80bb800 10 monclient(hunting): authenticate will time out at 2165.423407s 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request con 0x55e71e952130 auth_method 0 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.309 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request con 0x55e71e95cc10 auth_method 0 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:53:32.154+0000 7ff6a53a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:53:32.154+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request con 0x55e71e9617e0 auth_method 0 2024-09-12T00:53:32.310 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:53:32.154+0000 7ff6a63a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:53:32.154+0000 7ff6a63a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:53:32.154+0000 7ff6a63a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient: _finish_hunting 0 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 1 monclient: found mon.noname-c 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:53:32.154+0000 7ff6a5ba5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: dump: 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.311 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: _finish_auth 0 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: _check_auth_tickets 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:53:32.155+0000 7ff5777fe640 10 monclient: dump: 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.312 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 5 monclient: authenticate success, global_id 7826 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:53:32.155+0000 7ff5897fa640 4 set_mon_vals no callback set 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 10 monclient: _renew_subs 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 1 librados: init done 2024-09-12T00:53:32.313 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:53:32.155+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cr dump hook 0x55e71e955468 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:53:32.156+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:53:32.157+0000 7ff5777fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:53:32.157+0000 7ff5777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:53:32.157+0000 7ff5777fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:53:32.157+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x7ff570076470 auth_method 0 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:53:32.157+0000 7ff6a63a6640 10 monclient: get_auth_request con 0x55e71e97bca0 auth_method 0 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 realm 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.314 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:53:32.158+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:53:32.159+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x55e71e97ff10 auth_method 0 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:53:32.159+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:53:32.159+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:53:32.160+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:53:32.160+0000 7ff6a80bb800 20 searching for the correct realm 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:53:32.160+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x55e71e9851a0 auth_method 0 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:53:32.161+0000 7ff6a63a6640 10 monclient: get_auth_request con 0x7ff69002a070 auth_method 0 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:53:32.162+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x7ff6980aac20 auth_method 0 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:53:32.163+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x7ff690039b60 auth_method 0 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:53:32.164+0000 7ff6a53a4640 0 -- 172.21.15.83:0/4068512223 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff690039b60 msgr2=0x7ff690046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:53:32.164+0000 7ff5777fe640 1 client.7826.objecter ms_handle_reset 0x7ff690039b60 session 0x7ff690008e60 osd.5 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:53:32.164+0000 7ff5777fe640 10 monclient: _renew_subs 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:53:32.164+0000 7ff5777fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:53:32.315 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:53:32.164+0000 7ff6a53a4640 10 monclient: get_auth_request con 0x7ff570086790 auth_method 0 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:53:32.165+0000 7ff6a63a6640 10 monclient: get_auth_request con 0x7ff6980cc040 auth_method 0 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:53:32.166+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x7ff6a0092040 auth_method 0 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:53:32.167+0000 7ff6a5ba5640 0 -- 172.21.15.83:0/4068512223 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff6a0092040 msgr2=0x7ff6a0060010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:53:32.167+0000 7ff5777fe640 1 client.7826.objecter ms_handle_reset 0x7ff6a0092040 session 0x7ff6a005d5b0 osd.3 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:53:32.167+0000 7ff6a5ba5640 10 monclient: get_auth_request con 0x7ff690039b60 auth_method 0 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.316 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:53:32.172+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 zone default found 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 4 Realm: () 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 zonegroup default 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.317 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:53:32.173+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:53:32.174+0000 7ff6a80bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:53:32.174+0000 7ff6a80bb800 20 started sync module instance, tier type = 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:53:32.174+0000 7ff6a80bb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=0 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=1 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=2 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=3 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=4 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=5 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:53:32.183+0000 7ff6a80bb800 20 add_watcher() i=6 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:53:32.184+0000 7ff6a80bb800 20 add_watcher() i=7 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:53:32.184+0000 7ff6a80bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:32.318 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding auth protocol: cephx 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding auth protocol: cephx 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding auth protocol: cephx 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:53:32.186+0000 7ff557fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.319 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: crc 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:53:32.186+0000 7ff6a80bb800 5 AuthRegistry(0x7ffcaf6a0b70) adding con mode: secure 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cache list hook 0x55e71e959fb0 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cache inspect hook 0x55e71e959fb0 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cache erase hook 0x55e71e959fb0 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command cache zap hook 0x55e71e959fb0 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 note: GC not initialized 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:53:32.187+0000 7ff556ffd640 20 reqs_thread_entry: start 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command sync trace show hook 0x7ff6a0004320 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command sync trace history hook 0x7ff6a0004320 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command sync trace active hook 0x7ff6a0004320 2024-09-12T00:53:32.320 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 5 asok(0x55e71e670630) register_command sync trace active_short hook 0x7ff6a0004320 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 Filter name: none 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:53:32.187+0000 7ff554ff9640 20 reqs_thread_entry: start 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:53:32.187+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.321 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:53:32.188+0000 7ff6a80bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:53:32.190+0000 7ff6a80bb800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464429 cookie 94451139136592 notifier 7826 bl.length()=911 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:53:32.194+0000 7ff588ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:53:32.322 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:53:32.194+0000 7ff6a80bb800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:53:32.197+0000 7ff6a80bb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff6a80bb800 time 2024-09-12T00:53:32.197703+0000 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff6ab58c71a] 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff6ab58c8d8] 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e71c911641] 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: 4: radosgw-admin(+0xd8854c) [0x55e71ce2454c] 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e71c92131d] 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: 6: main() 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff6aa229590] 2024-09-12T00:53:32.323 INFO:tasks.workunit.client.0.smithi083.stderr: 8: __libc_start_main() 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 9: _start() 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:53:32.198+0000 7ff6a80bb800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7ff6a80bb800 thread_name:radosgw-admin 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff6aa23e6f0] 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff6aa28b99c] 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff6ab58c774] 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff6ab58c8d8] 2024-09-12T00:53:32.324 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e71c911641] 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 8: radosgw-admin(+0xd8854c) [0x55e71ce2454c] 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e71c92131d] 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 10: main() 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff6aa229590] 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 12: __libc_start_main() 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 13: _start() 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:53:32.325 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:53:32.326 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:53:32.327 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:32.328 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:53:32.329 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:32.330 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:53:32.331 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff554ff9640 / http_manager 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff556ffd640 / http_manager 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff557fff640 / rgw_dt_lg_renew 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff5777fe640 / ms_dispatch 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff588ff9640 / io_context_pool 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff5897fa640 / io_context_pool 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff58b7fe640 / ms_dispatch 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff592604640 / ms_dispatch 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff593e07640 / io_context_pool 2024-09-12T00:53:32.332 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a53a4640 / msgr-worker-2 2024-09-12T00:53:32.333 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a5ba5640 / msgr-worker-1 2024-09-12T00:53:32.333 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a63a6640 / msgr-worker-0 2024-09-12T00:53:32.333 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a6ba7640 / io_context_pool 2024-09-12T00:53:32.333 INFO:tasks.workunit.client.0.smithi083.stderr: 7ff6a80bb800 / radosgw-admin 2024-09-12T00:53:32.333 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:53:32.333 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:53:32.333 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:53:32.199425Z_95cba5da-a591-43ea-b49d-8713db630b71/log 2024-09-12T00:53:32.333 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:53:32.333 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.275+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.277+0000 7fb7b752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.277+0000 7fb7b752e800 20 realm 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.277+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.277+0000 7fb7b752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.277+0000 7fb7b752e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.277+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.277+0000 7fb7b752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.277+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.278+0000 7fb7b752e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:32.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.278+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.278+0000 7fb7b752e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:32.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.278+0000 7fb7b752e800 20 searching for the correct realm 2024-09-12T00:53:32.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.281+0000 7fb7b32dd640 0 -- 172.21.15.83:0/3913120101 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7fb7a40d75b0 msgr2=0x7fb7a40afb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:32.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.284+0000 7fb7b32dd640 0 -- 172.21.15.83:0/3913120101 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fb7ac026070 msgr2=0x7fb7ac03f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:32.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.491+0000 7fb7b752e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:53:32.493 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.491+0000 7fb7b752e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:32.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.491+0000 7fb7b752e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:53:32.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.491+0000 7fb7b752e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:32.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.491+0000 7fb7b752e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:32.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.491+0000 7fb7b752e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:32.494 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.491+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:32.495 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:32.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 20 zone default found 2024-09-12T00:53:32.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 4 Realm: () 2024-09-12T00:53:32.496 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:53:32.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:53:32.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:32.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 20 zonegroup default 2024-09-12T00:53:32.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.492+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.493+0000 7fb7b752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.493+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.493+0000 7fb7b752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.493+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.493+0000 7fb7b752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:32.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.493+0000 7fb7b752e800 20 started sync module instance, tier type = 2024-09-12T00:53:32.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.493+0000 7fb7b752e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:53:32.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.502+0000 7fb7b752e800 20 add_watcher() i=0 2024-09-12T00:53:32.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.502+0000 7fb7b752e800 20 add_watcher() i=1 2024-09-12T00:53:32.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.502+0000 7fb7b752e800 20 add_watcher() i=2 2024-09-12T00:53:32.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.502+0000 7fb7b752e800 20 add_watcher() i=3 2024-09-12T00:53:32.501 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.502+0000 7fb7b752e800 20 add_watcher() i=4 2024-09-12T00:53:32.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.502+0000 7fb7b752e800 20 add_watcher() i=5 2024-09-12T00:53:32.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.502+0000 7fb7b752e800 20 add_watcher() i=6 2024-09-12T00:53:32.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.503+0000 7fb7b752e800 20 add_watcher() i=7 2024-09-12T00:53:32.502 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.503+0000 7fb7b752e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:32.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.505+0000 7fb669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:32.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.506+0000 7fb7b752e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:32.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.506+0000 7fb7b752e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:32.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.506+0000 7fb7b752e800 5 note: GC not initialized 2024-09-12T00:53:32.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.506+0000 7fb668fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:32.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.506+0000 7fb7b752e800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:32.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.506+0000 7fb7b752e800 20 Filter name: none 2024-09-12T00:53:32.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.506+0000 7fb5e27fc640 20 reqs_thread_entry: start 2024-09-12T00:53:32.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.506+0000 7fb7b752e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:32.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.506+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:53:32.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:32.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:32.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:53:32.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:32.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:53:32.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:53:32.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:53:32.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:32.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:53:32.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:53:32.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:53:32.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:53:32.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:53:32.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.507+0000 7fb7b752e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:53:32.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.508+0000 7fb7b752e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:53:32.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.508+0000 7fb7b752e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:53:32.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.509+0000 7fb669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:32.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.511+0000 7fb7b752e800 20 remove_watcher() i=0 2024-09-12T00:53:32.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.511+0000 7fb7b752e800 2 removed watcher, disabling cache 2024-09-12T00:53:32.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.512+0000 7fb7b752e800 20 remove_watcher() i=1 2024-09-12T00:53:32.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.513+0000 7fb7b752e800 20 remove_watcher() i=2 2024-09-12T00:53:32.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.515+0000 7fb7b752e800 20 remove_watcher() i=3 2024-09-12T00:53:32.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.516+0000 7fb7b752e800 20 remove_watcher() i=4 2024-09-12T00:53:32.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.517+0000 7fb7b752e800 20 remove_watcher() i=5 2024-09-12T00:53:32.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.518+0000 7fb7b752e800 20 remove_watcher() i=6 2024-09-12T00:53:32.517 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:53:32.519+0000 7fb7b752e800 20 remove_watcher() i=7 2024-09-12T00:53:32.527 INFO:tasks.workunit.client.0.smithi083.stderr: test: duplicated entries can be purged manually 2024-09-12T00:54:02.539 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:02.570 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:02.570 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:02.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.613+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.616+0000 7fc4e8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.616+0000 7fc4e8a2f800 20 realm 2024-09-12T00:54:02.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.616+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.616+0000 7fc4e8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.616+0000 7fc4e8a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:02.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.616+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.616+0000 7fc4e8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.616+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.617+0000 7fc4e8a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:02.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.617+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.617+0000 7fc4e8a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:02.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.617+0000 7fc4e8a2f800 20 searching for the correct realm 2024-09-12T00:54:02.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.621+0000 7fc4e358a640 0 -- 172.21.15.83:0/3477729840 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fc4d8097920 msgr2=0x7fc4d805eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:02.826 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.828+0000 7fc4e458c640 0 -- 172.21.15.83:0/3477729840 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55dbec3421b0 msgr2=0x55dbec344640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:02.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.832+0000 7fc4e8a2f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:02.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.832+0000 7fc4e8a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:02.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.832+0000 7fc4e8a2f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:02.831 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.832+0000 7fc4e8a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:02.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.832+0000 7fc4e8a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:02.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.832+0000 7fc4e8a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:02.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.832+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.832 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:02.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.833 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 20 zone default found 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 4 Realm: () 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 20 zonegroup default 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.833+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.834+0000 7fc4e8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.834+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.834+0000 7fc4e8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.834+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.835+0000 7fc4e8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.835+0000 7fc4e8a2f800 20 started sync module instance, tier type = 2024-09-12T00:54:02.834 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.835+0000 7fc4e8a2f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:02.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.845+0000 7fc4e8a2f800 20 add_watcher() i=0 2024-09-12T00:54:02.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.845+0000 7fc4e8a2f800 20 add_watcher() i=1 2024-09-12T00:54:02.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.845+0000 7fc4e8a2f800 20 add_watcher() i=2 2024-09-12T00:54:02.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.845+0000 7fc4e8a2f800 20 add_watcher() i=3 2024-09-12T00:54:02.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.845+0000 7fc4e8a2f800 20 add_watcher() i=4 2024-09-12T00:54:02.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.845+0000 7fc4e8a2f800 20 add_watcher() i=5 2024-09-12T00:54:02.843 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.845+0000 7fc4e8a2f800 20 add_watcher() i=6 2024-09-12T00:54:02.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.846+0000 7fc4e8a2f800 20 add_watcher() i=7 2024-09-12T00:54:02.844 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.846+0000 7fc4e8a2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:02.846 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.848+0000 7fc399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:02.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.848+0000 7fc4e8a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:02.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.848+0000 7fc4e8a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:02.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.848+0000 7fc4e8a2f800 5 note: GC not initialized 2024-09-12T00:54:02.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.848+0000 7fc398fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:02.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.848+0000 7fc4e8a2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:02.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.848+0000 7fc4e8a2f800 20 Filter name: none 2024-09-12T00:54:02.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.848+0000 7fc3127fc640 20 reqs_thread_entry: start 2024-09-12T00:54:02.847 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.849+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.849+0000 7fc4e8a2f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:02.848 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.849+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.849+0000 7fc4e8a2f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:02.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.849+0000 7fc4e8a2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:02.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.849+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.850+0000 7fc4e8a2f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:02.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.850+0000 7fc4e8a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.850+0000 7fc4e8a2f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:02.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.850+0000 7fc4e8a2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:02.849 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.851+0000 7fc399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:02.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.854+0000 7fc4e8a2f800 20 remove_watcher() i=0 2024-09-12T00:54:02.852 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.854+0000 7fc4e8a2f800 2 removed watcher, disabling cache 2024-09-12T00:54:02.853 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.855+0000 7fc4e8a2f800 20 remove_watcher() i=1 2024-09-12T00:54:02.854 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.856+0000 7fc4e8a2f800 20 remove_watcher() i=2 2024-09-12T00:54:02.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.857+0000 7fc4e8a2f800 20 remove_watcher() i=3 2024-09-12T00:54:02.856 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.858+0000 7fc4e8a2f800 20 remove_watcher() i=4 2024-09-12T00:54:02.857 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.859+0000 7fc4e8a2f800 20 remove_watcher() i=5 2024-09-12T00:54:02.858 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.860+0000 7fc4e8a2f800 20 remove_watcher() i=6 2024-09-12T00:54:02.859 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.861+0000 7fc4e8a2f800 20 remove_watcher() i=7 2024-09-12T00:54:02.871 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:02.871 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:54:02.871 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: ad4424e4-de7c-4376-b125-e717016a3484.4511.18 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T00:54:02.871 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:02.872 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:54:02.907 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:02.908 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:02.945 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.946+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.948+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.948+0000 7f75a3a87800 20 realm 2024-09-12T00:54:02.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.948+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.949+0000 7f75a3a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:02.947 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.950+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:02.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.950+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.948 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.950+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:02.949 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.950+0000 7f75a3a87800 20 searching for the correct realm 2024-09-12T00:54:02.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.954+0000 7f75a1d72640 0 -- 172.21.15.83:0/3890581591 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f75980d5b30 msgr2=0x7f75980a3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:02.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.957+0000 7f75a1571640 0 -- 172.21.15.83:0/3890581591 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f759c02b020 msgr2=0x7f759c0643c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:02.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:02.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:02.959 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:02.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:02.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:02.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:02.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:02.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 20 zone default found 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 4 Realm: () 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 20 zonegroup default 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.963+0000 7f75a3a87800 20 started sync module instance, tier type = 2024-09-12T00:54:02.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.963+0000 7f75a3a87800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:02.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=0 2024-09-12T00:54:02.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=1 2024-09-12T00:54:02.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=2 2024-09-12T00:54:02.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=3 2024-09-12T00:54:02.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=4 2024-09-12T00:54:02.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=5 2024-09-12T00:54:02.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=6 2024-09-12T00:54:02.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.973+0000 7f75a3a87800 20 add_watcher() i=7 2024-09-12T00:54:02.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.973+0000 7f75a3a87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:02.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.974+0000 7f74577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 5 note: GC not initialized 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f74567e4640 20 reqs_thread_entry: start 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 20 Filter name: none 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f73c7fff640 20 reqs_thread_entry: start 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:02.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:02.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:02.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:54:02.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.976+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:02.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.976+0000 7f75a3a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:02.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.976+0000 7f75a3a87800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:02.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.976+0000 7f75a3a87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:02.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.976+0000 7f75a3a87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:02.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.976+0000 7f75a3a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:54:02.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.977+0000 7f75a3a87800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:54:02.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.981+0000 7f75a3a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:02.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.981+0000 7f75a3a87800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:02.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.981+0000 7f75a3a87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:02.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.981+0000 7f75a3a87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:54:02.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464430 cookie 94096410082576 notifier 7880 bl.length()=911 2024-09-12T00:54:02.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:02.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:02.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:02.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:54:02.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:54:02.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:54:02.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:54:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f75a3a87800 time 2024-09-12T00:54:02.985916+0000 2024-09-12T00:54:02.983 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:02.984 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:02.984 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f75a6f8c71a] 2024-09-12T00:54:02.984 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75a6f8c8d8] 2024-09-12T00:54:02.984 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55948541d641] 2024-09-12T00:54:02.984 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55948542d38a] 2024-09-12T00:54:02.984 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:54:02.984 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f75a5c29590] 2024-09-12T00:54:02.984 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:54:02.984 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.985+0000 7f75a3a87800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f75a3a87800 time 2024-09-12T00:54:02.985916+0000 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f75a6f8c71a] 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75a6f8c8d8] 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55948541d641] 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55948542d38a] 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f75a5c29590] 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:54:02.985 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:02.986 INFO:tasks.workunit.client.0.smithi083.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:54:02.986 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f75a3a87800 thread_name:radosgw-admin 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f75a5c3e6f0] 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f75a5c8b99c] 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f75a6f8c774] 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75a6f8c8d8] 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55948541d641] 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55948542d38a] 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:54:03.009 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f75a5c29590] 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:02.986+0000 7f75a3a87800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f75a3a87800 thread_name:radosgw-admin 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f75a5c3e6f0] 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f75a5c8b99c] 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f75a6f8c774] 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75a6f8c8d8] 2024-09-12T00:54:03.010 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55948541d641] 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55948542d38a] 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f75a5c29590] 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:54:02.929+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:54:02.929+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:54:02.929+0000 7f75a1571640 10 monclient(hunting): handle_auth_done global_id 8337 payload 274 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:54:02.929+0000 7f75a1571640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.011 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:54:02.929+0000 7f75a1571640 1 monclient: found mon.noname-a 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:54:02.929+0000 7f75a1571640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: dump: 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.012 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:54:02.929+0000 7f75a3a87800 5 monclient: authenticate success, global_id 8337 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:54:02.929+0000 7f75a3a87800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:54:02.929+0000 7f75a3a87800 4 set_mon_vals no callback set 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: dump: 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.013 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:54:02.930+0000 7f75a3a87800 10 monclient: shutdown 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 asok(0x559486e74630) unregister_commands rotate-key 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:54:02.930+0000 7f75a3a87800 10 monclient: build_initial_monmap 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:54:02.930+0000 7f75a3a87800 1 build_initial for_mkfs: 0 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:54:02.930+0000 7f75a3a87800 10 monclient: monmap: 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:54:03.014 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding auth protocol: cephx 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding auth protocol: cephx 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding auth protocol: cephx 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.015 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:54:02.930+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:54:02.930+0000 7f75a3a87800 1 librados: starting msgr at 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:54:02.930+0000 7f75a3a87800 1 librados: starting objecter 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 asok(0x559486e74630) register_command objecter_requests hook 0x5594870c5bd0 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:54:02.931+0000 7f75a3a87800 1 librados: setting wanted keys 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:54:02.931+0000 7f75a3a87800 1 librados: calling monclient init 2024-09-12T00:54:03.016 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient: init 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding auth protocol: cephx 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding auth protocol: cephx 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding auth protocol: cephx 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.017 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:54:02.931+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:54:02.931+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 asok(0x559486e74630) register_command rotate-key hook 0x559487093c28 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-b con 0x559486f4ba10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-c con 0x559486fd6a30 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-a con 0x559486fd9880 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:03.018 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): authenticate will time out at 2196.200598s 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): get_auth_request con 0x559486fd6a30 auth_method 0 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): get_auth_request con 0x559486fd9880 auth_method 0 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.019 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): handle_auth_done global_id 7871 payload 824 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:54:02.931+0000 7f75a0d70640 1 monclient: found mon.noname-c 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: dump: 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.020 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:54:02.932+0000 7f75a3a87800 5 monclient: authenticate success, global_id 7871 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: dump: 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.021 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:54:02.932+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:54:02.932+0000 7f748f606640 4 set_mon_vals no callback set 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:54:02.932+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:54:02.932+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:54:02.932+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:54:02.932+0000 7f75a3a87800 1 librados: init done 2024-09-12T00:54:03.022 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:54:02.934+0000 7f748de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:54:02.934+0000 7f748de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:54:02.934+0000 7f748de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:54:02.934+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f7488076470 auth_method 0 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:54:02.934+0000 7f75a1d72640 10 monclient: get_auth_request con 0x55948709c820 auth_method 0 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:54:02.935+0000 7f75a1571640 10 monclient: get_auth_request con 0x5594870e05c0 auth_method 0 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:54:02.937+0000 7f75a0d70640 10 monclient: get_auth_request con 0x5594870e3e70 auth_method 0 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:54:02.937+0000 7f75a3a87800 10 monclient: build_initial_monmap 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:54:02.937+0000 7f75a3a87800 1 build_initial for_mkfs: 0 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:54:02.937+0000 7f75a3a87800 10 monclient: monmap: 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:03.023 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding auth protocol: cephx 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding auth protocol: cephx 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding auth protocol: cephx 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.024 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:54:02.937+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 asok(0x559486e74630) register_command objecter_requests cmddesc objecter_requests hook 0x5594870ed2e0 EEXIST 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient: init 2024-09-12T00:54:03.025 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding auth protocol: cephx 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding auth protocol: cephx 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding auth protocol: cephx 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.026 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:54:02.938+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:54:02.938+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 asok(0x559486e74630) register_command rotate-key cmddesc rotate-key hook 0x5594870e8990 EEXIST 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-b con 0x559487110fd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-a con 0x5594871132a0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-c con 0x55948710f7a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): authenticate will time out at 2196.207731s 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): get_auth_request con 0x5594871132a0 auth_method 0 2024-09-12T00:54:03.027 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): get_auth_request con 0x55948710f7a0 auth_method 0 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.028 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:54:02.938+0000 7f75a1571640 10 monclient(hunting): get_auth_request con 0x559487110fd0 auth_method 0 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:54:02.938+0000 7f75a1571640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:54:02.938+0000 7f75a1571640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:54:02.938+0000 7f75a1571640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:54:02.939+0000 7f75a0d70640 10 monclient(hunting): handle_auth_done global_id 8343 payload 824 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:54:02.939+0000 7f75a0d70640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:54:02.939+0000 7f75a0d70640 1 monclient: found mon.noname-a 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:54:02.939+0000 7f75a0d70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: dump: 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.029 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: dump: 2024-09-12T00:54:03.030 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:54:02.939+0000 7f75a3a87800 5 monclient: authenticate success, global_id 8343 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:54:02.939+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:54:02.939+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:54:02.939+0000 7f75a2573640 4 set_mon_vals no callback set 2024-09-12T00:54:03.031 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:54:02.939+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:54:02.939+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:54:02.941+0000 7f7486ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:54:02.941+0000 7f7486ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:54:02.941+0000 7f7486ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:54:02.941+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f747c076380 auth_method 0 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:54:02.941+0000 7f75a3a87800 10 monclient: get_monmap_and_config 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:54:02.941+0000 7f75a3a87800 10 monclient: build_initial_monmap 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:54:02.941+0000 7f75a3a87800 1 build_initial for_mkfs: 0 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:54:02.941+0000 7f75a3a87800 10 monclient: monmap: 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:54:03.032 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding auth protocol: cephx 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding auth protocol: cephx 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding auth protocol: cephx 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.033 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:54:02.941+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:54:02.941+0000 7f75a3a87800 10 monclient: init 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding auth protocol: cephx 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding auth protocol: cephx 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding auth protocol: cephx 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.034 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:54:02.942+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:54:02.942+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:54:02.942+0000 7f75a3a87800 5 asok(0x559486e74630) register_command rotate-key cmddesc rotate-key hook 0x7ffd0931b8a8 EEXIST 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:03.035 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-b con 0x559487164ef0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-a con 0x559487135d10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-c con 0x559487160320 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): authenticate will time out at 2196.211300s 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): get_auth_request con 0x559487135d10 auth_method 0 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.036 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): get_auth_request con 0x559487160320 auth_method 0 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): handle_auth_done global_id 8346 payload 274 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:54:02.942+0000 7f75a0d70640 1 monclient: found mon.noname-a 2024-09-12T00:54:03.037 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: dump: 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.038 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:54:02.942+0000 7f75a3a87800 5 monclient: authenticate success, global_id 8346 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: dump: 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.039 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:54:02.942+0000 7f75a3a87800 4 set_mon_vals no callback set 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:54:02.943+0000 7f75a3a87800 10 monclient: shutdown 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:54:02.943+0000 7f75a3a87800 10 monclient: build_initial_monmap 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 build_initial for_mkfs: 0 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:54:02.943+0000 7f75a3a87800 10 monclient: monmap: 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.040 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding auth protocol: cephx 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding auth protocol: cephx 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding auth protocol: cephx 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.041 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:54:02.943+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 librados: starting msgr at 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 librados: starting objecter 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 asok(0x559486e74630) register_command objecter_requests cmddesc objecter_requests hook 0x559487117490 EEXIST 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 librados: setting wanted keys 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 librados: calling monclient init 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:54:02.943+0000 7f75a3a87800 10 monclient: init 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding auth protocol: cephx 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding auth protocol: cephx 2024-09-12T00:54:03.042 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding auth protocol: cephx 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:54:02.944+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.043 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:54:02.944+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:54:02.944+0000 7f75a3a87800 5 asok(0x559486e74630) register_command rotate-key cmddesc rotate-key hook 0x559487128ec8 EEXIST 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-a con 0x559487135d10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-b con 0x559487160320 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-c con 0x559487164ef0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): authenticate will time out at 2196.213429s 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): get_auth_request con 0x559487135d10 auth_method 0 2024-09-12T00:54:03.044 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): get_auth_request con 0x559487164ef0 auth_method 0 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): handle_auth_done global_id 7880 payload 824 2024-09-12T00:54:03.045 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:54:02.944+0000 7f75a1d72640 1 monclient: found mon.noname-c 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: dump: 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.046 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:54:02.945+0000 7f75a3a87800 5 monclient: authenticate success, global_id 7880 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:54:02.945+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:54:02.945+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: dump: 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.047 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:54:02.945+0000 7f7484ff9640 4 set_mon_vals no callback set 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:54:02.945+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:54:02.945+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:54:02.945+0000 7f75a3a87800 1 librados: init done 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:54:02.945+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cr dump hook 0x7f75980a3c38 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:54:02.946+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:54:02.947+0000 7f7472ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:54:02.947+0000 7f7472ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:54:02.947+0000 7f7472ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.048 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:54:02.947+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f746c076470 auth_method 0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:54:02.948+0000 7f75a0d70640 10 monclient: get_auth_request con 0x55948717ee70 auth_method 0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:54:02.948+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:54:02.948+0000 7f75a3a87800 20 realm 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:54:02.948+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:54:02.949+0000 7f75a3a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:54:02.949+0000 7f75a1571640 10 monclient: get_auth_request con 0x559487183020 auth_method 0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:54:02.950+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:54:02.950+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.049 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:54:02.950+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:54:02.950+0000 7f75a3a87800 20 searching for the correct realm 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:54:02.950+0000 7f75a0d70640 10 monclient: get_auth_request con 0x559487188280 auth_method 0 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:54:02.951+0000 7f75a1d72640 10 monclient: get_auth_request con 0x7f75980d5b30 auth_method 0 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:54:02.952+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f7594020070 auth_method 0 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:54:02.953+0000 7f75a0d70640 10 monclient: get_auth_request con 0x7f7598001000 auth_method 0 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:54:02.954+0000 7f75a1d72640 0 -- 172.21.15.83:0/3890581591 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f75980d5b30 msgr2=0x7f75980a3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:54:02.954+0000 7f7472ffd640 1 client.7880.objecter ms_handle_reset 0x7f75980d5b30 session 0x7f7598005040 osd.2 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:54:02.954+0000 7f7472ffd640 10 monclient: _renew_subs 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:54:02.954+0000 7f7472ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:54:02.954+0000 7f75a1d72640 10 monclient: get_auth_request con 0x7f746c086710 auth_method 0 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:54:02.955+0000 7f75a1d72640 10 monclient: get_auth_request con 0x7f759403cc00 auth_method 0 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:54:02.956+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f759c02b020 auth_method 0 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:54:02.957+0000 7f75a1571640 0 -- 172.21.15.83:0/3890581591 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f759c02b020 msgr2=0x7f759c0643c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:03.050 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:54:02.957+0000 7f7472ffd640 1 client.7880.objecter ms_handle_reset 0x7f759c02b020 session 0x7f759c065df0 osd.3 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:54:02.957+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f75980d5b30 auth_method 0 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:03.051 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 zone default found 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:54:02.962+0000 7f75a3a87800 4 Realm: () 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:54:02.962+0000 7f75a3a87800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:54:02.962+0000 7f75a3a87800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:54:02.962+0000 7f75a3a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 zonegroup default 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:54:02.963+0000 7f75a3a87800 20 started sync module instance, tier type = 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:54:02.963+0000 7f75a3a87800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:03.052 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=0 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=1 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=2 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=3 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=4 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=5 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=6 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:54:02.973+0000 7f75a3a87800 20 add_watcher() i=7 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:54:02.973+0000 7f75a3a87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding auth protocol: cephx 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding auth protocol: cephx 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding auth protocol: cephx 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.053 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:54:02.974+0000 7f74577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:54:02.975+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:03.054 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cache list hook 0x55948714e2c0 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cache inspect hook 0x55948714e2c0 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cache erase hook 0x55948714e2c0 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cache zap hook 0x55948714e2c0 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 note: GC not initialized 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:54:02.975+0000 7f74567e4640 20 reqs_thread_entry: start 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command sync trace show hook 0x7f759c004260 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command sync trace history hook 0x7f759c004260 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command sync trace active hook 0x7f759c004260 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command sync trace active_short hook 0x7f759c004260 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 Filter name: none 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:54:02.975+0000 7f73c7fff640 20 reqs_thread_entry: start 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:54:02.975+0000 7f75a3a87800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:03.055 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:54:02.975+0000 7f75a3a87800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:54:02.975+0000 7f75a3a87800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:54:02.975+0000 7f75a3a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:54:02.976+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:54:02.977+0000 7f75a3a87800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:54:03.056 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:54:02.981+0000 7f75a3a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:54:02.981+0000 7f75a3a87800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:54:02.981+0000 7f75a3a87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:54:02.981+0000 7f75a3a87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464430 cookie 94096410082576 notifier 7880 bl.length()=911 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:54:02.985+0000 7f75a3a87800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f75a3a87800 time 2024-09-12T00:54:02.985916+0000 2024-09-12T00:54:03.057 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f75a6f8c71a] 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75a6f8c8d8] 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55948541d641] 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55948542d38a] 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f75a5c29590] 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:54:02.986+0000 7f75a3a87800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f75a3a87800 thread_name:radosgw-admin 2024-09-12T00:54:03.058 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f75a5c3e6f0] 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f75a5c8b99c] 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f75a6f8c774] 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75a6f8c8d8] 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55948541d641] 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55948542d38a] 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f75a5c29590] 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:54:03.059 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:03.060 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:03.061 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:54:03.062 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:54:03.063 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:54:03.064 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:03.065 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:03.066 INFO:tasks.workunit.client.0.smithi083.stderr: 7f73c7fff640 / http_manager 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f74567e4640 / http_manager 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f74577e6640 / rgw_dt_lg_renew 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f7472ffd640 / ms_dispatch 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f7484ff9640 / io_context_pool 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f7486ffd640 / ms_dispatch 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f748de03640 / ms_dispatch 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f748f606640 / io_context_pool 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a0d70640 / msgr-worker-2 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a1571640 / msgr-worker-1 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a1d72640 / msgr-worker-0 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a2573640 / io_context_pool 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a3a87800 / radosgw-admin 2024-09-12T00:54:03.067 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/log/ceph/ceph-client.admin.155508.log 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr:--- begin dump of recent events --- 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: -499> 2024-09-12T00:54:02.929+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: -498> 2024-09-12T00:54:02.929+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: -497> 2024-09-12T00:54:02.929+0000 7f75a1571640 10 monclient(hunting): handle_auth_done global_id 8337 payload 274 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: -496> 2024-09-12T00:54:02.929+0000 7f75a1571640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: -495> 2024-09-12T00:54:02.929+0000 7f75a1571640 1 monclient: found mon.noname-a 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: -494> 2024-09-12T00:54:02.929+0000 7f75a1571640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: -493> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.068 INFO:tasks.workunit.client.0.smithi083.stderr: -492> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr: -491> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: dump: 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr: -490> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.069 INFO:tasks.workunit.client.0.smithi083.stderr: -489> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr: -488> 2024-09-12T00:54:02.929+0000 7f75a3a87800 5 monclient: authenticate success, global_id 8337 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr: -487> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr: -486> 2024-09-12T00:54:02.929+0000 7f75a3a87800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr: -485> 2024-09-12T00:54:02.929+0000 7f75a3a87800 4 set_mon_vals no callback set 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr: -484> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr: -483> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr: -482> 2024-09-12T00:54:02.929+0000 7f748f606640 10 monclient: dump: 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.070 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr: -481> 2024-09-12T00:54:02.930+0000 7f75a3a87800 10 monclient: shutdown 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr: -480> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 asok(0x559486e74630) unregister_commands rotate-key 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr: -479> 2024-09-12T00:54:02.930+0000 7f75a3a87800 10 monclient: build_initial_monmap 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr: -478> 2024-09-12T00:54:02.930+0000 7f75a3a87800 1 build_initial for_mkfs: 0 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr: -477> 2024-09-12T00:54:02.930+0000 7f75a3a87800 10 monclient: monmap: 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:54:03.071 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: -476> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding auth protocol: cephx 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: -475> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding auth protocol: cephx 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: -474> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding auth protocol: cephx 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: -473> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: -472> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: -471> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: -470> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: -469> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.072 INFO:tasks.workunit.client.0.smithi083.stderr: -468> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -467> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -466> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -465> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -464> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -463> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: crc 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -462> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 AuthRegistry(0x5594870996f0) adding con mode: secure 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -461> 2024-09-12T00:54:02.930+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -460> 2024-09-12T00:54:02.930+0000 7f75a3a87800 1 librados: starting msgr at 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -459> 2024-09-12T00:54:02.930+0000 7f75a3a87800 1 librados: starting objecter 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -458> 2024-09-12T00:54:02.930+0000 7f75a3a87800 5 asok(0x559486e74630) register_command objecter_requests hook 0x5594870c5bd0 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -457> 2024-09-12T00:54:02.931+0000 7f75a3a87800 1 librados: setting wanted keys 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -456> 2024-09-12T00:54:02.931+0000 7f75a3a87800 1 librados: calling monclient init 2024-09-12T00:54:03.073 INFO:tasks.workunit.client.0.smithi083.stderr: -455> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient: init 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -454> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding auth protocol: cephx 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -453> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding auth protocol: cephx 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -452> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding auth protocol: cephx 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -451> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -450> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -449> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -448> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -447> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -446> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -445> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -444> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -443> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.074 INFO:tasks.workunit.client.0.smithi083.stderr: -442> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -441> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: crc 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -440> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 AuthRegistry(0x559487093ae0) adding con mode: secure 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -439> 2024-09-12T00:54:02.931+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -438> 2024-09-12T00:54:02.931+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -437> 2024-09-12T00:54:02.931+0000 7f75a3a87800 5 asok(0x559486e74630) register_command rotate-key hook 0x559487093c28 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -436> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -435> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -434> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-b con 0x559486f4ba10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -433> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-c con 0x559486fd6a30 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -432> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-a con 0x559486fd9880 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -431> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -430> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.075 INFO:tasks.workunit.client.0.smithi083.stderr: -429> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -428> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -427> 2024-09-12T00:54:02.931+0000 7f75a3a87800 10 monclient(hunting): authenticate will time out at 2196.200598s 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -426> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): get_auth_request con 0x559486fd6a30 auth_method 0 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -425> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -424> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -423> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -422> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): get_auth_request con 0x559486fd9880 auth_method 0 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -421> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -420> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -419> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -418> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -417> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -416> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -415> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.076 INFO:tasks.workunit.client.0.smithi083.stderr: -414> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr: -413> 2024-09-12T00:54:02.931+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr: -412> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient(hunting): handle_auth_done global_id 7871 payload 824 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr: -411> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr: -410> 2024-09-12T00:54:02.931+0000 7f75a0d70640 1 monclient: found mon.noname-c 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr: -409> 2024-09-12T00:54:02.931+0000 7f75a0d70640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr: -408> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr: -407> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr: -406> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: dump: 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.077 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr: -405> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr: -404> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr: -403> 2024-09-12T00:54:02.932+0000 7f75a3a87800 5 monclient: authenticate success, global_id 7871 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr: -402> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr: -401> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr: -400> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr: -399> 2024-09-12T00:54:02.932+0000 7f748de03640 10 monclient: dump: 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.078 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr: -398> 2024-09-12T00:54:02.932+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr: -397> 2024-09-12T00:54:02.932+0000 7f748f606640 4 set_mon_vals no callback set 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr: -396> 2024-09-12T00:54:02.932+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr: -395> 2024-09-12T00:54:02.932+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.079 INFO:tasks.workunit.client.0.smithi083.stderr: -394> 2024-09-12T00:54:02.932+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -393> 2024-09-12T00:54:02.932+0000 7f75a3a87800 1 librados: init done 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -392> 2024-09-12T00:54:02.934+0000 7f748de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -391> 2024-09-12T00:54:02.934+0000 7f748de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -390> 2024-09-12T00:54:02.934+0000 7f748de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -389> 2024-09-12T00:54:02.934+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f7488076470 auth_method 0 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -388> 2024-09-12T00:54:02.934+0000 7f75a1d72640 10 monclient: get_auth_request con 0x55948709c820 auth_method 0 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -387> 2024-09-12T00:54:02.935+0000 7f75a1571640 10 monclient: get_auth_request con 0x5594870e05c0 auth_method 0 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -386> 2024-09-12T00:54:02.937+0000 7f75a0d70640 10 monclient: get_auth_request con 0x5594870e3e70 auth_method 0 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -385> 2024-09-12T00:54:02.937+0000 7f75a3a87800 10 monclient: build_initial_monmap 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -384> 2024-09-12T00:54:02.937+0000 7f75a3a87800 1 build_initial for_mkfs: 0 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr: -383> 2024-09-12T00:54:02.937+0000 7f75a3a87800 10 monclient: monmap: 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:03.080 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr: -382> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding auth protocol: cephx 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr: -381> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding auth protocol: cephx 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr: -380> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding auth protocol: cephx 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr: -379> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr: -378> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr: -377> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.081 INFO:tasks.workunit.client.0.smithi083.stderr: -376> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -375> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -374> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -373> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -372> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -371> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -370> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -369> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: crc 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -368> 2024-09-12T00:54:02.937+0000 7f75a3a87800 5 AuthRegistry(0x5594870e9890) adding con mode: secure 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -367> 2024-09-12T00:54:02.937+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -366> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 asok(0x559486e74630) register_command objecter_requests cmddesc objecter_requests hook 0x5594870ed2e0 EEXIST 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -365> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient: init 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -364> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding auth protocol: cephx 2024-09-12T00:54:03.082 INFO:tasks.workunit.client.0.smithi083.stderr: -363> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding auth protocol: cephx 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -362> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding auth protocol: cephx 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -361> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -360> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -359> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -358> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -357> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -356> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -355> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -354> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -353> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -352> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -351> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: crc 2024-09-12T00:54:03.083 INFO:tasks.workunit.client.0.smithi083.stderr: -350> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 AuthRegistry(0x5594870e8848) adding con mode: secure 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -349> 2024-09-12T00:54:02.938+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -348> 2024-09-12T00:54:02.938+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -347> 2024-09-12T00:54:02.938+0000 7f75a3a87800 5 asok(0x559486e74630) register_command rotate-key cmddesc rotate-key hook 0x5594870e8990 EEXIST 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -346> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -345> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -344> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-b con 0x559487110fd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -343> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-a con 0x5594871132a0 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -342> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-c con 0x55948710f7a0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -341> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -340> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -339> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -338> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -337> 2024-09-12T00:54:02.938+0000 7f75a3a87800 10 monclient(hunting): authenticate will time out at 2196.207731s 2024-09-12T00:54:03.084 INFO:tasks.workunit.client.0.smithi083.stderr: -336> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): get_auth_request con 0x5594871132a0 auth_method 0 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -335> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -334> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -333> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -332> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): get_auth_request con 0x55948710f7a0 auth_method 0 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -331> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -330> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -329> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -328> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -327> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -326> 2024-09-12T00:54:02.938+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -325> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -324> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -323> 2024-09-12T00:54:02.938+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.085 INFO:tasks.workunit.client.0.smithi083.stderr: -322> 2024-09-12T00:54:02.938+0000 7f75a1571640 10 monclient(hunting): get_auth_request con 0x559487110fd0 auth_method 0 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -321> 2024-09-12T00:54:02.938+0000 7f75a1571640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -320> 2024-09-12T00:54:02.938+0000 7f75a1571640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -319> 2024-09-12T00:54:02.938+0000 7f75a1571640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -318> 2024-09-12T00:54:02.939+0000 7f75a0d70640 10 monclient(hunting): handle_auth_done global_id 8343 payload 824 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -317> 2024-09-12T00:54:02.939+0000 7f75a0d70640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -316> 2024-09-12T00:54:02.939+0000 7f75a0d70640 1 monclient: found mon.noname-a 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -315> 2024-09-12T00:54:02.939+0000 7f75a0d70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -314> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -313> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr: -312> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: dump: 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.086 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr: -311> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr: -310> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr: -309> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr: -308> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr: -307> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr: -306> 2024-09-12T00:54:02.939+0000 7f7486ffd640 10 monclient: dump: 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.087 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.088 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.088 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.088 INFO:tasks.workunit.client.0.smithi083.stderr: -305> 2024-09-12T00:54:02.939+0000 7f75a3a87800 5 monclient: authenticate success, global_id 8343 2024-09-12T00:54:03.088 INFO:tasks.workunit.client.0.smithi083.stderr: -304> 2024-09-12T00:54:02.939+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -303> 2024-09-12T00:54:02.939+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -302> 2024-09-12T00:54:02.939+0000 7f75a2573640 4 set_mon_vals no callback set 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -301> 2024-09-12T00:54:02.939+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -300> 2024-09-12T00:54:02.939+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -299> 2024-09-12T00:54:02.941+0000 7f7486ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -298> 2024-09-12T00:54:02.941+0000 7f7486ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -297> 2024-09-12T00:54:02.941+0000 7f7486ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -296> 2024-09-12T00:54:02.941+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f747c076380 auth_method 0 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -295> 2024-09-12T00:54:02.941+0000 7f75a3a87800 10 monclient: get_monmap_and_config 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -294> 2024-09-12T00:54:02.941+0000 7f75a3a87800 10 monclient: build_initial_monmap 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -293> 2024-09-12T00:54:02.941+0000 7f75a3a87800 1 build_initial for_mkfs: 0 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr: -292> 2024-09-12T00:54:02.941+0000 7f75a3a87800 10 monclient: monmap: 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:54:03.089 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr: -291> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding auth protocol: cephx 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr: -290> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding auth protocol: cephx 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr: -289> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding auth protocol: cephx 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr: -288> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr: -287> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.090 INFO:tasks.workunit.client.0.smithi083.stderr: -286> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -285> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -284> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -283> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -282> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -281> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -280> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -279> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -278> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: crc 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -277> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x559487130a00) adding con mode: secure 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -276> 2024-09-12T00:54:02.941+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -275> 2024-09-12T00:54:02.941+0000 7f75a3a87800 10 monclient: init 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -274> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding auth protocol: cephx 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -273> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding auth protocol: cephx 2024-09-12T00:54:03.091 INFO:tasks.workunit.client.0.smithi083.stderr: -272> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding auth protocol: cephx 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -271> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -270> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -269> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -268> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -267> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -266> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -265> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -264> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -263> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -262> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -261> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: crc 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -260> 2024-09-12T00:54:02.941+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931b760) adding con mode: secure 2024-09-12T00:54:03.092 INFO:tasks.workunit.client.0.smithi083.stderr: -259> 2024-09-12T00:54:02.942+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -258> 2024-09-12T00:54:02.942+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -257> 2024-09-12T00:54:02.942+0000 7f75a3a87800 5 asok(0x559486e74630) register_command rotate-key cmddesc rotate-key hook 0x7ffd0931b8a8 EEXIST 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -256> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -255> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -254> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-b con 0x559487164ef0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -253> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-a con 0x559487135d10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -252> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-c con 0x559487160320 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -251> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -250> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -249> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -248> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -247> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient(hunting): authenticate will time out at 2196.211300s 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -246> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): get_auth_request con 0x559487135d10 auth_method 0 2024-09-12T00:54:03.093 INFO:tasks.workunit.client.0.smithi083.stderr: -245> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -244> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -243> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -242> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): get_auth_request con 0x559487160320 auth_method 0 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -241> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -240> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -239> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -238> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -237> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -236> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -235> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -234> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -233> 2024-09-12T00:54:02.942+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -232> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient(hunting): handle_auth_done global_id 8346 payload 274 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -231> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.094 INFO:tasks.workunit.client.0.smithi083.stderr: -230> 2024-09-12T00:54:02.942+0000 7f75a0d70640 1 monclient: found mon.noname-a 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr: -229> 2024-09-12T00:54:02.942+0000 7f75a0d70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.83:3300/0 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr: -228> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr: -227> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr: -226> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: dump: 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr: -225> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.095 INFO:tasks.workunit.client.0.smithi083.stderr: -224> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr: -223> 2024-09-12T00:54:02.942+0000 7f75a3a87800 5 monclient: authenticate success, global_id 8346 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr: -222> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr: -221> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr: -220> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr: -219> 2024-09-12T00:54:02.942+0000 7f7484ff9640 10 monclient: dump: 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.096 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr: -218> 2024-09-12T00:54:02.942+0000 7f75a3a87800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr: -217> 2024-09-12T00:54:02.942+0000 7f75a3a87800 4 set_mon_vals no callback set 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr: -216> 2024-09-12T00:54:02.943+0000 7f75a3a87800 10 monclient: shutdown 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr: -215> 2024-09-12T00:54:02.943+0000 7f75a3a87800 10 monclient: build_initial_monmap 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr: -214> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 build_initial for_mkfs: 0 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr: -213> 2024-09-12T00:54:02.943+0000 7f75a3a87800 10 monclient: monmap: 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 0 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 0.000000 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:created 0.000000 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.noname-a 2024-09-12T00:54:03.097 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-b 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.noname-c 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -212> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding auth protocol: cephx 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -211> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding auth protocol: cephx 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -210> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding auth protocol: cephx 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -209> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -208> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -207> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -206> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -205> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -204> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -203> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -202> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -201> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -200> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.098 INFO:tasks.workunit.client.0.smithi083.stderr: -199> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: crc 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -198> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487161120) adding con mode: secure 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -197> 2024-09-12T00:54:02.943+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -196> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 librados: starting msgr at 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -195> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 librados: starting objecter 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -194> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 asok(0x559486e74630) register_command objecter_requests cmddesc objecter_requests hook 0x559487117490 EEXIST 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -193> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 librados: setting wanted keys 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -192> 2024-09-12T00:54:02.943+0000 7f75a3a87800 1 librados: calling monclient init 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -191> 2024-09-12T00:54:02.943+0000 7f75a3a87800 10 monclient: init 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -190> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding auth protocol: cephx 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -189> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding auth protocol: cephx 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -188> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding auth protocol: cephx 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -187> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -186> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -185> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -184> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.099 INFO:tasks.workunit.client.0.smithi083.stderr: -183> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -182> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -181> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -180> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -179> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -178> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -177> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: crc 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -176> 2024-09-12T00:54:02.943+0000 7f75a3a87800 5 AuthRegistry(0x559487128d80) adding con mode: secure 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -175> 2024-09-12T00:54:02.944+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -174> 2024-09-12T00:54:02.944+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -173> 2024-09-12T00:54:02.944+0000 7f75a3a87800 5 asok(0x559486e74630) register_command rotate-key cmddesc rotate-key hook 0x559487128ec8 EEXIST 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -172> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:03.100 INFO:tasks.workunit.client.0.smithi083.stderr: -171> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -170> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-a con 0x559487135d10 addr [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -169> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-b con 0x559487160320 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -168> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): picked mon.noname-c con 0x559487164ef0 addr [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -167> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -166> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -165> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -164> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -163> 2024-09-12T00:54:02.944+0000 7f75a3a87800 10 monclient(hunting): authenticate will time out at 2196.213429s 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -162> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): get_auth_request con 0x559487135d10 auth_method 0 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -161> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -160> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -159> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -158> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): get_auth_request con 0x559487164ef0 auth_method 0 2024-09-12T00:54:03.101 INFO:tasks.workunit.client.0.smithi083.stderr: -157> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -156> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -155> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -154> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -153> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -152> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -151> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -150> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -149> 2024-09-12T00:54:02.944+0000 7f75a1571640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -148> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient(hunting): handle_auth_done global_id 7880 payload 824 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -147> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient: _finish_hunting 0 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -146> 2024-09-12T00:54:02.944+0000 7f75a1d72640 1 monclient: found mon.noname-c 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -145> 2024-09-12T00:54:02.944+0000 7f75a1d72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -144> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -143> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:03.102 INFO:tasks.workunit.client.0.smithi083.stderr: -142> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: dump: 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr: -141> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: _finish_auth 0 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr: -140> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr: -139> 2024-09-12T00:54:02.945+0000 7f75a3a87800 5 monclient: authenticate success, global_id 7880 2024-09-12T00:54:03.103 INFO:tasks.workunit.client.0.smithi083.stderr: -138> 2024-09-12T00:54:02.945+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr: -137> 2024-09-12T00:54:02.945+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr: -136> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr: -135> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr: -134> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr: -133> 2024-09-12T00:54:02.945+0000 7f7472ffd640 10 monclient: dump: 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr:epoch 1 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr:fsid a5119e9a-d5dd-4b87-aa73-8e94e0fd509b 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr:last_changed 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr:created 2024-09-12T00:28:59.444681+0000 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr:election_strategy: 1 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr:0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-12T00:54:03.104 INFO:tasks.workunit.client.0.smithi083.stderr:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -132> 2024-09-12T00:54:02.945+0000 7f7484ff9640 4 set_mon_vals no callback set 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -131> 2024-09-12T00:54:02.945+0000 7f75a3a87800 10 monclient: _renew_subs 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -130> 2024-09-12T00:54:02.945+0000 7f75a3a87800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -129> 2024-09-12T00:54:02.945+0000 7f75a3a87800 1 librados: init done 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -128> 2024-09-12T00:54:02.945+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cr dump hook 0x7f75980a3c38 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -127> 2024-09-12T00:54:02.946+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -126> 2024-09-12T00:54:02.947+0000 7f7472ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -125> 2024-09-12T00:54:02.947+0000 7f7472ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -124> 2024-09-12T00:54:02.947+0000 7f7472ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.83:6832/2589227164,v1:172.21.15.83:6833/2589227164] 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -123> 2024-09-12T00:54:02.947+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f746c076470 auth_method 0 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -122> 2024-09-12T00:54:02.948+0000 7f75a0d70640 10 monclient: get_auth_request con 0x55948717ee70 auth_method 0 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -121> 2024-09-12T00:54:02.948+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.105 INFO:tasks.workunit.client.0.smithi083.stderr: -120> 2024-09-12T00:54:02.948+0000 7f75a3a87800 20 realm 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -119> 2024-09-12T00:54:02.948+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -118> 2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -117> 2024-09-12T00:54:02.949+0000 7f75a3a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -116> 2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -115> 2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -114> 2024-09-12T00:54:02.949+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -113> 2024-09-12T00:54:02.949+0000 7f75a1571640 10 monclient: get_auth_request con 0x559487183020 auth_method 0 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -112> 2024-09-12T00:54:02.950+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -111> 2024-09-12T00:54:02.950+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -110> 2024-09-12T00:54:02.950+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -109> 2024-09-12T00:54:02.950+0000 7f75a3a87800 20 searching for the correct realm 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -108> 2024-09-12T00:54:02.950+0000 7f75a0d70640 10 monclient: get_auth_request con 0x559487188280 auth_method 0 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -107> 2024-09-12T00:54:02.951+0000 7f75a1d72640 10 monclient: get_auth_request con 0x7f75980d5b30 auth_method 0 2024-09-12T00:54:03.106 INFO:tasks.workunit.client.0.smithi083.stderr: -106> 2024-09-12T00:54:02.952+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f7594020070 auth_method 0 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -105> 2024-09-12T00:54:02.953+0000 7f75a0d70640 10 monclient: get_auth_request con 0x7f7598001000 auth_method 0 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -104> 2024-09-12T00:54:02.954+0000 7f75a1d72640 0 -- 172.21.15.83:0/3890581591 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f75980d5b30 msgr2=0x7f75980a3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -103> 2024-09-12T00:54:02.954+0000 7f7472ffd640 1 client.7880.objecter ms_handle_reset 0x7f75980d5b30 session 0x7f7598005040 osd.2 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -102> 2024-09-12T00:54:02.954+0000 7f7472ffd640 10 monclient: _renew_subs 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -101> 2024-09-12T00:54:02.954+0000 7f7472ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.83:3301/0 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -100> 2024-09-12T00:54:02.954+0000 7f75a1d72640 10 monclient: get_auth_request con 0x7f746c086710 auth_method 0 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -99> 2024-09-12T00:54:02.955+0000 7f75a1d72640 10 monclient: get_auth_request con 0x7f759403cc00 auth_method 0 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -98> 2024-09-12T00:54:02.956+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f759c02b020 auth_method 0 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -97> 2024-09-12T00:54:02.957+0000 7f75a1571640 0 -- 172.21.15.83:0/3890581591 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f759c02b020 msgr2=0x7f759c0643c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -96> 2024-09-12T00:54:02.957+0000 7f7472ffd640 1 client.7880.objecter ms_handle_reset 0x7f759c02b020 session 0x7f759c065df0 osd.3 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -95> 2024-09-12T00:54:02.957+0000 7f75a1571640 10 monclient: get_auth_request con 0x7f75980d5b30 auth_method 0 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -94> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -93> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:03.107 INFO:tasks.workunit.client.0.smithi083.stderr: -92> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -91> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -90> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -89> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -88> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -87> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -86> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -85> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -84> 2024-09-12T00:54:02.961+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -83> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -82> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 zone default found 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -81> 2024-09-12T00:54:02.962+0000 7f75a3a87800 4 Realm: () 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -80> 2024-09-12T00:54:02.962+0000 7f75a3a87800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -79> 2024-09-12T00:54:02.962+0000 7f75a3a87800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:03.108 INFO:tasks.workunit.client.0.smithi083.stderr: -78> 2024-09-12T00:54:02.962+0000 7f75a3a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -77> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 zonegroup default 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -76> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -75> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -74> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -73> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -72> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -71> 2024-09-12T00:54:02.962+0000 7f75a3a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -70> 2024-09-12T00:54:02.963+0000 7f75a3a87800 20 started sync module instance, tier type = 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -69> 2024-09-12T00:54:02.963+0000 7f75a3a87800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -68> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=0 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -67> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=1 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -66> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=2 2024-09-12T00:54:03.109 INFO:tasks.workunit.client.0.smithi083.stderr: -65> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=3 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -64> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=4 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -63> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=5 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -62> 2024-09-12T00:54:02.972+0000 7f75a3a87800 20 add_watcher() i=6 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -61> 2024-09-12T00:54:02.973+0000 7f75a3a87800 20 add_watcher() i=7 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -60> 2024-09-12T00:54:02.973+0000 7f75a3a87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -59> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding auth protocol: cephx 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -58> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding auth protocol: cephx 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -57> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding auth protocol: cephx 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -56> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -55> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -54> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -53> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -52> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.110 INFO:tasks.workunit.client.0.smithi083.stderr: -51> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -50> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -49> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -48> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -47> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -46> 2024-09-12T00:54:02.974+0000 7f74577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -45> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: crc 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -44> 2024-09-12T00:54:02.974+0000 7f75a3a87800 5 AuthRegistry(0x7ffd0931bc40) adding con mode: secure 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -43> 2024-09-12T00:54:02.975+0000 7f75a3a87800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -42> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -41> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -40> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cache list hook 0x55948714e2c0 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -39> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cache inspect hook 0x55948714e2c0 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -38> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cache erase hook 0x55948714e2c0 2024-09-12T00:54:03.111 INFO:tasks.workunit.client.0.smithi083.stderr: -37> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command cache zap hook 0x55948714e2c0 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -36> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 note: GC not initialized 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -35> 2024-09-12T00:54:02.975+0000 7f74567e4640 20 reqs_thread_entry: start 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -34> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command sync trace show hook 0x7f759c004260 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -33> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command sync trace history hook 0x7f759c004260 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -32> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command sync trace active hook 0x7f759c004260 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -31> 2024-09-12T00:54:02.975+0000 7f75a3a87800 5 asok(0x559486e74630) register_command sync trace active_short hook 0x7f759c004260 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -30> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -29> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 Filter name: none 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -28> 2024-09-12T00:54:02.975+0000 7f73c7fff640 20 reqs_thread_entry: start 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -27> 2024-09-12T00:54:02.975+0000 7f75a3a87800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -26> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -25> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:03.112 INFO:tasks.workunit.client.0.smithi083.stderr: -24> 2024-09-12T00:54:02.975+0000 7f75a3a87800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -23> 2024-09-12T00:54:02.975+0000 7f75a3a87800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -22> 2024-09-12T00:54:02.975+0000 7f75a3a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -21> 2024-09-12T00:54:02.975+0000 7f75a3a87800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -20> 2024-09-12T00:54:02.976+0000 7f75a3a87800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -19> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -18> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -17> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -16> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -15> 2024-09-12T00:54:02.976+0000 7f75a3a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -14> 2024-09-12T00:54:02.977+0000 7f75a3a87800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -13> 2024-09-12T00:54:02.981+0000 7f75a3a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -12> 2024-09-12T00:54:02.981+0000 7f75a3a87800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -11> 2024-09-12T00:54:02.981+0000 7f75a3a87800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:03.113 INFO:tasks.workunit.client.0.smithi083.stderr: -10> 2024-09-12T00:54:02.981+0000 7f75a3a87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: -9> 2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464430 cookie 94096410082576 notifier 7880 bl.length()=911 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: -8> 2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: -7> 2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: -6> 2024-09-12T00:54:02.982+0000 7f7484ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: -5> 2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: -4> 2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: -3> 2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: -2> 2024-09-12T00:54:02.982+0000 7f75a3a87800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: -1> 2024-09-12T00:54:02.985+0000 7f75a3a87800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f75a3a87800 time 2024-09-12T00:54:02.985916+0000 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f75a6f8c71a] 2024-09-12T00:54:03.114 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75a6f8c8d8] 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55948541d641] 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55948542d38a] 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 5: main() 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f75a5c29590] 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 7: __libc_start_main() 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 8: _start() 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 0> 2024-09-12T00:54:02.986+0000 7f75a3a87800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: in thread 7f75a3a87800 thread_name:radosgw-admin 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:03.115 INFO:tasks.workunit.client.0.smithi083.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f75a5c3e6f0] 2024-09-12T00:54:03.116 INFO:tasks.workunit.client.0.smithi083.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f75a5c8b99c] 2024-09-12T00:54:03.116 INFO:tasks.workunit.client.0.smithi083.stderr: 3: raise() 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 4: abort() 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f75a6f8c774] 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75a6f8c8d8] 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55948541d641] 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55948542d38a] 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 9: main() 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f75a5c29590] 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 11: __libc_start_main() 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 12: _start() 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr:--- logging levels --- 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 none 2024-09-12T00:54:03.117 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 lockdep 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 context 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 crush 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_locker 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 buffer 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 timer 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 filer 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 striper 2024-09-12T00:54:03.118 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 1 objecter 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rados 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 journaler 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objectcacher 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 client 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 osd 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 optracker 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 objclass 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 filestore 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 journal 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 ms 2024-09-12T00:54:03.119 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mon 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/10 monc 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 paxos 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 tp 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 auth 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 crypto 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 finisher 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 reserver 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 perfcounter 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_access 2024-09-12T00:54:03.120 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 20/20 rgw_notification 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 javaclient 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 asok 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 1 throttle 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 0 refs 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 compressor 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluestore 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 bluefs 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 3 bdev 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 kstore 2024-09-12T00:54:03.121 INFO:tasks.workunit.client.0.smithi083.stderr: 4/ 5 rocksdb 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 fuse 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 2/ 5 mgr 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mgrc 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 dpdk 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 eventtrace 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 prioritycache 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 test 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:03.122 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_t 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_device 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 alienstore 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 mclock 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 cyanstore 2024-09-12T00:54:03.123 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 memstore 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 1/ 5 trace 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 7f73c7fff640 / http_manager 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 7f74567e4640 / http_manager 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 7f74577e6640 / rgw_dt_lg_renew 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 7f7472ffd640 / ms_dispatch 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 7f7484ff9640 / io_context_pool 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 7f7486ffd640 / ms_dispatch 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 7f748de03640 / ms_dispatch 2024-09-12T00:54:03.124 INFO:tasks.workunit.client.0.smithi083.stderr: 7f748f606640 / io_context_pool 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a0d70640 / msgr-worker-2 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a1571640 / msgr-worker-1 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a1d72640 / msgr-worker-0 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a2573640 / io_context_pool 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr: 7f75a3a87800 / radosgw-admin 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr: max_recent 500 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr: max_new 1000 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:54:02.987359Z_cd4b56f7-987b-4315-b12d-9315257560b5/log 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr:--- end dump of recent events --- 2024-09-12T00:54:03.125 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:03.130 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:03.130 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:03.130 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.062+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.064+0000 7ff57ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.064+0000 7ff57ed26800 20 realm 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.064+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.064+0000 7ff57ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.064+0000 7ff57ed26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.064+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.064+0000 7ff57ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.064+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.065+0000 7ff57ed26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.065+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.065+0000 7ff57ed26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.065+0000 7ff57ed26800 20 searching for the correct realm 2024-09-12T00:54:03.131 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.069+0000 7ff573fff640 0 -- 172.21.15.83:0/1962491568 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff5640b6320 msgr2=0x7ff5640e3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.072+0000 7ff57b1da640 0 -- 172.21.15.83:0/1962491568 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55c0103edb60 msgr2=0x55c0103eff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.076+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:03.132 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 zone default found 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 4 Realm: () 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 zonegroup default 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 started sync module instance, tier type = 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.077+0000 7ff57ed26800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:03.133 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.086+0000 7ff57ed26800 20 add_watcher() i=0 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.086+0000 7ff57ed26800 20 add_watcher() i=1 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.086+0000 7ff57ed26800 20 add_watcher() i=2 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.086+0000 7ff57ed26800 20 add_watcher() i=3 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.086+0000 7ff57ed26800 20 add_watcher() i=4 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.086+0000 7ff57ed26800 20 add_watcher() i=5 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.086+0000 7ff57ed26800 20 add_watcher() i=6 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.087+0000 7ff57ed26800 20 add_watcher() i=7 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.087+0000 7ff57ed26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.088+0000 7ff4317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.088+0000 7ff57ed26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.088+0000 7ff57ed26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.088+0000 7ff57ed26800 5 note: GC not initialized 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.089+0000 7ff3abfff640 20 reqs_thread_entry: start 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.089+0000 7ff57ed26800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:03.134 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.089+0000 7ff57ed26800 20 Filter name: none 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.089+0000 7ff3a9ffb640 20 reqs_thread_entry: start 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.089+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.089+0000 7ff57ed26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.089+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.090+0000 7ff57ed26800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.090+0000 7ff57ed26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.090+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.090+0000 7ff57ed26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.090+0000 7ff57ed26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.090+0000 7ff57ed26800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.090+0000 7ff57ed26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.092+0000 7ff4317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.093+0000 7ff57ed26800 20 remove_watcher() i=0 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.093+0000 7ff57ed26800 2 removed watcher, disabling cache 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.095+0000 7ff57ed26800 20 remove_watcher() i=1 2024-09-12T00:54:03.135 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.096+0000 7ff57ed26800 20 remove_watcher() i=2 2024-09-12T00:54:03.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.097+0000 7ff57ed26800 20 remove_watcher() i=3 2024-09-12T00:54:03.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.098+0000 7ff57ed26800 20 remove_watcher() i=4 2024-09-12T00:54:03.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.099+0000 7ff57ed26800 20 remove_watcher() i=5 2024-09-12T00:54:03.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.100+0000 7ff57ed26800 20 remove_watcher() i=6 2024-09-12T00:54:03.136 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.101+0000 7ff57ed26800 20 remove_watcher() i=7 2024-09-12T00:54:03.136 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:03.136 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:03.136 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:54:03.152 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:03.153 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:03.189 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.190+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.192+0000 7f8eeb440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.192+0000 7f8eeb440800 20 realm 2024-09-12T00:54:03.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.192+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.192+0000 7f8eeb440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.192+0000 7f8eeb440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:03.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.192+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.193+0000 7f8eeb440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.191 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.193+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.193+0000 7f8eeb440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:03.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.193+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.194+0000 7f8eeb440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:03.192 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.194+0000 7f8eeb440800 20 searching for the correct realm 2024-09-12T00:54:03.195 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.197+0000 7f8ee8729640 0 -- 172.21.15.83:0/4234721394 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f8edc039910 msgr2=0x7f8edc0443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:03.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.402+0000 7f8ee972b640 0 -- 172.21.15.83:0/4234721394 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x556ef9b1fb00 msgr2=0x556ef9b21fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:03.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.406+0000 7f8eeb440800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:03.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.406+0000 7f8eeb440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:03.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.406+0000 7f8eeb440800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:03.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.406+0000 7f8eeb440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:03.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.406+0000 7f8eeb440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:03.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.406+0000 7f8eeb440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:03.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:03.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 20 zone default found 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 4 Realm: () 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 20 zonegroup default 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.407+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.408+0000 7f8eeb440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.408+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.408+0000 7f8eeb440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.408+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.408+0000 7f8eeb440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.408+0000 7f8eeb440800 20 started sync module instance, tier type = 2024-09-12T00:54:03.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.408+0000 7f8eeb440800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:03.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.417+0000 7f8eeb440800 20 add_watcher() i=0 2024-09-12T00:54:03.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.417+0000 7f8eeb440800 20 add_watcher() i=1 2024-09-12T00:54:03.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.417+0000 7f8eeb440800 20 add_watcher() i=2 2024-09-12T00:54:03.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.417+0000 7f8eeb440800 20 add_watcher() i=3 2024-09-12T00:54:03.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.417+0000 7f8eeb440800 20 add_watcher() i=4 2024-09-12T00:54:03.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.417+0000 7f8eeb440800 20 add_watcher() i=5 2024-09-12T00:54:03.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.417+0000 7f8eeb440800 20 add_watcher() i=6 2024-09-12T00:54:03.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.418+0000 7f8eeb440800 20 add_watcher() i=7 2024-09-12T00:54:03.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.418+0000 7f8eeb440800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:03.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.420+0000 7f8d9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:03.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.420+0000 7f8eeb440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:03.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.420+0000 7f8eeb440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:03.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 5 note: GC not initialized 2024-09-12T00:54:03.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8d9e7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:03.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:03.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 20 Filter name: none 2024-09-12T00:54:03.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8d977fe640 20 reqs_thread_entry: start 2024-09-12T00:54:03.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:03.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:03.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:03.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.421+0000 7f8eeb440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:03.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:03.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.422+0000 7f8eeb440800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:03.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.423+0000 7f8d9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:03.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.426+0000 7f8eeb440800 20 remove_watcher() i=0 2024-09-12T00:54:03.424 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.426+0000 7f8eeb440800 2 removed watcher, disabling cache 2024-09-12T00:54:03.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.427+0000 7f8eeb440800 20 remove_watcher() i=1 2024-09-12T00:54:03.426 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.428+0000 7f8eeb440800 20 remove_watcher() i=2 2024-09-12T00:54:03.427 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.429+0000 7f8eeb440800 20 remove_watcher() i=3 2024-09-12T00:54:03.428 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.430+0000 7f8eeb440800 20 remove_watcher() i=4 2024-09-12T00:54:03.429 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.431+0000 7f8eeb440800 20 remove_watcher() i=5 2024-09-12T00:54:03.430 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.432+0000 7f8eeb440800 20 remove_watcher() i=6 2024-09-12T00:54:03.431 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:03.433+0000 7f8eeb440800 20 remove_watcher() i=7 2024-09-12T00:54:33.474 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:54:33.507 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:33.507 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:33.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.549+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.550+0000 7fe16332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.550+0000 7fe16332a800 20 realm 2024-09-12T00:54:33.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.550+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.551+0000 7fe16332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.551+0000 7fe16332a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:33.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.551+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.551+0000 7fe16332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.551+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.552+0000 7fe16332a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.552+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.552+0000 7fe16332a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.552+0000 7fe16332a800 20 searching for the correct realm 2024-09-12T00:54:33.557 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.556+0000 7fe157fff640 0 -- 172.21.15.83:0/2650114596 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fe14806aee0 msgr2=0x7fe148066120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:33.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.761+0000 7fe157fff640 0 -- 172.21.15.83:0/2650114596 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5611d7703120 msgr2=0x5611d7705510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:33.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:33.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:33.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.766+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 20 zone default found 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 4 Realm: () 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 20 zonegroup default 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.767+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.768+0000 7fe16332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.768+0000 7fe16332a800 20 started sync module instance, tier type = 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.768+0000 7fe16332a800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.777+0000 7fe16332a800 20 add_watcher() i=0 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.777+0000 7fe16332a800 20 add_watcher() i=1 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.777+0000 7fe16332a800 20 add_watcher() i=2 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.777+0000 7fe16332a800 20 add_watcher() i=3 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.777+0000 7fe16332a800 20 add_watcher() i=4 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.777+0000 7fe16332a800 20 add_watcher() i=5 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.777+0000 7fe16332a800 20 add_watcher() i=6 2024-09-12T00:54:33.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.778+0000 7fe16332a800 20 add_watcher() i=7 2024-09-12T00:54:33.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.779+0000 7fe16332a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:33.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.780+0000 7fe015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.781+0000 7fe16332a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.781+0000 7fe16332a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.781+0000 7fe16332a800 5 note: GC not initialized 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.781+0000 7fe014fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.781+0000 7fe16332a800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.781+0000 7fe16332a800 20 Filter name: none 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.781+0000 7fdf8e7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.781+0000 7fe16332a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.781+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.782+0000 7fe16332a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:54:33.785 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.785+0000 7fe015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:33.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.788+0000 7fe16332a800 20 remove_watcher() i=0 2024-09-12T00:54:33.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.788+0000 7fe16332a800 2 removed watcher, disabling cache 2024-09-12T00:54:33.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.789+0000 7fe16332a800 20 remove_watcher() i=1 2024-09-12T00:54:33.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.790+0000 7fe16332a800 20 remove_watcher() i=2 2024-09-12T00:54:33.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.791+0000 7fe16332a800 20 remove_watcher() i=3 2024-09-12T00:54:33.792 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.792+0000 7fe16332a800 20 remove_watcher() i=4 2024-09-12T00:54:33.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.793+0000 7fe16332a800 20 remove_watcher() i=5 2024-09-12T00:54:33.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.794+0000 7fe16332a800 20 remove_watcher() i=6 2024-09-12T00:54:33.795 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.796+0000 7fe16332a800 20 remove_watcher() i=7 2024-09-12T00:54:33.808 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:54:33.838 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:33.838 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:33.877 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.877+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.879+0000 7f49f6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.879+0000 7f49f6b40800 20 realm 2024-09-12T00:54:33.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.879+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.879+0000 7f49f6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.879+0000 7f49f6b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:33.879 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.879+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.880+0000 7f49f6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.880+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.880+0000 7f49f6b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:33.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.880+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.880 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.881+0000 7f49f6b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:33.881 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.881+0000 7f49f6b40800 20 searching for the correct realm 2024-09-12T00:54:33.883 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:33.884+0000 7f49f20bf640 0 -- 172.21.15.83:0/2992585519 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f49e8020480 msgr2=0x7f49e80208e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:34.089 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.089+0000 7f49f20bf640 0 -- 172.21.15.83:0/2992585519 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55cde07388a0 msgr2=0x55cde073ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:34.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.093+0000 7f49f6b40800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.093+0000 7f49f6b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.093+0000 7f49f6b40800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.093+0000 7f49f6b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.093+0000 7f49f6b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.093+0000 7f49f6b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.093+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:34.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:34.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 20 zone default found 2024-09-12T00:54:34.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 4 Realm: () 2024-09-12T00:54:34.095 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 20 zonegroup default 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.094+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.095+0000 7f49f6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.095+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.095+0000 7f49f6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.095+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.095+0000 7f49f6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.095+0000 7f49f6b40800 20 started sync module instance, tier type = 2024-09-12T00:54:34.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.095+0000 7f49f6b40800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:34.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.105+0000 7f49f6b40800 20 add_watcher() i=0 2024-09-12T00:54:34.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.105+0000 7f49f6b40800 20 add_watcher() i=1 2024-09-12T00:54:34.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.105+0000 7f49f6b40800 20 add_watcher() i=2 2024-09-12T00:54:34.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.105+0000 7f49f6b40800 20 add_watcher() i=3 2024-09-12T00:54:34.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.105+0000 7f49f6b40800 20 add_watcher() i=4 2024-09-12T00:54:34.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.105+0000 7f49f6b40800 20 add_watcher() i=5 2024-09-12T00:54:34.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.105+0000 7f49f6b40800 20 add_watcher() i=6 2024-09-12T00:54:34.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.106+0000 7f49f6b40800 20 add_watcher() i=7 2024-09-12T00:54:34.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.106+0000 7f49f6b40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:34.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.107+0000 7f48a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:34.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.108+0000 7f49f6b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:34.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.108+0000 7f49f6b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:34.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.108+0000 7f49f6b40800 5 note: GC not initialized 2024-09-12T00:54:34.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.108+0000 7f4823fff640 20 reqs_thread_entry: start 2024-09-12T00:54:34.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.108+0000 7f49f6b40800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:34.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.108+0000 7f49f6b40800 20 Filter name: none 2024-09-12T00:54:34.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.108+0000 7f4821ffb640 20 reqs_thread_entry: start 2024-09-12T00:54:34.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.108+0000 7f49f6b40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:34.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.108+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:34.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.109+0000 7f49f6b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.110+0000 7f49f6b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.110+0000 7f49f6b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:34.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.110+0000 7f49f6b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:34.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.110+0000 7f49f6b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:34.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.111+0000 7f48a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:34.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.113+0000 7f49f6b40800 20 remove_watcher() i=0 2024-09-12T00:54:34.113 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.113+0000 7f49f6b40800 2 removed watcher, disabling cache 2024-09-12T00:54:34.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.115+0000 7f49f6b40800 20 remove_watcher() i=1 2024-09-12T00:54:34.115 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.116+0000 7f49f6b40800 20 remove_watcher() i=2 2024-09-12T00:54:34.116 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.117+0000 7f49f6b40800 20 remove_watcher() i=3 2024-09-12T00:54:34.117 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.118+0000 7f49f6b40800 20 remove_watcher() i=4 2024-09-12T00:54:34.118 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.119+0000 7f49f6b40800 20 remove_watcher() i=5 2024-09-12T00:54:34.119 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.120+0000 7f49f6b40800 20 remove_watcher() i=6 2024-09-12T00:54:34.120 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.121+0000 7f49f6b40800 20 remove_watcher() i=7 2024-09-12T00:54:34.131 INFO:tasks.workunit.client.0.smithi083.stderr:check reshard logrecord successfully 2024-09-12T00:54:34.131 INFO:tasks.workunit.client.0.smithi083.stderr: test: reshard versioned bucket 2024-09-12T00:54:34.132 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:54:34.161 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:34.161 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:34.197 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.197+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.199+0000 7fadd6531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.199+0000 7fadd6531800 20 realm 2024-09-12T00:54:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.199+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.200+0000 7fadd6531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.200+0000 7fadd6531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:34.199 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.200+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.200+0000 7fadd6531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.200+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.200+0000 7fadd6531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:34.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.200+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.200 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.201+0000 7fadd6531800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:34.201 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.201+0000 7fadd6531800 20 searching for the correct realm 2024-09-12T00:54:34.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.405+0000 7fadd221a640 0 -- 172.21.15.83:0/2493147786 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7fadc40c8070 msgr2=0x7fadc40a4c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:34.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.409+0000 7fadd221a640 0 -- 172.21.15.83:0/2493147786 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fadcc018040 msgr2=0x7fadcc031400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:34.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.616+0000 7fadd6531800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:34.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.616+0000 7fadd6531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:34.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.616+0000 7fadd6531800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:34.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.616+0000 7fadd6531800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:34.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.616+0000 7fadd6531800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:34.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.616+0000 7fadd6531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:34.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.616+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.616+0000 7fadd6531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.616+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:34.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:34.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 20 zone default found 2024-09-12T00:54:34.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 4 Realm: () 2024-09-12T00:54:34.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:34.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 20 zonegroup default 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.617+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.618+0000 7fadd6531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.618+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.618+0000 7fadd6531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.618+0000 7fadd6531800 20 started sync module instance, tier type = 2024-09-12T00:54:34.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.618+0000 7fadd6531800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:34.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.627+0000 7fadd6531800 20 add_watcher() i=0 2024-09-12T00:54:34.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.627+0000 7fadd6531800 20 add_watcher() i=1 2024-09-12T00:54:34.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.627+0000 7fadd6531800 20 add_watcher() i=2 2024-09-12T00:54:34.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.627+0000 7fadd6531800 20 add_watcher() i=3 2024-09-12T00:54:34.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.627+0000 7fadd6531800 20 add_watcher() i=4 2024-09-12T00:54:34.627 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.627+0000 7fadd6531800 20 add_watcher() i=5 2024-09-12T00:54:34.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.627+0000 7fadd6531800 20 add_watcher() i=6 2024-09-12T00:54:34.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.629+0000 7fadd6531800 20 add_watcher() i=7 2024-09-12T00:54:34.628 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.629+0000 7fadd6531800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:34.630 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.630+0000 7fac88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:34.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.631+0000 7fadd6531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:34.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.631+0000 7fadd6531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:34.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.631+0000 7fadd6531800 5 note: GC not initialized 2024-09-12T00:54:34.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.631+0000 7fac037fe640 20 reqs_thread_entry: start 2024-09-12T00:54:34.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.631+0000 7fadd6531800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:34.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.631+0000 7fadd6531800 20 Filter name: none 2024-09-12T00:54:34.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.631+0000 7fac017fa640 20 reqs_thread_entry: start 2024-09-12T00:54:34.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.631+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.632+0000 7fadd6531800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:34.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.632+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.633+0000 7fadd6531800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:34.632 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.633+0000 7fadd6531800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:34.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.633+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.633+0000 7fadd6531800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:34.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.633+0000 7fadd6531800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.634+0000 7fadd6531800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:34.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.634+0000 7fadd6531800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:34.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.635+0000 7fac88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:34.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.637+0000 7fadd6531800 20 remove_watcher() i=0 2024-09-12T00:54:34.637 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.637+0000 7fadd6531800 2 removed watcher, disabling cache 2024-09-12T00:54:34.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.638+0000 7fadd6531800 20 remove_watcher() i=1 2024-09-12T00:54:34.639 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.639+0000 7fadd6531800 20 remove_watcher() i=2 2024-09-12T00:54:34.640 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.640+0000 7fadd6531800 20 remove_watcher() i=3 2024-09-12T00:54:34.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.641+0000 7fadd6531800 20 remove_watcher() i=4 2024-09-12T00:54:34.642 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.643+0000 7fadd6531800 20 remove_watcher() i=5 2024-09-12T00:54:34.643 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.644+0000 7fadd6531800 20 remove_watcher() i=6 2024-09-12T00:54:34.644 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.645+0000 7fadd6531800 20 remove_watcher() i=7 2024-09-12T00:54:34.655 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:34.655 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:54:34.655 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: myver id: ad4424e4-de7c-4376-b125-e717016a3484.4511.19 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:54:34.655 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:34.656 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T00:54:34.687 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:34.687 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:34.723 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.723+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.725+0000 7efc119af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.725+0000 7efc119af800 20 realm 2024-09-12T00:54:34.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.725+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.725 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.726+0000 7efc119af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.726+0000 7efc119af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:34.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.726+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.726+0000 7efc119af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.726+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.726+0000 7efc119af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:34.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.726+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.727+0000 7efc119af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:34.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.727+0000 7efc119af800 20 searching for the correct realm 2024-09-12T00:54:34.730 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.730+0000 7efc0ec98640 0 -- 172.21.15.83:0/999802749 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7efc040158d0 msgr2=0x7efc0403d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:34.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.936+0000 7efc0ec98640 0 -- 172.21.15.83:0/999802749 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x559df8e7b330 msgr2=0x559df8e7d7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:34.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.940+0000 7efc119af800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:34.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.940+0000 7efc119af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:34.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.940+0000 7efc119af800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:34.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.940+0000 7efc119af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:34.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.940+0000 7efc119af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:34.941 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.940+0000 7efc119af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.940+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.940+0000 7efc119af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 20 zone default found 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 4 Realm: () 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:34.942 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 20 zonegroup default 2024-09-12T00:54:34.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.941+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.942+0000 7efc119af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.942+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.943 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.942+0000 7efc119af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.942+0000 7efc119af800 20 started sync module instance, tier type = 2024-09-12T00:54:34.944 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.942+0000 7efc119af800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:34.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.951+0000 7efc119af800 20 add_watcher() i=0 2024-09-12T00:54:34.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.952+0000 7efc119af800 20 add_watcher() i=1 2024-09-12T00:54:34.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.952+0000 7efc119af800 20 add_watcher() i=2 2024-09-12T00:54:34.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.952+0000 7efc119af800 20 add_watcher() i=3 2024-09-12T00:54:34.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.952+0000 7efc119af800 20 add_watcher() i=4 2024-09-12T00:54:34.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.952+0000 7efc119af800 20 add_watcher() i=5 2024-09-12T00:54:34.951 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.952+0000 7efc119af800 20 add_watcher() i=6 2024-09-12T00:54:34.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.953+0000 7efc119af800 20 add_watcher() i=7 2024-09-12T00:54:34.952 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.953+0000 7efc119af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:34.954 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.954+0000 7efac5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:34.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.955+0000 7efc119af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:34.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.955+0000 7efc119af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:34.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.955+0000 7efc119af800 5 note: GC not initialized 2024-09-12T00:54:34.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.955+0000 7efac4fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:34.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.955+0000 7efc119af800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:34.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.955+0000 7efc119af800 20 Filter name: none 2024-09-12T00:54:34.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.955+0000 7efa3e7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:34.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.955+0000 7efc119af800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:54:34.955 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.955+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:34.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:54:34.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:54:34.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : miss 2024-09-12T00:54:34.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:34.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:34.956 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 10 adding default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:34.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:34.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:34.957 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.956+0000 7efc119af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:34.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.961+0000 7efc119af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:34.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.961+0000 7efc119af800 10 moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:34.960 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.961+0000 7efc119af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:34.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.961+0000 7efc119af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19, ofs0, ns] 2024-09-12T00:54:34.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.961+0000 7efaf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464379 cookie 94136974224976 notifier 8454 bl.length()=905 2024-09-12T00:54:34.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.961+0000 7efaf2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:34.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.961+0000 7efaf2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:34.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.961+0000 7efaf2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:34.961 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.962+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_sources= new_sources= 2024-09-12T00:54:34.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.962+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential sources added=[] removed=[] 2024-09-12T00:54:34.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.962+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_dests= new_dests= 2024-09-12T00:54:34.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.962+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential dests added=[] removed=[] 2024-09-12T00:54:34.963 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.964+0000 7efc119af800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.0 2024-09-12T00:54:34.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.964+0000 7efc119af800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.0 2024-09-12T00:54:34.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.964+0000 7efc119af800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.1 2024-09-12T00:54:34.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.964+0000 7efc119af800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.1 2024-09-12T00:54:34.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.964+0000 7efc119af800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.0 2024-09-12T00:54:34.964 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.965+0000 7efc119af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:34.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.965+0000 7efc119af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:34.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.966+0000 7efc119af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:34.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efc119af800 10 moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:34.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efc119af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:34.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efc119af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19, ofs0, ns] 2024-09-12T00:54:34.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efaf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464380 cookie 94136974224976 notifier 8454 bl.length()=905 2024-09-12T00:54:34.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efaf2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:34.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efaf2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:34.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efaf2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:34.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_sources= new_sources= 2024-09-12T00:54:34.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential sources added=[] removed=[] 2024-09-12T00:54:34.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_dests= new_dests= 2024-09-12T00:54:34.967 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.967+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential dests added=[] removed=[] 2024-09-12T00:54:34.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.968+0000 7efc119af800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.0 2024-09-12T00:54:34.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.969+0000 7efc119af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:34.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.969+0000 7efc119af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:34.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.970+0000 7efc119af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:34.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.970+0000 7efc119af800 10 moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:34.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.970+0000 7efc119af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:34.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.970+0000 7efc119af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19, ofs0, ns] 2024-09-12T00:54:34.970 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.971+0000 7efaf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464381 cookie 94136974224976 notifier 8454 bl.length()=873 2024-09-12T00:54:34.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.971+0000 7efaf2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:34.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.971+0000 7efaf2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:34.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.971+0000 7efaf2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:34.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.971+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_sources= new_sources= 2024-09-12T00:54:34.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.971+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential sources added=[] removed=[] 2024-09-12T00:54:34.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.971+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_dests= new_dests= 2024-09-12T00:54:34.971 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.971+0000 7efc119af800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential dests added=[] removed=[] 2024-09-12T00:54:34.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.973+0000 7efc119af800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:34.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.974+0000 7efac5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:34.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.976+0000 7efc119af800 20 remove_watcher() i=0 2024-09-12T00:54:34.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.976+0000 7efc119af800 2 removed watcher, disabling cache 2024-09-12T00:54:34.976 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.977+0000 7efc119af800 20 remove_watcher() i=1 2024-09-12T00:54:34.978 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.978+0000 7efc119af800 20 remove_watcher() i=2 2024-09-12T00:54:34.979 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.979+0000 7efc119af800 20 remove_watcher() i=3 2024-09-12T00:54:34.980 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.981+0000 7efc119af800 20 remove_watcher() i=4 2024-09-12T00:54:34.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.982+0000 7efc119af800 20 remove_watcher() i=5 2024-09-12T00:54:34.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.983+0000 7efc119af800 20 remove_watcher() i=6 2024-09-12T00:54:34.983 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:34.984+0000 7efc119af800 20 remove_watcher() i=7 2024-09-12T00:54:34.995 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:54:35.023 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:35.023 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:35.059 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.060+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.062+0000 7fdb07f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.062+0000 7fdb07f40800 20 realm 2024-09-12T00:54:35.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.062+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.062+0000 7fdb07f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.062+0000 7fdb07f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:35.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.062+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.062+0000 7fdb07f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.062 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.062+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.063+0000 7fdb07f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.063+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.063+0000 7fdb07f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:35.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.063+0000 7fdb07f40800 20 searching for the correct realm 2024-09-12T00:54:35.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.066+0000 7fdb034bf640 0 -- 172.21.15.83:0/89162805 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fdaf80ab2a0 msgr2=0x7fdaf8055850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:35.271 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.272+0000 7fdb034bf640 0 -- 172.21.15.83:0/89162805 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56076914f1c0 msgr2=0x560769151610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:35.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.276+0000 7fdb07f40800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:35.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.276+0000 7fdb07f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:35.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.276+0000 7fdb07f40800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:35.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.276+0000 7fdb07f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:35.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.276+0000 7fdb07f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:35.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.276+0000 7fdb07f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:35.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.276+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.276+0000 7fdb07f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.276+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:35.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 20 zone default found 2024-09-12T00:54:35.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 4 Realm: () 2024-09-12T00:54:35.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:35.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:35.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:35.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 20 zonegroup default 2024-09-12T00:54:35.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.277+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.278+0000 7fdb07f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.278+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.278+0000 7fdb07f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.278+0000 7fdb07f40800 20 started sync module instance, tier type = 2024-09-12T00:54:35.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.278+0000 7fdb07f40800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:35.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.287+0000 7fdb07f40800 20 add_watcher() i=0 2024-09-12T00:54:35.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.287+0000 7fdb07f40800 20 add_watcher() i=1 2024-09-12T00:54:35.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.287+0000 7fdb07f40800 20 add_watcher() i=2 2024-09-12T00:54:35.286 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.287+0000 7fdb07f40800 20 add_watcher() i=3 2024-09-12T00:54:35.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.287+0000 7fdb07f40800 20 add_watcher() i=4 2024-09-12T00:54:35.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.287+0000 7fdb07f40800 20 add_watcher() i=5 2024-09-12T00:54:35.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.287+0000 7fdb07f40800 20 add_watcher() i=6 2024-09-12T00:54:35.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.288+0000 7fdb07f40800 20 add_watcher() i=7 2024-09-12T00:54:35.287 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.288+0000 7fdb07f40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:35.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.290+0000 7fd9b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:35.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.290+0000 7fdb07f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:35.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.290+0000 7fdb07f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:35.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.290+0000 7fdb07f40800 5 note: GC not initialized 2024-09-12T00:54:35.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.290+0000 7fd9b8fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:35.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.290+0000 7fdb07f40800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:35.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.290+0000 7fdb07f40800 20 Filter name: none 2024-09-12T00:54:35.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.290+0000 7fd9327fc640 20 reqs_thread_entry: start 2024-09-12T00:54:35.290 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.291+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.291+0000 7fdb07f40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:35.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.291+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.291+0000 7fdb07f40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:35.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.291+0000 7fdb07f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:35.291 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.292+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.292+0000 7fdb07f40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:35.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.292+0000 7fdb07f40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.292+0000 7fdb07f40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:35.292 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.292+0000 7fdb07f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:35.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.293+0000 7fd9b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:35.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.296+0000 7fdb07f40800 20 remove_watcher() i=0 2024-09-12T00:54:35.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.296+0000 7fdb07f40800 2 removed watcher, disabling cache 2024-09-12T00:54:35.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.297+0000 7fdb07f40800 20 remove_watcher() i=1 2024-09-12T00:54:35.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.298+0000 7fdb07f40800 20 remove_watcher() i=2 2024-09-12T00:54:35.298 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.299+0000 7fdb07f40800 20 remove_watcher() i=3 2024-09-12T00:54:35.300 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.300+0000 7fdb07f40800 20 remove_watcher() i=4 2024-09-12T00:54:35.301 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.301+0000 7fdb07f40800 20 remove_watcher() i=5 2024-09-12T00:54:35.302 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.302+0000 7fdb07f40800 20 remove_watcher() i=6 2024-09-12T00:54:35.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.303+0000 7fdb07f40800 20 remove_watcher() i=7 2024-09-12T00:54:35.313 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:35.313 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:54:35.313 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: myver id: ad4424e4-de7c-4376-b125-e717016a3484.4511.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:54:35.313 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:35.315 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:35.315 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:35.318 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:35.318 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:35.359 INFO:tasks.workunit.client.0.smithi083.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:54:35.361 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:35.361 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:35.407 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:35.408 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:35.451 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:54:35.480 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:35.480 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:35.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.517+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.519+0000 7f11b1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.519+0000 7f11b1575800 20 realm 2024-09-12T00:54:35.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.519+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.519+0000 7f11b1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.519+0000 7f11b1575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:35.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.519+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.519+0000 7f11b1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.519 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.519+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.520+0000 7f11b1575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.520+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.520+0000 7f11b1575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:35.520 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.520+0000 7f11b1575800 20 searching for the correct realm 2024-09-12T00:54:35.523 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.524+0000 7f11af860640 0 -- 172.21.15.83:0/2762327057 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f11a40aa9b0 msgr2=0x7f11a40c5110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:35.526 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.527+0000 7f11af05f640 0 -- 172.21.15.83:0/2762327057 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f11a803b410 msgr2=0x7f11a803b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:35.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:35.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:35.529 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:35.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:35.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:35.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:35.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.530 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.531 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.530+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 zone default found 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 4 Realm: () 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 zonegroup default 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.532 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 started sync module instance, tier type = 2024-09-12T00:54:35.533 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.531+0000 7f11b1575800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:35.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.540+0000 7f11b1575800 20 add_watcher() i=0 2024-09-12T00:54:35.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.540+0000 7f11b1575800 20 add_watcher() i=1 2024-09-12T00:54:35.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.540+0000 7f11b1575800 20 add_watcher() i=2 2024-09-12T00:54:35.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.540+0000 7f11b1575800 20 add_watcher() i=3 2024-09-12T00:54:35.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.540+0000 7f11b1575800 20 add_watcher() i=4 2024-09-12T00:54:35.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.540+0000 7f11b1575800 20 add_watcher() i=5 2024-09-12T00:54:35.540 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.540+0000 7f11b1575800 20 add_watcher() i=6 2024-09-12T00:54:35.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.541+0000 7f11b1575800 20 add_watcher() i=7 2024-09-12T00:54:35.541 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.541+0000 7f11b1575800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:35.542 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.543+0000 7f1065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:35.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.543+0000 7f11b1575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:35.543 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.543+0000 7f11b1575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:35.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.543+0000 7f11b1575800 5 note: GC not initialized 2024-09-12T00:54:35.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.543+0000 7f1064fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:35.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.543+0000 7f11b1575800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:35.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.544+0000 7f11b1575800 20 Filter name: none 2024-09-12T00:54:35.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.544+0000 7f0fde7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:35.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.544+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.544+0000 7f11b1575800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:35.544 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.544+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.544+0000 7f11b1575800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:35.545 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.544+0000 7f11b1575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:35.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.544+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.545+0000 7f11b1575800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:35.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.545+0000 7f11b1575800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.545+0000 7f11b1575800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:35.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.545+0000 7f11b1575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:35.546 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.546+0000 7f1065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:35.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.548+0000 7f11b1575800 20 remove_watcher() i=0 2024-09-12T00:54:35.548 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.548+0000 7f11b1575800 2 removed watcher, disabling cache 2024-09-12T00:54:35.549 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.549+0000 7f11b1575800 20 remove_watcher() i=1 2024-09-12T00:54:35.550 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.551+0000 7f11b1575800 20 remove_watcher() i=2 2024-09-12T00:54:35.551 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.551+0000 7f11b1575800 20 remove_watcher() i=3 2024-09-12T00:54:35.552 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.552+0000 7f11b1575800 20 remove_watcher() i=4 2024-09-12T00:54:35.553 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.553+0000 7f11b1575800 20 remove_watcher() i=5 2024-09-12T00:54:35.554 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.554+0000 7f11b1575800 20 remove_watcher() i=6 2024-09-12T00:54:35.555 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.556+0000 7f11b1575800 20 remove_watcher() i=7 2024-09-12T00:54:35.565 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:35.565 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:54:35.565 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: a-bucket id: ad4424e4-de7c-4376-b125-e717016a3484.4511.18 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T00:54:35.565 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:35.566 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:54:35.595 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:35.595 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:35.631 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.632+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.634+0000 7fda5840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.634+0000 7fda5840e800 20 realm 2024-09-12T00:54:35.633 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.634+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.634+0000 7fda5840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.634+0000 7fda5840e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:35.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.634+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.634+0000 7fda5840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.634 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.634+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.635+0000 7fda5840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.635+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.635+0000 7fda5840e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:35.635 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.635+0000 7fda5840e800 20 searching for the correct realm 2024-09-12T00:54:35.638 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.639+0000 7fda4bfff640 0 -- 172.21.15.83:0/2722912263 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fda3c06d930 msgr2=0x7fda3c085410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:35.641 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.642+0000 7fda53b6b640 0 -- 172.21.15.83:0/2722912263 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fda4c01d060 msgr2=0x7fda4c05ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.646+0000 7fda5840e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.646+0000 7fda5840e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.646+0000 7fda5840e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.646+0000 7fda5840e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.646+0000 7fda5840e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.646+0000 7fda5840e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:35.646 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.646+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.646+0000 7fda5840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.646+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.647 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:35.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 zone default found 2024-09-12T00:54:35.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 4 Realm: () 2024-09-12T00:54:35.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:35.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:35.648 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:35.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 zonegroup default 2024-09-12T00:54:35.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.647+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.648+0000 7fda5840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.648+0000 7fda5840e800 20 started sync module instance, tier type = 2024-09-12T00:54:35.649 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.648+0000 7fda5840e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:35.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.655+0000 7fda5840e800 20 add_watcher() i=0 2024-09-12T00:54:35.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.655+0000 7fda5840e800 20 add_watcher() i=1 2024-09-12T00:54:35.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.655+0000 7fda5840e800 20 add_watcher() i=2 2024-09-12T00:54:35.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.655+0000 7fda5840e800 20 add_watcher() i=3 2024-09-12T00:54:35.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.655+0000 7fda5840e800 20 add_watcher() i=4 2024-09-12T00:54:35.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.655+0000 7fda5840e800 20 add_watcher() i=5 2024-09-12T00:54:35.655 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.656+0000 7fda5840e800 20 add_watcher() i=6 2024-09-12T00:54:35.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.656+0000 7fda5840e800 20 add_watcher() i=7 2024-09-12T00:54:35.656 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.656+0000 7fda5840e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:35.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.658+0000 7fd909fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:35.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.658+0000 7fda5840e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:35.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.658+0000 7fda5840e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:35.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.658+0000 7fda5840e800 5 note: GC not initialized 2024-09-12T00:54:35.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.658+0000 7fd908fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:35.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.659+0000 7fda5840e800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:35.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.659+0000 7fda5840e800 20 Filter name: none 2024-09-12T00:54:35.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.659+0000 7fd8827fc640 20 reqs_thread_entry: start 2024-09-12T00:54:35.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.659+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.659+0000 7fda5840e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:35.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.659+0000 7fda5840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.659+0000 7fda5840e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:35.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.659+0000 7fda5840e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:35.660 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.660+0000 7fd909fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:35.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.662+0000 7fda5840e800 20 remove_watcher() i=0 2024-09-12T00:54:35.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.662+0000 7fda5840e800 2 removed watcher, disabling cache 2024-09-12T00:54:35.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.663+0000 7fda5840e800 20 remove_watcher() i=1 2024-09-12T00:54:35.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.664+0000 7fda5840e800 20 remove_watcher() i=2 2024-09-12T00:54:35.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.665+0000 7fda5840e800 20 remove_watcher() i=3 2024-09-12T00:54:35.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.666+0000 7fda5840e800 20 remove_watcher() i=4 2024-09-12T00:54:35.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.667+0000 7fda5840e800 20 remove_watcher() i=5 2024-09-12T00:54:35.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.668+0000 7fda5840e800 20 remove_watcher() i=6 2024-09-12T00:54:35.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.669+0000 7fda5840e800 20 remove_watcher() i=7 2024-09-12T00:54:35.680 INFO:tasks.workunit.client.0.smithi083.stderr:rados -p default.rgw.buckets.index setomapval .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:54:35.706 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:35.706 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:35.722 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:54:35.750 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:35.750 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:35.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.787+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.789+0000 7f19ed32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.789+0000 7f19ed32f800 20 realm 2024-09-12T00:54:35.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.789+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.789+0000 7f19ed32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.789+0000 7f19ed32f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:35.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.789+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.789+0000 7f19ed32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.789+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.790+0000 7f19ed32f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.790+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.790+0000 7f19ed32f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:35.790 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.790+0000 7f19ed32f800 20 searching for the correct realm 2024-09-12T00:54:35.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.793+0000 7f19e3fff640 0 -- 172.21.15.83:0/2185360986 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f19d4068600 msgr2=0x7f19d4066770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:35.997 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:35.998+0000 7f19e9877640 0 -- 172.21.15.83:0/2185360986 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x561e881d60d0 msgr2=0x561e881d84e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.002+0000 7f19ed32f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:36.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.002+0000 7f19ed32f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:36.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.002+0000 7f19ed32f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:36.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.002+0000 7f19ed32f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:36.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.002+0000 7f19ed32f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:36.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.002+0000 7f19ed32f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:36.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.002+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.002+0000 7f19ed32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.002 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.002+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 20 zone default found 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 4 Realm: () 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 20 zonegroup default 2024-09-12T00:54:36.004 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.003+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.004+0000 7f19ed32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.004+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.004+0000 7f19ed32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.004+0000 7f19ed32f800 20 started sync module instance, tier type = 2024-09-12T00:54:36.005 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.004+0000 7f19ed32f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:36.012 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.013+0000 7f19ed32f800 20 add_watcher() i=0 2024-09-12T00:54:36.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.013+0000 7f19ed32f800 20 add_watcher() i=1 2024-09-12T00:54:36.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.013+0000 7f19ed32f800 20 add_watcher() i=2 2024-09-12T00:54:36.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.013+0000 7f19ed32f800 20 add_watcher() i=3 2024-09-12T00:54:36.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.013+0000 7f19ed32f800 20 add_watcher() i=4 2024-09-12T00:54:36.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.013+0000 7f19ed32f800 20 add_watcher() i=5 2024-09-12T00:54:36.013 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.013+0000 7f19ed32f800 20 add_watcher() i=6 2024-09-12T00:54:36.017 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.014+0000 7f19ed32f800 20 add_watcher() i=7 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.014+0000 7f19ed32f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.015+0000 7f189f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.016+0000 7f19ed32f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.016+0000 7f19ed32f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.016+0000 7f19ed32f800 5 note: GC not initialized 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.016+0000 7f189e7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.016+0000 7f19ed32f800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.016+0000 7f19ed32f800 20 Filter name: none 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.016+0000 7f180ffff640 20 reqs_thread_entry: start 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.016+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.018 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 INFO: main: starting shard=0 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 INFO: main: starting shard=1 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.017+0000 7f19ed32f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.018+0000 7f19ed32f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.018+0000 7f19ed32f800 20 INFO: main: starting shard=2 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.018+0000 7f19ed32f800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:36.019 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.018+0000 7f19ed32f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:36.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.018+0000 7f19ed32f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:36.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.018+0000 7f19ed32f800 20 INFO: main: done 2024-09-12T00:54:36.020 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.019+0000 7f189f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.022+0000 7f19ed32f800 20 remove_watcher() i=0 2024-09-12T00:54:36.021 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.022+0000 7f19ed32f800 2 removed watcher, disabling cache 2024-09-12T00:54:36.022 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.023+0000 7f19ed32f800 20 remove_watcher() i=1 2024-09-12T00:54:36.023 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.024+0000 7f19ed32f800 20 remove_watcher() i=2 2024-09-12T00:54:36.024 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.025+0000 7f19ed32f800 20 remove_watcher() i=3 2024-09-12T00:54:36.025 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.025+0000 7f19ed32f800 20 remove_watcher() i=4 2024-09-12T00:54:36.026 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.026+0000 7f19ed32f800 20 remove_watcher() i=5 2024-09-12T00:54:36.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.027+0000 7f19ed32f800 20 remove_watcher() i=6 2024-09-12T00:54:36.027 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.028+0000 7f19ed32f800 20 remove_watcher() i=7 2024-09-12T00:54:36.039 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:54:36.070 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:36.071 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:36.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.108+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.110+0000 7f2733b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.110+0000 7f2733b40800 20 realm 2024-09-12T00:54:36.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.110+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.110+0000 7f2733b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.110+0000 7f2733b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:36.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.110+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.110+0000 7f2733b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.110+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.111+0000 7f2733b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.111+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.111+0000 7f2733b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:36.112 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.111+0000 7f2733b40800 20 searching for the correct realm 2024-09-12T00:54:36.114 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.115+0000 7f27270ec640 0 -- 172.21.15.83:0/1897012012 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f271803d400 msgr2=0x7f271803d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.320+0000 7f27270ec640 0 -- 172.21.15.83:0/1897012012 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55b69345d110 msgr2=0x55b69345f5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:36.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:36.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:36.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:36.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:36.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:36.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.324 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 zone default found 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 4 Realm: () 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 zonegroup default 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.324+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.325+0000 7f2733b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.325+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.326 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.325+0000 7f2733b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.325+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.325+0000 7f2733b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.325+0000 7f2733b40800 20 started sync module instance, tier type = 2024-09-12T00:54:36.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.325+0000 7f2733b40800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:36.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.333+0000 7f2733b40800 20 add_watcher() i=0 2024-09-12T00:54:36.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.333+0000 7f2733b40800 20 add_watcher() i=1 2024-09-12T00:54:36.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.333+0000 7f2733b40800 20 add_watcher() i=2 2024-09-12T00:54:36.333 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.333+0000 7f2733b40800 20 add_watcher() i=3 2024-09-12T00:54:36.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.333+0000 7f2733b40800 20 add_watcher() i=4 2024-09-12T00:54:36.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.333+0000 7f2733b40800 20 add_watcher() i=5 2024-09-12T00:54:36.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.334+0000 7f2733b40800 20 add_watcher() i=6 2024-09-12T00:54:36.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.334+0000 7f2733b40800 20 add_watcher() i=7 2024-09-12T00:54:36.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.334+0000 7f2733b40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:36.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.336+0000 7f25e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.336+0000 7f2733b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:36.336 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.336+0000 7f2733b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:36.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 5 note: GC not initialized 2024-09-12T00:54:36.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f25e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:36.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:36.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 20 Filter name: none 2024-09-12T00:54:36.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f255e7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:36.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:54:36.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : miss 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.337+0000 7f2733b40800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.338+0000 7f2733b40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.338+0000 7f2733b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.338+0000 7f2733b40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.338+0000 7f2733b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.338+0000 7f2733b40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:36.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.338+0000 7f2733b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:54:36.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.341+0000 7f2733b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:36.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.341+0000 7f2733b40800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:36.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.341+0000 7f2733b40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:36.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.341+0000 7f2733b40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:54:36.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.341+0000 7f260e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464432 cookie 94242643295776 notifier 8556 bl.length()=911 2024-09-12T00:54:36.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.341+0000 7f260e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:36.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.341+0000 7f260e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:36.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.341+0000 7f260e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:36.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.342+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:54:36.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.342+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:54:36.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.342+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:54:36.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.342+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:54:36.345 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.346+0000 7f2733b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:54:36.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.346+0000 7f2733b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:54:36.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.346+0000 7f2733b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:36.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.346+0000 7f2733b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:36.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.346+0000 7f2733b40800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:54:36.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.346+0000 7f2733b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:36.346 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.346+0000 7f2733b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:36.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.347+0000 7f2733b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:36.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.347+0000 7f2733b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:36.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.347+0000 7f2733b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:36.347 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.347+0000 7f2733b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:54:36.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.348+0000 7f2733b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:36.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.348+0000 7f2733b40800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:36.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.348+0000 7f2733b40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:36.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.348+0000 7f2733b40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:54:36.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.349+0000 7f260e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464433 cookie 94242643295776 notifier 8556 bl.length()=911 2024-09-12T00:54:36.348 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.349+0000 7f260e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:36.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.349+0000 7f260e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:36.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.349+0000 7f260e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:36.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.349+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:54:36.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.349+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:54:36.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.349+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:54:36.349 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.349+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:54:36.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.350+0000 7f2733b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:36.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.350+0000 7f2733b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.0 2024-09-12T00:54:36.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.350+0000 7f2733b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:36.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.350+0000 7f2733b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.1 2024-09-12T00:54:36.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.351+0000 7f2733b40800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:36.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.351+0000 7f2733b40800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.2.2 2024-09-12T00:54:36.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.351+0000 7f2733b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:36.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.351+0000 7f2733b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 2024-09-12T00:54:36.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.352+0000 7f2733b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:36.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.352+0000 7f2733b40800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:36.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.352+0000 7f2733b40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:36.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.352+0000 7f2733b40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18, ofs0, ns] 2024-09-12T00:54:36.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.352+0000 7f260effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464434 cookie 94242643295776 notifier 8556 bl.length()=879 2024-09-12T00:54:36.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.352+0000 7f260effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 info.flags=0x17 2024-09-12T00:54:36.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.352+0000 7f260effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.18 to cache LRU end 2024-09-12T00:54:36.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.352+0000 7f260effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:36.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.353+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_sources= new_sources= 2024-09-12T00:54:36.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.353+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential sources added=[] removed=[] 2024-09-12T00:54:36.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.353+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): orig_dests= new_dests= 2024-09-12T00:54:36.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.353+0000 7f2733b40800 20 handle_bi_update(): bucket=:a-bucket[ad4424e4-de7c-4376-b125-e717016a3484.4511.18]): potential dests added=[] removed=[] 2024-09-12T00:54:36.354 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.354+0000 7f2733b40800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T00:54:36.355 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.356+0000 7f25e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.358+0000 7f2733b40800 20 remove_watcher() i=0 2024-09-12T00:54:36.357 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.358+0000 7f2733b40800 2 removed watcher, disabling cache 2024-09-12T00:54:36.358 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.359+0000 7f2733b40800 20 remove_watcher() i=1 2024-09-12T00:54:36.359 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.360+0000 7f2733b40800 20 remove_watcher() i=2 2024-09-12T00:54:36.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.361+0000 7f2733b40800 20 remove_watcher() i=3 2024-09-12T00:54:36.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.362+0000 7f2733b40800 20 remove_watcher() i=4 2024-09-12T00:54:36.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.363+0000 7f2733b40800 20 remove_watcher() i=5 2024-09-12T00:54:36.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.363+0000 7f2733b40800 20 remove_watcher() i=6 2024-09-12T00:54:36.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.364+0000 7f2733b40800 20 remove_watcher() i=7 2024-09-12T00:54:36.375 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:54:36.404 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:36.404 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:36.440 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.440+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.442+0000 7fee7a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.442+0000 7fee7a40f800 20 realm 2024-09-12T00:54:36.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.442+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.442+0000 7fee7a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.442+0000 7fee7a40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:36.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.442+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.442 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.443+0000 7fee7a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.443+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.443+0000 7fee7a40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.443 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.443+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.444+0000 7fee7a40f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:36.444 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.444+0000 7fee7a40f800 20 searching for the correct realm 2024-09-12T00:54:36.446 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.447+0000 7fee6f6f8640 0 -- 172.21.15.83:0/2970438943 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fee60068840 msgr2=0x7fee6009d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.652 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.652+0000 7fee786fa640 0 -- 172.21.15.83:0/2970438943 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x562c5bc1c7f0 msgr2=0x562c5bc1ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.656+0000 7fee7a40f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:36.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.656+0000 7fee7a40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:36.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.656+0000 7fee7a40f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:36.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.656+0000 7fee7a40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:36.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.656+0000 7fee7a40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:36.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.656+0000 7fee7a40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:36.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.656+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.656+0000 7fee7a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.657 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.656+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 zone default found 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 4 Realm: () 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 zonegroup default 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.658 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.657+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.658+0000 7fee7a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.658+0000 7fee7a40f800 20 started sync module instance, tier type = 2024-09-12T00:54:36.659 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.658+0000 7fee7a40f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:36.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.666+0000 7fee7a40f800 20 add_watcher() i=0 2024-09-12T00:54:36.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.666+0000 7fee7a40f800 20 add_watcher() i=1 2024-09-12T00:54:36.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.666+0000 7fee7a40f800 20 add_watcher() i=2 2024-09-12T00:54:36.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.666+0000 7fee7a40f800 20 add_watcher() i=3 2024-09-12T00:54:36.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.666+0000 7fee7a40f800 20 add_watcher() i=4 2024-09-12T00:54:36.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.666+0000 7fee7a40f800 20 add_watcher() i=5 2024-09-12T00:54:36.666 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.666+0000 7fee7a40f800 20 add_watcher() i=6 2024-09-12T00:54:36.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.667+0000 7fee7a40f800 20 add_watcher() i=7 2024-09-12T00:54:36.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.667+0000 7fee7a40f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:36.668 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.669+0000 7fed2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.669+0000 7fee7a40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:36.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.669+0000 7fee7a40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:36.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.669+0000 7fee7a40f800 5 note: GC not initialized 2024-09-12T00:54:36.670 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.669+0000 7fed2cfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:36.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.669+0000 7fee7a40f800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:36.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.669+0000 7fee7a40f800 20 Filter name: none 2024-09-12T00:54:36.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.669+0000 7feca67fc640 20 reqs_thread_entry: start 2024-09-12T00:54:36.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.669+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.670+0000 7fee7a40f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:54:36.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.670+0000 7fee7a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.670+0000 7fee7a40f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:54:36.671 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.670+0000 7fee7a40f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:36.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.670+0000 7fee7a40f800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:54:36.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.670+0000 7fee7a40f800 20 INFO: main: starting shard=0 2024-09-12T00:54:36.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.670+0000 7fee7a40f800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:54:36.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.670+0000 7fee7a40f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.18.3.0 2024-09-12T00:54:36.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.671+0000 7fee7a40f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:36.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.671+0000 7fee7a40f800 20 INFO: main: done 2024-09-12T00:54:36.672 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.672+0000 7fed2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.674+0000 7fee7a40f800 20 remove_watcher() i=0 2024-09-12T00:54:36.673 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.674+0000 7fee7a40f800 2 removed watcher, disabling cache 2024-09-12T00:54:36.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.675+0000 7fee7a40f800 20 remove_watcher() i=1 2024-09-12T00:54:36.675 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.676+0000 7fee7a40f800 20 remove_watcher() i=2 2024-09-12T00:54:36.676 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.677+0000 7fee7a40f800 20 remove_watcher() i=3 2024-09-12T00:54:36.677 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.678+0000 7fee7a40f800 20 remove_watcher() i=4 2024-09-12T00:54:36.678 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.679+0000 7fee7a40f800 20 remove_watcher() i=5 2024-09-12T00:54:36.679 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.680+0000 7fee7a40f800 20 remove_watcher() i=6 2024-09-12T00:54:36.680 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.681+0000 7fee7a40f800 20 remove_watcher() i=7 2024-09-12T00:54:36.690 INFO:tasks.workunit.client.0.smithi083.stderr: test: PUT succeeds during reshard 2024-09-12T00:54:36.691 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:54:36.720 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:36.720 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:36.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.757+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.759+0000 7f0b70f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.759+0000 7f0b70f3c800 20 realm 2024-09-12T00:54:36.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.759+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.759+0000 7f0b70f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.759+0000 7f0b70f3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:36.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.759+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.759 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.760+0000 7f0b70f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.760 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.760+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.760+0000 7f0b70f3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.760+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.761+0000 7f0b70f3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:36.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.761+0000 7f0b70f3c800 20 searching for the correct realm 2024-09-12T00:54:36.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.762+0000 7f0b6cc81640 0 -- 172.21.15.83:0/3024289023 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x55d9e050e130 msgr2=0x55d9e0510520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.765+0000 7f0b6d482640 0 -- 172.21.15.83:0/3024289023 >> [v2:172.21.15.120:6816/3242240032,v1:172.21.15.120:6817/3242240032] conn(0x55d9e050e130 msgr2=0x7f0b640ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:36.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:36.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:36.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:36.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:36.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:36.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.972 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.973 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.972+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:36.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 20 zone default found 2024-09-12T00:54:36.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 4 Realm: () 2024-09-12T00:54:36.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:36.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:36.974 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:36.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 20 zonegroup default 2024-09-12T00:54:36.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.973+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.974+0000 7f0b70f3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.974+0000 7f0b70f3c800 20 started sync module instance, tier type = 2024-09-12T00:54:36.975 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.974+0000 7f0b70f3c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:36.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.982+0000 7f0b70f3c800 20 add_watcher() i=0 2024-09-12T00:54:36.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.982+0000 7f0b70f3c800 20 add_watcher() i=1 2024-09-12T00:54:36.981 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.982+0000 7f0b70f3c800 20 add_watcher() i=2 2024-09-12T00:54:36.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.982+0000 7f0b70f3c800 20 add_watcher() i=3 2024-09-12T00:54:36.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.982+0000 7f0b70f3c800 20 add_watcher() i=4 2024-09-12T00:54:36.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.982+0000 7f0b70f3c800 20 add_watcher() i=5 2024-09-12T00:54:36.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.982+0000 7f0b70f3c800 20 add_watcher() i=6 2024-09-12T00:54:36.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.983+0000 7f0b70f3c800 20 add_watcher() i=7 2024-09-12T00:54:36.982 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.983+0000 7f0b70f3c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:36.984 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.985+0000 7f0a22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.985+0000 7f0b70f3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:36.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.985+0000 7f0b70f3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:36.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.985+0000 7f0b70f3c800 5 note: GC not initialized 2024-09-12T00:54:36.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.985+0000 7f0a21fe3640 20 reqs_thread_entry: start 2024-09-12T00:54:36.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.985+0000 7f0b70f3c800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:36.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.985+0000 7f0b70f3c800 20 Filter name: none 2024-09-12T00:54:36.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.985+0000 7f09937fe640 20 reqs_thread_entry: start 2024-09-12T00:54:36.985 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.986+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.986+0000 7f0b70f3c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:36.986 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.986+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.986+0000 7f0b70f3c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:36.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.986+0000 7f0b70f3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:36.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.986+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.987+0000 7f0b70f3c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:36.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.987+0000 7f0b70f3c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.987+0000 7f0b70f3c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:36.987 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.987+0000 7f0b70f3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:36.988 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.988+0000 7f0a22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.991+0000 7f0b70f3c800 20 remove_watcher() i=0 2024-09-12T00:54:36.990 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.991+0000 7f0b70f3c800 2 removed watcher, disabling cache 2024-09-12T00:54:36.991 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.991+0000 7f0b70f3c800 20 remove_watcher() i=1 2024-09-12T00:54:36.992 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.992+0000 7f0b70f3c800 20 remove_watcher() i=2 2024-09-12T00:54:36.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.993+0000 7f0b70f3c800 20 remove_watcher() i=3 2024-09-12T00:54:36.993 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.994+0000 7f0b70f3c800 20 remove_watcher() i=4 2024-09-12T00:54:36.994 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.995+0000 7f0b70f3c800 20 remove_watcher() i=5 2024-09-12T00:54:36.995 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.996+0000 7f0b70f3c800 20 remove_watcher() i=6 2024-09-12T00:54:36.996 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:36.997+0000 7f0b70f3c800 20 remove_watcher() i=7 2024-09-12T00:54:37.007 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:37.007 INFO:tasks.workunit.client.0.smithi083.stderr:BUCKET_STATS: 2024-09-12T00:54:37.007 INFO:tasks.workunit.client.0.smithi083.stderr:bucket: myver id: ad4424e4-de7c-4376-b125-e717016a3484.4511.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:54:37.007 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:37.008 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T00:54:37.041 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:37.041 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:37.077 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.078+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.079+0000 7fc1fe92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.079+0000 7fc1fe92e800 20 realm 2024-09-12T00:54:37.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.079+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.079+0000 7fc1fe92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.079+0000 7fc1fe92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:37.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.079+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.079+0000 7fc1fe92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.079 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.079+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.080+0000 7fc1fe92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:37.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.080+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.081+0000 7fc1fe92e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:37.080 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.081+0000 7fc1fe92e800 20 searching for the correct realm 2024-09-12T00:54:37.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.084+0000 7fc1f1d63640 0 -- 172.21.15.83:0/223022608 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fc1e40d09e0 msgr2=0x7fc1e40de3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:37.289 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.289+0000 7fc1fa564640 0 -- 172.21.15.83:0/223022608 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fc1f401fb40 msgr2=0x7fc1f40019e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:37.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:37.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:37.293 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:37.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:37.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:37.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:37.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.294 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:37.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.295 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 zone default found 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 4 Realm: () 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 zonegroup default 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.294+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.295+0000 7fc1fe92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.295+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.295+0000 7fc1fe92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.295+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.295+0000 7fc1fe92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.296 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.295+0000 7fc1fe92e800 20 started sync module instance, tier type = 2024-09-12T00:54:37.297 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.295+0000 7fc1fe92e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:37.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.303+0000 7fc1fe92e800 20 add_watcher() i=0 2024-09-12T00:54:37.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.303+0000 7fc1fe92e800 20 add_watcher() i=1 2024-09-12T00:54:37.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.303+0000 7fc1fe92e800 20 add_watcher() i=2 2024-09-12T00:54:37.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.303+0000 7fc1fe92e800 20 add_watcher() i=3 2024-09-12T00:54:37.303 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.303+0000 7fc1fe92e800 20 add_watcher() i=4 2024-09-12T00:54:37.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.303+0000 7fc1fe92e800 20 add_watcher() i=5 2024-09-12T00:54:37.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.303+0000 7fc1fe92e800 20 add_watcher() i=6 2024-09-12T00:54:37.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.304+0000 7fc1fe92e800 20 add_watcher() i=7 2024-09-12T00:54:37.304 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.304+0000 7fc1fe92e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:37.305 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.306+0000 7fc0b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:37.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.306+0000 7fc1fe92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:37.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.306+0000 7fc1fe92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:37.306 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.306+0000 7fc1fe92e800 5 note: GC not initialized 2024-09-12T00:54:37.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc02b7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:37.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc1fe92e800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:37.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc1fe92e800 20 Filter name: none 2024-09-12T00:54:37.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc0297fa640 20 reqs_thread_entry: start 2024-09-12T00:54:37.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc1fe92e800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:54:37.307 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc1fe92e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:37.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc1fe92e800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:54:37.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc1fe92e800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:54:37.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc1fe92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : miss 2024-09-12T00:54:37.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.307+0000 7fc1fe92e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.308 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.308+0000 7fc1fe92e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:37.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.308+0000 7fc1fe92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:37.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.308+0000 7fc1fe92e800 10 adding default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:37.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.308+0000 7fc1fe92e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:37.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.308+0000 7fc1fe92e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:37.309 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.308+0000 7fc1fe92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:37.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.311+0000 7fc1fe92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:37.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.311+0000 7fc1fe92e800 10 moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:37.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.311+0000 7fc1fe92e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:37.311 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.311+0000 7fc1fe92e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19, ofs0, ns] 2024-09-12T00:54:37.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.312+0000 7fc0ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464382 cookie 94457247824112 notifier 8126 bl.length()=905 2024-09-12T00:54:37.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.312+0000 7fc0ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:37.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.312+0000 7fc0ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:37.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.312+0000 7fc0ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:37.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.312+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_sources= new_sources= 2024-09-12T00:54:37.312 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.312+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential sources added=[] removed=[] 2024-09-12T00:54:37.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.312+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_dests= new_dests= 2024-09-12T00:54:37.313 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.312+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential dests added=[] removed=[] 2024-09-12T00:54:37.314 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:37.315+0000 7fc1fe92e800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:54:38.012 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:38.013 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:38.027 INFO:tasks.workunit.client.0.smithi083.stderr:put object successful 2024-09-12T00:54:42.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.316+0000 7fc1fe92e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:42.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.316+0000 7fc1fe92e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:42.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.316+0000 7fc1fe92e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:42.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.316+0000 7fc1fe92e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:42.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.316+0000 7fc1fe92e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:42.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.316+0000 7fc1fe92e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:42.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.316+0000 7fc1fe92e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.0 2024-09-12T00:54:42.315 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.316+0000 7fc1fe92e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.0 2024-09-12T00:54:42.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.317+0000 7fc1fe92e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.1 2024-09-12T00:54:42.317 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.317+0000 7fc1fe92e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.1 2024-09-12T00:54:42.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.319+0000 7fc1fe92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:42.318 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.319+0000 7fc1fe92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:42.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.321+0000 7fc1fe92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:42.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.321+0000 7fc1fe92e800 10 moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:42.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.321+0000 7fc1fe92e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:42.320 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.321+0000 7fc1fe92e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19, ofs0, ns] 2024-09-12T00:54:42.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.322+0000 7fc0ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464383 cookie 94457247824112 notifier 8126 bl.length()=905 2024-09-12T00:54:42.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.322+0000 7fc0ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:42.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.322+0000 7fc0ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:42.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.322+0000 7fc0ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:42.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.323+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_sources= new_sources= 2024-09-12T00:54:42.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.323+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential sources added=[] removed=[] 2024-09-12T00:54:42.321 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.323+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_dests= new_dests= 2024-09-12T00:54:42.322 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.323+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential dests added=[] removed=[] 2024-09-12T00:54:42.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.324+0000 7fc1fe92e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.0 2024-09-12T00:54:42.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.324+0000 7fc1fe92e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.0 2024-09-12T00:54:42.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.325+0000 7fc1fe92e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.1 2024-09-12T00:54:42.323 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.325+0000 7fc1fe92e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.1.1 2024-09-12T00:54:42.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.327+0000 7fc1fe92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:42.325 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.327+0000 7fc1fe92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:42.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.328+0000 7fc1fe92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:42.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc1fe92e800 10 moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:42.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc1fe92e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:42.327 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc1fe92e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19, ofs0, ns] 2024-09-12T00:54:42.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc0ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464384 cookie 94457247824112 notifier 8126 bl.length()=873 2024-09-12T00:54:42.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc0ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:42.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc0ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:42.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc0ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:42.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_sources= new_sources= 2024-09-12T00:54:42.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential sources added=[] removed=[] 2024-09-12T00:54:42.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_dests= new_dests= 2024-09-12T00:54:42.328 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.329+0000 7fc1fe92e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential dests added=[] removed=[] 2024-09-12T00:54:42.329 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.331+0000 7fc1fe92e800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T00:54:42.332 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.333+0000 7fc0b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:42.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.336+0000 7fc1fe92e800 20 remove_watcher() i=0 2024-09-12T00:54:42.334 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.336+0000 7fc1fe92e800 2 removed watcher, disabling cache 2024-09-12T00:54:42.335 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.337+0000 7fc1fe92e800 20 remove_watcher() i=1 2024-09-12T00:54:42.337 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.338+0000 7fc1fe92e800 20 remove_watcher() i=2 2024-09-12T00:54:42.338 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.339+0000 7fc1fe92e800 20 remove_watcher() i=3 2024-09-12T00:54:42.340 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.341+0000 7fc1fe92e800 20 remove_watcher() i=4 2024-09-12T00:54:42.341 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.343+0000 7fc1fe92e800 20 remove_watcher() i=5 2024-09-12T00:54:42.342 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.344+0000 7fc1fe92e800 20 remove_watcher() i=6 2024-09-12T00:54:42.344 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:42.345+0000 7fc1fe92e800 20 remove_watcher() i=7 2024-09-12T00:54:43.031 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:54:43.032 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T00:54:43.036 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:43.036 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:43.041 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:43.042 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:43.085 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:43.085 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:43.102 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:43.102 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:43.106 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:43.106 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:43.122 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:43.122 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:43.125 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:43.125 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:43.140 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:43.140 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:43.144 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:54:43.539 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:54:44.932 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:44.932 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:44.988 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:54:44.990 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:54:45.022 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:45.023 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:45.063 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.064+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.066+0000 7f767be13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.066+0000 7f767be13800 20 realm 2024-09-12T00:54:45.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.066+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.066+0000 7f767be13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.066+0000 7f767be13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:45.065 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.066+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.067+0000 7f767be13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:45.066 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.067+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.067+0000 7f767be13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:45.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.067+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:45.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.068+0000 7f767be13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:45.067 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.068+0000 7f767be13800 20 searching for the correct realm 2024-09-12T00:54:45.070 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.072+0000 7f7677d93640 0 -- 172.21.15.83:0/3618717119 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f766c01f060 msgr2=0x7f766c05f690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:45.674 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:45.676+0000 7f7677592640 0 -- 172.21.15.83:0/3618717119 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f767006e070 msgr2=0x7f76700c2920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:46.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:46.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:46.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:46.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:46.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:46.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:46.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:46.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.485+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 20 zone default found 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 4 Realm: () 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 20 zonegroup default 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.486+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.487+0000 7f767be13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.487+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.487+0000 7f767be13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.487+0000 7f767be13800 20 started sync module instance, tier type = 2024-09-12T00:54:46.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.488+0000 7f767be13800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:46.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.499+0000 7f767be13800 20 add_watcher() i=0 2024-09-12T00:54:46.497 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.499+0000 7f767be13800 20 add_watcher() i=1 2024-09-12T00:54:46.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.499+0000 7f767be13800 20 add_watcher() i=2 2024-09-12T00:54:46.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.499+0000 7f767be13800 20 add_watcher() i=3 2024-09-12T00:54:46.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.499+0000 7f767be13800 20 add_watcher() i=4 2024-09-12T00:54:46.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.499+0000 7f767be13800 20 add_watcher() i=5 2024-09-12T00:54:46.498 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.499+0000 7f767be13800 20 add_watcher() i=6 2024-09-12T00:54:46.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.500+0000 7f767be13800 20 add_watcher() i=7 2024-09-12T00:54:46.499 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.500+0000 7f767be13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:46.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.503+0000 7f752dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:46.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.503+0000 7f767be13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:46.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.503+0000 7f767be13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:46.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.503+0000 7f767be13800 5 note: GC not initialized 2024-09-12T00:54:46.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.503+0000 7f752cfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:46.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.503+0000 7f767be13800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:46.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.503+0000 7f767be13800 20 Filter name: none 2024-09-12T00:54:46.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.504+0000 7f74a67fc640 20 reqs_thread_entry: start 2024-09-12T00:54:46.503 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.504+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.504+0000 7f767be13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:46.504 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.504+0000 7f767be13800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.505+0000 7f767be13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:46.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.505+0000 7f767be13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:46.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.505+0000 7f767be13800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:54:46.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.505+0000 7f767be13800 20 INFO: main: starting shard=0 2024-09-12T00:54:46.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.505+0000 7f767be13800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:46.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.505+0000 7f767be13800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:46.505 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.506+0000 7f767be13800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:54:46.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.506+0000 7f767be13800 20 INFO: main: starting shard=1 2024-09-12T00:54:46.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.506+0000 7f767be13800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:46.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.506+0000 7f767be13800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:46.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.506+0000 7f767be13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:46.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.506+0000 7f767be13800 20 INFO: main: starting shard=2 2024-09-12T00:54:46.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.506+0000 7f767be13800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:46.506 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.506+0000 7f767be13800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:46.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.507+0000 7f767be13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:46.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.507+0000 7f767be13800 20 INFO: main: done 2024-09-12T00:54:46.507 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.508+0000 7f752dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:46.509 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.511+0000 7f767be13800 20 remove_watcher() i=0 2024-09-12T00:54:46.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.511+0000 7f767be13800 2 removed watcher, disabling cache 2024-09-12T00:54:46.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.512+0000 7f767be13800 20 remove_watcher() i=1 2024-09-12T00:54:46.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.514+0000 7f767be13800 20 remove_watcher() i=2 2024-09-12T00:54:46.513 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.515+0000 7f767be13800 20 remove_watcher() i=3 2024-09-12T00:54:46.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.516+0000 7f767be13800 20 remove_watcher() i=4 2024-09-12T00:54:46.515 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.517+0000 7f767be13800 20 remove_watcher() i=5 2024-09-12T00:54:46.516 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.518+0000 7f767be13800 20 remove_watcher() i=6 2024-09-12T00:54:46.518 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.519+0000 7f767be13800 20 remove_watcher() i=7 2024-09-12T00:54:46.533 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:46.533 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:46.537 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:46.537 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:46.588 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:54:46.590 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:54:46.622 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:46.622 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:46.661 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.662+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.664+0000 7f47ca32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.663 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.664+0000 7f47ca32e800 20 realm 2024-09-12T00:54:46.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.664+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.665+0000 7f47ca32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.665+0000 7f47ca32e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:46.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.665+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.665+0000 7f47ca32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:46.664 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.665+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.666+0000 7f47ca32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:46.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.666+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:46.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.666+0000 7f47ca32e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:46.665 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.666+0000 7f47ca32e800 20 searching for the correct realm 2024-09-12T00:54:46.667 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.669+0000 7f47c60dd640 0 -- 172.21.15.83:0/2359965838 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f47b8062c20 msgr2=0x7f47b80864d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:46.873 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:46.875+0000 7f47c60dd640 0 -- 172.21.15.83:0/2359965838 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x556e1f259c10 msgr2=0x7f47c0016910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:47.081 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.082+0000 7f47ca32e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.082+0000 7f47ca32e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.082+0000 7f47ca32e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.082+0000 7f47ca32e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.082+0000 7f47ca32e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.082+0000 7f47ca32e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:47.082 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:47.083 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 20 zone default found 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 4 Realm: () 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 20 zonegroup default 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.083+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.084+0000 7f47ca32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.084+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.084+0000 7f47ca32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.084+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.084+0000 7f47ca32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.084 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.084+0000 7f47ca32e800 20 started sync module instance, tier type = 2024-09-12T00:54:47.085 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.084+0000 7f47ca32e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.094+0000 7f47ca32e800 20 add_watcher() i=0 2024-09-12T00:54:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.094+0000 7f47ca32e800 20 add_watcher() i=1 2024-09-12T00:54:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.094+0000 7f47ca32e800 20 add_watcher() i=2 2024-09-12T00:54:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.094+0000 7f47ca32e800 20 add_watcher() i=3 2024-09-12T00:54:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.094+0000 7f47ca32e800 20 add_watcher() i=4 2024-09-12T00:54:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.094+0000 7f47ca32e800 20 add_watcher() i=5 2024-09-12T00:54:47.093 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.094+0000 7f47ca32e800 20 add_watcher() i=6 2024-09-12T00:54:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.095+0000 7f47ca32e800 20 add_watcher() i=7 2024-09-12T00:54:47.094 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.095+0000 7f47ca32e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:47.096 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.097+0000 7f467cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.098+0000 7f47ca32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:47.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.098+0000 7f47ca32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:47.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.098+0000 7f47ca32e800 5 note: GC not initialized 2024-09-12T00:54:47.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.098+0000 7f45f77fe640 20 reqs_thread_entry: start 2024-09-12T00:54:47.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.098+0000 7f47ca32e800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:47.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.098+0000 7f47ca32e800 20 Filter name: none 2024-09-12T00:54:47.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.098+0000 7f45f57fa640 20 reqs_thread_entry: start 2024-09-12T00:54:47.097 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.098+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.099+0000 7f47ca32e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:47.098 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.099+0000 7f47ca32e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:47.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:47.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:54:47.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 20 INFO: main: starting shard=0 2024-09-12T00:54:47.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:47.099 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 20 INFO: main: starting shard=1 2024-09-12T00:54:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.100+0000 7f47ca32e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.101+0000 7f47ca32e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.101+0000 7f47ca32e800 20 INFO: main: starting shard=2 2024-09-12T00:54:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.101+0000 7f47ca32e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.101+0000 7f47ca32e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:47.100 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.101+0000 7f47ca32e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:54:47.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.102+0000 7f47ca32e800 20 INFO: main: done 2024-09-12T00:54:47.101 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.102+0000 7f467cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.105+0000 7f47ca32e800 20 remove_watcher() i=0 2024-09-12T00:54:47.103 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.105+0000 7f47ca32e800 2 removed watcher, disabling cache 2024-09-12T00:54:47.104 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.106+0000 7f47ca32e800 20 remove_watcher() i=1 2024-09-12T00:54:47.105 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.107+0000 7f47ca32e800 20 remove_watcher() i=2 2024-09-12T00:54:47.107 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.108+0000 7f47ca32e800 20 remove_watcher() i=3 2024-09-12T00:54:47.108 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.109+0000 7f47ca32e800 20 remove_watcher() i=4 2024-09-12T00:54:47.109 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.110+0000 7f47ca32e800 20 remove_watcher() i=5 2024-09-12T00:54:47.110 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.111+0000 7f47ca32e800 20 remove_watcher() i=6 2024-09-12T00:54:47.111 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.113+0000 7f47ca32e800 20 remove_watcher() i=7 2024-09-12T00:54:47.123 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:47.124 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:47.127 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:47.127 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:47.179 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:54:47.180 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:54:47.211 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:47.211 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:47.247 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.248+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.249 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.251+0000 7f18be139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.251+0000 7f18be139800 20 realm 2024-09-12T00:54:47.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.251+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.251+0000 7f18be139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.251+0000 7f18be139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:47.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.251+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.251+0000 7f18be139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.250 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.251+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.252+0000 7f18be139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:47.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.252+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.252+0000 7f18be139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:47.251 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.252+0000 7f18be139800 20 searching for the correct realm 2024-09-12T00:54:47.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.255+0000 7f18b95c6640 0 -- 172.21.15.83:0/2341623243 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f18b008f110 msgr2=0x7f18b007a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:47.459 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.460+0000 7f18b95c6640 0 -- 172.21.15.83:0/2341623243 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55eb960f0240 msgr2=0x55eb960f2630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:47.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.464+0000 7f18be139800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:47.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.464+0000 7f18be139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:47.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.464+0000 7f18be139800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:47.466 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.464+0000 7f18be139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.464+0000 7f18be139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.464+0000 7f18be139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.464+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 20 zone default found 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 4 Realm: () 2024-09-12T00:54:47.467 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 20 zonegroup default 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.465+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.466+0000 7f18be139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.466+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.466+0000 7f18be139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.466+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.466+0000 7f18be139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.466+0000 7f18be139800 20 started sync module instance, tier type = 2024-09-12T00:54:47.468 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.466+0000 7f18be139800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:47.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.476+0000 7f18be139800 20 add_watcher() i=0 2024-09-12T00:54:47.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.476+0000 7f18be139800 20 add_watcher() i=1 2024-09-12T00:54:47.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.476+0000 7f18be139800 20 add_watcher() i=2 2024-09-12T00:54:47.474 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.476+0000 7f18be139800 20 add_watcher() i=3 2024-09-12T00:54:47.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.476+0000 7f18be139800 20 add_watcher() i=4 2024-09-12T00:54:47.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.476+0000 7f18be139800 20 add_watcher() i=5 2024-09-12T00:54:47.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.476+0000 7f18be139800 20 add_watcher() i=6 2024-09-12T00:54:47.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.477+0000 7f18be139800 20 add_watcher() i=7 2024-09-12T00:54:47.475 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.477+0000 7f18be139800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:47.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.478+0000 7f176b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.479+0000 7f18be139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:47.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.479+0000 7f18be139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:47.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.479+0000 7f18be139800 5 note: GC not initialized 2024-09-12T00:54:47.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.479+0000 7f176a7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:47.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.479+0000 7f18be139800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:47.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.479+0000 7f18be139800 20 Filter name: none 2024-09-12T00:54:47.478 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.479+0000 7f16dbfff640 20 reqs_thread_entry: start 2024-09-12T00:54:47.479 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.479+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.480+0000 7f18be139800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:47.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.480+0000 7f18be139800 20 rados->read ofs=0 len=0 2024-09-12T00:54:47.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.480+0000 7f18be139800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:47.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.480+0000 7f18be139800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:47.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.480+0000 7f18be139800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:54:47.480 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.480+0000 7f18be139800 20 INFO: main: starting shard=0 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.480+0000 7f18be139800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.480+0000 7f18be139800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.481+0000 7f18be139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.481+0000 7f18be139800 20 INFO: main: starting shard=1 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.481+0000 7f18be139800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.481+0000 7f18be139800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.481+0000 7f18be139800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.481+0000 7f18be139800 20 INFO: main: starting shard=2 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.481+0000 7f18be139800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:47.481 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.481+0000 7f18be139800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:47.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.482+0000 7f18be139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:47.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.482+0000 7f18be139800 20 INFO: main: done 2024-09-12T00:54:47.482 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.483+0000 7f176b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:47.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.485+0000 7f18be139800 20 remove_watcher() i=0 2024-09-12T00:54:47.483 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.485+0000 7f18be139800 2 removed watcher, disabling cache 2024-09-12T00:54:47.484 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.486+0000 7f18be139800 20 remove_watcher() i=1 2024-09-12T00:54:47.485 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.487+0000 7f18be139800 20 remove_watcher() i=2 2024-09-12T00:54:47.486 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.488+0000 7f18be139800 20 remove_watcher() i=3 2024-09-12T00:54:47.487 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.489+0000 7f18be139800 20 remove_watcher() i=4 2024-09-12T00:54:47.489 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.490+0000 7f18be139800 20 remove_watcher() i=5 2024-09-12T00:54:47.490 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.491+0000 7f18be139800 20 remove_watcher() i=6 2024-09-12T00:54:47.491 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:47.492+0000 7f18be139800 20 remove_watcher() i=7 2024-09-12T00:54:47.503 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:47.504 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:47.508 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:54:47.900 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:54:48.291 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:54:48.323 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:48.323 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:48.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.361+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.363+0000 7f6eb840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.363+0000 7f6eb840e800 20 realm 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.363+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.363+0000 7f6eb840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.363+0000 7f6eb840e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:48.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.363+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.364+0000 7f6eb840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.364+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.364+0000 7f6eb840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.364+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.365+0000 7f6eb840e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:48.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.365+0000 7f6eb840e800 20 searching for the correct realm 2024-09-12T00:54:48.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.368+0000 7f6eabfff640 0 -- 172.21.15.83:0/4234218221 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f6e9c06b9a0 msgr2=0x7f6e9c084a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.372+0000 7f6eb3b6b640 0 -- 172.21.15.83:0/4234218221 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f6eac08bd20 msgr2=0x7f6eac0633f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.376+0000 7f6eb840e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.376+0000 7f6eb840e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.376+0000 7f6eb840e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.376+0000 7f6eb840e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.376+0000 7f6eb840e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.376+0000 7f6eb840e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.376+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:48.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 zone default found 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 4 Realm: () 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 zonegroup default 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.377+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.378+0000 7f6eb840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.378+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.378+0000 7f6eb840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.378+0000 7f6eb840e800 20 started sync module instance, tier type = 2024-09-12T00:54:48.378 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.378+0000 7f6eb840e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:48.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.388+0000 7f6eb840e800 20 add_watcher() i=0 2024-09-12T00:54:48.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.388+0000 7f6eb840e800 20 add_watcher() i=1 2024-09-12T00:54:48.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.388+0000 7f6eb840e800 20 add_watcher() i=2 2024-09-12T00:54:48.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.388+0000 7f6eb840e800 20 add_watcher() i=3 2024-09-12T00:54:48.386 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.388+0000 7f6eb840e800 20 add_watcher() i=4 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.388+0000 7f6eb840e800 20 add_watcher() i=5 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.388+0000 7f6eb840e800 20 add_watcher() i=6 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.389+0000 7f6eb840e800 20 add_watcher() i=7 2024-09-12T00:54:48.387 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.389+0000 7f6eb840e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:48.389 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.391+0000 7f6d69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:48.390 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.391+0000 7f6eb840e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:48.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.391+0000 7f6eb840e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:48.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.391+0000 7f6eb840e800 5 note: GC not initialized 2024-09-12T00:54:48.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.391+0000 7f6d68fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:48.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.391+0000 7f6eb840e800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:48.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.391+0000 7f6eb840e800 20 Filter name: none 2024-09-12T00:54:48.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.391+0000 7f6ce27fc640 20 reqs_thread_entry: start 2024-09-12T00:54:48.391 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:54:48.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:48.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:54:48.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:54:48.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : miss 2024-09-12T00:54:48.392 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:48.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:48.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 10 adding default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:48.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:48.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:48.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.392+0000 7f6eb840e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:48.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6eb840e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:48.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6eb840e800 10 moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:48.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6eb840e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:48.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6eb840e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19, ofs0, ns] 2024-09-12T00:54:48.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6d927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464385 cookie 94179439335280 notifier 8706 bl.length()=905 2024-09-12T00:54:48.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6d927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:48.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6d927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:48.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6d927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:48.400 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_sources= new_sources= 2024-09-12T00:54:48.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential sources added=[] removed=[] 2024-09-12T00:54:48.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_dests= new_dests= 2024-09-12T00:54:48.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.400+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential dests added=[] removed=[] 2024-09-12T00:54:48.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.0 2024-09-12T00:54:48.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.0 2024-09-12T00:54:48.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.1 2024-09-12T00:54:48.403 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.1 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.2 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.2 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.3 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.3 2024-09-12T00:54:48.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.4 2024-09-12T00:54:48.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.4 2024-09-12T00:54:48.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.5 2024-09-12T00:54:48.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.5 2024-09-12T00:54:48.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.6 2024-09-12T00:54:48.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.6 2024-09-12T00:54:48.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.7 2024-09-12T00:54:48.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.7 2024-09-12T00:54:48.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.8 2024-09-12T00:54:48.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.8 2024-09-12T00:54:48.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.10 2024-09-12T00:54:48.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.10 2024-09-12T00:54:48.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.11 2024-09-12T00:54:48.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.11 2024-09-12T00:54:48.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.12 2024-09-12T00:54:48.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.12 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.13 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.13 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.14 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.14 2024-09-12T00:54:48.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.15 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.15 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.16 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.16 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.403+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:48.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.404+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:48.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.404+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:48.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.404+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:48.410 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.404+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:48.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.406+0000 7f6eb840e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:48.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.406+0000 7f6eb840e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:48.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.408+0000 7f6eb840e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:48.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.408+0000 7f6eb840e800 10 moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:48.414 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.408+0000 7f6eb840e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:48.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.408+0000 7f6eb840e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19, ofs0, ns] 2024-09-12T00:54:48.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.408+0000 7f6d92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464386 cookie 94179439335280 notifier 8706 bl.length()=905 2024-09-12T00:54:48.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.408+0000 7f6d92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:48.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.408+0000 7f6d92ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:48.415 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.408+0000 7f6d92ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:48.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.409+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_sources= new_sources= 2024-09-12T00:54:48.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.409+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential sources added=[] removed=[] 2024-09-12T00:54:48.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.409+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_dests= new_dests= 2024-09-12T00:54:48.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.409+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential dests added=[] removed=[] 2024-09-12T00:54:48.416 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.410+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.410+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.0 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.410+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.410+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.1 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.410+0000 7f6eb840e800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:48.417 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.410+0000 7f6eb840e800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.2.2 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.411+0000 7f6eb840e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.411+0000 7f6eb840e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.412+0000 7f6eb840e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.412+0000 7f6eb840e800 10 moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.412+0000 7f6eb840e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:48.418 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.412+0000 7f6eb840e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19, ofs0, ns] 2024-09-12T00:54:48.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.413+0000 7f6d92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464387 cookie 94179439335280 notifier 8706 bl.length()=873 2024-09-12T00:54:48.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.413+0000 7f6d92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:48.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.413+0000 7f6d92ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:48.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.413+0000 7f6d92ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:48.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.413+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_sources= new_sources= 2024-09-12T00:54:48.419 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.413+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential sources added=[] removed=[] 2024-09-12T00:54:48.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.413+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): orig_dests= new_dests= 2024-09-12T00:54:48.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.413+0000 7f6eb840e800 20 handle_bi_update(): bucket=:myver[ad4424e4-de7c-4376-b125-e717016a3484.4511.19]): potential dests added=[] removed=[] 2024-09-12T00:54:48.420 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.414+0000 7f6eb840e800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T00:54:48.421 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.416+0000 7f6d69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:48.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.418+0000 7f6eb840e800 20 remove_watcher() i=0 2024-09-12T00:54:48.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.418+0000 7f6eb840e800 2 removed watcher, disabling cache 2024-09-12T00:54:48.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.419+0000 7f6eb840e800 20 remove_watcher() i=1 2024-09-12T00:54:48.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.421+0000 7f6eb840e800 20 remove_watcher() i=2 2024-09-12T00:54:48.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.422+0000 7f6eb840e800 20 remove_watcher() i=3 2024-09-12T00:54:48.422 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.423+0000 7f6eb840e800 20 remove_watcher() i=4 2024-09-12T00:54:48.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.424+0000 7f6eb840e800 20 remove_watcher() i=5 2024-09-12T00:54:48.423 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.425+0000 7f6eb840e800 20 remove_watcher() i=6 2024-09-12T00:54:48.425 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.427+0000 7f6eb840e800 20 remove_watcher() i=7 2024-09-12T00:54:48.437 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:54:48.471 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:48.471 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:48.508 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.510+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.511+0000 7f3cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.511+0000 7f3cbd742800 20 realm 2024-09-12T00:54:48.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.511+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.510 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.512+0000 7f3cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.512+0000 7f3cbd742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:48.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.512+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.512+0000 7f3cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.511 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.512+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.513+0000 7f3cbd742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.513+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.513+0000 7f3cbd742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:48.512 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.513+0000 7f3cbd742800 20 searching for the correct realm 2024-09-12T00:54:48.514 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.516+0000 7f3cb8c85640 0 -- 172.21.15.83:0/77197183 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f3cb0016070 msgr2=0x7f3cb0008410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:48.719 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.721+0000 7f3cb9c87640 0 -- 172.21.15.83:0/77197183 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x556b9e553930 msgr2=0x556b9e555da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:48.726 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.727 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:48.728 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 zone default found 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 4 Realm: () 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 zonegroup default 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.725+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.726+0000 7f3cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.726+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.726+0000 7f3cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.726+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.726+0000 7f3cbd742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.733 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.726+0000 7f3cbd742800 20 started sync module instance, tier type = 2024-09-12T00:54:48.734 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.726+0000 7f3cbd742800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:48.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.737+0000 7f3cbd742800 20 add_watcher() i=0 2024-09-12T00:54:48.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.737+0000 7f3cbd742800 20 add_watcher() i=1 2024-09-12T00:54:48.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.737+0000 7f3cbd742800 20 add_watcher() i=2 2024-09-12T00:54:48.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.737+0000 7f3cbd742800 20 add_watcher() i=3 2024-09-12T00:54:48.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.737+0000 7f3cbd742800 20 add_watcher() i=4 2024-09-12T00:54:48.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.737+0000 7f3cbd742800 20 add_watcher() i=5 2024-09-12T00:54:48.736 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.737+0000 7f3cbd742800 20 add_watcher() i=6 2024-09-12T00:54:48.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.738+0000 7f3cbd742800 20 add_watcher() i=7 2024-09-12T00:54:48.737 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.738+0000 7f3cbd742800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:48.738 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.740+0000 7f3b6ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:48.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.740+0000 7f3cbd742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:48.739 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.740+0000 7f3cbd742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:48.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.741+0000 7f3cbd742800 5 note: GC not initialized 2024-09-12T00:54:48.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.741+0000 7f3b6efe5640 20 reqs_thread_entry: start 2024-09-12T00:54:48.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.741+0000 7f3cbd742800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:48.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.741+0000 7f3cbd742800 20 Filter name: none 2024-09-12T00:54:48.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.741+0000 7f3cbd742800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:54:48.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.741+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.740 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.741+0000 7f3b6cfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:48.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.742+0000 7f3cbd742800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:48.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.742+0000 7f3cbd742800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:54:48.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.742+0000 7f3cbd742800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:54:48.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.742+0000 7f3cbd742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 : miss 2024-09-12T00:54:48.741 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.742+0000 7f3cbd742800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.745+0000 7f3cbd742800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:48.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.745+0000 7f3cbd742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 info.flags=0x17 2024-09-12T00:54:48.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.745+0000 7f3cbd742800 10 adding default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 to cache LRU end 2024-09-12T00:54:48.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.745+0000 7f3cbd742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:48.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.745+0000 7f3cbd742800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:54:48.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.745+0000 7f3cbd742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ad4424e4-de7c-4376-b125-e717016a3484.4511.19 2024-09-12T00:54:48.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.745+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.0 2024-09-12T00:54:48.744 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.745+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.0 2024-09-12T00:54:48.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.746+0000 7f3cbd742800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:54:48.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.746+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.1 2024-09-12T00:54:48.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.746+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.1 2024-09-12T00:54:48.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.747+0000 7f3cbd742800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:54:48.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.747+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.2 2024-09-12T00:54:48.745 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.747+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.2 2024-09-12T00:54:48.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.747+0000 7f3cbd742800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:54:48.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.747+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.3 2024-09-12T00:54:48.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.747+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.3 2024-09-12T00:54:48.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.748+0000 7f3cbd742800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:54:48.746 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.748+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.4 2024-09-12T00:54:48.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.748+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.4 2024-09-12T00:54:48.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.748+0000 7f3cbd742800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:54:48.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.748+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.5 2024-09-12T00:54:48.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.748+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.5 2024-09-12T00:54:48.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.749+0000 7f3cbd742800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:54:48.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.749+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.6 2024-09-12T00:54:48.747 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.749+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.6 2024-09-12T00:54:48.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.749+0000 7f3cbd742800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:54:48.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.749+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.7 2024-09-12T00:54:48.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.749+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.7 2024-09-12T00:54:48.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.750+0000 7f3cbd742800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:54:48.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.750+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.8 2024-09-12T00:54:48.748 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.750+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.8 2024-09-12T00:54:48.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.751+0000 7f3cbd742800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:54:48.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.751+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.751+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.751+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.10 2024-09-12T00:54:48.749 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.751+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.10 2024-09-12T00:54:48.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.751+0000 7f3cbd742800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:54:48.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.751+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.11 2024-09-12T00:54:48.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.751+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.11 2024-09-12T00:54:48.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.752+0000 7f3cbd742800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:54:48.750 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.752+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.12 2024-09-12T00:54:48.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.752+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.12 2024-09-12T00:54:48.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.753+0000 7f3cbd742800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:54:48.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.753+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.13 2024-09-12T00:54:48.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.753+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.13 2024-09-12T00:54:48.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.753+0000 7f3cbd742800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:54:48.751 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.753+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.14 2024-09-12T00:54:48.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.753+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.14 2024-09-12T00:54:48.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.753+0000 7f3cbd742800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:54:48.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.753+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.15 2024-09-12T00:54:48.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.753+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.15 2024-09-12T00:54:48.752 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.754+0000 7f3cbd742800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:54:48.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.754+0000 7f3cbd742800 10 bucket_obj is .dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.16 2024-09-12T00:54:48.753 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.754+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.16 2024-09-12T00:54:48.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.754+0000 7f3cbd742800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:54:48.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.754+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.755+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:x state=0x556b9e58a508 s->prefetch_data=0 2024-09-12T00:54:48.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.755+0000 7f3cbd742800 20 get_obj_state: setting s->obj_tag to fyyx19yvevtfnpyot5h3aw5x2gmh3ana 2024-09-12T00:54:48.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.755+0000 7f3cbd742800 20 get_obj_state_impl: setting s->olh_tag to c07fhuiusoj0k5b8dvwmbdcvld686t9y 2024-09-12T00:54:48.754 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.755+0000 7f3cbd742800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c07fhuiusoj0k5b8dvwmbdcvld686t9y 2024-09-12T00:54:48.755 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.757+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.758+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.757 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.759+0000 7f3cbd742800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:54:48.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.759+0000 7f3cbd742800 20 olh_log_entry: epoch=2 op=3 key=x[UlKslKc3YktVLfiXfmur8.V6WMImNY0] 2024-09-12T00:54:48.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.759+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:_:UlKslKc3YktVLfiXfmur8.V6WMImNY0_x state=0x556b9e5cc7e8 s->prefetch_data=0 2024-09-12T00:54:48.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.759+0000 7f3cbd742800 10 manifest: total_size = 11 2024-09-12T00:54:48.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.759+0000 7f3cbd742800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.6198768613606002711 2024-09-12T00:54:48.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.759+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:_:UlKslKc3YktVLfiXfmur8.V6WMImNY0_x state=0x556b9e5cc7e8 s->prefetch_data=0 2024-09-12T00:54:48.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.759+0000 7f3cbd742800 20 prepare_atomic_modification: state is not atomic. state=0x556b9e5cc7e8 2024-09-12T00:54:48.758 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.759+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.762+0000 7f3cbd742800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:54:48.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.762+0000 7f3cbd742800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:54:48.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.762+0000 7f3cbd742800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:54:48.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.762+0000 7f3cbd742800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.19__shadow:UlKslKc3YktVLfiXfmur8.V6WMImNY0_.bjrhwut-60n0_Zpu97ff0eRnK0oUURM_0 2024-09-12T00:54:48.761 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.763+0000 7f3b9cff9640 20 handle_completion(): completion ok for obj=x[UlKslKc3YktVLfiXfmur8.V6WMImNY0] 2024-09-12T00:54:48.762 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.763+0000 7f3cbd742800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:54:48.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.764+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:x state=0x556b9e58a508 s->prefetch_data=0 2024-09-12T00:54:48.763 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.764+0000 7f3cbd742800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c07fhuiusoj0k5b8dvwmbdcvld686t9y 2024-09-12T00:54:48.765 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.767+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.766 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.768+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.768+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.769+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:y state=0x556b9e5d40d8 s->prefetch_data=0 2024-09-12T00:54:48.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.769+0000 7f3cbd742800 20 get_obj_state: setting s->obj_tag to ynmq54al6gxd0b9x4xr4t4sqq3y9vzjw 2024-09-12T00:54:48.767 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.769+0000 7f3cbd742800 20 get_obj_state_impl: setting s->olh_tag to xgks7ld9jc0zs7lacfonqnzcl43q6bp4 2024-09-12T00:54:48.768 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.769+0000 7f3cbd742800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xgks7ld9jc0zs7lacfonqnzcl43q6bp4 2024-09-12T00:54:48.769 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.770+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.771+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.772+0000 7f3cbd742800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:54:48.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.772+0000 7f3cbd742800 20 olh_log_entry: epoch=2 op=3 key=y[Qgan3cVzmloJdko7YvGDhOoaFPAG90W] 2024-09-12T00:54:48.770 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.772+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:_:Qgan3cVzmloJdko7YvGDhOoaFPAG90W_y state=0x556b9e5d0fe8 s->prefetch_data=0 2024-09-12T00:54:48.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.772+0000 7f3cbd742800 10 manifest: total_size = 22 2024-09-12T00:54:48.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.772+0000 7f3cbd742800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.6219864614372331809 2024-09-12T00:54:48.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.772+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:_:Qgan3cVzmloJdko7YvGDhOoaFPAG90W_y state=0x556b9e5d0fe8 s->prefetch_data=0 2024-09-12T00:54:48.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.772+0000 7f3cbd742800 20 prepare_atomic_modification: state is not atomic. state=0x556b9e5d0fe8 2024-09-12T00:54:48.771 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.772+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.774+0000 7f3cbd742800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:54:48.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.774+0000 7f3cbd742800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:54:48.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.774+0000 7f3cbd742800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:54:48.773 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.774+0000 7f3cbd742800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.19__shadow:Qgan3cVzmloJdko7YvGDhOoaFPAG90W_.JWPVBmy2QdoOIlVVAH8RYdhha621bLY_0 2024-09-12T00:54:48.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.775+0000 7f3cbd742800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:54:48.774 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.776+0000 7f3b8ffff640 20 handle_completion(): completion ok for obj=y[Qgan3cVzmloJdko7YvGDhOoaFPAG90W] 2024-09-12T00:54:48.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.777+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:y state=0x556b9e5d40d8 s->prefetch_data=0 2024-09-12T00:54:48.775 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.777+0000 7f3cbd742800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xgks7ld9jc0zs7lacfonqnzcl43q6bp4 2024-09-12T00:54:48.778 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.780+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.779 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.781+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.781+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.782+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:z state=0x556b9e589ff8 s->prefetch_data=0 2024-09-12T00:54:48.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.782+0000 7f3cbd742800 20 get_obj_state: setting s->obj_tag to dpitg0gvig61wzhs0u1ir5kv60165jz9 2024-09-12T00:54:48.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.782+0000 7f3cbd742800 20 get_obj_state_impl: setting s->olh_tag to un34oam3c2rbvjy60ec8d0mniujywp9j 2024-09-12T00:54:48.780 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.782+0000 7f3cbd742800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=un34oam3c2rbvjy60ec8d0mniujywp9j 2024-09-12T00:54:48.782 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.783+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.783 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.785+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.785+0000 7f3cbd742800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:54:48.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.785+0000 7f3cbd742800 20 olh_log_entry: epoch=2 op=3 key=z[q0BuCHQ7XxlkOEfJknG8mE9xK1rpJEI] 2024-09-12T00:54:48.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.785+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:_:q0BuCHQ7XxlkOEfJknG8mE9xK1rpJEI_z state=0x556b9e5d0fb8 s->prefetch_data=0 2024-09-12T00:54:48.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.785+0000 7f3cbd742800 10 manifest: total_size = 22 2024-09-12T00:54:48.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.785+0000 7f3cbd742800 20 get_obj_state: setting s->obj_tag to ad4424e4-de7c-4376-b125-e717016a3484.4511.1488629423284515413 2024-09-12T00:54:48.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.785+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:_:q0BuCHQ7XxlkOEfJknG8mE9xK1rpJEI_z state=0x556b9e5d0fb8 s->prefetch_data=0 2024-09-12T00:54:48.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.785+0000 7f3cbd742800 20 prepare_atomic_modification: state is not atomic. state=0x556b9e5d0fb8 2024-09-12T00:54:48.784 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.785+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.788+0000 7f3cbd742800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:54:48.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.788+0000 7f3cbd742800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:54:48.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.788+0000 7f3cbd742800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:54:48.786 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.788+0000 7f3cbd742800 5 delete_objs_inline: removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.19__shadow:q0BuCHQ7XxlkOEfJknG8mE9xK1rpJEI_.asogmoqCTfu96e2sw_RQX2JanMHHaqi_0 2024-09-12T00:54:48.787 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.789+0000 7f3b9cff9640 20 handle_completion(): completion ok for obj=z[q0BuCHQ7XxlkOEfJknG8mE9xK1rpJEI] 2024-09-12T00:54:48.788 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.789+0000 7f3cbd742800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:54:48.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.790+0000 7f3cbd742800 20 get_obj_state: octx=0x556b9e2f1bf0 obj=myver:z state=0x556b9e589ff8 s->prefetch_data=0 2024-09-12T00:54:48.789 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.790+0000 7f3cbd742800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=un34oam3c2rbvjy60ec8d0mniujywp9j 2024-09-12T00:54:48.791 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.793+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.794+0000 7f3cbd742800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.19.3.9 2024-09-12T00:54:48.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.794+0000 7f3cbd742800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:54:48.793 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.794+0000 7f3cbd742800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:54:48.794 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.795+0000 7f3b6ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:48.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.797+0000 7f3cbd742800 20 remove_watcher() i=0 2024-09-12T00:54:48.796 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.797+0000 7f3cbd742800 2 removed watcher, disabling cache 2024-09-12T00:54:48.797 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.799+0000 7f3cbd742800 20 remove_watcher() i=1 2024-09-12T00:54:48.799 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.801+0000 7f3cbd742800 20 remove_watcher() i=2 2024-09-12T00:54:48.800 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.802+0000 7f3cbd742800 20 remove_watcher() i=3 2024-09-12T00:54:48.802 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.803+0000 7f3cbd742800 20 remove_watcher() i=4 2024-09-12T00:54:48.803 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.804+0000 7f3cbd742800 20 remove_watcher() i=5 2024-09-12T00:54:48.804 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.805+0000 7f3cbd742800 20 remove_watcher() i=6 2024-09-12T00:54:48.805 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.807+0000 7f3cbd742800 20 remove_watcher() i=7 2024-09-12T00:54:48.817 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:48.817 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:48.822 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:48.822 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:48.866 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:54:48.898 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:48.898 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:48.932 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.933+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.935+0000 7f0326125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.935+0000 7f0326125800 20 realm 2024-09-12T00:54:48.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.935+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.934 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.936+0000 7f0326125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.936+0000 7f0326125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:48.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.936+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.936+0000 7f0326125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:48.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.936+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.935 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.936+0000 7f0326125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:48.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.936+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:48.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.937+0000 7f0326125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:48.936 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.937+0000 7f0326125800 20 searching for the correct realm 2024-09-12T00:54:48.937 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:48.939+0000 7f0321d33640 0 -- 172.21.15.83:0/189432642 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f0314073310 msgr2=0x7f03140818b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:49.142 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.144+0000 7f0321d33640 0 -- 172.21.15.83:0/189432642 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f031c066c20 msgr2=0x7f031c060920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:49.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.351+0000 7f0326125800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:54:49.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.351+0000 7f0326125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:49.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.351+0000 7f0326125800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:54:49.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.351+0000 7f0326125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:49.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.351+0000 7f0326125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:49.350 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.351+0000 7f0326125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:49.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.351+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.351+0000 7f0326125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.351+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:49.351 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 20 zone default found 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 4 Realm: () 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 20 zonegroup default 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.352 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.352+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.353+0000 7f0326125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.353+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.353+0000 7f0326125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:49.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.353+0000 7f0326125800 20 started sync module instance, tier type = 2024-09-12T00:54:49.353 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.353+0000 7f0326125800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:54:49.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.361+0000 7f0326125800 20 add_watcher() i=0 2024-09-12T00:54:49.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.361+0000 7f0326125800 20 add_watcher() i=1 2024-09-12T00:54:49.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.361+0000 7f0326125800 20 add_watcher() i=2 2024-09-12T00:54:49.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.361+0000 7f0326125800 20 add_watcher() i=3 2024-09-12T00:54:49.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.361+0000 7f0326125800 20 add_watcher() i=4 2024-09-12T00:54:49.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.361+0000 7f0326125800 20 add_watcher() i=5 2024-09-12T00:54:49.360 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.361+0000 7f0326125800 20 add_watcher() i=6 2024-09-12T00:54:49.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.362+0000 7f0326125800 20 add_watcher() i=7 2024-09-12T00:54:49.361 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.362+0000 7f0326125800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:49.362 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.364+0000 7f01d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:49.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.364+0000 7f0326125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:49.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.364+0000 7f0326125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:49.363 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.364+0000 7f0326125800 5 note: GC not initialized 2024-09-12T00:54:49.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.364+0000 7f01d27fc640 20 reqs_thread_entry: start 2024-09-12T00:54:49.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.365+0000 7f0326125800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:49.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.365+0000 7f0326125800 20 Filter name: none 2024-09-12T00:54:49.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.365+0000 7f0143fff640 20 reqs_thread_entry: start 2024-09-12T00:54:49.364 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.365+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.365+0000 7f0326125800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:49.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.365+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.366+0000 7f0326125800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:49.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.366+0000 7f0326125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:49.365 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.366+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.367+0000 7f0326125800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:49.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.367+0000 7f0326125800 20 rados->read ofs=0 len=0 2024-09-12T00:54:49.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.367+0000 7f0326125800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:49.366 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.367+0000 7f0326125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:49.367 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.369+0000 7f01d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:49.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.372+0000 7f0326125800 20 remove_watcher() i=0 2024-09-12T00:54:49.370 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.372+0000 7f0326125800 2 removed watcher, disabling cache 2024-09-12T00:54:49.371 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.373+0000 7f0326125800 20 remove_watcher() i=1 2024-09-12T00:54:49.372 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.374+0000 7f0326125800 20 remove_watcher() i=2 2024-09-12T00:54:49.373 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.375+0000 7f0326125800 20 remove_watcher() i=3 2024-09-12T00:54:49.374 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.376+0000 7f0326125800 20 remove_watcher() i=4 2024-09-12T00:54:49.375 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.377+0000 7f0326125800 20 remove_watcher() i=5 2024-09-12T00:54:49.376 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.378+0000 7f0326125800 20 remove_watcher() i=6 2024-09-12T00:54:49.377 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T00:54:49.379+0000 7f0326125800 20 remove_watcher() i=7 2024-09-12T00:54:49.388 INFO:tasks.workunit.client.0.smithi083.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:54:49.388 INFO:tasks.workunit.client.0.smithi083.stderr:Deleting bucket a-bucket 2024-09-12T00:54:49.390 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:49.390 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:49.393 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:49.394 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:49.406 INFO:tasks.workunit.client.0.smithi083.stderr:Deleting bucket myver 2024-09-12T00:54:49.407 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:49.408 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:49.452 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:54:49.452 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T00:54:49.489 INFO:tasks.workunit.client.0.smithi083.stderr:Completed resharding tests 2024-09-12T00:54:49.489 INFO:tasks.workunit.client.0.smithi083.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:54:49.490 INFO:tasks.workunit.client.0.smithi083.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:54:49.490 INFO:tasks.workunit.client.0.smithi083.stdout:connected to https://localhost:443 2024-09-12T00:54:49.569 INFO:tasks.workunit.client.0.smithi083.stderr:+ deactivate 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ export PATH 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ hash -r 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset -f deactivate 2024-09-12T00:54:49.570 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo OK. 2024-09-12T00:54:49.571 INFO:tasks.workunit.client.0.smithi083.stdout:OK. 2024-09-12T00:54:49.572 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:54:49.572 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:54:49.652 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:54:49.652 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:54:50.066 DEBUG:teuthology.parallel:result is None 2024-09-12T00:54:50.067 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:54:50.105 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:54:50.105 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:54:50.174 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:54:50.175 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:54:50.190 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:54:50.190 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:54:50.190 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:54:50.191 DEBUG:teuthology.orchestra.run.smithi083:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:54:50.243 INFO:teuthology.orchestra.run.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:54:54.636 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:54:54.636 DEBUG:teuthology.orchestra.run.smithi083:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:54:56.518 INFO:teuthology.orchestra.run.smithi083.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T00:54:57.085 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:28:00 ago on Thu 12 Sep 2024 12:26:57 AM UTC. 2024-09-12T00:54:57.229 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-12T00:54:57.230 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout:Installing weak dependencies: 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:54:57.231 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-12T00:54:57.232 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-12T00:54:57.232 INFO:teuthology.orchestra.run.smithi083.stdout:Install 5 Packages 2024-09-12T00:54:57.232 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:54:57.232 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 46 M 2024-09-12T00:54:57.232 INFO:teuthology.orchestra.run.smithi083.stdout:Installed size: 166 M 2024-09-12T00:54:57.232 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-12T00:54:57.479 INFO:teuthology.orchestra.run.smithi083.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.8 MB/s | 426 kB 00:00 2024-09-12T00:54:58.113 INFO:teuthology.orchestra.run.smithi083.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 4.1 MB/s | 3.5 MB 00:00 2024-09-12T00:54:58.155 INFO:teuthology.orchestra.run.smithi083.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 625 kB/s | 26 kB 00:00 2024-09-12T00:54:59.597 INFO:teuthology.orchestra.run.smithi083.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 4.0 MB/s | 9.3 MB 00:02 2024-09-12T00:55:03.660 INFO:teuthology.orchestra.run.smithi083.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 5.2 MB/s | 32 MB 00:06 2024-09-12T00:55:03.661 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:55:03.661 INFO:teuthology.orchestra.run.smithi083.stdout:Total 7.1 MB/s | 46 MB 00:06 2024-09-12T00:55:04.090 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-12T00:55:04.111 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-12T00:55:04.111 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-12T00:55:04.592 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-12T00:55:04.592 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-12T00:55:05.117 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T00:55:05.265 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-12T00:55:05.459 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T00:55:06.073 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T00:55:06.118 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:55:06.359 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:55:06.386 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:55:06.617 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:55:06.657 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:55:06.665 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:55:06.674 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T00:55:06.709 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T00:55:09.968 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:55:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T00:55:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T00:55:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T00:55:09.969 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:10.385 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-12T00:55:10.830 INFO:teuthology.orchestra.run.smithi083.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:55:10.899 INFO:teuthology.orchestra.run.smithi083.stderr:--2024-09-12 00:55:10-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:55:11.059 INFO:teuthology.orchestra.run.smithi083.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T00:55:11.072 INFO:teuthology.orchestra.run.smithi083.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T00:55:11.190 INFO:teuthology.orchestra.run.smithi083.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:55:11.190 INFO:teuthology.orchestra.run.smithi083.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:55:11.191 INFO:teuthology.orchestra.run.smithi083.stderr:--2024-09-12 00:55:11-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:55:11.191 INFO:teuthology.orchestra.run.smithi083.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-12T00:55:11.201 INFO:teuthology.orchestra.run.smithi083.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-12T00:55:11.290 INFO:teuthology.orchestra.run.smithi083.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:55:11.290 INFO:teuthology.orchestra.run.smithi083.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T005325Z&X-Amz-Expires=300&X-Amz-Signature=b232e39c8f6732d16d94ae018fcbfd563a9dca3afe606d8a79e324ac3d74dcba&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:55:11.290 INFO:teuthology.orchestra.run.smithi083.stderr:--2024-09-12 00:55:11-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T005325Z&X-Amz-Expires=300&X-Amz-Signature=b232e39c8f6732d16d94ae018fcbfd563a9dca3afe606d8a79e324ac3d74dcba&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:55:11.290 INFO:teuthology.orchestra.run.smithi083.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.110.133, 185.199.111.133, ... 2024-09-12T00:55:11.302 INFO:teuthology.orchestra.run.smithi083.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected. 2024-09-12T00:55:11.376 INFO:teuthology.orchestra.run.smithi083.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:55:11.376 INFO:teuthology.orchestra.run.smithi083.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:55:11.376 INFO:teuthology.orchestra.run.smithi083.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T00:55:11.376 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T00:55:11.389 INFO:teuthology.orchestra.run.smithi083.stderr: 0K .......... .......... .......... .......... .......... 0% 3.51M 26s 2024-09-12T00:55:11.401 INFO:teuthology.orchestra.run.smithi083.stderr: 50K .......... .......... .......... .......... .......... 0% 3.89M 25s 2024-09-12T00:55:11.411 INFO:teuthology.orchestra.run.smithi083.stderr: 100K .......... .......... .......... .......... .......... 0% 5.27M 22s 2024-09-12T00:55:11.413 INFO:teuthology.orchestra.run.smithi083.stderr: 150K .......... .......... .......... .......... .......... 0% 23.9M 17s 2024-09-12T00:55:11.415 INFO:teuthology.orchestra.run.smithi083.stderr: 200K .......... .......... .......... .......... .......... 0% 25.1M 15s 2024-09-12T00:55:11.421 INFO:teuthology.orchestra.run.smithi083.stderr: 250K .......... .......... .......... .......... .......... 0% 25.3M 13s 2024-09-12T00:55:11.424 INFO:teuthology.orchestra.run.smithi083.stderr: 300K .......... .......... .......... .......... .......... 0% 7.18M 13s 2024-09-12T00:55:11.425 INFO:teuthology.orchestra.run.smithi083.stderr: 350K .......... .......... .......... .......... .......... 0% 48.3M 11s 2024-09-12T00:55:11.427 INFO:teuthology.orchestra.run.smithi083.stderr: 400K .......... .......... .......... .......... .......... 0% 37.3M 10s 2024-09-12T00:55:11.427 INFO:teuthology.orchestra.run.smithi083.stderr: 450K .......... .......... .......... .......... .......... 0% 83.1M 9s 2024-09-12T00:55:11.429 INFO:teuthology.orchestra.run.smithi083.stderr: 500K .......... .......... .......... .......... .......... 0% 40.6M 9s 2024-09-12T00:55:11.429 INFO:teuthology.orchestra.run.smithi083.stderr: 550K .......... .......... .......... .......... .......... 0% 78.2M 8s 2024-09-12T00:55:11.433 INFO:teuthology.orchestra.run.smithi083.stderr: 600K .......... .......... .......... .......... .......... 0% 10.1M 8s 2024-09-12T00:55:12.751 INFO:teuthology.orchestra.run.smithi083.stderr: 650K .......... .......... .......... .......... .......... 0% 42.5M 8s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 700K .......... .......... .......... .......... .......... 0% 48.1M 7s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 750K .......... .......... .......... .......... .......... 0% 48.9M 7s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 800K .......... .......... .......... .......... .......... 0% 165M 7s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 850K .......... .......... .......... .......... .......... 0% 58.3M 6s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 900K .......... .......... .......... .......... .......... 1% 278M 6s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 950K .......... .......... .......... .......... .......... 1% 89.2M 6s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 1000K .......... .......... .......... .......... .......... 1% 45.2M 6s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 1050K .......... .......... .......... .......... .......... 1% 189M 5s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 1100K .......... .......... .......... .......... .......... 1% 79.3M 5s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 1150K .......... .......... .......... .......... .......... 1% 254M 5s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 1200K .......... .......... .......... .......... .......... 1% 97.2M 5s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 1250K .......... .......... .......... .......... .......... 1% 11.8M 5s 2024-09-12T00:55:12.752 INFO:teuthology.orchestra.run.smithi083.stderr: 1300K .......... .......... .......... .......... .......... 1% 43.8M 5s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1350K .......... .......... .......... .......... .......... 1% 380M 5s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1400K .......... .......... .......... .......... .......... 1% 52.8M 5s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1450K .......... .......... .......... .......... .......... 1% 328M 4s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1500K .......... .......... .......... .......... .......... 1% 79.2M 4s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1550K .......... .......... .......... .......... .......... 1% 102M 4s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1600K .......... .......... .......... .......... .......... 1% 414M 4s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1650K .......... .......... .......... .......... .......... 1% 392M 4s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1700K .......... .......... .......... .......... .......... 1% 156M 4s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1750K .......... .......... .......... .......... .......... 1% 149M 4s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1800K .......... .......... .......... .......... .......... 1% 152M 4s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1850K .......... .......... .......... .......... .......... 2% 215M 4s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1900K .......... .......... .......... .......... .......... 2% 187M 3s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 1950K .......... .......... .......... .......... .......... 2% 99.3M 3s 2024-09-12T00:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr: 2000K .......... .......... .......... .......... .......... 2% 179M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2050K .......... .......... .......... .......... .......... 2% 302M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2100K .......... .......... .......... .......... .......... 2% 304M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2150K .......... .......... .......... .......... .......... 2% 141M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2200K .......... .......... .......... .......... .......... 2% 84.8M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2250K .......... .......... .......... .......... .......... 2% 321M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2300K .......... .......... .......... .......... .......... 2% 302M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2350K .......... .......... .......... .......... .......... 2% 401M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2400K .......... .......... .......... .......... .......... 2% 208M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2450K .......... .......... .......... .......... .......... 2% 272M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2500K .......... .......... .......... .......... .......... 2% 12.8M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2550K .......... .......... .......... .......... .......... 2% 221M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2600K .......... .......... .......... .......... .......... 2% 427M 3s 2024-09-12T00:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr: 2650K .......... .......... .......... .......... .......... 2% 103M 3s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 2700K .......... .......... .......... .......... .......... 2% 295M 3s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 2750K .......... .......... .......... .......... .......... 3% 73.9M 3s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 2800K .......... .......... .......... .......... .......... 3% 278M 3s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 2850K .......... .......... .......... .......... .......... 3% 319M 3s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 2900K .......... .......... .......... .......... .......... 3% 309M 3s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 2950K .......... .......... .......... .......... .......... 3% 368M 3s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 3000K .......... .......... .......... .......... .......... 3% 401M 2s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 3050K .......... .......... .......... .......... .......... 3% 120M 2s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 3100K .......... .......... .......... .......... .......... 3% 409M 2s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 3150K .......... .......... .......... .......... .......... 3% 82.9M 2s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 3200K .......... .......... .......... .......... .......... 3% 287M 2s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 3250K .......... .......... .......... .......... .......... 3% 384M 2s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 3300K .......... .......... .......... .......... .......... 3% 384M 2s 2024-09-12T00:55:12.755 INFO:teuthology.orchestra.run.smithi083.stderr: 3350K .......... .......... .......... .......... .......... 3% 404M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3400K .......... .......... .......... .......... .......... 3% 301M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3450K .......... .......... .......... .......... .......... 3% 405M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3500K .......... .......... .......... .......... .......... 3% 287M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3550K .......... .......... .......... .......... .......... 3% 396M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3600K .......... .......... .......... .......... .......... 3% 295M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3650K .......... .......... .......... .......... .......... 3% 326M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3700K .......... .......... .......... .......... .......... 4% 306M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3750K .......... .......... .......... .......... .......... 4% 379M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3800K .......... .......... .......... .......... .......... 4% 296M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3850K .......... .......... .......... .......... .......... 4% 297M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3900K .......... .......... .......... .......... .......... 4% 421M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 3950K .......... .......... .......... .......... .......... 4% 358M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 4000K .......... .......... .......... .......... .......... 4% 320M 2s 2024-09-12T00:55:12.756 INFO:teuthology.orchestra.run.smithi083.stderr: 4050K .......... .......... .......... .......... .......... 4% 323M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4100K .......... .......... .......... .......... .......... 4% 387M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4150K .......... .......... .......... .......... .......... 4% 377M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4200K .......... .......... .......... .......... .......... 4% 283M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4250K .......... .......... .......... .......... .......... 4% 432M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4300K .......... .......... .......... .......... .......... 4% 406M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4350K .......... .......... .......... .......... .......... 4% 275M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4400K .......... .......... .......... .......... .......... 4% 359M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4450K .......... .......... .......... .......... .......... 4% 427M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4500K .......... .......... .......... .......... .......... 4% 443M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4550K .......... .......... .......... .......... .......... 4% 435M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4600K .......... .......... .......... .......... .......... 5% 110M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4650K .......... .......... .......... .......... .......... 5% 374M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4700K .......... .......... .......... .......... .......... 5% 386M 2s 2024-09-12T00:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr: 4750K .......... .......... .......... .......... .......... 5% 399M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 4800K .......... .......... .......... .......... .......... 5% 318M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 4850K .......... .......... .......... .......... .......... 5% 344M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 4900K .......... .......... .......... .......... .......... 5% 335M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 4950K .......... .......... .......... .......... .......... 5% 359M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 5000K .......... .......... .......... .......... .......... 5% 418M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 5050K .......... .......... .......... .......... .......... 5% 78.3M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 5100K .......... .......... .......... .......... .......... 5% 20.8M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 5150K .......... .......... .......... .......... .......... 5% 351M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 5200K .......... .......... .......... .......... .......... 5% 407M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 5250K .......... .......... .......... .......... .......... 5% 415M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 5300K .......... .......... .......... .......... .......... 5% 310M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 5350K .......... .......... .......... .......... .......... 5% 396M 2s 2024-09-12T00:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr: 5400K .......... .......... .......... .......... .......... 5% 399M 2s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5450K .......... .......... .......... .......... .......... 5% 380M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5500K .......... .......... .......... .......... .......... 5% 337M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5550K .......... .......... .......... .......... .......... 6% 135M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5600K .......... .......... .......... .......... .......... 6% 368M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5650K .......... .......... .......... .......... .......... 6% 339M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5700K .......... .......... .......... .......... .......... 6% 316M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5750K .......... .......... .......... .......... .......... 6% 383M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5800K .......... .......... .......... .......... .......... 6% 428M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5850K .......... .......... .......... .......... .......... 6% 367M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5900K .......... .......... .......... .......... .......... 6% 228M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 5950K .......... .......... .......... .......... .......... 6% 347M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 6000K .......... .......... .......... .......... .......... 6% 437M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 6050K .......... .......... .......... .......... .......... 6% 455M 1s 2024-09-12T00:55:12.759 INFO:teuthology.orchestra.run.smithi083.stderr: 6100K .......... .......... .......... .......... .......... 6% 404M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6150K .......... .......... .......... .......... .......... 6% 209M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6200K .......... .......... .......... .......... .......... 6% 269M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6250K .......... .......... .......... .......... .......... 6% 418M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6300K .......... .......... .......... .......... .......... 6% 297M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6350K .......... .......... .......... .......... .......... 6% 412M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6400K .......... .......... .......... .......... .......... 6% 174M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6450K .......... .......... .......... .......... .......... 6% 388M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6500K .......... .......... .......... .......... .......... 7% 371M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6550K .......... .......... .......... .......... .......... 7% 208M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6600K .......... .......... .......... .......... .......... 7% 388M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6650K .......... .......... .......... .......... .......... 7% 318M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6700K .......... .......... .......... .......... .......... 7% 330M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6750K .......... .......... .......... .......... .......... 7% 335M 1s 2024-09-12T00:55:12.760 INFO:teuthology.orchestra.run.smithi083.stderr: 6800K .......... .......... .......... .......... .......... 7% 305M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 6850K .......... .......... .......... .......... .......... 7% 414M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 6900K .......... .......... .......... .......... .......... 7% 329M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 6950K .......... .......... .......... .......... .......... 7% 393M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7000K .......... .......... .......... .......... .......... 7% 400M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7050K .......... .......... .......... .......... .......... 7% 412M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7100K .......... .......... .......... .......... .......... 7% 331M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7150K .......... .......... .......... .......... .......... 7% 402M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7200K .......... .......... .......... .......... .......... 7% 438M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7250K .......... .......... .......... .......... .......... 7% 420M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7300K .......... .......... .......... .......... .......... 7% 381M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7350K .......... .......... .......... .......... .......... 7% 334M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7400K .......... .......... .......... .......... .......... 8% 368M 1s 2024-09-12T00:55:12.761 INFO:teuthology.orchestra.run.smithi083.stderr: 7450K .......... .......... .......... .......... .......... 8% 383M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7500K .......... .......... .......... .......... .......... 8% 328M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7550K .......... .......... .......... .......... .......... 8% 376M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7600K .......... .......... .......... .......... .......... 8% 441M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7650K .......... .......... .......... .......... .......... 8% 110M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7700K .......... .......... .......... .......... .......... 8% 359M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7750K .......... .......... .......... .......... .......... 8% 157M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7800K .......... .......... .......... .......... .......... 8% 281M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7850K .......... .......... .......... .......... .......... 8% 141M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7900K .......... .......... .......... .......... .......... 8% 339M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 7950K .......... .......... .......... .......... .......... 8% 419M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 8000K .......... .......... .......... .......... .......... 8% 456M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 8050K .......... .......... .......... .......... .......... 8% 221M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 8100K .......... .......... .......... .......... .......... 8% 375M 1s 2024-09-12T00:55:12.762 INFO:teuthology.orchestra.run.smithi083.stderr: 8150K .......... .......... .......... .......... .......... 8% 399M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8200K .......... .......... .......... .......... .......... 8% 24.0M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8250K .......... .......... .......... .......... .......... 8% 111M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8300K .......... .......... .......... .......... .......... 8% 323M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8350K .......... .......... .......... .......... .......... 9% 360M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8400K .......... .......... .......... .......... .......... 9% 453M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8450K .......... .......... .......... .......... .......... 9% 148M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8500K .......... .......... .......... .......... .......... 9% 354M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8550K .......... .......... .......... .......... .......... 9% 210M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8600K .......... .......... .......... .......... .......... 9% 239M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8650K .......... .......... .......... .......... .......... 9% 420M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8700K .......... .......... .......... .......... .......... 9% 361M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8750K .......... .......... .......... .......... .......... 9% 365M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8800K .......... .......... .......... .......... .......... 9% 422M 1s 2024-09-12T00:55:12.763 INFO:teuthology.orchestra.run.smithi083.stderr: 8850K .......... .......... .......... .......... .......... 9% 438M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 8900K .......... .......... .......... .......... .......... 9% 291M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 8950K .......... .......... .......... .......... .......... 9% 282M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9000K .......... .......... .......... .......... .......... 9% 442M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9050K .......... .......... .......... .......... .......... 9% 446M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9100K .......... .......... .......... .......... .......... 9% 82.6M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9150K .......... .......... .......... .......... .......... 9% 379M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9200K .......... .......... .......... .......... .......... 9% 338M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9250K .......... .......... .......... .......... .......... 10% 414M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9300K .......... .......... .......... .......... .......... 10% 385M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9350K .......... .......... .......... .......... .......... 10% 427M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9400K .......... .......... .......... .......... .......... 10% 388M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9450K .......... .......... .......... .......... .......... 10% 384M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9500K .......... .......... .......... .......... .......... 10% 331M 1s 2024-09-12T00:55:12.764 INFO:teuthology.orchestra.run.smithi083.stderr: 9550K .......... .......... .......... .......... .......... 10% 376M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 9600K .......... .......... .......... .......... .......... 10% 365M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 9650K .......... .......... .......... .......... .......... 10% 361M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 9700K .......... .......... .......... .......... .......... 10% 295M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 9750K .......... .......... .......... .......... .......... 10% 217M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 9800K .......... .......... .......... .......... .......... 10% 263M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 9850K .......... .......... .......... .......... .......... 10% 375M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 9900K .......... .......... .......... .......... .......... 10% 195M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 9950K .......... .......... .......... .......... .......... 10% 395M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 10000K .......... .......... .......... .......... .......... 10% 451M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 10050K .......... .......... .......... .......... .......... 10% 448M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 10100K .......... .......... .......... .......... .......... 10% 83.3M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 10150K .......... .......... .......... .......... .......... 10% 346M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 10200K .......... .......... .......... .......... .......... 11% 348M 1s 2024-09-12T00:55:12.765 INFO:teuthology.orchestra.run.smithi083.stderr: 10250K .......... .......... .......... .......... .......... 11% 421M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10300K .......... .......... .......... .......... .......... 11% 428M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10350K .......... .......... .......... .......... .......... 11% 440M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10400K .......... .......... .......... .......... .......... 11% 335M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10450K .......... .......... .......... .......... .......... 11% 452M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10500K .......... .......... .......... .......... .......... 11% 428M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10550K .......... .......... .......... .......... .......... 11% 354M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10600K .......... .......... .......... .......... .......... 11% 401M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10650K .......... .......... .......... .......... .......... 11% 433M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10700K .......... .......... .......... .......... .......... 11% 413M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10750K .......... .......... .......... .......... .......... 11% 357M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10800K .......... .......... .......... .......... .......... 11% 463M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10850K .......... .......... .......... .......... .......... 11% 452M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10900K .......... .......... .......... .......... .......... 11% 431M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 10950K .......... .......... .......... .......... .......... 11% 382M 1s 2024-09-12T00:55:12.766 INFO:teuthology.orchestra.run.smithi083.stderr: 11000K .......... .......... .......... .......... .......... 11% 211M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11050K .......... .......... .......... .......... .......... 11% 222M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11100K .......... .......... .......... .......... .......... 12% 412M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11150K .......... .......... .......... .......... .......... 12% 235M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11200K .......... .......... .......... .......... .......... 12% 255M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11250K .......... .......... .......... .......... .......... 12% 55.2M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11300K .......... .......... .......... .......... .......... 12% 43.3M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11350K .......... .......... .......... .......... .......... 12% 152M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11400K .......... .......... .......... .......... .......... 12% 398M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11450K .......... .......... .......... .......... .......... 12% 104M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11500K .......... .......... .......... .......... .......... 12% 420M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11550K .......... .......... .......... .......... .......... 12% 260M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11600K .......... .......... .......... .......... .......... 12% 300M 1s 2024-09-12T00:55:12.767 INFO:teuthology.orchestra.run.smithi083.stderr: 11650K .......... .......... .......... .......... .......... 12% 394M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 11700K .......... .......... .......... .......... .......... 12% 211M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 11750K .......... .......... .......... .......... .......... 12% 241M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 11800K .......... .......... .......... .......... .......... 12% 400M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 11850K .......... .......... .......... .......... .......... 12% 343M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 11900K .......... .......... .......... .......... .......... 12% 249M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 11950K .......... .......... .......... .......... .......... 12% 147M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 12000K .......... .......... .......... .......... .......... 12% 434M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 12050K .......... .......... .......... .......... .......... 13% 148M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 12100K .......... .......... .......... .......... .......... 13% 376M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 12150K .......... .......... .......... .......... .......... 13% 361M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 12200K .......... .......... .......... .......... .......... 13% 364M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 12250K .......... .......... .......... .......... .......... 13% 460M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 12300K .......... .......... .......... .......... .......... 13% 199M 1s 2024-09-12T00:55:12.768 INFO:teuthology.orchestra.run.smithi083.stderr: 12350K .......... .......... .......... .......... .......... 13% 269M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12400K .......... .......... .......... .......... .......... 13% 384M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12450K .......... .......... .......... .......... .......... 13% 381M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12500K .......... .......... .......... .......... .......... 13% 386M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12550K .......... .......... .......... .......... .......... 13% 373M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12600K .......... .......... .......... .......... .......... 13% 416M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12650K .......... .......... .......... .......... .......... 13% 391M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12700K .......... .......... .......... .......... .......... 13% 431M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12750K .......... .......... .......... .......... .......... 13% 78.4M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12800K .......... .......... .......... .......... .......... 13% 348M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12850K .......... .......... .......... .......... .......... 13% 432M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12900K .......... .......... .......... .......... .......... 13% 314M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 12950K .......... .......... .......... .......... .......... 13% 264M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 13000K .......... .......... .......... .......... .......... 14% 420M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 13050K .......... .......... .......... .......... .......... 14% 389M 1s 2024-09-12T00:55:12.769 INFO:teuthology.orchestra.run.smithi083.stderr: 13100K .......... .......... .......... .......... .......... 14% 344M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13150K .......... .......... .......... .......... .......... 14% 317M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13200K .......... .......... .......... .......... .......... 14% 114M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13250K .......... .......... .......... .......... .......... 14% 228M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13300K .......... .......... .......... .......... .......... 14% 377M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13350K .......... .......... .......... .......... .......... 14% 346M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13400K .......... .......... .......... .......... .......... 14% 385M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13450K .......... .......... .......... .......... .......... 14% 409M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13500K .......... .......... .......... .......... .......... 14% 388M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13550K .......... .......... .......... .......... .......... 14% 289M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13600K .......... .......... .......... .......... .......... 14% 389M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13650K .......... .......... .......... .......... .......... 14% 342M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13700K .......... .......... .......... .......... .......... 14% 351M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13750K .......... .......... .......... .......... .......... 14% 370M 1s 2024-09-12T00:55:12.770 INFO:teuthology.orchestra.run.smithi083.stderr: 13800K .......... .......... .......... .......... .......... 14% 383M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 13850K .......... .......... .......... .......... .......... 14% 386M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 13900K .......... .......... .......... .......... .......... 15% 335M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 13950K .......... .......... .......... .......... .......... 15% 315M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14000K .......... .......... .......... .......... .......... 15% 338M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14050K .......... .......... .......... .......... .......... 15% 370M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14100K .......... .......... .......... .......... .......... 15% 386M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14150K .......... .......... .......... .......... .......... 15% 385M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14200K .......... .......... .......... .......... .......... 15% 457M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14250K .......... .......... .......... .......... .......... 15% 453M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14300K .......... .......... .......... .......... .......... 15% 141M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14350K .......... .......... .......... .......... .......... 15% 55.0M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14400K .......... .......... .......... .......... .......... 15% 83.2M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14450K .......... .......... .......... .......... .......... 15% 103M 1s 2024-09-12T00:55:12.771 INFO:teuthology.orchestra.run.smithi083.stderr: 14500K .......... .......... .......... .......... .......... 15% 304M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 14550K .......... .......... .......... .......... .......... 15% 129M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 14600K .......... .......... .......... .......... .......... 15% 371M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 14650K .......... .......... .......... .......... .......... 15% 308M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 14700K .......... .......... .......... .......... .......... 15% 381M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 14750K .......... .......... .......... .......... .......... 15% 221M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 14800K .......... .......... .......... .......... .......... 15% 383M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 14850K .......... .......... .......... .......... .......... 16% 203M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 14900K .......... .......... .......... .......... .......... 16% 374M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 14950K .......... .......... .......... .......... .......... 16% 227M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 15000K .......... .......... .......... .......... .......... 16% 365M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 15050K .......... .......... .......... .......... .......... 16% 125M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 15100K .......... .......... .......... .......... .......... 16% 242M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 15150K .......... .......... .......... .......... .......... 16% 254M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 15200K .......... .......... .......... .......... .......... 16% 393M 1s 2024-09-12T00:55:12.772 INFO:teuthology.orchestra.run.smithi083.stderr: 15250K .......... .......... .......... .......... .......... 16% 289M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15300K .......... .......... .......... .......... .......... 16% 331M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15350K .......... .......... .......... .......... .......... 16% 331M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15400K .......... .......... .......... .......... .......... 16% 355M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15450K .......... .......... .......... .......... .......... 16% 240M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15500K .......... .......... .......... .......... .......... 16% 285M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15550K .......... .......... .......... .......... .......... 16% 249M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15600K .......... .......... .......... .......... .......... 16% 78.4M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15650K .......... .......... .......... .......... .......... 16% 249M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15700K .......... .......... .......... .......... .......... 16% 450M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15750K .......... .......... .......... .......... .......... 17% 306M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15800K .......... .......... .......... .......... .......... 17% 197M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15850K .......... .......... .......... .......... .......... 17% 423M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15900K .......... .......... .......... .......... .......... 17% 401M 1s 2024-09-12T00:55:12.773 INFO:teuthology.orchestra.run.smithi083.stderr: 15950K .......... .......... .......... .......... .......... 17% 332M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16000K .......... .......... .......... .......... .......... 17% 455M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16050K .......... .......... .......... .......... .......... 17% 439M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16100K .......... .......... .......... .......... .......... 17% 449M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16150K .......... .......... .......... .......... .......... 17% 374M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16200K .......... .......... .......... .......... .......... 17% 351M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16250K .......... .......... .......... .......... .......... 17% 434M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16300K .......... .......... .......... .......... .......... 17% 384M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16350K .......... .......... .......... .......... .......... 17% 185M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16400K .......... .......... .......... .......... .......... 17% 100M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16450K .......... .......... .......... .......... .......... 17% 445M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16500K .......... .......... .......... .......... .......... 17% 450M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16550K .......... .......... .......... .......... .......... 17% 364M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16600K .......... .......... .......... .......... .......... 17% 397M 1s 2024-09-12T00:55:12.774 INFO:teuthology.orchestra.run.smithi083.stderr: 16650K .......... .......... .......... .......... .......... 17% 400M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 16700K .......... .......... .......... .......... .......... 18% 425M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 16750K .......... .......... .......... .......... .......... 18% 241M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 16800K .......... .......... .......... .......... .......... 18% 426M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 16850K .......... .......... .......... .......... .......... 18% 352M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 16900K .......... .......... .......... .......... .......... 18% 345M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 16950K .......... .......... .......... .......... .......... 18% 375M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 17000K .......... .......... .......... .......... .......... 18% 391M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 17050K .......... .......... .......... .......... .......... 18% 449M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 17100K .......... .......... .......... .......... .......... 18% 458M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 17150K .......... .......... .......... .......... .......... 18% 230M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 17200K .......... .......... .......... .......... .......... 18% 200M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 17250K .......... .......... .......... .......... .......... 18% 418M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 17300K .......... .......... .......... .......... .......... 18% 436M 1s 2024-09-12T00:55:12.775 INFO:teuthology.orchestra.run.smithi083.stderr: 17350K .......... .......... .......... .......... .......... 18% 408M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17400K .......... .......... .......... .......... .......... 18% 70.0M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17450K .......... .......... .......... .......... .......... 18% 96.7M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17500K .......... .......... .......... .......... .......... 18% 462M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17550K .......... .......... .......... .......... .......... 18% 86.3M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17600K .......... .......... .......... .......... .......... 18% 106M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17650K .......... .......... .......... .......... .......... 19% 333M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17700K .......... .......... .......... .......... .......... 19% 438M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17750K .......... .......... .......... .......... .......... 19% 409M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17800K .......... .......... .......... .......... .......... 19% 419M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17850K .......... .......... .......... .......... .......... 19% 416M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17900K .......... .......... .......... .......... .......... 19% 159M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 17950K .......... .......... .......... .......... .......... 19% 233M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 18000K .......... .......... .......... .......... .......... 19% 453M 1s 2024-09-12T00:55:12.776 INFO:teuthology.orchestra.run.smithi083.stderr: 18050K .......... .......... .......... .......... .......... 19% 251M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18100K .......... .......... .......... .......... .......... 19% 290M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18150K .......... .......... .......... .......... .......... 19% 98.0M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18200K .......... .......... .......... .......... .......... 19% 445M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18250K .......... .......... .......... .......... .......... 19% 175M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18300K .......... .......... .......... .......... .......... 19% 451M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18350K .......... .......... .......... .......... .......... 19% 316M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18400K .......... .......... .......... .......... .......... 19% 427M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18450K .......... .......... .......... .......... .......... 19% 437M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18500K .......... .......... .......... .......... .......... 19% 446M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18550K .......... .......... .......... .......... .......... 20% 388M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18600K .......... .......... .......... .......... .......... 20% 451M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18650K .......... .......... .......... .......... .......... 20% 328M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18700K .......... .......... .......... .......... .......... 20% 78.5M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18750K .......... .......... .......... .......... .......... 20% 99.7M 1s 2024-09-12T00:55:12.777 INFO:teuthology.orchestra.run.smithi083.stderr: 18800K .......... .......... .......... .......... .......... 20% 458M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 18850K .......... .......... .......... .......... .......... 20% 451M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 18900K .......... .......... .......... .......... .......... 20% 450M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 18950K .......... .......... .......... .......... .......... 20% 148M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19000K .......... .......... .......... .......... .......... 20% 413M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19050K .......... .......... .......... .......... .......... 20% 418M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19100K .......... .......... .......... .......... .......... 20% 447M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19150K .......... .......... .......... .......... .......... 20% 375M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19200K .......... .......... .......... .......... .......... 20% 441M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19250K .......... .......... .......... .......... .......... 20% 439M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19300K .......... .......... .......... .......... .......... 20% 442M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19350K .......... .......... .......... .......... .......... 20% 385M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19400K .......... .......... .......... .......... .......... 20% 455M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19450K .......... .......... .......... .......... .......... 20% 95.4M 1s 2024-09-12T00:55:12.778 INFO:teuthology.orchestra.run.smithi083.stderr: 19500K .......... .......... .......... .......... .......... 21% 132M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 19550K .......... .......... .......... .......... .......... 21% 243M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 19600K .......... .......... .......... .......... .......... 21% 415M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 19650K .......... .......... .......... .......... .......... 21% 302M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 19700K .......... .......... .......... .......... .......... 21% 412M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 19750K .......... .......... .......... .......... .......... 21% 393M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 19800K .......... .......... .......... .......... .......... 21% 420M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 19850K .......... .......... .......... .......... .......... 21% 453M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 19900K .......... .......... .......... .......... .......... 21% 423M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 19950K .......... .......... .......... .......... .......... 21% 325M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 20000K .......... .......... .......... .......... .......... 21% 407M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 20050K .......... .......... .......... .......... .......... 21% 396M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 20100K .......... .......... .......... .......... .......... 21% 439M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 20150K .......... .......... .......... .......... .......... 21% 399M 1s 2024-09-12T00:55:12.779 INFO:teuthology.orchestra.run.smithi083.stderr: 20200K .......... .......... .......... .......... .......... 21% 371M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20250K .......... .......... .......... .......... .......... 21% 238M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20300K .......... .......... .......... .......... .......... 21% 302M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20350K .......... .......... .......... .......... .......... 21% 281M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20400K .......... .......... .......... .......... .......... 22% 120M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20450K .......... .......... .......... .......... .......... 22% 406M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20500K .......... .......... .......... .......... .......... 22% 172M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20550K .......... .......... .......... .......... .......... 22% 275M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20600K .......... .......... .......... .......... .......... 22% 85.2M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20650K .......... .......... .......... .......... .......... 22% 100M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20700K .......... .......... .......... .......... .......... 22% 275M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20750K .......... .......... .......... .......... .......... 22% 203M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20800K .......... .......... .......... .......... .......... 22% 369M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20850K .......... .......... .......... .......... .......... 22% 450M 1s 2024-09-12T00:55:12.780 INFO:teuthology.orchestra.run.smithi083.stderr: 20900K .......... .......... .......... .......... .......... 22% 389M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 20950K .......... .......... .......... .......... .......... 22% 247M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21000K .......... .......... .......... .......... .......... 22% 347M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21050K .......... .......... .......... .......... .......... 22% 197M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21100K .......... .......... .......... .......... .......... 22% 234M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21150K .......... .......... .......... .......... .......... 22% 458M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21200K .......... .......... .......... .......... .......... 22% 109M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21250K .......... .......... .......... .......... .......... 22% 286M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21300K .......... .......... .......... .......... .......... 22% 155M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21350K .......... .......... .......... .......... .......... 23% 146M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21400K .......... .......... .......... .......... .......... 23% 429M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21450K .......... .......... .......... .......... .......... 23% 460M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21500K .......... .......... .......... .......... .......... 23% 370M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21550K .......... .......... .......... .......... .......... 23% 451M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21600K .......... .......... .......... .......... .......... 23% 156M 1s 2024-09-12T00:55:12.781 INFO:teuthology.orchestra.run.smithi083.stderr: 21650K .......... .......... .......... .......... .......... 23% 447M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 21700K .......... .......... .......... .......... .......... 23% 382M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 21750K .......... .......... .......... .......... .......... 23% 308M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 21800K .......... .......... .......... .......... .......... 23% 111M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 21850K .......... .......... .......... .......... .......... 23% 192M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 21900K .......... .......... .......... .......... .......... 23% 354M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 21950K .......... .......... .......... .......... .......... 23% 450M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 22000K .......... .......... .......... .......... .......... 23% 150M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 22050K .......... .......... .......... .......... .......... 23% 320M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 22100K .......... .......... .......... .......... .......... 23% 166M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 22150K .......... .......... .......... .......... .......... 23% 388M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 22200K .......... .......... .......... .......... .......... 23% 455M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 22250K .......... .......... .......... .......... .......... 24% 286M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 22300K .......... .......... .......... .......... .......... 24% 209M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 22350K .......... .......... .......... .......... .......... 24% 325M 1s 2024-09-12T00:55:12.782 INFO:teuthology.orchestra.run.smithi083.stderr: 22400K .......... .......... .......... .......... .......... 24% 441M 1s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22450K .......... .......... .......... .......... .......... 24% 448M 1s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22500K .......... .......... .......... .......... .......... 24% 261M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22550K .......... .......... .......... .......... .......... 24% 258M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22600K .......... .......... .......... .......... .......... 24% 217M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22650K .......... .......... .......... .......... .......... 24% 197M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22700K .......... .......... .......... .......... .......... 24% 373M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22750K .......... .......... .......... .......... .......... 24% 416M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22800K .......... .......... .......... .......... .......... 24% 166M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22850K .......... .......... .......... .......... .......... 24% 437M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22900K .......... .......... .......... .......... .......... 24% 402M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 22950K .......... .......... .......... .......... .......... 24% 433M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 23000K .......... .......... .......... .......... .......... 24% 459M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 23050K .......... .......... .......... .......... .......... 24% 455M 0s 2024-09-12T00:55:12.783 INFO:teuthology.orchestra.run.smithi083.stderr: 23100K .......... .......... .......... .......... .......... 24% 330M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23150K .......... .......... .......... .......... .......... 24% 460M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23200K .......... .......... .......... .......... .......... 25% 425M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23250K .......... .......... .......... .......... .......... 25% 440M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23300K .......... .......... .......... .......... .......... 25% 210M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23350K .......... .......... .......... .......... .......... 25% 444M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23400K .......... .......... .......... .......... .......... 25% 440M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23450K .......... .......... .......... .......... .......... 25% 123M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23500K .......... .......... .......... .......... .......... 25% 118M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23550K .......... .......... .......... .......... .......... 25% 437M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23600K .......... .......... .......... .......... .......... 25% 378M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23650K .......... .......... .......... .......... .......... 25% 111M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23700K .......... .......... .......... .......... .......... 25% 77.4M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23750K .......... .......... .......... .......... .......... 25% 329M 0s 2024-09-12T00:55:12.784 INFO:teuthology.orchestra.run.smithi083.stderr: 23800K .......... .......... .......... .......... .......... 25% 270M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 23850K .......... .......... .......... .......... .......... 25% 276M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 23900K .......... .......... .......... .......... .......... 25% 367M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 23950K .......... .......... .......... .......... .......... 25% 447M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24000K .......... .......... .......... .......... .......... 25% 442M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24050K .......... .......... .......... .......... .......... 25% 460M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24100K .......... .......... .......... .......... .......... 25% 145M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24150K .......... .......... .......... .......... .......... 26% 440M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24200K .......... .......... .......... .......... .......... 26% 104M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24250K .......... .......... .......... .......... .......... 26% 448M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24300K .......... .......... .......... .......... .......... 26% 349M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24350K .......... .......... .......... .......... .......... 26% 220M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24400K .......... .......... .......... .......... .......... 26% 133M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24450K .......... .......... .......... .......... .......... 26% 168M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24500K .......... .......... .......... .......... .......... 26% 385M 0s 2024-09-12T00:55:12.785 INFO:teuthology.orchestra.run.smithi083.stderr: 24550K .......... .......... .......... .......... .......... 26% 452M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 24600K .......... .......... .......... .......... .......... 26% 405M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 24650K .......... .......... .......... .......... .......... 26% 210M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 24700K .......... .......... .......... .......... .......... 26% 263M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 24750K .......... .......... .......... .......... .......... 26% 448M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 24800K .......... .......... .......... .......... .......... 26% 444M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 24850K .......... .......... .......... .......... .......... 26% 178M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 24900K .......... .......... .......... .......... .......... 26% 133M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 24950K .......... .......... .......... .......... .......... 26% 432M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 25000K .......... .......... .......... .......... .......... 26% 300M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 25050K .......... .......... .......... .......... .......... 27% 121M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 25100K .......... .......... .......... .......... .......... 27% 202M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 25150K .......... .......... .......... .......... .......... 27% 281M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 25200K .......... .......... .......... .......... .......... 27% 270M 0s 2024-09-12T00:55:12.786 INFO:teuthology.orchestra.run.smithi083.stderr: 25250K .......... .......... .......... .......... .......... 27% 256M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25300K .......... .......... .......... .......... .......... 27% 299M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25350K .......... .......... .......... .......... .......... 27% 262M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25400K .......... .......... .......... .......... .......... 27% 442M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25450K .......... .......... .......... .......... .......... 27% 436M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25500K .......... .......... .......... .......... .......... 27% 368M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25550K .......... .......... .......... .......... .......... 27% 361M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25600K .......... .......... .......... .......... .......... 27% 418M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25650K .......... .......... .......... .......... .......... 27% 135M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25700K .......... .......... .......... .......... .......... 27% 219M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25750K .......... .......... .......... .......... .......... 27% 231M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25800K .......... .......... .......... .......... .......... 27% 382M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25850K .......... .......... .......... .......... .......... 27% 391M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25900K .......... .......... .......... .......... .......... 27% 353M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 25950K .......... .......... .......... .......... .......... 27% 443M 0s 2024-09-12T00:55:12.787 INFO:teuthology.orchestra.run.smithi083.stderr: 26000K .......... .......... .......... .......... .......... 28% 455M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26050K .......... .......... .......... .......... .......... 28% 428M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26100K .......... .......... .......... .......... .......... 28% 394M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26150K .......... .......... .......... .......... .......... 28% 452M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26200K .......... .......... .......... .......... .......... 28% 164M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26250K .......... .......... .......... .......... .......... 28% 440M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26300K .......... .......... .......... .......... .......... 28% 255M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26350K .......... .......... .......... .......... .......... 28% 418M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26400K .......... .......... .......... .......... .......... 28% 452M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26450K .......... .......... .......... .......... .......... 28% 450M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26500K .......... .......... .......... .......... .......... 28% 314M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26550K .......... .......... .......... .......... .......... 28% 119M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26600K .......... .......... .......... .......... .......... 28% 433M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26650K .......... .......... .......... .......... .......... 28% 444M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26700K .......... .......... .......... .......... .......... 28% 102M 0s 2024-09-12T00:55:12.788 INFO:teuthology.orchestra.run.smithi083.stderr: 26750K .......... .......... .......... .......... .......... 28% 63.8M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 26800K .......... .......... .......... .......... .......... 28% 281M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 26850K .......... .......... .......... .......... .......... 28% 411M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 26900K .......... .......... .......... .......... .......... 29% 395M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 26950K .......... .......... .......... .......... .......... 29% 441M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27000K .......... .......... .......... .......... .......... 29% 289M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27050K .......... .......... .......... .......... .......... 29% 441M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27100K .......... .......... .......... .......... .......... 29% 84.3M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27150K .......... .......... .......... .......... .......... 29% 402M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27200K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27250K .......... .......... .......... .......... .......... 29% 315M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27300K .......... .......... .......... .......... .......... 29% 410M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27350K .......... .......... .......... .......... .......... 29% 281M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27400K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-12T00:55:12.789 INFO:teuthology.orchestra.run.smithi083.stderr: 27450K .......... .......... .......... .......... .......... 29% 394M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27500K .......... .......... .......... .......... .......... 29% 74.3M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27550K .......... .......... .......... .......... .......... 29% 436M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27600K .......... .......... .......... .......... .......... 29% 424M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27650K .......... .......... .......... .......... .......... 29% 307M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27700K .......... .......... .......... .......... .......... 29% 389M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27750K .......... .......... .......... .......... .......... 29% 451M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27800K .......... .......... .......... .......... .......... 29% 376M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27850K .......... .......... .......... .......... .......... 30% 310M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27900K .......... .......... .......... .......... .......... 30% 367M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 27950K .......... .......... .......... .......... .......... 30% 79.1M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 28000K .......... .......... .......... .......... .......... 30% 439M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 28050K .......... .......... .......... .......... .......... 30% 452M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 28100K .......... .......... .......... .......... .......... 30% 183M 0s 2024-09-12T00:55:12.790 INFO:teuthology.orchestra.run.smithi083.stderr: 28150K .......... .......... .......... .......... .......... 30% 90.4M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28200K .......... .......... .......... .......... .......... 30% 323M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28250K .......... .......... .......... .......... .......... 30% 431M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28300K .......... .......... .......... .......... .......... 30% 371M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28350K .......... .......... .......... .......... .......... 30% 423M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28400K .......... .......... .......... .......... .......... 30% 446M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28450K .......... .......... .......... .......... .......... 30% 217M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28500K .......... .......... .......... .......... .......... 30% 389M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28550K .......... .......... .......... .......... .......... 30% 392M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28600K .......... .......... .......... .......... .......... 30% 429M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28650K .......... .......... .......... .......... .......... 30% 189M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28700K .......... .......... .......... .......... .......... 30% 349M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28750K .......... .......... .......... .......... .......... 31% 441M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28800K .......... .......... .......... .......... .......... 31% 433M 0s 2024-09-12T00:55:12.791 INFO:teuthology.orchestra.run.smithi083.stderr: 28850K .......... .......... .......... .......... .......... 31% 217M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 28900K .......... .......... .......... .......... .......... 31% 144M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 28950K .......... .......... .......... .......... .......... 31% 344M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29000K .......... .......... .......... .......... .......... 31% 427M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29050K .......... .......... .......... .......... .......... 31% 429M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29100K .......... .......... .......... .......... .......... 31% 365M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29150K .......... .......... .......... .......... .......... 31% 430M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29200K .......... .......... .......... .......... .......... 31% 443M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29250K .......... .......... .......... .......... .......... 31% 451M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29300K .......... .......... .......... .......... .......... 31% 115M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29350K .......... .......... .......... .......... .......... 31% 423M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29400K .......... .......... .......... .......... .......... 31% 432M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29450K .......... .......... .......... .......... .......... 31% 438M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29500K .......... .......... .......... .......... .......... 31% 374M 0s 2024-09-12T00:55:12.792 INFO:teuthology.orchestra.run.smithi083.stderr: 29550K .......... .......... .......... .......... .......... 31% 448M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 29600K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 29650K .......... .......... .......... .......... .......... 31% 429M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 29700K .......... .......... .......... .......... .......... 32% 296M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 29750K .......... .......... .......... .......... .......... 32% 176M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 29800K .......... .......... .......... .......... .......... 32% 57.2M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 29850K .......... .......... .......... .......... .......... 32% 315M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 29900K .......... .......... .......... .......... .......... 32% 238M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 29950K .......... .......... .......... .......... .......... 32% 362M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 30000K .......... .......... .......... .......... .......... 32% 308M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 30050K .......... .......... .......... .......... .......... 32% 442M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 30100K .......... .......... .......... .......... .......... 32% 395M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 30150K .......... .......... .......... .......... .......... 32% 149M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 30200K .......... .......... .......... .......... .......... 32% 145M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 30250K .......... .......... .......... .......... .......... 32% 405M 0s 2024-09-12T00:55:12.793 INFO:teuthology.orchestra.run.smithi083.stderr: 30300K .......... .......... .......... .......... .......... 32% 129M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30350K .......... .......... .......... .......... .......... 32% 330M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30400K .......... .......... .......... .......... .......... 32% 425M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30450K .......... .......... .......... .......... .......... 32% 438M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30500K .......... .......... .......... .......... .......... 32% 396M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30550K .......... .......... .......... .......... .......... 32% 422M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30600K .......... .......... .......... .......... .......... 32% 80.9M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30650K .......... .......... .......... .......... .......... 33% 298M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30700K .......... .......... .......... .......... .......... 33% 414M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30750K .......... .......... .......... .......... .......... 33% 249M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30800K .......... .......... .......... .......... .......... 33% 383M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30850K .......... .......... .......... .......... .......... 33% 401M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30900K .......... .......... .......... .......... .......... 33% 440M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 30950K .......... .......... .......... .......... .......... 33% 69.4M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 31000K .......... .......... .......... .......... .......... 33% 435M 0s 2024-09-12T00:55:12.794 INFO:teuthology.orchestra.run.smithi083.stderr: 31050K .......... .......... .......... .......... .......... 33% 447M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31100K .......... .......... .......... .......... .......... 33% 291M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31150K .......... .......... .......... .......... .......... 33% 382M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31200K .......... .......... .......... .......... .......... 33% 87.9M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31250K .......... .......... .......... .......... .......... 33% 274M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31300K .......... .......... .......... .......... .......... 33% 208M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31350K .......... .......... .......... .......... .......... 33% 405M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31400K .......... .......... .......... .......... .......... 33% 465M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31450K .......... .......... .......... .......... .......... 33% 237M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31500K .......... .......... .......... .......... .......... 33% 441M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31550K .......... .......... .......... .......... .......... 34% 377M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31600K .......... .......... .......... .......... .......... 34% 462M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31650K .......... .......... .......... .......... .......... 34% 442M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31700K .......... .......... .......... .......... .......... 34% 466M 0s 2024-09-12T00:55:12.795 INFO:teuthology.orchestra.run.smithi083.stderr: 31750K .......... .......... .......... .......... .......... 34% 226M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 31800K .......... .......... .......... .......... .......... 34% 449M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 31850K .......... .......... .......... .......... .......... 34% 457M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 31900K .......... .......... .......... .......... .......... 34% 217M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 31950K .......... .......... .......... .......... .......... 34% 186M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32000K .......... .......... .......... .......... .......... 34% 349M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32050K .......... .......... .......... .......... .......... 34% 206M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32100K .......... .......... .......... .......... .......... 34% 392M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32150K .......... .......... .......... .......... .......... 34% 292M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32200K .......... .......... .......... .......... .......... 34% 422M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32250K .......... .......... .......... .......... .......... 34% 419M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32300K .......... .......... .......... .......... .......... 34% 352M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32350K .......... .......... .......... .......... .......... 34% 209M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32400K .......... .......... .......... .......... .......... 34% 147M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32450K .......... .......... .......... .......... .......... 34% 357M 0s 2024-09-12T00:55:12.796 INFO:teuthology.orchestra.run.smithi083.stderr: 32500K .......... .......... .......... .......... .......... 35% 414M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 32550K .......... .......... .......... .......... .......... 35% 368M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 32600K .......... .......... .......... .......... .......... 35% 316M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 32650K .......... .......... .......... .......... .......... 35% 410M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 32700K .......... .......... .......... .......... .......... 35% 432M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 32750K .......... .......... .......... .......... .......... 35% 341M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 32800K .......... .......... .......... .......... .......... 35% 447M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 32850K .......... .......... .......... .......... .......... 35% 58.9M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 32900K .......... .......... .......... .......... .......... 35% 406M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 32950K .......... .......... .......... .......... .......... 35% 270M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 33000K .......... .......... .......... .......... .......... 35% 85.3M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 33050K .......... .......... .......... .......... .......... 35% 380M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 33100K .......... .......... .......... .......... .......... 35% 382M 0s 2024-09-12T00:55:12.797 INFO:teuthology.orchestra.run.smithi083.stderr: 33150K .......... .......... .......... .......... .......... 35% 364M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33200K .......... .......... .......... .......... .......... 35% 440M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33250K .......... .......... .......... .......... .......... 35% 107M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33300K .......... .......... .......... .......... .......... 35% 396M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33350K .......... .......... .......... .......... .......... 35% 399M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33400K .......... .......... .......... .......... .......... 36% 433M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33450K .......... .......... .......... .......... .......... 36% 280M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33500K .......... .......... .......... .......... .......... 36% 248M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33550K .......... .......... .......... .......... .......... 36% 96.1M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33600K .......... .......... .......... .......... .......... 36% 432M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33650K .......... .......... .......... .......... .......... 36% 453M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33700K .......... .......... .......... .......... .......... 36% 112M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33750K .......... .......... .......... .......... .......... 36% 363M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33800K .......... .......... .......... .......... .......... 36% 370M 0s 2024-09-12T00:55:12.798 INFO:teuthology.orchestra.run.smithi083.stderr: 33850K .......... .......... .......... .......... .......... 36% 421M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 33900K .......... .......... .......... .......... .......... 36% 442M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 33950K .......... .......... .......... .......... .......... 36% 333M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34000K .......... .......... .......... .......... .......... 36% 102M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34050K .......... .......... .......... .......... .......... 36% 166M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34100K .......... .......... .......... .......... .......... 36% 453M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34150K .......... .......... .......... .......... .......... 36% 381M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34200K .......... .......... .......... .......... .......... 36% 86.3M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34250K .......... .......... .......... .......... .......... 36% 397M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34300K .......... .......... .......... .......... .......... 36% 390M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34350K .......... .......... .......... .......... .......... 37% 359M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34400K .......... .......... .......... .......... .......... 37% 456M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34450K .......... .......... .......... .......... .......... 37% 294M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34500K .......... .......... .......... .......... .......... 37% 418M 0s 2024-09-12T00:55:12.799 INFO:teuthology.orchestra.run.smithi083.stderr: 34550K .......... .......... .......... .......... .......... 37% 324M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 34600K .......... .......... .......... .......... .......... 37% 160M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 34650K .......... .......... .......... .......... .......... 37% 417M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 34700K .......... .......... .......... .......... .......... 37% 257M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 34750K .......... .......... .......... .......... .......... 37% 368M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 34800K .......... .......... .......... .......... .......... 37% 443M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 34850K .......... .......... .......... .......... .......... 37% 422M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 34900K .......... .......... .......... .......... .......... 37% 399M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 34950K .......... .......... .......... .......... .......... 37% 378M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 35000K .......... .......... .......... .......... .......... 37% 440M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 35050K .......... .......... .......... .......... .......... 37% 429M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 35100K .......... .......... .......... .......... .......... 37% 198M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 35150K .......... .......... .......... .......... .......... 37% 202M 0s 2024-09-12T00:55:12.800 INFO:teuthology.orchestra.run.smithi083.stderr: 35200K .......... .......... .......... .......... .......... 37% 150M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35250K .......... .......... .......... .......... .......... 37% 314M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35300K .......... .......... .......... .......... .......... 38% 433M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35350K .......... .......... .......... .......... .......... 38% 368M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35400K .......... .......... .......... .......... .......... 38% 399M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35450K .......... .......... .......... .......... .......... 38% 437M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35500K .......... .......... .......... .......... .......... 38% 309M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35550K .......... .......... .......... .......... .......... 38% 90.4M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35600K .......... .......... .......... .......... .......... 38% 426M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35650K .......... .......... .......... .......... .......... 38% 419M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35700K .......... .......... .......... .......... .......... 38% 428M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35750K .......... .......... .......... .......... .......... 38% 388M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35800K .......... .......... .......... .......... .......... 38% 425M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35850K .......... .......... .......... .......... .......... 38% 99.6M 0s 2024-09-12T00:55:12.801 INFO:teuthology.orchestra.run.smithi083.stderr: 35900K .......... .......... .......... .......... .......... 38% 413M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 35950K .......... .......... .......... .......... .......... 38% 403M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36000K .......... .......... .......... .......... .......... 38% 380M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36050K .......... .......... .......... .......... .......... 38% 73.8M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36100K .......... .......... .......... .......... .......... 38% 443M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36150K .......... .......... .......... .......... .......... 38% 387M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36200K .......... .......... .......... .......... .......... 39% 441M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36250K .......... .......... .......... .......... .......... 39% 118M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36300K .......... .......... .......... .......... .......... 39% 426M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36350K .......... .......... .......... .......... .......... 39% 227M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36400K .......... .......... .......... .......... .......... 39% 306M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36450K .......... .......... .......... .......... .......... 39% 401M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36500K .......... .......... .......... .......... .......... 39% 364M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36550K .......... .......... .......... .......... .......... 39% 388M 0s 2024-09-12T00:55:12.802 INFO:teuthology.orchestra.run.smithi083.stderr: 36600K .......... .......... .......... .......... .......... 39% 75.8M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 36650K .......... .......... .......... .......... .......... 39% 300M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 36700K .......... .......... .......... .......... .......... 39% 386M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 36750K .......... .......... .......... .......... .......... 39% 199M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 36800K .......... .......... .......... .......... .......... 39% 247M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 36850K .......... .......... .......... .......... .......... 39% 386M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 36900K .......... .......... .......... .......... .......... 39% 423M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 36950K .......... .......... .......... .......... .......... 39% 356M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 37000K .......... .......... .......... .......... .......... 39% 79.7M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 37050K .......... .......... .......... .......... .......... 39% 402M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 37100K .......... .......... .......... .......... .......... 39% 435M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 37150K .......... .......... .......... .......... .......... 40% 342M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 37200K .......... .......... .......... .......... .......... 40% 315M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 37250K .......... .......... .......... .......... .......... 40% 149M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 37300K .......... .......... .......... .......... .......... 40% 169M 0s 2024-09-12T00:55:12.803 INFO:teuthology.orchestra.run.smithi083.stderr: 37350K .......... .......... .......... .......... .......... 40% 341M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37400K .......... .......... .......... .......... .......... 40% 397M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37450K .......... .......... .......... .......... .......... 40% 174M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37500K .......... .......... .......... .......... .......... 40% 374M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37550K .......... .......... .......... .......... .......... 40% 364M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37600K .......... .......... .......... .......... .......... 40% 438M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37650K .......... .......... .......... .......... .......... 40% 238M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37700K .......... .......... .......... .......... .......... 40% 261M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37750K .......... .......... .......... .......... .......... 40% 322M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37800K .......... .......... .......... .......... .......... 40% 390M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37850K .......... .......... .......... .......... .......... 40% 277M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37900K .......... .......... .......... .......... .......... 40% 442M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 37950K .......... .......... .......... .......... .......... 40% 354M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 38000K .......... .......... .......... .......... .......... 40% 404M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 38050K .......... .......... .......... .......... .......... 41% 353M 0s 2024-09-12T00:55:12.804 INFO:teuthology.orchestra.run.smithi083.stderr: 38100K .......... .......... .......... .......... .......... 41% 431M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38150K .......... .......... .......... .......... .......... 41% 389M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38200K .......... .......... .......... .......... .......... 41% 421M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38250K .......... .......... .......... .......... .......... 41% 445M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38300K .......... .......... .......... .......... .......... 41% 83.8M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38350K .......... .......... .......... .......... .......... 41% 355M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38400K .......... .......... .......... .......... .......... 41% 416M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38450K .......... .......... .......... .......... .......... 41% 437M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38500K .......... .......... .......... .......... .......... 41% 441M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38550K .......... .......... .......... .......... .......... 41% 400M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38600K .......... .......... .......... .......... .......... 41% 108M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38650K .......... .......... .......... .......... .......... 41% 158M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38700K .......... .......... .......... .......... .......... 41% 285M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38750K .......... .......... .......... .......... .......... 41% 350M 0s 2024-09-12T00:55:12.805 INFO:teuthology.orchestra.run.smithi083.stderr: 38800K .......... .......... .......... .......... .......... 41% 431M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 38850K .......... .......... .......... .......... .......... 41% 126M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 38900K .......... .......... .......... .......... .......... 41% 438M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 38950K .......... .......... .......... .......... .......... 41% 377M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39000K .......... .......... .......... .......... .......... 42% 435M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39050K .......... .......... .......... .......... .......... 42% 444M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39100K .......... .......... .......... .......... .......... 42% 135M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39150K .......... .......... .......... .......... .......... 42% 153M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39200K .......... .......... .......... .......... .......... 42% 385M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39250K .......... .......... .......... .......... .......... 42% 417M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39300K .......... .......... .......... .......... .......... 42% 107M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39350K .......... .......... .......... .......... .......... 42% 391M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39400K .......... .......... .......... .......... .......... 42% 128M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39450K .......... .......... .......... .......... .......... 42% 327M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39500K .......... .......... .......... .......... .......... 42% 431M 0s 2024-09-12T00:55:12.806 INFO:teuthology.orchestra.run.smithi083.stderr: 39550K .......... .......... .......... .......... .......... 42% 341M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 39600K .......... .......... .......... .......... .......... 42% 420M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 39650K .......... .......... .......... .......... .......... 42% 116M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 39700K .......... .......... .......... .......... .......... 42% 371M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 39750K .......... .......... .......... .......... .......... 42% 251M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 39800K .......... .......... .......... .......... .......... 42% 230M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 39850K .......... .......... .......... .......... .......... 42% 423M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 39900K .......... .......... .......... .......... .......... 43% 465M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 39950K .......... .......... .......... .......... .......... 43% 125M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 40000K .......... .......... .......... .......... .......... 43% 398M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 40050K .......... .......... .......... .......... .......... 43% 110M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 40100K .......... .......... .......... .......... .......... 43% 423M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 40150K .......... .......... .......... .......... .......... 43% 385M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 40200K .......... .......... .......... .......... .......... 43% 163M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 40250K .......... .......... .......... .......... .......... 43% 442M 0s 2024-09-12T00:55:12.807 INFO:teuthology.orchestra.run.smithi083.stderr: 40300K .......... .......... .......... .......... .......... 43% 261M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40350K .......... .......... .......... .......... .......... 43% 181M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40400K .......... .......... .......... .......... .......... 43% 409M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40450K .......... .......... .......... .......... .......... 43% 435M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40500K .......... .......... .......... .......... .......... 43% 255M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40550K .......... .......... .......... .......... .......... 43% 152M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40600K .......... .......... .......... .......... .......... 43% 441M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40650K .......... .......... .......... .......... .......... 43% 249M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40700K .......... .......... .......... .......... .......... 43% 430M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40750K .......... .......... .......... .......... .......... 43% 51.2M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40800K .......... .......... .......... .......... .......... 43% 441M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40850K .......... .......... .......... .......... .......... 44% 427M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40900K .......... .......... .......... .......... .......... 44% 405M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 40950K .......... .......... .......... .......... .......... 44% 437M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 41000K .......... .......... .......... .......... .......... 44% 409M 0s 2024-09-12T00:55:12.808 INFO:teuthology.orchestra.run.smithi083.stderr: 41050K .......... .......... .......... .......... .......... 44% 376M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41100K .......... .......... .......... .......... .......... 44% 343M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41150K .......... .......... .......... .......... .......... 44% 403M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41200K .......... .......... .......... .......... .......... 44% 412M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41250K .......... .......... .......... .......... .......... 44% 372M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41300K .......... .......... .......... .......... .......... 44% 369M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41350K .......... .......... .......... .......... .......... 44% 388M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41400K .......... .......... .......... .......... .......... 44% 421M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41450K .......... .......... .......... .......... .......... 44% 353M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41500K .......... .......... .......... .......... .......... 44% 304M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41550K .......... .......... .......... .......... .......... 44% 349M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41600K .......... .......... .......... .......... .......... 44% 336M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41650K .......... .......... .......... .......... .......... 44% 413M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41700K .......... .......... .......... .......... .......... 44% 241M 0s 2024-09-12T00:55:12.809 INFO:teuthology.orchestra.run.smithi083.stderr: 41750K .......... .......... .......... .......... .......... 44% 155M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 41800K .......... .......... .......... .......... .......... 45% 421M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 41850K .......... .......... .......... .......... .......... 45% 319M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 41900K .......... .......... .......... .......... .......... 45% 195M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 41950K .......... .......... .......... .......... .......... 45% 146M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42000K .......... .......... .......... .......... .......... 45% 427M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42050K .......... .......... .......... .......... .......... 45% 438M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42100K .......... .......... .......... .......... .......... 45% 139M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42150K .......... .......... .......... .......... .......... 45% 399M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42200K .......... .......... .......... .......... .......... 45% 130M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42250K .......... .......... .......... .......... .......... 45% 426M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42300K .......... .......... .......... .......... .......... 45% 195M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42350K .......... .......... .......... .......... .......... 45% 417M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42400K .......... .......... .......... .......... .......... 45% 97.7M 0s 2024-09-12T00:55:12.810 INFO:teuthology.orchestra.run.smithi083.stderr: 42450K .......... .......... .......... .......... .......... 45% 315M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42500K .......... .......... .......... .......... .......... 45% 381M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42550K .......... .......... .......... .......... .......... 45% 194M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42600K .......... .......... .......... .......... .......... 45% 417M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42650K .......... .......... .......... .......... .......... 45% 151M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42700K .......... .......... .......... .......... .......... 46% 366M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42750K .......... .......... .......... .......... .......... 46% 423M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42800K .......... .......... .......... .......... .......... 46% 428M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42850K .......... .......... .......... .......... .......... 46% 413M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42900K .......... .......... .......... .......... .......... 46% 122M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 42950K .......... .......... .......... .......... .......... 46% 321M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 43000K .......... .......... .......... .......... .......... 46% 390M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 43050K .......... .......... .......... .......... .......... 46% 396M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 43100K .......... .......... .......... .......... .......... 46% 110M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 43150K .......... .......... .......... .......... .......... 46% 170M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 43200K .......... .......... .......... .......... .......... 46% 296M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 43250K .......... .......... .......... .......... .......... 46% 423M 0s 2024-09-12T00:55:12.811 INFO:teuthology.orchestra.run.smithi083.stderr: 43300K .......... .......... .......... .......... .......... 46% 181M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43350K .......... .......... .......... .......... .......... 46% 409M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43400K .......... .......... .......... .......... .......... 46% 444M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43450K .......... .......... .......... .......... .......... 46% 265M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43500K .......... .......... .......... .......... .......... 46% 255M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43550K .......... .......... .......... .......... .......... 46% 231M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43600K .......... .......... .......... .......... .......... 46% 417M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43650K .......... .......... .......... .......... .......... 47% 443M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43700K .......... .......... .......... .......... .......... 47% 198M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43750K .......... .......... .......... .......... .......... 47% 301M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43800K .......... .......... .......... .......... .......... 47% 52.2M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43850K .......... .......... .......... .......... .......... 47% 433M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43900K .......... .......... .......... .......... .......... 47% 144M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 43950K .......... .......... .......... .......... .......... 47% 410M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 44000K .......... .......... .......... .......... .......... 47% 126M 0s 2024-09-12T00:55:12.812 INFO:teuthology.orchestra.run.smithi083.stderr: 44050K .......... .......... .......... .......... .......... 47% 445M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44100K .......... .......... .......... .......... .......... 47% 391M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44150K .......... .......... .......... .......... .......... 47% 405M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44200K .......... .......... .......... .......... .......... 47% 392M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44250K .......... .......... .......... .......... .......... 47% 419M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44300K .......... .......... .......... .......... .......... 47% 356M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44350K .......... .......... .......... .......... .......... 47% 410M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44400K .......... .......... .......... .......... .......... 47% 363M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44450K .......... .......... .......... .......... .......... 47% 411M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44500K .......... .......... .......... .......... .......... 47% 392M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44550K .......... .......... .......... .......... .......... 48% 424M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44600K .......... .......... .......... .......... .......... 48% 424M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44650K .......... .......... .......... .......... .......... 48% 340M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44700K .......... .......... .......... .......... .......... 48% 292M 0s 2024-09-12T00:55:12.813 INFO:teuthology.orchestra.run.smithi083.stderr: 44750K .......... .......... .......... .......... .......... 48% 383M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 44800K .......... .......... .......... .......... .......... 48% 259M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 44850K .......... .......... .......... .......... .......... 48% 247M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 44900K .......... .......... .......... .......... .......... 48% 355M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 44950K .......... .......... .......... .......... .......... 48% 424M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45000K .......... .......... .......... .......... .......... 48% 276M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45050K .......... .......... .......... .......... .......... 48% 280M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45100K .......... .......... .......... .......... .......... 48% 150M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45150K .......... .......... .......... .......... .......... 48% 394M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45200K .......... .......... .......... .......... .......... 48% 415M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45250K .......... .......... .......... .......... .......... 48% 175M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45300K .......... .......... .......... .......... .......... 48% 369M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45350K .......... .......... .......... .......... .......... 48% 246M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45400K .......... .......... .......... .......... .......... 48% 182M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45450K .......... .......... .......... .......... .......... 48% 78.2M 0s 2024-09-12T00:55:12.814 INFO:teuthology.orchestra.run.smithi083.stderr: 45500K .......... .......... .......... .......... .......... 49% 327M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 45550K .......... .......... .......... .......... .......... 49% 444M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 45600K .......... .......... .......... .......... .......... 49% 156M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 45650K .......... .......... .......... .......... .......... 49% 439M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 45700K .......... .......... .......... .......... .......... 49% 378M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 45750K .......... .......... .......... .......... .......... 49% 411M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 45800K .......... .......... .......... .......... .......... 49% 154M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 45850K .......... .......... .......... .......... .......... 49% 420M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 45900K .......... .......... .......... .......... .......... 49% 348M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 45950K .......... .......... .......... .......... .......... 49% 396M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 46000K .......... .......... .......... .......... .......... 49% 435M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 46050K .......... .......... .......... .......... .......... 49% 133M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 46100K .......... .......... .......... .......... .......... 49% 395M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 46150K .......... .......... .......... .......... .......... 49% 161M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 46200K .......... .......... .......... .......... .......... 49% 382M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 46250K .......... .......... .......... .......... .......... 49% 188M 0s 2024-09-12T00:55:12.815 INFO:teuthology.orchestra.run.smithi083.stderr: 46300K .......... .......... .......... .......... .......... 49% 205M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46350K .......... .......... .......... .......... .......... 49% 269M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46400K .......... .......... .......... .......... .......... 49% 438M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46450K .......... .......... .......... .......... .......... 50% 418M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46500K .......... .......... .......... .......... .......... 50% 151M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46550K .......... .......... .......... .......... .......... 50% 404M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46600K .......... .......... .......... .......... .......... 50% 434M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46650K .......... .......... .......... .......... .......... 50% 420M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46700K .......... .......... .......... .......... .......... 50% 351M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46750K .......... .......... .......... .......... .......... 50% 161M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46800K .......... .......... .......... .......... .......... 50% 261M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46850K .......... .......... .......... .......... .......... 50% 65.7M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46900K .......... .......... .......... .......... .......... 50% 81.3M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 46950K .......... .......... .......... .......... .......... 50% 420M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 47000K .......... .......... .......... .......... .......... 50% 395M 0s 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi083.stderr: 47050K .......... .......... .......... .......... .......... 50% 309M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47100K .......... .......... .......... .......... .......... 50% 198M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47150K .......... .......... .......... .......... .......... 50% 408M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47200K .......... .......... .......... .......... .......... 50% 159M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47250K .......... .......... .......... .......... .......... 50% 260M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47300K .......... .......... .......... .......... .......... 50% 132M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47350K .......... .......... .......... .......... .......... 51% 342M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47400K .......... .......... .......... .......... .......... 51% 290M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47450K .......... .......... .......... .......... .......... 51% 438M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47500K .......... .......... .......... .......... .......... 51% 436M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47550K .......... .......... .......... .......... .......... 51% 411M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47600K .......... .......... .......... .......... .......... 51% 358M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47650K .......... .......... .......... .......... .......... 51% 421M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47700K .......... .......... .......... .......... .......... 51% 417M 0s 2024-09-12T00:55:12.817 INFO:teuthology.orchestra.run.smithi083.stderr: 47750K .......... .......... .......... .......... .......... 51% 411M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 47800K .......... .......... .......... .......... .......... 51% 276M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 47850K .......... .......... .......... .......... .......... 51% 442M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 47900K .......... .......... .......... .......... .......... 51% 188M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 47950K .......... .......... .......... .......... .......... 51% 305M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48000K .......... .......... .......... .......... .......... 51% 426M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48050K .......... .......... .......... .......... .......... 51% 413M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48100K .......... .......... .......... .......... .......... 51% 389M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48150K .......... .......... .......... .......... .......... 51% 425M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48200K .......... .......... .......... .......... .......... 51% 124M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48250K .......... .......... .......... .......... .......... 51% 249M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48300K .......... .......... .......... .......... .......... 52% 149M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48350K .......... .......... .......... .......... .......... 52% 421M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48400K .......... .......... .......... .......... .......... 52% 312M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48450K .......... .......... .......... .......... .......... 52% 128M 0s 2024-09-12T00:55:12.818 INFO:teuthology.orchestra.run.smithi083.stderr: 48500K .......... .......... .......... .......... .......... 52% 106M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 48550K .......... .......... .......... .......... .......... 52% 374M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 48600K .......... .......... .......... .......... .......... 52% 361M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 48650K .......... .......... .......... .......... .......... 52% 285M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 48700K .......... .......... .......... .......... .......... 52% 183M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 48750K .......... .......... .......... .......... .......... 52% 329M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 48800K .......... .......... .......... .......... .......... 52% 303M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 48850K .......... .......... .......... .......... .......... 52% 192M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 48900K .......... .......... .......... .......... .......... 52% 433M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 48950K .......... .......... .......... .......... .......... 52% 387M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 49000K .......... .......... .......... .......... .......... 52% 375M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 49050K .......... .......... .......... .......... .......... 52% 434M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 49100K .......... .......... .......... .......... .......... 52% 288M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 49150K .......... .......... .......... .......... .......... 52% 167M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 49200K .......... .......... .......... .......... .......... 53% 295M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 49250K .......... .......... .......... .......... .......... 53% 169M 0s 2024-09-12T00:55:12.819 INFO:teuthology.orchestra.run.smithi083.stderr: 49300K .......... .......... .......... .......... .......... 53% 310M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49350K .......... .......... .......... .......... .......... 53% 438M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49400K .......... .......... .......... .......... .......... 53% 386M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49450K .......... .......... .......... .......... .......... 53% 208M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49500K .......... .......... .......... .......... .......... 53% 424M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49550K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49600K .......... .......... .......... .......... .......... 53% 213M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49650K .......... .......... .......... .......... .......... 53% 220M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49700K .......... .......... .......... .......... .......... 53% 427M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49750K .......... .......... .......... .......... .......... 53% 434M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49800K .......... .......... .......... .......... .......... 53% 340M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49850K .......... .......... .......... .......... .......... 53% 321M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49900K .......... .......... .......... .......... .......... 53% 109M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 49950K .......... .......... .......... .......... .......... 53% 428M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 50000K .......... .......... .......... .......... .......... 53% 63.9M 0s 2024-09-12T00:55:12.820 INFO:teuthology.orchestra.run.smithi083.stderr: 50050K .......... .......... .......... .......... .......... 53% 433M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50100K .......... .......... .......... .......... .......... 53% 445M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50150K .......... .......... .......... .......... .......... 54% 309M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50200K .......... .......... .......... .......... .......... 54% 339M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50250K .......... .......... .......... .......... .......... 54% 172M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50300K .......... .......... .......... .......... .......... 54% 122M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50350K .......... .......... .......... .......... .......... 54% 160M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50400K .......... .......... .......... .......... .......... 54% 103M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50450K .......... .......... .......... .......... .......... 54% 417M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50500K .......... .......... .......... .......... .......... 54% 235M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50550K .......... .......... .......... .......... .......... 54% 442M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50600K .......... .......... .......... .......... .......... 54% 426M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50650K .......... .......... .......... .......... .......... 54% 429M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50700K .......... .......... .......... .......... .......... 54% 369M 0s 2024-09-12T00:55:12.821 INFO:teuthology.orchestra.run.smithi083.stderr: 50750K .......... .......... .......... .......... .......... 54% 222M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 50800K .......... .......... .......... .......... .......... 54% 328M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 50850K .......... .......... .......... .......... .......... 54% 396M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 50900K .......... .......... .......... .......... .......... 54% 410M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 50950K .......... .......... .......... .......... .......... 54% 412M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51000K .......... .......... .......... .......... .......... 54% 305M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51050K .......... .......... .......... .......... .......... 55% 423M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51100K .......... .......... .......... .......... .......... 55% 351M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51150K .......... .......... .......... .......... .......... 55% 468M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51200K .......... .......... .......... .......... .......... 55% 107M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51250K .......... .......... .......... .......... .......... 55% 76.7M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51300K .......... .......... .......... .......... .......... 55% 366M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51350K .......... .......... .......... .......... .......... 55% 433M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51400K .......... .......... .......... .......... .......... 55% 424M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51450K .......... .......... .......... .......... .......... 55% 430M 0s 2024-09-12T00:55:12.822 INFO:teuthology.orchestra.run.smithi083.stderr: 51500K .......... .......... .......... .......... .......... 55% 361M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 51550K .......... .......... .......... .......... .......... 55% 164M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 51600K .......... .......... .......... .......... .......... 55% 390M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 51650K .......... .......... .......... .......... .......... 55% 141M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 51700K .......... .......... .......... .......... .......... 55% 266M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 51750K .......... .......... .......... .......... .......... 55% 308M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 51800K .......... .......... .......... .......... .......... 55% 391M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 51850K .......... .......... .......... .......... .......... 55% 340M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 51900K .......... .......... .......... .......... .......... 55% 148M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 51950K .......... .......... .......... .......... .......... 55% 378M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 52000K .......... .......... .......... .......... .......... 56% 437M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 52050K .......... .......... .......... .......... .......... 56% 444M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 52100K .......... .......... .......... .......... .......... 56% 315M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 52150K .......... .......... .......... .......... .......... 56% 411M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 52200K .......... .......... .......... .......... .......... 56% 313M 0s 2024-09-12T00:55:12.823 INFO:teuthology.orchestra.run.smithi083.stderr: 52250K .......... .......... .......... .......... .......... 56% 445M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52300K .......... .......... .......... .......... .......... 56% 228M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52350K .......... .......... .......... .......... .......... 56% 189M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52400K .......... .......... .......... .......... .......... 56% 54.7M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52450K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52500K .......... .......... .......... .......... .......... 56% 392M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52550K .......... .......... .......... .......... .......... 56% 300M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52600K .......... .......... .......... .......... .......... 56% 439M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52650K .......... .......... .......... .......... .......... 56% 413M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52700K .......... .......... .......... .......... .......... 56% 195M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52750K .......... .......... .......... .......... .......... 56% 416M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52800K .......... .......... .......... .......... .......... 56% 54.4M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52850K .......... .......... .......... .......... .......... 56% 39.6M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52900K .......... .......... .......... .......... .......... 56% 363M 0s 2024-09-12T00:55:12.824 INFO:teuthology.orchestra.run.smithi083.stderr: 52950K .......... .......... .......... .......... .......... 57% 347M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53000K .......... .......... .......... .......... .......... 57% 394M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53050K .......... .......... .......... .......... .......... 57% 140M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53100K .......... .......... .......... .......... .......... 57% 233M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53150K .......... .......... .......... .......... .......... 57% 399M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53200K .......... .......... .......... .......... .......... 57% 428M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53250K .......... .......... .......... .......... .......... 57% 427M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53300K .......... .......... .......... .......... .......... 57% 377M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53350K .......... .......... .......... .......... .......... 57% 417M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53400K .......... .......... .......... .......... .......... 57% 172M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53450K .......... .......... .......... .......... .......... 57% 207M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53500K .......... .......... .......... .......... .......... 57% 157M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53550K .......... .......... .......... .......... .......... 57% 244M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53600K .......... .......... .......... .......... .......... 57% 430M 0s 2024-09-12T00:55:12.825 INFO:teuthology.orchestra.run.smithi083.stderr: 53650K .......... .......... .......... .......... .......... 57% 355M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 53700K .......... .......... .......... .......... .......... 57% 371M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 53750K .......... .......... .......... .......... .......... 57% 401M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 53800K .......... .......... .......... .......... .......... 57% 398M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 53850K .......... .......... .......... .......... .......... 58% 411M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 53900K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 53950K .......... .......... .......... .......... .......... 58% 434M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 54000K .......... .......... .......... .......... .......... 58% 423M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 54050K .......... .......... .......... .......... .......... 58% 430M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 54100K .......... .......... .......... .......... .......... 58% 362M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 54150K .......... .......... .......... .......... .......... 58% 414M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 54200K .......... .......... .......... .......... .......... 58% 432M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 54250K .......... .......... .......... .......... .......... 58% 427M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 54300K .......... .......... .......... .......... .......... 58% 362M 0s 2024-09-12T00:55:12.826 INFO:teuthology.orchestra.run.smithi083.stderr: 54350K .......... .......... .......... .......... .......... 58% 344M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54400K .......... .......... .......... .......... .......... 58% 410M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54450K .......... .......... .......... .......... .......... 58% 390M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54500K .......... .......... .......... .......... .......... 58% 355M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54550K .......... .......... .......... .......... .......... 58% 438M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54600K .......... .......... .......... .......... .......... 58% 275M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54650K .......... .......... .......... .......... .......... 58% 409M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54700K .......... .......... .......... .......... .......... 58% 297M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54750K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54800K .......... .......... .......... .......... .......... 59% 165M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54850K .......... .......... .......... .......... .......... 59% 413M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54900K .......... .......... .......... .......... .......... 59% 271M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 54950K .......... .......... .......... .......... .......... 59% 421M 0s 2024-09-12T00:55:12.827 INFO:teuthology.orchestra.run.smithi083.stderr: 55000K .......... .......... .......... .......... .......... 59% 429M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55050K .......... .......... .......... .......... .......... 59% 424M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55100K .......... .......... .......... .......... .......... 59% 225M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55150K .......... .......... .......... .......... .......... 59% 425M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55200K .......... .......... .......... .......... .......... 59% 409M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55250K .......... .......... .......... .......... .......... 59% 424M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55300K .......... .......... .......... .......... .......... 59% 401M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55350K .......... .......... .......... .......... .......... 59% 435M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55400K .......... .......... .......... .......... .......... 59% 170M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55450K .......... .......... .......... .......... .......... 59% 46.4M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55500K .......... .......... .......... .......... .......... 59% 145M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55550K .......... .......... .......... .......... .......... 59% 374M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55600K .......... .......... .......... .......... .......... 59% 218M 0s 2024-09-12T00:55:12.828 INFO:teuthology.orchestra.run.smithi083.stderr: 55650K .......... .......... .......... .......... .......... 59% 53.0M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 55700K .......... .......... .......... .......... .......... 60% 31.8M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 55750K .......... .......... .......... .......... .......... 60% 242M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 55800K .......... .......... .......... .......... .......... 60% 401M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 55850K .......... .......... .......... .......... .......... 60% 385M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 55900K .......... .......... .......... .......... .......... 60% 62.7M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 55950K .......... .......... .......... .......... .......... 60% 69.9M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 56000K .......... .......... .......... .......... .......... 60% 371M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 56050K .......... .......... .......... .......... .......... 60% 384M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 56100K .......... .......... .......... .......... .......... 60% 338M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 56150K .......... .......... .......... .......... .......... 60% 406M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 56200K .......... .......... .......... .......... .......... 60% 409M 0s 2024-09-12T00:55:12.829 INFO:teuthology.orchestra.run.smithi083.stderr: 56250K .......... .......... .......... .......... .......... 60% 391M 0s 2024-09-12T00:55:12.832 INFO:teuthology.orchestra.run.smithi083.stderr: 56300K .......... .......... .......... .......... .......... 60% 330M 0s 2024-09-12T00:55:12.832 INFO:teuthology.orchestra.run.smithi083.stderr: 56350K .......... .......... .......... .......... .......... 60% 402M 0s 2024-09-12T00:55:12.832 INFO:teuthology.orchestra.run.smithi083.stderr: 56400K .......... .......... .......... .......... .......... 60% 376M 0s 2024-09-12T00:55:12.832 INFO:teuthology.orchestra.run.smithi083.stderr: 56450K .......... .......... .......... .......... .......... 60% 414M 0s 2024-09-12T00:55:12.832 INFO:teuthology.orchestra.run.smithi083.stderr: 56500K .......... .......... .......... .......... .......... 60% 363M 0s 2024-09-12T00:55:12.832 INFO:teuthology.orchestra.run.smithi083.stderr: 56550K .......... .......... .......... .......... .......... 60% 405M 0s 2024-09-12T00:55:12.832 INFO:teuthology.orchestra.run.smithi083.stderr: 56600K .......... .......... .......... .......... .......... 60% 128M 0s 2024-09-12T00:55:12.832 INFO:teuthology.orchestra.run.smithi083.stderr: 56650K .......... .......... .......... .......... .......... 61% 280M 0s 2024-09-12T00:55:12.832 INFO:teuthology.orchestra.run.smithi083.stderr: 56700K .......... .......... .......... .......... .......... 61% 282M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 56750K .......... .......... .......... .......... .......... 61% 442M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 56800K .......... .......... .......... .......... .......... 61% 396M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 56850K .......... .......... .......... .......... .......... 61% 419M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 56900K .......... .......... .......... .......... .......... 61% 374M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 56950K .......... .......... .......... .......... .......... 61% 417M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 57000K .......... .......... .......... .......... .......... 61% 421M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 57050K .......... .......... .......... .......... .......... 61% 396M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 57100K .......... .......... .......... .......... .......... 61% 315M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 57150K .......... .......... .......... .......... .......... 61% 410M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 57200K .......... .......... .......... .......... .......... 61% 424M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 57250K .......... .......... .......... .......... .......... 61% 378M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 57300K .......... .......... .......... .......... .......... 61% 328M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 57350K .......... .......... .......... .......... .......... 61% 290M 0s 2024-09-12T00:55:12.833 INFO:teuthology.orchestra.run.smithi083.stderr: 57400K .......... .......... .......... .......... .......... 61% 402M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57450K .......... .......... .......... .......... .......... 61% 410M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57500K .......... .......... .......... .......... .......... 61% 388M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57550K .......... .......... .......... .......... .......... 62% 431M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57600K .......... .......... .......... .......... .......... 62% 363M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57650K .......... .......... .......... .......... .......... 62% 436M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57700K .......... .......... .......... .......... .......... 62% 425M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57750K .......... .......... .......... .......... .......... 62% 416M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57800K .......... .......... .......... .......... .......... 62% 435M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57850K .......... .......... .......... .......... .......... 62% 398M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57900K .......... .......... .......... .......... .......... 62% 345M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 57950K .......... .......... .......... .......... .......... 62% 428M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 58000K .......... .......... .......... .......... .......... 62% 409M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 58050K .......... .......... .......... .......... .......... 62% 397M 0s 2024-09-12T00:55:12.834 INFO:teuthology.orchestra.run.smithi083.stderr: 58100K .......... .......... .......... .......... .......... 62% 363M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58150K .......... .......... .......... .......... .......... 62% 412M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58200K .......... .......... .......... .......... .......... 62% 439M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58250K .......... .......... .......... .......... .......... 62% 436M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58300K .......... .......... .......... .......... .......... 62% 352M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58350K .......... .......... .......... .......... .......... 62% 416M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58400K .......... .......... .......... .......... .......... 62% 453M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58450K .......... .......... .......... .......... .......... 62% 392M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58500K .......... .......... .......... .......... .......... 63% 374M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58550K .......... .......... .......... .......... .......... 63% 149M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58600K .......... .......... .......... .......... .......... 63% 423M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58650K .......... .......... .......... .......... .......... 63% 207M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58700K .......... .......... .......... .......... .......... 63% 58.0M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58750K .......... .......... .......... .......... .......... 63% 36.7M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58800K .......... .......... .......... .......... .......... 63% 94.4M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58850K .......... .......... .......... .......... .......... 63% 372M 0s 2024-09-12T00:55:12.835 INFO:teuthology.orchestra.run.smithi083.stderr: 58900K .......... .......... .......... .......... .......... 63% 295M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 58950K .......... .......... .......... .......... .......... 63% 126M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59000K .......... .......... .......... .......... .......... 63% 55.9M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59050K .......... .......... .......... .......... .......... 63% 402M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59100K .......... .......... .......... .......... .......... 63% 201M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59150K .......... .......... .......... .......... .......... 63% 377M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59200K .......... .......... .......... .......... .......... 63% 333M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59250K .......... .......... .......... .......... .......... 63% 410M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59300K .......... .......... .......... .......... .......... 63% 387M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59350K .......... .......... .......... .......... .......... 63% 249M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59400K .......... .......... .......... .......... .......... 63% 123M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59450K .......... .......... .......... .......... .......... 64% 313M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59500K .......... .......... .......... .......... .......... 64% 350M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59550K .......... .......... .......... .......... .......... 64% 395M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59600K .......... .......... .......... .......... .......... 64% 351M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59650K .......... .......... .......... .......... .......... 64% 415M 0s 2024-09-12T00:55:12.836 INFO:teuthology.orchestra.run.smithi083.stderr: 59700K .......... .......... .......... .......... .......... 64% 109M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 59750K .......... .......... .......... .......... .......... 64% 275M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 59800K .......... .......... .......... .......... .......... 64% 347M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 59850K .......... .......... .......... .......... .......... 64% 246M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 59900K .......... .......... .......... .......... .......... 64% 410M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 59950K .......... .......... .......... .......... .......... 64% 408M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 60000K .......... .......... .......... .......... .......... 64% 321M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 60050K .......... .......... .......... .......... .......... 64% 262M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 60100K .......... .......... .......... .......... .......... 64% 188M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 60150K .......... .......... .......... .......... .......... 64% 320M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 60200K .......... .......... .......... .......... .......... 64% 315M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 60250K .......... .......... .......... .......... .......... 64% 393M 0s 2024-09-12T00:55:12.837 INFO:teuthology.orchestra.run.smithi083.stderr: 60300K .......... .......... .......... .......... .......... 64% 336M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60350K .......... .......... .......... .......... .......... 65% 350M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60400K .......... .......... .......... .......... .......... 65% 420M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60450K .......... .......... .......... .......... .......... 65% 422M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60500K .......... .......... .......... .......... .......... 65% 335M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60550K .......... .......... .......... .......... .......... 65% 325M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60600K .......... .......... .......... .......... .......... 65% 413M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60650K .......... .......... .......... .......... .......... 65% 434M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60700K .......... .......... .......... .......... .......... 65% 330M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60750K .......... .......... .......... .......... .......... 65% 425M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60800K .......... .......... .......... .......... .......... 65% 429M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60850K .......... .......... .......... .......... .......... 65% 425M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60900K .......... .......... .......... .......... .......... 65% 397M 0s 2024-09-12T00:55:12.838 INFO:teuthology.orchestra.run.smithi083.stderr: 60950K .......... .......... .......... .......... .......... 65% 423M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61000K .......... .......... .......... .......... .......... 65% 407M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61050K .......... .......... .......... .......... .......... 65% 437M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61100K .......... .......... .......... .......... .......... 65% 333M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61150K .......... .......... .......... .......... .......... 65% 351M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61200K .......... .......... .......... .......... .......... 65% 423M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61250K .......... .......... .......... .......... .......... 65% 425M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61300K .......... .......... .......... .......... .......... 66% 345M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61350K .......... .......... .......... .......... .......... 66% 423M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61400K .......... .......... .......... .......... .......... 66% 381M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61450K .......... .......... .......... .......... .......... 66% 451M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61500K .......... .......... .......... .......... .......... 66% 452M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61550K .......... .......... .......... .......... .......... 66% 354M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61600K .......... .......... .......... .......... .......... 66% 429M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61650K .......... .......... .......... .......... .......... 66% 445M 0s 2024-09-12T00:55:12.839 INFO:teuthology.orchestra.run.smithi083.stderr: 61700K .......... .......... .......... .......... .......... 66% 390M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 61750K .......... .......... .......... .......... .......... 66% 268M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 61800K .......... .......... .......... .......... .......... 66% 30.3M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 61850K .......... .......... .......... .......... .......... 66% 461M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 61900K .......... .......... .......... .......... .......... 66% 88.8M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 61950K .......... .......... .......... .......... .......... 66% 329M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 62000K .......... .......... .......... .......... .......... 66% 429M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 62050K .......... .......... .......... .......... .......... 66% 53.1M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 62100K .......... .......... .......... .......... .......... 66% 353M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 62150K .......... .......... .......... .......... .......... 66% 155M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 62200K .......... .......... .......... .......... .......... 67% 256M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 62250K .......... .......... .......... .......... .......... 67% 218M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 62300K .......... .......... .......... .......... .......... 67% 423M 0s 2024-09-12T00:55:12.840 INFO:teuthology.orchestra.run.smithi083.stderr: 62350K .......... .......... .......... .......... .......... 67% 366M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62400K .......... .......... .......... .......... .......... 67% 432M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62450K .......... .......... .......... .......... .......... 67% 73.6M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62500K .......... .......... .......... .......... .......... 67% 163M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62550K .......... .......... .......... .......... .......... 67% 237M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62600K .......... .......... .......... .......... .......... 67% 425M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62650K .......... .......... .......... .......... .......... 67% 463M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62700K .......... .......... .......... .......... .......... 67% 430M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62750K .......... .......... .......... .......... .......... 67% 184M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62800K .......... .......... .......... .......... .......... 67% 390M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62850K .......... .......... .......... .......... .......... 67% 401M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62900K .......... .......... .......... .......... .......... 67% 207M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 62950K .......... .......... .......... .......... .......... 67% 153M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 63000K .......... .......... .......... .......... .......... 67% 421M 0s 2024-09-12T00:55:12.841 INFO:teuthology.orchestra.run.smithi083.stderr: 63050K .......... .......... .......... .......... .......... 67% 463M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63100K .......... .......... .......... .......... .......... 67% 454M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63150K .......... .......... .......... .......... .......... 68% 113M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63200K .......... .......... .......... .......... .......... 68% 365M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63250K .......... .......... .......... .......... .......... 68% 433M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63300K .......... .......... .......... .......... .......... 68% 425M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63350K .......... .......... .......... .......... .......... 68% 397M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63400K .......... .......... .......... .......... .......... 68% 464M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63450K .......... .......... .......... .......... .......... 68% 431M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63500K .......... .......... .......... .......... .......... 68% 421M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63550K .......... .......... .......... .......... .......... 68% 373M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63600K .......... .......... .......... .......... .......... 68% 413M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63650K .......... .......... .......... .......... .......... 68% 416M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63700K .......... .......... .......... .......... .......... 68% 439M 0s 2024-09-12T00:55:12.842 INFO:teuthology.orchestra.run.smithi083.stderr: 63750K .......... .......... .......... .......... .......... 68% 416M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 63800K .......... .......... .......... .......... .......... 68% 454M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 63850K .......... .......... .......... .......... .......... 68% 153M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 63900K .......... .......... .......... .......... .......... 68% 411M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 63950K .......... .......... .......... .......... .......... 68% 375M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64000K .......... .......... .......... .......... .......... 68% 231M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64050K .......... .......... .......... .......... .......... 68% 464M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64100K .......... .......... .......... .......... .......... 69% 439M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64150K .......... .......... .......... .......... .......... 69% 418M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64200K .......... .......... .......... .......... .......... 69% 461M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64250K .......... .......... .......... .......... .......... 69% 450M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64300K .......... .......... .......... .......... .......... 69% 457M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64350K .......... .......... .......... .......... .......... 69% 355M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64400K .......... .......... .......... .......... .......... 69% 446M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64450K .......... .......... .......... .......... .......... 69% 435M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64500K .......... .......... .......... .......... .......... 69% 445M 0s 2024-09-12T00:55:12.843 INFO:teuthology.orchestra.run.smithi083.stderr: 64550K .......... .......... .......... .......... .......... 69% 392M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 64600K .......... .......... .......... .......... .......... 69% 444M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 64650K .......... .......... .......... .......... .......... 69% 446M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 64700K .......... .......... .......... .......... .......... 69% 459M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 64750K .......... .......... .......... .......... .......... 69% 373M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 64800K .......... .......... .......... .......... .......... 69% 457M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 64850K .......... .......... .......... .......... .......... 69% 96.5M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 64900K .......... .......... .......... .......... .......... 69% 67.2M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 64950K .......... .......... .......... .......... .......... 69% 76.0M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 65000K .......... .......... .......... .......... .......... 70% 202M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 65050K .......... .......... .......... .......... .......... 70% 390M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 65100K .......... .......... .......... .......... .......... 70% 431M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 65150K .......... .......... .......... .......... .......... 70% 54.0M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 65200K .......... .......... .......... .......... .......... 70% 345M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 65250K .......... .......... .......... .......... .......... 70% 113M 0s 2024-09-12T00:55:12.844 INFO:teuthology.orchestra.run.smithi083.stderr: 65300K .......... .......... .......... .......... .......... 70% 437M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65350K .......... .......... .......... .......... .......... 70% 362M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65400K .......... .......... .......... .......... .......... 70% 406M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65450K .......... .......... .......... .......... .......... 70% 93.8M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65500K .......... .......... .......... .......... .......... 70% 367M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65550K .......... .......... .......... .......... .......... 70% 157M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65600K .......... .......... .......... .......... .......... 70% 141M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65650K .......... .......... .......... .......... .......... 70% 405M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65700K .......... .......... .......... .......... .......... 70% 411M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65750K .......... .......... .......... .......... .......... 70% 191M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65800K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65850K .......... .......... .......... .......... .......... 70% 407M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65900K .......... .......... .......... .......... .......... 70% 447M 0s 2024-09-12T00:55:12.845 INFO:teuthology.orchestra.run.smithi083.stderr: 65950K .......... .......... .......... .......... .......... 71% 308M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66000K .......... .......... .......... .......... .......... 71% 330M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66050K .......... .......... .......... .......... .......... 71% 184M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66100K .......... .......... .......... .......... .......... 71% 352M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66150K .......... .......... .......... .......... .......... 71% 373M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66200K .......... .......... .......... .......... .......... 71% 140M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66250K .......... .......... .......... .......... .......... 71% 179M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66300K .......... .......... .......... .......... .......... 71% 443M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66350K .......... .......... .......... .......... .......... 71% 222M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66400K .......... .......... .......... .......... .......... 71% 328M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66450K .......... .......... .......... .......... .......... 71% 413M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66500K .......... .......... .......... .......... .......... 71% 447M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66550K .......... .......... .......... .......... .......... 71% 406M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66600K .......... .......... .......... .......... .......... 71% 351M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66650K .......... .......... .......... .......... .......... 71% 435M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66700K .......... .......... .......... .......... .......... 71% 408M 0s 2024-09-12T00:55:12.846 INFO:teuthology.orchestra.run.smithi083.stderr: 66750K .......... .......... .......... .......... .......... 71% 325M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 66800K .......... .......... .......... .......... .......... 71% 444M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 66850K .......... .......... .......... .......... .......... 72% 446M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 66900K .......... .......... .......... .......... .......... 72% 193M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 66950K .......... .......... .......... .......... .......... 72% 389M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67000K .......... .......... .......... .......... .......... 72% 445M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67050K .......... .......... .......... .......... .......... 72% 458M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67100K .......... .......... .......... .......... .......... 72% 437M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67150K .......... .......... .......... .......... .......... 72% 296M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67200K .......... .......... .......... .......... .......... 72% 441M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67250K .......... .......... .......... .......... .......... 72% 444M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67300K .......... .......... .......... .......... .......... 72% 450M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67350K .......... .......... .......... .......... .......... 72% 205M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67400K .......... .......... .......... .......... .......... 72% 272M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67450K .......... .......... .......... .......... .......... 72% 423M 0s 2024-09-12T00:55:12.847 INFO:teuthology.orchestra.run.smithi083.stderr: 67500K .......... .......... .......... .......... .......... 72% 280M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 67550K .......... .......... .......... .......... .......... 72% 326M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 67600K .......... .......... .......... .......... .......... 72% 189M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 67650K .......... .......... .......... .......... .......... 72% 421M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 67700K .......... .......... .......... .......... .......... 72% 455M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 67750K .......... .......... .......... .......... .......... 72% 386M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 67800K .......... .......... .......... .......... .......... 73% 414M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 67850K .......... .......... .......... .......... .......... 73% 446M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 67900K .......... .......... .......... .......... .......... 73% 431M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 67950K .......... .......... .......... .......... .......... 73% 69.9M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 68000K .......... .......... .......... .......... .......... 73% 148M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 68050K .......... .......... .......... .......... .......... 73% 144M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 68100K .......... .......... .......... .......... .......... 73% 173M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 68150K .......... .......... .......... .......... .......... 73% 87.7M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 68200K .......... .......... .......... .......... .......... 73% 309M 0s 2024-09-12T00:55:12.848 INFO:teuthology.orchestra.run.smithi083.stderr: 68250K .......... .......... .......... .......... .......... 73% 232M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68300K .......... .......... .......... .......... .......... 73% 88.8M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68350K .......... .......... .......... .......... .......... 73% 242M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68400K .......... .......... .......... .......... .......... 73% 399M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68450K .......... .......... .......... .......... .......... 73% 437M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68500K .......... .......... .......... .......... .......... 73% 178M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68550K .......... .......... .......... .......... .......... 73% 210M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68600K .......... .......... .......... .......... .......... 73% 265M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68650K .......... .......... .......... .......... .......... 73% 448M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68700K .......... .......... .......... .......... .......... 74% 64.1M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68750K .......... .......... .......... .......... .......... 74% 245M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68800K .......... .......... .......... .......... .......... 74% 430M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68850K .......... .......... .......... .......... .......... 74% 291M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68900K .......... .......... .......... .......... .......... 74% 318M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 68950K .......... .......... .......... .......... .......... 74% 141M 0s 2024-09-12T00:55:12.849 INFO:teuthology.orchestra.run.smithi083.stderr: 69000K .......... .......... .......... .......... .......... 74% 438M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69050K .......... .......... .......... .......... .......... 74% 445M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69100K .......... .......... .......... .......... .......... 74% 426M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69150K .......... .......... .......... .......... .......... 74% 160M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69200K .......... .......... .......... .......... .......... 74% 439M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69250K .......... .......... .......... .......... .......... 74% 443M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69300K .......... .......... .......... .......... .......... 74% 353M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69350K .......... .......... .......... .......... .......... 74% 164M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69400K .......... .......... .......... .......... .......... 74% 409M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69450K .......... .......... .......... .......... .......... 74% 181M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69500K .......... .......... .......... .......... .......... 74% 434M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69550K .......... .......... .......... .......... .......... 74% 121M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69600K .......... .......... .......... .......... .......... 74% 410M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69650K .......... .......... .......... .......... .......... 75% 425M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69700K .......... .......... .......... .......... .......... 75% 416M 0s 2024-09-12T00:55:12.850 INFO:teuthology.orchestra.run.smithi083.stderr: 69750K .......... .......... .......... .......... .......... 75% 193M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 69800K .......... .......... .......... .......... .......... 75% 422M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 69850K .......... .......... .......... .......... .......... 75% 442M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 69900K .......... .......... .......... .......... .......... 75% 409M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 69950K .......... .......... .......... .......... .......... 75% 371M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70000K .......... .......... .......... .......... .......... 75% 350M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70050K .......... .......... .......... .......... .......... 75% 321M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70100K .......... .......... .......... .......... .......... 75% 280M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70150K .......... .......... .......... .......... .......... 75% 336M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70200K .......... .......... .......... .......... .......... 75% 297M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70250K .......... .......... .......... .......... .......... 75% 454M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70300K .......... .......... .......... .......... .......... 75% 165M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70350K .......... .......... .......... .......... .......... 75% 197M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70400K .......... .......... .......... .......... .......... 75% 298M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70450K .......... .......... .......... .......... .......... 75% 434M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70500K .......... .......... .......... .......... .......... 75% 353M 0s 2024-09-12T00:55:12.851 INFO:teuthology.orchestra.run.smithi083.stderr: 70550K .......... .......... .......... .......... .......... 75% 87.6M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 70600K .......... .......... .......... .......... .......... 76% 429M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 70650K .......... .......... .......... .......... .......... 76% 218M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 70700K .......... .......... .......... .......... .......... 76% 153M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 70750K .......... .......... .......... .......... .......... 76% 236M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 70800K .......... .......... .......... .......... .......... 76% 419M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 70850K .......... .......... .......... .......... .......... 76% 208M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 70900K .......... .......... .......... .......... .......... 76% 193M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 70950K .......... .......... .......... .......... .......... 76% 373M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 71000K .......... .......... .......... .......... .......... 76% 260M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 71050K .......... .......... .......... .......... .......... 76% 173M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 71100K .......... .......... .......... .......... .......... 76% 108M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 71150K .......... .......... .......... .......... .......... 76% 174M 0s 2024-09-12T00:55:12.852 INFO:teuthology.orchestra.run.smithi083.stderr: 71200K .......... .......... .......... .......... .......... 76% 129M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71250K .......... .......... .......... .......... .......... 76% 302M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71300K .......... .......... .......... .......... .......... 76% 229M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71350K .......... .......... .......... .......... .......... 76% 116M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71400K .......... .......... .......... .......... .......... 76% 281M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71450K .......... .......... .......... .......... .......... 76% 387M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71500K .......... .......... .......... .......... .......... 77% 258M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71550K .......... .......... .......... .......... .......... 77% 280M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71600K .......... .......... .......... .......... .......... 77% 258M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71650K .......... .......... .......... .......... .......... 77% 256M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71700K .......... .......... .......... .......... .......... 77% 283M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71750K .......... .......... .......... .......... .......... 77% 82.5M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71800K .......... .......... .......... .......... .......... 77% 286M 0s 2024-09-12T00:55:12.853 INFO:teuthology.orchestra.run.smithi083.stderr: 71850K .......... .......... .......... .......... .......... 77% 165M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 71900K .......... .......... .......... .......... .......... 77% 244M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 71950K .......... .......... .......... .......... .......... 77% 431M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72000K .......... .......... .......... .......... .......... 77% 278M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72050K .......... .......... .......... .......... .......... 77% 364M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72100K .......... .......... .......... .......... .......... 77% 214M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72150K .......... .......... .......... .......... .......... 77% 447M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72200K .......... .......... .......... .......... .......... 77% 430M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72250K .......... .......... .......... .......... .......... 77% 229M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72300K .......... .......... .......... .......... .......... 77% 348M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72350K .......... .......... .......... .......... .......... 77% 140M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72400K .......... .......... .......... .......... .......... 77% 398M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72450K .......... .......... .......... .......... .......... 78% 432M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72500K .......... .......... .......... .......... .......... 78% 259M 0s 2024-09-12T00:55:12.854 INFO:teuthology.orchestra.run.smithi083.stderr: 72550K .......... .......... .......... .......... .......... 78% 282M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 72600K .......... .......... .......... .......... .......... 78% 269M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 72650K .......... .......... .......... .......... .......... 78% 277M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 72700K .......... .......... .......... .......... .......... 78% 232M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 72750K .......... .......... .......... .......... .......... 78% 285M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 72800K .......... .......... .......... .......... .......... 78% 429M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 72850K .......... .......... .......... .......... .......... 78% 362M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 72900K .......... .......... .......... .......... .......... 78% 367M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 72950K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 73000K .......... .......... .......... .......... .......... 78% 257M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 73050K .......... .......... .......... .......... .......... 78% 425M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 73100K .......... .......... .......... .......... .......... 78% 349M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 73150K .......... .......... .......... .......... .......... 78% 331M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 73200K .......... .......... .......... .......... .......... 78% 174M 0s 2024-09-12T00:55:12.855 INFO:teuthology.orchestra.run.smithi083.stderr: 73250K .......... .......... .......... .......... .......... 78% 127M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73300K .......... .......... .......... .......... .......... 78% 375M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73350K .......... .......... .......... .......... .......... 79% 346M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73400K .......... .......... .......... .......... .......... 79% 392M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73450K .......... .......... .......... .......... .......... 79% 92.5M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73500K .......... .......... .......... .......... .......... 79% 84.8M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73550K .......... .......... .......... .......... .......... 79% 134M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73600K .......... .......... .......... .......... .......... 79% 99.5M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73650K .......... .......... .......... .......... .......... 79% 182M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73700K .......... .......... .......... .......... .......... 79% 258M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73750K .......... .......... .......... .......... .......... 79% 436M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73800K .......... .......... .......... .......... .......... 79% 365M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73850K .......... .......... .......... .......... .......... 79% 156M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73900K .......... .......... .......... .......... .......... 79% 354M 0s 2024-09-12T00:55:12.856 INFO:teuthology.orchestra.run.smithi083.stderr: 73950K .......... .......... .......... .......... .......... 79% 222M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74000K .......... .......... .......... .......... .......... 79% 215M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74050K .......... .......... .......... .......... .......... 79% 414M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74100K .......... .......... .......... .......... .......... 79% 388M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74150K .......... .......... .......... .......... .......... 79% 130M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74200K .......... .......... .......... .......... .......... 79% 423M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74250K .......... .......... .......... .......... .......... 79% 407M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74300K .......... .......... .......... .......... .......... 80% 219M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74350K .......... .......... .......... .......... .......... 80% 165M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74400K .......... .......... .......... .......... .......... 80% 405M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74450K .......... .......... .......... .......... .......... 80% 147M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74500K .......... .......... .......... .......... .......... 80% 343M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74550K .......... .......... .......... .......... .......... 80% 224M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74600K .......... .......... .......... .......... .......... 80% 423M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74650K .......... .......... .......... .......... .......... 80% 443M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74700K .......... .......... .......... .......... .......... 80% 221M 0s 2024-09-12T00:55:12.857 INFO:teuthology.orchestra.run.smithi083.stderr: 74750K .......... .......... .......... .......... .......... 80% 363M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 74800K .......... .......... .......... .......... .......... 80% 116M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 74850K .......... .......... .......... .......... .......... 80% 344M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 74900K .......... .......... .......... .......... .......... 80% 147M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 74950K .......... .......... .......... .......... .......... 80% 432M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75000K .......... .......... .......... .......... .......... 80% 409M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75050K .......... .......... .......... .......... .......... 80% 233M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75100K .......... .......... .......... .......... .......... 80% 87.3M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75150K .......... .......... .......... .......... .......... 80% 378M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75200K .......... .......... .......... .......... .......... 81% 410M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75250K .......... .......... .......... .......... .......... 81% 199M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75300K .......... .......... .......... .......... .......... 81% 308M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75350K .......... .......... .......... .......... .......... 81% 434M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75400K .......... .......... .......... .......... .......... 81% 394M 0s 2024-09-12T00:55:12.858 INFO:teuthology.orchestra.run.smithi083.stderr: 75450K .......... .......... .......... .......... .......... 81% 267M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75500K .......... .......... .......... .......... .......... 81% 370M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75550K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75600K .......... .......... .......... .......... .......... 81% 140M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75650K .......... .......... .......... .......... .......... 81% 445M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75700K .......... .......... .......... .......... .......... 81% 402M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75750K .......... .......... .......... .......... .......... 81% 209M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75800K .......... .......... .......... .......... .......... 81% 117M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75850K .......... .......... .......... .......... .......... 81% 435M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75900K .......... .......... .......... .......... .......... 81% 367M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 75950K .......... .......... .......... .......... .......... 81% 410M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 76000K .......... .......... .......... .......... .......... 81% 438M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 76050K .......... .......... .......... .......... .......... 81% 432M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 76100K .......... .......... .......... .......... .......... 81% 365M 0s 2024-09-12T00:55:12.859 INFO:teuthology.orchestra.run.smithi083.stderr: 76150K .......... .......... .......... .......... .......... 82% 392M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76200K .......... .......... .......... .......... .......... 82% 464M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76250K .......... .......... .......... .......... .......... 82% 282M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76300K .......... .......... .......... .......... .......... 82% 260M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76350K .......... .......... .......... .......... .......... 82% 403M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76400K .......... .......... .......... .......... .......... 82% 123M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76450K .......... .......... .......... .......... .......... 82% 445M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76500K .......... .......... .......... .......... .......... 82% 147M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76550K .......... .......... .......... .......... .......... 82% 235M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76600K .......... .......... .......... .......... .......... 82% 307M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76650K .......... .......... .......... .......... .......... 82% 76.7M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76700K .......... .......... .......... .......... .......... 82% 243M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76750K .......... .......... .......... .......... .......... 82% 205M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76800K .......... .......... .......... .......... .......... 82% 410M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76850K .......... .......... .......... .......... .......... 82% 435M 0s 2024-09-12T00:55:12.860 INFO:teuthology.orchestra.run.smithi083.stderr: 76900K .......... .......... .......... .......... .......... 82% 134M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 76950K .......... .......... .......... .......... .......... 82% 214M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77000K .......... .......... .......... .......... .......... 82% 440M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77050K .......... .......... .......... .......... .......... 82% 464M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77100K .......... .......... .......... .......... .......... 83% 180M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77150K .......... .......... .......... .......... .......... 83% 403M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77200K .......... .......... .......... .......... .......... 83% 409M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77250K .......... .......... .......... .......... .......... 83% 424M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77300K .......... .......... .......... .......... .......... 83% 364M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77350K .......... .......... .......... .......... .......... 83% 235M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77400K .......... .......... .......... .......... .......... 83% 210M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77450K .......... .......... .......... .......... .......... 83% 425M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77500K .......... .......... .......... .......... .......... 83% 107M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77550K .......... .......... .......... .......... .......... 83% 404M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77600K .......... .......... .......... .......... .......... 83% 120M 0s 2024-09-12T00:55:12.861 INFO:teuthology.orchestra.run.smithi083.stderr: 77650K .......... .......... .......... .......... .......... 83% 251M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 77700K .......... .......... .......... .......... .......... 83% 385M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 77750K .......... .......... .......... .......... .......... 83% 350M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 77800K .......... .......... .......... .......... .......... 83% 419M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 77850K .......... .......... .......... .......... .......... 83% 434M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 77900K .......... .......... .......... .......... .......... 83% 174M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 77950K .......... .......... .......... .......... .......... 83% 222M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 78000K .......... .......... .......... .......... .......... 84% 425M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 78050K .......... .......... .......... .......... .......... 84% 240M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 78100K .......... .......... .......... .......... .......... 84% 312M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 78150K .......... .......... .......... .......... .......... 84% 86.1M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 78200K .......... .......... .......... .......... .......... 84% 446M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 78250K .......... .......... .......... .......... .......... 84% 265M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 78300K .......... .......... .......... .......... .......... 84% 63.5M 0s 2024-09-12T00:55:12.862 INFO:teuthology.orchestra.run.smithi083.stderr: 78350K .......... .......... .......... .......... .......... 84% 431M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78400K .......... .......... .......... .......... .......... 84% 293M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78450K .......... .......... .......... .......... .......... 84% 280M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78500K .......... .......... .......... .......... .......... 84% 190M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78550K .......... .......... .......... .......... .......... 84% 343M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78600K .......... .......... .......... .......... .......... 84% 388M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78650K .......... .......... .......... .......... .......... 84% 469M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78700K .......... .......... .......... .......... .......... 84% 260M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78750K .......... .......... .......... .......... .......... 84% 202M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78800K .......... .......... .......... .......... .......... 84% 240M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78850K .......... .......... .......... .......... .......... 84% 82.6M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78900K .......... .......... .......... .......... .......... 84% 384M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 78950K .......... .......... .......... .......... .......... 85% 370M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 79000K .......... .......... .......... .......... .......... 85% 439M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 79050K .......... .......... .......... .......... .......... 85% 384M 0s 2024-09-12T00:55:12.863 INFO:teuthology.orchestra.run.smithi083.stderr: 79100K .......... .......... .......... .......... .......... 85% 340M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79150K .......... .......... .......... .......... .......... 85% 432M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79200K .......... .......... .......... .......... .......... 85% 424M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79250K .......... .......... .......... .......... .......... 85% 396M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79300K .......... .......... .......... .......... .......... 85% 398M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79350K .......... .......... .......... .......... .......... 85% 220M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79400K .......... .......... .......... .......... .......... 85% 326M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79450K .......... .......... .......... .......... .......... 85% 421M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79500K .......... .......... .......... .......... .......... 85% 342M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79550K .......... .......... .......... .......... .......... 85% 412M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79600K .......... .......... .......... .......... .......... 85% 408M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79650K .......... .......... .......... .......... .......... 85% 427M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79700K .......... .......... .......... .......... .......... 85% 315M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79750K .......... .......... .......... .......... .......... 85% 270M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79800K .......... .......... .......... .......... .......... 85% 209M 0s 2024-09-12T00:55:12.864 INFO:teuthology.orchestra.run.smithi083.stderr: 79850K .......... .......... .......... .......... .......... 86% 304M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 79900K .......... .......... .......... .......... .......... 86% 353M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 79950K .......... .......... .......... .......... .......... 86% 205M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80000K .......... .......... .......... .......... .......... 86% 144M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80050K .......... .......... .......... .......... .......... 86% 311M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80100K .......... .......... .......... .......... .......... 86% 381M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80150K .......... .......... .......... .......... .......... 86% 194M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80200K .......... .......... .......... .......... .......... 86% 167M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80250K .......... .......... .......... .......... .......... 86% 434M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80300K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80350K .......... .......... .......... .......... .......... 86% 421M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80400K .......... .......... .......... .......... .......... 86% 450M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80450K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-12T00:55:12.865 INFO:teuthology.orchestra.run.smithi083.stderr: 80500K .......... .......... .......... .......... .......... 86% 197M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 80550K .......... .......... .......... .......... .......... 86% 449M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 80600K .......... .......... .......... .......... .......... 86% 199M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 80650K .......... .......... .......... .......... .......... 86% 25.0M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 80700K .......... .......... .......... .......... .......... 86% 48.5M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 80750K .......... .......... .......... .......... .......... 86% 167M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 80800K .......... .......... .......... .......... .......... 87% 375M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 80850K .......... .......... .......... .......... .......... 87% 446M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 80900K .......... .......... .......... .......... .......... 87% 399M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 80950K .......... .......... .......... .......... .......... 87% 422M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 81000K .......... .......... .......... .......... .......... 87% 388M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 81050K .......... .......... .......... .......... .......... 87% 320M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 81100K .......... .......... .......... .......... .......... 87% 306M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 81150K .......... .......... .......... .......... .......... 87% 377M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 81200K .......... .......... .......... .......... .......... 87% 186M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 81250K .......... .......... .......... .......... .......... 87% 431M 0s 2024-09-12T00:55:12.866 INFO:teuthology.orchestra.run.smithi083.stderr: 81300K .......... .......... .......... .......... .......... 87% 403M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81350K .......... .......... .......... .......... .......... 87% 210M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81400K .......... .......... .......... .......... .......... 87% 183M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81450K .......... .......... .......... .......... .......... 87% 286M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81500K .......... .......... .......... .......... .......... 87% 368M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81550K .......... .......... .......... .......... .......... 87% 208M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81600K .......... .......... .......... .......... .......... 87% 451M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81650K .......... .......... .......... .......... .......... 87% 395M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81700K .......... .......... .......... .......... .......... 87% 393M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81750K .......... .......... .......... .......... .......... 88% 432M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81800K .......... .......... .......... .......... .......... 88% 420M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81850K .......... .......... .......... .......... .......... 88% 311M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81900K .......... .......... .......... .......... .......... 88% 157M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 81950K .......... .......... .......... .......... .......... 88% 196M 0s 2024-09-12T00:55:12.867 INFO:teuthology.orchestra.run.smithi083.stderr: 82000K .......... .......... .......... .......... .......... 88% 362M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82050K .......... .......... .......... .......... .......... 88% 407M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82100K .......... .......... .......... .......... .......... 88% 407M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82150K .......... .......... .......... .......... .......... 88% 331M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82200K .......... .......... .......... .......... .......... 88% 358M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82250K .......... .......... .......... .......... .......... 88% 430M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82300K .......... .......... .......... .......... .......... 88% 372M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82350K .......... .......... .......... .......... .......... 88% 231M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82400K .......... .......... .......... .......... .......... 88% 419M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82450K .......... .......... .......... .......... .......... 88% 391M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82500K .......... .......... .......... .......... .......... 88% 381M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82550K .......... .......... .......... .......... .......... 88% 381M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82600K .......... .......... .......... .......... .......... 88% 436M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82650K .......... .......... .......... .......... .......... 89% 451M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82700K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-12T00:55:12.868 INFO:teuthology.orchestra.run.smithi083.stderr: 82750K .......... .......... .......... .......... .......... 89% 448M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 82800K .......... .......... .......... .......... .......... 89% 367M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 82850K .......... .......... .......... .......... .......... 89% 419M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 82900K .......... .......... .......... .......... .......... 89% 398M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 82950K .......... .......... .......... .......... .......... 89% 376M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83000K .......... .......... .......... .......... .......... 89% 445M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83050K .......... .......... .......... .......... .......... 89% 412M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83100K .......... .......... .......... .......... .......... 89% 358M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83150K .......... .......... .......... .......... .......... 89% 444M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83200K .......... .......... .......... .......... .......... 89% 443M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83250K .......... .......... .......... .......... .......... 89% 437M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83300K .......... .......... .......... .......... .......... 89% 118M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83350K .......... .......... .......... .......... .......... 89% 295M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83400K .......... .......... .......... .......... .......... 89% 422M 0s 2024-09-12T00:55:12.869 INFO:teuthology.orchestra.run.smithi083.stderr: 83450K .......... .......... .......... .......... .......... 89% 434M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83500K .......... .......... .......... .......... .......... 89% 370M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83550K .......... .......... .......... .......... .......... 89% 415M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83600K .......... .......... .......... .......... .......... 90% 429M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83650K .......... .......... .......... .......... .......... 90% 444M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83700K .......... .......... .......... .......... .......... 90% 56.2M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83750K .......... .......... .......... .......... .......... 90% 13.5M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83800K .......... .......... .......... .......... .......... 90% 86.2M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83850K .......... .......... .......... .......... .......... 90% 367M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83900K .......... .......... .......... .......... .......... 90% 355M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 83950K .......... .......... .......... .......... .......... 90% 440M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 84000K .......... .......... .......... .......... .......... 90% 389M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 84050K .......... .......... .......... .......... .......... 90% 350M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 84100K .......... .......... .......... .......... .......... 90% 391M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 84150K .......... .......... .......... .......... .......... 90% 413M 0s 2024-09-12T00:55:12.870 INFO:teuthology.orchestra.run.smithi083.stderr: 84200K .......... .......... .......... .......... .......... 90% 440M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84250K .......... .......... .......... .......... .......... 90% 425M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84300K .......... .......... .......... .......... .......... 90% 329M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84350K .......... .......... .......... .......... .......... 90% 457M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84400K .......... .......... .......... .......... .......... 90% 448M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84450K .......... .......... .......... .......... .......... 90% 420M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84500K .......... .......... .......... .......... .......... 91% 98.1M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84550K .......... .......... .......... .......... .......... 91% 389M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84600K .......... .......... .......... .......... .......... 91% 433M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84650K .......... .......... .......... .......... .......... 91% 433M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84700K .......... .......... .......... .......... .......... 91% 357M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84750K .......... .......... .......... .......... .......... 91% 406M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84800K .......... .......... .......... .......... .......... 91% 405M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84850K .......... .......... .......... .......... .......... 91% 424M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84900K .......... .......... .......... .......... .......... 91% 405M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 84950K .......... .......... .......... .......... .......... 91% 442M 0s 2024-09-12T00:55:12.871 INFO:teuthology.orchestra.run.smithi083.stderr: 85000K .......... .......... .......... .......... .......... 91% 436M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85050K .......... .......... .......... .......... .......... 91% 437M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85100K .......... .......... .......... .......... .......... 91% 379M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85150K .......... .......... .......... .......... .......... 91% 428M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85200K .......... .......... .......... .......... .......... 91% 445M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85250K .......... .......... .......... .......... .......... 91% 387M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85300K .......... .......... .......... .......... .......... 91% 416M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85350K .......... .......... .......... .......... .......... 91% 458M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85400K .......... .......... .......... .......... .......... 91% 479M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85450K .......... .......... .......... .......... .......... 92% 472M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85500K .......... .......... .......... .......... .......... 92% 145M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85550K .......... .......... .......... .......... .......... 92% 433M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85600K .......... .......... .......... .......... .......... 92% 446M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85650K .......... .......... .......... .......... .......... 92% 407M 0s 2024-09-12T00:55:12.872 INFO:teuthology.orchestra.run.smithi083.stderr: 85700K .......... .......... .......... .......... .......... 92% 394M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 85750K .......... .......... .......... .......... .......... 92% 435M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 85800K .......... .......... .......... .......... .......... 92% 435M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 85850K .......... .......... .......... .......... .......... 92% 372M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 85900K .......... .......... .......... .......... .......... 92% 373M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 85950K .......... .......... .......... .......... .......... 92% 419M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 86000K .......... .......... .......... .......... .......... 92% 424M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 86050K .......... .......... .......... .......... .......... 92% 427M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 86100K .......... .......... .......... .......... .......... 92% 399M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 86150K .......... .......... .......... .......... .......... 92% 450M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 86200K .......... .......... .......... .......... .......... 92% 454M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 86250K .......... .......... .......... .......... .......... 92% 434M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 86300K .......... .......... .......... .......... .......... 92% 369M 0s 2024-09-12T00:55:12.873 INFO:teuthology.orchestra.run.smithi083.stderr: 86350K .......... .......... .......... .......... .......... 93% 423M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86400K .......... .......... .......... .......... .......... 93% 454M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86450K .......... .......... .......... .......... .......... 93% 436M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86500K .......... .......... .......... .......... .......... 93% 404M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86550K .......... .......... .......... .......... .......... 93% 429M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86600K .......... .......... .......... .......... .......... 93% 389M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86650K .......... .......... .......... .......... .......... 93% 450M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86700K .......... .......... .......... .......... .......... 93% 300M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86750K .......... .......... .......... .......... .......... 93% 441M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86800K .......... .......... .......... .......... .......... 93% 22.9M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86850K .......... .......... .......... .......... .......... 93% 36.0M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86900K .......... .......... .......... .......... .......... 93% 60.6M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 86950K .......... .......... .......... .......... .......... 93% 138M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 87000K .......... .......... .......... .......... .......... 93% 339M 0s 2024-09-12T00:55:12.874 INFO:teuthology.orchestra.run.smithi083.stderr: 87050K .......... .......... .......... .......... .......... 93% 210M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87100K .......... .......... .......... .......... .......... 93% 354M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87150K .......... .......... .......... .......... .......... 93% 397M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87200K .......... .......... .......... .......... .......... 93% 418M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87250K .......... .......... .......... .......... .......... 93% 418M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87300K .......... .......... .......... .......... .......... 94% 352M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87350K .......... .......... .......... .......... .......... 94% 414M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87400K .......... .......... .......... .......... .......... 94% 437M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87450K .......... .......... .......... .......... .......... 94% 450M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87500K .......... .......... .......... .......... .......... 94% 219M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87550K .......... .......... .......... .......... .......... 94% 376M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87600K .......... .......... .......... .......... .......... 94% 434M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87650K .......... .......... .......... .......... .......... 94% 418M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87700K .......... .......... .......... .......... .......... 94% 400M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87750K .......... .......... .......... .......... .......... 94% 400M 0s 2024-09-12T00:55:12.875 INFO:teuthology.orchestra.run.smithi083.stderr: 87800K .......... .......... .......... .......... .......... 94% 471M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 87850K .......... .......... .......... .......... .......... 94% 171M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 87900K .......... .......... .......... .......... .......... 94% 319M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 87950K .......... .......... .......... .......... .......... 94% 448M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88000K .......... .......... .......... .......... .......... 94% 429M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88050K .......... .......... .......... .......... .......... 94% 385M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88100K .......... .......... .......... .......... .......... 94% 435M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88150K .......... .......... .......... .......... .......... 94% 446M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88200K .......... .......... .......... .......... .......... 94% 207M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88250K .......... .......... .......... .......... .......... 95% 459M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88300K .......... .......... .......... .......... .......... 95% 369M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88350K .......... .......... .......... .......... .......... 95% 407M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88400K .......... .......... .......... .......... .......... 95% 329M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88450K .......... .......... .......... .......... .......... 95% 435M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88500K .......... .......... .......... .......... .......... 95% 398M 0s 2024-09-12T00:55:12.876 INFO:teuthology.orchestra.run.smithi083.stderr: 88550K .......... .......... .......... .......... .......... 95% 429M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 88600K .......... .......... .......... .......... .......... 95% 436M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 88650K .......... .......... .......... .......... .......... 95% 437M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 88700K .......... .......... .......... .......... .......... 95% 194M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 88750K .......... .......... .......... .......... .......... 95% 443M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 88800K .......... .......... .......... .......... .......... 95% 315M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 88850K .......... .......... .......... .......... .......... 95% 228M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 88900K .......... .......... .......... .......... .......... 95% 373M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 88950K .......... .......... .......... .......... .......... 95% 450M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 89000K .......... .......... .......... .......... .......... 95% 409M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 89050K .......... .......... .......... .......... .......... 95% 460M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 89100K .......... .......... .......... .......... .......... 95% 389M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 89150K .......... .......... .......... .......... .......... 96% 485M 0s 2024-09-12T00:55:12.877 INFO:teuthology.orchestra.run.smithi083.stderr: 89200K .......... .......... .......... .......... .......... 96% 474M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89250K .......... .......... .......... .......... .......... 96% 468M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89300K .......... .......... .......... .......... .......... 96% 415M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89350K .......... .......... .......... .......... .......... 96% 392M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89400K .......... .......... .......... .......... .......... 96% 321M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89450K .......... .......... .......... .......... .......... 96% 275M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89500K .......... .......... .......... .......... .......... 96% 234M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89550K .......... .......... .......... .......... .......... 96% 287M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89600K .......... .......... .......... .......... .......... 96% 300M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89650K .......... .......... .......... .......... .......... 96% 400M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89700K .......... .......... .......... .......... .......... 96% 397M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89750K .......... .......... .......... .......... .......... 96% 332M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89800K .......... .......... .......... .......... .......... 96% 455M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89850K .......... .......... .......... .......... .......... 96% 443M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89900K .......... .......... .......... .......... .......... 96% 43.3M 0s 2024-09-12T00:55:12.878 INFO:teuthology.orchestra.run.smithi083.stderr: 89950K .......... .......... .......... .......... .......... 96% 23.7M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90000K .......... .......... .......... .......... .......... 96% 80.4M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90050K .......... .......... .......... .......... .......... 96% 252M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90100K .......... .......... .......... .......... .......... 97% 280M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90150K .......... .......... .......... .......... .......... 97% 173M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90200K .......... .......... .......... .......... .......... 97% 313M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90250K .......... .......... .......... .......... .......... 97% 288M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90300K .......... .......... .......... .......... .......... 97% 219M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90350K .......... .......... .......... .......... .......... 97% 379M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90400K .......... .......... .......... .......... .......... 97% 448M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90450K .......... .......... .......... .......... .......... 97% 391M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90500K .......... .......... .......... .......... .......... 97% 364M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90550K .......... .......... .......... .......... .......... 97% 436M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90600K .......... .......... .......... .......... .......... 97% 431M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90650K .......... .......... .......... .......... .......... 97% 438M 0s 2024-09-12T00:55:12.879 INFO:teuthology.orchestra.run.smithi083.stderr: 90700K .......... .......... .......... .......... .......... 97% 376M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 90750K .......... .......... .......... .......... .......... 97% 448M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 90800K .......... .......... .......... .......... .......... 97% 430M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 90850K .......... .......... .......... .......... .......... 97% 449M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 90900K .......... .......... .......... .......... .......... 97% 318M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 90950K .......... .......... .......... .......... .......... 97% 208M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91000K .......... .......... .......... .......... .......... 98% 421M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91050K .......... .......... .......... .......... .......... 98% 435M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91100K .......... .......... .......... .......... .......... 98% 49.1M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91150K .......... .......... .......... .......... .......... 98% 29.8M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91200K .......... .......... .......... .......... .......... 98% 314M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91250K .......... .......... .......... .......... .......... 98% 434M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91300K .......... .......... .......... .......... .......... 98% 71.2M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91350K .......... .......... .......... .......... .......... 98% 13.9M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91400K .......... .......... .......... .......... .......... 98% 376M 0s 2024-09-12T00:55:12.880 INFO:teuthology.orchestra.run.smithi083.stderr: 91450K .......... .......... .......... .......... .......... 98% 13.7M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91500K .......... .......... .......... .......... .......... 98% 30.8M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91550K .......... .......... .......... .......... .......... 98% 390M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91600K .......... .......... .......... .......... .......... 98% 14.7M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91650K .......... .......... .......... .......... .......... 98% 361M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91700K .......... .......... .......... .......... .......... 98% 42.0M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91750K .......... .......... .......... .......... .......... 98% 376M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91800K .......... .......... .......... .......... .......... 98% 24.1M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91850K .......... .......... .......... .......... .......... 98% 16.0M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91900K .......... .......... .......... .......... .......... 98% 160M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 91950K .......... .......... .......... .......... .......... 99% 229M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 92000K .......... .......... .......... .......... .......... 99% 20.6M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 92050K .......... .......... .......... .......... .......... 99% 326M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 92100K .......... .......... .......... .......... .......... 99% 347M 0s 2024-09-12T00:55:12.881 INFO:teuthology.orchestra.run.smithi083.stderr: 92150K .......... .......... .......... .......... .......... 99% 12.6M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92200K .......... .......... .......... .......... .......... 99% 36.3M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92250K .......... .......... .......... .......... .......... 99% 224M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92300K .......... .......... .......... .......... .......... 99% 352M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92350K .......... .......... .......... .......... .......... 99% 82.2M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92400K .......... .......... .......... .......... .......... 99% 262M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92450K .......... .......... .......... .......... .......... 99% 90.8M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92500K .......... .......... .......... .......... .......... 99% 99.9M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92550K .......... .......... .......... .......... .......... 99% 272M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92600K .......... .......... .......... .......... .......... 99% 156M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92650K .......... .......... .......... .......... .......... 99% 40.5M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92700K .......... .......... .......... .......... .......... 99% 355M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92750K .......... .......... .......... .......... .......... 99% 278M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92800K .......... .......... .......... .......... .......... 99% 408M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92850K .......... .......... .......... .......... .......... 99% 459M 0s 2024-09-12T00:55:12.882 INFO:teuthology.orchestra.run.smithi083.stderr: 92900K 100% 134G=0.5s 2024-09-12T00:55:12.883 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T00:55:12.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12 00:55:11 (193 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T00:55:12.883 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:55:12.916 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:55:12.917 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:55:12.918 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:55:12.919 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:55:12.920 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:55:12.921 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:55:12.922 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:55:12.923 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:55:12.924 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:55:12.925 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:55:12.926 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:55:12.927 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:55:12.928 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:55:12.929 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:55:12.930 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:55:12.931 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:12.932 INFO:teuthology.orchestra.run.smithi083.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout:Here are the highlights of this release: 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - Advanced control of transitive versions 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - Support for optional features and dependencies 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - Rules to tweak published metadata 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - Support for Java 13 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - New Zinc compiler for Scala 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - VS2019 support 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:55:12.933 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:------------------------------------------------------------ 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:Gradle 6.0.1 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:------------------------------------------------------------ 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:Kotlin: 1.3.50 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:Groovy: 2.5.8 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T00:55:12.934 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:12.935 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:55:12.935 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:55:12.935 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T00:55:12.935 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:55:12.935 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T00:55:12.935 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:55:13.212 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:55:13.213 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:55:13.213 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'KTOXETYCNZSTGHETGNAA', 'access_secret': 'Wo97c0kEJyGGuo6gSSqU92m5mrUoV1oqws+zlwYlofOkY2l9hVHJGA==', 'region': 'mexico', 'endpoint': 'smithi083.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi083.front.sepia.ceph.com'} 2024-09-12T00:55:13.213 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:55:13.213 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'KTOXETYCNZSTGHETGNAA', '--secret', 'Wo97c0kEJyGGuo6gSSqU92m5mrUoV1oqws+zlwYlofOkY2l9hVHJGA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:55:13.213 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key KTOXETYCNZSTGHETGNAA --secret Wo97c0kEJyGGuo6gSSqU92m5mrUoV1oqws+zlwYlofOkY2l9hVHJGA== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:55:13.278 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:13.278 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:13.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.312+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.314+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.314+0000 7f32a3136800 20 realm 2024-09-12T00:55:13.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.314+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.315+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.315+0000 7f32a3136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:13.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.315+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.315+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.315+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.316+0000 7f32a3136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:13.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.316+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.316+0000 7f32a3136800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:13.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.316+0000 7f32a3136800 20 searching for the correct realm 2024-09-12T00:55:13.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.320+0000 7f329e6b6640 0 -- 172.21.15.83:0/554061182 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f329400b040 msgr2=0x7f329409da60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:13.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.323+0000 7f329eeb7640 0 -- 172.21.15.83:0/554061182 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f32980691f0 msgr2=0x7f3298063b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:13.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:55:13.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:13.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:55:13.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:13.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:13.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:13.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:13.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.327+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:13.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 zone default found 2024-09-12T00:55:13.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 4 Realm: () 2024-09-12T00:55:13.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:55:13.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:55:13.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:13.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 zonegroup default 2024-09-12T00:55:13.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 started sync module instance, tier type = 2024-09-12T00:55:13.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.328+0000 7f32a3136800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:55:13.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.338+0000 7f32a3136800 20 add_watcher() i=0 2024-09-12T00:55:13.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.338+0000 7f32a3136800 20 add_watcher() i=1 2024-09-12T00:55:13.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.338+0000 7f32a3136800 20 add_watcher() i=2 2024-09-12T00:55:13.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.338+0000 7f32a3136800 20 add_watcher() i=3 2024-09-12T00:55:13.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.338+0000 7f32a3136800 20 add_watcher() i=4 2024-09-12T00:55:13.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.338+0000 7f32a3136800 20 add_watcher() i=5 2024-09-12T00:55:13.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.338+0000 7f32a3136800 20 add_watcher() i=6 2024-09-12T00:55:13.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.339+0000 7f32a3136800 20 add_watcher() i=7 2024-09-12T00:55:13.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.339+0000 7f32a3136800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:13.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.342+0000 7f31557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:13.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.342+0000 7f32a3136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:13.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.342+0000 7f32a3136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:13.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.342+0000 7f32a3136800 5 note: GC not initialized 2024-09-12T00:55:13.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.342+0000 7f30cffff640 20 reqs_thread_entry: start 2024-09-12T00:55:13.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.342+0000 7f32a3136800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.342+0000 7f32a3136800 20 Filter name: none 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.342+0000 7f30cdffb640 20 reqs_thread_entry: start 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:55:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:55:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 cache get: name=default.rgw.meta+users.keys+KTOXETYCNZSTGHETGNAA : miss 2024-09-12T00:55:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 cache put: name=default.rgw.meta+users.keys+KTOXETYCNZSTGHETGNAA info.flags=0x0 2024-09-12T00:55:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 adding default.rgw.meta+users.keys+KTOXETYCNZSTGHETGNAA to cache LRU end 2024-09-12T00:55:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 cache get: name=default.rgw.meta+users.keys+KTOXETYCNZSTGHETGNAA : hit (negative entry) 2024-09-12T00:55:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.343+0000 7f32a3136800 10 cache get: name=default.rgw.meta+users.keys+KTOXETYCNZSTGHETGNAA : hit (negative entry) 2024-09-12T00:55:13.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.345+0000 7f32a3136800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:55:13.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.345+0000 7f32a3136800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:55:13.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.345+0000 7f32a3136800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:55:13.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.345+0000 7f31827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464389 cookie 94425629927264 notifier 8258 bl.length()=670 2024-09-12T00:55:13.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.345+0000 7f31827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:55:13.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.345+0000 7f31827fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:55:13.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.347+0000 7f32a3136800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:55:13.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.347+0000 7f32a3136800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:55:13.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.347+0000 7f32a3136800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:55:13.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.347+0000 7f31827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94425629916496 notifier 8258 bl.length()=200 2024-09-12T00:55:13.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.347+0000 7f31827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:55:13.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.347+0000 7f31827fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:55:13.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.349+0000 7f32a3136800 10 cache put: name=default.rgw.meta+users.keys+KTOXETYCNZSTGHETGNAA info.flags=0x7 2024-09-12T00:55:13.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.349+0000 7f32a3136800 10 moving default.rgw.meta+users.keys+KTOXETYCNZSTGHETGNAA to cache LRU end 2024-09-12T00:55:13.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.349+0000 7f32a3136800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:KTOXETYCNZSTGHETGNAA, ofs0, ns] 2024-09-12T00:55:13.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.349+0000 7f31827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464437 cookie 94425629915248 notifier 8258 bl.length()=189 2024-09-12T00:55:13.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.349+0000 7f31827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KTOXETYCNZSTGHETGNAA info.flags=0x7 2024-09-12T00:55:13.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.349+0000 7f31827fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KTOXETYCNZSTGHETGNAA to cache LRU end 2024-09-12T00:55:13.349 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "tester.client.0", 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "tester.client.0", 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "KTOXETYCNZSTGHETGNAA", 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "Wo97c0kEJyGGuo6gSSqU92m5mrUoV1oqws+zlwYlofOkY2l9hVHJGA==", 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:55:13.345675Z" 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:55:13.350 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:55:13.351 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:55:13.345659Z", 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:55:13.352 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:13.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.350+0000 7f31557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:13.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.353+0000 7f32a3136800 20 remove_watcher() i=0 2024-09-12T00:55:13.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.353+0000 7f32a3136800 2 removed watcher, disabling cache 2024-09-12T00:55:13.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.354+0000 7f32a3136800 20 remove_watcher() i=1 2024-09-12T00:55:13.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.355+0000 7f32a3136800 20 remove_watcher() i=2 2024-09-12T00:55:13.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.356+0000 7f32a3136800 20 remove_watcher() i=3 2024-09-12T00:55:13.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.357+0000 7f32a3136800 20 remove_watcher() i=4 2024-09-12T00:55:13.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.357+0000 7f32a3136800 20 remove_watcher() i=5 2024-09-12T00:55:13.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.359+0000 7f32a3136800 20 remove_watcher() i=6 2024-09-12T00:55:13.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.360+0000 7f32a3136800 20 remove_watcher() i=7 2024-09-12T00:55:13.370 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:55:13.371 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:55:13.401 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:55:13.401 DEBUG:teuthology.orchestra.run.smithi083:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:55:13.470 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:55:13.562 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:13.562 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:13.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.599+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.601+0000 7f7c0a73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.601+0000 7f7c0a73e800 20 realm 2024-09-12T00:55:13.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.601+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.601+0000 7f7c0a73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.601+0000 7f7c0a73e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:13.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.601+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.601+0000 7f7c0a73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.601+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.602+0000 7f7c0a73e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:13.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.602+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.603+0000 7f7c0a73e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:13.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.603+0000 7f7c0a73e800 20 searching for the correct realm 2024-09-12T00:55:13.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.606+0000 7f7c05cbf640 0 -- 172.21.15.83:0/1885497818 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f7bf003abc0 msgr2=0x7f7bf0019920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:13.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.610+0000 7f7c05cbf640 0 -- 172.21.15.83:0/1885497818 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x56464ab40940 msgr2=0x56464ab42e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.614+0000 7f7c0a73e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.614+0000 7f7c0a73e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.614+0000 7f7c0a73e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.614+0000 7f7c0a73e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.614+0000 7f7c0a73e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.614+0000 7f7c0a73e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.614+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.614+0000 7f7c0a73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.614+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:13.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 20 zone default found 2024-09-12T00:55:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 4 Realm: () 2024-09-12T00:55:13.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:55:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:55:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 20 zonegroup default 2024-09-12T00:55:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.615+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.616+0000 7f7c0a73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.616+0000 7f7c0a73e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:13.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.616+0000 7f7c0a73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:13.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.616+0000 7f7c0a73e800 20 started sync module instance, tier type = 2024-09-12T00:55:13.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.616+0000 7f7c0a73e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:55:13.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.624+0000 7f7c0a73e800 20 add_watcher() i=0 2024-09-12T00:55:13.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.624+0000 7f7c0a73e800 20 add_watcher() i=1 2024-09-12T00:55:13.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.624+0000 7f7c0a73e800 20 add_watcher() i=2 2024-09-12T00:55:13.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.624+0000 7f7c0a73e800 20 add_watcher() i=3 2024-09-12T00:55:13.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.624+0000 7f7c0a73e800 20 add_watcher() i=4 2024-09-12T00:55:13.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.624+0000 7f7c0a73e800 20 add_watcher() i=5 2024-09-12T00:55:13.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.625+0000 7f7c0a73e800 20 add_watcher() i=6 2024-09-12T00:55:13.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.626+0000 7f7c0a73e800 20 add_watcher() i=7 2024-09-12T00:55:13.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.626+0000 7f7c0a73e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.628+0000 7f7abcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.628+0000 7f7c0a73e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.628+0000 7f7c0a73e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:13.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.663+0000 7f7a377fe640 20 reqs_thread_entry: start 2024-09-12T00:55:13.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.663+0000 7f7c0a73e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:13.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.663+0000 7f7c0a73e800 20 Filter name: none 2024-09-12T00:55:13.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.664+0000 7f7a357fa640 20 reqs_thread_entry: start 2024-09-12T00:55:13.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.664+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:55:13.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.665+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.665+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:55:13.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_sVl0s79uTCBcX8qiq291heqfd2rqMdi', time=2024-09-12T02:46:28.251361+0000, chain.objs.size()=1 2024-09-12T00:55:13.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.brkxwjATlQcSRpUcw5nxVwFAiRmyjlu_0 2024-09-12T00:55:13.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14209002594803722211', time=2024-09-12T02:48:27.168753+0000, chain.objs.size()=1 2024-09-12T00:55:13.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.bhW1gDlLi1DMepInM-NV4x6WwPOdU4d_0 2024-09-12T00:55:13.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4238028256116608726', time=2024-09-12T02:48:28.215350+0000, chain.objs.size()=1 2024-09-12T00:55:13.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.mXIPbMk10dYtqKiypcj2Ks6j9zxiPK__0 2024-09-12T00:55:13.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3350707027868133986', time=2024-09-12T02:49:01.120315+0000, chain.objs.size()=1 2024-09-12T00:55:13.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.tXBTlvSl9-2f7piXDd2XQhujABNT7EA_0 2024-09-12T00:55:13.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3454493779132566236', time=2024-09-12T02:49:38.225208+0000, chain.objs.size()=1 2024-09-12T00:55:13.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.z3QgQy455RKky56MTw6zr9EF4cFhdDn_0 2024-09-12T00:55:13.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16420103335455191645', time=2024-09-12T02:49:38.229727+0000, chain.objs.size()=1 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.yS5pzmwuW8x5B_ysZgV_k8nmvKohaFg_0 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6373579572194340860', time=2024-09-12T02:49:38.230373+0000, chain.objs.size()=1 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_._ZlSsfbWAOWyFWrDrqvoSSXQxcLFMsX_0 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11837704137927365249', time=2024-09-12T02:49:38.233007+0000, chain.objs.size()=1 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.xmXnoFKbZpJrRUAqYEx0aNcNaH26LLH_0 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12812965219819023560', time=2024-09-12T02:50:15.149190+0000, chain.objs.size()=1 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_._KMijP7L4QTQYMpZL_6nVgYKRoklzAB_0 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15748085649286649029', time=2024-09-12T02:50:47.154079+0000, chain.objs.size()=1 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.sNk1Gce3EXIO1H06YJGq_RcSigwoHSy_0 2024-09-12T00:55:13.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9144646987396095720', time=2024-09-12T02:50:48.715913+0000, chain.objs.size()=1 2024-09-12T00:55:13.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.vD_CYktJLgLkucchpU49S8ipFtP-3Zt_0 2024-09-12T00:55:13.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11687107013605742749', time=2024-09-12T02:51:20.997714+0000, chain.objs.size()=1 2024-09-12T00:55:13.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.666+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.wWbJmn-rcu4Hb9A6o_9SE9BjGo_ECjS_0 2024-09-12T00:55:13.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.668+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11382157596277653052', time=2024-09-12T02:51:54.637776+0000, chain.objs.size()=1 2024-09-12T00:55:13.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.668+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.Zv7hpiq4kPiUDeL83wQB6iAEoame_Pk_0 2024-09-12T00:55:13.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.669+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11183139050501417031', time=2024-09-12T02:52:29.113891+0000, chain.objs.size()=1 2024-09-12T00:55:13.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.669+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.l6-xo2MUADUt3I3W3EEMmit57HEoXJi_0 2024-09-12T00:55:13.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.672+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13621414535347687195', time=2024-09-12T02:54:43.054626+0000, chain.objs.size()=1 2024-09-12T00:55:13.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.672+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.19__shadow:gRA5vY3.IfB3aEJOuDQUUzdvEDHQwaf_.qczWcKmxHv2jVUT1nzIDuz2eN1NJ5uz_0 2024-09-12T00:55:13.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.674+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.676+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:55:13.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.678+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.678+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:55:13.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_dQO7R3gZAvtgzuCqh0j9RTZYNaV1x49', time=2024-09-12T02:46:28.155741+0000, chain.objs.size()=2 2024-09-12T00:55:13.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.KHeHYalt5Ex4giWQqBNHsCV0TKSHnJx_0 2024-09-12T00:55:13.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.KHeHYalt5Ex4giWQqBNHsCV0TKSHnJx_1 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18116676333579152495', time=2024-09-12T02:46:28.351886+0000, chain.objs.size()=1 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.8__shadow_.64LxyjhDrxrrBj8zuSVT8_y7W1HvnDr_0 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1154238857084208980', time=2024-09-12T02:47:52.139415+0000, chain.objs.size()=1 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.fy3sSF2lPgZDzz1zkQYREO2x6NMRjEl_0 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12743065186032321325', time=2024-09-12T02:48:27.174971+0000, chain.objs.size()=1 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.1kGUp53ALq3xUG_qCG5zWMvXoSQZKGe_0 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16868171060746829970', time=2024-09-12T02:48:27.181220+0000, chain.objs.size()=1 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.VrVwqIxFN0tkP8KXcq0eR2P-8bJ6U6q_0 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5866461623212829469', time=2024-09-12T02:48:27.183224+0000, chain.objs.size()=1 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.IiaKinmplJobnhFQZ4skH-rWIFZOSAN_0 2024-09-12T00:55:13.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5300963200097824770', time=2024-09-12T02:49:02.775586+0000, chain.objs.size()=1 2024-09-12T00:55:13.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.uGs9zhl0kaDXaaCFL6rvkFrWxash0sF_0 2024-09-12T00:55:13.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12092231174483635597', time=2024-09-12T02:49:03.998747+0000, chain.objs.size()=1 2024-09-12T00:55:13.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.rKE1L2jcqR2_ly_Ym9CF33I3bHnaOi-_0 2024-09-12T00:55:13.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10263626996620549477', time=2024-09-12T02:49:35.876462+0000, chain.objs.size()=1 2024-09-12T00:55:13.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.rFLy4b4ahFEUAlVcY2VG_JpkBnh66nC_0 2024-09-12T00:55:13.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11733883799755848079', time=2024-09-12T02:50:13.709283+0000, chain.objs.size()=1 2024-09-12T00:55:13.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.eaPe1qMynX4bz8Dq0odDq8uEvWnfgjE_0 2024-09-12T00:55:13.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16093484431659732882', time=2024-09-12T02:50:15.151652+0000, chain.objs.size()=1 2024-09-12T00:55:13.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.679+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.ykIDOfID7R2UKSH9ujWT01cJfBWucJG_0 2024-09-12T00:55:13.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.682+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10935535658486060577', time=2024-09-12T02:51:22.948329+0000, chain.objs.size()=1 2024-09-12T00:55:13.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.682+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.hBdHJey0mMaLrBI3WGirlZRx2oIbVzM_0 2024-09-12T00:55:13.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.682+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6309675299542771673', time=2024-09-12T02:51:56.596231+0000, chain.objs.size()=1 2024-09-12T00:55:13.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.682+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.twKj2QKW1IX1lez4iA-0vweOeJq4yvc_0 2024-09-12T00:55:13.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.682+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18368724585524872738', time=2024-09-12T02:52:29.117711+0000, chain.objs.size()=1 2024-09-12T00:55:13.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.682+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.207QSOlnMELn2d3r2TyKqhVVR0o_LL7_0 2024-09-12T00:55:13.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.686+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.688+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:55:13.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.690+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:55:13.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_rvah2xjnxB6Q5xBt0EGG_9OFRvdp1ws', time=2024-09-12T02:46:28.247340+0000, chain.objs.size()=1 2024-09-12T00:55:13.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.14BVmJVmJbIZgTc6g639d8n-4rdwoCV_0 2024-09-12T00:55:13.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10080686715869384255', time=2024-09-12T02:47:52.143300+0000, chain.objs.size()=1 2024-09-12T00:55:13.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.u5755CINqEy1MGpgBmYeIZkr52N1RRa_0 2024-09-12T00:55:13.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13667513301917218682', time=2024-09-12T02:47:53.379402+0000, chain.objs.size()=1 2024-09-12T00:55:13.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.vWFBTwwGzIhWkHGVzqdeUX9w-kd4nnY_0 2024-09-12T00:55:13.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16217560049940201474', time=2024-09-12T02:48:25.056621+0000, chain.objs.size()=1 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.DX3Zvyy6k2FEG1BA3k-XqIMTtIZ4Jyk_0 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16968542755858178657', time=2024-09-12T02:48:28.225597+0000, chain.objs.size()=1 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.h0hsBQIJ1FJ_djyJqBOBhglbGjo-zbL_0 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1900662563422711812', time=2024-09-12T02:49:02.768240+0000, chain.objs.size()=1 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.edCAfZ3TYF5WgQk4puHo9mqpbWErGiQ_0 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2900169668465375789', time=2024-09-12T02:49:03.980541+0000, chain.objs.size()=1 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.G2IliLpGcjJGRGRrWRWS5aY7prXtNlV_0 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9144172009688368927', time=2024-09-12T02:49:35.883129+0000, chain.objs.size()=1 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.VPrH2PaTJyUdq2ThOQwk1thy30qsUe1_0 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12723651341698415234', time=2024-09-12T02:49:39.651493+0000, chain.objs.size()=1 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.orp5qmducoIsRM7jU4RzI3tkAFGgroB_0 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.635294294539751428', time=2024-09-12T02:50:11.152503+0000, chain.objs.size()=1 2024-09-12T00:55:13.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.MTyWwo9WAwhBij7d5LYhmz71FgoEBMN_0 2024-09-12T00:55:13.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1606202622795441508', time=2024-09-12T02:51:21.000559+0000, chain.objs.size()=1 2024-09-12T00:55:13.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.A_7f8rQmc6sjt6LKjLKWmki4Hx_7Lxx_0 2024-09-12T00:55:13.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14514939855897757773', time=2024-09-12T02:51:21.006785+0000, chain.objs.size()=1 2024-09-12T00:55:13.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.691+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.2E8hvjdR1RNw-OKb_zC_azrpi9JA2Jz_0 2024-09-12T00:55:13.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.693+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15292427225010835985', time=2024-09-12T02:51:56.604435+0000, chain.objs.size()=1 2024-09-12T00:55:13.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.693+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.MCATyodMt-OSIQM2hFE4so1WliNE8_V_0 2024-09-12T00:55:13.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.694+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4827399559146423977', time=2024-09-12T02:54:35.441689+0000, chain.objs.size()=1 2024-09-12T00:55:13.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.694+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.-TTEjeOoShEG59KKzRuWglJUae76rZT_0 2024-09-12T00:55:13.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.697+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.699+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:55:13.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15708125343109868793', time=2024-09-12T02:47:52.138885+0000, chain.objs.size()=1 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.ve6nX1R9UfI0CXxGOaYom3up-X317ZL_0 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16510597535659830967', time=2024-09-12T02:47:53.376117+0000, chain.objs.size()=1 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.ZkaThGiCBcjtt56acGFxIhdIlTrgzt7_0 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13518694975843438707', time=2024-09-12T02:47:53.379133+0000, chain.objs.size()=1 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.IY8_OeOmbaKjrOtfMPe5uzktuwdazmJ_0 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11320279355011095274', time=2024-09-12T02:48:25.256858+0000, chain.objs.size()=1 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.H4hj6L1YQXNwUbBd6ONkPqTTRqnAphI_0 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2792322264429125527', time=2024-09-12T02:49:35.878385+0000, chain.objs.size()=1 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.701+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.dtD-xeJLnSsIAE6Jm5jKbLYB28fMePe_0 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6318731951056262718', time=2024-09-12T02:49:38.233401+0000, chain.objs.size()=1 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.ekssZ2VjOx5dT5LksiJzr9ImroSW-uj_0 2024-09-12T00:55:13.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6120781260617833630', time=2024-09-12T02:49:38.245822+0000, chain.objs.size()=1 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.3a6yTdDxrn-bP6VjHVvxv2jPcHYCRZC_0 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11377901329837071723', time=2024-09-12T02:50:13.713350+0000, chain.objs.size()=1 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.vFxKR5NAjlSioLLUicWwsC2Eyec_y1i_0 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1272277329748314761', time=2024-09-12T02:50:13.715274+0000, chain.objs.size()=1 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.HjqMd2yt46F9MfuSxPdCgQ1P5kQqRhN_0 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1947525610371013246', time=2024-09-12T02:50:13.718156+0000, chain.objs.size()=1 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.5Hq94r-ghFeaMMQ-ZtPQ5rlgXEQdGZu_0 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3145570175990898119', time=2024-09-12T02:50:15.149652+0000, chain.objs.size()=1 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.IPlRzQTNjZ1qEHbzoiTGHWm_4mYNF8N_0 2024-09-12T00:55:13.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.683408385057018860', time=2024-09-12T02:50:47.154211+0000, chain.objs.size()=1 2024-09-12T00:55:13.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.702+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.IHTmMgyIYtLXSleuqco9HOYpHoB3c5U_0 2024-09-12T00:55:13.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4589820712131279256', time=2024-09-12T02:50:47.157607+0000, chain.objs.size()=1 2024-09-12T00:55:13.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.Zjs1GUgHrCUCXg0bHKV2iATusgSjzPa_0 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3253715410422490398', time=2024-09-12T02:50:48.723340+0000, chain.objs.size()=1 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.sT-MHvX20bbF2Rtm7UM0bvFRiXIiulq_0 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3471478918566502988', time=2024-09-12T02:50:48.726183+0000, chain.objs.size()=1 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.O2pSosJxxDPocl04dOdjva3gX8aKHVO_0 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8323210838972145043', time=2024-09-12T02:51:21.000293+0000, chain.objs.size()=1 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.J1BaFiYR2KMz0yieIsCIyNTFiwyjmhf_0 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10829823076060270251', time=2024-09-12T02:51:22.953485+0000, chain.objs.size()=1 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.705+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.eEU4onGmlYqmKMABpciqZaNT71yVeSz_0 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.706+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7023768397296878662', time=2024-09-12T02:51:54.632265+0000, chain.objs.size()=1 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.706+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.X-A8fUR2dMPVbtuU6lYdKHwK-54lpf1_0 2024-09-12T00:55:13.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.706+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.876738910808071251', time=2024-09-12T02:51:57.431026+0000, chain.objs.size()=1 2024-09-12T00:55:13.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.706+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.8s3q3gezFGv0veTYuwliee63DPJSEPM_0 2024-09-12T00:55:13.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.706+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6024075683790061895', time=2024-09-12T02:52:29.115280+0000, chain.objs.size()=1 2024-09-12T00:55:13.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.706+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.XKNH4PmU2AdORZa1zzaDG_yNHHVipTL_0 2024-09-12T00:55:13.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.711+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.713+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:55:13.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.714+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:55:13.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11399748414591887083', time=2024-09-12T02:46:28.040433+0000, chain.objs.size()=1 2024-09-12T00:55:13.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.ioD68x0LtQRhVBAHg34Dc-JvtjExdrL_0 2024-09-12T00:55:13.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11313149625589192429', time=2024-09-12T02:47:52.137222+0000, chain.objs.size()=1 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.qYycuGR3dWW3n1ekfKvch3wT-rovC2f_0 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14870370877765193265', time=2024-09-12T02:47:52.148460+0000, chain.objs.size()=1 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.M2hklHcv1pUGjyFXDOaoXpHjnohODLK_0 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13059212241958162566', time=2024-09-12T02:48:25.051940+0000, chain.objs.size()=1 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.4Qc64zMMPPlFwM44SoctHlgTR0osSyj_0 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7758387819782128821', time=2024-09-12T02:49:35.879305+0000, chain.objs.size()=1 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.gsdWlJ4irPbyt0T6_3RfktUk3oMzjr1_0 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16885320423835425344', time=2024-09-12T02:50:48.721147+0000, chain.objs.size()=1 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.o6qQ-I6nYg0kbUWFfz0Z6eB-6YPr7a0_0 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12125738718543864861', time=2024-09-12T02:51:56.599139+0000, chain.objs.size()=1 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.Emi6ObZQqfEPH2JLBaFSp5iT1QgWFhm_0 2024-09-12T00:55:13.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4121833726126570419', time=2024-09-12T02:54:35.438429+0000, chain.objs.size()=1 2024-09-12T00:55:13.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.9GrtXalr-1UgdI-mZ9Y2l9Cmjx8__kx_0 2024-09-12T00:55:13.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9642557042849695830', time=2024-09-12T02:54:35.440549+0000, chain.objs.size()=1 2024-09-12T00:55:13.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.715+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.GorBAAzssnF5-511RVkFu93XFkHjHD3_0 2024-09-12T00:55:13.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.719+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.721+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:55:13.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.723+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.723+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17745138053283030251', time=2024-09-12T02:46:28.035671+0000, chain.objs.size()=1 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.hz53NFigERm_GLP9NNOoND0u6kNulKY_0 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7779540561805460697', time=2024-09-12T02:46:28.075864+0000, chain.objs.size()=4 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.12__multipart_foo.2~tbmP6EMUwBVwbsgZNpXZonM0bqwT-S6.1 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.12__multipart_foo.2~tbmP6EMUwBVwbsgZNpXZonM0bqwT-S6.2 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.12__multipart_foo.2~tbmP6EMUwBVwbsgZNpXZonM0bqwT-S6.3 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.12__multipart_foo.2~tbmP6EMUwBVwbsgZNpXZonM0bqwT-S6.4 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_t7X0NxWL0-bvbm7HqkIWTFmtEvvnuFi', time=2024-09-12T02:46:28.185124+0000, chain.objs.size()=1 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.w5YuhtnJ5hpL71RMewI1a3sqwFqsCla_0 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5265732624081516485', time=2024-09-12T02:46:28.370778+0000, chain.objs.size()=1 2024-09-12T00:55:13.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.9__shadow_.ve2SBGfjCWSfAEK8DaijUegnLNzWSXr_0 2024-09-12T00:55:13.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1312813771641677161', time=2024-09-12T02:47:53.371225+0000, chain.objs.size()=1 2024-09-12T00:55:13.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.MM0tX6yuejLij55Jl8Hg2yvXOUexaD5_0 2024-09-12T00:55:13.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14913838447322024331', time=2024-09-12T02:48:27.178188+0000, chain.objs.size()=1 2024-09-12T00:55:13.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.EVYNP9rgecBaG_WLmDxyOdtsHIBqoQA_0 2024-09-12T00:55:13.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2340643338882994819', time=2024-09-12T02:49:01.116043+0000, chain.objs.size()=1 2024-09-12T00:55:13.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.yhvMyMh4i37_-RbYNKg8PyVXGNVFbJZ_0 2024-09-12T00:55:13.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2894850187435449654', time=2024-09-12T02:49:01.119231+0000, chain.objs.size()=1 2024-09-12T00:55:13.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.aUOrA9E6q4X--l4IMhyoudgNEl8QrzL_0 2024-09-12T00:55:13.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.455449420941725272', time=2024-09-12T02:49:02.764745+0000, chain.objs.size()=1 2024-09-12T00:55:13.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.724+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.NLqG7nR_Oi5pXnuTrizmhTuTOxZiHc1_0 2024-09-12T00:55:13.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.728+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1723542365384621520', time=2024-09-12T02:50:11.148359+0000, chain.objs.size()=1 2024-09-12T00:55:13.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.728+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.BV5RWMCdDnykqVd6FhIFORLiheDym6u_0 2024-09-12T00:55:13.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.728+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17190328474368400106', time=2024-09-12T02:50:11.152299+0000, chain.objs.size()=1 2024-09-12T00:55:13.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.728+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.uMrJgHhVo0pkjmu6Q7f0JN5EsRi0zjA_0 2024-09-12T00:55:13.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1274883443955724142', time=2024-09-12T02:50:47.136974+0000, chain.objs.size()=1 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.BIfQCAFz8kF1gdByjpsvO4P3KSLfOUY_0 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12134660236443850428', time=2024-09-12T02:50:47.156533+0000, chain.objs.size()=1 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.G4krvFsl52tC5M1hY3rnOCFka3aNiKo_0 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2541305519228544739', time=2024-09-12T02:51:20.997749+0000, chain.objs.size()=1 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.krbqwO_Eav1aJ1VAdGpvfDHWUzR3QdA_0 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1930580092320434344', time=2024-09-12T02:51:54.634088+0000, chain.objs.size()=1 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.rXlktH9EOo28fMRzTfM8SMop1wOb4dK_0 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1875127466617201165', time=2024-09-12T02:51:57.442874+0000, chain.objs.size()=1 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.rRz9M-Ldk6OOUG3k5Jl-0cXWBvCMp5G_0 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14472204614060456467', time=2024-09-12T02:52:29.124346+0000, chain.objs.size()=1 2024-09-12T00:55:13.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.730+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.6-CN3envpi8fMiuB7Hii-Q9cveXmglN_0 2024-09-12T00:55:13.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.735+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.737+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:55:13.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.738+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:55:13.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10399794923662544361', time=2024-09-12T02:46:28.026742+0000, chain.objs.size()=1 2024-09-12T00:55:13.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.lLZv4QrjQd48cu6zRbCzD6MMNVqepCf_0 2024-09-12T00:55:13.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_SVtne8XA56qrssd_dmnqhP-PO2PEQWc', time=2024-09-12T02:46:28.175667+0000, chain.objs.size()=2 2024-09-12T00:55:13.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.cYB1QapYKZjETBXz1VPKaqR8Y9TFSpx_0 2024-09-12T00:55:13.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.cYB1QapYKZjETBXz1VPKaqR8Y9TFSpx_1 2024-09-12T00:55:13.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4038075457448231455', time=2024-09-12T02:46:28.210923+0000, chain.objs.size()=5 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.1 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.1_1 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.2 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.2_1 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.3 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4550461025323712225', time=2024-09-12T02:46:28.255357+0000, chain.objs.size()=3 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.1 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.2 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.3 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16736400965522795434', time=2024-09-12T02:46:28.347970+0000, chain.objs.size()=1 2024-09-12T00:55:13.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.739+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.8__shadow_.Vmye5YvBmTZ0JFaTCHYLEw9oZ0TKlW__0 2024-09-12T00:55:13.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18335062341974493907', time=2024-09-12T02:48:28.214431+0000, chain.objs.size()=1 2024-09-12T00:55:13.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.Hau-Dq9bwMT6WL5KtMSU8K2Ai1OXUcG_0 2024-09-12T00:55:13.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18205185221154886547', time=2024-09-12T02:50:11.148714+0000, chain.objs.size()=1 2024-09-12T00:55:13.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.jjTGxmEwMxGXNxOsoALwIxCRLfA0zAN_0 2024-09-12T00:55:13.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16782256783218561772', time=2024-09-12T02:50:47.139707+0000, chain.objs.size()=1 2024-09-12T00:55:13.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.JroIMaYfozDRH4N0stllHpf07I3u5A4_0 2024-09-12T00:55:13.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11994612239943130302', time=2024-09-12T02:50:47.149051+0000, chain.objs.size()=1 2024-09-12T00:55:13.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.HuC3QCKFk6m_mDkZFaFlpBzezmV7iCJ_0 2024-09-12T00:55:13.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11271747517673173499', time=2024-09-12T02:50:48.723377+0000, chain.objs.size()=1 2024-09-12T00:55:13.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.y3iTceGwswlsnPgOcGqvtqdCRyNde-Q_0 2024-09-12T00:55:13.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6667255563486192190', time=2024-09-12T02:51:57.424222+0000, chain.objs.size()=1 2024-09-12T00:55:13.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.iDPDY-rcNkbU4GxPB8HdrQ4hZ14nDb3_0 2024-09-12T00:55:13.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14546233548183356248', time=2024-09-12T02:51:57.440458+0000, chain.objs.size()=1 2024-09-12T00:55:13.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.742+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.fpmrkn0-Wk-lu8Bg5xqrxK37X82m0Tf_0 2024-09-12T00:55:13.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.747+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.749+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:55:13.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:55:13.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14512245273261686604', time=2024-09-12T02:48:25.064133+0000, chain.objs.size()=1 2024-09-12T00:55:13.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.byd9LmYrL5cM_A_p-DJ02UBBTqM6uON_0 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3091450561801438301', time=2024-09-12T02:48:28.214486+0000, chain.objs.size()=1 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.WkBA6iV0L4zp8kvO6NM3EiFTojTIWhJ_0 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11349552365335310763', time=2024-09-12T02:49:01.113639+0000, chain.objs.size()=1 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.GrfBpAcKP-mvvmAp_4sNjPhCiyuUIoF_0 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17673181794254947427', time=2024-09-12T02:49:02.771989+0000, chain.objs.size()=1 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.TfJ0SkuNsi2-sXf33kuRR7oFBNhCQnI_0 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.751+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11124673851032517902', time=2024-09-12T02:50:13.721304+0000, chain.objs.size()=1 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.752+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.UiXlJBZg8e66jd7qfAhHviJ1HwkCYs6_0 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.752+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5069094069304957145', time=2024-09-12T02:51:22.949923+0000, chain.objs.size()=1 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.752+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.j8ZGM2WPQhhdbze0A2P66_jmKBrMXYs_0 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.752+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5475849286842010671', time=2024-09-12T02:51:54.632032+0000, chain.objs.size()=1 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.752+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.kASv4XSghRQD5joJxTfDIwrDDcD61Tj_0 2024-09-12T00:55:13.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.752+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11614078056626331477', time=2024-09-12T02:51:56.077882+0000, chain.objs.size()=1 2024-09-12T00:55:13.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.752+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.BYvdY4IjVxKwFNcCiYxqyWiRRk0ZJET_0 2024-09-12T00:55:13.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.755+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.757+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:55:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.759+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.759+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2649774012608343008', time=2024-09-12T02:46:28.151883+0000, chain.objs.size()=2 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.0XMrGLJIreGrReSSSMu3P07fFpLScJy_0 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.0XMrGLJIreGrReSSSMu3P07fFpLScJy_1 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10696682409539539384', time=2024-09-12T02:48:25.051866+0000, chain.objs.size()=1 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.ILgdNB6h3l_RljTwTsceQ-go6Ix95gu_0 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4094736990614059125', time=2024-09-12T02:48:25.064056+0000, chain.objs.size()=1 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.ovdkQ9ZxLO_b8BeB_-xat3WGgrC24vy_0 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13877203980045337624', time=2024-09-12T02:48:28.224850+0000, chain.objs.size()=1 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.5ld_kNgx4YTv-naTCCgbbBq56tQMi6r_0 2024-09-12T00:55:13.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6250797384846779580', time=2024-09-12T02:49:38.234519+0000, chain.objs.size()=1 2024-09-12T00:55:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.kekQmugEdIh3VR32XML3hKIZFV7akux_0 2024-09-12T00:55:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6151057497253756629', time=2024-09-12T02:50:13.719448+0000, chain.objs.size()=1 2024-09-12T00:55:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.nOIPEcf7s0mB3DCXDHVLN5p5U8iUZtH_0 2024-09-12T00:55:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6349402915455467547', time=2024-09-12T02:50:50.134761+0000, chain.objs.size()=1 2024-09-12T00:55:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.yotO7BnpSVql1TbZ2_GuQElJqZJxBZ3_0 2024-09-12T00:55:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4671149436236988565', time=2024-09-12T02:52:29.129591+0000, chain.objs.size()=1 2024-09-12T00:55:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.5jaJl9uU1pT4O1ilkKqIWgwge-LKBa1_0 2024-09-12T00:55:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6772401177874851015', time=2024-09-12T02:54:35.438809+0000, chain.objs.size()=1 2024-09-12T00:55:13.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.760+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.lVpuf_9F0ILiuQxPAqmh2cK3p2QI9ZN_0 2024-09-12T00:55:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.764+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.766+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:55:13.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.768+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.768+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:55:13.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13108915940228347323', time=2024-09-12T02:46:28.163745+0000, chain.objs.size()=2 2024-09-12T00:55:13.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.MG8nPlonksgcChJv_OYjBh4RwMnHcsi_0 2024-09-12T00:55:13.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.MG8nPlonksgcChJv_OYjBh4RwMnHcsi_1 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_lFLFjrCUD8atOFN1gcHIDhonmYlXFFZ', time=2024-09-12T02:46:28.239301+0000, chain.objs.size()=3 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.sm6n_sxmF2l1A78yNtIJY4xarlo_vMF_0 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.sm6n_sxmF2l1A78yNtIJY4xarlo_vMF_1 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.sm6n_sxmF2l1A78yNtIJY4xarlo_vMF_2 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5143483573048966950', time=2024-09-12T02:47:53.383989+0000, chain.objs.size()=1 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.L6h3SxWXyz_23w7R0SDk6lIZqqzF70g_0 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4156016147974210787', time=2024-09-12T02:48:25.045686+0000, chain.objs.size()=1 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.5QmRA16VBLYWQO7kuwmotj1JcECP9HC_0 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.566048277721043049', time=2024-09-12T02:48:28.205966+0000, chain.objs.size()=1 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.ca1bxUPQfCQrYiHg3jGdzNTkuZKcoAS_0 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.531042072552097816', time=2024-09-12T02:48:28.211071+0000, chain.objs.size()=1 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.QD2x72tlKYgCVygFtnxCug6eBkrI3Is_0 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11581754779608482176', time=2024-09-12T02:48:30.029723+0000, chain.objs.size()=1 2024-09-12T00:55:13.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.HyahCUDoLFTw_azEK4ZESmEOY9-d-78_0 2024-09-12T00:55:13.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4378629208213987722', time=2024-09-12T02:49:02.777656+0000, chain.objs.size()=1 2024-09-12T00:55:13.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.rpYTnrYpGcRoR8OtvENstQaJn1YD-Ic_0 2024-09-12T00:55:13.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3988252822012940940', time=2024-09-12T02:50:13.715360+0000, chain.objs.size()=1 2024-09-12T00:55:13.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.769+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.cXk0531gHQBpAzXb9VfGuRmfCwr516l_0 2024-09-12T00:55:13.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.771+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6375008733745896390', time=2024-09-12T02:50:15.154564+0000, chain.objs.size()=1 2024-09-12T00:55:13.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.771+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.eZkDaq_L-6wSYv_lIjPsWRYQsqA4fpp_0 2024-09-12T00:55:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.771+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10100764949598472192', time=2024-09-12T02:50:47.147957+0000, chain.objs.size()=1 2024-09-12T00:55:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.771+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.bqjCksDITkEIFdOfd1-7AdSA5oek4BD_0 2024-09-12T00:55:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.771+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4634972886271083362', time=2024-09-12T02:51:20.995154+0000, chain.objs.size()=1 2024-09-12T00:55:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.771+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.A5y-Uzpg1hF984TvCNfLNVdEw6dTMPw_0 2024-09-12T00:55:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.772+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15874695657406897255', time=2024-09-12T02:51:57.427369+0000, chain.objs.size()=1 2024-09-12T00:55:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.772+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.nW0U49on2IAxi0-5VnCOxB5aMdZAXG5_0 2024-09-12T00:55:13.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.774+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5518982874980873918', time=2024-09-12T02:52:29.124275+0000, chain.objs.size()=1 2024-09-12T00:55:13.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.774+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.kfXmiUn6aEaj_dVUaYtZf4MDD5NarIJ_0 2024-09-12T00:55:13.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.776+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.779+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:55:13.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.780+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.780+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17199939327028829567', time=2024-09-12T02:46:28.343977+0000, chain.objs.size()=1 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.8__shadow_.aJ5YlO5PkQjkkfXn3_9l_NoXI6KNQMY_0 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9090847608474204068', time=2024-09-12T02:47:52.138354+0000, chain.objs.size()=1 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.dbJphZM15sHYQZ_XmEjPrnqjBFf4jTy_0 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9525394142627836268', time=2024-09-12T02:47:53.371107+0000, chain.objs.size()=1 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.KqJvyJAPcqAGtpImFcEQReHXbsSN4LP_0 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2552535821308186413', time=2024-09-12T02:49:03.987012+0000, chain.objs.size()=1 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.3I86wT6kWTj_nles4VZ5UfO4b7l88Ba_0 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15368372745305660483', time=2024-09-12T02:50:11.142555+0000, chain.objs.size()=1 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.QO_4BhucPPITaeuFOoNKo5FbfSG_DF3_0 2024-09-12T00:55:13.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10070105504391697255', time=2024-09-12T02:50:15.153217+0000, chain.objs.size()=1 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.wymmX7uUpn04cX7VDBo6NufOGHpwddh_0 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14138519510348995958', time=2024-09-12T02:50:15.162598+0000, chain.objs.size()=1 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.F1PHIONejjnfNbIRNoyZ0OslfuVj_BE_0 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7501584187930509189', time=2024-09-12T02:50:15.165398+0000, chain.objs.size()=1 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.SSlbZF-NJl-jtmm3h1tPrNfVAILv4KO_0 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.867790918522501100', time=2024-09-12T02:50:47.153237+0000, chain.objs.size()=1 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.WtGcfrnxpIitJEGMieVNPhcqT3o23uA_0 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11284574836382278542', time=2024-09-12T02:51:20.999976+0000, chain.objs.size()=1 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.Nwl790U4V134NbsPrDa0swimxqGYlrs_0 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12484585400012011209', time=2024-09-12T02:51:22.941068+0000, chain.objs.size()=1 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.xqxpcZkaJ4-83R_gutfAmDLgjUhh0wH_0 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7211723589826206488', time=2024-09-12T02:51:22.948277+0000, chain.objs.size()=1 2024-09-12T00:55:13.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.781+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_._fkpPL7qk6um3CC4NxPC6F3gB10CJgf_0 2024-09-12T00:55:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.785+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4567975723336889218', time=2024-09-12T02:51:54.624490+0000, chain.objs.size()=1 2024-09-12T00:55:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.785+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.B4Wl0IVOnqCOiJPR2nmL7polO4K2Vt3_0 2024-09-12T00:55:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.785+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11025108711993856920', time=2024-09-12T02:51:54.634806+0000, chain.objs.size()=1 2024-09-12T00:55:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.785+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.8tVMQc5vLHNweyZee2U-mk2sbnarOmG_0 2024-09-12T00:55:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.785+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16893079600672639272', time=2024-09-12T02:51:56.603226+0000, chain.objs.size()=1 2024-09-12T00:55:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.785+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.FPSZdB-p6KuzLFxULNfcKCK0oqRa4Hq_0 2024-09-12T00:55:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.786+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.88476269191370241', time=2024-09-12T02:51:57.431991+0000, chain.objs.size()=1 2024-09-12T00:55:13.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.786+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.51aFrgD0QIcOVuYLeqp-YPwszRsANVg_0 2024-09-12T00:55:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.786+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8435115678824534723', time=2024-09-12T02:51:57.437027+0000, chain.objs.size()=1 2024-09-12T00:55:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.786+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.7BPgQ8amLufxVHWcEEt_L0B2hcNpaxe_0 2024-09-12T00:55:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.786+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9755388327282562846', time=2024-09-12T02:52:29.115653+0000, chain.objs.size()=1 2024-09-12T00:55:13.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.786+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.Csa4BS4wYPmDQ6WLymyKQReFt2XIGBE_0 2024-09-12T00:55:13.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.789+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.792+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:55:13.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.793+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:55:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11828576584538917956', time=2024-09-12T02:46:28.195708+0000, chain.objs.size()=1 2024-09-12T00:55:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.4lmMqj0DXIIWMjfhSBPWGHGKdqEZZrf_0 2024-09-12T00:55:13.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15733041257552233697', time=2024-09-12T02:47:52.134406+0000, chain.objs.size()=1 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.GI2EIVkWdf2ywRK9s3sGG3IS8TstQZt_0 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11442075850388147789', time=2024-09-12T02:47:52.138245+0000, chain.objs.size()=1 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.OmVTVC1ecc50or89F1jZ-2kgnMmqkZQ_0 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18291898869219326712', time=2024-09-12T02:47:52.139249+0000, chain.objs.size()=1 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.jYiiVBp8BE0upC_wv90IGTgSA_czbQR_0 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7371625994673783367', time=2024-09-12T02:47:53.370705+0000, chain.objs.size()=1 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.PmLkouQnC1EwZ062lx4d0E_2woJIkHN_0 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.497387340958303579', time=2024-09-12T02:47:53.373867+0000, chain.objs.size()=1 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.mkIBb7OaolAQJiKG1xQVigjpr2TyRdK_0 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15661850968985777331', time=2024-09-12T02:47:53.382041+0000, chain.objs.size()=1 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.I7Ce5yTP531nDrM6IgL2RGQEEZy0TwY_0 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2510693630419318293', time=2024-09-12T02:48:27.189477+0000, chain.objs.size()=1 2024-09-12T00:55:13.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.qHMjovjjB-uI3agbEkMQ8AsYdpWdtqV_0 2024-09-12T00:55:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3019316081710761007', time=2024-09-12T02:49:03.986172+0000, chain.objs.size()=1 2024-09-12T00:55:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.Ew_zgZYnvEbYrjHJSpmsbYQuGlLDJbB_0 2024-09-12T00:55:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12776641656267090077', time=2024-09-12T02:49:38.245409+0000, chain.objs.size()=1 2024-09-12T00:55:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.rSeZEy3CNV8W6TQQAp_yAMZ6JsYaX2Q_0 2024-09-12T00:55:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15304059030217688704', time=2024-09-12T02:50:11.142419+0000, chain.objs.size()=1 2024-09-12T00:55:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.RROvu2s9LqkcdXpq4Rf5qGBuOvTvPiD_0 2024-09-12T00:55:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.238556619003949209', time=2024-09-12T02:50:47.154939+0000, chain.objs.size()=1 2024-09-12T00:55:13.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.794+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.9X9H0i9TmIlRDqhoJ7cVIJP1XEy_vJN_0 2024-09-12T00:55:13.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.797+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.128863560735753626', time=2024-09-12T02:50:47.158747+0000, chain.objs.size()=1 2024-09-12T00:55:13.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.797+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.ky3SFFZIdlMYkPaXALakBx-Dy8HGgr3_0 2024-09-12T00:55:13.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.798+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11753451604839731099', time=2024-09-12T02:50:48.717952+0000, chain.objs.size()=1 2024-09-12T00:55:13.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.798+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.3LYi00iAzIScHcG6-mzKGG9TdmtWxIG_0 2024-09-12T00:55:13.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.798+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10570810325525001436', time=2024-09-12T02:51:54.627445+0000, chain.objs.size()=1 2024-09-12T00:55:13.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.798+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.y2RvG16MhzHFTqeSajW61EcDCoTFlDP_0 2024-09-12T00:55:13.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.798+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17559062005255195475', time=2024-09-12T02:51:56.600610+0000, chain.objs.size()=1 2024-09-12T00:55:13.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.798+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.3uUaYixtEb856nbYggkx8STSYZt6ZkM_0 2024-09-12T00:55:13.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.801+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.804+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:55:13.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.805+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.805+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8698872575690833284', time=2024-09-12T02:46:28.049077+0000, chain.objs.size()=1 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.9pRtBD4Uuw-aC2_X_24sNuu5DIwA8Tq_0 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_z2x-JIMPlBjbD7bQk815koWE4toAYvR', time=2024-09-12T02:46:28.167717+0000, chain.objs.size()=2 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.K00DB6pwufwgoXvTw-e5LvRzc7vtuMQ_0 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.K00DB6pwufwgoXvTw-e5LvRzc7vtuMQ_1 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18201264319122564769', time=2024-09-12T02:46:28.243525+0000, chain.objs.size()=3 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.1 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.2 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-STANDARD.2~aY6xqYKIpWxcElY_-xDjC6jVr3vLWWb.3 2024-09-12T00:55:13.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12359551131086754834', time=2024-09-12T02:48:27.174971+0000, chain.objs.size()=1 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.5uyjVkrQiEePrjD7i7UnIIJEtr8o_b8_0 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10434686907577395430', time=2024-09-12T02:48:27.179456+0000, chain.objs.size()=1 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.Xc8-WaerCq5vRoEgbzRHMECTUpNMph-_0 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16596919748079183751', time=2024-09-12T02:48:28.209206+0000, chain.objs.size()=1 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.SxGHwMxwPnpkOmjPWwGpo5z6N-9nt-W_0 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11717607822954054576', time=2024-09-12T02:49:02.762807+0000, chain.objs.size()=1 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.u8LLsOXPsiwhPFc5FvOYkcUuU5ZTVd4_0 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12890710553801106835', time=2024-09-12T02:49:02.768934+0000, chain.objs.size()=1 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.5sYclgyyfr_r8CeiNUdWH9vKiyo3ioz_0 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8750960839136676418', time=2024-09-12T02:49:02.771017+0000, chain.objs.size()=1 2024-09-12T00:55:13.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.806+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.o8FPoEuLQeyxLEh-QtMQdkMy6JNTrU0_0 2024-09-12T00:55:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3573453374871043625', time=2024-09-12T02:49:02.774957+0000, chain.objs.size()=1 2024-09-12T00:55:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.8nrvQM8ilNVpDCJ25OGwM5SOROr0qLw_0 2024-09-12T00:55:13.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7674174119945203076', time=2024-09-12T02:49:03.988829+0000, chain.objs.size()=1 2024-09-12T00:55:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.mwvHTVjocfWc5h2du2gh1NGUwiiugF8_0 2024-09-12T00:55:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13236167582828977407', time=2024-09-12T02:49:03.993598+0000, chain.objs.size()=1 2024-09-12T00:55:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.QUPpDiKzV0c_OvmTSzF5MRYpz0rXFb0_0 2024-09-12T00:55:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1349683017206235203', time=2024-09-12T02:50:11.149977+0000, chain.objs.size()=1 2024-09-12T00:55:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.cp2UaMAA7uFBTYo0kEnxZTTMl0L9gqo_0 2024-09-12T00:55:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3582265993023040756', time=2024-09-12T02:50:11.158288+0000, chain.objs.size()=1 2024-09-12T00:55:13.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.809+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.G0PJY7HH3zN3fWVVcwdlGmoknImrLx2_0 2024-09-12T00:55:13.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5337608577330142568', time=2024-09-12T02:50:13.702423+0000, chain.objs.size()=1 2024-09-12T00:55:13.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.g6l-iehTbJNZCnvZjH-ZTiL0UCoIFES_0 2024-09-12T00:55:13.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6637079718201462841', time=2024-09-12T02:50:15.144602+0000, chain.objs.size()=1 2024-09-12T00:55:13.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.hsewIPlad8vfYcCbVl0dIHBlJfnVjT7_0 2024-09-12T00:55:13.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3772110818446090890', time=2024-09-12T02:50:15.147031+0000, chain.objs.size()=1 2024-09-12T00:55:13.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.plGyORUL-VAOIvl0MioddgNiFo1zQb2_0 2024-09-12T00:55:13.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7955344133758234018', time=2024-09-12T02:51:22.942316+0000, chain.objs.size()=1 2024-09-12T00:55:13.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.PZf51OMTtmdLdGJ3RvvtFu3ZrboWQAx_0 2024-09-12T00:55:13.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15768984009143803984', time=2024-09-12T02:51:56.598219+0000, chain.objs.size()=1 2024-09-12T00:55:13.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.810+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.p2S0GZIbR33q0hslkfEK-NxZ6QnIaoa_0 2024-09-12T00:55:13.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.812+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17686816777146990729', time=2024-09-12T02:52:29.129774+0000, chain.objs.size()=1 2024-09-12T00:55:13.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.812+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.I3EYu_gho_tiemIncI7I8rT0gNGUSTc_0 2024-09-12T00:55:13.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.813+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15916939512485527201', time=2024-09-12T02:54:35.440056+0000, chain.objs.size()=1 2024-09-12T00:55:13.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.813+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.aMoyd_P7rKWkfScisYtWwVGfIskj3R1_0 2024-09-12T00:55:13.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.816+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.818+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:55:13.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T00:55:13.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17241298126303196040', time=2024-09-12T02:46:28.179542+0000, chain.objs.size()=1 2024-09-12T00:55:13.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.4lmMqj0DXIIWMjfhSBPWGHGKdqEZZrf_0 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13237157112382762071', time=2024-09-12T02:46:28.302077+0000, chain.objs.size()=1 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.fJ_sJNYhy6FJMMfERRQilMsh4aVQyMk_0 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1519820486523448212', time=2024-09-12T02:46:28.339952+0000, chain.objs.size()=1 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.8__shadow_.oVrljPRVIZ-eNSGciSBrXX5ce4XL7kU_0 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2181514079296057871', time=2024-09-12T02:47:52.138481+0000, chain.objs.size()=1 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.SUAc-mmQUoQr7kWw4LvWor8RgyCQtwa_0 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2833226815817654822', time=2024-09-12T02:48:25.045740+0000, chain.objs.size()=1 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.mbm8I6YzIU5UWiS6_HrVy3C9ydd-1fC_0 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3988744861611766818', time=2024-09-12T02:48:25.055712+0000, chain.objs.size()=1 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.09OWLaN6qpJof7pzf3YU4pwsHmS98Sa_0 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9259352154954379549', time=2024-09-12T02:48:27.168728+0000, chain.objs.size()=1 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.6eyYEClOopQEbo0TW0f7PFdaOquZCAA_0 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7920274504310893077', time=2024-09-12T02:48:27.178200+0000, chain.objs.size()=1 2024-09-12T00:55:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.6N-tQcP_o3PBQ2RbxUnCW3kfM7-MbES_0 2024-09-12T00:55:13.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.820+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7634819874903783947', time=2024-09-12T02:48:28.212183+0000, chain.objs.size()=1 2024-09-12T00:55:13.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.821+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.jElTGX9De_FNgqtFLZF9GZlh_6KMM3k_0 2024-09-12T00:55:13.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.821+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3988660832066541381', time=2024-09-12T02:48:28.212937+0000, chain.objs.size()=1 2024-09-12T00:55:13.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.821+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.fxlJMvl38HAjZPkg2oYZJEADd6sBtod_0 2024-09-12T00:55:13.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.821+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3922913168648504335', time=2024-09-12T02:49:01.115211+0000, chain.objs.size()=1 2024-09-12T00:55:13.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.821+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.wsx1x5nH90gdBTl1lK-cFviCpH3TRfe_0 2024-09-12T00:55:13.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.821+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1735469084681201082', time=2024-09-12T02:49:03.983827+0000, chain.objs.size()=1 2024-09-12T00:55:13.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.821+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.1tNVuF1HW3D8evWDdBpBwYMme9SsOtt_0 2024-09-12T00:55:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.824+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.350136973685374236', time=2024-09-12T02:49:03.996455+0000, chain.objs.size()=1 2024-09-12T00:55:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.824+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.k_GoHUixIvDbNwhVTBSS6_W8UozzTug_0 2024-09-12T00:55:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.824+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17920006517638498834', time=2024-09-12T02:49:35.873745+0000, chain.objs.size()=1 2024-09-12T00:55:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.824+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.6fSgknUR1Mb5B8shJTtHT99X6SaUH4n_0 2024-09-12T00:55:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.824+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13474712025505341300', time=2024-09-12T02:49:38.228824+0000, chain.objs.size()=1 2024-09-12T00:55:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.824+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.rAuZatvousLSFVIsrWgtg3uCI3oXnwa_0 2024-09-12T00:55:13.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.825+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10080574783850772989', time=2024-09-12T02:50:11.149330+0000, chain.objs.size()=1 2024-09-12T00:55:13.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.825+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.XraCaZoD76yHnyH8UneF1jjiN1YfoKG_0 2024-09-12T00:55:13.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.825+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4950779535457601408', time=2024-09-12T02:50:15.151588+0000, chain.objs.size()=1 2024-09-12T00:55:13.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.825+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.ZPXc32bBCG5cNVI-7QSHYDpGBMo3PMQ_0 2024-09-12T00:55:13.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.825+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11013224513206246758', time=2024-09-12T02:50:15.155831+0000, chain.objs.size()=1 2024-09-12T00:55:13.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.825+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.jg5lX4qqGvaoEX22bXGQcSn47POfs1n_0 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10866225575286354655', time=2024-09-12T02:50:15.156552+0000, chain.objs.size()=1 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.-16ui__ArkR5tm21Gkl5_EScQv6umGq_0 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11657857915699071415', time=2024-09-12T02:50:47.152698+0000, chain.objs.size()=1 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.X4DoToYKuWOd9LMCsVEwl7bsG5oGItL_0 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14182314026112327621', time=2024-09-12T02:51:20.993636+0000, chain.objs.size()=1 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.UCTe1Cw1Vy5g0pCQ2iL2PpzLc-T4jW9_0 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12688226199993564696', time=2024-09-12T02:51:57.421473+0000, chain.objs.size()=1 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.1TqfIrkqoklKdZs1P5iWXzoXUQ_ZxkN_0 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1342489704590919934', time=2024-09-12T02:51:57.430586+0000, chain.objs.size()=1 2024-09-12T00:55:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.826+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.Ofj3zpHwhmCBorDqQoPKgSJizTtWyMU_0 2024-09-12T00:55:13.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.828+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8379178774589112808', time=2024-09-12T02:52:29.119357+0000, chain.objs.size()=1 2024-09-12T00:55:13.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.828+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.1LslFomk5sneUINvPdNpSfyWnJf6tLp_0 2024-09-12T00:55:13.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.831+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.538888583937734348', time=2024-09-12T02:52:29.129283+0000, chain.objs.size()=1 2024-09-12T00:55:13.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.831+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.U0fBa---Os_CjWgHCXeyQMkaVmW58sj_0 2024-09-12T00:55:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.834+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.836+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:55:13.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.837+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.837+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:55:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17258382422275565967', time=2024-09-12T02:46:28.214934+0000, chain.objs.size()=5 2024-09-12T00:55:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.1 2024-09-12T00:55:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.1_1 2024-09-12T00:55:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.2 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.2_1 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-FROZEN.2~bp2KG0cDV3c7G0W83sDw9SiDyknSD3x.3 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15941381366202858743', time=2024-09-12T02:47:52.148438+0000, chain.objs.size()=1 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.HfpHyd0JYt5qn9bs0rhr2RSOlykC5hX_0 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14638298174666883505', time=2024-09-12T02:48:25.056651+0000, chain.objs.size()=1 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.edxmOl6w9hq7mo7f4SaVBBr2mHx6bSW_0 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15420241278652636304', time=2024-09-12T02:48:27.184169+0000, chain.objs.size()=1 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.AM9zmZjKj7fWjocvUtvKUPyOP1FIugr_0 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2805424239856201070', time=2024-09-12T02:48:28.227735+0000, chain.objs.size()=1 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.E8yZZM2h0DaMpupalwrVHzLgMkV5YvD_0 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5514887960986828744', time=2024-09-12T02:49:01.111713+0000, chain.objs.size()=1 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.knMH4T3qHqETFUZ2C3oWnLey6hNT1W2_0 2024-09-12T00:55:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9096385846785292307', time=2024-09-12T02:49:02.673774+0000, chain.objs.size()=1 2024-09-12T00:55:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.wi8_qktU-tGwF1QhQPR7SjwXqehWUgu_0 2024-09-12T00:55:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15868096785802008716', time=2024-09-12T02:49:02.774659+0000, chain.objs.size()=1 2024-09-12T00:55:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.838+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.fBRoNwyanTEnjHeY_M07HymJe0wXBOR_0 2024-09-12T00:55:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16115878952935076514', time=2024-09-12T02:49:38.229908+0000, chain.objs.size()=1 2024-09-12T00:55:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.R55jMWJZR0s7QDKD3XI0yalwpNT-JTK_0 2024-09-12T00:55:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2642590075980005537', time=2024-09-12T02:49:38.233069+0000, chain.objs.size()=1 2024-09-12T00:55:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.20H7JgD5oFW3zppPKQMf6SgQxECxvGG_0 2024-09-12T00:55:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17409808679342121755', time=2024-09-12T02:50:13.703058+0000, chain.objs.size()=1 2024-09-12T00:55:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.82u11fL7e4hxCk7dgk21rqGtcevFq5a_0 2024-09-12T00:55:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2216167022787968251', time=2024-09-12T02:50:13.709341+0000, chain.objs.size()=1 2024-09-12T00:55:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.20igChcw_ZP5yzxgwfw3ts0RWWa_tjz_0 2024-09-12T00:55:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1050932108678563543', time=2024-09-12T02:50:15.146539+0000, chain.objs.size()=1 2024-09-12T00:55:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.841+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.TN8IaEie_IRBoJx7hHPwgoUsuMxwbr0_0 2024-09-12T00:55:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.842+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5347991726988533025', time=2024-09-12T02:50:48.729195+0000, chain.objs.size()=1 2024-09-12T00:55:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.842+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.uOmBOgMGH3kO1VAuX4Io-yqsRWgUXUU_0 2024-09-12T00:55:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.842+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13143590390937294498', time=2024-09-12T02:51:54.634059+0000, chain.objs.size()=1 2024-09-12T00:55:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.842+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.Ei5Czp01WSHMc5EEH8KjllVGmQHM97f_0 2024-09-12T00:55:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.842+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14882110974977389415', time=2024-09-12T02:52:29.122502+0000, chain.objs.size()=1 2024-09-12T00:55:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.842+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.OmB9XDaT7eS6oRMTiC3tFfsiacoFl5U_0 2024-09-12T00:55:13.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.846+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.849+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:55:13.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.850+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.850+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1376252023809909018', time=2024-09-12T02:46:28.044561+0000, chain.objs.size()=1 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.032RnzqrGSbGNzaucPB8xsu5WYQvVfN_0 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4666019008261958638', time=2024-09-12T02:46:28.108003+0000, chain.objs.size()=7 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.11__multipart_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.1 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.11__shadow_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.1_1 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.11__multipart_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.2 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.11__shadow_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.2_1 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.11__multipart_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.3 2024-09-12T00:55:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.11__shadow_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.3_1 2024-09-12T00:55:13.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.11__multipart_foo.2~-vVP-fmBy064utH2i_b0-OFAgN0vzVA.4 2024-09-12T00:55:13.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10092822459975072925', time=2024-09-12T02:48:28.204929+0000, chain.objs.size()=1 2024-09-12T00:55:13.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.p9vS_j644jbMGtGu-p8a0AAY_5c4MqC_0 2024-09-12T00:55:13.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.557915936172595864', time=2024-09-12T02:48:28.205945+0000, chain.objs.size()=1 2024-09-12T00:55:13.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.Og7STsJrcr4BIzj6jVL5l6OesVtja_r_0 2024-09-12T00:55:13.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2263652088947513841', time=2024-09-12T02:48:28.209214+0000, chain.objs.size()=1 2024-09-12T00:55:13.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.nfhlmFtTKMfqx-7JCaofEUsz4ekJoSa_0 2024-09-12T00:55:13.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5971503105304522324', time=2024-09-12T02:49:02.769833+0000, chain.objs.size()=1 2024-09-12T00:55:13.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.851+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.-VcbCWlycgFOj-PlgaU9ne_0S8Ts6Ff_0 2024-09-12T00:55:13.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4754824124197696769', time=2024-09-12T02:49:35.874972+0000, chain.objs.size()=1 2024-09-12T00:55:13.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.LXYzU1WrQJZtC7YSvisdNAjJBFGHdeJ_0 2024-09-12T00:55:13.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16281961735236729945', time=2024-09-12T02:49:35.877529+0000, chain.objs.size()=1 2024-09-12T00:55:13.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.rVaM3EU9vqdqmGFegAfjMWO39at8Ydz_0 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5263957787972026551', time=2024-09-12T02:49:38.232576+0000, chain.objs.size()=1 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.BOxcaLGUJEINuFopX9-3W-_XTco1Bdt_0 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12525459967999215718', time=2024-09-12T02:50:13.704242+0000, chain.objs.size()=1 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.rGRf1d_wQfSTycLa7HqWVY86og9NIDb_0 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1521757839024736633', time=2024-09-12T02:50:48.715791+0000, chain.objs.size()=1 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.855+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.AaWJGiKZ1TkhuosMa4HsrW43RXT0Bin_0 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4620233145393448775', time=2024-09-12T02:51:20.991263+0000, chain.objs.size()=1 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.vDcoWIjVQK6_9sOJR3o26QK1xZ4zOwx_0 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9416960926237979430', time=2024-09-12T02:51:21.001245+0000, chain.objs.size()=1 2024-09-12T00:55:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.CDqmAMxXalMCX3pBrAaW6GZSviQ_0xF_0 2024-09-12T00:55:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2857039346674701555', time=2024-09-12T02:51:54.632889+0000, chain.objs.size()=1 2024-09-12T00:55:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.E9De_3FYGSGq9Z_RyDXvWht2cqukfXA_0 2024-09-12T00:55:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6720550640581671334', time=2024-09-12T02:51:57.429242+0000, chain.objs.size()=1 2024-09-12T00:55:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.EVy9EI_YAqWwlwDOQ8Z3_qR5agdZA0i_0 2024-09-12T00:55:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4415555334623061181', time=2024-09-12T02:52:29.115250+0000, chain.objs.size()=1 2024-09-12T00:55:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.VOUybAyLHwZnHJfa71VmKEvZzohKumk_0 2024-09-12T00:55:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13415778643020148670', time=2024-09-12T02:54:35.439068+0000, chain.objs.size()=1 2024-09-12T00:55:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.856+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.VAXcHRxLm6w5Prm8l5r_EFJBf_nmi7g_0 2024-09-12T00:55:13.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.861+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.864+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:55:13.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2512132397740400092', time=2024-09-12T02:47:52.132151+0000, chain.objs.size()=1 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.JvmxX1nQBQvg9ACsSpj0ocvj2NpfMRf_0 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5335986703382918918', time=2024-09-12T02:47:53.379100+0000, chain.objs.size()=1 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.6yzUTAOvkZySGJ2Lx8vuEwWMwrpikQF_0 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15881727587510653221', time=2024-09-12T02:49:01.109800+0000, chain.objs.size()=1 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.M3a4qns_32it1gvFutwuZWDqooDTgUy_0 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5160532669341394948', time=2024-09-12T02:49:02.766372+0000, chain.objs.size()=1 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.i7yH6-F9HGV9yx8NplQNkVZD_gfJ5a6_0 2024-09-12T00:55:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3779000607642363239', time=2024-09-12T02:49:03.984730+0000, chain.objs.size()=1 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.kdHmUHX3Edag3W01U577dqzWY9Gxb_L_0 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11415674022399755924', time=2024-09-12T02:49:35.890356+0000, chain.objs.size()=1 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.krg1C_GAx_MU8AwneT3YKS9RSMiw0eK_0 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16567526535712095687', time=2024-09-12T02:49:38.235429+0000, chain.objs.size()=1 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.mlpZzSt2anjFPZ3TFQecx1xCa3eg6DN_0 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14776743598954434739', time=2024-09-12T02:50:15.161824+0000, chain.objs.size()=1 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.oYfZhtBxS94_kTkhH3apLsNhhrewaBx_0 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4388219751962633162', time=2024-09-12T02:50:48.733976+0000, chain.objs.size()=1 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.kfwrcWDXz5xK_-by-X7UsbXn_IoeXrh_0 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1715576083603703466', time=2024-09-12T02:51:20.992797+0000, chain.objs.size()=1 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.9jXIg2sv0fNvxeWkourjL16YG-T5kB__0 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7189533538511511151', time=2024-09-12T02:51:20.993673+0000, chain.objs.size()=1 2024-09-12T00:55:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.E7mdVEo-S4djWMUDXdNnRjbKBSRNSQw_0 2024-09-12T00:55:13.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15851048043847155463', time=2024-09-12T02:51:56.589000+0000, chain.objs.size()=1 2024-09-12T00:55:13.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.865+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.Yw0oZ6FSWJwBTXQBizP6lJfvpgzKyH0_0 2024-09-12T00:55:13.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.868+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16309322724975017407', time=2024-09-12T02:51:56.591760+0000, chain.objs.size()=1 2024-09-12T00:55:13.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.868+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.-01JWDqnYbM_mv0Gg0GhkXU8hkwFHJm_0 2024-09-12T00:55:13.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.868+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4736585922544368199', time=2024-09-12T02:51:56.602358+0000, chain.objs.size()=1 2024-09-12T00:55:13.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.868+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.KR_3qQG7wLG9EWgRWAKtRVaS3uvIgDz_0 2024-09-12T00:55:13.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.869+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8174957286190033603', time=2024-09-12T02:54:35.438552+0000, chain.objs.size()=1 2024-09-12T00:55:13.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.869+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.TN5uzaxdIXtU8317LHFLac7m-yrVHQY_0 2024-09-12T00:55:13.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.869+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3160235795890414217', time=2024-09-12T02:54:48.835731+0000, chain.objs.size()=1 2024-09-12T00:55:13.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.869+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.19__shadow:kJc0kBgnIY3p8zxz.7xtmm9mUeZ1j37_.LDcmnSmcivHlFrwM-4gGWdBOXInMJaZ_0 2024-09-12T00:55:13.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.873+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.875+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:55:13.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.877+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.877+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:55:13.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.283801322495771725', time=2024-09-12T02:47:53.378325+0000, chain.objs.size()=1 2024-09-12T00:55:13.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.HMl-BR0iLW0HRAO0orTG22ucPPIMsdc_0 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4681592816840584313', time=2024-09-12T02:49:01.111346+0000, chain.objs.size()=1 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.jA94d_nA92sN6gJlfZP_p6ANrwMA39g_0 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13791292878670222606', time=2024-09-12T02:49:02.762847+0000, chain.objs.size()=1 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.nJj7mh-nUxbTSaCKy4Jso585zwgsIca_0 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8554439825649928386', time=2024-09-12T02:49:04.000088+0000, chain.objs.size()=1 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.WdWp0l_8FUfrhX5CXk4Zi5TfDATN0Az_0 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5657183583001803990', time=2024-09-12T02:49:38.239784+0000, chain.objs.size()=1 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.zAZ9KkoQtBmMI-OeI72F8fmyGF3-ZwF_0 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13729773645791911909', time=2024-09-12T02:50:13.704431+0000, chain.objs.size()=1 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.8BI-caQVmOMC0KJ83E46zTwVnmZPX9A_0 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3806513500825193656', time=2024-09-12T02:50:13.717634+0000, chain.objs.size()=1 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.kdgd_EfdoZEFznVR7JWQVvdH3UeJ4Im_0 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1137997777164776727', time=2024-09-12T02:51:21.000825+0000, chain.objs.size()=1 2024-09-12T00:55:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.eo41MuFpEPIU89gvBQA6WwxlzbPpcfs_0 2024-09-12T00:55:13.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3262163945642670009', time=2024-09-12T02:51:22.942567+0000, chain.objs.size()=1 2024-09-12T00:55:13.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.Au9VZC-ValiS7MCPIKhHSVwzX3Ovti5_0 2024-09-12T00:55:13.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2902352619855988361', time=2024-09-12T02:52:29.132275+0000, chain.objs.size()=1 2024-09-12T00:55:13.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.878+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.BFUh16nWQ2ESNqc2abTT0IFOq9-vTH9_0 2024-09-12T00:55:13.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.882+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.884+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:55:13.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.885+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12415201487894214794', time=2024-09-12T02:46:28.226962+0000, chain.objs.size()=5 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.1 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.1_1 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.2 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.2_1 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.3 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.223688285799172176', time=2024-09-12T02:46:28.273093+0000, chain.objs.size()=5 2024-09-12T00:55:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.1 2024-09-12T00:55:13.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__shadow_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.1_1 2024-09-12T00:55:13.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.2 2024-09-12T00:55:13.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__shadow_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.2_1 2024-09-12T00:55:13.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-LUKEWARM.2~Z-9dhSEcfblVsFkb7KmZT93YO8vYRn4.3 2024-09-12T00:55:13.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2386855321676408466', time=2024-09-12T02:48:25.064242+0000, chain.objs.size()=1 2024-09-12T00:55:13.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.yF0LpCLIPId_hvXRDEi_DP1P6iY3nIT_0 2024-09-12T00:55:13.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5284554628028044429', time=2024-09-12T02:48:25.256935+0000, chain.objs.size()=1 2024-09-12T00:55:13.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.886+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.WBGkeSdTGKRZZNMVmoaxch0v_Pwg2fe_0 2024-09-12T00:55:13.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.888+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10856045454615808530', time=2024-09-12T02:49:01.107450+0000, chain.objs.size()=1 2024-09-12T00:55:13.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.888+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.WgMpFIEH4dHS34AJxuCLmpObN8ej8Oq_0 2024-09-12T00:55:13.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.203691620579790538', time=2024-09-12T02:49:35.888494+0000, chain.objs.size()=1 2024-09-12T00:55:13.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.29MtxaWRTq4cvqWs_a92wgAWKLLUD8Y_0 2024-09-12T00:55:13.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2596185430183434189', time=2024-09-12T02:49:38.229834+0000, chain.objs.size()=1 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.ifaST0nVC2rUH0GuV7ACw_78dvuBPRB_0 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1735096723135137247', time=2024-09-12T02:49:38.235722+0000, chain.objs.size()=1 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.AaiHsZH3q2HusK5yRpwqjDjmI2QNzHi_0 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5530292138504671949', time=2024-09-12T02:50:11.142219+0000, chain.objs.size()=1 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.VMGZdtQB26001MnaGc830s4-FScV6WA_0 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4786904046464195304', time=2024-09-12T02:50:11.145353+0000, chain.objs.size()=1 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.zq0qZPitCPOQUkCbsZM6A4rOsJ5dIDM_0 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4932865333640135113', time=2024-09-12T02:51:56.590962+0000, chain.objs.size()=1 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.889+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.JhlqpAVuglwBT7BISxOgFMrPYaTNOqI_0 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.890+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9364886632282583061', time=2024-09-12T02:52:29.122764+0000, chain.objs.size()=1 2024-09-12T00:55:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.890+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.BE3tOzYfEIUcuPcUNdJYgI4wRu0m4iv_0 2024-09-12T00:55:13.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.893+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.896+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:55:13.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.897+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:55:13.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14203095611337332989', time=2024-09-12T02:46:28.133711+0000, chain.objs.size()=4 2024-09-12T00:55:13.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.10__multipart_foo.2~1D-KYGVPcXFtT9NP_4Oi7aexhE_McKs.1 2024-09-12T00:55:13.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.10__multipart_foo.2~1D-KYGVPcXFtT9NP_4Oi7aexhE_McKs.2 2024-09-12T00:55:13.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.10__multipart_foo.2~1D-KYGVPcXFtT9NP_4Oi7aexhE_McKs.3 2024-09-12T00:55:13.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.10__multipart_foo.2~1D-KYGVPcXFtT9NP_4Oi7aexhE_McKs.4 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2007950747603464997', time=2024-09-12T02:46:28.268795+0000, chain.objs.size()=5 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.1 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__shadow_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.1_1 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.2 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__shadow_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.2_1 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-FROZEN.2~F9YQha6R27Fz_W-wdy780yDdVCRLJ4r.3 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3421097033210709054', time=2024-09-12T02:47:54.181162+0000, chain.objs.size()=1 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.6Aomc937dq2ny--8m2Ygm-g2-dB3GWq_0 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17343101725324178738', time=2024-09-12T02:48:27.172025+0000, chain.objs.size()=1 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.e4XPM5GrRE-9N8c59aorYjf-SK2EMnw_0 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12975303369073037906', time=2024-09-12T02:48:27.175533+0000, chain.objs.size()=1 2024-09-12T00:55:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.898+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.YzIK5ANkQ94Jz5qI29xdDA_o1lL5-ia_0 2024-09-12T00:55:13.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.901+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5371488809356521329', time=2024-09-12T02:48:27.180551+0000, chain.objs.size()=1 2024-09-12T00:55:13.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.901+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.0H-Sm_QtfzL4wN-QOcbJSQEKD4VCfxJ_0 2024-09-12T00:55:13.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14329497069246055414', time=2024-09-12T02:49:01.107129+0000, chain.objs.size()=1 2024-09-12T00:55:13.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.AGTX2T48DOc5RWrBqebiBPKi3p49TEU_0 2024-09-12T00:55:13.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10450998994599322934', time=2024-09-12T02:49:01.119100+0000, chain.objs.size()=1 2024-09-12T00:55:13.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.-6EMrdKJnj_WiD4R-FE-or7svZRFGuj_0 2024-09-12T00:55:13.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3933040727097962832', time=2024-09-12T02:49:03.995417+0000, chain.objs.size()=1 2024-09-12T00:55:13.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.qoeg8qc-VAGQMhr1MMkNvy1kYYy-aMq_0 2024-09-12T00:55:13.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8544744271276614893', time=2024-09-12T02:50:11.141808+0000, chain.objs.size()=1 2024-09-12T00:55:13.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.gQdPn67LR2AGr2pMbVYROvI19KTU4ag_0 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2208474547314824503', time=2024-09-12T02:50:15.154040+0000, chain.objs.size()=1 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.vRWuybTjNlhFweY3FmzrOJmJAZogR4Q_0 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12535446274606361334', time=2024-09-12T02:50:15.156241+0000, chain.objs.size()=1 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.DUrUmW7RtrO7JTP1OvXUVcIo3uj21tc_0 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10648215478255309081', time=2024-09-12T02:50:47.139803+0000, chain.objs.size()=1 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.vJKOTy9KpuA5mhkPKbYrnzm85RSAVLM_0 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1012479010662285410', time=2024-09-12T02:50:48.730081+0000, chain.objs.size()=1 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.dXt_A4QcVzvnv5WF3DkzvQHN2KgwFof_0 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7112325668057835610', time=2024-09-12T02:51:57.434678+0000, chain.objs.size()=1 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.902+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.4oafhkCvqkEtuy3v7tSNG46lWMFajou_0 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.903+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17729152691275039879', time=2024-09-12T02:51:57.443255+0000, chain.objs.size()=1 2024-09-12T00:55:13.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.903+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.1NKJdueDrLuDujRD7p3hHsvYeBP-eP0_0 2024-09-12T00:55:13.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.904+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12932222461267787202', time=2024-09-12T02:52:29.124404+0000, chain.objs.size()=1 2024-09-12T00:55:13.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.904+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.m65C0wK72FBoPQmK_8JwNvltlb9BO7t_0 2024-09-12T00:55:13.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.908+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.911+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:55:13.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.912+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.912+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6992183830369905437', time=2024-09-12T02:46:28.147834+0000, chain.objs.size()=2 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.0XMrGLJIreGrReSSSMu3P07fFpLScJy_0 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.0XMrGLJIreGrReSSSMu3P07fFpLScJy_1 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12940570078999178984', time=2024-09-12T02:46:28.276898+0000, chain.objs.size()=3 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-STANDARD.2~X5JPoFSufFOdMVt_ezbmzNxcIPH7CsN.1 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-STANDARD.2~X5JPoFSufFOdMVt_ezbmzNxcIPH7CsN.2 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.15__multipart_foo-STANDARD.2~X5JPoFSufFOdMVt_ezbmzNxcIPH7CsN.3 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10277254171200928865', time=2024-09-12T02:46:28.375077+0000, chain.objs.size()=1 2024-09-12T00:55:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.9__shadow_.ZaE-fejPTbttZEfY4j1COy_-bpoIBA4_0 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7315832363078600606', time=2024-09-12T02:47:53.377511+0000, chain.objs.size()=1 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.ToWEyiwmx-hlxuCK2wVEsMv4FAjPaHV_0 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5968573949046469512', time=2024-09-12T02:48:25.047304+0000, chain.objs.size()=1 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.nEND3SSsYCAKOkShOxukbp6mQaNfY3P_0 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7051053934606749969', time=2024-09-12T02:48:25.051952+0000, chain.objs.size()=1 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.u5qFE3sz5hoVmoXsPlKi3Xch-_AzdIS_0 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7267321770962660360', time=2024-09-12T02:48:27.180724+0000, chain.objs.size()=1 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.2ytce5i38YE66rJr8N1iMiKuusXcmT-_0 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14048137602943044006', time=2024-09-12T02:48:28.212622+0000, chain.objs.size()=1 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.kNCDPqgjIH-sZidt6mvTO83dJPXUYiY_0 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4573443708318158015', time=2024-09-12T02:48:28.213678+0000, chain.objs.size()=1 2024-09-12T00:55:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.913+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.Vc0cQXepjTkTIruvwqKRKxheXCHW3SM_0 2024-09-12T00:55:13.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.916+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13292281436806725616', time=2024-09-12T02:49:01.105283+0000, chain.objs.size()=1 2024-09-12T00:55:13.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.916+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.YjG4ti21n3BRpLVZN4_sZf3plooZBPr_0 2024-09-12T00:55:13.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.916+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15949365738527592869', time=2024-09-12T02:49:01.111332+0000, chain.objs.size()=1 2024-09-12T00:55:13.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.916+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.z2viO1D4NDB8loGlm1NXJI-fzkpGKLW_0 2024-09-12T00:55:13.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.916+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14740509012788787211', time=2024-09-12T02:49:01.123008+0000, chain.objs.size()=1 2024-09-12T00:55:13.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.916+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.UUbf9rVZIrlaguF4JNjcyJ-PxWSyQGM_0 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.893294709066407913', time=2024-09-12T02:49:02.768120+0000, chain.objs.size()=1 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.eEkF8mJZIF24jHtM9ifOzj9rgI13UG0_0 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10058775962021121545', time=2024-09-12T02:49:03.978953+0000, chain.objs.size()=1 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.EeGD6snHcNOiOIz6JGUjk0aO--_VQRn_0 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12707185981126655761', time=2024-09-12T02:49:03.991875+0000, chain.objs.size()=1 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.vqPB36Kpb-VKmTbfskOHdYPTOENSmXp_0 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17033383892762439942', time=2024-09-12T02:49:35.873762+0000, chain.objs.size()=1 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.RkbvP3sSET5NCDwCA3s3dXkvIBrgG5C_0 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13323605984378849601', time=2024-09-12T02:49:35.885597+0000, chain.objs.size()=1 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.I8UMTzA9Mru6L51Xk7FL-ndKrvTa7CY_0 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1067189490273934519', time=2024-09-12T02:51:22.026319+0000, chain.objs.size()=1 2024-09-12T00:55:13.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.RGJYYZLM9qv_xZNHMqjQ6fhI7mO1wnM_0 2024-09-12T00:55:13.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8929998690654399762', time=2024-09-12T02:51:22.953427+0000, chain.objs.size()=1 2024-09-12T00:55:13.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.917+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.qi7TTX_yzDcqdSMvHSbAqiYENwQweVU_0 2024-09-12T00:55:13.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.918+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5792002669304186450', time=2024-09-12T02:51:56.590378+0000, chain.objs.size()=1 2024-09-12T00:55:13.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.918+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.p91ehmhKY1o5JMPNpeF1IetMNjk4_B4_0 2024-09-12T00:55:13.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.918+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6741438810549159998', time=2024-09-12T02:51:56.592381+0000, chain.objs.size()=1 2024-09-12T00:55:13.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.918+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.baSmUdWQ3ouU4YwV-_AAjGPmPnzO7C7_0 2024-09-12T00:55:13.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.920+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13234949469031940905', time=2024-09-12T02:52:29.114106+0000, chain.objs.size()=1 2024-09-12T00:55:13.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.920+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.rFt5_iLv5AszpW9qyWFPJ2gchhdmvCL_0 2024-09-12T00:55:13.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.921+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7151264068964001754', time=2024-09-12T02:54:35.438463+0000, chain.objs.size()=1 2024-09-12T00:55:13.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.921+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.eRCNefc8m1dqWhJ6wsYl77sLVoaRLGy_0 2024-09-12T00:55:13.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.922+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1034139028800140393', time=2024-09-12T02:54:48.835457+0000, chain.objs.size()=1 2024-09-12T00:55:13.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.922+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.19__shadow:xW9qXEZV1.FZVfuJ3Ll22qgw9MUqfFL_.JThah_4l2WztXvgiv3Ely3NT2D4ES_4_0 2024-09-12T00:55:13.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.925+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.927+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:55:13.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.928+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:55:13.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13972604623927775779', time=2024-09-12T02:47:51.617611+0000, chain.objs.size()=1 2024-09-12T00:55:13.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.FTXSdXg2kWxy0Tg4f8oaWQm9VaM7HBv_0 2024-09-12T00:55:13.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5064478322026029075', time=2024-09-12T02:47:52.138153+0000, chain.objs.size()=1 2024-09-12T00:55:13.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.W6Ah5DCZZgGYwkex1xPBAkvSCE4zLk8_0 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8989329734388509826', time=2024-09-12T02:47:53.374435+0000, chain.objs.size()=1 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.9xijhFZ5ZJwiwAkYJJkze7umfmEN1F2_0 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7211816026835722226', time=2024-09-12T02:48:27.181220+0000, chain.objs.size()=1 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.Lby2mSHYXvLkFD7eyxs6iApeytds6H4_0 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17176878361200370568', time=2024-09-12T02:49:01.112995+0000, chain.objs.size()=1 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.RKcqJKU1PTCMWO-SueM4ghZ9y8zkdTB_0 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10043507094211820964', time=2024-09-12T02:49:03.987638+0000, chain.objs.size()=1 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.Vo45Qr91-mRTL2U4NPQU8TFfs_ZQOBu_0 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11898844770770796146', time=2024-09-12T02:50:15.169756+0000, chain.objs.size()=1 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.OiTR2QdxW5BofXTDVHVpv5r7HT76DK1_0 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15850281706162951542', time=2024-09-12T02:50:48.715227+0000, chain.objs.size()=1 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.pVsoX-_-RvOI7vZsIgLKlzMCs8mGIJP_0 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5908571540835706258', time=2024-09-12T02:50:48.730767+0000, chain.objs.size()=1 2024-09-12T00:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.5rNwtb90QgVEGV5fAiBtxX0RiEZilB6_0 2024-09-12T00:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5413942496704413905', time=2024-09-12T02:51:20.999384+0000, chain.objs.size()=1 2024-09-12T00:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.tFn65QXpj_XgbpUOjxEmLAOh-RIBYLX_0 2024-09-12T00:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2511519387293556271', time=2024-09-12T02:51:22.944871+0000, chain.objs.size()=1 2024-09-12T00:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.X1J9QdnOLTCX58VfWnHV5D01nhkUoP2_0 2024-09-12T00:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.472792937398792729', time=2024-09-12T02:51:54.633178+0000, chain.objs.size()=1 2024-09-12T00:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.929+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.KZgSdYNeXLkhzdptlAhG6IVpPlfscUH_0 2024-09-12T00:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.932+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15399058709995512711', time=2024-09-12T02:51:54.637852+0000, chain.objs.size()=1 2024-09-12T00:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.932+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.nb1NgXt9EfUacwwIApG4jlrBd5xQcXM_0 2024-09-12T00:55:13.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.933+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2588406318099515062', time=2024-09-12T02:51:56.589266+0000, chain.objs.size()=1 2024-09-12T00:55:13.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.933+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.sXOgl93LvAdwnrZqPWiorgweqhGAR7y_0 2024-09-12T00:55:13.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.933+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9141567491073796125', time=2024-09-12T02:51:56.596274+0000, chain.objs.size()=1 2024-09-12T00:55:13.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.933+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.PyCoKdc_lGD1tbvpRQbZEb2rvm6Rxao_0 2024-09-12T00:55:13.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.934+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1547934954713227031', time=2024-09-12T02:52:29.120826+0000, chain.objs.size()=1 2024-09-12T00:55:13.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.934+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.R7W4Fchx_SG4LlFQ28td9iMP84n--so_0 2024-09-12T00:55:13.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.937+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.939+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:55:13.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.940+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.940+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:55:13.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11071671523346308977', time=2024-09-12T02:46:28.057521+0000, chain.objs.size()=1 2024-09-12T00:55:13.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.Y78swkFHUXxYtRR-BiCkv5rP0skoHRe_0 2024-09-12T00:55:13.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_H1ISm8UgJLE391gllwpGfH1nLnF_Gma', time=2024-09-12T02:46:28.223123+0000, chain.objs.size()=3 2024-09-12T00:55:13.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.uS-4XW0V5k07hEHWje1nYRbj8GmaBiK_0 2024-09-12T00:55:13.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.uS-4XW0V5k07hEHWje1nYRbj8GmaBiK_1 2024-09-12T00:55:13.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.uS-4XW0V5k07hEHWje1nYRbj8GmaBiK_2 2024-09-12T00:55:13.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10245308532137773226', time=2024-09-12T02:47:52.133185+0000, chain.objs.size()=1 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.5JbSx4RDFUGOdCVcg0Cyma4bjqJGF2N_0 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6874519396449717284', time=2024-09-12T02:47:52.140987+0000, chain.objs.size()=1 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.OUzaL0GEeOWcmuX7MkskxoH2meKgtZP_0 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18035348580143647943', time=2024-09-12T02:47:52.143457+0000, chain.objs.size()=1 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.vpCYN3PA6MJKYwTIR8NI_QtEIMosBEb_0 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8305151451091535971', time=2024-09-12T02:47:52.144602+0000, chain.objs.size()=1 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.E0Iblh2kkmL1lXvdffhcayXXdKI_-mX_0 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15420412069363663394', time=2024-09-12T02:47:53.382106+0000, chain.objs.size()=1 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.S_3tw7_89TyvUqTxQAzVd1HhQsbQuYe_0 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5757699912268662227', time=2024-09-12T02:49:02.768211+0000, chain.objs.size()=1 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.-KSWJwfMyxGSJ-yp9FORgQxLNvFIiuh_0 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4555786369029891856', time=2024-09-12T02:49:03.998713+0000, chain.objs.size()=1 2024-09-12T00:55:13.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.OF9PdyxynesbKLBEuc3q78SbuM9Eyyj_0 2024-09-12T00:55:13.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16649327535969945108', time=2024-09-12T02:49:35.887423+0000, chain.objs.size()=1 2024-09-12T00:55:13.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.941+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.fLiVVr0GGB4xrIwi8NdfkUaScpH-YFx_0 2024-09-12T00:55:13.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.944+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2363094193390221547', time=2024-09-12T02:50:11.146264+0000, chain.objs.size()=1 2024-09-12T00:55:13.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.944+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.rGKyiqpMd534Refjz5tuvTaPZYwl3_O_0 2024-09-12T00:55:13.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.944+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12236662023986639590', time=2024-09-12T02:50:13.706851+0000, chain.objs.size()=1 2024-09-12T00:55:13.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.944+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.P-JTLnW0e0--UC0_LPj8L98CbSf8AVz_0 2024-09-12T00:55:13.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.944+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7109746855023702024', time=2024-09-12T02:50:48.731808+0000, chain.objs.size()=1 2024-09-12T00:55:13.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.944+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.tEWjAzFRte0p88xgW59HJASj_5MSr5o_0 2024-09-12T00:55:13.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.945+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16369809712368016011', time=2024-09-12T02:51:20.995785+0000, chain.objs.size()=1 2024-09-12T00:55:13.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.945+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.5uPk_7eXDntEjbzOBHx75ifo8-NbICh_0 2024-09-12T00:55:13.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.947+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17416659551535184838', time=2024-09-12T02:51:22.953078+0000, chain.objs.size()=1 2024-09-12T00:55:13.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.947+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.-lGh3ikScP04iJVwdSoQTDZfAThBMnY_0 2024-09-12T00:55:13.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.947+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2072233431309890926', time=2024-09-12T02:51:56.599991+0000, chain.objs.size()=1 2024-09-12T00:55:13.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.947+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.tt24IANYqq8tkNzEqdpDjzvbi63ZMZl_0 2024-09-12T00:55:13.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.947+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17024731119511660960', time=2024-09-12T02:51:57.428050+0000, chain.objs.size()=1 2024-09-12T00:55:13.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.947+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.J6sTl9cwZm2sXyLqG5Huf_zPBWqVEfk_0 2024-09-12T00:55:13.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.947+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18313890747044701950', time=2024-09-12T02:51:57.440816+0000, chain.objs.size()=1 2024-09-12T00:55:13.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.947+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.BtL7SdBJ16TtNCu_RuTRg8__hjmWt7r_0 2024-09-12T00:55:13.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.950+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.953+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:55:13.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.954+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:55:13.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15292665891768697852', time=2024-09-12T02:46:28.089516+0000, chain.objs.size()=4 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.13__multipart_foo.2~CuyNtxa3V1ZPNJ7keLEPdVTlJ4jhvgF.1 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.13__multipart_foo.2~CuyNtxa3V1ZPNJ7keLEPdVTlJ4jhvgF.2 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.13__multipart_foo.2~CuyNtxa3V1ZPNJ7keLEPdVTlJ4jhvgF.3 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.13__multipart_foo.2~CuyNtxa3V1ZPNJ7keLEPdVTlJ4jhvgF.4 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16814325615792721015', time=2024-09-12T02:48:26.457455+0000, chain.objs.size()=1 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.SQtHGeh-F97Ebr3dAI-ockg7CwWsmUc_0 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6920530444068245080', time=2024-09-12T02:48:28.208434+0000, chain.objs.size()=1 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.pwQ2RaBbMSY0vBmjgRiaUoX0HXMuzS6_0 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16810428338412882690', time=2024-09-12T02:49:02.776189+0000, chain.objs.size()=1 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.RFZOp3FlBSWuzSmb-rIJzyMocztQs5o_0 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3185919235584716745', time=2024-09-12T02:51:21.006365+0000, chain.objs.size()=1 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.376kY7WY6cuh4I0nIaO9sGea-u2gHs8_0 2024-09-12T00:55:13.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8381025002203679080', time=2024-09-12T02:51:22.949418+0000, chain.objs.size()=1 2024-09-12T00:55:13.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.UyNflkn_yT-XOOuY1eLkSicm-JZPkGF_0 2024-09-12T00:55:13.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1822295869518040', time=2024-09-12T02:51:23.964332+0000, chain.objs.size()=1 2024-09-12T00:55:13.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.QeyD9JIbskl37XcNN6O3w02RDEt8wJ2_0 2024-09-12T00:55:13.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8840284462614323652', time=2024-09-12T02:51:54.632501+0000, chain.objs.size()=1 2024-09-12T00:55:13.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.F_ERRq23brTojSa6liGWtY1NxFScfrs_0 2024-09-12T00:55:13.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3849380657172838199', time=2024-09-12T02:51:54.643276+0000, chain.objs.size()=1 2024-09-12T00:55:13.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.955+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.Z-1Xwi-wmJWY15ljZLWPPbcjf4TI5cf_0 2024-09-12T00:55:13.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.958+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10032090803560446319', time=2024-09-12T02:54:35.438740+0000, chain.objs.size()=1 2024-09-12T00:55:13.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.958+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.NtyTB4bsiZuJXbYcRSgMwR5oTDvOBOV_0 2024-09-12T00:55:13.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.961+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.964+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:55:13.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.965+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.965+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16088463193345235740', time=2024-09-12T02:47:53.373453+0000, chain.objs.size()=1 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.9VNI85PWAPlSEF9ck8JYgEAo8QOt4vz_0 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13738657494386434597', time=2024-09-12T02:47:53.382239+0000, chain.objs.size()=1 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.OIYqXeC9vnIihH9ORBOj8bOyl4HdJGF_0 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13681532345937793763', time=2024-09-12T02:48:27.178407+0000, chain.objs.size()=1 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.cK0kB8XPeX7YzeZsawmuCI2oCvFF-Db_0 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.634037489227053225', time=2024-09-12T02:48:28.224870+0000, chain.objs.size()=1 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.1kGtkvjRVypeVEsWmU9idcOIEvcVbnp_0 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6217376582624847892', time=2024-09-12T02:49:01.119265+0000, chain.objs.size()=1 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.ow_N8fCfESZjx3OolRB0j6WlGCTcwm-_0 2024-09-12T00:55:13.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12631630891446723446', time=2024-09-12T02:49:03.993815+0000, chain.objs.size()=1 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.FPWK1eQZL80xeILJI5wx6h9C2hlKSqD_0 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5236541418492057125', time=2024-09-12T02:50:11.144195+0000, chain.objs.size()=1 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.DurEHhXldXM73SREECd2cPailGyfumc_0 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17753110899972833126', time=2024-09-12T02:50:11.155395+0000, chain.objs.size()=1 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.kQShh9OETIEcCMKWLEzFfhlO1kgoSUn_0 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17157715701404466881', time=2024-09-12T02:50:46.605145+0000, chain.objs.size()=1 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.XYI42fg0SLmn8YG0gqP0JEI7YxdvE2j_0 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5321970189117877471', time=2024-09-12T02:50:47.148376+0000, chain.objs.size()=1 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.wXSdpD1SHMgED5DkrKmIaOFyoHFh27J_0 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7862752489188519225', time=2024-09-12T02:50:47.162117+0000, chain.objs.size()=1 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.5pQHfBwt-q-SBa6xv8L8Oih22A5swi__0 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10099790044522772458', time=2024-09-12T02:51:22.940898+0000, chain.objs.size()=1 2024-09-12T00:55:13.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.966+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.ecaOgiPkkHT3K1WAuXTg1FWTmIuZ_bV_0 2024-09-12T00:55:13.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.969+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14425130102742531317', time=2024-09-12T02:51:56.597252+0000, chain.objs.size()=1 2024-09-12T00:55:13.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.969+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.-iPbohaYPp8HHgYKkXapleJDA13695k_0 2024-09-12T00:55:13.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.970+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8350136036443471603', time=2024-09-12T02:51:57.433054+0000, chain.objs.size()=1 2024-09-12T00:55:13.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.970+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_._dv9G8uRb0lVK6Iqb5I48x9V8XKmSmH_0 2024-09-12T00:55:13.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.970+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2679986902275903413', time=2024-09-12T02:51:57.435811+0000, chain.objs.size()=1 2024-09-12T00:55:13.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.970+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.do9yToOFTMpl9fjXpL4gwbBROnBGQ0g_0 2024-09-12T00:55:13.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.970+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11482399857241681717', time=2024-09-12T02:54:35.440532+0000, chain.objs.size()=1 2024-09-12T00:55:13.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.970+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.RnL4XzcZjchvEWHxhkY-kPDrmkt3Pn4_0 2024-09-12T00:55:13.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.974+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.976+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:55:13.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.977+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T00:55:13.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_agU-s2eqdaNkneBMntZk7KWV6zCqqQ0', time=2024-09-12T02:46:28.159543+0000, chain.objs.size()=2 2024-09-12T00:55:13.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.13cBF--n_VlHHrD3gSYVQ6Z0TcHf8nJ_0 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.13cBF--n_VlHHrD3gSYVQ6Z0TcHf8nJ_1 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4169532593136232589', time=2024-09-12T02:47:53.380030+0000, chain.objs.size()=1 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.RYgXEPz_ajZrI8h_GYrALxB4YNcrfdJ_0 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15649269657191065703', time=2024-09-12T02:47:53.385291+0000, chain.objs.size()=1 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.1_U5Vexro2HCIaH72wQd6vDu77kFXK4_0 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12276877764604835523', time=2024-09-12T02:49:02.769169+0000, chain.objs.size()=1 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.WbV3B2SNwJ1STsLgKIYakLDGlXWuS4n_0 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2587505351464412118', time=2024-09-12T02:49:03.980074+0000, chain.objs.size()=1 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.dJZE248-PkBUCufWGNpnE5PyJ15XZy9_0 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10528562207657972285', time=2024-09-12T02:49:03.985918+0000, chain.objs.size()=1 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.v5pcKjKQZ_Y5G6nfm3a52BG6Fxua-hA_0 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1016920413116953481', time=2024-09-12T02:49:03.989804+0000, chain.objs.size()=1 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.a8bQs23zbx00uR0AI9t9BqkK4-F1WJm_0 2024-09-12T00:55:13.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9202673839072494877', time=2024-09-12T02:49:35.878064+0000, chain.objs.size()=1 2024-09-12T00:55:13.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.-9soI33oxZiWYvFY2zyWPFtq7cozOQF_0 2024-09-12T00:55:13.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17666011354666957061', time=2024-09-12T02:50:11.141471+0000, chain.objs.size()=1 2024-09-12T00:55:13.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.fpJdvo9s8FXvQt5j6kTojtR2p0keTPn_0 2024-09-12T00:55:13.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6179114487593894097', time=2024-09-12T02:50:11.150777+0000, chain.objs.size()=1 2024-09-12T00:55:13.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.abfaBaA07_mRKCLbVgChLBihgdbr-Wb_0 2024-09-12T00:55:13.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12669715124047641616', time=2024-09-12T02:50:12.377412+0000, chain.objs.size()=1 2024-09-12T00:55:13.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.978+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.GpHWVfLpz7pCEbJG7i6HhaoNq2RiFpC_0 2024-09-12T00:55:13.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.983+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9963340191473773669', time=2024-09-12T02:50:13.716145+0000, chain.objs.size()=1 2024-09-12T00:55:13.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.983+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_._rpTjDFaf393bD21CMjU-vHUvaePECD_0 2024-09-12T00:55:13.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.983+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17527575542591433455', time=2024-09-12T02:50:15.153211+0000, chain.objs.size()=1 2024-09-12T00:55:13.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.983+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.FcFbxii_rrAblORtsTb38-JNZYKRuRD_0 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6248608343144882300', time=2024-09-12T02:50:47.141871+0000, chain.objs.size()=1 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.kvfNepmuq0OC9kJlAI7RpGlU5bTWAf4_0 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3001666597979151922', time=2024-09-12T02:50:48.717061+0000, chain.objs.size()=1 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.jq3Euwn7iDi8tfQdtApOZC-ZYLxkt8L_0 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7661112719391686515', time=2024-09-12T02:51:21.004204+0000, chain.objs.size()=1 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.2JchRVLnbJGIfef6OOXeVyOPF2YO5N1_0 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.186209953271081138', time=2024-09-12T02:51:22.940343+0000, chain.objs.size()=1 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.PFiWTrTT_J9oFsbei5FSsb6Evpf_vrm_0 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.538420068058887438', time=2024-09-12T02:51:54.630987+0000, chain.objs.size()=1 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.yQti213cEj-_E9foijlETWCL0aB3SdZ_0 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2591454778745251095', time=2024-09-12T02:51:54.632369+0000, chain.objs.size()=1 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.ERfvjuG79vP6C9gks2B1iOu_2ZO0oPt_0 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.399378697363075115', time=2024-09-12T02:51:54.640601+0000, chain.objs.size()=1 2024-09-12T00:55:13.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.OOdmOgPXT43ZLH7AJ-szI2pIhHU6oMS_0 2024-09-12T00:55:13.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9660468601094104482', time=2024-09-12T02:51:56.604339+0000, chain.objs.size()=1 2024-09-12T00:55:13.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.wlDInhrzQXQvcW7QP2dRbUHElp_I7W8_0 2024-09-12T00:55:13.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.182407466561238233', time=2024-09-12T02:51:57.429077+0000, chain.objs.size()=1 2024-09-12T00:55:13.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.984+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.FoPMBd-U2QE3DaMEBwO06owGnxOb3it_0 2024-09-12T00:55:13.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.988+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13578535352997505852', time=2024-09-12T02:51:57.429805+0000, chain.objs.size()=1 2024-09-12T00:55:13.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.988+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.Ka6i5xBZ37Xe2Ml4JqzgWUcWnvI1UMX_0 2024-09-12T00:55:13.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.988+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16414692364463449545', time=2024-09-12T02:52:29.114948+0000, chain.objs.size()=1 2024-09-12T00:55:13.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.988+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.J78rIrvwHemDpMXzcdJw0Poqdvc5w8a_0 2024-09-12T00:55:13.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.988+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14639964899161068060', time=2024-09-12T02:52:29.117333+0000, chain.objs.size()=1 2024-09-12T00:55:13.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.988+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.CZZRB_BuaSoT7XmQ-mvyL5n4tKsbc0d_0 2024-09-12T00:55:13.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.988+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8705053756310096064', time=2024-09-12T02:54:48.836037+0000, chain.objs.size()=1 2024-09-12T00:55:13.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.988+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.19__shadow:NTNYMTjSqsaB4qd.e4wi3.vzPIsUjv7_._HQT0cbwZ4P803Y44EgheuUOtur5uKy_0 2024-09-12T00:55:13.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.991+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:13.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.995+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:55:13.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.996+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:13.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.996+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16154578081488253045', time=2024-09-12T02:46:28.296721+0000, chain.objs.size()=3 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.CXdZOnJ3Y-rVUve3y3p_wTpmWbbfOt4_0 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.CXdZOnJ3Y-rVUve3y3p_wTpmWbbfOt4_1 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.CXdZOnJ3Y-rVUve3y3p_wTpmWbbfOt4_2 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11026001251837182292', time=2024-09-12T02:47:52.140509+0000, chain.objs.size()=1 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.-kOJ2Zihe7ZOUtaOareaIfvqBxlVszg_0 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3544793046426085842', time=2024-09-12T02:48:25.048977+0000, chain.objs.size()=1 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.1hys79MQCYFd-ekv864ydUAdWXeZZYX_0 2024-09-12T00:55:13.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4778095798475620028', time=2024-09-12T02:49:35.884534+0000, chain.objs.size()=1 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.tIU2_AJgMFEj0kfncsJe3uovlrcf9OZ_0 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2330482230033959103', time=2024-09-12T02:49:35.891058+0000, chain.objs.size()=1 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.2poBAs9C0ZgLmTxNAqxQn6C2uD-Kdmi_0 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6909232500019334812', time=2024-09-12T02:50:11.155425+0000, chain.objs.size()=1 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.SfRI5wJ3arqmJsNkA8BnHvsB4MFRSKi_0 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6691344050298966682', time=2024-09-12T02:50:15.146284+0000, chain.objs.size()=1 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.kiVa19aLOXuDk2g6geSNjpFVZxBn6T-_0 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4606048464662900191', time=2024-09-12T02:50:48.715931+0000, chain.objs.size()=1 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.Ng2rrFInqEYSwb6ZvAH2YYaoGeQAQV6_0 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11507340070651672316', time=2024-09-12T02:50:48.728429+0000, chain.objs.size()=1 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.OWo-JzNurKeUTjNtK7aBKzyG3ZJ9lms_0 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5720151725845836005', time=2024-09-12T02:51:22.946025+0000, chain.objs.size()=1 2024-09-12T00:55:13.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:13.997+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.fw7xs7be2ctenhOjmoSkT49GMaa60-4_0 2024-09-12T00:55:14.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.001+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12890210684415629319', time=2024-09-12T02:51:22.947311+0000, chain.objs.size()=1 2024-09-12T00:55:14.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.001+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.3zn4Q4DLbe5QbSilNck_ct2Hg5OYCIu_0 2024-09-12T00:55:14.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.001+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16994216843188025176', time=2024-09-12T02:51:54.623337+0000, chain.objs.size()=1 2024-09-12T00:55:14.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.001+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.hvt0P7hHcnMMKu8FZ7ro1Yedb7MKLlt_0 2024-09-12T00:55:14.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.002+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11893471885699604807', time=2024-09-12T02:51:58.444867+0000, chain.objs.size()=1 2024-09-12T00:55:14.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.002+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.40__shadow_.umOy4oUJ3IVtGgjUQ5bu8VvU3fDfBQG_0 2024-09-12T00:55:14.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.002+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4103421095896430571', time=2024-09-12T02:54:35.443180+0000, chain.objs.size()=1 2024-09-12T00:55:14.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.002+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.C0y7Lxa234X6Fwc4s-ryEzjvYGVwCGa_0 2024-09-12T00:55:14.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.005+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:14.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.007+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:55:14.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.008+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6363602362399097346', time=2024-09-12T02:46:28.053368+0000, chain.objs.size()=1 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.QJrYjWgxmG2Mgj6u65v9BY7bozWk9i5_0 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1799723717736693119', time=2024-09-12T02:46:28.171656+0000, chain.objs.size()=2 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.MG8nPlonksgcChJv_OYjBh4RwMnHcsi_0 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.MG8nPlonksgcChJv_OYjBh4RwMnHcsi_1 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_x_uRNfNdxV3Zg8pELVDqWDgjBT9zg5m', time=2024-09-12T02:46:28.218913+0000, chain.objs.size()=3 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.wuUG0FgwE90cigINEBKB1n8kU9t9wqa_0 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.009+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.wuUG0FgwE90cigINEBKB1n8kU9t9wqa_1 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.wuUG0FgwE90cigINEBKB1n8kU9t9wqa_2 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12928961352979677850', time=2024-09-12T02:46:28.379783+0000, chain.objs.size()=1 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.9__shadow_.Pj1Vf2LT52pEbun5PX3dKeg-hrUnCEc_0 2024-09-12T00:55:14.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15460538141100427506', time=2024-09-12T02:47:53.368508+0000, chain.objs.size()=1 2024-09-12T00:55:14.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.9WHBUK34HdwmS4TADdxnxmxA655gJly_0 2024-09-12T00:55:14.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8839113791397311632', time=2024-09-12T02:47:53.384168+0000, chain.objs.size()=1 2024-09-12T00:55:14.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.21__shadow_.y6zPKT0c5F87Jb-JZmgTz3HyfZPWCtJ_0 2024-09-12T00:55:14.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16899741836425910835', time=2024-09-12T02:48:27.179949+0000, chain.objs.size()=1 2024-09-12T00:55:14.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.puJn7lJovqQnjyeZvPQ1kxf-R6K5MaG_0 2024-09-12T00:55:14.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5212145755361969160', time=2024-09-12T02:48:27.186926+0000, chain.objs.size()=1 2024-09-12T00:55:14.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.23__shadow_.diJLGn5p12_E_H60wJBAHkR-J6pKa3v_0 2024-09-12T00:55:14.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17526549735312479456', time=2024-09-12T02:49:01.121051+0000, chain.objs.size()=1 2024-09-12T00:55:14.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.010+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.lU2L8LvCr6US6Wc15xEJWeWbpXOcPyy_0 2024-09-12T00:55:14.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.013+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4984983979922387291', time=2024-09-12T02:49:03.989260+0000, chain.objs.size()=1 2024-09-12T00:55:14.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.013+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.27__shadow_.O9ZlXTXP7rWIu7Ko-L8N9dDzzx8AZkT_0 2024-09-12T00:55:14.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.014+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13153601934969780576', time=2024-09-12T02:49:37.313002+0000, chain.objs.size()=1 2024-09-12T00:55:14.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.014+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.7dPJIU4tpAXQgZu2tQwr0NBfrACh7-z_0 2024-09-12T00:55:14.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.014+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4220373562548883857', time=2024-09-12T02:49:38.228881+0000, chain.objs.size()=1 2024-09-12T00:55:14.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.014+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.aJofd1Vse7uxKG194OnEZFePB05Ja1B_0 2024-09-12T00:55:14.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.014+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6058865255555809847', time=2024-09-12T02:50:13.712263+0000, chain.objs.size()=1 2024-09-12T00:55:14.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.014+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.CWLtg9Ot1oo4uzKIMVEk1jcUl8ygYnS_0 2024-09-12T00:55:14.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.015+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14202473525553574790', time=2024-09-12T02:50:48.720923+0000, chain.objs.size()=1 2024-09-12T00:55:14.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.015+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.ZzdqyYBXboVqfWtt-8BftSOsNE2qo-o_0 2024-09-12T00:55:14.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.015+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5971859287582190063', time=2024-09-12T02:51:56.595605+0000, chain.objs.size()=1 2024-09-12T00:55:14.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.015+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.0wr_2mYTS8D2fNwsMFkf1xIDFSiXHE0_0 2024-09-12T00:55:14.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.015+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12732276919003440618', time=2024-09-12T02:51:57.432919+0000, chain.objs.size()=1 2024-09-12T00:55:14.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.015+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.DoVtPA1F2ZjwzUGJV2ALXgWx8aMbQuJ_0 2024-09-12T00:55:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.019+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:14.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.021+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:55:14.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.023+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.023+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2738704888318142884', time=2024-09-12T02:46:28.062099+0000, chain.objs.size()=1 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.0uYS8gzDbprxSMwDorBPzbgzUMc-HZG_0 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_to-wl91l2MBF7RQ8lHwFQp6aeDzHrOf', time=2024-09-12T02:46:28.191361+0000, chain.objs.size()=1 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.16__shadow_.68Y30TEfBlzfJZOwpCgUJjz9LTJ49___0 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='_-_3BqJLM8u5gGTzg5HTVoNRiSL1jCfR', time=2024-09-12T02:46:28.231190+0000, chain.objs.size()=3 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.UZuEkjKtPDAV0SygaX3fAC_qwr3SbLy_0 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.UZuEkjKtPDAV0SygaX3fAC_qwr3SbLy_1 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_.UZuEkjKtPDAV0SygaX3fAC_qwr3SbLy_2 2024-09-12T00:55:14.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17571563513785573170', time=2024-09-12T02:46:28.235354+0000, chain.objs.size()=5 2024-09-12T00:55:14.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.1 2024-09-12T00:55:14.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.1_1 2024-09-12T00:55:14.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.2 2024-09-12T00:55:14.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__shadow_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.2_1 2024-09-12T00:55:14.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.17__multipart_foo-LUKEWARM.2~2eljapG58Wexg-Tfb7uz32ZilMV1Sr9.3 2024-09-12T00:55:14.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17958428436095683054', time=2024-09-12T02:46:28.366591+0000, chain.objs.size()=1 2024-09-12T00:55:14.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.9__shadow_.4aRFOvLk3eSMC-dJSno1Y1ZRkr_tOUh_0 2024-09-12T00:55:14.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.25041564693886740', time=2024-09-12T02:48:25.045036+0000, chain.objs.size()=1 2024-09-12T00:55:14.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.024+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.flyA2648R5DGMLGezLIZQkB_6_OC7Bf_0 2024-09-12T00:55:14.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12091647531105486551', time=2024-09-12T02:49:02.764328+0000, chain.objs.size()=1 2024-09-12T00:55:14.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.qwMx7GhOwHe4AVR38oClf4u8bwTuqDk_0 2024-09-12T00:55:14.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.701132421414371099', time=2024-09-12T02:49:35.879530+0000, chain.objs.size()=1 2024-09-12T00:55:14.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.m-AmgtSw9pQEjOerCzbt4UHJv1QIj-L_0 2024-09-12T00:55:14.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.908220554480816739', time=2024-09-12T02:49:35.880255+0000, chain.objs.size()=1 2024-09-12T00:55:14.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.T2uOSvekyc-cCN_HrFtoZFET5DGj0L8_0 2024-09-12T00:55:14.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4431719622073794607', time=2024-09-12T02:49:35.881357+0000, chain.objs.size()=1 2024-09-12T00:55:14.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.bk4zY4tsiamklCN_LwnjrQ8LnnDNlOp_0 2024-09-12T00:55:14.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1913393805109066894', time=2024-09-12T02:50:47.163935+0000, chain.objs.size()=1 2024-09-12T00:55:14.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.75hjj5_zLojEIxDV7WuVtqNyBxMRBjy_0 2024-09-12T00:55:14.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5139312242398785418', time=2024-09-12T02:50:48.724164+0000, chain.objs.size()=1 2024-09-12T00:55:14.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.1d0smEpECIXVDAm-8QUMG3u3tTVIheq_0 2024-09-12T00:55:14.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12959280447282141370', time=2024-09-12T02:50:48.725633+0000, chain.objs.size()=1 2024-09-12T00:55:14.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.PRGfg9OhdoPZCdigXdQRVlN2o8XdXsH_0 2024-09-12T00:55:14.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9915636773910651592', time=2024-09-12T02:51:22.942206+0000, chain.objs.size()=1 2024-09-12T00:55:14.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.tPHSplyKzWGA_K-WgC8s9tI0JeA6qTN_0 2024-09-12T00:55:14.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.521784131526129369', time=2024-09-12T02:51:57.429194+0000, chain.objs.size()=1 2024-09-12T00:55:14.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.027+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.39__shadow_.Zg68EanhTtweyFTb_JUBDg60p3xXxxC_0 2024-09-12T00:55:14.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.031+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:14.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.034+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:55:14.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.035+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.035+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:55:14.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.727932486181784996', time=2024-09-12T02:46:28.291326+0000, chain.objs.size()=3 2024-09-12T00:55:14.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.BouH6xau7WCeB64kiW2KyLkgyK8lTdz_0 2024-09-12T00:55:14.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.BouH6xau7WCeB64kiW2KyLkgyK8lTdz_1 2024-09-12T00:55:14.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.14__shadow_.BouH6xau7WCeB64kiW2KyLkgyK8lTdz_2 2024-09-12T00:55:14.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8993885800482348573', time=2024-09-12T02:48:25.044365+0000, chain.objs.size()=1 2024-09-12T00:55:14.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.O8wRYfQm-rGiu0k9ci0ifobJwXjaGOn_0 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5184117678967930884', time=2024-09-12T02:48:28.211798+0000, chain.objs.size()=1 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.Ff3ihf3NGl9Yv6YUT4AAajJJ2mPXdzN_0 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2650120065126373946', time=2024-09-12T02:49:01.110811+0000, chain.objs.size()=1 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.jOzbPVmh_m_UqJDl7G4-zb9fGSfWsK3_0 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13099811725874823234', time=2024-09-12T02:49:01.967080+0000, chain.objs.size()=1 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.26__shadow_.23xy5k8jKTzUMasNNkFSRewvzwRp7VZ_0 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5865451941514793853', time=2024-09-12T02:49:35.872514+0000, chain.objs.size()=1 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.B5WDmdfJ4dQQp_bc07cfl_McrgxUcWC_0 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17433088170521693934', time=2024-09-12T02:49:38.234518+0000, chain.objs.size()=1 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.jQ8pZgw8j3-JoykYX0M0ZIcRJKkCotx_0 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15372686858965944273', time=2024-09-12T02:49:38.235128+0000, chain.objs.size()=1 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.29__shadow_.EaJ_tToE4eW96x7r7wpUyphGeHJwQPh_0 2024-09-12T00:55:14.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9331300431723261766', time=2024-09-12T02:50:11.147831+0000, chain.objs.size()=1 2024-09-12T00:55:14.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.30__shadow_.fVD5gBLRvljtmYXAMtUEVZrp1n0lBo1_0 2024-09-12T00:55:14.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12297812374269620312', time=2024-09-12T02:50:13.700887+0000, chain.objs.size()=1 2024-09-12T00:55:14.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.036+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.G-wy7yhb3GTPNMpIPKx8xEp0S_MjYV2_0 2024-09-12T00:55:14.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.039+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.68030720542266213', time=2024-09-12T02:50:47.153919+0000, chain.objs.size()=1 2024-09-12T00:55:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.039+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.sQkGVwIsmkkhveXNebQ9MOYoJ3IRIFO_0 2024-09-12T00:55:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.039+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5865256991423653707', time=2024-09-12T02:50:48.205585+0000, chain.objs.size()=1 2024-09-12T00:55:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.039+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.34__shadow_.W2spEUFlgaXEGvYABYe53y4teWAL-Ds_0 2024-09-12T00:55:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.039+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.275691972087157552', time=2024-09-12T02:51:22.940488+0000, chain.objs.size()=1 2024-09-12T00:55:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.039+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_._1jBn2Uep1Az8PVb8zf97sE7wLrE-0Z_0 2024-09-12T00:55:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.039+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1390593802788579557', time=2024-09-12T02:51:56.600283+0000, chain.objs.size()=1 2024-09-12T00:55:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.039+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.38__shadow_.h59MTANUj_XgUAQOA4-5vSDyz9WrFTy_0 2024-09-12T00:55:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.040+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18217316526377138866', time=2024-09-12T02:54:35.444968+0000, chain.objs.size()=1 2024-09-12T00:55:14.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.040+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.18__shadow_.yKGHYwW0ovJPD-wCL1LSHic0JB98AvJ_0 2024-09-12T00:55:14.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.043+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:14.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.045+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:55:14.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.047+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.047+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.047+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.047+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1357618948363251008', time=2024-09-12T02:46:28.031437+0000, chain.objs.size()=1 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.047+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.5__shadow_.4UYbSlm1n5W6htkUyhurMfPpACItp-__0 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.047+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6372601645585486949', time=2024-09-12T02:47:52.130121+0000, chain.objs.size()=1 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.047+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.20__shadow_.0-LdK6XptTL58tVcFXj1TLbA-fW_QcL_0 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2879672367202854914', time=2024-09-12T02:48:25.054068+0000, chain.objs.size()=1 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.Yf8o0khGH0dA2D5b7OSJHkxgcFD7S3x_0 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13911256768028115841', time=2024-09-12T02:48:28.211122+0000, chain.objs.size()=1 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.24__shadow_.t64HOdmGE04o5FVbf0j_Yaiq15ruNSL_0 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8625100512687118645', time=2024-09-12T02:49:01.111331+0000, chain.objs.size()=1 2024-09-12T00:55:14.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.25__shadow_.DVvXhfSmerGCEhkv9WWs--bSqKQxrxA_0 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9421202529545467675', time=2024-09-12T02:50:13.706831+0000, chain.objs.size()=1 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.Vzyl_c18Tcbkklj5Xu9qMLIXFoSPWoI_0 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10916555624276197269', time=2024-09-12T02:50:15.145739+0000, chain.objs.size()=1 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.32__shadow_.49WTkX0GeaVewwSeEPgkIEM38-X13F1_0 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16434541822821762133', time=2024-09-12T02:51:20.992839+0000, chain.objs.size()=1 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.lDeWC7DXGEXVjaVoAU4yUn-49tLm2bP_0 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12169656941070791589', time=2024-09-12T02:51:21.005929+0000, chain.objs.size()=1 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.35__shadow_.0znGrrUeTLmKWvqWQ5vE2fw7PXpvIMA_0 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6655298482828191308', time=2024-09-12T02:51:22.947665+0000, chain.objs.size()=1 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_._1uDuirLajcJ4dRp5Yoq5LlfiR2P_Gm_0 2024-09-12T00:55:14.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4971682110858128796', time=2024-09-12T02:51:22.948379+0000, chain.objs.size()=1 2024-09-12T00:55:14.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.048+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.36__shadow_.JrrGaMEYMgZReV7XvBxQR__IdhQGCGH_0 2024-09-12T00:55:14.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.052+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:14.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.055+0000 7f7c0a73e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:55:14.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.056+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.056+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16623891561342843582', time=2024-09-12T02:48:25.063930+0000, chain.objs.size()=1 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.22__shadow_.suM3gHpZNGkOkkAYiRHvpAtwGkHt9jj_0 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.440254182332973055', time=2024-09-12T02:49:05.207046+0000, chain.objs.size()=1 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.28__shadow_.WhJ5e2KdwXfmXV3uQPH4YYixg_sxBYF_0 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1524003772308651595', time=2024-09-12T02:50:13.714767+0000, chain.objs.size()=1 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.31__shadow_.1WxAyOSlUwqyJelmBy6hetQJdNbjjFA_0 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10298822130289364644', time=2024-09-12T02:50:47.148654+0000, chain.objs.size()=1 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.33__shadow_.UIv1Xt67cLZOLq_0B7Qjl0mAw13HZuY_0 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.455609368922981971', time=2024-09-12T02:51:54.623977+0000, chain.objs.size()=1 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.5uEtF-FsJZiPYRzD-TyuB1RVA52b0-y_0 2024-09-12T00:55:14.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2508482845275334388', time=2024-09-12T02:51:54.629099+0000, chain.objs.size()=1 2024-09-12T00:55:14.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.057+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.37__shadow_.pULIwXi6bTJAxnC5IfFw3uzrNtbP3VC_0 2024-09-12T00:55:14.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.059+0000 7f7c0a73e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:55:14.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.063+0000 7f7abcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:14.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.064+0000 7f7c0a73e800 20 remove_watcher() i=0 2024-09-12T00:55:14.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.064+0000 7f7c0a73e800 2 removed watcher, disabling cache 2024-09-12T00:55:14.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.066+0000 7f7c0a73e800 20 remove_watcher() i=1 2024-09-12T00:55:14.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.067+0000 7f7c0a73e800 20 remove_watcher() i=2 2024-09-12T00:55:14.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.067+0000 7f7c0a73e800 20 remove_watcher() i=3 2024-09-12T00:55:14.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.068+0000 7f7c0a73e800 20 remove_watcher() i=4 2024-09-12T00:55:14.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.069+0000 7f7c0a73e800 20 remove_watcher() i=5 2024-09-12T00:55:14.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.070+0000 7f7c0a73e800 20 remove_watcher() i=6 2024-09-12T00:55:14.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.071+0000 7f7c0a73e800 20 remove_watcher() i=7 2024-09-12T00:55:14.081 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:55:14.173 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:14.173 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:14.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.210+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.211+0000 7fb3cb539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.211+0000 7fb3cb539800 20 realm 2024-09-12T00:55:14.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.211+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.211+0000 7fb3cb539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.211+0000 7fb3cb539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:14.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.211+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.211+0000 7fb3cb539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.211+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.212+0000 7fb3cb539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:14.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.212+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.212+0000 7fb3cb539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:14.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.212+0000 7fb3cb539800 20 searching for the correct realm 2024-09-12T00:55:14.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.215+0000 7fb3bffff640 0 -- 172.21.15.83:0/1228365830 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fb3b0095910 msgr2=0x7fb3b0063400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:14.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.420+0000 7fb3bffff640 0 -- 172.21.15.83:0/1228365830 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5627de04c4a0 msgr2=0x5627de04e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:14.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.424+0000 7fb3cb539800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:55:14.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.424+0000 7fb3cb539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:14.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.424+0000 7fb3cb539800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:55:14.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.424+0000 7fb3cb539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:14.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.424+0000 7fb3cb539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:14.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.424+0000 7fb3cb539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:14.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.424+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.424+0000 7fb3cb539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.424+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 20 zone default found 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 4 Realm: () 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 20 zonegroup default 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.425+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.426+0000 7fb3cb539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.426+0000 7fb3cb539800 20 rados->read ofs=0 len=0 2024-09-12T00:55:14.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.426+0000 7fb3cb539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:14.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.426+0000 7fb3cb539800 20 started sync module instance, tier type = 2024-09-12T00:55:14.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.426+0000 7fb3cb539800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:55:14.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.434+0000 7fb3cb539800 20 add_watcher() i=0 2024-09-12T00:55:14.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.434+0000 7fb3cb539800 20 add_watcher() i=1 2024-09-12T00:55:14.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.434+0000 7fb3cb539800 20 add_watcher() i=2 2024-09-12T00:55:14.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.434+0000 7fb3cb539800 20 add_watcher() i=3 2024-09-12T00:55:14.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.434+0000 7fb3cb539800 20 add_watcher() i=4 2024-09-12T00:55:14.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.434+0000 7fb3cb539800 20 add_watcher() i=5 2024-09-12T00:55:14.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.434+0000 7fb3cb539800 20 add_watcher() i=6 2024-09-12T00:55:14.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.435+0000 7fb3cb539800 20 add_watcher() i=7 2024-09-12T00:55:14.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.435+0000 7fb3cb539800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:14.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.436+0000 7fb27dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:14.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.436+0000 7fb3cb539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:14.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.436+0000 7fb3cb539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:14.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.470+0000 7fb27cfe1640 20 reqs_thread_entry: start 2024-09-12T00:55:14.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.470+0000 7fb3cb539800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:14.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.470+0000 7fb3cb539800 20 Filter name: none 2024-09-12T00:55:14.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.470+0000 7fb1f67fc640 20 reqs_thread_entry: start 2024-09-12T00:55:14.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.470+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:55:14.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.471+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.472+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.472+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.473+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:55:14.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.474+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.474+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.475+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.476+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:55:14.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.477+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.477+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.478+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.479+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:55:14.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.480+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.480+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.480+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.481+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:55:14.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.483+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.483+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.483+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.484+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:55:14.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.485+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.486+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.486+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.487+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:55:14.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.488+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.489+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.489+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.490+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:55:14.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.491+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.492+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.492+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.494+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:55:14.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.495+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.495+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.496+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.497+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:55:14.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.498+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.499+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.499+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.500+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:55:14.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.501+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.502+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.502+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.503+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:55:14.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.504+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.504+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.505+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.506+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:55:14.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.507+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.507+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.507+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.508+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:55:14.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.510+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.510+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.510+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.511+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:55:14.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.512+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.513+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.513+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.514+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:55:14.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.516+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.517+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.517+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.518+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:55:14.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.519+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.520+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.520+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.521+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:55:14.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.522+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.523+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.523+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.524+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:55:14.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.525+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.525+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.526+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.527+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:55:14.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.528+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.528+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.528+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.529+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:55:14.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.531+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.531+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.532+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.533+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:55:14.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.534+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.535+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.535+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.536+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:55:14.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.537+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.538+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.538+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.539+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:55:14.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.540+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.541+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.541+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.542+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:55:14.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.544+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.544+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.544+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.545+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:55:14.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.546+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.547+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.547+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.548+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:55:14.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.549+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.549+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.550+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.550+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:55:14.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.552+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.552+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.552+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.554+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:55:14.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.555+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.555+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.556+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.556+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:55:14.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.558+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.558+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.558+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.559+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:55:14.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.561+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.561+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.561+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.562+0000 7fb3cb539800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:55:14.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.564+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.564+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:55:14.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.564+0000 7fb3cb539800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:55:14.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.566+0000 7fb27dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:14.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.568+0000 7fb3cb539800 20 remove_watcher() i=0 2024-09-12T00:55:14.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.568+0000 7fb3cb539800 2 removed watcher, disabling cache 2024-09-12T00:55:14.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.569+0000 7fb3cb539800 20 remove_watcher() i=1 2024-09-12T00:55:14.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.570+0000 7fb3cb539800 20 remove_watcher() i=2 2024-09-12T00:55:14.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.571+0000 7fb3cb539800 20 remove_watcher() i=3 2024-09-12T00:55:14.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.571+0000 7fb3cb539800 20 remove_watcher() i=4 2024-09-12T00:55:14.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.572+0000 7fb3cb539800 20 remove_watcher() i=5 2024-09-12T00:55:14.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.573+0000 7fb3cb539800 20 remove_watcher() i=6 2024-09-12T00:55:14.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:55:14.574+0000 7fb3cb539800 20 remove_watcher() i=7 2024-09-12T00:55:14.585 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:55:15.073 INFO:teuthology.orchestra.run.smithi083.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:55:18.674 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:55:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileJava 2024-09-12T00:55:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processResources 2024-09-12T00:55:36.573 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :classes 2024-09-12T00:55:37.372 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:37.372 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileTestJava 2024-09-12T00:55:37.373 INFO:teuthology.orchestra.run.smithi083.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:55:37.373 INFO:teuthology.orchestra.run.smithi083.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:55:37.373 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:37.373 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:55:37.374 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :testClasses 2024-09-12T00:55:43.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:43.272 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :test 2024-09-12T00:55:43.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:43.272 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:55:44.371 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:44.372 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:55:44.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:55:44.671 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:44.672 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:55:44.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:44.872 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:55:45.372 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:45.372 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:55:45.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:45.572 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:55:45.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:45.572 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:55:45.672 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:55:45.672 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:45.672 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:55:45.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:45.872 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:55:46.372 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:46.372 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:55:46.671 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:46.672 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:55:46.872 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:46.872 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:55:46.872 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12 00:55:46,786 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:55:50.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:50.872 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:55:51.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:51.272 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:55:51.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:51.272 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:55:51.471 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:51.472 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:55:51.472 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:51.472 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:55:51.771 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:51.771 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:55:52.071 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:52.071 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:55:52.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:52.272 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:55:52.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:52.272 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:55:52.371 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:52.372 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:55:54.672 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:54.672 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:55:54.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:54.871 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:55:55.471 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:55.471 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:55:55.671 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:55.672 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:55:55.971 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:55.972 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:55:56.071 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:56.071 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:55:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:55:59.872 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:56:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:00.072 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:56:01.471 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:01.472 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:56:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:01.672 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:56:02.072 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:02.072 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:56:02.271 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:02.272 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:56:02.672 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:02.672 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:56:02.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:02.872 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:56:02.872 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:02.872 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:56:03.071 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.071 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:56:03.072 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.072 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:56:03.271 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.272 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:56:03.272 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.272 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:56:03.471 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.472 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:56:03.472 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.472 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:56:03.671 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.672 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:56:03.771 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.771 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:56:03.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.871 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:56:03.971 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:03.971 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:56:04.071 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:04.072 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:56:04.172 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:04.172 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:56:04.371 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:04.371 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:56:04.872 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:04.872 INFO:teuthology.orchestra.run.smithi083.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:56:05.072 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:05.072 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------------------------------------------------- 2024-09-12T00:56:05.072 INFO:teuthology.orchestra.run.smithi083.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:56:05.073 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------------------------------------------------- 2024-09-12T00:56:05.073 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:05.073 INFO:teuthology.orchestra.run.smithi083.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:56:05.073 INFO:teuthology.orchestra.run.smithi083.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:56:05.073 INFO:teuthology.orchestra.run.smithi083.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:56:05.073 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:05.073 INFO:teuthology.orchestra.run.smithi083.stdout:BUILD SUCCESSFUL in 50s 2024-09-12T00:56:05.073 INFO:teuthology.orchestra.run.smithi083.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:56:05.416 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:05.468 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:05.469 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:05.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.507+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.508+0000 7fc0f9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:05.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.508+0000 7fc0f9d25800 20 realm 2024-09-12T00:56:05.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.508+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.508+0000 7fc0f9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:05.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.508+0000 7fc0f9d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:05.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.508+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.508+0000 7fc0f9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:05.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.508+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.509+0000 7fc0f9d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:05.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.509+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.510+0000 7fc0f9d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:05.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.510+0000 7fc0f9d25800 20 searching for the correct realm 2024-09-12T00:56:05.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.715+0000 7fc0effff640 0 -- 172.21.15.83:0/2485055355 >> [v2:172.21.15.120:6800/3447039892,v1:172.21.15.120:6801/3447039892] conn(0x555d00d44d00 msgr2=0x555d00d471c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:05.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.718+0000 7fc0f59b5640 0 -- 172.21.15.83:0/2485055355 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fc0f0027040 msgr2=0x7fc0f0019a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:05.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.925+0000 7fc0f9d25800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:05.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.925+0000 7fc0f9d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:05.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.925+0000 7fc0f9d25800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:05.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.925+0000 7fc0f9d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:05.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.925+0000 7fc0f9d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:05.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.925+0000 7fc0f9d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:05.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:05.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:05.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:05.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 20 zone default found 2024-09-12T00:56:05.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 4 Realm: () 2024-09-12T00:56:05.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 20 zonegroup default 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.926+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.927+0000 7fc0f9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.927+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.927+0000 7fc0f9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.927+0000 7fc0f9d25800 20 rados->read ofs=0 len=0 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.928+0000 7fc0f9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.928+0000 7fc0f9d25800 20 started sync module instance, tier type = 2024-09-12T00:56:05.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.928+0000 7fc0f9d25800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:05.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.937+0000 7fc0f9d25800 20 add_watcher() i=0 2024-09-12T00:56:05.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.937+0000 7fc0f9d25800 20 add_watcher() i=1 2024-09-12T00:56:05.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.937+0000 7fc0f9d25800 20 add_watcher() i=2 2024-09-12T00:56:05.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.937+0000 7fc0f9d25800 20 add_watcher() i=3 2024-09-12T00:56:05.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.937+0000 7fc0f9d25800 20 add_watcher() i=4 2024-09-12T00:56:05.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.937+0000 7fc0f9d25800 20 add_watcher() i=5 2024-09-12T00:56:05.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.937+0000 7fc0f9d25800 20 add_watcher() i=6 2024-09-12T00:56:05.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.938+0000 7fc0f9d25800 20 add_watcher() i=7 2024-09-12T00:56:05.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.938+0000 7fc0f9d25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:05.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.940+0000 7fbfa77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:05.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.940+0000 7fc0f9d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:05.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.940+0000 7fc0f9d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:05.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.979+0000 7fbfa67fc640 20 reqs_thread_entry: start 2024-09-12T00:56:05.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.979+0000 7fc0f9d25800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:05.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.979+0000 7fc0f9d25800 20 Filter name: none 2024-09-12T00:56:05.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.979+0000 7fbf17fff640 20 reqs_thread_entry: start 2024-09-12T00:56:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.979+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:05.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.981+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:05.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:05.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:05.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5738560752570215719', time=2024-09-12T02:55:49.054515+0000, chain.objs.size()=9 2024-09-12T00:56:05.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~Q7zxx0MsadGyj9yopasa94zSUHHqGSl.1 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~Q7zxx0MsadGyj9yopasa94zSUHHqGSl.1_1 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~Q7zxx0MsadGyj9yopasa94zSUHHqGSl.2 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~Q7zxx0MsadGyj9yopasa94zSUHHqGSl.2_1 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~Q7zxx0MsadGyj9yopasa94zSUHHqGSl.3 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~Q7zxx0MsadGyj9yopasa94zSUHHqGSl.3_1 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~Q7zxx0MsadGyj9yopasa94zSUHHqGSl.4 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~Q7zxx0MsadGyj9yopasa94zSUHHqGSl.4_1 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~Q7zxx0MsadGyj9yopasa94zSUHHqGSl.5 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6789658210193658450', time=2024-09-12T02:55:55.540777+0000, chain.objs.size()=1 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_.y8xEFMDjnHbNgiLaDg9Qno9feo5mIAZ_0 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3847385313569316966', time=2024-09-12T02:56:02.142874+0000, chain.objs.size()=9 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.58__multipart_key1.2~W0Ob3ele5UkXBmfzmPrJlcZnVZFYaEj.1 2024-09-12T00:56:05.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.982+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.58__shadow_key1.2~W0Ob3ele5UkXBmfzmPrJlcZnVZFYaEj.1_1 2024-09-12T00:56:05.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.986+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.58__multipart_key1.2~W0Ob3ele5UkXBmfzmPrJlcZnVZFYaEj.2 2024-09-12T00:56:05.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.986+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.58__shadow_key1.2~W0Ob3ele5UkXBmfzmPrJlcZnVZFYaEj.2_1 2024-09-12T00:56:05.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.986+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.58__multipart_key1.2~W0Ob3ele5UkXBmfzmPrJlcZnVZFYaEj.3 2024-09-12T00:56:05.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.987+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.58__shadow_key1.2~W0Ob3ele5UkXBmfzmPrJlcZnVZFYaEj.3_1 2024-09-12T00:56:05.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.989+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.58__multipart_key1.2~W0Ob3ele5UkXBmfzmPrJlcZnVZFYaEj.4 2024-09-12T00:56:05.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.989+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.58__shadow_key1.2~W0Ob3ele5UkXBmfzmPrJlcZnVZFYaEj.4_1 2024-09-12T00:56:05.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.989+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.58__multipart_key1.2~W0Ob3ele5UkXBmfzmPrJlcZnVZFYaEj.5 2024-09-12T00:56:05.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.993+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:05.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.996+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:05.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.997+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:05.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.997+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:05.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:05.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11678627290236501025', time=2024-09-12T02:55:50.960446+0000, chain.objs.size()=7 2024-09-12T00:56:05.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~-OS9UgexQumKELU-5P71qd6k_OAd4rF.1 2024-09-12T00:56:05.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~-OS9UgexQumKELU-5P71qd6k_OAd4rF.1_1 2024-09-12T00:56:05.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~-OS9UgexQumKELU-5P71qd6k_OAd4rF.1_2 2024-09-12T00:56:05.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~-OS9UgexQumKELU-5P71qd6k_OAd4rF.2 2024-09-12T00:56:05.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~-OS9UgexQumKELU-5P71qd6k_OAd4rF.2_1 2024-09-12T00:56:05.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~-OS9UgexQumKELU-5P71qd6k_OAd4rF.2_2 2024-09-12T00:56:05.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~-OS9UgexQumKELU-5P71qd6k_OAd4rF.3 2024-09-12T00:56:05.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1511350212156199688', time=2024-09-12T02:56:00.987935+0000, chain.objs.size()=1 2024-09-12T00:56:05.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__shadow_.WMbHdsxTmu7EFCnYpJRWQdnmkpplDjO_0 2024-09-12T00:56:05.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5186100897783894479', time=2024-09-12T02:56:03.135574+0000, chain.objs.size()=1 2024-09-12T00:56:05.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:05.998+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.61__shadow_.8f6oS0mOlpKR1vbBIgvIwAydb_jhh10_0 2024-09-12T00:56:06.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.002+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.005+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:06.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.006+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.006+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14100967550767890621', time=2024-09-12T02:55:52.113309+0000, chain.objs.size()=9 2024-09-12T00:56:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.52__multipart_key1.2~F_C45ploAa7OZb_wT0-wYIbdZOwkD_r.1 2024-09-12T00:56:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.52__shadow_key1.2~F_C45ploAa7OZb_wT0-wYIbdZOwkD_r.1_1 2024-09-12T00:56:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.52__multipart_key1.2~F_C45ploAa7OZb_wT0-wYIbdZOwkD_r.2 2024-09-12T00:56:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.52__shadow_key1.2~F_C45ploAa7OZb_wT0-wYIbdZOwkD_r.2_1 2024-09-12T00:56:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.52__multipart_key1.2~F_C45ploAa7OZb_wT0-wYIbdZOwkD_r.3 2024-09-12T00:56:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.52__shadow_key1.2~F_C45ploAa7OZb_wT0-wYIbdZOwkD_r.3_1 2024-09-12T00:56:06.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.52__multipart_key1.2~F_C45ploAa7OZb_wT0-wYIbdZOwkD_r.4 2024-09-12T00:56:06.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.52__shadow_key1.2~F_C45ploAa7OZb_wT0-wYIbdZOwkD_r.4_1 2024-09-12T00:56:06.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.52__multipart_key1.2~F_C45ploAa7OZb_wT0-wYIbdZOwkD_r.5 2024-09-12T00:56:06.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14002013489425665760', time=2024-09-12T02:55:55.516258+0000, chain.objs.size()=9 2024-09-12T00:56:06.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file.mpg.2~u-o-AyU6rPysRvpCsYMlPT17jykSQ4L.1 2024-09-12T00:56:06.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_file.mpg.2~u-o-AyU6rPysRvpCsYMlPT17jykSQ4L.1_1 2024-09-12T00:56:06.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.007+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file.mpg.2~u-o-AyU6rPysRvpCsYMlPT17jykSQ4L.2 2024-09-12T00:56:06.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.011+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_file.mpg.2~u-o-AyU6rPysRvpCsYMlPT17jykSQ4L.2_1 2024-09-12T00:56:06.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.011+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file.mpg.2~u-o-AyU6rPysRvpCsYMlPT17jykSQ4L.3 2024-09-12T00:56:06.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.011+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_file.mpg.2~u-o-AyU6rPysRvpCsYMlPT17jykSQ4L.3_1 2024-09-12T00:56:06.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.012+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file.mpg.2~u-o-AyU6rPysRvpCsYMlPT17jykSQ4L.4 2024-09-12T00:56:06.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.012+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_file.mpg.2~u-o-AyU6rPysRvpCsYMlPT17jykSQ4L.4_1 2024-09-12T00:56:06.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.012+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file.mpg.2~u-o-AyU6rPysRvpCsYMlPT17jykSQ4L.5 2024-09-12T00:56:06.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.012+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7019108031401021805', time=2024-09-12T02:55:59.290492+0000, chain.objs.size()=16 2024-09-12T00:56:06.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.013+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.1 2024-09-12T00:56:06.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.013+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.1_1 2024-09-12T00:56:06.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.014+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.1_2 2024-09-12T00:56:06.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.014+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.2 2024-09-12T00:56:06.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.014+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.2_1 2024-09-12T00:56:06.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.016+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.2_2 2024-09-12T00:56:06.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.016+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.3 2024-09-12T00:56:06.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.016+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.3_1 2024-09-12T00:56:06.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.019+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.3_2 2024-09-12T00:56:06.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.019+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.4 2024-09-12T00:56:06.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.019+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.4_1 2024-09-12T00:56:06.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.019+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.4_2 2024-09-12T00:56:06.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.019+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.5 2024-09-12T00:56:06.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.019+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.5_1 2024-09-12T00:56:06.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.019+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.5_2 2024-09-12T00:56:06.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.019+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~me5Xl_F7uM_j9xx0d6WGZiYOJW1p3gg.6 2024-09-12T00:56:06.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.025+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.028+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:06.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:06.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3285460822985909676', time=2024-09-12T02:55:51.068079+0000, chain.objs.size()=6 2024-09-12T00:56:06.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.47__shadow_.yGOtevPaEaZlTC-m_-rp20JZ-9tCV2r_0 2024-09-12T00:56:06.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.47__shadow_.yGOtevPaEaZlTC-m_-rp20JZ-9tCV2r_1 2024-09-12T00:56:06.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.47__shadow_.yGOtevPaEaZlTC-m_-rp20JZ-9tCV2r_2 2024-09-12T00:56:06.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.47__shadow_.yGOtevPaEaZlTC-m_-rp20JZ-9tCV2r_3 2024-09-12T00:56:06.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.47__shadow_.yGOtevPaEaZlTC-m_-rp20JZ-9tCV2r_4 2024-09-12T00:56:06.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.47__shadow_.yGOtevPaEaZlTC-m_-rp20JZ-9tCV2r_5 2024-09-12T00:56:06.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17665743993008042208', time=2024-09-12T02:55:59.811342+0000, chain.objs.size()=16 2024-09-12T00:56:06.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.1 2024-09-12T00:56:06.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.029+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.1_1 2024-09-12T00:56:06.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.030+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.1_2 2024-09-12T00:56:06.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.030+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.2 2024-09-12T00:56:06.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.030+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.2_1 2024-09-12T00:56:06.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.030+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.2_2 2024-09-12T00:56:06.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.033+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.3 2024-09-12T00:56:06.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.033+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.3_1 2024-09-12T00:56:06.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.033+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.3_2 2024-09-12T00:56:06.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.034+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.4 2024-09-12T00:56:06.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.037+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.4_1 2024-09-12T00:56:06.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.037+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.4_2 2024-09-12T00:56:06.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.037+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.5 2024-09-12T00:56:06.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.037+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.5_1 2024-09-12T00:56:06.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.037+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.5_2 2024-09-12T00:56:06.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.037+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~CN_wDAdnBJUomABQBAvf8vJXBefKBAZ.6 2024-09-12T00:56:06.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.042+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.044+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:06.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.046+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.046+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.047+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.048+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:06.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.049+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.049+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.050+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.051+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:06.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.052+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.052+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.052+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:06.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.052+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2563358325936772493', time=2024-09-12T02:55:50.409287+0000, chain.objs.size()=7 2024-09-12T00:56:06.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.052+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~OhwZV2e1W9eKnfye9ghQ6hdjYWitBWA.1 2024-09-12T00:56:06.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.052+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~OhwZV2e1W9eKnfye9ghQ6hdjYWitBWA.1_1 2024-09-12T00:56:06.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.052+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~OhwZV2e1W9eKnfye9ghQ6hdjYWitBWA.1_2 2024-09-12T00:56:06.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.052+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~OhwZV2e1W9eKnfye9ghQ6hdjYWitBWA.2 2024-09-12T00:56:06.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.052+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~OhwZV2e1W9eKnfye9ghQ6hdjYWitBWA.2_1 2024-09-12T00:56:06.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.053+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~OhwZV2e1W9eKnfye9ghQ6hdjYWitBWA.2_2 2024-09-12T00:56:06.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.053+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~OhwZV2e1W9eKnfye9ghQ6hdjYWitBWA.3 2024-09-12T00:56:06.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.056+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.058+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:06.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.059+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:06.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_', time=2024-09-12T02:55:44.348179+0000, chain.objs.size()=9 2024-09-12T00:56:06.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.41__multipart_key1.2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_.1 2024-09-12T00:56:06.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.41__shadow_key1.2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_.1_1 2024-09-12T00:56:06.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.41__multipart_key1.2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_.2 2024-09-12T00:56:06.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.41__shadow_key1.2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_.2_1 2024-09-12T00:56:06.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.41__multipart_key1.2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_.3 2024-09-12T00:56:06.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.41__shadow_key1.2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_.3_1 2024-09-12T00:56:06.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.41__multipart_key1.2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_.4 2024-09-12T00:56:06.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.41__shadow_key1.2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_.4_1 2024-09-12T00:56:06.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.060+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.41__multipart_key1.2~Ha1cAmPj5Mgj57tJfDq8Mnwgjyn6s4_.5 2024-09-12T00:56:06.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.065+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.068+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:06.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.070+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.070+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.071+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:06.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.071+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='2~-cdelJF6BNQNpMi2rYztT_Qw0TlP2u0', time=2024-09-12T02:55:56.012867+0000, chain.objs.size()=5 2024-09-12T00:56:06.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.071+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.55__multipart_key1.2~-cdelJF6BNQNpMi2rYztT_Qw0TlP2u0.7 2024-09-12T00:56:06.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.071+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.55__shadow_key1.2~-cdelJF6BNQNpMi2rYztT_Qw0TlP2u0.7_1 2024-09-12T00:56:06.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.071+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.55__multipart_key1.2~-cdelJF6BNQNpMi2rYztT_Qw0TlP2u0.10 2024-09-12T00:56:06.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.071+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.55__shadow_key1.2~-cdelJF6BNQNpMi2rYztT_Qw0TlP2u0.10_1 2024-09-12T00:56:06.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.071+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.55__multipart_key1.2~-cdelJF6BNQNpMi2rYztT_Qw0TlP2u0.13 2024-09-12T00:56:06.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.071+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8896427537630752638', time=2024-09-12T02:56:02.921895+0000, chain.objs.size()=1 2024-09-12T00:56:06.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.071+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.60__shadow_.4YxRpsfzryla3TQbzchYcahu9I0TraE_0 2024-09-12T00:56:06.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.074+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.076+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:06.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.078+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.078+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.078+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.079+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:06.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.081+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.081+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.081+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.082+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:06.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.084+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.084+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.085+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.086+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:06.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.088+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.088+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:06.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1195353762584627790', time=2024-09-12T02:55:57.570723+0000, chain.objs.size()=21 2024-09-12T00:56:06.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.1 2024-09-12T00:56:06.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.1_1 2024-09-12T00:56:06.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.2 2024-09-12T00:56:06.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.2_1 2024-09-12T00:56:06.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.3 2024-09-12T00:56:06.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.3_1 2024-09-12T00:56:06.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.4 2024-09-12T00:56:06.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.4_1 2024-09-12T00:56:06.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.5 2024-09-12T00:56:06.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.5_1 2024-09-12T00:56:06.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.6 2024-09-12T00:56:06.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.089+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.6_1 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.7 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.7_1 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.8 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.8_1 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.9 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.9_1 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.10 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.10_1 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~78_LMBKeFKS0Y6DWP-wvk27HvNttr1e.11 2024-09-12T00:56:06.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13698289895421205222', time=2024-09-12T02:56:03.343892+0000, chain.objs.size()=1 2024-09-12T00:56:06.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.093+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.62__shadow_.anRWOLvSR1uRehvQ8Jlsnoh5nzl9NBr_0 2024-09-12T00:56:06.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.100+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.102+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:06.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.103+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.103+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.104+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.104+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:06.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.106+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.106+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.106+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.107+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:06.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.109+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.109+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.109+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.110+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:06.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.112+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.112+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.112+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.113+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:06.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.114+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.115+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.115+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:06.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.115+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17431400668960626604', time=2024-09-12T02:56:03.966027+0000, chain.objs.size()=1 2024-09-12T00:56:06.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.115+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.65__shadow_.chEucA5oTvkJS_NKlyBAJ4SWRM4FMLU_0 2024-09-12T00:56:06.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.116+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.118+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:06.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.119+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.120+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.120+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:06.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.120+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6337254743764640560', time=2024-09-12T02:55:55.522666+0000, chain.objs.size()=1 2024-09-12T00:56:06.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.120+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_.k_7hOkvqDjh-S92QDOEswffecG6e8nZ_0 2024-09-12T00:56:06.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.121+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.123+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:06.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.125+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.125+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.410165907821716140', time=2024-09-12T02:55:50.820472+0000, chain.objs.size()=7 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~tU2WlprRrJfDY5DbrbnoEJhWKzk3RFA.1 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~tU2WlprRrJfDY5DbrbnoEJhWKzk3RFA.1_1 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~tU2WlprRrJfDY5DbrbnoEJhWKzk3RFA.1_2 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~tU2WlprRrJfDY5DbrbnoEJhWKzk3RFA.2 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~tU2WlprRrJfDY5DbrbnoEJhWKzk3RFA.2_1 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~tU2WlprRrJfDY5DbrbnoEJhWKzk3RFA.2_2 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~tU2WlprRrJfDY5DbrbnoEJhWKzk3RFA.3 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6320020152825566975', time=2024-09-12T02:55:55.529011+0000, chain.objs.size()=9 2024-09-12T00:56:06.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file2.mpg.2~BkAWIh-AVWccWavZ_30sixsZVcDGrZf.1 2024-09-12T00:56:06.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_file2.mpg.2~BkAWIh-AVWccWavZ_30sixsZVcDGrZf.1_1 2024-09-12T00:56:06.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file2.mpg.2~BkAWIh-AVWccWavZ_30sixsZVcDGrZf.2 2024-09-12T00:56:06.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_file2.mpg.2~BkAWIh-AVWccWavZ_30sixsZVcDGrZf.2_1 2024-09-12T00:56:06.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.126+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file2.mpg.2~BkAWIh-AVWccWavZ_30sixsZVcDGrZf.3 2024-09-12T00:56:06.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.130+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_file2.mpg.2~BkAWIh-AVWccWavZ_30sixsZVcDGrZf.3_1 2024-09-12T00:56:06.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.130+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file2.mpg.2~BkAWIh-AVWccWavZ_30sixsZVcDGrZf.4 2024-09-12T00:56:06.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.130+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_file2.mpg.2~BkAWIh-AVWccWavZ_30sixsZVcDGrZf.4_1 2024-09-12T00:56:06.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.131+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__multipart_file2.mpg.2~BkAWIh-AVWccWavZ_30sixsZVcDGrZf.5 2024-09-12T00:56:06.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.135+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.138+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:06.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.139+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.139+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.139+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.139+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13411736095824666707', time=2024-09-12T02:55:45.375891+0000, chain.objs.size()=9 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.140+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.43__multipart_key1.2~70KIi1XHMGhzvrCiHZlWt25QgxWJCqZ.1 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.140+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.43__shadow_key1.2~70KIi1XHMGhzvrCiHZlWt25QgxWJCqZ.1_1 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.140+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.43__multipart_key1.2~70KIi1XHMGhzvrCiHZlWt25QgxWJCqZ.2 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.140+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.43__shadow_key1.2~70KIi1XHMGhzvrCiHZlWt25QgxWJCqZ.2_1 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.140+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.43__multipart_key1.2~70KIi1XHMGhzvrCiHZlWt25QgxWJCqZ.3 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.140+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.43__shadow_key1.2~70KIi1XHMGhzvrCiHZlWt25QgxWJCqZ.3_1 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.140+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.43__multipart_key1.2~70KIi1XHMGhzvrCiHZlWt25QgxWJCqZ.4 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.140+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.43__shadow_key1.2~70KIi1XHMGhzvrCiHZlWt25QgxWJCqZ.4_1 2024-09-12T00:56:06.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.140+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.43__multipart_key1.2~70KIi1XHMGhzvrCiHZlWt25QgxWJCqZ.5 2024-09-12T00:56:06.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.144+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.147+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:06.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.148+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.149+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.149+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.150+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:06.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.151+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.151+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17746317353156862425', time=2024-09-12T02:55:54.732667+0000, chain.objs.size()=9 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.53__multipart_key1.2~oTV67IhWyCYBmFY-r_JSOzEtjP5vQ-p.1 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.53__shadow_key1.2~oTV67IhWyCYBmFY-r_JSOzEtjP5vQ-p.1_1 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.53__multipart_key1.2~oTV67IhWyCYBmFY-r_JSOzEtjP5vQ-p.2 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.53__shadow_key1.2~oTV67IhWyCYBmFY-r_JSOzEtjP5vQ-p.2_1 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.53__multipart_key1.2~oTV67IhWyCYBmFY-r_JSOzEtjP5vQ-p.3 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.53__shadow_key1.2~oTV67IhWyCYBmFY-r_JSOzEtjP5vQ-p.3_1 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.53__multipart_key1.2~oTV67IhWyCYBmFY-r_JSOzEtjP5vQ-p.4 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.53__shadow_key1.2~oTV67IhWyCYBmFY-r_JSOzEtjP5vQ-p.4_1 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.53__multipart_key1.2~oTV67IhWyCYBmFY-r_JSOzEtjP5vQ-p.5 2024-09-12T00:56:06.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3286556752597155484', time=2024-09-12T02:55:59.950829+0000, chain.objs.size()=16 2024-09-12T00:56:06.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.1 2024-09-12T00:56:06.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.1_1 2024-09-12T00:56:06.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.152+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.1_2 2024-09-12T00:56:06.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.155+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.2 2024-09-12T00:56:06.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.156+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.2_1 2024-09-12T00:56:06.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.156+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.2_2 2024-09-12T00:56:06.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.157+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.3 2024-09-12T00:56:06.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.157+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.3_1 2024-09-12T00:56:06.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.158+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.3_2 2024-09-12T00:56:06.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.158+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.4 2024-09-12T00:56:06.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.158+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.4_1 2024-09-12T00:56:06.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.158+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.4_2 2024-09-12T00:56:06.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.158+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.5 2024-09-12T00:56:06.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.158+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.5_1 2024-09-12T00:56:06.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.160+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.5_2 2024-09-12T00:56:06.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.160+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~FnhP_HgwVHm3xW29136k8r7plP5ONpu.6 2024-09-12T00:56:06.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.165+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.167+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:06.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.168+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:06.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3347239692964005785', time=2024-09-12T02:56:01.541659+0000, chain.objs.size()=9 2024-09-12T00:56:06.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__multipart_key1.2~DJMS-2hDEkJ0acaoQZtFP5PoNQXDYNC.1 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__shadow_key1.2~DJMS-2hDEkJ0acaoQZtFP5PoNQXDYNC.1_1 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__multipart_key1.2~DJMS-2hDEkJ0acaoQZtFP5PoNQXDYNC.2 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__shadow_key1.2~DJMS-2hDEkJ0acaoQZtFP5PoNQXDYNC.2_1 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__multipart_key1.2~DJMS-2hDEkJ0acaoQZtFP5PoNQXDYNC.3 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__shadow_key1.2~DJMS-2hDEkJ0acaoQZtFP5PoNQXDYNC.3_1 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__multipart_key1.2~DJMS-2hDEkJ0acaoQZtFP5PoNQXDYNC.4 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__shadow_key1.2~DJMS-2hDEkJ0acaoQZtFP5PoNQXDYNC.4_1 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.57__multipart_key1.2~DJMS-2hDEkJ0acaoQZtFP5PoNQXDYNC.5 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12390025717307018272', time=2024-09-12T02:56:03.758013+0000, chain.objs.size()=1 2024-09-12T00:56:06.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.169+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.64__shadow_.5j2B-dfPyZMcX1r0NP8xO6sVm-vuOeQ_0 2024-09-12T00:56:06.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.174+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.177+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:06.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.178+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.179+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.179+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.180+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:06.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.181+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.181+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:06.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.799213450807368834', time=2024-09-12T02:55:46.408750+0000, chain.objs.size()=9 2024-09-12T00:56:06.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.1 2024-09-12T00:56:06.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__shadow_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.1_1 2024-09-12T00:56:06.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.2 2024-09-12T00:56:06.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__shadow_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.2_1 2024-09-12T00:56:06.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.3 2024-09-12T00:56:06.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__shadow_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.3_1 2024-09-12T00:56:06.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.4 2024-09-12T00:56:06.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__shadow_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.4_1 2024-09-12T00:56:06.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.5 2024-09-12T00:56:06.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12069622989798204377', time=2024-09-12T02:55:50.000438+0000, chain.objs.size()=9 2024-09-12T00:56:06.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~H-Bzhevv8lKO_3fegvk7huJlGLlAqmt.1 2024-09-12T00:56:06.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~H-Bzhevv8lKO_3fegvk7huJlGLlAqmt.1_1 2024-09-12T00:56:06.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.182+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~H-Bzhevv8lKO_3fegvk7huJlGLlAqmt.2 2024-09-12T00:56:06.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.186+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~H-Bzhevv8lKO_3fegvk7huJlGLlAqmt.2_1 2024-09-12T00:56:06.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.186+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~H-Bzhevv8lKO_3fegvk7huJlGLlAqmt.3 2024-09-12T00:56:06.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.186+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~H-Bzhevv8lKO_3fegvk7huJlGLlAqmt.3_1 2024-09-12T00:56:06.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.186+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~H-Bzhevv8lKO_3fegvk7huJlGLlAqmt.4 2024-09-12T00:56:06.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.186+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~H-Bzhevv8lKO_3fegvk7huJlGLlAqmt.4_1 2024-09-12T00:56:06.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.186+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~H-Bzhevv8lKO_3fegvk7huJlGLlAqmt.5 2024-09-12T00:56:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.190+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.192+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:06.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.193+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:06.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8122728760899586421', time=2024-09-12T02:55:48.512872+0000, chain.objs.size()=9 2024-09-12T00:56:06.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~2N2s0g6zuCESis0_B0rKmelke9KKU6K.1 2024-09-12T00:56:06.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~2N2s0g6zuCESis0_B0rKmelke9KKU6K.1_1 2024-09-12T00:56:06.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~2N2s0g6zuCESis0_B0rKmelke9KKU6K.2 2024-09-12T00:56:06.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~2N2s0g6zuCESis0_B0rKmelke9KKU6K.2_1 2024-09-12T00:56:06.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~2N2s0g6zuCESis0_B0rKmelke9KKU6K.3 2024-09-12T00:56:06.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~2N2s0g6zuCESis0_B0rKmelke9KKU6K.3_1 2024-09-12T00:56:06.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~2N2s0g6zuCESis0_B0rKmelke9KKU6K.4 2024-09-12T00:56:06.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__shadow_key1.2~2N2s0g6zuCESis0_B0rKmelke9KKU6K.4_1 2024-09-12T00:56:06.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.194+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.48__multipart_key1.2~2N2s0g6zuCESis0_B0rKmelke9KKU6K.5 2024-09-12T00:56:06.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.200+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.202+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:06.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.203+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.204+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.204+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.205+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:06.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.207+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.207+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:06.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12955996566899228406', time=2024-09-12T02:55:58.757902+0000, chain.objs.size()=19 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.1 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.1_1 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.2 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.2_1 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.3 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.3_1 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.4 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.4_1 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.5 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.5_1 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.6 2024-09-12T00:56:06.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.208+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.6_1 2024-09-12T00:56:06.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.212+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.7 2024-09-12T00:56:06.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.212+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.7_1 2024-09-12T00:56:06.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.212+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.8 2024-09-12T00:56:06.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.212+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.8_1 2024-09-12T00:56:06.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.212+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.9 2024-09-12T00:56:06.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.212+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.9_1 2024-09-12T00:56:06.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.212+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~todb_Oqhd-idfAdMJtdu9elZufJ-apf.10 2024-09-12T00:56:06.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.214+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2435865396627744688', time=2024-09-12T02:56:04.880679+0000, chain.objs.size()=21 2024-09-12T00:56:06.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.214+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.1 2024-09-12T00:56:06.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.214+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.1_1 2024-09-12T00:56:06.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.215+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.2 2024-09-12T00:56:06.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.215+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.2_1 2024-09-12T00:56:06.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.3 2024-09-12T00:56:06.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.3_1 2024-09-12T00:56:06.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.4 2024-09-12T00:56:06.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.4_1 2024-09-12T00:56:06.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.5 2024-09-12T00:56:06.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.5_1 2024-09-12T00:56:06.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.6 2024-09-12T00:56:06.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.6_1 2024-09-12T00:56:06.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.7 2024-09-12T00:56:06.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.7_1 2024-09-12T00:56:06.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.219+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.8 2024-09-12T00:56:06.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.223+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.8_1 2024-09-12T00:56:06.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.223+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.9 2024-09-12T00:56:06.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.224+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.9_1 2024-09-12T00:56:06.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.224+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.10 2024-09-12T00:56:06.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.224+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__shadow_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.10_1 2024-09-12T00:56:06.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.224+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.67__multipart_key1.2~04I88BDYd2OnY-F_Lia_ULZ5O2btRbB.11 2024-09-12T00:56:06.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.229+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.231+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:06.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:06.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-', time=2024-09-12T02:56:02.737921+0000, chain.objs.size()=48 2024-09-12T00:56:06.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.1 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.2 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.3 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.4 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.5 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.6 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.7 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.8 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.9 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.10 2024-09-12T00:56:06.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.234+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.11 2024-09-12T00:56:06.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.235+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.12 2024-09-12T00:56:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.238+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.13 2024-09-12T00:56:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.238+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.14 2024-09-12T00:56:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.239+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.15 2024-09-12T00:56:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.239+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.16 2024-09-12T00:56:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.239+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.17 2024-09-12T00:56:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.239+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.18 2024-09-12T00:56:06.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.239+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.19 2024-09-12T00:56:06.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.239+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.20 2024-09-12T00:56:06.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.239+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.21 2024-09-12T00:56:06.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.239+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.22 2024-09-12T00:56:06.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.239+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.23 2024-09-12T00:56:06.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.244+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.24 2024-09-12T00:56:06.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.244+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.25 2024-09-12T00:56:06.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.244+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.26 2024-09-12T00:56:06.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.244+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.27 2024-09-12T00:56:06.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.244+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.28 2024-09-12T00:56:06.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.244+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.29 2024-09-12T00:56:06.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.246+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.30 2024-09-12T00:56:06.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.246+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.31 2024-09-12T00:56:06.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.246+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.32 2024-09-12T00:56:06.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.246+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.33 2024-09-12T00:56:06.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.247+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.34 2024-09-12T00:56:06.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.247+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.35 2024-09-12T00:56:06.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.248+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.36 2024-09-12T00:56:06.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.250+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.37 2024-09-12T00:56:06.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.250+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.38 2024-09-12T00:56:06.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.250+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.39 2024-09-12T00:56:06.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.250+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.40 2024-09-12T00:56:06.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.250+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.41 2024-09-12T00:56:06.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.252+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.42 2024-09-12T00:56:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.253+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.43 2024-09-12T00:56:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.253+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.44 2024-09-12T00:56:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.253+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.45 2024-09-12T00:56:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.253+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.46 2024-09-12T00:56:06.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.253+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.47 2024-09-12T00:56:06.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.255+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.59__multipart_key1.2~Xj8Sd8xSXKqWAXEJDoMBxwxGSCbsU7-.48 2024-09-12T00:56:06.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.257+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7829380828219453536', time=2024-09-12T02:56:03.551920+0000, chain.objs.size()=1 2024-09-12T00:56:06.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.257+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.63__shadow_.2THdMU0Dcojob5JIl98nH808zKeAaqJ_0 2024-09-12T00:56:06.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.259+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.262+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:06.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.263+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.263+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.264+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.264+0000 7fc0f9d25800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:06.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7221724237441394044', time=2024-09-12T02:55:46.518337+0000, chain.objs.size()=9 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.1 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__shadow_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.1_1 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.2 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__shadow_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.2_1 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.3 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__shadow_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.3_1 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.4 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__shadow_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.4_1 2024-09-12T00:56:06.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.45__multipart_key1.2~rmt8qVVzVR6cLa4RBIQeTje-WZDZmOv.5 2024-09-12T00:56:06.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12901839055769257691', time=2024-09-12T02:55:55.534710+0000, chain.objs.size()=1 2024-09-12T00:56:06.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.54__shadow_.Bx4R_XAeVqcUGcbB1KnTvh1VcuhJrwD_0 2024-09-12T00:56:06.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16147930143793014362', time=2024-09-12T02:55:58.222665+0000, chain.objs.size()=21 2024-09-12T00:56:06.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.1 2024-09-12T00:56:06.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.266+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.1_1 2024-09-12T00:56:06.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.269+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.2 2024-09-12T00:56:06.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.271+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.2_1 2024-09-12T00:56:06.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.271+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.3 2024-09-12T00:56:06.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.271+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.3_1 2024-09-12T00:56:06.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.271+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.4 2024-09-12T00:56:06.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.272+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.4_1 2024-09-12T00:56:06.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.272+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.5 2024-09-12T00:56:06.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.272+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.5_1 2024-09-12T00:56:06.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.272+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.6 2024-09-12T00:56:06.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.272+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.6_1 2024-09-12T00:56:06.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.275+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.7 2024-09-12T00:56:06.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.275+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.7_1 2024-09-12T00:56:06.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.275+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.8 2024-09-12T00:56:06.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.275+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.8_1 2024-09-12T00:56:06.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.277+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.9 2024-09-12T00:56:06.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.277+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.9_1 2024-09-12T00:56:06.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.277+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.10 2024-09-12T00:56:06.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.279+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__shadow_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.10_1 2024-09-12T00:56:06.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.279+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.56__multipart_key1.2~6Jl-9Awbly1pC3gcOMbv5KRJSl9UZEz.11 2024-09-12T00:56:06.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.282+0000 7fc0f9d25800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:06.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.285+0000 7fbfa77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:06.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.287+0000 7fc0f9d25800 20 remove_watcher() i=0 2024-09-12T00:56:06.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.287+0000 7fc0f9d25800 2 removed watcher, disabling cache 2024-09-12T00:56:06.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.288+0000 7fc0f9d25800 20 remove_watcher() i=1 2024-09-12T00:56:06.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.289+0000 7fc0f9d25800 20 remove_watcher() i=2 2024-09-12T00:56:06.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.290+0000 7fc0f9d25800 20 remove_watcher() i=3 2024-09-12T00:56:06.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.291+0000 7fc0f9d25800 20 remove_watcher() i=4 2024-09-12T00:56:06.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.292+0000 7fc0f9d25800 20 remove_watcher() i=5 2024-09-12T00:56:06.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.293+0000 7fc0f9d25800 20 remove_watcher() i=6 2024-09-12T00:56:06.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.294+0000 7fc0f9d25800 20 remove_watcher() i=7 2024-09-12T00:56:06.303 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:06.355 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:06.355 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:06.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.393+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.394+0000 7fee83f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.394+0000 7fee83f23800 20 realm 2024-09-12T00:56:06.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.394+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.394+0000 7fee83f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.394+0000 7fee83f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:06.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.394+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.395+0000 7fee83f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.395+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.395+0000 7fee83f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:06.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.395+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.395+0000 7fee83f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:06.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.396+0000 7fee83f23800 20 searching for the correct realm 2024-09-12T00:56:06.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.399+0000 7fee77fff640 0 -- 172.21.15.83:0/2642355661 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fee68061a90 msgr2=0x7fee6808f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:06.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.604+0000 7fee8040d640 0 -- 172.21.15.83:0/2642355661 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55703b34eab0 msgr2=0x55703b350f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:06.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:06.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:06.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:06.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:06.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:06.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:06.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:06.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.608+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 20 zone default found 2024-09-12T00:56:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 4 Realm: () 2024-09-12T00:56:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:06.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 20 zonegroup default 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.609+0000 7fee83f23800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.610+0000 7fee83f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.610+0000 7fee83f23800 20 started sync module instance, tier type = 2024-09-12T00:56:06.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.610+0000 7fee83f23800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:06.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.618+0000 7fee83f23800 20 add_watcher() i=0 2024-09-12T00:56:06.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.618+0000 7fee83f23800 20 add_watcher() i=1 2024-09-12T00:56:06.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.618+0000 7fee83f23800 20 add_watcher() i=2 2024-09-12T00:56:06.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.618+0000 7fee83f23800 20 add_watcher() i=3 2024-09-12T00:56:06.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.618+0000 7fee83f23800 20 add_watcher() i=4 2024-09-12T00:56:06.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.618+0000 7fee83f23800 20 add_watcher() i=5 2024-09-12T00:56:06.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.618+0000 7fee83f23800 20 add_watcher() i=6 2024-09-12T00:56:06.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.619+0000 7fee83f23800 20 add_watcher() i=7 2024-09-12T00:56:06.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.619+0000 7fee83f23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:06.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.620+0000 7fed35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:06.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.620+0000 7fee83f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:06.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.620+0000 7fee83f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:06.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.653+0000 7fed34fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:06.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.653+0000 7fee83f23800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:06.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.653+0000 7fee83f23800 20 Filter name: none 2024-09-12T00:56:06.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.653+0000 7fecae7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:06.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.653+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:06.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.654+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.655+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.655+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.656+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:06.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.657+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.657+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.658+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.659+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:06.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.660+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.660+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.660+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.661+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:06.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.662+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.663+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.663+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.664+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:06.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.665+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.666+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.666+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.667+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:06.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.668+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.669+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.669+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.670+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:06.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.671+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.672+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.672+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.673+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:06.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.675+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.675+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.676+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.677+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:06.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.678+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.678+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.679+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.680+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:06.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.681+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.681+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.682+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.683+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:06.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.684+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.684+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.684+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.685+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:06.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.687+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.687+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.687+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.688+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:06.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.690+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.690+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.690+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.692+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:06.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.693+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.694+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.694+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.695+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:06.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.696+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.697+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.697+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.698+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:06.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.699+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.700+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.700+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.701+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:06.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.702+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.703+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.703+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.704+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:06.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.705+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.706+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.706+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.707+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:06.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.708+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.708+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.708+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.709+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:06.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.711+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.712+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.712+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.714+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:06.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.715+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.716+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.716+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.717+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:06.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.718+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.718+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.718+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.719+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:06.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.721+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.721+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.722+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.723+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:06.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.724+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.725+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.725+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.726+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:06.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.727+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.728+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.728+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.729+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:06.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.730+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.730+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.731+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.732+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:06.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.733+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.734+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.734+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.735+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:06.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.736+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.737+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.737+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.738+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:06.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.739+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.740+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.740+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.741+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:06.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.742+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.743+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.743+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.744+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:06.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.745+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.746+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.746+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.747+0000 7fee83f23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:06.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.748+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.749+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.749+0000 7fee83f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.751+0000 7fed35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:06.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.753+0000 7fee83f23800 20 remove_watcher() i=0 2024-09-12T00:56:06.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.753+0000 7fee83f23800 2 removed watcher, disabling cache 2024-09-12T00:56:06.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.754+0000 7fee83f23800 20 remove_watcher() i=1 2024-09-12T00:56:06.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.755+0000 7fee83f23800 20 remove_watcher() i=2 2024-09-12T00:56:06.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.756+0000 7fee83f23800 20 remove_watcher() i=3 2024-09-12T00:56:06.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.757+0000 7fee83f23800 20 remove_watcher() i=4 2024-09-12T00:56:06.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.758+0000 7fee83f23800 20 remove_watcher() i=5 2024-09-12T00:56:06.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.758+0000 7fee83f23800 20 remove_watcher() i=6 2024-09-12T00:56:06.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.759+0000 7fee83f23800 20 remove_watcher() i=7 2024-09-12T00:56:06.769 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:06.821 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:06.821 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:06.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.859+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.860+0000 7f2ac92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.860+0000 7f2ac92bb800 20 realm 2024-09-12T00:56:06.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.860+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.861+0000 7f2ac92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.861+0000 7f2ac92bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:06.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.861+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.861+0000 7f2ac92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.861+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.861+0000 7f2ac92bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:06.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.861+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.862+0000 7f2ac92bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:06.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.862+0000 7f2ac92bb800 20 searching for the correct realm 2024-09-12T00:56:06.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.866+0000 7f2ac6da5640 0 -- 172.21.15.83:0/2284422826 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f2ab801d060 msgr2=0x7f2ab80a2ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:06.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.869+0000 7f2ac6da5640 0 -- 172.21.15.83:0/2284422826 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f2ac007c040 msgr2=0x7f2ac0084730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:06.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:06.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 zone default found 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 4 Realm: () 2024-09-12T00:56:06.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.873+0000 7f2ac92bb800 20 zonegroup default 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.874+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.874+0000 7f2ac92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.874+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.874+0000 7f2ac92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.874+0000 7f2ac92bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.874+0000 7f2ac92bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.874+0000 7f2ac92bb800 20 started sync module instance, tier type = 2024-09-12T00:56:06.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.874+0000 7f2ac92bb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:06.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.883+0000 7f2ac92bb800 20 add_watcher() i=0 2024-09-12T00:56:06.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.883+0000 7f2ac92bb800 20 add_watcher() i=1 2024-09-12T00:56:06.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.883+0000 7f2ac92bb800 20 add_watcher() i=2 2024-09-12T00:56:06.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.883+0000 7f2ac92bb800 20 add_watcher() i=3 2024-09-12T00:56:06.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.883+0000 7f2ac92bb800 20 add_watcher() i=4 2024-09-12T00:56:06.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.883+0000 7f2ac92bb800 20 add_watcher() i=5 2024-09-12T00:56:06.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.883+0000 7f2ac92bb800 20 add_watcher() i=6 2024-09-12T00:56:06.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.884+0000 7f2ac92bb800 20 add_watcher() i=7 2024-09-12T00:56:06.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.884+0000 7f2ac92bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:06.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.885+0000 7f297d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:06.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.886+0000 7f2ac92bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:06.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.886+0000 7f2ac92bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:06.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.919+0000 7f28f7fff640 20 reqs_thread_entry: start 2024-09-12T00:56:06.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.919+0000 7f2ac92bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:06.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.919+0000 7f2ac92bb800 20 Filter name: none 2024-09-12T00:56:06.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.919+0000 7f28f5ffb640 20 reqs_thread_entry: start 2024-09-12T00:56:06.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.919+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:06.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.920+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.921+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.921+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.922+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:06.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.923+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.924+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.924+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.925+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:06.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.926+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.927+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.927+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.928+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:06.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.929+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.930+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.930+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.931+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:06.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.933+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.933+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.933+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.934+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:06.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.936+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.936+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.936+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.937+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:06.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.938+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.939+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.939+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.940+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:06.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.941+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.942+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.942+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.943+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:06.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.945+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.945+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.946+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.947+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:06.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.948+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.948+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.948+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.950+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:06.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.951+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.951+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.951+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.952+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:06.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.954+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.954+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.954+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.955+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:06.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.956+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.957+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.957+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.958+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:06.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.959+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.959+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.960+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.961+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:06.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.962+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.962+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.963+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.964+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:06.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.965+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.965+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.965+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.966+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:06.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.967+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.968+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.968+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.969+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:06.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.970+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.971+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.971+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.972+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:06.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.973+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.973+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.974+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.975+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:06.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.976+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.976+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.977+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.978+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:06.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.979+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.979+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.979+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.980+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:06.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.982+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.982+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.982+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.983+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:06.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.984+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.985+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.985+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.986+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:06.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.987+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.988+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.988+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.989+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:06.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.991+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.991+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.992+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.993+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:06.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.994+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.995+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.995+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.996+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:06.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.997+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.998+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.998+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:06.999+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:06.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.000+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:06.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.000+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:06.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.001+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.001+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:07.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.003+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.003+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.003+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.005+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:07.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.006+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.006+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.006+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.007+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:07.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.009+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.010+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.010+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.011+0000 7f2ac92bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:07.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.012+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.012+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.012+0000 7f2ac92bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.014+0000 7f297d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:07.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.016+0000 7f2ac92bb800 20 remove_watcher() i=0 2024-09-12T00:56:07.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.016+0000 7f2ac92bb800 2 removed watcher, disabling cache 2024-09-12T00:56:07.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.017+0000 7f2ac92bb800 20 remove_watcher() i=1 2024-09-12T00:56:07.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.018+0000 7f2ac92bb800 20 remove_watcher() i=2 2024-09-12T00:56:07.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.019+0000 7f2ac92bb800 20 remove_watcher() i=3 2024-09-12T00:56:07.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.020+0000 7f2ac92bb800 20 remove_watcher() i=4 2024-09-12T00:56:07.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.021+0000 7f2ac92bb800 20 remove_watcher() i=5 2024-09-12T00:56:07.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.021+0000 7f2ac92bb800 20 remove_watcher() i=6 2024-09-12T00:56:07.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.022+0000 7f2ac92bb800 20 remove_watcher() i=7 2024-09-12T00:56:07.031 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:07.085 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:07.085 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:07.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.123+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.124+0000 7f9d5470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:07.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.124+0000 7f9d5470c800 20 realm 2024-09-12T00:56:07.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.124+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.125+0000 7f9d5470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:07.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.125+0000 7f9d5470c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:07.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.125+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.125+0000 7f9d5470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:07.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.125+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.125+0000 7f9d5470c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:07.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.125+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.126+0000 7f9d5470c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:07.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.126+0000 7f9d5470c800 20 searching for the correct realm 2024-09-12T00:56:07.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.129+0000 7f9d4bfff640 0 -- 172.21.15.83:0/173501409 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f9d3c0df040 msgr2=0x7f9d3c070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:07.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.335+0000 7f9d529f7640 0 -- 172.21.15.83:0/173501409 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5566acc44a90 msgr2=0x5566acc46f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:07.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.338+0000 7f9d5470c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:07.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.338+0000 7f9d5470c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:07.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.338+0000 7f9d5470c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:07.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.338+0000 7f9d5470c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:07.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.338+0000 7f9d5470c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:07.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.338+0000 7f9d5470c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:07.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.338+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:07.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 20 zone default found 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 4 Realm: () 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 20 zonegroup default 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.339+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.340+0000 7f9d5470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:07.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.340+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.340+0000 7f9d5470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:07.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.340+0000 7f9d5470c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:07.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.340+0000 7f9d5470c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:07.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.340+0000 7f9d5470c800 20 started sync module instance, tier type = 2024-09-12T00:56:07.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.340+0000 7f9d5470c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:07.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.348+0000 7f9d5470c800 20 add_watcher() i=0 2024-09-12T00:56:07.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.348+0000 7f9d5470c800 20 add_watcher() i=1 2024-09-12T00:56:07.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.348+0000 7f9d5470c800 20 add_watcher() i=2 2024-09-12T00:56:07.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.348+0000 7f9d5470c800 20 add_watcher() i=3 2024-09-12T00:56:07.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.348+0000 7f9d5470c800 20 add_watcher() i=4 2024-09-12T00:56:07.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.348+0000 7f9d5470c800 20 add_watcher() i=5 2024-09-12T00:56:07.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.348+0000 7f9d5470c800 20 add_watcher() i=6 2024-09-12T00:56:07.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.349+0000 7f9d5470c800 20 add_watcher() i=7 2024-09-12T00:56:07.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.349+0000 7f9d5470c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:07.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.351+0000 7f9c08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:07.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.351+0000 7f9d5470c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:07.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.351+0000 7f9d5470c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:07.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.385+0000 7f9b837fe640 20 reqs_thread_entry: start 2024-09-12T00:56:07.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.385+0000 7f9d5470c800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:07.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.385+0000 7f9d5470c800 20 Filter name: none 2024-09-12T00:56:07.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.385+0000 7f9b817fa640 20 reqs_thread_entry: start 2024-09-12T00:56:07.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.385+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:07.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.386+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.387+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.387+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.388+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:07.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.390+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.390+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.391+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.392+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:07.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.393+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.393+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.394+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.395+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:07.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.396+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.396+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.397+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.398+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:07.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.400+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.400+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.400+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.402+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:07.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.403+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.403+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.403+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.404+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:07.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.405+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.406+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.406+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.407+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:07.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.408+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.409+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.409+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.410+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:07.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.411+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.411+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.412+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.413+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:07.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.414+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.414+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.414+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.415+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:07.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.417+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.418+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.418+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.420+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:07.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.421+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.421+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.422+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.423+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:07.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.424+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.424+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.424+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.425+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:07.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.427+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.427+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.427+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.428+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:07.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.430+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.430+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.430+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.432+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:07.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.433+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.433+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.434+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.435+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:07.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.436+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.437+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.437+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.438+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:07.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.439+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.439+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.440+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.441+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:07.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.442+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.443+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.443+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.444+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:07.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.445+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.446+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.446+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.447+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:07.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.448+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.449+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.449+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.450+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:07.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.452+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.452+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.452+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.453+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:07.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.455+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.455+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.456+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.457+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:07.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.458+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.459+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.459+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.460+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:07.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.461+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.462+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.462+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.463+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:07.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.465+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.465+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.466+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.467+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:07.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.468+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.468+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.469+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.470+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:07.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.471+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.471+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.472+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.473+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:07.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.474+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.474+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.475+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.475+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:07.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.477+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.477+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.478+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.478+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:07.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.480+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.480+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.481+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.482+0000 7f9d5470c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:07.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.483+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.483+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:07.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.484+0000 7f9d5470c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:07.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.485+0000 7f9c08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:07.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.488+0000 7f9d5470c800 20 remove_watcher() i=0 2024-09-12T00:56:07.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.488+0000 7f9d5470c800 2 removed watcher, disabling cache 2024-09-12T00:56:07.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.489+0000 7f9d5470c800 20 remove_watcher() i=1 2024-09-12T00:56:07.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.490+0000 7f9d5470c800 20 remove_watcher() i=2 2024-09-12T00:56:07.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.491+0000 7f9d5470c800 20 remove_watcher() i=3 2024-09-12T00:56:07.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.492+0000 7f9d5470c800 20 remove_watcher() i=4 2024-09-12T00:56:07.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.493+0000 7f9d5470c800 20 remove_watcher() i=5 2024-09-12T00:56:07.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.494+0000 7f9d5470c800 20 remove_watcher() i=6 2024-09-12T00:56:07.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:07.495+0000 7f9d5470c800 20 remove_watcher() i=7 2024-09-12T00:56:07.504 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:56:08.014 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :clean 2024-09-12T00:56:08.810 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileJava 2024-09-12T00:56:08.810 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processResources 2024-09-12T00:56:08.810 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :classes 2024-09-12T00:56:09.409 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:09.409 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileTestJava 2024-09-12T00:56:09.410 INFO:teuthology.orchestra.run.smithi083.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:56:09.410 INFO:teuthology.orchestra.run.smithi083.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:56:09.411 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:09.411 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:56:09.411 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :testClasses 2024-09-12T00:56:11.411 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.411 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :test 2024-09-12T00:56:11.411 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.411 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:56:11.411 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12 00:56:10,552 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:56:11.412 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.413 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:56:11.413 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.413 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:56:11.509 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.509 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:56:11.609 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.609 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:56:11.609 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.610 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:56:11.809 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.809 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:56:11.909 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:11.909 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:56:12.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:12.010 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:56:12.010 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:12.010 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:56:12.309 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:12.309 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:56:12.409 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:12.409 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:56:12.609 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:12.609 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:56:12.609 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:12.609 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:56:12.702 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:12.702 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------- 2024-09-12T00:56:12.702 INFO:teuthology.orchestra.run.smithi083.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:56:12.702 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------- 2024-09-12T00:56:12.702 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:12.702 INFO:teuthology.orchestra.run.smithi083.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:56:12.702 INFO:teuthology.orchestra.run.smithi083.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:56:12.702 INFO:teuthology.orchestra.run.smithi083.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:56:12.702 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:12.703 INFO:teuthology.orchestra.run.smithi083.stdout:BUILD SUCCESSFUL in 5s 2024-09-12T00:56:12.703 INFO:teuthology.orchestra.run.smithi083.stdout:5 actionable tasks: 5 executed 2024-09-12T00:56:12.706 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:12.758 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:12.758 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:12.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.797+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.798+0000 7f54517af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:12.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.798+0000 7f54517af800 20 realm 2024-09-12T00:56:12.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.798+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.799+0000 7f54517af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:12.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.799+0000 7f54517af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:12.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.799+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.799+0000 7f54517af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:12.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.799+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.799+0000 7f54517af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:12.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.799+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.800+0000 7f54517af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:12.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.800+0000 7f54517af800 20 searching for the correct realm 2024-09-12T00:56:12.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.804+0000 7f544fa9a640 0 -- 172.21.15.83:0/2488298961 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f543802ec20 msgr2=0x7f543800a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:12.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.807+0000 7f544f299640 0 -- 172.21.15.83:0/2488298961 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f5448020040 msgr2=0x7f5448021430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:12.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.811+0000 7f54517af800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:12.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.811+0000 7f54517af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:12.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.811+0000 7f54517af800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:12.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.811+0000 7f54517af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:12.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.811+0000 7f54517af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.811+0000 7f54517af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.811+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.811+0000 7f54517af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.811+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 20 zone default found 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 4 Realm: () 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 20 zonegroup default 2024-09-12T00:56:12.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:12.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.812+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.813+0000 7f54517af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:12.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.813+0000 7f54517af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:12.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.813+0000 7f54517af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:12.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.813+0000 7f54517af800 20 started sync module instance, tier type = 2024-09-12T00:56:12.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.813+0000 7f54517af800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:12.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.822+0000 7f54517af800 20 add_watcher() i=0 2024-09-12T00:56:12.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.822+0000 7f54517af800 20 add_watcher() i=1 2024-09-12T00:56:12.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.822+0000 7f54517af800 20 add_watcher() i=2 2024-09-12T00:56:12.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.822+0000 7f54517af800 20 add_watcher() i=3 2024-09-12T00:56:12.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.822+0000 7f54517af800 20 add_watcher() i=4 2024-09-12T00:56:12.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.822+0000 7f54517af800 20 add_watcher() i=5 2024-09-12T00:56:12.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.822+0000 7f54517af800 20 add_watcher() i=6 2024-09-12T00:56:12.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.824+0000 7f54517af800 20 add_watcher() i=7 2024-09-12T00:56:12.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.824+0000 7f54517af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:12.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.826+0000 7f5305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:12.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.826+0000 7f54517af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:12.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.826+0000 7f54517af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.869+0000 7f5304fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.869+0000 7f54517af800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.869+0000 7f54517af800 20 Filter name: none 2024-09-12T00:56:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.869+0000 7f527e7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:12.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.869+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:12.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.871+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.871+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.872+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.872+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:12.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.874+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.875+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.875+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.877+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:12.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.878+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.878+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.878+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.879+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.880+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.881+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.881+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.882+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:12.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.883+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.884+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.884+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.885+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:12.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.886+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.888+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.888+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.889+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:12.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.890+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.891+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.891+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.893+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:12.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.895+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.895+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.895+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.896+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.898+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.898+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.898+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.899+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.901+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.901+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.902+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.903+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:12.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.904+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.904+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.905+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.906+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:12.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.907+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.907+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.907+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.908+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:12.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.910+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.910+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.910+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.911+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:12.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.912+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.913+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.913+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.914+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:12.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.915+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.916+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.916+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.917+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:12.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.918+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.919+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.919+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.920+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:12.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.921+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.922+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.922+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.923+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:12.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.924+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.925+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.925+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:12.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.925+0000 7f54517af800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17217348941402323105', time=2024-09-12T02:56:12.187665+0000, chain.objs.size()=1 2024-09-12T00:56:12.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.925+0000 7f54517af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.73__shadow_.eyIwcnHG8XWPW4Sfn4puBkw4_pveNvP_0 2024-09-12T00:56:12.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.927+0000 7f54517af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:12.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.929+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:12.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.930+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.931+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.931+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.932+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:12.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.933+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.934+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.934+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.935+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:12.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.936+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.936+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.937+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.938+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:12.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.939+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.939+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.940+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.941+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:12.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.942+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.942+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.943+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.943+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:12.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.945+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.945+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.945+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.946+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:12.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.948+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.949+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.949+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.950+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:12.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.952+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.952+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.952+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.953+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:12.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.954+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.955+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.955+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.956+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:12.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.957+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.958+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.958+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:12.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.958+0000 7f54517af800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18362878816558896281', time=2024-09-12T02:56:11.686548+0000, chain.objs.size()=1 2024-09-12T00:56:12.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.958+0000 7f54517af800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.72__shadow_.gBVmfj9kNli51P5QCpwlKHQrGO-mZtg_0 2024-09-12T00:56:12.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.959+0000 7f54517af800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:12.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.961+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:12.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.963+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.963+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.963+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.964+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:12.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.966+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.966+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.966+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.967+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:12.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.969+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.969+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.970+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.971+0000 7f54517af800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:12.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.972+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.972+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:12.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.973+0000 7f54517af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:12.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.974+0000 7f5305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:12.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.976+0000 7f54517af800 20 remove_watcher() i=0 2024-09-12T00:56:12.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.976+0000 7f54517af800 2 removed watcher, disabling cache 2024-09-12T00:56:12.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.977+0000 7f54517af800 20 remove_watcher() i=1 2024-09-12T00:56:12.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.978+0000 7f54517af800 20 remove_watcher() i=2 2024-09-12T00:56:12.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.979+0000 7f54517af800 20 remove_watcher() i=3 2024-09-12T00:56:12.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.980+0000 7f54517af800 20 remove_watcher() i=4 2024-09-12T00:56:12.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.981+0000 7f54517af800 20 remove_watcher() i=5 2024-09-12T00:56:12.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.982+0000 7f54517af800 20 remove_watcher() i=6 2024-09-12T00:56:12.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:12.983+0000 7f54517af800 20 remove_watcher() i=7 2024-09-12T00:56:12.992 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:13.044 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:13.044 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:13.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.082+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.084+0000 7fc21febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.084+0000 7fc21febb800 20 realm 2024-09-12T00:56:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.084+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.084+0000 7fc21febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.084+0000 7fc21febb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.084+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.084+0000 7fc21febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.084+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.085+0000 7fc21febb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:13.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.085+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.085+0000 7fc21febb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:13.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.085+0000 7fc21febb800 20 searching for the correct realm 2024-09-12T00:56:13.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.087+0000 7fc21d9a5640 0 -- 172.21.15.83:0/3516151753 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x55ab14ae4910 msgr2=0x55ab14ae6d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:13.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.090+0000 7fc21e1a6640 0 -- 172.21.15.83:0/3516151753 >> [v2:172.21.15.120:6816/3242240032,v1:172.21.15.120:6817/3242240032] conn(0x55ab14ae4910 msgr2=0x7fc210072960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:13.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.297+0000 7fc21febb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:13.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.297+0000 7fc21febb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:13.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.297+0000 7fc21febb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:13.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.297+0000 7fc21febb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:13.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.297+0000 7fc21febb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:13.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.297+0000 7fc21febb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:13.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.297+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:13.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 zone default found 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 4 Realm: () 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 zonegroup default 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.298+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.299+0000 7fc21febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.299+0000 7fc21febb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.299+0000 7fc21febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.299+0000 7fc21febb800 20 started sync module instance, tier type = 2024-09-12T00:56:13.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.300+0000 7fc21febb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:13.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.308+0000 7fc21febb800 20 add_watcher() i=0 2024-09-12T00:56:13.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.308+0000 7fc21febb800 20 add_watcher() i=1 2024-09-12T00:56:13.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.308+0000 7fc21febb800 20 add_watcher() i=2 2024-09-12T00:56:13.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.308+0000 7fc21febb800 20 add_watcher() i=3 2024-09-12T00:56:13.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.308+0000 7fc21febb800 20 add_watcher() i=4 2024-09-12T00:56:13.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.308+0000 7fc21febb800 20 add_watcher() i=5 2024-09-12T00:56:13.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.308+0000 7fc21febb800 20 add_watcher() i=6 2024-09-12T00:56:13.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.309+0000 7fc21febb800 20 add_watcher() i=7 2024-09-12T00:56:13.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.309+0000 7fc21febb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:13.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.311+0000 7fc0cffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:13.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.312+0000 7fc21febb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:13.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.312+0000 7fc21febb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:13.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.344+0000 7fc0ceffd640 20 reqs_thread_entry: start 2024-09-12T00:56:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.344+0000 7fc21febb800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.344+0000 7fc21febb800 20 Filter name: none 2024-09-12T00:56:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.345+0000 7fc0ccff9640 20 reqs_thread_entry: start 2024-09-12T00:56:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.345+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:13.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.346+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.346+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.347+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.348+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:13.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.349+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.349+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.350+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.351+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:13.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.352+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.352+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.352+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.353+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:13.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.355+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.355+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.355+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.356+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:13.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.357+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.358+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.358+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.359+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:13.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.360+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.360+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.361+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.361+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:13.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.363+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.363+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.363+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.364+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:13.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.366+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.366+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.366+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.367+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:13.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.369+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.369+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.370+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.371+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:13.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.372+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.373+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.373+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.374+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:13.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.375+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.375+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.376+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.376+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:13.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.378+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.378+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.379+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.379+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:13.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.381+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.381+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.381+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.382+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:13.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.383+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.384+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.384+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.386+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:13.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.387+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.387+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.387+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.388+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:13.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.389+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.390+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.390+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.391+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:13.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.392+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.393+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.393+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.394+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:13.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.395+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.396+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.396+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.397+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:13.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.398+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.399+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.399+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.400+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:13.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.401+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.401+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.402+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.403+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:13.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.404+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.404+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.405+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.406+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:13.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.407+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.408+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.408+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.409+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:13.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.410+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.411+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.411+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.412+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:13.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.413+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.414+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.414+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.415+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:13.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.416+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.416+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.417+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.417+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:13.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.419+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.419+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.419+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.420+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:13.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.422+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.422+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.422+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.423+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:13.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.424+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.425+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.425+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.426+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.428+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.428+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.428+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.429+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:13.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.431+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.431+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.432+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.433+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:13.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.434+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.434+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.435+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.436+0000 7fc21febb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.437+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.437+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.437+0000 7fc21febb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.439+0000 7fc0cffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:13.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.441+0000 7fc21febb800 20 remove_watcher() i=0 2024-09-12T00:56:13.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.441+0000 7fc21febb800 2 removed watcher, disabling cache 2024-09-12T00:56:13.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.442+0000 7fc21febb800 20 remove_watcher() i=1 2024-09-12T00:56:13.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.443+0000 7fc21febb800 20 remove_watcher() i=2 2024-09-12T00:56:13.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.444+0000 7fc21febb800 20 remove_watcher() i=3 2024-09-12T00:56:13.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.445+0000 7fc21febb800 20 remove_watcher() i=4 2024-09-12T00:56:13.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.446+0000 7fc21febb800 20 remove_watcher() i=5 2024-09-12T00:56:13.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.447+0000 7fc21febb800 20 remove_watcher() i=6 2024-09-12T00:56:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.448+0000 7fc21febb800 20 remove_watcher() i=7 2024-09-12T00:56:13.458 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:13.509 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:13.509 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:13.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.547+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.549+0000 7efc255af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.549+0000 7efc255af800 20 realm 2024-09-12T00:56:13.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.549+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.549+0000 7efc255af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.549+0000 7efc255af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:13.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.549+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.550+0000 7efc255af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.550+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.550+0000 7efc255af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:13.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.550+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.551+0000 7efc255af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:13.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.551+0000 7efc255af800 20 searching for the correct realm 2024-09-12T00:56:13.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.554+0000 7efc22898640 0 -- 172.21.15.83:0/728890013 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7efc1806bc20 msgr2=0x7efc1808d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:13.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.760+0000 7efc2389a640 0 -- 172.21.15.83:0/728890013 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x560bd882f130 msgr2=0x560bd8831520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:13.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.764+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 20 zone default found 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 4 Realm: () 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 20 zonegroup default 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.765+0000 7efc255af800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.766+0000 7efc255af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.766+0000 7efc255af800 20 started sync module instance, tier type = 2024-09-12T00:56:13.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.766+0000 7efc255af800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.774+0000 7efc255af800 20 add_watcher() i=0 2024-09-12T00:56:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.774+0000 7efc255af800 20 add_watcher() i=1 2024-09-12T00:56:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.774+0000 7efc255af800 20 add_watcher() i=2 2024-09-12T00:56:13.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.774+0000 7efc255af800 20 add_watcher() i=3 2024-09-12T00:56:13.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.774+0000 7efc255af800 20 add_watcher() i=4 2024-09-12T00:56:13.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.774+0000 7efc255af800 20 add_watcher() i=5 2024-09-12T00:56:13.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.774+0000 7efc255af800 20 add_watcher() i=6 2024-09-12T00:56:13.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.775+0000 7efc255af800 20 add_watcher() i=7 2024-09-12T00:56:13.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.775+0000 7efc255af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:13.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.776+0000 7efad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:13.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.777+0000 7efc255af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:13.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.777+0000 7efc255af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:13.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.811+0000 7efad8fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:13.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.811+0000 7efc255af800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:13.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.811+0000 7efc255af800 20 Filter name: none 2024-09-12T00:56:13.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.811+0000 7efa527fc640 20 reqs_thread_entry: start 2024-09-12T00:56:13.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.811+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:13.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.813+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.813+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.814+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.814+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:13.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.816+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.816+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.816+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.817+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:13.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.818+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.819+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.819+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.820+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:13.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.821+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.821+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.822+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.823+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.824+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.825+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.825+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.826+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:13.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.827+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.827+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.828+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.829+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:13.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.830+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.830+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.831+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.833+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.834+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.835+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.835+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.836+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:13.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.837+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.837+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.838+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.839+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.840+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.840+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.841+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.842+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.843+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.844+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.844+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.845+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:13.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.846+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.847+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.847+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.848+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:13.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.849+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.850+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.850+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.851+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:13.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.852+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.852+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.852+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.853+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:13.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.854+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.855+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.855+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.856+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.858+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.858+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.858+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.859+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:13.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.860+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.861+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.861+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.862+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:13.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.863+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.864+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.864+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.865+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:13.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.866+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.866+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.867+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.867+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.869+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.869+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.869+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.870+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:13.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.871+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.872+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.872+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.873+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:13.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.875+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.875+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.875+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.877+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:13.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.878+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.878+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.879+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.879+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:13.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.881+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.881+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.881+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.882+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:13.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.883+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.884+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.884+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.885+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:13.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.887+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.887+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.888+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.889+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:13.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.890+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.890+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.891+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.892+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:13.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.893+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.893+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.894+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.895+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:13.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.896+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.896+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.897+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.898+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:13.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.899+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.899+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.900+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.901+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:13.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.902+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.903+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.903+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.904+0000 7efc255af800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:13.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.905+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.906+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:13.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.906+0000 7efc255af800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:13.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.908+0000 7efad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:13.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.910+0000 7efc255af800 20 remove_watcher() i=0 2024-09-12T00:56:13.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.910+0000 7efc255af800 2 removed watcher, disabling cache 2024-09-12T00:56:13.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.911+0000 7efc255af800 20 remove_watcher() i=1 2024-09-12T00:56:13.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.912+0000 7efc255af800 20 remove_watcher() i=2 2024-09-12T00:56:13.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.913+0000 7efc255af800 20 remove_watcher() i=3 2024-09-12T00:56:13.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.914+0000 7efc255af800 20 remove_watcher() i=4 2024-09-12T00:56:13.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.915+0000 7efc255af800 20 remove_watcher() i=5 2024-09-12T00:56:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.915+0000 7efc255af800 20 remove_watcher() i=6 2024-09-12T00:56:13.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:13.916+0000 7efc255af800 20 remove_watcher() i=7 2024-09-12T00:56:13.926 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:13.978 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:13.978 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:14.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.016+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.018+0000 7ff37e2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.018+0000 7ff37e2bb800 20 realm 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.018+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.018+0000 7ff37e2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.018+0000 7ff37e2bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.018+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.018+0000 7ff37e2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.018+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.019+0000 7ff37e2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.019+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.019+0000 7ff37e2bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:14.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.019+0000 7ff37e2bb800 20 searching for the correct realm 2024-09-12T00:56:14.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.021+0000 7ff37bda5640 0 -- 172.21.15.83:0/421025358 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7ff36c07eba0 msgr2=0x7ff36c08f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:14.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.024+0000 7ff37bda5640 0 -- 172.21.15.83:0/421025358 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff37402f040 msgr2=0x7ff374015440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:14.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.230+0000 7ff37e2bb800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.230+0000 7ff37e2bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.230+0000 7ff37e2bb800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.230+0000 7ff37e2bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.230+0000 7ff37e2bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.230+0000 7ff37e2bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.230+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:14.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:14.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 20 zone default found 2024-09-12T00:56:14.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 4 Realm: () 2024-09-12T00:56:14.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 20 zonegroup default 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.231+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.232+0000 7ff37e2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.232+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.232+0000 7ff37e2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.232+0000 7ff37e2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.232+0000 7ff37e2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.232+0000 7ff37e2bb800 20 started sync module instance, tier type = 2024-09-12T00:56:14.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.232+0000 7ff37e2bb800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:14.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.240+0000 7ff37e2bb800 20 add_watcher() i=0 2024-09-12T00:56:14.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.240+0000 7ff37e2bb800 20 add_watcher() i=1 2024-09-12T00:56:14.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.240+0000 7ff37e2bb800 20 add_watcher() i=2 2024-09-12T00:56:14.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.240+0000 7ff37e2bb800 20 add_watcher() i=3 2024-09-12T00:56:14.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.240+0000 7ff37e2bb800 20 add_watcher() i=4 2024-09-12T00:56:14.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.240+0000 7ff37e2bb800 20 add_watcher() i=5 2024-09-12T00:56:14.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.240+0000 7ff37e2bb800 20 add_watcher() i=6 2024-09-12T00:56:14.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.241+0000 7ff37e2bb800 20 add_watcher() i=7 2024-09-12T00:56:14.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.241+0000 7ff37e2bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:14.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.243+0000 7ff231fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:14.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.243+0000 7ff37e2bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:14.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.243+0000 7ff37e2bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:14.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.280+0000 7ff230fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:14.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.281+0000 7ff37e2bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:14.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.281+0000 7ff37e2bb800 20 Filter name: none 2024-09-12T00:56:14.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.281+0000 7ff1aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:14.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.281+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:14.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.282+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.282+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.283+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.283+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:14.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.285+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.285+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.285+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.286+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:14.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.288+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.288+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.289+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.290+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:14.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.291+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.291+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.292+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.292+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:14.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.294+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.294+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.295+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.296+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:14.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.297+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.297+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.298+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.298+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:14.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.300+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.300+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.300+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.301+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:14.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.302+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.303+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.303+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.304+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:14.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.305+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.306+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.306+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.307+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:14.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.309+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.309+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.309+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.311+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:14.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.312+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.312+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.313+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.313+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:14.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.315+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.315+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.315+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.316+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:14.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.317+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.318+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.318+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.319+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:14.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.321+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.321+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.321+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.323+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.324+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.324+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.325+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.326+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.327+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.328+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.328+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.329+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:14.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.330+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.330+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.330+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.331+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:14.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.333+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.333+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.333+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.334+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:14.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.336+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.336+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.336+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.337+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:14.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.338+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.339+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.339+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.340+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:14.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.341+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.342+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.342+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.343+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:14.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.344+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.345+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.345+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.346+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:14.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.347+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.347+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.348+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.349+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:14.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.350+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.350+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.351+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.352+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:14.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.353+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.354+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.354+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.355+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:14.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.356+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.357+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.357+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.358+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:14.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.359+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.360+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.360+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.362+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:14.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.363+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.364+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.364+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.365+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:14.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.366+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.367+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.367+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.368+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:14.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.370+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.370+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.371+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.372+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:14.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.374+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.374+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.375+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.376+0000 7ff37e2bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:14.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.377+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.377+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:14.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.377+0000 7ff37e2bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:14.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.379+0000 7ff231fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:14.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.382+0000 7ff37e2bb800 20 remove_watcher() i=0 2024-09-12T00:56:14.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.382+0000 7ff37e2bb800 2 removed watcher, disabling cache 2024-09-12T00:56:14.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.382+0000 7ff37e2bb800 20 remove_watcher() i=1 2024-09-12T00:56:14.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.384+0000 7ff37e2bb800 20 remove_watcher() i=2 2024-09-12T00:56:14.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.385+0000 7ff37e2bb800 20 remove_watcher() i=3 2024-09-12T00:56:14.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.386+0000 7ff37e2bb800 20 remove_watcher() i=4 2024-09-12T00:56:14.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.387+0000 7ff37e2bb800 20 remove_watcher() i=5 2024-09-12T00:56:14.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.387+0000 7ff37e2bb800 20 remove_watcher() i=6 2024-09-12T00:56:14.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:14.388+0000 7ff37e2bb800 20 remove_watcher() i=7 2024-09-12T00:56:14.398 DEBUG:teuthology.orchestra.run.smithi083:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:56:14.882 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :clean 2024-09-12T00:56:15.578 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileJava 2024-09-12T00:56:15.579 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processResources 2024-09-12T00:56:15.579 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :classes 2024-09-12T00:56:16.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:16.079 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :compileTestJava 2024-09-12T00:56:16.079 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:16.079 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:56:16.079 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :testClasses 2024-09-12T00:56:16.079 INFO:teuthology.orchestra.run.smithi083.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:56:16.079 INFO:teuthology.orchestra.run.smithi083.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:> Task :test 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12 00:56:17,198 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:56:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.082 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:56:18.082 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.082 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:56:18.082 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.082 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:56:18.082 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.082 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:56:18.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:56:18.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:18.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:56:19.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:19.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:56:19.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:19.178 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:56:19.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:19.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:56:19.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:19.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:56:19.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:19.579 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:56:19.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:19.678 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:56:19.679 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:19.679 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:56:19.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:19.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:56:20.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:20.178 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:56:20.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:56:20.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:20.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:56:20.580 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:20.581 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:56:20.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:20.678 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:56:20.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:20.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:56:20.879 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:20.879 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:56:21.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:21.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:56:21.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:21.179 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:56:21.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:21.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:56:21.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:21.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:56:21.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:21.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:56:21.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:21.579 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:56:21.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:21.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:56:21.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:21.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:56:22.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:22.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:56:22.478 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:22.478 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:56:22.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:22.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:56:27.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:27.779 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:56:28.182 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:28.183 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:56:28.183 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:28.183 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:56:28.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:28.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:56:28.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:28.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:56:28.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:28.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:56:29.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:29.178 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:56:29.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:29.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:56:29.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:29.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:56:29.478 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:29.478 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:56:30.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:30.179 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:56:30.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:30.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:56:30.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:30.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:56:31.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:31.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T00:56:31.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:31.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T00:56:31.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:31.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T00:56:34.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:34.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T00:56:34.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:34.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T00:56:35.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:35.179 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T00:56:35.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:35.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T00:56:35.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:35.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T00:56:35.978 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:35.978 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T00:56:36.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:36.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T00:56:36.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:36.678 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T00:56:36.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:36.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T00:56:36.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:36.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T00:56:36.879 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:36.879 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T00:56:37.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:37.079 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T00:56:37.079 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:37.079 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T00:56:37.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:37.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T00:56:37.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:37.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T00:56:37.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:37.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T00:56:37.579 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:37.579 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T00:56:37.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:37.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T00:56:37.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:37.879 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T00:56:37.978 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:37.978 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T00:56:38.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:38.079 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T00:56:38.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:38.178 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T00:56:38.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:38.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T00:56:38.478 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:38.478 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T00:56:38.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:38.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T00:56:38.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:38.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T00:56:38.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:38.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T00:56:39.079 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:39.079 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T00:56:39.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:39.178 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T00:56:39.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:39.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T00:56:39.478 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:39.479 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T00:56:39.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:39.678 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T00:56:39.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:39.779 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T00:56:39.978 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:39.979 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T00:56:39.979 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:39.979 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T00:56:40.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:40.178 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T00:56:40.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:40.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T00:56:40.478 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:40.478 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T00:56:40.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:40.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T00:56:40.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:40.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T00:56:40.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:40.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T00:56:41.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:41.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T00:56:41.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:41.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T00:56:41.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:41.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T00:56:41.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:41.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T00:56:41.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:41.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T00:56:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:41.678 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T00:56:41.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:41.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T00:56:41.978 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:41.978 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T00:56:42.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:42.179 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T00:56:42.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:42.179 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T00:56:42.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:42.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T00:56:42.478 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:42.479 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T00:56:42.679 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:42.679 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T00:56:42.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:42.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T00:56:42.978 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:42.978 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T00:56:43.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:43.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T00:56:43.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:43.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T00:56:43.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:43.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T00:56:43.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:43.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T00:56:43.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:43.579 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T00:56:43.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:43.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T00:56:43.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:43.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T00:56:44.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:44.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T00:56:44.178 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:44.178 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T00:56:44.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:44.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T00:56:44.379 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:44.379 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T00:56:44.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:44.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T00:56:44.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:44.678 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T00:56:44.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:44.878 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T00:56:44.878 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:44.879 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T00:56:45.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:45.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T00:56:45.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:45.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T00:56:45.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:45.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T00:56:45.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:45.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T00:56:45.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:45.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T00:56:45.678 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:45.678 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T00:56:45.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:45.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T00:56:45.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:45.779 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T00:56:45.978 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:45.978 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T00:56:46.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:46.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T00:56:46.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:46.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T00:56:46.378 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:46.378 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T00:56:46.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:46.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T00:56:46.578 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:46.578 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T00:56:46.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:46.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T00:56:47.078 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:47.078 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T00:56:47.278 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:47.278 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T00:56:47.778 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:47.778 INFO:teuthology.orchestra.run.smithi083.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T00:56:47.975 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:47.975 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------------------------------------------------- 2024-09-12T00:56:47.975 INFO:teuthology.orchestra.run.smithi083.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T00:56:47.975 INFO:teuthology.orchestra.run.smithi083.stdout:---------------------------------------------------------------------- 2024-09-12T00:56:47.975 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:47.975 INFO:teuthology.orchestra.run.smithi083.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:56:47.976 INFO:teuthology.orchestra.run.smithi083.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:56:47.976 INFO:teuthology.orchestra.run.smithi083.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:56:47.976 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:47.976 INFO:teuthology.orchestra.run.smithi083.stdout:BUILD SUCCESSFUL in 33s 2024-09-12T00:56:47.976 INFO:teuthology.orchestra.run.smithi083.stdout:5 actionable tasks: 5 executed 2024-09-12T00:56:47.990 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:48.042 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:48.043 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:48.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.081+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.082+0000 7fd9ff71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.082+0000 7fd9ff71f800 20 realm 2024-09-12T00:56:48.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.082+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.082+0000 7fd9ff71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.082+0000 7fd9ff71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:48.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.082+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.083+0000 7fd9ff71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.083+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.083+0000 7fd9ff71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:48.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.083+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.084+0000 7fd9ff71f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:48.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.084+0000 7fd9ff71f800 20 searching for the correct realm 2024-09-12T00:56:48.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.087+0000 7fd9faca1640 0 -- 172.21.15.83:0/1137829293 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fd9f0096580 msgr2=0x7fd9f006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:48.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.292+0000 7fd9faca1640 0 -- 172.21.15.83:0/1137829293 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55fb11f62180 msgr2=0x55fb11f645b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.296+0000 7fd9ff71f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.296+0000 7fd9ff71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.296+0000 7fd9ff71f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.296+0000 7fd9ff71f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.296+0000 7fd9ff71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.296+0000 7fd9ff71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.296+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:48.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 zone default found 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 4 Realm: () 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 zonegroup default 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.297+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.298+0000 7fd9ff71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.298+0000 7fd9ff71f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.298+0000 7fd9ff71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.298+0000 7fd9ff71f800 20 started sync module instance, tier type = 2024-09-12T00:56:48.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.298+0000 7fd9ff71f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:48.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.307+0000 7fd9ff71f800 20 add_watcher() i=0 2024-09-12T00:56:48.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.307+0000 7fd9ff71f800 20 add_watcher() i=1 2024-09-12T00:56:48.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.307+0000 7fd9ff71f800 20 add_watcher() i=2 2024-09-12T00:56:48.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.307+0000 7fd9ff71f800 20 add_watcher() i=3 2024-09-12T00:56:48.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.307+0000 7fd9ff71f800 20 add_watcher() i=4 2024-09-12T00:56:48.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.307+0000 7fd9ff71f800 20 add_watcher() i=5 2024-09-12T00:56:48.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.307+0000 7fd9ff71f800 20 add_watcher() i=6 2024-09-12T00:56:48.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.308+0000 7fd9ff71f800 20 add_watcher() i=7 2024-09-12T00:56:48.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.308+0000 7fd9ff71f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:48.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.310+0000 7fd8b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:48.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.310+0000 7fd9ff71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:48.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.310+0000 7fd9ff71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.346+0000 7fd8b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.346+0000 7fd9ff71f800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.346+0000 7fd9ff71f800 20 Filter name: none 2024-09-12T00:56:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.346+0000 7fd82a7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:48.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.346+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:48.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.347+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15592838535791375374', time=2024-09-12T02:56:30.154089+0000, chain.objs.size()=9 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.100__multipart_key1.2~DlmJL7BktIwCzNNk-WWosaUT-dQooA5.1 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.100__shadow_key1.2~DlmJL7BktIwCzNNk-WWosaUT-dQooA5.1_1 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.100__multipart_key1.2~DlmJL7BktIwCzNNk-WWosaUT-dQooA5.2 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.100__shadow_key1.2~DlmJL7BktIwCzNNk-WWosaUT-dQooA5.2_1 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.100__multipart_key1.2~DlmJL7BktIwCzNNk-WWosaUT-dQooA5.3 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.100__shadow_key1.2~DlmJL7BktIwCzNNk-WWosaUT-dQooA5.3_1 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.100__multipart_key1.2~DlmJL7BktIwCzNNk-WWosaUT-dQooA5.4 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.100__shadow_key1.2~DlmJL7BktIwCzNNk-WWosaUT-dQooA5.4_1 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.100__multipart_key1.2~DlmJL7BktIwCzNNk-WWosaUT-dQooA5.5 2024-09-12T00:56:48.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5893209254609199724', time=2024-09-12T02:56:38.357151+0000, chain.objs.size()=1 2024-09-12T00:56:48.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.113__shadow_.GAbmYObJss0_Gob9wq9dVU8HA1M8NL1_0 2024-09-12T00:56:48.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2817911007943452567', time=2024-09-12T02:56:40.336464+0000, chain.objs.size()=1 2024-09-12T00:56:48.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.120__shadow_.CtpW9VMCnHEqxA-c_wiH-GdGjE481NJ_0 2024-09-12T00:56:48.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1133606054985605164', time=2024-09-12T02:56:41.161417+0000, chain.objs.size()=1 2024-09-12T00:56:48.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.348+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.123__shadow_.Mw29iiLwkTvBOMiK4R8OonzRO0xzeMa_0 2024-09-12T00:56:48.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.355+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.357+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:48.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.358+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:56:48.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9929679747528791258', time=2024-09-12T02:56:27.971230+0000, chain.objs.size()=6 2024-09-12T00:56:48.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.94__shadow_.MOS3QVIaov78V7fD-R4dTKtd4upc3fv_0 2024-09-12T00:56:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.94__shadow_.MOS3QVIaov78V7fD-R4dTKtd4upc3fv_1 2024-09-12T00:56:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.94__shadow_.MOS3QVIaov78V7fD-R4dTKtd4upc3fv_2 2024-09-12T00:56:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.94__shadow_.MOS3QVIaov78V7fD-R4dTKtd4upc3fv_3 2024-09-12T00:56:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.94__shadow_.MOS3QVIaov78V7fD-R4dTKtd4upc3fv_4 2024-09-12T00:56:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.94__shadow_.MOS3QVIaov78V7fD-R4dTKtd4upc3fv_5 2024-09-12T00:56:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13822091776113914004', time=2024-09-12T02:56:38.340148+0000, chain.objs.size()=1 2024-09-12T00:56:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.113__shadow_.1YyLeBtf0cabAxhw5pEVQQuGsJ7UgZp_0 2024-09-12T00:56:48.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10429434003356513201', time=2024-09-12T02:56:39.198232+0000, chain.objs.size()=1 2024-09-12T00:56:48.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.116__shadow_.z6qiZiChjxIfax6fvcItJMMsnt-QGYL_0 2024-09-12T00:56:48.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9989635896432279633', time=2024-09-12T02:56:40.341604+0000, chain.objs.size()=1 2024-09-12T00:56:48.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.120__shadow_.sDaVpxHwMJFT8J8BhzG7zxiN3eCOdp-_0 2024-09-12T00:56:48.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6363877933952244018', time=2024-09-12T02:56:40.893136+0000, chain.objs.size()=1 2024-09-12T00:56:48.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.359+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.122__shadow_.yJw70_LWTc_2ZnCfQXfaCauJoh13L4K_0 2024-09-12T00:56:48.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.364+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.367+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:48.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.368+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.368+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.369+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:48.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.369+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3239191108937818030', time=2024-09-12T02:56:38.346022+0000, chain.objs.size()=1 2024-09-12T00:56:48.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.369+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.113__shadow_.tPOkvyJMU7uV8aWGsPuCrmb8zwcVrus_0 2024-09-12T00:56:48.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.369+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10562865581026126519', time=2024-09-12T02:56:43.659958+0000, chain.objs.size()=1 2024-09-12T00:56:48.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.369+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.132__shadow_.f_Mq91D-OnNzRzBk1LPtpwvPL-QK0iG_0 2024-09-12T00:56:48.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.369+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15855537820897011006', time=2024-09-12T02:56:43.665220+0000, chain.objs.size()=1 2024-09-12T00:56:48.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.369+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.132__shadow_.IzRKJi2qbcTj_FOz7qrs2qivRt8VCIQ_0 2024-09-12T00:56:48.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.371+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.373+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:48.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.374+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:48.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12694021756103949107', time=2024-09-12T02:56:25.940594+0000, chain.objs.size()=9 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~YB0ybzuPQiNahT9QcBFCj-kQkiwptmG.1 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~YB0ybzuPQiNahT9QcBFCj-kQkiwptmG.1_1 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~YB0ybzuPQiNahT9QcBFCj-kQkiwptmG.2 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~YB0ybzuPQiNahT9QcBFCj-kQkiwptmG.2_1 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~YB0ybzuPQiNahT9QcBFCj-kQkiwptmG.3 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~YB0ybzuPQiNahT9QcBFCj-kQkiwptmG.3_1 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~YB0ybzuPQiNahT9QcBFCj-kQkiwptmG.4 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~YB0ybzuPQiNahT9QcBFCj-kQkiwptmG.4_1 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~YB0ybzuPQiNahT9QcBFCj-kQkiwptmG.5 2024-09-12T00:56:48.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15367470558890283429', time=2024-09-12T02:56:34.637443+0000, chain.objs.size()=1 2024-09-12T00:56:48.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__shadow_.2d8wkQYKiugMbjtX5RZwSmzBEh3nAS7_0 2024-09-12T00:56:48.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1319930446408326219', time=2024-09-12T02:56:43.118111+0000, chain.objs.size()=1 2024-09-12T00:56:48.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.375+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.130__shadow_.mgZuRaJE9ybzx1VNuyBJ781BqSFQEQc_0 2024-09-12T00:56:48.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.381+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.384+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:48.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.386+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.386+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.386+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:48.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.386+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15236367475159483852', time=2024-09-12T02:56:38.645112+0000, chain.objs.size()=1 2024-09-12T00:56:48.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.386+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.114__shadow_.360HxBHIdwnLZ0IJpjz3LZ3JehzV0-v_0 2024-09-12T00:56:48.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.386+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3123885410057822764', time=2024-09-12T02:56:39.491107+0000, chain.objs.size()=1 2024-09-12T00:56:48.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.386+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.117__shadow_._9a7bP2vInevmx9Nux2tA1qqQRtEEMQ_0 2024-09-12T00:56:48.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.386+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12170754852824955516', time=2024-09-12T02:56:43.384102+0000, chain.objs.size()=1 2024-09-12T00:56:48.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.386+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.131__shadow_.SG3hrJuAlPKdkh-JkOZCaZ7xe1hi7ke_0 2024-09-12T00:56:48.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.388+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.391+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:48.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.392+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:56:48.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8765266574467743805', time=2024-09-12T02:56:38.639065+0000, chain.objs.size()=1 2024-09-12T00:56:48.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.114__shadow_.4BgMqk2iTac9cNTWJ12d15lvzemaKVK_0 2024-09-12T00:56:48.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2622788504734294396', time=2024-09-12T02:56:39.208950+0000, chain.objs.size()=1 2024-09-12T00:56:48.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.116__shadow_.Jtj0gIF6Wv6OIjmfxlBwUh64iBAc826_0 2024-09-12T00:56:48.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7316930337110277670', time=2024-09-12T02:56:43.389002+0000, chain.objs.size()=1 2024-09-12T00:56:48.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.131__shadow_.bOKOg9bJyczWqvVSFdxnQbpygDTRWi0_0 2024-09-12T00:56:48.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11919854551541454553', time=2024-09-12T02:56:45.105194+0000, chain.objs.size()=1 2024-09-12T00:56:48.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.393+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.138__shadow_.4NL6u0TfrqlazTxxgNkdkrteSKlQWBO_0 2024-09-12T00:56:48.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.395+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.398+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:48.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.399+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.399+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:48.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16186044469317797227', time=2024-09-12T02:56:20.176326+0000, chain.objs.size()=3 2024-09-12T00:56:48.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.84__shadow_.TNIL6uBT9yGvyNs3FWsglQCmGk4VCAL_0 2024-09-12T00:56:48.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.84__shadow_.TNIL6uBT9yGvyNs3FWsglQCmGk4VCAL_1 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.84__shadow_.TNIL6uBT9yGvyNs3FWsglQCmGk4VCAL_2 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5671389455266805971', time=2024-09-12T02:56:35.202385+0000, chain.objs.size()=9 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__multipart_key1.2~KMHVBmvglUzdLtmb_4ZzpmlP284fOBq.1 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__shadow_key1.2~KMHVBmvglUzdLtmb_4ZzpmlP284fOBq.1_1 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__multipart_key1.2~KMHVBmvglUzdLtmb_4ZzpmlP284fOBq.2 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__shadow_key1.2~KMHVBmvglUzdLtmb_4ZzpmlP284fOBq.2_1 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__multipart_key1.2~KMHVBmvglUzdLtmb_4ZzpmlP284fOBq.3 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__shadow_key1.2~KMHVBmvglUzdLtmb_4ZzpmlP284fOBq.3_1 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__multipart_key1.2~KMHVBmvglUzdLtmb_4ZzpmlP284fOBq.4 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__shadow_key1.2~KMHVBmvglUzdLtmb_4ZzpmlP284fOBq.4_1 2024-09-12T00:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.400+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.104__multipart_key1.2~KMHVBmvglUzdLtmb_4ZzpmlP284fOBq.5 2024-09-12T00:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.405+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3991909317346987999', time=2024-09-12T02:56:36.903374+0000, chain.objs.size()=1 2024-09-12T00:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.405+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.107__shadow_.FC63NAikaANn_yOpBc1QSff5rjolchP_0 2024-09-12T00:56:48.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.407+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.409+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:48.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.411+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.411+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:56:48.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.841795848594928771', time=2024-09-12T02:56:22.656425+0000, chain.objs.size()=9 2024-09-12T00:56:48.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.1 2024-09-12T00:56:48.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__shadow_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.1_1 2024-09-12T00:56:48.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.2 2024-09-12T00:56:48.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__shadow_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.2_1 2024-09-12T00:56:48.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.3 2024-09-12T00:56:48.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__shadow_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.3_1 2024-09-12T00:56:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.4 2024-09-12T00:56:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__shadow_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.4_1 2024-09-12T00:56:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.5 2024-09-12T00:56:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5596253491102802019', time=2024-09-12T02:56:30.875629+0000, chain.objs.size()=1 2024-09-12T00:56:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_.TznlM8kr8q4Bw4qLfTW8zQDY1h_HPz6_0 2024-09-12T00:56:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9320517286482978270', time=2024-09-12T02:56:42.832295+0000, chain.objs.size()=1 2024-09-12T00:56:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.129__shadow_.CazycSXzrnRCyspK1TfBJHu5lLhYUZB_0 2024-09-12T00:56:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11348799666426483845', time=2024-09-12T02:56:43.654093+0000, chain.objs.size()=1 2024-09-12T00:56:48.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.412+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.132__shadow_.id8Jrf93Q1jAFks5u9NragFBKc1MsqP_0 2024-09-12T00:56:48.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.416+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1889188000346545012', time=2024-09-12T02:56:43.937521+0000, chain.objs.size()=1 2024-09-12T00:56:48.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.417+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.133__shadow_.I5B1F_3cF9F2GOLSqGAiEsD1nSW9e-v_0 2024-09-12T00:56:48.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.419+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.422+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:48.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.423+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.423+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:56:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13280691696838746261', time=2024-09-12T02:56:30.881638+0000, chain.objs.size()=9 2024-09-12T00:56:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file2.mpg.2~o1Hjipum5yYPYsS_QLt4kRbnBaN6jxI.1 2024-09-12T00:56:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_file2.mpg.2~o1Hjipum5yYPYsS_QLt4kRbnBaN6jxI.1_1 2024-09-12T00:56:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file2.mpg.2~o1Hjipum5yYPYsS_QLt4kRbnBaN6jxI.2 2024-09-12T00:56:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_file2.mpg.2~o1Hjipum5yYPYsS_QLt4kRbnBaN6jxI.2_1 2024-09-12T00:56:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file2.mpg.2~o1Hjipum5yYPYsS_QLt4kRbnBaN6jxI.3 2024-09-12T00:56:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_file2.mpg.2~o1Hjipum5yYPYsS_QLt4kRbnBaN6jxI.3_1 2024-09-12T00:56:48.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file2.mpg.2~o1Hjipum5yYPYsS_QLt4kRbnBaN6jxI.4 2024-09-12T00:56:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_file2.mpg.2~o1Hjipum5yYPYsS_QLt4kRbnBaN6jxI.4_1 2024-09-12T00:56:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file2.mpg.2~o1Hjipum5yYPYsS_QLt4kRbnBaN6jxI.5 2024-09-12T00:56:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3494024587366230119', time=2024-09-12T02:56:32.255700+0000, chain.objs.size()=9 2024-09-12T00:56:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~HFy5P82RQMDVSuHdJb1mWZvHZ66vp9M.1 2024-09-12T00:56:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~HFy5P82RQMDVSuHdJb1mWZvHZ66vp9M.1_1 2024-09-12T00:56:48.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.424+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~HFy5P82RQMDVSuHdJb1mWZvHZ66vp9M.2 2024-09-12T00:56:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.429+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~HFy5P82RQMDVSuHdJb1mWZvHZ66vp9M.2_1 2024-09-12T00:56:48.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.429+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~HFy5P82RQMDVSuHdJb1mWZvHZ66vp9M.3 2024-09-12T00:56:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.430+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~HFy5P82RQMDVSuHdJb1mWZvHZ66vp9M.3_1 2024-09-12T00:56:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.430+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~HFy5P82RQMDVSuHdJb1mWZvHZ66vp9M.4 2024-09-12T00:56:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.430+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~HFy5P82RQMDVSuHdJb1mWZvHZ66vp9M.4_1 2024-09-12T00:56:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.430+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~HFy5P82RQMDVSuHdJb1mWZvHZ66vp9M.5 2024-09-12T00:56:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.430+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8470591076334986367', time=2024-09-12T02:56:42.542814+0000, chain.objs.size()=1 2024-09-12T00:56:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.430+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.128__shadow_.w4JZ372K-BvGA-91vlRbK2TVzDpT8lq_0 2024-09-12T00:56:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.430+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.714002213387452382', time=2024-09-12T02:56:44.201801+0000, chain.objs.size()=1 2024-09-12T00:56:48.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.430+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.134__shadow_.jq04KdY62yraLTU74GCat4PkRvlCNWS_0 2024-09-12T00:56:48.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.436+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.438+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:48.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:56:48.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15433750237628078948', time=2024-09-12T02:56:38.930537+0000, chain.objs.size()=1 2024-09-12T00:56:48.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.115__shadow_.rThroYZOPRNjDQ609x7TNpTMa7fj3vK_0 2024-09-12T00:56:48.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17268834573271011767', time=2024-09-12T02:56:39.761759+0000, chain.objs.size()=1 2024-09-12T00:56:48.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.118__shadow_.2QMczEILEwg0yZ6i0wbBLPlRsp9LQpE_0 2024-09-12T00:56:48.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9362776594974868004', time=2024-09-12T02:56:43.123853+0000, chain.objs.size()=1 2024-09-12T00:56:48.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.130__shadow_.gUzIFiXHXYvAqHaxAjG9lcHGb4nDfVz_0 2024-09-12T00:56:48.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2042489439776274871', time=2024-09-12T02:56:43.395140+0000, chain.objs.size()=1 2024-09-12T00:56:48.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.131__shadow_.a2ApyTYEGXUINuxcdjSh0YyGwtmXhGC_0 2024-09-12T00:56:48.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17424023508831513199', time=2024-09-12T02:56:44.889323+0000, chain.objs.size()=1 2024-09-12T00:56:48.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.440+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.137__shadow_.ifryt7R2zdNvl-DCvWBOq-zNVF2KmJP_0 2024-09-12T00:56:48.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.443+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.445+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:48.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.446+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.446+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:56:48.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ', time=2024-09-12T02:56:36.566465+0000, chain.objs.size()=81 2024-09-12T00:56:48.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.1 2024-09-12T00:56:48.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.2 2024-09-12T00:56:48.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.3 2024-09-12T00:56:48.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.4 2024-09-12T00:56:48.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.5 2024-09-12T00:56:48.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.6 2024-09-12T00:56:48.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.7 2024-09-12T00:56:48.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.8 2024-09-12T00:56:48.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.9 2024-09-12T00:56:48.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.10 2024-09-12T00:56:48.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.11 2024-09-12T00:56:48.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.447+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.12 2024-09-12T00:56:48.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.451+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.13 2024-09-12T00:56:48.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.451+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.14 2024-09-12T00:56:48.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.451+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.15 2024-09-12T00:56:48.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.451+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.16 2024-09-12T00:56:48.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.451+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.17 2024-09-12T00:56:48.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.451+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.18 2024-09-12T00:56:48.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.452+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.19 2024-09-12T00:56:48.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.452+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.20 2024-09-12T00:56:48.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.452+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.21 2024-09-12T00:56:48.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.452+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.22 2024-09-12T00:56:48.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.452+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.23 2024-09-12T00:56:48.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.456+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.24 2024-09-12T00:56:48.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.457+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.25 2024-09-12T00:56:48.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.457+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.26 2024-09-12T00:56:48.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.457+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.27 2024-09-12T00:56:48.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.457+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.28 2024-09-12T00:56:48.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.457+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.29 2024-09-12T00:56:48.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.457+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.30 2024-09-12T00:56:48.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.457+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.31 2024-09-12T00:56:48.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.459+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.32 2024-09-12T00:56:48.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.459+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.33 2024-09-12T00:56:48.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.459+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.34 2024-09-12T00:56:48.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.460+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.35 2024-09-12T00:56:48.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.462+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.36 2024-09-12T00:56:48.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.462+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.37 2024-09-12T00:56:48.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.462+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.38 2024-09-12T00:56:48.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.462+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.39 2024-09-12T00:56:48.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.464+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.40 2024-09-12T00:56:48.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.464+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.41 2024-09-12T00:56:48.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.464+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.42 2024-09-12T00:56:48.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.464+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.43 2024-09-12T00:56:48.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.464+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.44 2024-09-12T00:56:48.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.464+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.45 2024-09-12T00:56:48.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.464+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.46 2024-09-12T00:56:48.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.466+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.47 2024-09-12T00:56:48.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.467+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.48 2024-09-12T00:56:48.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.467+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.49 2024-09-12T00:56:48.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.467+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.50 2024-09-12T00:56:48.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.469+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.51 2024-09-12T00:56:48.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.470+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.52 2024-09-12T00:56:48.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.470+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.53 2024-09-12T00:56:48.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.470+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.54 2024-09-12T00:56:48.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.470+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.55 2024-09-12T00:56:48.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.470+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.56 2024-09-12T00:56:48.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.470+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.57 2024-09-12T00:56:48.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.472+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.58 2024-09-12T00:56:48.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.472+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.59 2024-09-12T00:56:48.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.472+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.60 2024-09-12T00:56:48.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.473+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.61 2024-09-12T00:56:48.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.473+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.62 2024-09-12T00:56:48.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.474+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.63 2024-09-12T00:56:48.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.474+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.64 2024-09-12T00:56:48.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.474+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.65 2024-09-12T00:56:48.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.474+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.66 2024-09-12T00:56:48.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.476+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.67 2024-09-12T00:56:48.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.476+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.68 2024-09-12T00:56:48.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.476+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.69 2024-09-12T00:56:48.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.480+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.70 2024-09-12T00:56:48.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.480+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.71 2024-09-12T00:56:48.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.480+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.72 2024-09-12T00:56:48.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.480+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.73 2024-09-12T00:56:48.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.480+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.74 2024-09-12T00:56:48.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.480+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.75 2024-09-12T00:56:48.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.480+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.76 2024-09-12T00:56:48.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.480+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.77 2024-09-12T00:56:48.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.480+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.78 2024-09-12T00:56:48.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.481+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.79 2024-09-12T00:56:48.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.481+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.80 2024-09-12T00:56:48.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.484+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.106__multipart_key1.2~ca9exW6PgNGNP5R1_M_0mQvIujbgCcJ.81 2024-09-12T00:56:48.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.484+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1903002943776549714', time=2024-09-12T02:56:38.925170+0000, chain.objs.size()=1 2024-09-12T00:56:48.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.484+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.115__shadow_.ZJFhIZZCHMT4fakH85BZFOcDPivsoem_0 2024-09-12T00:56:48.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.485+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12303837839631019256', time=2024-09-12T02:56:41.172229+0000, chain.objs.size()=1 2024-09-12T00:56:48.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.485+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.123__shadow_.XsJ8AgGyCoE06ORNq_KJo5m67Bz8nIV_0 2024-09-12T00:56:48.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.485+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17595130102153223272', time=2024-09-12T02:56:42.261540+0000, chain.objs.size()=1 2024-09-12T00:56:48.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.485+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.127__shadow_.l1YYJAoklnpb54wdgBj5osVUvTHgB-J_0 2024-09-12T00:56:48.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.485+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10754942584992673344', time=2024-09-12T02:56:43.927082+0000, chain.objs.size()=1 2024-09-12T00:56:48.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.485+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.133__shadow_.1aAEpk_9ZHRbBPbTWwRwto2uC_aMTRz_0 2024-09-12T00:56:48.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.489+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.492+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:48.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.493+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:48.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1423989775610273659', time=2024-09-12T02:56:33.406588+0000, chain.objs.size()=9 2024-09-12T00:56:48.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~NdwBnwXH5mR-QNIKy_mmAe7p1wIi0CQ.1 2024-09-12T00:56:48.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~NdwBnwXH5mR-QNIKy_mmAe7p1wIi0CQ.1_1 2024-09-12T00:56:48.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~NdwBnwXH5mR-QNIKy_mmAe7p1wIi0CQ.2 2024-09-12T00:56:48.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~NdwBnwXH5mR-QNIKy_mmAe7p1wIi0CQ.2_1 2024-09-12T00:56:48.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~NdwBnwXH5mR-QNIKy_mmAe7p1wIi0CQ.3 2024-09-12T00:56:48.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~NdwBnwXH5mR-QNIKy_mmAe7p1wIi0CQ.3_1 2024-09-12T00:56:48.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~NdwBnwXH5mR-QNIKy_mmAe7p1wIi0CQ.4 2024-09-12T00:56:48.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~NdwBnwXH5mR-QNIKy_mmAe7p1wIi0CQ.4_1 2024-09-12T00:56:48.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~NdwBnwXH5mR-QNIKy_mmAe7p1wIi0CQ.5 2024-09-12T00:56:48.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5575767374022640368', time=2024-09-12T02:56:41.166887+0000, chain.objs.size()=1 2024-09-12T00:56:48.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.123__shadow_.NNQnhJyzDO92ZavCSOEsfX2dO5YvPzP_0 2024-09-12T00:56:48.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1420948128983474995', time=2024-09-12T02:56:41.433786+0000, chain.objs.size()=1 2024-09-12T00:56:48.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.494+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.124__shadow_.sXYWru4E7cvwdnaBFU735Al2ZNlLyv0_0 2024-09-12T00:56:48.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.500+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.502+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:48.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS', time=2024-09-12T02:56:18.843492+0000, chain.objs.size()=9 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.80__multipart_key1.2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS.1 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.80__shadow_key1.2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS.1_1 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.80__multipart_key1.2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS.2 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.80__shadow_key1.2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS.2_1 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.80__multipart_key1.2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS.3 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.80__shadow_key1.2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS.3_1 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.504+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.80__multipart_key1.2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS.4 2024-09-12T00:56:48.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.505+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.80__shadow_key1.2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS.4_1 2024-09-12T00:56:48.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.505+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.80__multipart_key1.2~OZfHqjTvOrm4IvHZHwVbkWyd21C8ZyS.5 2024-09-12T00:56:48.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.505+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14884380017513679110', time=2024-09-12T02:56:27.308377+0000, chain.objs.size()=7 2024-09-12T00:56:48.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.505+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~taijYvSnbFF-_R4o_FMhFGtemeFD99u.1 2024-09-12T00:56:48.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.505+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~taijYvSnbFF-_R4o_FMhFGtemeFD99u.1_1 2024-09-12T00:56:48.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.505+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~taijYvSnbFF-_R4o_FMhFGtemeFD99u.1_2 2024-09-12T00:56:48.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.508+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~taijYvSnbFF-_R4o_FMhFGtemeFD99u.2 2024-09-12T00:56:48.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.509+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~taijYvSnbFF-_R4o_FMhFGtemeFD99u.2_1 2024-09-12T00:56:48.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.509+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~taijYvSnbFF-_R4o_FMhFGtemeFD99u.2_2 2024-09-12T00:56:48.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.509+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~taijYvSnbFF-_R4o_FMhFGtemeFD99u.3 2024-09-12T00:56:48.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.509+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3235380369383734246', time=2024-09-12T02:56:39.773685+0000, chain.objs.size()=1 2024-09-12T00:56:48.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.509+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.118__shadow_.9fbEQ_IrVs-RVel2h4tzYnE7hhPtb9V_0 2024-09-12T00:56:48.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.509+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8852183071129990250', time=2024-09-12T02:56:41.177054+0000, chain.objs.size()=1 2024-09-12T00:56:48.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.509+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.123__shadow_.kVhVWNF7Xwtrp151104gfqLrLCIm4Kg_0 2024-09-12T00:56:48.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.509+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11006295890759266004', time=2024-09-12T02:56:42.838162+0000, chain.objs.size()=1 2024-09-12T00:56:48.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.509+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.129__shadow_.iAXFcYBJqvTkQ5IU3AXINS2Iv1PHWOZ_0 2024-09-12T00:56:48.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.514+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.516+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:48.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.517+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18269063105320889270', time=2024-09-12T02:56:27.726208+0000, chain.objs.size()=7 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~rkrzOvk6GIhYuAtBc5mCiLLru80llvW.1 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~rkrzOvk6GIhYuAtBc5mCiLLru80llvW.1_1 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~rkrzOvk6GIhYuAtBc5mCiLLru80llvW.1_2 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~rkrzOvk6GIhYuAtBc5mCiLLru80llvW.2 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~rkrzOvk6GIhYuAtBc5mCiLLru80llvW.2_1 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~rkrzOvk6GIhYuAtBc5mCiLLru80llvW.2_2 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~rkrzOvk6GIhYuAtBc5mCiLLru80llvW.3 2024-09-12T00:56:48.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1042720376185852595', time=2024-09-12T02:56:34.009770+0000, chain.objs.size()=7 2024-09-12T00:56:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~y7O5WNAr8qcdJq7YPS1rwiXwByIyXXK.1 2024-09-12T00:56:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~y7O5WNAr8qcdJq7YPS1rwiXwByIyXXK.1_1 2024-09-12T00:56:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~y7O5WNAr8qcdJq7YPS1rwiXwByIyXXK.1_2 2024-09-12T00:56:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~y7O5WNAr8qcdJq7YPS1rwiXwByIyXXK.2 2024-09-12T00:56:48.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.518+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~y7O5WNAr8qcdJq7YPS1rwiXwByIyXXK.2_1 2024-09-12T00:56:48.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.521+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~y7O5WNAr8qcdJq7YPS1rwiXwByIyXXK.2_2 2024-09-12T00:56:48.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.521+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~y7O5WNAr8qcdJq7YPS1rwiXwByIyXXK.3 2024-09-12T00:56:48.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.521+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11477776978113749234', time=2024-09-12T02:56:40.325576+0000, chain.objs.size()=1 2024-09-12T00:56:48.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.521+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.120__shadow_.CfTt1UL9vMKkRGbORWGRtZ3eGziLNDO_0 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13395051262854094281', time=2024-09-12T02:56:42.266975+0000, chain.objs.size()=1 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.127__shadow_.WK45rX_V3ayTgJc9qy_z80H1Pz9L7uC_0 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.92586119051066030', time=2024-09-12T02:56:47.830016+0000, chain.objs.size()=9 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__multipart_key1/data/file.mpg.2~4gzuFCi3yE9BOVRZVYPnP333Uh4-7gU.1 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__shadow_key1/data/file.mpg.2~4gzuFCi3yE9BOVRZVYPnP333Uh4-7gU.1_1 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__multipart_key1/data/file.mpg.2~4gzuFCi3yE9BOVRZVYPnP333Uh4-7gU.2 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__shadow_key1/data/file.mpg.2~4gzuFCi3yE9BOVRZVYPnP333Uh4-7gU.2_1 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__multipart_key1/data/file.mpg.2~4gzuFCi3yE9BOVRZVYPnP333Uh4-7gU.3 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__shadow_key1/data/file.mpg.2~4gzuFCi3yE9BOVRZVYPnP333Uh4-7gU.3_1 2024-09-12T00:56:48.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.524+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__multipart_key1/data/file.mpg.2~4gzuFCi3yE9BOVRZVYPnP333Uh4-7gU.4 2024-09-12T00:56:48.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.526+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__shadow_key1/data/file.mpg.2~4gzuFCi3yE9BOVRZVYPnP333Uh4-7gU.4_1 2024-09-12T00:56:48.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.527+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__multipart_key1/data/file.mpg.2~4gzuFCi3yE9BOVRZVYPnP333Uh4-7gU.5 2024-09-12T00:56:48.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.531+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.533+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:48.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.534+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.535+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.535+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:48.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.535+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6112561979661030387', time=2024-09-12T02:56:38.351393+0000, chain.objs.size()=1 2024-09-12T00:56:48.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.535+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.113__shadow_.sADEdY_jNt2WB3EyjSN_r6LS3gqshf5_0 2024-09-12T00:56:48.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.537+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.539+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:48.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.540+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:56:48.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3025795024005351308', time=2024-09-12T02:56:17.940129+0000, chain.objs.size()=1 2024-09-12T00:56:48.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.78__shadow_.m8Uz1_JwTqsFOEGA6PdFnTKc6Rzc-UX_0 2024-09-12T00:56:48.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7601074518790873110', time=2024-09-12T02:56:30.869841+0000, chain.objs.size()=9 2024-09-12T00:56:48.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file.mpg.2~fF385wDchCRVz6MaXxhwgA0QK_or-VY.1 2024-09-12T00:56:48.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_file.mpg.2~fF385wDchCRVz6MaXxhwgA0QK_or-VY.1_1 2024-09-12T00:56:48.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file.mpg.2~fF385wDchCRVz6MaXxhwgA0QK_or-VY.2 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_file.mpg.2~fF385wDchCRVz6MaXxhwgA0QK_or-VY.2_1 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file.mpg.2~fF385wDchCRVz6MaXxhwgA0QK_or-VY.3 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_file.mpg.2~fF385wDchCRVz6MaXxhwgA0QK_or-VY.3_1 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file.mpg.2~fF385wDchCRVz6MaXxhwgA0QK_or-VY.4 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_file.mpg.2~fF385wDchCRVz6MaXxhwgA0QK_or-VY.4_1 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__multipart_file.mpg.2~fF385wDchCRVz6MaXxhwgA0QK_or-VY.5 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10356517319848285222', time=2024-09-12T02:56:30.893562+0000, chain.objs.size()=1 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_.u6_RtWpwyr6MrnQStgHdKPXA6qorkZK_0 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10648427969130149331', time=2024-09-12T02:56:42.272290+0000, chain.objs.size()=1 2024-09-12T00:56:48.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.541+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.127__shadow_.FgDrMFWj2jCHT7GuctmgMXMGSYG-Pk2_0 2024-09-12T00:56:48.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.548+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.551+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:48.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.552+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.552+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:48.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3500192277387647153', time=2024-09-12T02:56:29.183869+0000, chain.objs.size()=9 2024-09-12T00:56:48.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.99__multipart_key1.2~GCGudgQbL83xI1ruCvqllRrRGJWml8X.1 2024-09-12T00:56:48.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.99__shadow_key1.2~GCGudgQbL83xI1ruCvqllRrRGJWml8X.1_1 2024-09-12T00:56:48.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.99__multipart_key1.2~GCGudgQbL83xI1ruCvqllRrRGJWml8X.2 2024-09-12T00:56:48.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.99__shadow_key1.2~GCGudgQbL83xI1ruCvqllRrRGJWml8X.2_1 2024-09-12T00:56:48.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.99__multipart_key1.2~GCGudgQbL83xI1ruCvqllRrRGJWml8X.3 2024-09-12T00:56:48.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.99__shadow_key1.2~GCGudgQbL83xI1ruCvqllRrRGJWml8X.3_1 2024-09-12T00:56:48.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.99__multipart_key1.2~GCGudgQbL83xI1ruCvqllRrRGJWml8X.4 2024-09-12T00:56:48.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.99__shadow_key1.2~GCGudgQbL83xI1ruCvqllRrRGJWml8X.4_1 2024-09-12T00:56:48.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.99__multipart_key1.2~GCGudgQbL83xI1ruCvqllRrRGJWml8X.5 2024-09-12T00:56:48.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11631596695302839725', time=2024-09-12T02:56:38.633042+0000, chain.objs.size()=1 2024-09-12T00:56:48.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.114__shadow_.BgiMF5NGCXBAAKv6bjYAPalQAm_A2vD_0 2024-09-12T00:56:48.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3431924771297915901', time=2024-09-12T02:56:40.050986+0000, chain.objs.size()=1 2024-09-12T00:56:48.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.553+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.119__shadow_.uJ7ZqoKdnjrIuCOphqdnNosXBmwT2ny_0 2024-09-12T00:56:48.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.558+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.561+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:48.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:48.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.556398763609958229', time=2024-09-12T02:56:27.865220+0000, chain.objs.size()=7 2024-09-12T00:56:48.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~Azi7WyLb8RNlSyxcjXooh-DXcbdyfLX.1 2024-09-12T00:56:48.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~Azi7WyLb8RNlSyxcjXooh-DXcbdyfLX.1_1 2024-09-12T00:56:48.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~Azi7WyLb8RNlSyxcjXooh-DXcbdyfLX.1_2 2024-09-12T00:56:48.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~Azi7WyLb8RNlSyxcjXooh-DXcbdyfLX.2 2024-09-12T00:56:48.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~Azi7WyLb8RNlSyxcjXooh-DXcbdyfLX.2_1 2024-09-12T00:56:48.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~Azi7WyLb8RNlSyxcjXooh-DXcbdyfLX.2_2 2024-09-12T00:56:48.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~Azi7WyLb8RNlSyxcjXooh-DXcbdyfLX.3 2024-09-12T00:56:48.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4971897818688647640', time=2024-09-12T02:56:39.485950+0000, chain.objs.size()=1 2024-09-12T00:56:48.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.562+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.117__shadow_.GWgFrQp4i2HDSqzrMcM45tqAFwso4r0_0 2024-09-12T00:56:48.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.568+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.570+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:48.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.571+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.572+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.572+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:48.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.572+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3390742367710758848', time=2024-09-12T02:56:20.694505+0000, chain.objs.size()=1 2024-09-12T00:56:48.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.572+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.86__shadow_.ja_Crehf9oyTqyXg-4vcr44Xl9g2YQ1_0 2024-09-12T00:56:48.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.572+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17867536748589662991', time=2024-09-12T02:56:41.978860+0000, chain.objs.size()=1 2024-09-12T00:56:48.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.572+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.126__shadow_.W3zTCTzpuA2R_MpHFlrhMXFv53cdL_a_0 2024-09-12T00:56:48.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.572+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3907131112655933538', time=2024-09-12T02:56:42.820937+0000, chain.objs.size()=1 2024-09-12T00:56:48.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.572+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.129__shadow_.88aZcBneTs_RmMOLT3mZcObhuoXArpe_0 2024-09-12T00:56:48.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.574+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.576+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:48.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.577+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:56:48.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11070776436567429541', time=2024-09-12T02:56:19.461821+0000, chain.objs.size()=1 2024-09-12T00:56:48.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.82__shadow_.bvmF-D7_5VfDmy91HVxF_78y7gaKv5K_0 2024-09-12T00:56:48.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9227271472472720652', time=2024-09-12T02:56:33.704039+0000, chain.objs.size()=7 2024-09-12T00:56:48.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~7iE_qmkFRljaboLgXkfGA9qbQ1kaFgz.1 2024-09-12T00:56:48.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~7iE_qmkFRljaboLgXkfGA9qbQ1kaFgz.1_1 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~7iE_qmkFRljaboLgXkfGA9qbQ1kaFgz.1_2 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~7iE_qmkFRljaboLgXkfGA9qbQ1kaFgz.2 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~7iE_qmkFRljaboLgXkfGA9qbQ1kaFgz.2_1 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~7iE_qmkFRljaboLgXkfGA9qbQ1kaFgz.2_2 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~7iE_qmkFRljaboLgXkfGA9qbQ1kaFgz.3 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14363007621954436137', time=2024-09-12T02:56:34.146217+0000, chain.objs.size()=7 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~Qwfia-UrdZJaDTQ668gmI1zlXibbION.1 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~Qwfia-UrdZJaDTQ668gmI1zlXibbION.1_1 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~Qwfia-UrdZJaDTQ668gmI1zlXibbION.1_2 2024-09-12T00:56:48.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.578+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~Qwfia-UrdZJaDTQ668gmI1zlXibbION.2 2024-09-12T00:56:48.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.582+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~Qwfia-UrdZJaDTQ668gmI1zlXibbION.2_1 2024-09-12T00:56:48.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.582+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~Qwfia-UrdZJaDTQ668gmI1zlXibbION.2_2 2024-09-12T00:56:48.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.583+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~Qwfia-UrdZJaDTQ668gmI1zlXibbION.3 2024-09-12T00:56:48.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.583+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4097102775898239211', time=2024-09-12T02:56:39.480081+0000, chain.objs.size()=1 2024-09-12T00:56:48.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.583+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.117__shadow_.N64CGndxAoVitUU0gAjfXti5pgXhojx_0 2024-09-12T00:56:48.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.583+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10393023298531197884', time=2024-09-12T02:56:43.107742+0000, chain.objs.size()=1 2024-09-12T00:56:48.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.583+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.130__shadow_.kgO1OduxYpy8UiRBwJvRxaWzvFFbulG_0 2024-09-12T00:56:48.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.588+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.590+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:48.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.592+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.593+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.593+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:48.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.593+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11004793969744862381', time=2024-09-12T02:56:38.913244+0000, chain.objs.size()=1 2024-09-12T00:56:48.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.593+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.115__shadow_.Weeh1aVcK-TIhgoMftCk-rceiZ9clrK_0 2024-09-12T00:56:48.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.593+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.588211710767623451', time=2024-09-12T02:56:40.603929+0000, chain.objs.size()=1 2024-09-12T00:56:48.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.593+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.121__shadow_.Qlk4VvebWIVFlS82VbyN_ovJ3YNfMOt_0 2024-09-12T00:56:48.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.593+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.734975254720344059', time=2024-09-12T02:56:41.989184+0000, chain.objs.size()=1 2024-09-12T00:56:48.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.593+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.126__shadow_.4EgGebp0KcdkG8PJrUra4owczacxvHa_0 2024-09-12T00:56:48.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.595+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.597+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:48.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.598+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.598+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:56:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp', time=2024-09-12T02:56:31.507159+0000, chain.objs.size()=9 2024-09-12T00:56:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.102__multipart_key1.2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp.7 2024-09-12T00:56:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.102__shadow_key1.2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp.7_1 2024-09-12T00:56:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.102__multipart_key1.2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp.8 2024-09-12T00:56:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.102__shadow_key1.2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp.8_1 2024-09-12T00:56:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.102__multipart_key1.2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp.9 2024-09-12T00:56:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.102__shadow_key1.2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp.9_1 2024-09-12T00:56:48.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.102__multipart_key1.2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp.10 2024-09-12T00:56:48.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.102__shadow_key1.2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp.10_1 2024-09-12T00:56:48.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.102__multipart_key1.2~o1dt9yjTxi7-P-t0Vl02Fwus7j4ibNp.11 2024-09-12T00:56:48.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15294444443053971476', time=2024-09-12T02:56:32.588723+0000, chain.objs.size()=9 2024-09-12T00:56:48.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~ZNzxehrDk_r99r8dKSp5F_D9I0ASMEa.1 2024-09-12T00:56:48.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~ZNzxehrDk_r99r8dKSp5F_D9I0ASMEa.1_1 2024-09-12T00:56:48.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.599+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~ZNzxehrDk_r99r8dKSp5F_D9I0ASMEa.2 2024-09-12T00:56:48.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~ZNzxehrDk_r99r8dKSp5F_D9I0ASMEa.2_1 2024-09-12T00:56:48.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~ZNzxehrDk_r99r8dKSp5F_D9I0ASMEa.3 2024-09-12T00:56:48.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~ZNzxehrDk_r99r8dKSp5F_D9I0ASMEa.3_1 2024-09-12T00:56:48.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~ZNzxehrDk_r99r8dKSp5F_D9I0ASMEa.4 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__shadow_key1.2~ZNzxehrDk_r99r8dKSp5F_D9I0ASMEa.4_1 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.103__multipart_key1.2~ZNzxehrDk_r99r8dKSp5F_D9I0ASMEa.5 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6374451440198305654', time=2024-09-12T02:56:40.056385+0000, chain.objs.size()=1 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.119__shadow_.jcjRcy91LXTx7Qiooc0xvAvIONUoxwA_0 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17407286150147360846', time=2024-09-12T02:56:40.061761+0000, chain.objs.size()=1 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.119__shadow_.UtFhykfPTHdgREjia6y0DkK6fNLwMD8_0 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6989860503317181614', time=2024-09-12T02:56:40.887790+0000, chain.objs.size()=1 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.122__shadow_.rw-pGNZ1k95WLek53EZZp6EhCtG9WNK_0 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1477083374213252343', time=2024-09-12T02:56:41.701694+0000, chain.objs.size()=1 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.125__shadow_.CH6WUoAWZAzKJo4ot-pk8WoaFH53v-k_0 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.604+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4619376924077784539', time=2024-09-12T02:56:42.256145+0000, chain.objs.size()=1 2024-09-12T00:56:48.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.605+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.127__shadow_.j8kHwbgq12Zojzp7sP6AaNpUEwcsY3i_0 2024-09-12T00:56:48.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.608+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12052261170194792807', time=2024-09-12T02:56:42.549136+0000, chain.objs.size()=1 2024-09-12T00:56:48.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.608+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.128__shadow_.4A7yomPRdHiR0RJOFBhDVBUiUGEBUOM_0 2024-09-12T00:56:48.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.611+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.614+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:48.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.615+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.615+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16854615387194033217', time=2024-09-12T02:56:35.801919+0000, chain.objs.size()=9 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.105__multipart_key1.2~X7OxuzZPydFJOKZds7MvEA6aX0_ua-2.1 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.105__shadow_key1.2~X7OxuzZPydFJOKZds7MvEA6aX0_ua-2.1_1 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.105__multipart_key1.2~X7OxuzZPydFJOKZds7MvEA6aX0_ua-2.2 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.105__shadow_key1.2~X7OxuzZPydFJOKZds7MvEA6aX0_ua-2.2_1 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.105__multipart_key1.2~X7OxuzZPydFJOKZds7MvEA6aX0_ua-2.3 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.105__shadow_key1.2~X7OxuzZPydFJOKZds7MvEA6aX0_ua-2.3_1 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.105__multipart_key1.2~X7OxuzZPydFJOKZds7MvEA6aX0_ua-2.4 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.105__shadow_key1.2~X7OxuzZPydFJOKZds7MvEA6aX0_ua-2.4_1 2024-09-12T00:56:48.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.105__multipart_key1.2~X7OxuzZPydFJOKZds7MvEA6aX0_ua-2.5 2024-09-12T00:56:48.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2880189429476959148', time=2024-09-12T02:56:40.898153+0000, chain.objs.size()=1 2024-09-12T00:56:48.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.616+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.122__shadow_.HLDUl_0uDBCriZZUJ9Q_uEbXN8oE35L_0 2024-09-12T00:56:48.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.621+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.623+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:48.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.625+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.625+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.625+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:56:48.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.625+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3697115186994189129', time=2024-09-12T02:56:39.767697+0000, chain.objs.size()=1 2024-09-12T00:56:48.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.625+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.118__shadow_.TNHQvVE9I8Y3EqJSbtSbwZ8A9XmKdfm_0 2024-09-12T00:56:48.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.625+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12501317211702493463', time=2024-09-12T02:56:39.779103+0000, chain.objs.size()=1 2024-09-12T00:56:48.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.625+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.118__shadow_.G7_VTAHI-RBhqtrTGP5diUiQlWKO0YF_0 2024-09-12T00:56:48.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.625+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1273290151092029469', time=2024-09-12T02:56:40.609717+0000, chain.objs.size()=1 2024-09-12T00:56:48.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.625+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.121__shadow_.tq-JbnF75W3iJRqncqUJuTLMPEqW2Sy_0 2024-09-12T00:56:48.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.627+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.629+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:48.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.631+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.631+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.631+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:56:48.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.631+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4110298674405127162', time=2024-09-12T02:56:46.079426+0000, chain.objs.size()=1 2024-09-12T00:56:48.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.631+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.141__shadow_.nxIMcwp3GpiXTJNh82yJxoz4w-nMNuZ_0 2024-09-12T00:56:48.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.633+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.635+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:48.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.636+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:56:48.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17694434929776956600', time=2024-09-12T02:56:30.887719+0000, chain.objs.size()=1 2024-09-12T00:56:48.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.101__shadow_.r2GRFDPwR3vDWNIufW9NI7IMpo5p1yV_0 2024-09-12T00:56:48.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5079414103925033932', time=2024-09-12T02:56:40.045651+0000, chain.objs.size()=1 2024-09-12T00:56:48.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.119__shadow_.BjnA98QfUfy-4DHCkWza-_5YVY7z_Hu_0 2024-09-12T00:56:48.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.88851635090567823', time=2024-09-12T02:56:41.707074+0000, chain.objs.size()=1 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.125__shadow_.oLukOKqI7MZ4g5_kXjm0wpl7th731Xv_0 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.19159200172673904', time=2024-09-12T02:56:44.196635+0000, chain.objs.size()=1 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.134__shadow_.mHztNH-Z5pGeC5ev71oUd2pG3dHwU25_0 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8021530142821253777', time=2024-09-12T02:56:45.275153+0000, chain.objs.size()=1 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.139__shadow_.ELTMEqdzmac80ibNlLilu92RSsG5JrO_0 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4216447985408075898', time=2024-09-12T02:56:47.143585+0000, chain.objs.size()=9 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.144__multipart_key1.2~k3EXvI3oUQqHIXcAjCnaiw2h20uY0CQ.1 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.144__shadow_key1.2~k3EXvI3oUQqHIXcAjCnaiw2h20uY0CQ.1_1 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.144__multipart_key1.2~k3EXvI3oUQqHIXcAjCnaiw2h20uY0CQ.2 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.144__shadow_key1.2~k3EXvI3oUQqHIXcAjCnaiw2h20uY0CQ.2_1 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.144__multipart_key1.2~k3EXvI3oUQqHIXcAjCnaiw2h20uY0CQ.3 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.144__shadow_key1.2~k3EXvI3oUQqHIXcAjCnaiw2h20uY0CQ.3_1 2024-09-12T00:56:48.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.637+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.144__multipart_key1.2~k3EXvI3oUQqHIXcAjCnaiw2h20uY0CQ.4 2024-09-12T00:56:48.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.641+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.144__shadow_key1.2~k3EXvI3oUQqHIXcAjCnaiw2h20uY0CQ.4_1 2024-09-12T00:56:48.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.641+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.144__multipart_key1.2~k3EXvI3oUQqHIXcAjCnaiw2h20uY0CQ.5 2024-09-12T00:56:48.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.645+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.647+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.648+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16475148681254978403', time=2024-09-12T02:56:20.435278+0000, chain.objs.size()=1 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.85__shadow_.bmE8eDIJF8XsU62qFgtwtFl9ZaygAtk_0 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1117480471935536157', time=2024-09-12T02:56:25.375981+0000, chain.objs.size()=9 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~FrKWdOiDkfPnEFpWJ0fSOMw715HSaob.1 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~FrKWdOiDkfPnEFpWJ0fSOMw715HSaob.1_1 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~FrKWdOiDkfPnEFpWJ0fSOMw715HSaob.2 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~FrKWdOiDkfPnEFpWJ0fSOMw715HSaob.2_1 2024-09-12T00:56:48.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~FrKWdOiDkfPnEFpWJ0fSOMw715HSaob.3 2024-09-12T00:56:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~FrKWdOiDkfPnEFpWJ0fSOMw715HSaob.3_1 2024-09-12T00:56:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~FrKWdOiDkfPnEFpWJ0fSOMw715HSaob.4 2024-09-12T00:56:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~FrKWdOiDkfPnEFpWJ0fSOMw715HSaob.4_1 2024-09-12T00:56:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~FrKWdOiDkfPnEFpWJ0fSOMw715HSaob.5 2024-09-12T00:56:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17290045508261602231', time=2024-09-12T02:56:41.984214+0000, chain.objs.size()=1 2024-09-12T00:56:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.126__shadow_.WgmnxIFi-goi2v3sFfZhDleFlZWb8GE_0 2024-09-12T00:56:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14055806778036272704', time=2024-09-12T02:56:44.206799+0000, chain.objs.size()=1 2024-09-12T00:56:48.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.649+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.134__shadow_.vSkeomNJtmRijlFNixKJoQ5qVJFnwPo_0 2024-09-12T00:56:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.656+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.658+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:48.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.659+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6325832611912033755', time=2024-09-12T02:56:39.203600+0000, chain.objs.size()=1 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.116__shadow_.0E8pcbQoHAgRXfSDUu-cq1hr3rbnhEl_0 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11537770199317557748', time=2024-09-12T02:56:39.496409+0000, chain.objs.size()=1 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.117__shadow_.i2WwrdxslNsUWz1qkhQJt1G7_J5d5LN_0 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8099105502142482102', time=2024-09-12T02:56:40.619744+0000, chain.objs.size()=1 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.121__shadow_.4SdkZq46dSrp8ZAaBJU0Rk4uNJ5Xy6p_0 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6493322457985581346', time=2024-09-12T02:56:41.444410+0000, chain.objs.size()=1 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.124__shadow_.iMZp8uHJ5wCTRpfE_oGkz3uhLlCIMPW_0 2024-09-12T00:56:48.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18374678798968741595', time=2024-09-12T02:56:45.830824+0000, chain.objs.size()=1 2024-09-12T00:56:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.660+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.140__shadow_.MGi7ZjRnJYiJxq9ApJCIFiEBAJOei7Y_0 2024-09-12T00:56:48.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.662+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.665+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:48.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.666+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.666+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.667+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:56:48.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.667+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8005316084900021623', time=2024-09-12T02:56:40.614729+0000, chain.objs.size()=1 2024-09-12T00:56:48.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.667+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.121__shadow_.HEdVc6oMRljo8KGYv6ljgkfo7wZdx6P_0 2024-09-12T00:56:48.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.667+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5450541468599459632', time=2024-09-12T02:56:42.826554+0000, chain.objs.size()=1 2024-09-12T00:56:48.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.667+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.129__shadow_.vhbp5ca4Ortp_EG-rk27beM8aaYoetP_0 2024-09-12T00:56:48.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.667+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10184605836914255778', time=2024-09-12T02:56:43.112951+0000, chain.objs.size()=1 2024-09-12T00:56:48.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.667+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.130__shadow_.AfSI-8dS_lypsfu_rqUjAczZzuHvRCH_0 2024-09-12T00:56:48.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.667+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17859747758003643258', time=2024-09-12T02:56:43.932236+0000, chain.objs.size()=1 2024-09-12T00:56:48.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.667+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.133__shadow_.eb9unvnXF2Ny81hwaiOMsSD1TSuHkXC_0 2024-09-12T00:56:48.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.669+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.671+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:48.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.672+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.672+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.673+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:56:48.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.673+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4766756525780491775', time=2024-09-12T02:56:40.331266+0000, chain.objs.size()=1 2024-09-12T00:56:48.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.673+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.120__shadow_.0B-TD-pd1pg4V7BQYPSTw-_YoonjaAl_0 2024-09-12T00:56:48.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.673+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17660519918980741504', time=2024-09-12T02:56:41.439333+0000, chain.objs.size()=1 2024-09-12T00:56:48.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.673+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.124__shadow_.xWY5d0AyLGLziRYT3OawNukdDG3wVON_0 2024-09-12T00:56:48.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.674+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.676+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:48.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.678+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.678+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.678+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.678+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12449565515265163560', time=2024-09-12T02:56:22.548712+0000, chain.objs.size()=9 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.678+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.1 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.678+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__shadow_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.1_1 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.678+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.2 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.678+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__shadow_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.2_1 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.3 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__shadow_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.3_1 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.4 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__shadow_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.4_1 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.92__multipart_key1.2~gYobu7U8WyJVk4-4lxFeU4fZ7gPMU8v.5 2024-09-12T00:56:48.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3864530905647116872', time=2024-09-12T02:56:40.882223+0000, chain.objs.size()=1 2024-09-12T00:56:48.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.122__shadow_.QpiI8dUWU2cEPv5OFvwxrDKPhRHD3gj_0 2024-09-12T00:56:48.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13847196722136187393', time=2024-09-12T02:56:42.536666+0000, chain.objs.size()=1 2024-09-12T00:56:48.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.128__shadow_.Yo-d_0xMe6JSM997vKZe8CZMLk5BnAn_0 2024-09-12T00:56:48.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13383267582120187690', time=2024-09-12T02:56:45.323969+0000, chain.objs.size()=1 2024-09-12T00:56:48.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.679+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.139__shadow_.JPD31zHWprXUXZU665vPw2bgUcaXznG_0 2024-09-12T00:56:48.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.685+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.688+0000 7fd9ff71f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:48.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.689+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:56:48.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8988871337531780646', time=2024-09-12T02:56:21.782632+0000, chain.objs.size()=1 2024-09-12T00:56:48.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.91__shadow_.bJlkxeEQXapqmtVm0JJSIQawGtPdymD_0 2024-09-12T00:56:48.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16005397525775529683', time=2024-09-12T02:56:26.885411+0000, chain.objs.size()=9 2024-09-12T00:56:48.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~s1bpLCT4oRWaaiwNwK_Zg9aeg3wn74_.1 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~s1bpLCT4oRWaaiwNwK_Zg9aeg3wn74_.1_1 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~s1bpLCT4oRWaaiwNwK_Zg9aeg3wn74_.2 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~s1bpLCT4oRWaaiwNwK_Zg9aeg3wn74_.2_1 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~s1bpLCT4oRWaaiwNwK_Zg9aeg3wn74_.3 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~s1bpLCT4oRWaaiwNwK_Zg9aeg3wn74_.3_1 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~s1bpLCT4oRWaaiwNwK_Zg9aeg3wn74_.4 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__shadow_key1.2~s1bpLCT4oRWaaiwNwK_Zg9aeg3wn74_.4_1 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.95__multipart_key1.2~s1bpLCT4oRWaaiwNwK_Zg9aeg3wn74_.5 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14965155010775032403', time=2024-09-12T02:56:38.627312+0000, chain.objs.size()=1 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.114__shadow_.pGDkBrKnQtNoUZUcn2HLm8dVhQEE4VI_0 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14426444602802399818', time=2024-09-12T02:56:38.919313+0000, chain.objs.size()=1 2024-09-12T00:56:48.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.690+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.115__shadow_.IqKkXua1DnhOmQFmvWKoqKKK48L5SWp_0 2024-09-12T00:56:48.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.695+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10249065152532940957', time=2024-09-12T02:56:39.214354+0000, chain.objs.size()=1 2024-09-12T00:56:48.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.695+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.116__shadow_.IQplDTnETK3f_3zxNHBMVfFtWazroMQ_0 2024-09-12T00:56:48.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.695+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17880704901390698182', time=2024-09-12T02:56:41.713224+0000, chain.objs.size()=1 2024-09-12T00:56:48.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.695+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.125__shadow_.qCyed_JKH7olwXty0hiM71OTpPoqG1E_0 2024-09-12T00:56:48.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.695+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16945364746960030252', time=2024-09-12T02:56:41.994993+0000, chain.objs.size()=1 2024-09-12T00:56:48.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.695+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.126__shadow_.jd-gTyevLqaYFT1gA7jtJT5mq0wPhMS_0 2024-09-12T00:56:48.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.696+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10058943028966379939', time=2024-09-12T02:56:42.554064+0000, chain.objs.size()=1 2024-09-12T00:56:48.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.696+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.128__shadow_.puvpaHbAwDDjIcuK2yz3cMDUm3N38FW_0 2024-09-12T00:56:48.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.696+0000 7fd9ff71f800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15897407370941667152', time=2024-09-12T02:56:47.836063+0000, chain.objs.size()=1 2024-09-12T00:56:48.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.696+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.145__shadow_.Kkp8J3kUArydoXLQsEBPE6mnplWKFQK_0 2024-09-12T00:56:48.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.700+0000 7fd9ff71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:56:48.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.703+0000 7fd8b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:48.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.705+0000 7fd9ff71f800 20 remove_watcher() i=0 2024-09-12T00:56:48.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.705+0000 7fd9ff71f800 2 removed watcher, disabling cache 2024-09-12T00:56:48.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.706+0000 7fd9ff71f800 20 remove_watcher() i=1 2024-09-12T00:56:48.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.706+0000 7fd9ff71f800 20 remove_watcher() i=2 2024-09-12T00:56:48.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.707+0000 7fd9ff71f800 20 remove_watcher() i=3 2024-09-12T00:56:48.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.709+0000 7fd9ff71f800 20 remove_watcher() i=4 2024-09-12T00:56:48.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.709+0000 7fd9ff71f800 20 remove_watcher() i=5 2024-09-12T00:56:48.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.710+0000 7fd9ff71f800 20 remove_watcher() i=6 2024-09-12T00:56:48.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.711+0000 7fd9ff71f800 20 remove_watcher() i=7 2024-09-12T00:56:48.721 DEBUG:teuthology.orchestra.run.smithi083:> radosgw-admin gc process --include-all 2024-09-12T00:56:48.773 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:48.773 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:48.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.811+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.812+0000 7f1b93722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.812+0000 7f1b93722800 20 realm 2024-09-12T00:56:48.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.812+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.812+0000 7f1b93722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.812+0000 7f1b93722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:48.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.812+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.813+0000 7f1b93722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.813+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.813+0000 7f1b93722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:48.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.813+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.813+0000 7f1b93722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:48.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.813+0000 7f1b93722800 20 searching for the correct realm 2024-09-12T00:56:48.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.817+0000 7f1b8fb03640 0 -- 172.21.15.83:0/1798157797 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f1b8403ac00 msgr2=0x7f1b8402b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:48.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.820+0000 7f1b8f302640 0 -- 172.21.15.83:0/1798157797 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f1b88020040 msgr2=0x7f1b88020930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:48.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.824+0000 7f1b93722800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:48.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.824+0000 7f1b93722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:48.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.824+0000 7f1b93722800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:48.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.824+0000 7f1b93722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:48.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.824+0000 7f1b93722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:48.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.824+0000 7f1b93722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:48.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.824+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.824+0000 7f1b93722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.824+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:48.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:48.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 20 zone default found 2024-09-12T00:56:48.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 4 Realm: () 2024-09-12T00:56:48.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:48.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:48.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:48.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 20 zonegroup default 2024-09-12T00:56:48.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.825+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.826+0000 7f1b93722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.826+0000 7f1b93722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.826+0000 7f1b93722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.826+0000 7f1b93722800 20 started sync module instance, tier type = 2024-09-12T00:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.826+0000 7f1b93722800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:48.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.834+0000 7f1b93722800 20 add_watcher() i=0 2024-09-12T00:56:48.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.834+0000 7f1b93722800 20 add_watcher() i=1 2024-09-12T00:56:48.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.834+0000 7f1b93722800 20 add_watcher() i=2 2024-09-12T00:56:48.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.834+0000 7f1b93722800 20 add_watcher() i=3 2024-09-12T00:56:48.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.834+0000 7f1b93722800 20 add_watcher() i=4 2024-09-12T00:56:48.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.834+0000 7f1b93722800 20 add_watcher() i=5 2024-09-12T00:56:48.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.834+0000 7f1b93722800 20 add_watcher() i=6 2024-09-12T00:56:48.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.835+0000 7f1b93722800 20 add_watcher() i=7 2024-09-12T00:56:48.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.835+0000 7f1b93722800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:48.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.837+0000 7f1a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:48.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.837+0000 7f1b93722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:48.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.837+0000 7f1b93722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:48.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.872+0000 7f1a44fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:48.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.872+0000 7f1b93722800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:48.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.872+0000 7f1b93722800 20 Filter name: none 2024-09-12T00:56:48.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.872+0000 7f19be7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:48.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.872+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:56:48.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.873+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.874+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.874+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.875+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:56:48.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.877+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.877+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.878+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.879+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:56:48.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.880+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.880+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.881+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.882+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:56:48.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.883+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.883+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.884+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.885+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:56:48.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.886+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.886+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.886+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.887+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:56:48.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.889+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.889+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.889+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.890+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:56:48.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.891+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.892+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.892+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.893+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:56:48.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.894+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.895+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.895+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.896+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:56:48.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.897+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.898+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.898+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.899+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:56:48.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.900+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.901+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.901+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.902+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:56:48.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.903+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.904+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.904+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.905+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:56:48.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.907+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.907+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.907+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.908+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:56:48.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.909+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.910+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.910+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.911+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:56:48.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.912+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.913+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.913+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.915+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:56:48.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.916+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.917+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.917+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.918+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:56:48.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.919+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.920+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.920+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.921+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:56:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.922+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.923+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.923+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.924+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:56:48.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.925+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.926+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.926+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.927+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:56:48.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.928+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.929+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.929+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.930+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:56:48.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.931+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.932+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.932+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.933+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:56:48.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.935+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.935+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.935+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.936+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:56:48.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.937+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.938+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.938+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.939+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:56:48.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.940+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.941+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.941+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.942+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:56:48.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.943+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.944+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.944+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.945+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:56:48.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.947+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.947+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.947+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.949+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:56:48.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.951+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.951+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.951+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.952+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:56:48.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.953+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.954+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.954+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.955+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:56:48.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.956+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.957+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.957+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.958+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:56:48.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.959+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.960+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.960+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.961+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:56:48.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.962+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.963+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.963+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.964+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:56:48.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.965+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.966+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.966+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.967+0000 7f1b93722800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:56:48.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.968+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.968+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:56:48.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.969+0000 7f1b93722800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:56:48.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.970+0000 7f1a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:48.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.972+0000 7f1b93722800 20 remove_watcher() i=0 2024-09-12T00:56:48.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.972+0000 7f1b93722800 2 removed watcher, disabling cache 2024-09-12T00:56:48.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.973+0000 7f1b93722800 20 remove_watcher() i=1 2024-09-12T00:56:48.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.974+0000 7f1b93722800 20 remove_watcher() i=2 2024-09-12T00:56:48.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.975+0000 7f1b93722800 20 remove_watcher() i=3 2024-09-12T00:56:48.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.976+0000 7f1b93722800 20 remove_watcher() i=4 2024-09-12T00:56:48.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.977+0000 7f1b93722800 20 remove_watcher() i=5 2024-09-12T00:56:48.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.978+0000 7f1b93722800 20 remove_watcher() i=6 2024-09-12T00:56:48.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:48.979+0000 7f1b93722800 20 remove_watcher() i=7 2024-09-12T00:56:48.990 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T00:56:49.013 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T00:56:49.014 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T00:56:49.014 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T00:56:49.014 DEBUG:teuthology.orchestra.run.smithi083:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:56:49.043 INFO:teuthology.orchestra.run.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T00:56:49.830 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T00:56:49.831 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T00:56:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:49.930 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:50.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.167+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.169+0000 7f322d335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.169+0000 7f322d335800 20 realm 2024-09-12T00:56:50.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.169+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.169+0000 7f322d335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.169+0000 7f322d335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:50.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.169+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.170+0000 7f322d335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.170+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.170+0000 7f322d335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:50.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.170+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.171+0000 7f322d335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:50.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.171+0000 7f322d335800 20 searching for the correct realm 2024-09-12T00:56:50.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.174+0000 7f32287c2640 0 -- 172.21.15.83:0/3864142796 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f321c045960 msgr2=0x7f321c015420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:50.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.380+0000 7f32297c4640 0 -- 172.21.15.83:0/3864142796 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x555652f5c060 msgr2=0x555652f5e520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:50.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:50.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:50.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:50.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:50.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:50.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:50.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:50.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.385+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 20 zone default found 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 4 Realm: () 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 20 zonegroup default 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.386+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.387+0000 7f322d335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.387+0000 7f322d335800 20 started sync module instance, tier type = 2024-09-12T00:56:50.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.387+0000 7f322d335800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:50.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.397+0000 7f322d335800 20 add_watcher() i=0 2024-09-12T00:56:50.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.397+0000 7f322d335800 20 add_watcher() i=1 2024-09-12T00:56:50.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.397+0000 7f322d335800 20 add_watcher() i=2 2024-09-12T00:56:50.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.397+0000 7f322d335800 20 add_watcher() i=3 2024-09-12T00:56:50.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.397+0000 7f322d335800 20 add_watcher() i=4 2024-09-12T00:56:50.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.397+0000 7f322d335800 20 add_watcher() i=5 2024-09-12T00:56:50.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.397+0000 7f322d335800 20 add_watcher() i=6 2024-09-12T00:56:50.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.398+0000 7f322d335800 20 add_watcher() i=7 2024-09-12T00:56:50.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.398+0000 7f322d335800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:50.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.400+0000 7f30df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:50.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.400+0000 7f322d335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:50.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.400+0000 7f322d335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:50.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.400+0000 7f322d335800 5 note: GC not initialized 2024-09-12T00:56:50.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.400+0000 7f30de7e4640 20 reqs_thread_entry: start 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 20 Filter name: none 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f30d77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T00:56:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.401+0000 7f322d335800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.402+0000 7f322d335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.402+0000 7f322d335800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T00:56:50.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.402+0000 7f322d335800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:56:50.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.402+0000 7f322d335800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T00:56:50.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.403+0000 7f322d335800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:56:50.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.403+0000 7f322d335800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:56:50.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.403+0000 7f322d335800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T00:56:50.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.403+0000 7f30fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464545 cookie 93829247435712 notifier 9003 bl.length()=384 2024-09-12T00:56:50.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.403+0000 7f30fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:56:50.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.403+0000 7f30fffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:56:50.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.405+0000 7f322d335800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:56:50.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.405+0000 7f322d335800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:56:50.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.405+0000 7f322d335800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T00:56:50.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.405+0000 7f30ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464546 cookie 93829247443728 notifier 9003 bl.length()=225 2024-09-12T00:56:50.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.405+0000 7f30ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:56:50.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.405+0000 7f30ff7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:56:50.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.407+0000 7f322d335800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:56:50.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.407+0000 7f322d335800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:56:50.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.407+0000 7f322d335800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T00:56:50.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.407+0000 7f30ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464352 cookie 93829247441664 notifier 9003 bl.length()=234 2024-09-12T00:56:50.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.407+0000 7f30ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:56:50.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.407+0000 7f30ff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:56:50.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.409+0000 7f30df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:50.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.411+0000 7f322d335800 20 remove_watcher() i=0 2024-09-12T00:56:50.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.411+0000 7f322d335800 2 removed watcher, disabling cache 2024-09-12T00:56:50.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.412+0000 7f322d335800 20 remove_watcher() i=1 2024-09-12T00:56:50.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.413+0000 7f322d335800 20 remove_watcher() i=2 2024-09-12T00:56:50.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.415+0000 7f322d335800 20 remove_watcher() i=3 2024-09-12T00:56:50.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.416+0000 7f322d335800 20 remove_watcher() i=4 2024-09-12T00:56:50.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.417+0000 7f322d335800 20 remove_watcher() i=5 2024-09-12T00:56:50.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.418+0000 7f322d335800 20 remove_watcher() i=6 2024-09-12T00:56:50.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.419+0000 7f322d335800 20 remove_watcher() i=7 2024-09-12T00:56:50.426 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:50.426 INFO:teuthology.orchestra.run.smithi083.stdout: "id": "RGW11111111111111111", 2024-09-12T00:56:50.426 INFO:teuthology.orchestra.run.smithi083.stdout: "tenant": "", 2024-09-12T00:56:50.426 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T00:56:50.426 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T00:56:50.426 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-09-12T00:56:50.426 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:50.426 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max_users": 1000, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max_roles": 1000, 2024-09-12T00:56:50.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max_groups": 1000, 2024-09-12T00:56:50.428 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:50.428 INFO:teuthology.orchestra.run.smithi083.stdout: "max_access_keys": 4 2024-09-12T00:56:50.428 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:50.429 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T00:56:50.429 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key NVWIWWSGOIRARZUSQFLV --secret QK5+S0WZek7INwc2+2yHK9US7+PKXxszFENycAqBURKo6qhnPSvUrg== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T00:56:50.497 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:50.497 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:50.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.532+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.533+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.533+0000 7f050d146800 20 realm 2024-09-12T00:56:50.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.533+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.534+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.534+0000 7f050d146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:50.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.534+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.534+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.534+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.535+0000 7f050d146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:50.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.535+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.535+0000 7f050d146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:50.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.535+0000 7f050d146800 20 searching for the correct realm 2024-09-12T00:56:50.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.538+0000 7f050a42f640 0 -- 172.21.15.83:0/828939324 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f04f4027c00 msgr2=0x7f04f4034920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:50.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.744+0000 7f050a42f640 0 -- 172.21.15.83:0/828939324 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x557d2d00bc90 msgr2=0x557d2d00e120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:50.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 zone default found 2024-09-12T00:56:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 4 Realm: () 2024-09-12T00:56:50.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 zonegroup default 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.749+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.750+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.750+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.750+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.750+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.750+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.751+0000 7f050d146800 20 started sync module instance, tier type = 2024-09-12T00:56:50.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.751+0000 7f050d146800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:50.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.760+0000 7f050d146800 20 add_watcher() i=0 2024-09-12T00:56:50.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.760+0000 7f050d146800 20 add_watcher() i=1 2024-09-12T00:56:50.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.760+0000 7f050d146800 20 add_watcher() i=2 2024-09-12T00:56:50.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.760+0000 7f050d146800 20 add_watcher() i=3 2024-09-12T00:56:50.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.760+0000 7f050d146800 20 add_watcher() i=4 2024-09-12T00:56:50.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.760+0000 7f050d146800 20 add_watcher() i=5 2024-09-12T00:56:50.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.760+0000 7f050d146800 20 add_watcher() i=6 2024-09-12T00:56:50.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.762+0000 7f050d146800 20 add_watcher() i=7 2024-09-12T00:56:50.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.762+0000 7f050d146800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f03c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f050d146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f050d146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f050d146800 5 note: GC not initialized 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f033bfff640 20 reqs_thread_entry: start 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f050d146800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f050d146800 20 Filter name: none 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f0339ffb640 20 reqs_thread_entry: start 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f050d146800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:56:50.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.764+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T00:56:50.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:56:50.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 10 cache get: name=default.rgw.meta+users.keys+NVWIWWSGOIRARZUSQFLV : miss 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 10 cache put: name=default.rgw.meta+users.keys+NVWIWWSGOIRARZUSQFLV info.flags=0x0 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 10 adding default.rgw.meta+users.keys+NVWIWWSGOIRARZUSQFLV to cache LRU end 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T00:56:50.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.765+0000 7f050d146800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.766+0000 7f050d146800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:56:50.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.766+0000 7f050d146800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:56:50.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.766+0000 7f050d146800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:56:50.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.766+0000 7f050d146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:50.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.766+0000 7f050d146800 10 cache get: name=default.rgw.meta+users.keys+NVWIWWSGOIRARZUSQFLV : hit (negative entry) 2024-09-12T00:56:50.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.766+0000 7f050d146800 10 cache get: name=default.rgw.meta+users.keys+NVWIWWSGOIRARZUSQFLV : hit (negative entry) 2024-09-12T00:56:50.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.768+0000 7f050d146800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:56:50.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.768+0000 7f050d146800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:56:50.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.768+0000 7f050d146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:56:50.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.769+0000 7f03ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 93996114304128 notifier 8483 bl.length()=673 2024-09-12T00:56:50.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.769+0000 7f03ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:56:50.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.769+0000 7f03ee7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:56:50.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.770+0000 7f050d146800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:56:50.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.770+0000 7f050d146800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:56:50.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.770+0000 7f050d146800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T00:56:50.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.771+0000 7f03ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464547 cookie 93996114355312 notifier 8483 bl.length()=185 2024-09-12T00:56:50.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.771+0000 7f03ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:56:50.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.771+0000 7f03ee7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:56:50.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.772+0000 7f050d146800 10 cache put: name=default.rgw.meta+users.keys+NVWIWWSGOIRARZUSQFLV info.flags=0x7 2024-09-12T00:56:50.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.772+0000 7f050d146800 10 moving default.rgw.meta+users.keys+NVWIWWSGOIRARZUSQFLV to cache LRU end 2024-09-12T00:56:50.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.772+0000 7f050d146800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:NVWIWWSGOIRARZUSQFLV, ofs0, ns] 2024-09-12T00:56:50.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.773+0000 7f03edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464353 cookie 93996114352640 notifier 8483 bl.length()=186 2024-09-12T00:56:50.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.773+0000 7f03edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NVWIWWSGOIRARZUSQFLV info.flags=0x7 2024-09-12T00:56:50.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.773+0000 7f03edffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NVWIWWSGOIRARZUSQFLV to cache LRU end 2024-09-12T00:56:50.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.774+0000 7f050d146800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T00:56:50.773 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:50.773 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "foo.client.0", 2024-09-12T00:56:50.773 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T00:56:50.773 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "foo+test@test.test", 2024-09-12T00:56:50.773 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:56:50.773 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:50.773 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "foo.client.0", 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "NVWIWWSGOIRARZUSQFLV", 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "QK5+S0WZek7INwc2+2yHK9US7+PKXxszFENycAqBURKo6qhnPSvUrg==", 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:50.767456Z" 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:56:50.774 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:50.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "root", 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "RGW11111111111111111", 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:50.767429Z", 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:50.776 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:50.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.775+0000 7f03c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:50.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.778+0000 7f050d146800 20 remove_watcher() i=0 2024-09-12T00:56:50.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.778+0000 7f050d146800 2 removed watcher, disabling cache 2024-09-12T00:56:50.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.779+0000 7f050d146800 20 remove_watcher() i=1 2024-09-12T00:56:50.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.780+0000 7f050d146800 20 remove_watcher() i=2 2024-09-12T00:56:50.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.782+0000 7f050d146800 20 remove_watcher() i=3 2024-09-12T00:56:50.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.783+0000 7f050d146800 20 remove_watcher() i=4 2024-09-12T00:56:50.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.784+0000 7f050d146800 20 remove_watcher() i=5 2024-09-12T00:56:50.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.785+0000 7f050d146800 20 remove_watcher() i=6 2024-09-12T00:56:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.786+0000 7f050d146800 20 remove_watcher() i=7 2024-09-12T00:56:50.795 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 8293177316 --totp-seed 43K3OWS2KB4BQQJGKA7FI4Y65YSD7VBKADHBSZ4UIGI6DYKCUUOVGM4SAYKDKHKV --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:56:50.860 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:50.861 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:50.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.895+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.897+0000 7f45ad92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.897+0000 7f45ad92e800 20 realm 2024-09-12T00:56:50.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.897+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.897+0000 7f45ad92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.897+0000 7f45ad92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:50.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.897+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.898+0000 7f45ad92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:50.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.898+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.898+0000 7f45ad92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:50.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.898+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:50.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.899+0000 7f45ad92e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:50.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.899+0000 7f45ad92e800 20 searching for the correct realm 2024-09-12T00:56:50.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:50.902+0000 7f45a8eaf640 0 -- 172.21.15.83:0/1355339650 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f45a006daf0 msgr2=0x7f45a006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:51.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.510+0000 7f45a96b0640 0 -- 172.21.15.83:0/1355339650 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f45a4056be0 msgr2=0x7f45a40a4200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:51.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:51.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:51.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:51.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:51.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:51.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:51.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:51.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:51.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.718+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 20 zone default found 2024-09-12T00:56:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 4 Realm: () 2024-09-12T00:56:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 20 zonegroup default 2024-09-12T00:56:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.719+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.720+0000 7f45ad92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.720+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.720+0000 7f45ad92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.720+0000 7f45ad92e800 20 started sync module instance, tier type = 2024-09-12T00:56:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.720+0000 7f45ad92e800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:51.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.730+0000 7f45ad92e800 20 add_watcher() i=0 2024-09-12T00:56:51.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.730+0000 7f45ad92e800 20 add_watcher() i=1 2024-09-12T00:56:51.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.730+0000 7f45ad92e800 20 add_watcher() i=2 2024-09-12T00:56:51.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.730+0000 7f45ad92e800 20 add_watcher() i=3 2024-09-12T00:56:51.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.730+0000 7f45ad92e800 20 add_watcher() i=4 2024-09-12T00:56:51.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.730+0000 7f45ad92e800 20 add_watcher() i=5 2024-09-12T00:56:51.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.730+0000 7f45ad92e800 20 add_watcher() i=6 2024-09-12T00:56:51.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.731+0000 7f45ad92e800 20 add_watcher() i=7 2024-09-12T00:56:51.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.731+0000 7f45ad92e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.733+0000 7f445ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.734+0000 7f45ad92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.734+0000 7f45ad92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.734+0000 7f45ad92e800 5 note: GC not initialized 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.734+0000 7f445efe5640 20 reqs_thread_entry: start 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.734+0000 7f45ad92e800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.734+0000 7f45ad92e800 20 Filter name: none 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.734+0000 7f445cfe1640 20 reqs_thread_entry: start 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.734+0000 7f45ad92e800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:56:51.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.734+0000 7f45ad92e800 20 rados->read ofs=0 len=0 2024-09-12T00:56:51.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.735+0000 7f45ad92e800 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T00:56:51.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.735+0000 7f45ad92e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T00:56:51.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.735+0000 7f45ad92e800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:56:51.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:51.735+0000 7f45ad92e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:52.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:52.997+0000 7f45ad92e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:56:52.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:52.997+0000 7f45ad92e800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:56:52.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:52.997+0000 7f45ad92e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:56:52.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:52.997+0000 7f447ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398929 cookie 94060112582512 notifier 9042 bl.length()=687 2024-09-12T00:56:52.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:52.997+0000 7f447ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:56:52.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:52.997+0000 7f447ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:56:52.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:52.999+0000 7f445ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:52.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.001+0000 7f45ad92e800 20 remove_watcher() i=0 2024-09-12T00:56:52.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.001+0000 7f45ad92e800 2 removed watcher, disabling cache 2024-09-12T00:56:53.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.002+0000 7f45ad92e800 20 remove_watcher() i=1 2024-09-12T00:56:53.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.003+0000 7f45ad92e800 20 remove_watcher() i=2 2024-09-12T00:56:53.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.004+0000 7f45ad92e800 20 remove_watcher() i=3 2024-09-12T00:56:53.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.006+0000 7f45ad92e800 20 remove_watcher() i=4 2024-09-12T00:56:53.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.007+0000 7f45ad92e800 20 remove_watcher() i=5 2024-09-12T00:56:53.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.008+0000 7f45ad92e800 20 remove_watcher() i=6 2024-09-12T00:56:53.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.009+0000 7f45ad92e800 20 remove_watcher() i=7 2024-09-12T00:56:53.018 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T00:56:53.018 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key RSZPMOKQFMGPVRILQUEJ --secret gW1cL3oLGmiyuvC95Nvoc+Mko+tTD0kO29h8LhqY9YwxRHdLdaYsxg== --cluster ceph 2024-09-12T00:56:53.084 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:53.084 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:53.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.119+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.121+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.121+0000 7fb8ebd22800 20 realm 2024-09-12T00:56:53.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.121+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.121+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.121+0000 7fb8ebd22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:53.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.121+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.121+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.121+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.122+0000 7fb8ebd22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:53.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.122+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.122+0000 7fb8ebd22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:53.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.122+0000 7fb8ebd22800 20 searching for the correct realm 2024-09-12T00:56:53.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.126+0000 7fb8e7267640 0 -- 172.21.15.83:0/1215062741 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fb8d00822c0 msgr2=0x7fb8d005f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:53.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.331+0000 7fb8e8269640 0 -- 172.21.15.83:0/1215062741 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x555b376f20e0 msgr2=0x555b376f4550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.336+0000 7fb8ebd22800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.336+0000 7fb8ebd22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.336+0000 7fb8ebd22800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.336+0000 7fb8ebd22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.336+0000 7fb8ebd22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.336+0000 7fb8ebd22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.336+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.336+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.336+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:53.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 20 zone default found 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 4 Realm: () 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 20 zonegroup default 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.337+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.338+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.338+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.338+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.338+0000 7fb8ebd22800 20 started sync module instance, tier type = 2024-09-12T00:56:53.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.338+0000 7fb8ebd22800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:53.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.347+0000 7fb8ebd22800 20 add_watcher() i=0 2024-09-12T00:56:53.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.347+0000 7fb8ebd22800 20 add_watcher() i=1 2024-09-12T00:56:53.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.347+0000 7fb8ebd22800 20 add_watcher() i=2 2024-09-12T00:56:53.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.347+0000 7fb8ebd22800 20 add_watcher() i=3 2024-09-12T00:56:53.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.347+0000 7fb8ebd22800 20 add_watcher() i=4 2024-09-12T00:56:53.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.347+0000 7fb8ebd22800 20 add_watcher() i=5 2024-09-12T00:56:53.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.347+0000 7fb8ebd22800 20 add_watcher() i=6 2024-09-12T00:56:53.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.348+0000 7fb8ebd22800 20 add_watcher() i=7 2024-09-12T00:56:53.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.348+0000 7fb8ebd22800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:53.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.350+0000 7fb79dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.350+0000 7fb8ebd22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.350+0000 7fb8ebd22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.350+0000 7fb8ebd22800 5 note: GC not initialized 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.350+0000 7fb79cfe1640 20 reqs_thread_entry: start 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.350+0000 7fb8ebd22800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.350+0000 7fb8ebd22800 20 Filter name: none 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb7167fc640 20 reqs_thread_entry: start 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T00:56:53.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:56:53.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T00:56:53.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T00:56:53.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:56:53.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 10 cache get: name=default.rgw.meta+users.keys+RSZPMOKQFMGPVRILQUEJ : miss 2024-09-12T00:56:53.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.351+0000 7fb8ebd22800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.352+0000 7fb8ebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.352+0000 7fb8ebd22800 10 cache put: name=default.rgw.meta+users.keys+RSZPMOKQFMGPVRILQUEJ info.flags=0x0 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.352+0000 7fb8ebd22800 10 adding default.rgw.meta+users.keys+RSZPMOKQFMGPVRILQUEJ to cache LRU end 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.352+0000 7fb8ebd22800 10 cache get: name=default.rgw.meta+users.keys+RSZPMOKQFMGPVRILQUEJ : hit (negative entry) 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.352+0000 7fb8ebd22800 10 cache get: name=default.rgw.meta+users.keys+RSZPMOKQFMGPVRILQUEJ : hit (negative entry) 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.353+0000 7fb8ebd22800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.353+0000 7fb8ebd22800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.353+0000 7fb8ebd22800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.353+0000 7fb7c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399140 cookie 93850260467136 notifier 8516 bl.length()=645 2024-09-12T00:56:53.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.353+0000 7fb7c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:56:53.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.353+0000 7fb7c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:56:53.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.354+0000 7fb8ebd22800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:56:53.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.354+0000 7fb8ebd22800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:56:53.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.354+0000 7fb8ebd22800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T00:56:53.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.355+0000 7fb7c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399139 cookie 93850260420480 notifier 8516 bl.length()=185 2024-09-12T00:56:53.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.355+0000 7fb7c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:56:53.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.355+0000 7fb7c67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:56:53.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.357+0000 7fb8ebd22800 10 cache put: name=default.rgw.meta+users.keys+RSZPMOKQFMGPVRILQUEJ info.flags=0x7 2024-09-12T00:56:53.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.357+0000 7fb8ebd22800 10 moving default.rgw.meta+users.keys+RSZPMOKQFMGPVRILQUEJ to cache LRU end 2024-09-12T00:56:53.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.357+0000 7fb8ebd22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:RSZPMOKQFMGPVRILQUEJ, ofs0, ns] 2024-09-12T00:56:53.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.357+0000 7fb7c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398946 cookie 93850260472352 notifier 8516 bl.length()=186 2024-09-12T00:56:53.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.357+0000 7fb7c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RSZPMOKQFMGPVRILQUEJ info.flags=0x7 2024-09-12T00:56:53.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.357+0000 7fb7c67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RSZPMOKQFMGPVRILQUEJ to cache LRU end 2024-09-12T00:56:53.356 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:53.356 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "bar.client.0", 2024-09-12T00:56:53.356 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T00:56:53.356 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "bar+test@test.test", 2024-09-12T00:56:53.356 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:56:53.356 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:53.356 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:56:53.356 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "bar.client.0", 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "RSZPMOKQFMGPVRILQUEJ", 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "gW1cL3oLGmiyuvC95Nvoc+Mko+tTD0kO29h8LhqY9YwxRHdLdaYsxg==", 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:53.352778Z" 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:56:53.357 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:53.358 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:56:53.359 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-09-12T00:56:53.359 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:56:53.359 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-09-12T00:56:53.359 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:56:53.359 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:53.352769Z", 2024-09-12T00:56:53.359 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:56:53.359 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:56:53.359 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:53.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:53.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.358+0000 7fb79dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:53.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.360+0000 7fb8ebd22800 20 remove_watcher() i=0 2024-09-12T00:56:53.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.360+0000 7fb8ebd22800 2 removed watcher, disabling cache 2024-09-12T00:56:53.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.361+0000 7fb8ebd22800 20 remove_watcher() i=1 2024-09-12T00:56:53.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.362+0000 7fb8ebd22800 20 remove_watcher() i=2 2024-09-12T00:56:53.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.363+0000 7fb8ebd22800 20 remove_watcher() i=3 2024-09-12T00:56:53.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.364+0000 7fb8ebd22800 20 remove_watcher() i=4 2024-09-12T00:56:53.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.365+0000 7fb8ebd22800 20 remove_watcher() i=5 2024-09-12T00:56:53.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.366+0000 7fb8ebd22800 20 remove_watcher() i=6 2024-09-12T00:56:53.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.367+0000 7fb8ebd22800 20 remove_watcher() i=7 2024-09-12T00:56:53.377 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 5346314664 --totp-seed JXZ4IBTDJBJVAKGBDE5YLKHD2GXNQNTYK6LGMEMBVC3TUOI26JV7R23XKSZD52GH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:56:53.443 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:53.443 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:53.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.477+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.479+0000 7f95d4521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.479+0000 7f95d4521800 20 realm 2024-09-12T00:56:53.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.479+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.479+0000 7f95d4521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.479+0000 7f95d4521800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:53.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.479+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.479+0000 7f95d4521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.479+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.480+0000 7f95d4521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:53.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.480+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.481+0000 7f95d4521800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:53.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.481+0000 7f95d4521800 20 searching for the correct realm 2024-09-12T00:56:53.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.484+0000 7f95cf955640 0 -- 172.21.15.83:0/3816353242 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f95b80d3be0 msgr2=0x7f95b80da210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:53.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.487+0000 7f95d0156640 0 -- 172.21.15.83:0/3816353242 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f95c8030070 msgr2=0x7f95c801c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:53.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.694+0000 7f95d4521800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.694+0000 7f95d4521800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.694+0000 7f95d4521800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.694+0000 7f95d4521800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.694+0000 7f95d4521800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.694+0000 7f95d4521800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.694+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 20 zone default found 2024-09-12T00:56:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 4 Realm: () 2024-09-12T00:56:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 20 zonegroup default 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.695+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.696+0000 7f95d4521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.696+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.696+0000 7f95d4521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.696+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.696+0000 7f95d4521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.696+0000 7f95d4521800 20 started sync module instance, tier type = 2024-09-12T00:56:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.696+0000 7f95d4521800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:53.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.705+0000 7f95d4521800 20 add_watcher() i=0 2024-09-12T00:56:53.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.705+0000 7f95d4521800 20 add_watcher() i=1 2024-09-12T00:56:53.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.705+0000 7f95d4521800 20 add_watcher() i=2 2024-09-12T00:56:53.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.705+0000 7f95d4521800 20 add_watcher() i=3 2024-09-12T00:56:53.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.705+0000 7f95d4521800 20 add_watcher() i=4 2024-09-12T00:56:53.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.705+0000 7f95d4521800 20 add_watcher() i=5 2024-09-12T00:56:53.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.705+0000 7f95d4521800 20 add_watcher() i=6 2024-09-12T00:56:53.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.706+0000 7f95d4521800 20 add_watcher() i=7 2024-09-12T00:56:53.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.706+0000 7f95d4521800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:53.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.708+0000 7f9486fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:53.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.708+0000 7f95d4521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:53.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.708+0000 7f95d4521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:53.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.708+0000 7f95d4521800 5 note: GC not initialized 2024-09-12T00:56:53.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.708+0000 7f9485fdb640 20 reqs_thread_entry: start 2024-09-12T00:56:53.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.709+0000 7f95d4521800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:53.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.709+0000 7f95d4521800 20 Filter name: none 2024-09-12T00:56:53.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.709+0000 7f93f77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:53.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.709+0000 7f95d4521800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:56:53.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.709+0000 7f95d4521800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.709+0000 7f95d4521800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:56:53.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.709+0000 7f95d4521800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T00:56:53.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.709+0000 7f95d4521800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:56:53.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.709+0000 7f95d4521800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:53.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.712+0000 7f95d4521800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:56:53.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.712+0000 7f95d4521800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:56:53.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.712+0000 7f95d4521800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:56:53.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.712+0000 7f94a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399141 cookie 93975818388192 notifier 8531 bl.length()=659 2024-09-12T00:56:53.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.712+0000 7f94a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:56:53.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.712+0000 7f94a77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:56:53.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.713+0000 7f9486fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:53.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.715+0000 7f95d4521800 20 remove_watcher() i=0 2024-09-12T00:56:53.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.715+0000 7f95d4521800 2 removed watcher, disabling cache 2024-09-12T00:56:53.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.717+0000 7f95d4521800 20 remove_watcher() i=1 2024-09-12T00:56:53.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.718+0000 7f95d4521800 20 remove_watcher() i=2 2024-09-12T00:56:53.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.719+0000 7f95d4521800 20 remove_watcher() i=3 2024-09-12T00:56:53.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.720+0000 7f95d4521800 20 remove_watcher() i=4 2024-09-12T00:56:53.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.721+0000 7f95d4521800 20 remove_watcher() i=5 2024-09-12T00:56:53.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.722+0000 7f95d4521800 20 remove_watcher() i=6 2024-09-12T00:56:53.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.723+0000 7f95d4521800 20 remove_watcher() i=7 2024-09-12T00:56:53.732 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T00:56:53.794 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:53.794 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:53.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.828+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.830+0000 7f33a4c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.830+0000 7f33a4c98800 20 realm 2024-09-12T00:56:53.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.830+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.830+0000 7f33a4c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.830+0000 7f33a4c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:53.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.830+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.830+0000 7f33a4c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:53.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.830+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.831+0000 7f33a4c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:53.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.831+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:53.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.831+0000 7f33a4c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:53.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.831+0000 7f33a4c98800 20 searching for the correct realm 2024-09-12T00:56:53.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:53.835+0000 7f33a1f81640 0 -- 172.21.15.83:0/783618651 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f338c08c750 msgr2=0x7f338c08a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:54.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.056+0000 7f33a2782640 0 -- 172.21.15.83:0/783618651 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f33940a9a10 msgr2=0x7f33940aaa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:54.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.063+0000 7f33a4c98800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:54.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.063+0000 7f33a4c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:54.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.063+0000 7f33a4c98800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:54.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.063+0000 7f33a4c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:54.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.063+0000 7f33a4c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:54.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.063+0000 7f33a4c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:54.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.063+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.063+0000 7f33a4c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.063+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:54.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 20 zone default found 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 4 Realm: () 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 20 zonegroup default 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.064+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.065+0000 7f33a4c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.065+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.065+0000 7f33a4c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.065+0000 7f33a4c98800 20 started sync module instance, tier type = 2024-09-12T00:56:54.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.065+0000 7f33a4c98800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:54.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.074+0000 7f33a4c98800 20 add_watcher() i=0 2024-09-12T00:56:54.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.074+0000 7f33a4c98800 20 add_watcher() i=1 2024-09-12T00:56:54.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.074+0000 7f33a4c98800 20 add_watcher() i=2 2024-09-12T00:56:54.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.074+0000 7f33a4c98800 20 add_watcher() i=3 2024-09-12T00:56:54.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.074+0000 7f33a4c98800 20 add_watcher() i=4 2024-09-12T00:56:54.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.074+0000 7f33a4c98800 20 add_watcher() i=5 2024-09-12T00:56:54.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.074+0000 7f33a4c98800 20 add_watcher() i=6 2024-09-12T00:56:54.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.075+0000 7f33a4c98800 20 add_watcher() i=7 2024-09-12T00:56:54.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.075+0000 7f33a4c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:54.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.076+0000 7f3258fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:54.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.076+0000 7f33a4c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:54.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.076+0000 7f33a4c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:54.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.076+0000 7f33a4c98800 5 note: GC not initialized 2024-09-12T00:56:54.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f31d37fe640 20 reqs_thread_entry: start 2024-09-12T00:56:54.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:54.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 20 Filter name: none 2024-09-12T00:56:54.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f31d17fa640 20 reqs_thread_entry: start 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:56:54.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.077+0000 7f33a4c98800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T00:56:54.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.079+0000 7f33a4c98800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:56:54.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.079+0000 7f33a4c98800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:56:54.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.079+0000 7f33a4c98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T00:56:54.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.079+0000 7f3285ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366438 cookie 94821976538896 notifier 8546 bl.length()=389 2024-09-12T00:56:54.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.079+0000 7f3285ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:56:54.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.079+0000 7f3285ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:56:54.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.080+0000 7f33a4c98800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:56:54.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.080+0000 7f33a4c98800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:56:54.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.080+0000 7f33a4c98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T00:56:54.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.081+0000 7f3285ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366439 cookie 94821976548000 notifier 8546 bl.length()=230 2024-09-12T00:56:54.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.081+0000 7f3285ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:56:54.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.081+0000 7f3285ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:56:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.082+0000 7f33a4c98800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:56:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.082+0000 7f33a4c98800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:56:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.082+0000 7f33a4c98800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T00:56:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.083+0000 7f32857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 94821976536000 notifier 8546 bl.length()=234 2024-09-12T00:56:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.083+0000 7f32857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:56:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.083+0000 7f32857fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:56:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.084+0000 7f3258fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:54.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.086+0000 7f33a4c98800 20 remove_watcher() i=0 2024-09-12T00:56:54.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.086+0000 7f33a4c98800 2 removed watcher, disabling cache 2024-09-12T00:56:54.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.087+0000 7f33a4c98800 20 remove_watcher() i=1 2024-09-12T00:56:54.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.088+0000 7f33a4c98800 20 remove_watcher() i=2 2024-09-12T00:56:54.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.089+0000 7f33a4c98800 20 remove_watcher() i=3 2024-09-12T00:56:54.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.090+0000 7f33a4c98800 20 remove_watcher() i=4 2024-09-12T00:56:54.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.090+0000 7f33a4c98800 20 remove_watcher() i=5 2024-09-12T00:56:54.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.091+0000 7f33a4c98800 20 remove_watcher() i=6 2024-09-12T00:56:54.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.092+0000 7f33a4c98800 20 remove_watcher() i=7 2024-09-12T00:56:54.099 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:54.099 INFO:teuthology.orchestra.run.smithi083.stdout: "id": "RGW33333333333333333", 2024-09-12T00:56:54.100 INFO:teuthology.orchestra.run.smithi083.stdout: "tenant": "testx", 2024-09-12T00:56:54.100 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T00:56:54.100 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T00:56:54.100 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-09-12T00:56:54.100 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:54.100 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:54.100 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:54.100 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:54.101 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:54.101 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:54.101 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:54.101 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:54.101 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:54.101 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:54.101 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:54.101 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:54.102 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:54.102 INFO:teuthology.orchestra.run.smithi083.stdout: "max_users": 1000, 2024-09-12T00:56:54.102 INFO:teuthology.orchestra.run.smithi083.stdout: "max_roles": 1000, 2024-09-12T00:56:54.102 INFO:teuthology.orchestra.run.smithi083.stdout: "max_groups": 1000, 2024-09-12T00:56:54.102 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:54.102 INFO:teuthology.orchestra.run.smithi083.stdout: "max_access_keys": 4 2024-09-12T00:56:54.102 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:54.104 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T00:56:54.104 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key DTPWXIWRCDWZAMZSOPMD --secret KN3ipr6DA+7Q7iUZnSKyqJ4Fgo8E7NAEhjFi6n7cTDMtTaKglj3z6A== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T00:56:54.172 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:54.172 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:54.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.206+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.208+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.208+0000 7fbb2d51f800 20 realm 2024-09-12T00:56:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.208+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.208+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.208+0000 7fbb2d51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:54.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.208+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.208+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.208+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.209+0000 7fbb2d51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:54.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.209+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.210+0000 7fbb2d51f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:54.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.210+0000 7fbb2d51f800 20 searching for the correct realm 2024-09-12T00:56:54.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.213+0000 7fbb20aa8640 0 -- 172.21.15.83:0/2583697861 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fbb1409f9a0 msgr2=0x7fbb1402d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:54.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.418+0000 7fbb29aaa640 0 -- 172.21.15.83:0/2583697861 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x5626d1f010e0 msgr2=0x5626d1f035a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:54.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.422+0000 7fbb2d51f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:54.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.422+0000 7fbb2d51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:54.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.422+0000 7fbb2d51f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:54.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.422+0000 7fbb2d51f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:54.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.422+0000 7fbb2d51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:54.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.422+0000 7fbb2d51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:54.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.422+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.422+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.422+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 20 zone default found 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 4 Realm: () 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 20 zonegroup default 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.423+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.424+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.424+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.424+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.424+0000 7fbb2d51f800 20 started sync module instance, tier type = 2024-09-12T00:56:54.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.424+0000 7fbb2d51f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:54.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.433+0000 7fbb2d51f800 20 add_watcher() i=0 2024-09-12T00:56:54.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.433+0000 7fbb2d51f800 20 add_watcher() i=1 2024-09-12T00:56:54.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.433+0000 7fbb2d51f800 20 add_watcher() i=2 2024-09-12T00:56:54.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.433+0000 7fbb2d51f800 20 add_watcher() i=3 2024-09-12T00:56:54.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.433+0000 7fbb2d51f800 20 add_watcher() i=4 2024-09-12T00:56:54.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.433+0000 7fbb2d51f800 20 add_watcher() i=5 2024-09-12T00:56:54.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.433+0000 7fbb2d51f800 20 add_watcher() i=6 2024-09-12T00:56:54.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.433+0000 7fbb2d51f800 20 add_watcher() i=7 2024-09-12T00:56:54.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.433+0000 7fbb2d51f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:54.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.435+0000 7fb9df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:54.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.435+0000 7fbb2d51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:54.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.435+0000 7fbb2d51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:54.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.435+0000 7fbb2d51f800 5 note: GC not initialized 2024-09-12T00:56:54.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.435+0000 7fb9de7e4640 20 reqs_thread_entry: start 2024-09-12T00:56:54.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.435+0000 7fbb2d51f800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:54.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 20 Filter name: none 2024-09-12T00:56:54.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fb94ffff640 20 reqs_thread_entry: start 2024-09-12T00:56:54.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:56:54.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T00:56:54.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:56:54.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T00:56:54.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T00:56:54.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 10 cache get: name=default.rgw.meta+users.keys+DTPWXIWRCDWZAMZSOPMD : miss 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.436+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 10 cache put: name=default.rgw.meta+users.keys+DTPWXIWRCDWZAMZSOPMD info.flags=0x0 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 10 adding default.rgw.meta+users.keys+DTPWXIWRCDWZAMZSOPMD to cache LRU end 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 10 cache get: name=default.rgw.meta+users.keys+DTPWXIWRCDWZAMZSOPMD : hit (negative entry) 2024-09-12T00:56:54.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.437+0000 7fbb2d51f800 10 cache get: name=default.rgw.meta+users.keys+DTPWXIWRCDWZAMZSOPMD : hit (negative entry) 2024-09-12T00:56:54.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.439+0000 7fbb2d51f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:56:54.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.439+0000 7fbb2d51f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:56:54.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.439+0000 7fbb2d51f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:56:54.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.439+0000 7fba0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366436 cookie 94724730980944 notifier 9114 bl.length()=732 2024-09-12T00:56:54.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.439+0000 7fba0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:56:54.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.439+0000 7fba0cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:56:54.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.441+0000 7fbb2d51f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:56:54.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.441+0000 7fbb2d51f800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:56:54.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.441+0000 7fbb2d51f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T00:56:54.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.441+0000 7fba0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366437 cookie 94724730986656 notifier 9114 bl.length()=215 2024-09-12T00:56:54.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.441+0000 7fba0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:56:54.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.441+0000 7fba0cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:56:54.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.443+0000 7fbb2d51f800 10 cache put: name=default.rgw.meta+users.keys+DTPWXIWRCDWZAMZSOPMD info.flags=0x7 2024-09-12T00:56:54.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.443+0000 7fbb2d51f800 10 moving default.rgw.meta+users.keys+DTPWXIWRCDWZAMZSOPMD to cache LRU end 2024-09-12T00:56:54.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.443+0000 7fbb2d51f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:DTPWXIWRCDWZAMZSOPMD, ofs0, ns] 2024-09-12T00:56:54.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.444+0000 7fba0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366440 cookie 94724730976960 notifier 9114 bl.length()=201 2024-09-12T00:56:54.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.444+0000 7fba0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DTPWXIWRCDWZAMZSOPMD info.flags=0x7 2024-09-12T00:56:54.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.444+0000 7fba0cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DTPWXIWRCDWZAMZSOPMD to cache LRU end 2024-09-12T00:56:54.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.445+0000 7fbb2d51f800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T00:56:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:54.444 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T00:56:54.444 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T00:56:54.444 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T00:56:54.444 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "DTPWXIWRCDWZAMZSOPMD", 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "KN3ipr6DA+7Q7iUZnSKyqJ4Fgo8E7NAEhjFi6n7cTDMtTaKglj3z6A==", 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:54.438506Z" 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-09-12T00:56:54.445 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "root", 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "RGW33333333333333333", 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:54.438494Z", 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:54.447 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:54.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.446+0000 7fb9df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:54.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.448+0000 7fbb2d51f800 20 remove_watcher() i=0 2024-09-12T00:56:54.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.448+0000 7fbb2d51f800 2 removed watcher, disabling cache 2024-09-12T00:56:54.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.449+0000 7fbb2d51f800 20 remove_watcher() i=1 2024-09-12T00:56:54.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.450+0000 7fbb2d51f800 20 remove_watcher() i=2 2024-09-12T00:56:54.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.451+0000 7fbb2d51f800 20 remove_watcher() i=3 2024-09-12T00:56:54.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.452+0000 7fbb2d51f800 20 remove_watcher() i=4 2024-09-12T00:56:54.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.453+0000 7fbb2d51f800 20 remove_watcher() i=5 2024-09-12T00:56:54.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.454+0000 7fbb2d51f800 20 remove_watcher() i=6 2024-09-12T00:56:54.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.455+0000 7fbb2d51f800 20 remove_watcher() i=7 2024-09-12T00:56:54.465 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0989174643 --totp-seed 7TN36UJUHOKVIB2IAUWMWTWG2T2KXUY6CD6FTRZIYQIP6KOOKTUPXKYFKYQM76DC --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:56:54.531 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:54.531 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:54.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.568+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.569+0000 7f661a728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.569+0000 7f661a728800 20 realm 2024-09-12T00:56:54.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.569+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.569+0000 7f661a728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.569+0000 7f661a728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:54.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.569+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.569+0000 7f661a728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.569+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.570+0000 7f661a728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.570+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.570+0000 7f661a728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:54.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.570+0000 7f661a728800 20 searching for the correct realm 2024-09-12T00:56:54.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.572+0000 7f6616c70640 0 -- 172.21.15.83:0/1996699197 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55d83da0fb80 msgr2=0x55d83da12040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:54.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.575+0000 7f661646f640 0 -- 172.21.15.83:0/1996699197 >> [v2:172.21.15.83:6812/514291182,v1:172.21.15.83:6814/514291182] conn(0x55d83da13b10 msgr2=0x55d83da15f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:54.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.580+0000 7f661a728800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:54.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.580+0000 7f661a728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:54.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.580+0000 7f661a728800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:54.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.580+0000 7f661a728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:54.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.580+0000 7f661a728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:54.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.580+0000 7f661a728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:54.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.580+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:54.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:54.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 zone default found 2024-09-12T00:56:54.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 4 Realm: () 2024-09-12T00:56:54.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:54.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:54.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:54.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 zonegroup default 2024-09-12T00:56:54.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.581+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.582+0000 7f661a728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.582+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.582+0000 7f661a728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.582+0000 7f661a728800 20 started sync module instance, tier type = 2024-09-12T00:56:54.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.582+0000 7f661a728800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:54.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.590+0000 7f661a728800 20 add_watcher() i=0 2024-09-12T00:56:54.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.590+0000 7f661a728800 20 add_watcher() i=1 2024-09-12T00:56:54.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.590+0000 7f661a728800 20 add_watcher() i=2 2024-09-12T00:56:54.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.590+0000 7f661a728800 20 add_watcher() i=3 2024-09-12T00:56:54.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.590+0000 7f661a728800 20 add_watcher() i=4 2024-09-12T00:56:54.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.590+0000 7f661a728800 20 add_watcher() i=5 2024-09-12T00:56:54.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.590+0000 7f661a728800 20 add_watcher() i=6 2024-09-12T00:56:54.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.591+0000 7f661a728800 20 add_watcher() i=7 2024-09-12T00:56:54.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.591+0000 7f661a728800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.592+0000 7f64ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.592+0000 7f661a728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.592+0000 7f661a728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.592+0000 7f661a728800 5 note: GC not initialized 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f64477fe640 20 reqs_thread_entry: start 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f661a728800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f661a728800 20 Filter name: none 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f64457fa640 20 reqs_thread_entry: start 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f661a728800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:56:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f661a728800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f661a728800 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T00:56:54.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f661a728800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T00:56:54.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f661a728800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:56:54.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.593+0000 7f661a728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:54.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.596+0000 7f661a728800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:56:54.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.596+0000 7f661a728800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:56:54.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.596+0000 7f661a728800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:56:54.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.596+0000 7f64f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366438 cookie 94387235264880 notifier 9132 bl.length()=746 2024-09-12T00:56:54.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.596+0000 7f64f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:56:54.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.596+0000 7f64f9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:56:54.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.597+0000 7f64ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:54.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.599+0000 7f661a728800 20 remove_watcher() i=0 2024-09-12T00:56:54.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.599+0000 7f661a728800 2 removed watcher, disabling cache 2024-09-12T00:56:54.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.600+0000 7f661a728800 20 remove_watcher() i=1 2024-09-12T00:56:54.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.601+0000 7f661a728800 20 remove_watcher() i=2 2024-09-12T00:56:54.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.602+0000 7f661a728800 20 remove_watcher() i=3 2024-09-12T00:56:54.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.603+0000 7f661a728800 20 remove_watcher() i=4 2024-09-12T00:56:54.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.604+0000 7f661a728800 20 remove_watcher() i=5 2024-09-12T00:56:54.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.605+0000 7f661a728800 20 remove_watcher() i=6 2024-09-12T00:56:54.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.606+0000 7f661a728800 20 remove_watcher() i=7 2024-09-12T00:56:54.615 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T00:56:54.615 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key NITAMRPHDJYAQNBYRUIN --secret +PoP4IPuOMwTxnSfcyyVH5pCRQnfzggKANMRPfFVT0ZigppMjkVNDA== --cluster ceph 2024-09-12T00:56:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:54.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.715+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.717+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.717+0000 7f7eb2ab7800 20 realm 2024-09-12T00:56:54.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.717+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.717+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.717+0000 7f7eb2ab7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.717+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.717+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.717+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.718+0000 7f7eb2ab7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:54.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.718+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.718+0000 7f7eb2ab7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:54.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.718+0000 7f7eb2ab7800 20 searching for the correct realm 2024-09-12T00:56:54.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.721+0000 7f7ea7da0640 0 -- 172.21.15.83:0/1044059999 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f7e98016b60 msgr2=0x7f7e9808b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:54.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.926+0000 7f7eb0da2640 0 -- 172.21.15.83:0/1044059999 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x555b8e9bcbf0 msgr2=0x555b8e9bf0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:54.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:54.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:54.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:54.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.930+0000 7f7eb2ab7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 zone default found 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 4 Realm: () 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:54.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 zonegroup default 2024-09-12T00:56:54.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 started sync module instance, tier type = 2024-09-12T00:56:54.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.931+0000 7f7eb2ab7800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:54.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.940+0000 7f7eb2ab7800 20 add_watcher() i=0 2024-09-12T00:56:54.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.940+0000 7f7eb2ab7800 20 add_watcher() i=1 2024-09-12T00:56:54.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.940+0000 7f7eb2ab7800 20 add_watcher() i=2 2024-09-12T00:56:54.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.940+0000 7f7eb2ab7800 20 add_watcher() i=3 2024-09-12T00:56:54.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.940+0000 7f7eb2ab7800 20 add_watcher() i=4 2024-09-12T00:56:54.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.940+0000 7f7eb2ab7800 20 add_watcher() i=5 2024-09-12T00:56:54.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.940+0000 7f7eb2ab7800 20 add_watcher() i=6 2024-09-12T00:56:54.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.941+0000 7f7eb2ab7800 20 add_watcher() i=7 2024-09-12T00:56:54.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.941+0000 7f7eb2ab7800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:54.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7d66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:54.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7eb2ab7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:54.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7eb2ab7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:54.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7eb2ab7800 5 note: GC not initialized 2024-09-12T00:56:54.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7d65fdb640 20 reqs_thread_entry: start 2024-09-12T00:56:54.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7eb2ab7800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:54.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7eb2ab7800 20 Filter name: none 2024-09-12T00:56:54.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7cd77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7eb2ab7800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.943+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 cache get: name=default.rgw.meta+users.keys+NITAMRPHDJYAQNBYRUIN : miss 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 20 rados->read ofs=0 len=0 2024-09-12T00:56:54.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:54.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 cache put: name=default.rgw.meta+users.keys+NITAMRPHDJYAQNBYRUIN info.flags=0x0 2024-09-12T00:56:54.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 adding default.rgw.meta+users.keys+NITAMRPHDJYAQNBYRUIN to cache LRU end 2024-09-12T00:56:54.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 cache get: name=default.rgw.meta+users.keys+NITAMRPHDJYAQNBYRUIN : hit (negative entry) 2024-09-12T00:56:54.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.944+0000 7f7eb2ab7800 10 cache get: name=default.rgw.meta+users.keys+NITAMRPHDJYAQNBYRUIN : hit (negative entry) 2024-09-12T00:56:54.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.945+0000 7f7eb2ab7800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:56:54.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.945+0000 7f7eb2ab7800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:56:54.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.945+0000 7f7eb2ab7800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:56:54.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.946+0000 7f7d877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366439 cookie 93851723029840 notifier 9150 bl.length()=660 2024-09-12T00:56:54.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.946+0000 7f7d877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:56:54.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.946+0000 7f7d877fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:56:54.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.948+0000 7f7eb2ab7800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:56:54.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.948+0000 7f7eb2ab7800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:56:54.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.948+0000 7f7eb2ab7800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T00:56:54.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.948+0000 7f7d877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366441 cookie 93851723011120 notifier 9150 bl.length()=191 2024-09-12T00:56:54.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.948+0000 7f7d877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:56:54.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.948+0000 7f7d877fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:56:54.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.949+0000 7f7eb2ab7800 10 cache put: name=default.rgw.meta+users.keys+NITAMRPHDJYAQNBYRUIN info.flags=0x7 2024-09-12T00:56:54.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.949+0000 7f7eb2ab7800 10 moving default.rgw.meta+users.keys+NITAMRPHDJYAQNBYRUIN to cache LRU end 2024-09-12T00:56:54.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.949+0000 7f7eb2ab7800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:NITAMRPHDJYAQNBYRUIN, ofs0, ns] 2024-09-12T00:56:54.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.950+0000 7f7d86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 93851722965728 notifier 9150 bl.length()=189 2024-09-12T00:56:54.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.950+0000 7f7d86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NITAMRPHDJYAQNBYRUIN info.flags=0x7 2024-09-12T00:56:54.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.950+0000 7f7d86ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NITAMRPHDJYAQNBYRUIN to cache LRU end 2024-09-12T00:56:54.949 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:54.949 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "foobar.client.0", 2024-09-12T00:56:54.949 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:56:54.949 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "foobar+test@test.test", 2024-09-12T00:56:54.949 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:56:54.949 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "foobar.client.0", 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "NITAMRPHDJYAQNBYRUIN", 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "+PoP4IPuOMwTxnSfcyyVH5pCRQnfzggKANMRPfFVT0ZigppMjkVNDA==", 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:54.945540Z" 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:56:54.950 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:54.951 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:54.945529Z", 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:54.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:54.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.951+0000 7f7d66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:54.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.953+0000 7f7eb2ab7800 20 remove_watcher() i=0 2024-09-12T00:56:54.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.953+0000 7f7eb2ab7800 2 removed watcher, disabling cache 2024-09-12T00:56:54.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.954+0000 7f7eb2ab7800 20 remove_watcher() i=1 2024-09-12T00:56:54.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.955+0000 7f7eb2ab7800 20 remove_watcher() i=2 2024-09-12T00:56:54.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.956+0000 7f7eb2ab7800 20 remove_watcher() i=3 2024-09-12T00:56:54.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.957+0000 7f7eb2ab7800 20 remove_watcher() i=4 2024-09-12T00:56:54.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.958+0000 7f7eb2ab7800 20 remove_watcher() i=5 2024-09-12T00:56:54.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.959+0000 7f7eb2ab7800 20 remove_watcher() i=6 2024-09-12T00:56:54.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:54.960+0000 7f7eb2ab7800 20 remove_watcher() i=7 2024-09-12T00:56:54.969 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 3525189974 --totp-seed VNQMMIHD4YMDYAC7QN623SHLQIZHQRBTZSS2RRCLKHMWWL45CDWNJWZAAQNYC6N7 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:56:55.036 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:55.036 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:55.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.071+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.073+0000 7f571f708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.073+0000 7f571f708800 20 realm 2024-09-12T00:56:55.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.073+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.073+0000 7f571f708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.073+0000 7f571f708800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:55.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.073+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.073+0000 7f571f708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.073+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.074+0000 7f571f708800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:55.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.074+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.074+0000 7f571f708800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:55.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.074+0000 7f571f708800 20 searching for the correct realm 2024-09-12T00:56:55.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.077+0000 7f571c9f1640 0 -- 172.21.15.83:0/912717232 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f571407a070 msgr2=0x7f571404d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:55.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.283+0000 7f571c9f1640 0 -- 172.21.15.83:0/912717232 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f989f4e1e0 msgr2=0x55f989f50670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:55.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:55.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:55.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:55.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:55.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:55.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:55.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:55.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.287+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:55.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 20 zone default found 2024-09-12T00:56:55.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 4 Realm: () 2024-09-12T00:56:55.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:55.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:55.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:55.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 20 zonegroup default 2024-09-12T00:56:55.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.288+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.289+0000 7f571f708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.289+0000 7f571f708800 20 started sync module instance, tier type = 2024-09-12T00:56:55.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.289+0000 7f571f708800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.297+0000 7f571f708800 20 add_watcher() i=0 2024-09-12T00:56:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.297+0000 7f571f708800 20 add_watcher() i=1 2024-09-12T00:56:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.297+0000 7f571f708800 20 add_watcher() i=2 2024-09-12T00:56:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.297+0000 7f571f708800 20 add_watcher() i=3 2024-09-12T00:56:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.297+0000 7f571f708800 20 add_watcher() i=4 2024-09-12T00:56:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.297+0000 7f571f708800 20 add_watcher() i=5 2024-09-12T00:56:55.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.297+0000 7f571f708800 20 add_watcher() i=6 2024-09-12T00:56:55.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.298+0000 7f571f708800 20 add_watcher() i=7 2024-09-12T00:56:55.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.298+0000 7f571f708800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:55.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.300+0000 7f55d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:55.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.300+0000 7f571f708800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:55.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.300+0000 7f571f708800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:55.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.300+0000 7f571f708800 5 note: GC not initialized 2024-09-12T00:56:55.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.300+0000 7f55d27e4640 20 reqs_thread_entry: start 2024-09-12T00:56:55.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.301+0000 7f571f708800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:55.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.301+0000 7f571f708800 20 Filter name: none 2024-09-12T00:56:55.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.301+0000 7f5543fff640 20 reqs_thread_entry: start 2024-09-12T00:56:55.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.301+0000 7f571f708800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:56:55.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.301+0000 7f571f708800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.302+0000 7f571f708800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T00:56:55.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.302+0000 7f571f708800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:56:55.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.302+0000 7f571f708800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:56:55.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.302+0000 7f571f708800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:55.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.304+0000 7f571f708800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:56:55.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.304+0000 7f571f708800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:56:55.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.304+0000 7f571f708800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:56:55.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.304+0000 7f5600ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366440 cookie 94530249810096 notifier 9168 bl.length()=674 2024-09-12T00:56:55.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.304+0000 7f5600ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:56:55.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.304+0000 7f5600ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:56:55.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.305+0000 7f55d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:55.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.308+0000 7f571f708800 20 remove_watcher() i=0 2024-09-12T00:56:55.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.308+0000 7f571f708800 2 removed watcher, disabling cache 2024-09-12T00:56:55.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.309+0000 7f571f708800 20 remove_watcher() i=1 2024-09-12T00:56:55.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.310+0000 7f571f708800 20 remove_watcher() i=2 2024-09-12T00:56:55.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.311+0000 7f571f708800 20 remove_watcher() i=3 2024-09-12T00:56:55.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.312+0000 7f571f708800 20 remove_watcher() i=4 2024-09-12T00:56:55.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.313+0000 7f571f708800 20 remove_watcher() i=5 2024-09-12T00:56:55.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.314+0000 7f571f708800 20 remove_watcher() i=6 2024-09-12T00:56:55.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.315+0000 7f571f708800 20 remove_watcher() i=7 2024-09-12T00:56:55.324 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T00:56:55.383 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:55.383 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:55.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.418+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.420+0000 7fabb3b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.420+0000 7fabb3b35800 20 realm 2024-09-12T00:56:55.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.420+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.420+0000 7fabb3b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.420+0000 7fabb3b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:55.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.420+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.420+0000 7fabb3b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.420+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.421+0000 7fabb3b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:55.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.421+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.421+0000 7fabb3b35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:55.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.421+0000 7fabb3b35800 20 searching for the correct realm 2024-09-12T00:56:55.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.424+0000 7faba7fff640 0 -- 172.21.15.83:0/2518325484 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fab9806e120 msgr2=0x7fab9808b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:55.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.630+0000 7fabb00e5640 0 -- 172.21.15.83:0/2518325484 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55979ffd42f0 msgr2=0x55979ffd6780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:55.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.633+0000 7fabb3b35800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:55.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.633+0000 7fabb3b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:55.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.633+0000 7fabb3b35800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:55.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.633+0000 7fabb3b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.633+0000 7fabb3b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.633+0000 7fabb3b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.633+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:55.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:55.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 zone default found 2024-09-12T00:56:55.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 4 Realm: () 2024-09-12T00:56:55.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 zonegroup default 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.634+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.635+0000 7fabb3b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.635+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.635+0000 7fabb3b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.635+0000 7fabb3b35800 20 started sync module instance, tier type = 2024-09-12T00:56:55.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.635+0000 7fabb3b35800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:55.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.643+0000 7fabb3b35800 20 add_watcher() i=0 2024-09-12T00:56:55.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.643+0000 7fabb3b35800 20 add_watcher() i=1 2024-09-12T00:56:55.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.643+0000 7fabb3b35800 20 add_watcher() i=2 2024-09-12T00:56:55.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.643+0000 7fabb3b35800 20 add_watcher() i=3 2024-09-12T00:56:55.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.643+0000 7fabb3b35800 20 add_watcher() i=4 2024-09-12T00:56:55.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.643+0000 7fabb3b35800 20 add_watcher() i=5 2024-09-12T00:56:55.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.643+0000 7fabb3b35800 20 add_watcher() i=6 2024-09-12T00:56:55.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.644+0000 7fabb3b35800 20 add_watcher() i=7 2024-09-12T00:56:55.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.644+0000 7fabb3b35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:55.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.646+0000 7faa65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:55.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.646+0000 7fabb3b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:55.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.646+0000 7fabb3b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:55.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.646+0000 7fabb3b35800 5 note: GC not initialized 2024-09-12T00:56:55.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.646+0000 7faa64fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:55.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.646+0000 7fabb3b35800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:55.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.647+0000 7fabb3b35800 20 Filter name: none 2024-09-12T00:56:55.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.647+0000 7fa9de7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:55.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.647+0000 7fabb3b35800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:56:55.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.647+0000 7fabb3b35800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.647+0000 7fabb3b35800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:56:55.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.647+0000 7fabb3b35800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:56:55.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.647+0000 7fabb3b35800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:56:55.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.647+0000 7fabb3b35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.648+0000 7fabb3b35800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.648+0000 7fabb3b35800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.648+0000 7fabb3b35800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.649+0000 7faa8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366441 cookie 94109712661568 notifier 9186 bl.length()=727 2024-09-12T00:56:55.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.649+0000 7faa8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.649+0000 7faa8effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "foobar.client.0", 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "foobar+test@test.test", 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:56:55.648 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "foobar.client.0", 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "NITAMRPHDJYAQNBYRUIN", 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "+PoP4IPuOMwTxnSfcyyVH5pCRQnfzggKANMRPfFVT0ZigppMjkVNDA==", 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:54.945540Z" 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [ 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "oidc-provider", 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: "perm": "*" 2024-09-12T00:56:55.649 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "roles", 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: "perm": "*" 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "user-policy", 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: "perm": "*" 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:56:55.650 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:55.651 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "rgw", 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [ 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: "3525189974" 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "", 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:54.945529Z", 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:55.652 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.650+0000 7faa65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.652+0000 7fabb3b35800 20 remove_watcher() i=0 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.652+0000 7fabb3b35800 2 removed watcher, disabling cache 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.653+0000 7fabb3b35800 20 remove_watcher() i=1 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.654+0000 7fabb3b35800 20 remove_watcher() i=2 2024-09-12T00:56:55.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.655+0000 7fabb3b35800 20 remove_watcher() i=3 2024-09-12T00:56:55.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.656+0000 7fabb3b35800 20 remove_watcher() i=4 2024-09-12T00:56:55.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.657+0000 7fabb3b35800 20 remove_watcher() i=5 2024-09-12T00:56:55.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.658+0000 7fabb3b35800 20 remove_watcher() i=6 2024-09-12T00:56:55.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.658+0000 7fabb3b35800 20 remove_watcher() i=7 2024-09-12T00:56:55.668 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T00:56:55.727 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:55.728 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:55.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.762+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.764+0000 7f300f722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.764+0000 7f300f722800 20 realm 2024-09-12T00:56:55.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.764+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.764+0000 7f300f722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.764+0000 7f300f722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:55.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.764+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.764+0000 7f300f722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.764+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.765+0000 7f300f722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:55.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.765+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.765+0000 7f300f722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:55.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.765+0000 7f300f722800 20 searching for the correct realm 2024-09-12T00:56:55.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.767+0000 7f300b302640 0 -- 172.21.15.83:0/3020278452 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f2ffc0af2f0 msgr2=0x7f2ffc0ab090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:55.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.770+0000 7f300b302640 0 -- 172.21.15.83:0/3020278452 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f300401d060 msgr2=0x7f300405f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:55.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.976+0000 7f300f722800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.976+0000 7f300f722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.976+0000 7f300f722800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.976+0000 7f300f722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.976+0000 7f300f722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.976+0000 7f300f722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:55.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:55.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 20 zone default found 2024-09-12T00:56:55.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 4 Realm: () 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 20 zonegroup default 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.977+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.978+0000 7f300f722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.978+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.978+0000 7f300f722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.978+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.978+0000 7f300f722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.978+0000 7f300f722800 20 started sync module instance, tier type = 2024-09-12T00:56:55.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.978+0000 7f300f722800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:55.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.987+0000 7f300f722800 20 add_watcher() i=0 2024-09-12T00:56:55.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.987+0000 7f300f722800 20 add_watcher() i=1 2024-09-12T00:56:55.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.987+0000 7f300f722800 20 add_watcher() i=2 2024-09-12T00:56:55.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.987+0000 7f300f722800 20 add_watcher() i=3 2024-09-12T00:56:55.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.987+0000 7f300f722800 20 add_watcher() i=4 2024-09-12T00:56:55.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.987+0000 7f300f722800 20 add_watcher() i=5 2024-09-12T00:56:55.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.987+0000 7f300f722800 20 add_watcher() i=6 2024-09-12T00:56:55.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.988+0000 7f300f722800 20 add_watcher() i=7 2024-09-12T00:56:55.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.988+0000 7f300f722800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:55.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f2ec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f300f722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f300f722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f300f722800 5 note: GC not initialized 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f2ec0fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f300f722800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f300f722800 20 Filter name: none 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f2e3a7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f300f722800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.990+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 20 rados->read ofs=0 len=0 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.991+0000 7f300f722800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.992+0000 7f300f722800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.992+0000 7f300f722800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.992+0000 7f300f722800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T00:56:55.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.992+0000 7f2eeeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366442 cookie 94015186062592 notifier 9204 bl.length()=384 2024-09-12T00:56:55.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.992+0000 7f2eeeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:56:55.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.992+0000 7f2eeeffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.994+0000 7f300f722800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.994+0000 7f300f722800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.994+0000 7f300f722800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.994+0000 7f2eee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366443 cookie 94015186070672 notifier 9204 bl.length()=225 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.994+0000 7f2eee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.994+0000 7f2eee7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.996+0000 7f300f722800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.996+0000 7f300f722800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.996+0000 7f300f722800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.996+0000 7f2eeeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 94015186068000 notifier 9204 bl.length()=234 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.996+0000 7f2eeeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:56:55.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.996+0000 7f2eeeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:56:55.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.997+0000 7f2ec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:55.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.999+0000 7f300f722800 20 remove_watcher() i=0 2024-09-12T00:56:55.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:55.999+0000 7f300f722800 2 removed watcher, disabling cache 2024-09-12T00:56:56.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.001+0000 7f300f722800 20 remove_watcher() i=1 2024-09-12T00:56:56.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.002+0000 7f300f722800 20 remove_watcher() i=2 2024-09-12T00:56:56.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.003+0000 7f300f722800 20 remove_watcher() i=3 2024-09-12T00:56:56.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.003+0000 7f300f722800 20 remove_watcher() i=4 2024-09-12T00:56:56.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.004+0000 7f300f722800 20 remove_watcher() i=5 2024-09-12T00:56:56.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.005+0000 7f300f722800 20 remove_watcher() i=6 2024-09-12T00:56:56.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.006+0000 7f300f722800 20 remove_watcher() i=7 2024-09-12T00:56:56.013 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: "id": "RGW88888888888888888", 2024-09-12T00:56:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: "tenant": "", 2024-09-12T00:56:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T00:56:56.014 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T00:56:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-09-12T00:56:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:56.015 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:56.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max_users": 1000, 2024-09-12T00:56:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max_roles": 1000, 2024-09-12T00:56:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max_groups": 1000, 2024-09-12T00:56:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:56.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max_access_keys": 4 2024-09-12T00:56:56.017 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:56.018 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T00:56:56.018 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key ABOJSZBHOAPKDQLXOKMX --secret I9ahtgK2ZscM0Fe5Qc7WsPoSziMbK3Z82UYa5D4Kfl7+MABk4Z2z5w== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T00:56:56.086 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:56.086 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.121+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.123+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.123+0000 7f0123d2c800 20 realm 2024-09-12T00:56:56.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.123+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.123+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.123+0000 7f0123d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:56.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.123+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.123+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.123+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.124+0000 7f0123d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:56.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.124+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.124+0000 7f0123d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:56.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.124+0000 7f0123d2c800 20 searching for the correct realm 2024-09-12T00:56:56.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.126+0000 7f011fa4f640 0 -- 172.21.15.83:0/1523854800 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f01180db000 msgr2=0x7f01180c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:56.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.332+0000 7f011fa4f640 0 -- 172.21.15.83:0/1523854800 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f0108003cb0 msgr2=0x7f0110063ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:56.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.539+0000 7f0123d2c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.539+0000 7f0123d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.539+0000 7f0123d2c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.539+0000 7f0123d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.539+0000 7f0123d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.539+0000 7f0123d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.539+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.539+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.539+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:56.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:56.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 20 zone default found 2024-09-12T00:56:56.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 4 Realm: () 2024-09-12T00:56:56.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:56.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:56.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:56.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 20 zonegroup default 2024-09-12T00:56:56.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.540+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.541+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.541+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.541+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.541+0000 7f0123d2c800 20 started sync module instance, tier type = 2024-09-12T00:56:56.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.541+0000 7f0123d2c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:56.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.550+0000 7f0123d2c800 20 add_watcher() i=0 2024-09-12T00:56:56.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.550+0000 7f0123d2c800 20 add_watcher() i=1 2024-09-12T00:56:56.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.550+0000 7f0123d2c800 20 add_watcher() i=2 2024-09-12T00:56:56.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.550+0000 7f0123d2c800 20 add_watcher() i=3 2024-09-12T00:56:56.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.550+0000 7f0123d2c800 20 add_watcher() i=4 2024-09-12T00:56:56.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.550+0000 7f0123d2c800 20 add_watcher() i=5 2024-09-12T00:56:56.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.550+0000 7f0123d2c800 20 add_watcher() i=6 2024-09-12T00:56:56.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.551+0000 7f0123d2c800 20 add_watcher() i=7 2024-09-12T00:56:56.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.551+0000 7f0123d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:56.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.552+0000 7effd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:56.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.552+0000 7f0123d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.552+0000 7f0123d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 5 note: GC not initialized 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7effd4fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 20 Filter name: none 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7eff4e7fc640 20 reqs_thread_entry: start 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T00:56:56.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.553+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 10 cache get: name=default.rgw.meta+users.keys+ABOJSZBHOAPKDQLXOKMX : miss 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 10 cache put: name=default.rgw.meta+users.keys+ABOJSZBHOAPKDQLXOKMX info.flags=0x0 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 10 adding default.rgw.meta+users.keys+ABOJSZBHOAPKDQLXOKMX to cache LRU end 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T00:56:56.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:56:56.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:56:56.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:56:56.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.554+0000 7f0123d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:56.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.555+0000 7f0123d2c800 10 cache get: name=default.rgw.meta+users.keys+ABOJSZBHOAPKDQLXOKMX : hit (negative entry) 2024-09-12T00:56:56.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.555+0000 7f0123d2c800 10 cache get: name=default.rgw.meta+users.keys+ABOJSZBHOAPKDQLXOKMX : hit (negative entry) 2024-09-12T00:56:56.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.556+0000 7f0123d2c800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:56:56.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.556+0000 7f0123d2c800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:56:56.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.556+0000 7f0123d2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:56:56.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.556+0000 7efffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366444 cookie 94047514819984 notifier 8660 bl.length()=681 2024-09-12T00:56:56.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.556+0000 7efffeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:56:56.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.556+0000 7efffeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:56:56.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.558+0000 7f0123d2c800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:56:56.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.558+0000 7f0123d2c800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:56:56.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.558+0000 7f0123d2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T00:56:56.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.558+0000 7efffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366442 cookie 94047514832544 notifier 8660 bl.length()=189 2024-09-12T00:56:56.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.558+0000 7efffe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:56:56.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.558+0000 7efffe7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:56:56.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.560+0000 7f0123d2c800 10 cache put: name=default.rgw.meta+users.keys+ABOJSZBHOAPKDQLXOKMX info.flags=0x7 2024-09-12T00:56:56.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.560+0000 7f0123d2c800 10 moving default.rgw.meta+users.keys+ABOJSZBHOAPKDQLXOKMX to cache LRU end 2024-09-12T00:56:56.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.560+0000 7f0123d2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:ABOJSZBHOAPKDQLXOKMX, ofs0, ns] 2024-09-12T00:56:56.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.560+0000 7efffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366246 cookie 94047514827488 notifier 8660 bl.length()=188 2024-09-12T00:56:56.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.560+0000 7efffeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ABOJSZBHOAPKDQLXOKMX info.flags=0x7 2024-09-12T00:56:56.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.560+0000 7efffeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ABOJSZBHOAPKDQLXOKMX to cache LRU end 2024-09-12T00:56:56.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.561+0000 7f0123d2c800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T00:56:56.560 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "root1.client.0", 2024-09-12T00:56:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T00:56:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "root1+test@test.test", 2024-09-12T00:56:56.560 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "root1.client.0", 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "ABOJSZBHOAPKDQLXOKMX", 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "I9ahtgK2ZscM0Fe5Qc7WsPoSziMbK3Z82UYa5D4Kfl7+MABk4Z2z5w==", 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:56.555799Z" 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:56:56.561 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:56.562 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "root", 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "RGW88888888888888888", 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:56.555784Z", 2024-09-12T00:56:56.563 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:56:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:56:56.564 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:56.564 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:56.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.562+0000 7effd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:56.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.564+0000 7f0123d2c800 20 remove_watcher() i=0 2024-09-12T00:56:56.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.564+0000 7f0123d2c800 2 removed watcher, disabling cache 2024-09-12T00:56:56.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.565+0000 7f0123d2c800 20 remove_watcher() i=1 2024-09-12T00:56:56.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.566+0000 7f0123d2c800 20 remove_watcher() i=2 2024-09-12T00:56:56.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.567+0000 7f0123d2c800 20 remove_watcher() i=3 2024-09-12T00:56:56.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.568+0000 7f0123d2c800 20 remove_watcher() i=4 2024-09-12T00:56:56.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.569+0000 7f0123d2c800 20 remove_watcher() i=5 2024-09-12T00:56:56.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.570+0000 7f0123d2c800 20 remove_watcher() i=6 2024-09-12T00:56:56.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.571+0000 7f0123d2c800 20 remove_watcher() i=7 2024-09-12T00:56:56.581 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 3019114205 --totp-seed 35W6JACX4R5BK3TM2QAJX7TGABOTKVICCZALKYWRXGKJV33Z35PLR73AQH7ZKXCP --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:56:56.647 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:56.648 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:56.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.683+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.684+0000 7facebb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.684+0000 7facebb42800 20 realm 2024-09-12T00:56:56.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.684+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.684+0000 7facebb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.684+0000 7facebb42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:56.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.684+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.684+0000 7facebb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:56.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.684+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.685+0000 7facebb42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:56.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.685+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:56.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.685+0000 7facebb42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:56.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.685+0000 7facebb42800 20 searching for the correct realm 2024-09-12T00:56:56.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.688+0000 7face7886640 0 -- 172.21.15.83:0/840658879 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7facd40023b0 msgr2=0x7facd8010070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:56.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:56.893+0000 7face7886640 0 -- 172.21.15.83:0/840658879 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7face0026040 msgr2=0x7face0032900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:57.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.100+0000 7facebb42800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:57.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.100+0000 7facebb42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:57.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.100+0000 7facebb42800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:57.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.100+0000 7facebb42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:57.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.100+0000 7facebb42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.100+0000 7facebb42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.100+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.100+0000 7facebb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.100+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 20 zone default found 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 4 Realm: () 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 20 zonegroup default 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.101+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.102+0000 7facebb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.102+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.102+0000 7facebb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.102+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.103+0000 7facebb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.103+0000 7facebb42800 20 started sync module instance, tier type = 2024-09-12T00:56:57.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.103+0000 7facebb42800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:57.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.111+0000 7facebb42800 20 add_watcher() i=0 2024-09-12T00:56:57.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.111+0000 7facebb42800 20 add_watcher() i=1 2024-09-12T00:56:57.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.111+0000 7facebb42800 20 add_watcher() i=2 2024-09-12T00:56:57.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.111+0000 7facebb42800 20 add_watcher() i=3 2024-09-12T00:56:57.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.111+0000 7facebb42800 20 add_watcher() i=4 2024-09-12T00:56:57.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.111+0000 7facebb42800 20 add_watcher() i=5 2024-09-12T00:56:57.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.111+0000 7facebb42800 20 add_watcher() i=6 2024-09-12T00:56:57.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.112+0000 7facebb42800 20 add_watcher() i=7 2024-09-12T00:56:57.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.112+0000 7facebb42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:57.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.114+0000 7fab9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:57.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.114+0000 7facebb42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:57.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.114+0000 7facebb42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:57.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.114+0000 7facebb42800 5 note: GC not initialized 2024-09-12T00:56:57.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.115+0000 7fab9cfe1640 20 reqs_thread_entry: start 2024-09-12T00:56:57.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.115+0000 7facebb42800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:57.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.115+0000 7facebb42800 20 Filter name: none 2024-09-12T00:56:57.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.115+0000 7fab167fc640 20 reqs_thread_entry: start 2024-09-12T00:56:57.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.115+0000 7facebb42800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:56:57.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.115+0000 7facebb42800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.116+0000 7facebb42800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:56:57.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.116+0000 7facebb42800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T00:56:57.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.116+0000 7facebb42800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:56:57.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.116+0000 7facebb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:57.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.119+0000 7facebb42800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:56:57.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.119+0000 7facebb42800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:56:57.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.119+0000 7facebb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:56:57.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.119+0000 7fabc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366445 cookie 94247474208832 notifier 8675 bl.length()=695 2024-09-12T00:56:57.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.119+0000 7fabc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:56:57.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.119+0000 7fabc6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:56:57.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.120+0000 7fab9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:57.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.122+0000 7facebb42800 20 remove_watcher() i=0 2024-09-12T00:56:57.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.122+0000 7facebb42800 2 removed watcher, disabling cache 2024-09-12T00:56:57.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.123+0000 7facebb42800 20 remove_watcher() i=1 2024-09-12T00:56:57.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.124+0000 7facebb42800 20 remove_watcher() i=2 2024-09-12T00:56:57.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.125+0000 7facebb42800 20 remove_watcher() i=3 2024-09-12T00:56:57.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.126+0000 7facebb42800 20 remove_watcher() i=4 2024-09-12T00:56:57.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.127+0000 7facebb42800 20 remove_watcher() i=5 2024-09-12T00:56:57.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.128+0000 7facebb42800 20 remove_watcher() i=6 2024-09-12T00:56:57.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.129+0000 7facebb42800 20 remove_watcher() i=7 2024-09-12T00:56:57.139 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T00:56:57.200 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:57.200 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:57.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.234+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.236+0000 7fd41ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.236+0000 7fd41ad1f800 20 realm 2024-09-12T00:56:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.236+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.236+0000 7fd41ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.236+0000 7fd41ad1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.236+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.236+0000 7fd41ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.236+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.237+0000 7fd41ad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.237+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.237+0000 7fd41ad1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.238+0000 7fd41ad1f800 20 searching for the correct realm 2024-09-12T00:56:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.241+0000 7fd4162a8640 0 -- 172.21.15.83:0/1186930170 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fd400020ab0 msgr2=0x7fd40000f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:57.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.447+0000 7fd4172aa640 0 -- 172.21.15.83:0/1186930170 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55f58fd5ebe0 msgr2=0x55f58fd610a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:57.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.451+0000 7fd41ad1f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:57.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.451+0000 7fd41ad1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:57.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.451+0000 7fd41ad1f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:57.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.451+0000 7fd41ad1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:57.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.451+0000 7fd41ad1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:57.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.451+0000 7fd41ad1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:57.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.451+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.451+0000 7fd41ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.451+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:57.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:57.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 20 zone default found 2024-09-12T00:56:57.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 4 Realm: () 2024-09-12T00:56:57.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:57.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:57.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:57.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 20 zonegroup default 2024-09-12T00:56:57.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.452+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.453+0000 7fd41ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.453+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.453+0000 7fd41ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.453+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.453+0000 7fd41ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.453+0000 7fd41ad1f800 20 started sync module instance, tier type = 2024-09-12T00:56:57.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.453+0000 7fd41ad1f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:57.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.462+0000 7fd41ad1f800 20 add_watcher() i=0 2024-09-12T00:56:57.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.462+0000 7fd41ad1f800 20 add_watcher() i=1 2024-09-12T00:56:57.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.462+0000 7fd41ad1f800 20 add_watcher() i=2 2024-09-12T00:56:57.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.462+0000 7fd41ad1f800 20 add_watcher() i=3 2024-09-12T00:56:57.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.462+0000 7fd41ad1f800 20 add_watcher() i=4 2024-09-12T00:56:57.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.462+0000 7fd41ad1f800 20 add_watcher() i=5 2024-09-12T00:56:57.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.462+0000 7fd41ad1f800 20 add_watcher() i=6 2024-09-12T00:56:57.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.463+0000 7fd41ad1f800 20 add_watcher() i=7 2024-09-12T00:56:57.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.463+0000 7fd41ad1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:57.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd2cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:57.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd41ad1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:57.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd41ad1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd41ad1f800 5 note: GC not initialized 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd247fff640 20 reqs_thread_entry: start 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd41ad1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd41ad1f800 20 Filter name: none 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd245ffb640 20 reqs_thread_entry: start 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd41ad1f800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.465+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T00:56:57.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:56:57.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.466+0000 7fd41ad1f800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.467+0000 7fd41ad1f800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.467+0000 7fd41ad1f800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.467+0000 7fd41ad1f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.467+0000 7fd2fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366446 cookie 94513168561040 notifier 9261 bl.length()=384 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.467+0000 7fd2fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.467+0000 7fd2fa7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.469+0000 7fd41ad1f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.469+0000 7fd41ad1f800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.469+0000 7fd41ad1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.469+0000 7fd2f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366447 cookie 94513168570560 notifier 9261 bl.length()=225 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.469+0000 7fd2f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:56:57.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.469+0000 7fd2f9ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:56:57.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.471+0000 7fd41ad1f800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:56:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.471+0000 7fd41ad1f800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:56:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.471+0000 7fd41ad1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T00:56:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.471+0000 7fd2fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366247 cookie 94513168562256 notifier 9261 bl.length()=234 2024-09-12T00:56:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.471+0000 7fd2fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:56:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.471+0000 7fd2fa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:56:57.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.472+0000 7fd2cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:57.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.474+0000 7fd41ad1f800 20 remove_watcher() i=0 2024-09-12T00:56:57.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.474+0000 7fd41ad1f800 2 removed watcher, disabling cache 2024-09-12T00:56:57.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.475+0000 7fd41ad1f800 20 remove_watcher() i=1 2024-09-12T00:56:57.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.476+0000 7fd41ad1f800 20 remove_watcher() i=2 2024-09-12T00:56:57.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.477+0000 7fd41ad1f800 20 remove_watcher() i=3 2024-09-12T00:56:57.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.478+0000 7fd41ad1f800 20 remove_watcher() i=4 2024-09-12T00:56:57.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.479+0000 7fd41ad1f800 20 remove_watcher() i=5 2024-09-12T00:56:57.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.480+0000 7fd41ad1f800 20 remove_watcher() i=6 2024-09-12T00:56:57.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.481+0000 7fd41ad1f800 20 remove_watcher() i=7 2024-09-12T00:56:57.488 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: "id": "RGW99999999999999999", 2024-09-12T00:56:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: "tenant": "", 2024-09-12T00:56:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T00:56:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T00:56:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: "quota": { 2024-09-12T00:56:57.489 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:57.491 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: "max_users": 1000, 2024-09-12T00:56:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: "max_roles": 1000, 2024-09-12T00:56:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: "max_groups": 1000, 2024-09-12T00:56:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:57.492 INFO:teuthology.orchestra.run.smithi083.stdout: "max_access_keys": 4 2024-09-12T00:56:57.492 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:57.494 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T00:56:57.495 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key PEAIPDVTKTNFZXSKPNCB --secret g7+M3ykJ3sLiKwXW5ta+9XZeeyREGqAS8+51jh7YZaYmML4DX4TLCA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T00:56:57.562 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:57.563 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:57.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.597+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.599+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.599+0000 7f63fa523800 20 realm 2024-09-12T00:56:57.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.599+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.599+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.599+0000 7f63fa523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:57.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.599+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.599+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.599+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.600+0000 7f63fa523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:57.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.600+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.600+0000 7f63fa523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:57.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.600+0000 7f63fa523800 20 searching for the correct realm 2024-09-12T00:56:57.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.604+0000 7f63f6a14640 0 -- 172.21.15.83:0/3448116281 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7f63ec0e7bf0 msgr2=0x7f63ec086460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:57.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.607+0000 7f63f6213640 0 -- 172.21.15.83:0/3448116281 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f63f0024040 msgr2=0x7f63f0026940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:57.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.610+0000 7f63fa523800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:57.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.610+0000 7f63fa523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:57.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.610+0000 7f63fa523800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:57.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.610+0000 7f63fa523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:57.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.610+0000 7f63fa523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:57.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.610+0000 7f63fa523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:57.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.610+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 20 zone default found 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 4 Realm: () 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 20 zonegroup default 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.611+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.612+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.612+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.612+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.612+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.612+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.612+0000 7f63fa523800 20 started sync module instance, tier type = 2024-09-12T00:56:57.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.612+0000 7f63fa523800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:57.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.620+0000 7f63fa523800 20 add_watcher() i=0 2024-09-12T00:56:57.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.620+0000 7f63fa523800 20 add_watcher() i=1 2024-09-12T00:56:57.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.620+0000 7f63fa523800 20 add_watcher() i=2 2024-09-12T00:56:57.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.620+0000 7f63fa523800 20 add_watcher() i=3 2024-09-12T00:56:57.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.620+0000 7f63fa523800 20 add_watcher() i=4 2024-09-12T00:56:57.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.620+0000 7f63fa523800 20 add_watcher() i=5 2024-09-12T00:56:57.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.620+0000 7f63fa523800 20 add_watcher() i=6 2024-09-12T00:56:57.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.621+0000 7f63fa523800 20 add_watcher() i=7 2024-09-12T00:56:57.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.621+0000 7f63fa523800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f62ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f63fa523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f63fa523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f63fa523800 5 note: GC not initialized 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f62a77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f63fa523800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f63fa523800 20 Filter name: none 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f62a57fa640 20 reqs_thread_entry: start 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f63fa523800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.623+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 10 cache get: name=default.rgw.meta+users.keys+PEAIPDVTKTNFZXSKPNCB : miss 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 10 cache put: name=default.rgw.meta+users.keys+PEAIPDVTKTNFZXSKPNCB info.flags=0x0 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 10 adding default.rgw.meta+users.keys+PEAIPDVTKTNFZXSKPNCB to cache LRU end 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T00:56:57.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.624+0000 7f63fa523800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.625+0000 7f63fa523800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:56:57.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.625+0000 7f63fa523800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.625+0000 7f63fa523800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.625+0000 7f63fa523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.625+0000 7f63fa523800 10 cache get: name=default.rgw.meta+users.keys+PEAIPDVTKTNFZXSKPNCB : hit (negative entry) 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.625+0000 7f63fa523800 10 cache get: name=default.rgw.meta+users.keys+PEAIPDVTKTNFZXSKPNCB : hit (negative entry) 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.626+0000 7f63fa523800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.626+0000 7f63fa523800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.626+0000 7f63fa523800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.627+0000 7f62d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366448 cookie 94594855104832 notifier 9276 bl.length()=681 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.627+0000 7f62d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:56:57.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.627+0000 7f62d9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:56:57.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.628+0000 7f63fa523800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:56:57.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.628+0000 7f63fa523800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:56:57.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.628+0000 7f63fa523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T00:56:57.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.628+0000 7f62d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366443 cookie 94594855115424 notifier 9276 bl.length()=189 2024-09-12T00:56:57.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.628+0000 7f62d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:56:57.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.628+0000 7f62d97fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:56:57.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.630+0000 7f63fa523800 10 cache put: name=default.rgw.meta+users.keys+PEAIPDVTKTNFZXSKPNCB info.flags=0x7 2024-09-12T00:56:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.630+0000 7f63fa523800 10 moving default.rgw.meta+users.keys+PEAIPDVTKTNFZXSKPNCB to cache LRU end 2024-09-12T00:56:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.630+0000 7f63fa523800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:PEAIPDVTKTNFZXSKPNCB, ofs0, ns] 2024-09-12T00:56:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.630+0000 7f62d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366449 cookie 94594855114368 notifier 9276 bl.length()=188 2024-09-12T00:56:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.630+0000 7f62d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PEAIPDVTKTNFZXSKPNCB info.flags=0x7 2024-09-12T00:56:57.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.630+0000 7f62d97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PEAIPDVTKTNFZXSKPNCB to cache LRU end 2024-09-12T00:56:57.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.631+0000 7f63fa523800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T00:56:57.630 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T00:56:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: "user_id": "root2.client.0", 2024-09-12T00:56:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T00:56:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: "email": "root2+test@test.test", 2024-09-12T00:56:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: "suspended": 0, 2024-09-12T00:56:57.630 INFO:teuthology.orchestra.run.smithi083.stdout: "max_buckets": 1000, 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "subusers": [], 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "keys": [ 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "user": "root2.client.0", 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "access_key": "PEAIPDVTKTNFZXSKPNCB", 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "secret_key": "g7+M3ykJ3sLiKwXW5ta+9XZeeyREGqAS8+51jh7YZaYmML4DX4TLCA==", 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "active": true, 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:57.626174Z" 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "swift_keys": [], 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": [], 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "op_mask": "read, write, delete", 2024-09-12T00:56:57.631 INFO:teuthology.orchestra.run.smithi083.stdout: "default_placement": "", 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "default_storage_class": "", 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "placement_tags": [], 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "bucket_quota": { 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "user_quota": { 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": false, 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "check_on_raw": false, 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size": -1, 2024-09-12T00:56:57.632 INFO:teuthology.orchestra.run.smithi083.stdout: "max_size_kb": 0, 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: "max_objects": -1 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: "temp_url_keys": [], 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "root", 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: "mfa_ids": [], 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: "account_id": "RGW99999999999999999", 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: "create_date": "2024-09-12T00:56:57.626162Z", 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: "group_ids": [] 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T00:56:57.633 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:56:57.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.632+0000 7f62ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:57.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.634+0000 7f63fa523800 20 remove_watcher() i=0 2024-09-12T00:56:57.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.634+0000 7f63fa523800 2 removed watcher, disabling cache 2024-09-12T00:56:57.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.635+0000 7f63fa523800 20 remove_watcher() i=1 2024-09-12T00:56:57.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.636+0000 7f63fa523800 20 remove_watcher() i=2 2024-09-12T00:56:57.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.637+0000 7f63fa523800 20 remove_watcher() i=3 2024-09-12T00:56:57.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.638+0000 7f63fa523800 20 remove_watcher() i=4 2024-09-12T00:56:57.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.639+0000 7f63fa523800 20 remove_watcher() i=5 2024-09-12T00:56:57.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.640+0000 7f63fa523800 20 remove_watcher() i=6 2024-09-12T00:56:57.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.642+0000 7f63fa523800 20 remove_watcher() i=7 2024-09-12T00:56:57.651 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 7194907999 --totp-seed FWQOAKN22QBVMFLPEGWFHUUXBA6H3DBLTAYUOBXCNZ32ILLNPEXAGQ5OEGEXZXYW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:56:57.718 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:57.718 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.753+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.754+0000 7fb28d924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.754+0000 7fb28d924800 20 realm 2024-09-12T00:56:57.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.754+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.754+0000 7fb28d924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.754+0000 7fb28d924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:57.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.754+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.754+0000 7fb28d924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.754+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.755+0000 7fb28d924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:57.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.755+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.755+0000 7fb28d924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:57.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.755+0000 7fb28d924800 20 searching for the correct realm 2024-09-12T00:56:57.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.758+0000 7fb280d01640 0 -- 172.21.15.83:0/3270808667 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fb274088ef0 msgr2=0x7fb274096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:57.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.963+0000 7fb289d03640 0 -- 172.21.15.83:0/3270808667 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55ca50fe9030 msgr2=0x55ca50feb4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:57.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.967+0000 7fb28d924800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T00:56:57.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.967+0000 7fb28d924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:57.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.967+0000 7fb28d924800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T00:56:57.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.967+0000 7fb28d924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:57.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.967+0000 7fb28d924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:57.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.967+0000 7fb28d924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:57.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.967+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.967+0000 7fb28d924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.967+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:57.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:57.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 20 zone default found 2024-09-12T00:56:57.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 4 Realm: () 2024-09-12T00:56:57.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T00:56:57.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T00:56:57.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:57.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 20 zonegroup default 2024-09-12T00:56:57.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.968+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.969+0000 7fb28d924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.969+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.969+0000 7fb28d924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:57.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.969+0000 7fb28d924800 20 started sync module instance, tier type = 2024-09-12T00:56:57.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.969+0000 7fb28d924800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T00:56:57.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.980+0000 7fb28d924800 20 add_watcher() i=0 2024-09-12T00:56:57.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.980+0000 7fb28d924800 20 add_watcher() i=1 2024-09-12T00:56:57.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.980+0000 7fb28d924800 20 add_watcher() i=2 2024-09-12T00:56:57.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.980+0000 7fb28d924800 20 add_watcher() i=3 2024-09-12T00:56:57.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.980+0000 7fb28d924800 20 add_watcher() i=4 2024-09-12T00:56:57.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.980+0000 7fb28d924800 20 add_watcher() i=5 2024-09-12T00:56:57.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.980+0000 7fb28d924800 20 add_watcher() i=6 2024-09-12T00:56:57.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.981+0000 7fb28d924800 20 add_watcher() i=7 2024-09-12T00:56:57.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.981+0000 7fb28d924800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.982+0000 7fb13f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.983+0000 7fb28d924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.983+0000 7fb28d924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.983+0000 7fb28d924800 5 note: GC not initialized 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.983+0000 7fb13e7e4640 20 reqs_thread_entry: start 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.983+0000 7fb28d924800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.983+0000 7fb28d924800 20 Filter name: none 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.983+0000 7fb0affff640 20 reqs_thread_entry: start 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.983+0000 7fb28d924800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:56:57.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.983+0000 7fb28d924800 20 rados->read ofs=0 len=0 2024-09-12T00:56:57.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.984+0000 7fb28d924800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:56:57.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.984+0000 7fb28d924800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T00:56:57.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.984+0000 7fb28d924800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:56:57.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.984+0000 7fb28d924800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:57.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.987+0000 7fb28d924800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:56:57.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.987+0000 7fb28d924800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:56:57.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.987+0000 7fb28d924800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:56:57.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.987+0000 7fb16cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366450 cookie 94327430668640 notifier 9297 bl.length()=695 2024-09-12T00:56:57.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.987+0000 7fb16cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:56:57.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.987+0000 7fb16cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:56:57.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.988+0000 7fb13f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:57.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.990+0000 7fb28d924800 20 remove_watcher() i=0 2024-09-12T00:56:57.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.990+0000 7fb28d924800 2 removed watcher, disabling cache 2024-09-12T00:56:57.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.991+0000 7fb28d924800 20 remove_watcher() i=1 2024-09-12T00:56:57.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.992+0000 7fb28d924800 20 remove_watcher() i=2 2024-09-12T00:56:57.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.993+0000 7fb28d924800 20 remove_watcher() i=3 2024-09-12T00:56:57.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.993+0000 7fb28d924800 20 remove_watcher() i=4 2024-09-12T00:56:57.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.994+0000 7fb28d924800 20 remove_watcher() i=5 2024-09-12T00:56:57.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.995+0000 7fb28d924800 20 remove_watcher() i=6 2024-09-12T00:56:57.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T00:56:57.996+0000 7fb28d924800 20 remove_watcher() i=7 2024-09-12T00:56:58.005 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T00:56:58.005 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:56:58.006 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T00:56:58.034 INFO:tasks.s3tests:Configuring boto... 2024-09-12T00:56:58.034 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T00:56:58.034 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:56:58.103 DEBUG:teuthology.orchestra.run.smithi083:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:56:58.280 INFO:teuthology.orchestra.run.smithi083.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T00:56:58.458 INFO:teuthology.orchestra.run.smithi083.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T00:56:58.733 INFO:teuthology.orchestra.run.smithi083.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:58:43.694 INFO:teuthology.orchestra.run.smithi083.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T00:58:45.087 INFO:teuthology.orchestra.run.smithi083.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=751c73c43938c925cf88ce265305e5764a89a9d11e4041eacb6803a3ff4fae86,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:58:45.087 INFO:teuthology.orchestra.run.smithi083.stdout:py run-test-pre: PYTHONHASHSEED='2278638345' 2024-09-12T00:58:45.087 INFO:teuthology.orchestra.run.smithi083.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:58:45.223 INFO:teuthology.orchestra.run.smithi083.stdout:============================= test session starts ============================== 2024-09-12T00:58:45.223 INFO:teuthology.orchestra.run.smithi083.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T00:58:45.223 INFO:teuthology.orchestra.run.smithi083.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:58:45.223 INFO:teuthology.orchestra.run.smithi083.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:58:45.223 INFO:teuthology.orchestra.run.smithi083.stdout:configfile: pytest.ini 2024-09-12T00:58:46.984 INFO:teuthology.orchestra.run.smithi083.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T00:58:46.984 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T00:58:47.298 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T00:58:47.457 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T00:58:47.615 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T00:58:47.771 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T00:58:47.929 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T00:58:48.039 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T00:58:48.199 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T00:58:48.308 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T00:58:48.394 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T00:58:48.480 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T00:58:48.641 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T00:58:48.800 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T00:58:48.958 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T00:58:49.120 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T00:58:49.206 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T00:58:49.292 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T00:58:49.337 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T00:58:49.382 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T00:58:49.427 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T00:58:49.473 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T00:58:49.518 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T00:58:49.563 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T00:58:49.608 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:58:49.653 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:58:49.698 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:58:49.743 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:58:49.788 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:58:49.833 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:58:49.878 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T00:58:49.923 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T00:58:49.969 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:58:50.015 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:58:50.061 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:58:50.107 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:58:50.153 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:58:50.199 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:58:50.246 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T00:58:50.291 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T00:58:50.338 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:58:50.385 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:58:50.432 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T00:58:50.479 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:58:50.525 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:58:50.572 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:58:50.618 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T00:58:50.665 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:58:50.712 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:58:50.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:58:50.807 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:58:50.854 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:58:50.901 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:58:50.947 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T00:58:50.994 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T00:58:51.419 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T00:58:51.994 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T00:58:53.051 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T00:58:54.032 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T00:58:55.696 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T00:58:56.243 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T00:58:57.025 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T00:58:57.257 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T00:58:57.376 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T00:58:57.573 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T00:58:57.769 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T00:58:58.096 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T00:58:58.280 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T00:58:58.514 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T00:58:58.515 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:58:58.515 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:58:58.516 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:58:58.517 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:58:58.518 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:58:58.519 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:58:58.520 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T00:58:58.520 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:58:58.521 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:58:58.522 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:58:58.523 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:58:58.523 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T00:58:58.524 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:58:58.525 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:58:58.526 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:58:58.526 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:58:58.527 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:58:58.528 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:58:58.529 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:58:58.530 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T00:58:58.531 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T00:58:58.531 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T00:58:58.532 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T00:58:58.533 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T00:58:58.534 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T00:58:58.535 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T00:58:58.535 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T00:58:58.619 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T00:58:58.632 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T00:58:59.208 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T00:59:08.453 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T00:59:08.825 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T00:59:09.301 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T00:59:09.689 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T00:59:10.153 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T00:59:10.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T00:59:10.991 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T00:59:11.445 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T00:59:11.862 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T00:59:12.274 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T00:59:12.650 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T00:59:12.967 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T00:59:13.286 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T00:59:13.578 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T00:59:13.945 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T00:59:14.406 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T00:59:14.862 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T00:59:15.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T00:59:15.638 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T00:59:16.004 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T00:59:16.384 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T00:59:16.761 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T00:59:17.117 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T00:59:17.468 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T00:59:17.771 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T00:59:18.107 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T00:59:18.400 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T00:59:18.703 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T00:59:18.995 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T00:59:19.491 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T00:59:19.782 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:59:20.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T00:59:20.473 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T00:59:20.872 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T00:59:21.163 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:59:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T00:59:21.982 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:59:22.479 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:59:22.839 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T00:59:23.243 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T00:59:23.645 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T00:59:24.230 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:59:24.716 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:59:25.110 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:59:25.514 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:59:26.115 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:59:26.593 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:59:27.085 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:59:27.573 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:59:28.093 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:59:28.517 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T00:59:29.084 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T00:59:29.566 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T00:59:30.544 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T00:59:31.249 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T00:59:32.102 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T00:59:33.787 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T00:59:36.048 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T00:59:37.313 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T00:59:38.489 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T00:59:39.403 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T00:59:39.985 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T00:59:41.000 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T00:59:41.768 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T00:59:42.770 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T00:59:43.492 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T00:59:44.745 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T00:59:45.682 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T00:59:47.115 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T00:59:48.465 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T00:59:49.392 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T00:59:50.250 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T00:59:50.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T00:59:52.670 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T00:59:53.867 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T00:59:55.289 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T00:59:56.682 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T00:59:57.873 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T00:59:59.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T01:00:00.057 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T01:00:00.797 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T01:00:01.636 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T01:00:03.148 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T01:00:05.127 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T01:00:06.031 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T01:00:07.300 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T01:00:08.583 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T01:00:09.754 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:00:11.015 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:00:12.328 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T01:00:13.612 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T01:00:14.809 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T01:00:15.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T01:00:16.350 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:00:17.065 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:00:17.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T01:00:18.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:00:19.912 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:00:20.981 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:00:22.043 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:00:23.115 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:00:24.173 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:00:25.214 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T01:00:26.332 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T01:00:27.370 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T01:00:28.459 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:00:29.520 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T01:00:30.627 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T01:00:31.329 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T01:00:32.060 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T01:00:32.749 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:00:33.441 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T01:00:33.955 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T01:00:34.498 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T01:00:34.990 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T01:00:35.506 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T01:00:35.936 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T01:00:36.426 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T01:00:36.878 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T01:00:37.355 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T01:00:37.850 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T01:00:38.668 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T01:00:39.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T01:00:39.914 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:00:40.343 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:00:40.823 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T01:00:41.299 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T01:00:42.139 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:00:42.960 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:00:43.419 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T01:00:43.864 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T01:00:44.340 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:00:44.784 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:00:45.297 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T01:00:45.740 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T01:00:46.216 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:00:46.696 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:00:47.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T01:00:47.646 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T01:00:48.159 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T01:00:48.650 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T01:00:49.097 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T01:00:49.545 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T01:00:49.997 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T01:00:50.444 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:00:50.930 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:01:01.206 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T01:01:01.709 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T01:01:02.144 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T01:01:02.598 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T01:01:03.098 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T01:01:03.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T01:01:04.008 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T01:01:04.458 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T01:01:04.935 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T01:01:05.401 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T01:01:05.868 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T01:01:06.348 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T01:01:06.787 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T01:01:07.232 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:01:07.675 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:01:08.156 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:01:08.650 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:01:09.141 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T01:01:09.629 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T01:01:10.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:01:10.575 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:01:11.052 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:01:11.581 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:01:12.160 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T01:01:12.692 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T01:01:13.185 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T01:01:13.631 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T01:01:14.077 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T01:01:14.592 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T01:01:14.884 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T01:01:15.293 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T01:01:16.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T01:01:16.886 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T01:01:17.338 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T01:01:17.861 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T01:01:18.303 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T01:01:18.781 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T01:01:19.298 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T01:01:19.824 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T01:01:20.312 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T01:01:20.785 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T01:01:21.309 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T01:01:21.760 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T01:01:22.232 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T01:01:22.684 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T01:01:23.288 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T01:01:23.950 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T01:01:24.364 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T01:01:24.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T01:01:25.153 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:01:25.520 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:01:25.813 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T01:01:26.117 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T01:01:26.409 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T01:01:26.834 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T01:01:27.259 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T01:01:27.599 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T01:01:28.010 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T01:01:28.337 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T01:01:28.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T01:01:29.152 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T01:01:29.840 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T01:01:30.447 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T01:01:31.061 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T01:01:42.324 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T01:01:52.545 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T01:01:52.999 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T01:01:53.444 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T01:01:53.897 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T01:01:54.349 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T01:01:54.842 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T01:01:55.306 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T01:01:55.699 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T01:01:56.173 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T01:01:56.619 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T01:01:57.085 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T01:01:57.551 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T01:01:57.979 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T01:01:58.432 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T01:01:58.802 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T01:01:59.259 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T01:01:59.675 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T01:02:00.173 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T01:02:00.645 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T01:02:01.104 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T01:02:01.556 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T01:02:02.065 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T01:02:02.530 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T01:02:02.953 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T01:02:03.420 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T01:02:03.824 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T01:02:04.281 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T01:02:04.666 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T01:02:05.076 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T01:02:05.512 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T01:02:05.918 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T01:02:06.292 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T01:02:06.665 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T01:02:07.054 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T01:02:07.537 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T01:02:07.984 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T01:02:08.355 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T01:02:08.730 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T01:02:09.148 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T01:02:09.523 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T01:02:09.913 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T01:02:10.347 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T01:02:10.813 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T01:02:11.232 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T01:02:11.763 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T01:02:12.213 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T01:02:12.592 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T01:02:13.010 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T01:02:13.500 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T01:02:15.011 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T01:02:15.516 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T01:02:15.978 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T01:02:16.529 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T01:02:17.051 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T01:02:17.526 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T01:02:18.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T01:02:18.563 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T01:02:19.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T01:02:19.527 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T01:02:20.126 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T01:02:20.543 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T01:02:20.885 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T01:02:21.240 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T01:02:21.680 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T01:02:22.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T01:02:22.373 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T01:02:22.822 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T01:02:23.235 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T01:02:23.696 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T01:02:26.444 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T01:02:26.903 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T01:02:27.337 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T01:02:27.750 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T01:02:28.125 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T01:02:28.532 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T01:02:28.950 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T01:02:29.428 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T01:02:29.941 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T01:02:30.366 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T01:02:30.792 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T01:02:31.250 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T01:02:31.755 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T01:02:32.224 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T01:02:32.674 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T01:02:33.148 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T01:02:33.701 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T01:02:34.132 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T01:02:34.427 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T01:02:34.731 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T01:02:35.038 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T01:02:35.389 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T01:02:35.706 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T01:02:36.026 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T01:02:36.391 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T01:02:36.761 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T01:02:37.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T01:02:37.374 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T01:02:37.773 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T01:02:38.068 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T01:02:38.579 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T01:02:38.873 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T01:02:39.169 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T01:02:39.502 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T01:02:39.906 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T01:02:40.310 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T01:02:40.675 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T01:02:41.039 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T01:02:41.486 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T01:02:41.850 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T01:02:42.268 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T01:02:42.679 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:02:43.072 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:02:43.545 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T01:02:43.962 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T01:02:44.515 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T01:02:44.942 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:02:45.413 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:02:45.927 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T01:02:46.395 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T01:02:46.908 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T01:02:47.344 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T01:02:47.713 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T01:02:48.235 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T01:02:48.749 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T01:02:49.300 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T01:02:49.799 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T01:02:50.348 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T01:02:51.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T01:02:51.685 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T01:02:52.379 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T01:02:53.113 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T01:02:53.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T01:02:54.182 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T01:02:54.615 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T01:02:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T01:02:55.580 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T01:02:56.009 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T01:02:56.553 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T01:02:57.257 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T01:02:57.978 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T01:02:58.665 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T01:02:59.376 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T01:03:00.100 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:03:00.841 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T01:03:01.595 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T01:03:02.278 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T01:03:02.955 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:03:03.551 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T01:03:04.146 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T01:03:04.745 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T01:03:05.462 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T01:03:06.149 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T01:03:06.439 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T01:03:06.731 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T01:03:07.033 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T01:03:07.479 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T01:03:07.928 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T01:03:08.279 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T01:03:08.610 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T01:03:09.212 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T01:03:10.318 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T01:03:10.863 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T01:03:11.353 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T01:03:11.972 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T01:03:12.653 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T01:03:13.161 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T01:03:13.700 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T01:03:14.145 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T01:03:14.839 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T01:03:15.369 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T01:03:15.996 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T01:03:16.517 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T01:03:17.176 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T01:03:17.907 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T01:03:18.236 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T01:03:18.601 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T01:03:19.890 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T01:03:20.452 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T01:03:22.350 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T01:03:22.858 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T01:03:23.387 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T01:03:24.219 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T01:03:24.704 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T01:03:25.556 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T01:03:27.817 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T01:03:29.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T01:03:32.184 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T01:03:43.256 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T01:03:44.560 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T01:03:47.244 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T01:03:47.775 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T01:03:48.590 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T01:03:49.294 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T01:03:49.849 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T01:03:50.347 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T01:03:51.117 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T01:03:51.637 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T01:03:52.074 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T01:03:52.592 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T01:04:07.044 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T01:04:09.119 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T01:04:09.582 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T01:04:09.913 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T01:04:10.389 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T01:04:15.504 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T01:04:19.044 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T01:04:22.578 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T01:04:23.093 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T01:04:23.534 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T01:04:24.046 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T01:04:24.525 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T01:04:25.005 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T01:04:25.516 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T01:04:25.978 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T01:04:26.526 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T01:04:27.163 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T01:04:27.810 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T01:04:28.333 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T01:04:29.047 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T01:04:29.774 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T01:04:30.365 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T01:04:30.883 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T01:04:31.499 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T01:04:32.618 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T01:04:33.307 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T01:04:33.726 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T01:04:38.107 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T01:04:38.600 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T01:04:39.106 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T01:04:40.055 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T01:04:40.724 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T01:04:47.128 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T01:04:47.728 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T01:04:48.315 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T01:04:49.094 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T01:04:49.864 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T01:04:52.681 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T01:04:53.347 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T01:04:56.852 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T01:05:09.762 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T01:05:12.029 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T01:05:13.154 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T01:05:14.454 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T01:05:15.138 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T01:05:15.771 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T01:05:16.406 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T01:05:17.091 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T01:05:17.730 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T01:05:18.472 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T01:05:18.885 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T01:05:19.299 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T01:05:19.714 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T01:05:20.079 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T01:05:20.500 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T01:05:20.955 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T01:05:21.324 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T01:05:21.692 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T01:05:22.126 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T01:05:22.498 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T01:05:22.909 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T01:05:23.310 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T01:05:23.646 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T01:05:24.090 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T01:05:24.510 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T01:05:25.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T01:05:25.496 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T01:05:25.966 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T01:05:26.394 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T01:05:26.856 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T01:05:27.290 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T01:05:27.731 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T01:05:28.143 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T01:05:28.557 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T01:05:28.958 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T01:05:31.875 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T01:05:34.766 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T01:05:35.753 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T01:05:36.213 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T01:06:37.027 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:07:38.020 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:07:38.411 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:07:38.845 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:07:39.214 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:07:39.582 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:07:41.450 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:07:42.222 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:07:43.028 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:07:43.524 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:07:44.021 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:07:44.472 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:07:44.898 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:07:45.357 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:07:45.849 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:07:46.318 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:07:46.859 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:07:47.351 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:07:47.797 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:07:48.223 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:07:48.646 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:07:49.322 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:07:50.039 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:07:50.643 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:07:51.118 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:07:51.694 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:07:52.284 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:07:52.855 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:07:53.485 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:07:54.041 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:07:54.629 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:07:55.282 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:07:55.781 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:07:56.243 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:07:56.789 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:07:57.375 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:07:57.932 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:07:58.537 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:07:59.369 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:08:01.399 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:08:02.027 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:08:02.659 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:08:03.171 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:08:04.030 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:08:04.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:08:05.285 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:08:05.927 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:08:06.330 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:08:06.728 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:08:07.126 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:08:07.530 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:08:07.987 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:08:08.402 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:08:09.003 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:08:09.372 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:08:09.736 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:08:10.132 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:08:10.495 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:08:10.902 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:08:11.393 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:08:11.758 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:08:12.122 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:08:12.489 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:08:12.852 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:08:13.286 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:08:13.733 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:08:14.231 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:08:14.662 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:08:15.035 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:08:15.494 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:08:15.945 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:08:16.390 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:08:16.823 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:08:17.226 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:08:17.629 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:08:18.024 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:08:18.517 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:08:19.018 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:08:19.495 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:08:19.880 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:08:20.326 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:08:20.747 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:08:21.231 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:08:21.679 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:08:22.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:08:22.685 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:08:23.053 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:08:23.426 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:08:23.836 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:08:34.145 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:08:34.624 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:08:44.262 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:08:44.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:08:45.284 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:08:45.683 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:08:46.124 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:08:46.540 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:08:47.025 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:08:47.453 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:08:47.904 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:08:48.302 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:08:48.758 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:08:49.212 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:08:49.617 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:08:50.189 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:08:50.686 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:08:51.152 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:08:51.571 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:08:52.223 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:08:53.386 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:08:53.725 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:08:54.184 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:08:54.599 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:08:55.112 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:08:55.651 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:08:56.116 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:08:56.849 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:08:57.558 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:08:58.067 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:09:03.415 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:09:08.634 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:09:09.051 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:09:09.658 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:09:10.786 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:09:12.023 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:09:13.095 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:09:13.818 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:09:14.577 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:09:15.310 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:09:15.739 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:09:16.737 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:09:17.758 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:09:21.456 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:09:22.454 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:09:23.159 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:09:23.776 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:09:24.239 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:09:25.001 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:09:25.682 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:09:26.385 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:09:26.979 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:09:27.660 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:09:28.346 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:09:29.121 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:09:29.861 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:09:30.106 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:09:31.081 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:09:32.016 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:09:32.744 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:09:33.343 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:09:33.945 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:09:44.377 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:09:44.676 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:09:45.413 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:09:46.017 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:09:46.472 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:09:47.065 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:09:47.086 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:09:47.086 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.086 INFO:teuthology.orchestra.run.smithi083.stdout:=============================== warnings summary =============================== 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout: import imp 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout: if boto_type is 'S3Connection': 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.087 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout: if k is 'BucketName': 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.mark.timeout(10) 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.088 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:09:47.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.090 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.091 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.092 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T01:09:47.093 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T01:09:47.093 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T01:09:47.093 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T01:09:47.093 INFO:teuthology.orchestra.run.smithi083.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T01:09:47.093 INFO:teuthology.orchestra.run.smithi083.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi083.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:09:47.093 INFO:teuthology.orchestra.run.smithi083.stdout: warnings.warn( 2024-09-12T01:09:47.093 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:09:47.093 INFO:teuthology.orchestra.run.smithi083.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:09:47.093 INFO:teuthology.orchestra.run.smithi083.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 661.86s (0:11:01) = 2024-09-12T01:09:47.221 INFO:teuthology.orchestra.run.smithi083.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:09:47.221 INFO:teuthology.orchestra.run.smithi083.stdout: py: commands succeeded 2024-09-12T01:09:47.221 INFO:teuthology.orchestra.run.smithi083.stdout: congratulations :) 2024-09-12T01:09:47.239 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:09:47.239 DEBUG:teuthology.orchestra.run.smithi083:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:09:47.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:09:47.352 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:09:47.352 DEBUG:teuthology.orchestra.run.smithi083:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:09:47.381 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:09:47.382 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:09:47.571 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:09:47.583 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:09:47.584 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:09:47.584 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:09:47.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:09:47.613 INFO:teuthology.orchestra.run.smithi083.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:09:47.613 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:09:47.682 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:09:47.682 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:09:47.751 INFO:tasks.workunit:timeout=3h 2024-09-12T01:09:47.751 INFO:tasks.workunit:cleanup=True 2024-09-12T01:09:47.752 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:09:47.821 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:10:33.157 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:10:33.157 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:33.157 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:10:33.157 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:10:33.157 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:33.158 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:10:33.161 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:10:33.231 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:10:33.233 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:10:33.233 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:10:33.280 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:10:33.329 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:10:33.368 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:10:33.369 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:10:33.370 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:10:33.407 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:10:33.411 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-12T01:10:33.411 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:10:33.480 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:10:33.481 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:10:33.481 DEBUG:teuthology.orchestra.run.smithi083:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:10:33.553 INFO:tasks.workunit.client.0.smithi083.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:10:33.553 INFO:tasks.workunit.client.0.smithi083.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:10:33.554 INFO:tasks.workunit.client.0.smithi083.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:10:35.947 INFO:tasks.workunit.client.0.smithi083.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ deactivate nondestructive 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ export VIRTUAL_ENV 2024-09-12T01:10:35.948 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:10:35.949 INFO:tasks.workunit.client.0.smithi083.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:10:35.949 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PATH 2024-09-12T01:10:35.949 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n '' ']' 2024-09-12T01:10:35.950 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -z '' ']' 2024-09-12T01:10:35.950 INFO:tasks.workunit.client.0.smithi083.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:10:35.950 INFO:tasks.workunit.client.0.smithi083.stderr:++ PS1='(rgw) ' 2024-09-12T01:10:35.950 INFO:tasks.workunit.client.0.smithi083.stderr:++ export PS1 2024-09-12T01:10:35.950 INFO:tasks.workunit.client.0.smithi083.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:10:35.950 INFO:tasks.workunit.client.0.smithi083.stderr:++ hash -r 2024-09-12T01:10:35.950 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install pip --upgrade 2024-09-12T01:10:36.175 INFO:tasks.workunit.client.0.smithi083.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T01:10:36.351 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting pip 2024-09-12T01:10:36.356 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:10:36.401 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: pip 2024-09-12T01:10:36.401 INFO:tasks.workunit.client.0.smithi083.stdout: Attempting uninstall: pip 2024-09-12T01:10:36.401 INFO:tasks.workunit.client.0.smithi083.stdout: Found existing installation: pip 21.3.1 2024-09-12T01:10:36.551 INFO:tasks.workunit.client.0.smithi083.stdout: Uninstalling pip-21.3.1: 2024-09-12T01:10:36.557 INFO:tasks.workunit.client.0.smithi083.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T01:10:37.278 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed pip-24.2 2024-09-12T01:10:37.327 INFO:tasks.workunit.client.0.smithi083.stderr:+ pip install boto3 2024-09-12T01:10:38.207 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting boto3 2024-09-12T01:10:38.208 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:10:38.739 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:10:38.741 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:10:38.788 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:10:38.789 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:10:38.842 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:10:38.844 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:10:38.894 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:10:38.895 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:10:38.971 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:10:38.972 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T01:10:39.125 INFO:tasks.workunit.client.0.smithi083.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:10:39.126 INFO:tasks.workunit.client.0.smithi083.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:10:39.131 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:10:39.132 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:10:39.141 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:10:39.142 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:10:39.144 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:10:39.145 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T01:10:39.146 INFO:tasks.workunit.client.0.smithi083.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:10:39.220 INFO:tasks.workunit.client.0.smithi083.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:10:40.265 INFO:tasks.workunit.client.0.smithi083.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T01:10:40.382 INFO:tasks.workunit.client.0.smithi083.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:10:40.504 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:10:40.538 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:40.539 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:40.575 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.576+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.578+0000 7fc45a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.578+0000 7fc45a126800 20 realm 2024-09-12T01:10:40.577 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.578+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.578+0000 7fc45a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.578+0000 7fc45a126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:40.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.578+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.579+0000 7fc45a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.578 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.579+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.579+0000 7fc45a126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:40.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.579+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.580+0000 7fc45a126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:40.579 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.580+0000 7fc45a126800 20 searching for the correct realm 2024-09-12T01:10:40.583 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.584+0000 7fc4565b6640 0 -- 172.21.15.83:0/982897713 >> [v2:172.21.15.83:6800/1337722402,v1:172.21.15.83:6801/1337722402] conn(0x7fc44007dbf0 msgr2=0x7fc440056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:40.586 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.588+0000 7fc455db5640 0 -- 172.21.15.83:0/982897713 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fc4500a40e0 msgr2=0x7fc450013a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:40.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.592+0000 7fc45a126800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T01:10:40.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.592+0000 7fc45a126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:40.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.592+0000 7fc45a126800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T01:10:40.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.592+0000 7fc45a126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:40.591 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.592+0000 7fc45a126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:40.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.592+0000 7fc45a126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:40.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.592+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.592+0000 7fc45a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.592 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.592+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:40.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:40.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 20 zone default found 2024-09-12T01:10:40.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 4 Realm: () 2024-09-12T01:10:40.593 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 20 zonegroup default 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.593+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.594+0000 7fc45a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.594+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.594+0000 7fc45a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.594+0000 7fc45a126800 20 started sync module instance, tier type = 2024-09-12T01:10:40.594 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.594+0000 7fc45a126800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T01:10:40.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.603+0000 7fc45a126800 20 add_watcher() i=0 2024-09-12T01:10:40.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.603+0000 7fc45a126800 20 add_watcher() i=1 2024-09-12T01:10:40.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.603+0000 7fc45a126800 20 add_watcher() i=2 2024-09-12T01:10:40.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.603+0000 7fc45a126800 20 add_watcher() i=3 2024-09-12T01:10:40.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.603+0000 7fc45a126800 20 add_watcher() i=4 2024-09-12T01:10:40.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.603+0000 7fc45a126800 20 add_watcher() i=5 2024-09-12T01:10:40.602 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.603+0000 7fc45a126800 20 add_watcher() i=6 2024-09-12T01:10:40.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.604+0000 7fc45a126800 20 add_watcher() i=7 2024-09-12T01:10:40.603 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.604+0000 7fc45a126800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:40.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.606+0000 7fc3077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:40.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.606+0000 7fc45a126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:40.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.606+0000 7fc45a126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:40.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.606+0000 7fc45a126800 5 note: GC not initialized 2024-09-12T01:10:40.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc3067fc640 20 reqs_thread_entry: start 2024-09-12T01:10:40.606 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc45a126800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:40.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc45a126800 20 Filter name: none 2024-09-12T01:10:40.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc27bfff640 20 reqs_thread_entry: start 2024-09-12T01:10:40.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc45a126800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:10:40.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc45a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc45a126800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:10:40.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc45a126800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:10:40.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc45a126800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:10:40.607 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.607+0000 7fc45a126800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.608+0000 7fc45a126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.608+0000 7fc45a126800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:10:40.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.608+0000 7fc45a126800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:10:40.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.608+0000 7fc45a126800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:10:40.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.608+0000 7fc45a126800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:10:40.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.609+0000 7fc45a126800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:10:40.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.609+0000 7fc45a126800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:10:40.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.609+0000 7fc45a126800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:10:40.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.609+0000 7fc3397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367994 cookie 93892994403264 notifier 8741 bl.length()=613 2024-09-12T01:10:40.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.609+0000 7fc3397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:10:40.609 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.609+0000 7fc3397fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:10:40.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.611+0000 7fc45a126800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:10:40.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.611+0000 7fc45a126800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:10:40.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.611+0000 7fc45a126800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:10:40.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.611+0000 7fc338ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367995 cookie 93892994401120 notifier 8741 bl.length()=191 2024-09-12T01:10:40.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.611+0000 7fc338ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:10:40.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.611+0000 7fc338ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:10:40.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.612+0000 7fc3077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:40.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.614+0000 7fc45a126800 20 remove_watcher() i=0 2024-09-12T01:10:40.613 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.614+0000 7fc45a126800 2 removed watcher, disabling cache 2024-09-12T01:10:40.614 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.615+0000 7fc45a126800 20 remove_watcher() i=1 2024-09-12T01:10:40.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.616+0000 7fc45a126800 20 remove_watcher() i=2 2024-09-12T01:10:40.616 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.617+0000 7fc45a126800 20 remove_watcher() i=3 2024-09-12T01:10:40.617 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.619+0000 7fc45a126800 20 remove_watcher() i=4 2024-09-12T01:10:40.618 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.620+0000 7fc45a126800 20 remove_watcher() i=5 2024-09-12T01:10:40.619 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.621+0000 7fc45a126800 20 remove_watcher() i=6 2024-09-12T01:10:40.620 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.622+0000 7fc45a126800 20 remove_watcher() i=7 2024-09-12T01:10:40.760 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:40.760 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:40.806 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:40.806 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:40.852 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:40.852 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:40.863 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:40.864 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:40.867 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:10:40.867 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:40.869 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:40.869 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:40.879 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:40.879 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:40.886 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:40.886 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:40.897 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:10:40.925 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:40.925 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:40.962 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.963+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.965+0000 7f35e6544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.965+0000 7f35e6544800 20 realm 2024-09-12T01:10:40.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.965+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.966+0000 7f35e6544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.966+0000 7f35e6544800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:40.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.966+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.966+0000 7f35e6544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:40.965 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.966+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.966+0000 7f35e6544800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:40.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.966+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:40.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.967+0000 7f35e6544800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:40.966 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.967+0000 7f35e6544800 20 searching for the correct realm 2024-09-12T01:10:40.968 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:40.969+0000 7f35e22f4640 0 -- 172.21.15.83:0/3232527527 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f35d40adb90 msgr2=0x7f35d40ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:41.174 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.175+0000 7f35e22f4640 0 -- 172.21.15.83:0/3232527527 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f35d0003bd0 msgr2=0x7f35dc010440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:41.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.382+0000 7f35e6544800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T01:10:41.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.382+0000 7f35e6544800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:41.381 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.382+0000 7f35e6544800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T01:10:41.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.382+0000 7f35e6544800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:41.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.382+0000 7f35e6544800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:41.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.382+0000 7f35e6544800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:41.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.382+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:41.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:41.382 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:41.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:41.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:41.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:41.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 20 zone default found 2024-09-12T01:10:41.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 4 Realm: () 2024-09-12T01:10:41.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T01:10:41.383 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 20 zonegroup default 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.383+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.384+0000 7f35e6544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.384+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.384+0000 7f35e6544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.384+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.384+0000 7f35e6544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.384+0000 7f35e6544800 20 started sync module instance, tier type = 2024-09-12T01:10:41.384 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.384+0000 7f35e6544800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T01:10:41.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.394+0000 7f35e6544800 20 add_watcher() i=0 2024-09-12T01:10:41.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.394+0000 7f35e6544800 20 add_watcher() i=1 2024-09-12T01:10:41.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.394+0000 7f35e6544800 20 add_watcher() i=2 2024-09-12T01:10:41.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.394+0000 7f35e6544800 20 add_watcher() i=3 2024-09-12T01:10:41.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.394+0000 7f35e6544800 20 add_watcher() i=4 2024-09-12T01:10:41.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.394+0000 7f35e6544800 20 add_watcher() i=5 2024-09-12T01:10:41.393 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.394+0000 7f35e6544800 20 add_watcher() i=6 2024-09-12T01:10:41.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.395+0000 7f35e6544800 20 add_watcher() i=7 2024-09-12T01:10:41.394 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.395+0000 7f35e6544800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:41.396 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.397+0000 7f3498fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:41.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.398+0000 7f35e6544800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:41.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.398+0000 7f35e6544800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:41.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.398+0000 7f35e6544800 5 note: GC not initialized 2024-09-12T01:10:41.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.398+0000 7f34137fe640 20 reqs_thread_entry: start 2024-09-12T01:10:41.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.398+0000 7f35e6544800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:41.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.398+0000 7f35e6544800 20 Filter name: none 2024-09-12T01:10:41.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.398+0000 7f34117fa640 20 reqs_thread_entry: start 2024-09-12T01:10:41.397 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.398+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:41.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.399+0000 7f35e6544800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:10:41.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.399+0000 7f35e6544800 20 rados->read ofs=0 len=0 2024-09-12T01:10:41.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.399+0000 7f35e6544800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:10:41.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.399+0000 7f35e6544800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:10:41.398 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.399+0000 7f35e6544800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:10:41.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.399+0000 7f35e6544800 20 INFO: main: starting shard=0 2024-09-12T01:10:41.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.399+0000 7f35e6544800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.783.0 2024-09-12T01:10:41.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.400+0000 7f35e6544800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:10:41.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.400+0000 7f35e6544800 20 INFO: main: done 2024-09-12T01:10:41.399 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.401+0000 7f3498fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:41.401 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.403+0000 7f35e6544800 20 remove_watcher() i=0 2024-09-12T01:10:41.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.403+0000 7f35e6544800 2 removed watcher, disabling cache 2024-09-12T01:10:41.402 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.404+0000 7f35e6544800 20 remove_watcher() i=1 2024-09-12T01:10:41.404 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.405+0000 7f35e6544800 20 remove_watcher() i=2 2024-09-12T01:10:41.405 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.406+0000 7f35e6544800 20 remove_watcher() i=3 2024-09-12T01:10:41.406 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.407+0000 7f35e6544800 20 remove_watcher() i=4 2024-09-12T01:10:41.407 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.408+0000 7f35e6544800 20 remove_watcher() i=5 2024-09-12T01:10:41.408 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.409+0000 7f35e6544800 20 remove_watcher() i=6 2024-09-12T01:10:41.409 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.411+0000 7f35e6544800 20 remove_watcher() i=7 2024-09-12T01:10:41.421 INFO:tasks.workunit.client.0.smithi083.stderr:rados -p default.rgw.buckets.data ls | grep 1b485ecd-a06f-4db5-b54b-2a326d746826 2024-09-12T01:10:41.443 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:41.443 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:41.521 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:41.522+0000 7ff4624ea640 0 -- 172.21.15.83:0/3787450877 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7ff45c02eb20 msgr2=0x7ff45c02ef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:10:41.535 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:10:41.535 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:41.537 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:10:42.931 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:42.931 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:42.941 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:10:43.342 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:10:43.370 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:43.370 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:43.608 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.610+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:43.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.612+0000 7fbb0951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:43.610 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.612+0000 7fbb0951f800 20 realm 2024-09-12T01:10:43.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.612+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:43.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.612+0000 7fbb0951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:43.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.612+0000 7fbb0951f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:43.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.612+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:43.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.612+0000 7fbb0951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:43.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.612+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:43.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.613+0000 7fbb0951f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:43.611 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.613+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:43.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.613+0000 7fbb0951f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:43.612 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.613+0000 7fbb0951f800 20 searching for the correct realm 2024-09-12T01:10:43.615 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.616+0000 7fbafffff640 0 -- 172.21.15.83:0/949776391 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7fbaf00740b0 msgr2=0x7fbaf004b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:43.820 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:43.821+0000 7fbb0520c640 0 -- 172.21.15.83:0/949776391 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7fbb0002f040 msgr2=0x7fbb00030430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:44.028 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.029+0000 7fbb0951f800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.029+0000 7fbb0951f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.029+0000 7fbb0951f800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.029+0000 7fbb0951f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.029+0000 7fbb0951f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.029+0000 7fbb0951f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.029+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:44.029 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:44.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:44.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 20 zone default found 2024-09-12T01:10:44.030 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 4 Realm: () 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 20 zonegroup default 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.030+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.031+0000 7fbb0951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.031+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.031+0000 7fbb0951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.031+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.031+0000 7fbb0951f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.031+0000 7fbb0951f800 20 started sync module instance, tier type = 2024-09-12T01:10:44.031 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.031+0000 7fbb0951f800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T01:10:44.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.042+0000 7fbb0951f800 20 add_watcher() i=0 2024-09-12T01:10:44.040 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.042+0000 7fbb0951f800 20 add_watcher() i=1 2024-09-12T01:10:44.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.042+0000 7fbb0951f800 20 add_watcher() i=2 2024-09-12T01:10:44.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.042+0000 7fbb0951f800 20 add_watcher() i=3 2024-09-12T01:10:44.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.042+0000 7fbb0951f800 20 add_watcher() i=4 2024-09-12T01:10:44.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.042+0000 7fbb0951f800 20 add_watcher() i=5 2024-09-12T01:10:44.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.042+0000 7fbb0951f800 20 add_watcher() i=6 2024-09-12T01:10:44.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.043+0000 7fbb0951f800 20 add_watcher() i=7 2024-09-12T01:10:44.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.043+0000 7fbb0951f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:44.043 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.045+0000 7fb9bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:44.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.045+0000 7fbb0951f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:44.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.045+0000 7fbb0951f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:44.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.045+0000 7fbb0951f800 5 note: GC not initialized 2024-09-12T01:10:44.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.045+0000 7fb9bafe5640 20 reqs_thread_entry: start 2024-09-12T01:10:44.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.046+0000 7fbb0951f800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:44.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.046+0000 7fbb0951f800 20 Filter name: none 2024-09-12T01:10:44.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.046+0000 7fb9b8fe1640 20 reqs_thread_entry: start 2024-09-12T01:10:44.045 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.046+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:44.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.046+0000 7fbb0951f800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:10:44.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.046+0000 7fbb0951f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:44.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.047+0000 7fbb0951f800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:10:44.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.047+0000 7fbb0951f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:10:44.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.047+0000 7fbb0951f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:10:44.046 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.047+0000 7fbb0951f800 20 INFO: main: starting shard=0 2024-09-12T01:10:44.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.047+0000 7fbb0951f800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.783.0 2024-09-12T01:10:44.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.047+0000 7fbb0951f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:10:44.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.047+0000 7fbb0951f800 20 INFO: main: done 2024-09-12T01:10:44.047 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.048+0000 7fb9bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:44.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.050+0000 7fbb0951f800 20 remove_watcher() i=0 2024-09-12T01:10:44.049 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.050+0000 7fbb0951f800 2 removed watcher, disabling cache 2024-09-12T01:10:44.050 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.051+0000 7fbb0951f800 20 remove_watcher() i=1 2024-09-12T01:10:44.051 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.053+0000 7fbb0951f800 20 remove_watcher() i=2 2024-09-12T01:10:44.053 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.055+0000 7fbb0951f800 20 remove_watcher() i=3 2024-09-12T01:10:44.054 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.056+0000 7fbb0951f800 20 remove_watcher() i=4 2024-09-12T01:10:44.056 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.057+0000 7fbb0951f800 20 remove_watcher() i=5 2024-09-12T01:10:44.057 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.058+0000 7fbb0951f800 20 remove_watcher() i=6 2024-09-12T01:10:44.058 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.059+0000 7fbb0951f800 20 remove_watcher() i=7 2024-09-12T01:10:44.070 INFO:tasks.workunit.client.0.smithi083.stderr:rados -p default.rgw.buckets.data ls | grep 68d3bb6d-def7-4557-a645-5d54eeb2a182 2024-09-12T01:10:44.093 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:44.093 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:44.171 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:44.172+0000 7f1f07f05640 0 -- 172.21.15.83:0/1338437321 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x7f1f0002f040 msgr2=0x7f1f0002f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:44.183 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:10:44.183 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:44.185 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:44.185 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:44.191 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:44.191 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:44.200 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:44.200 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:44.204 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:10:45.594 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:45.594 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:45.649 INFO:tasks.workunit.client.0.smithi083.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:10:45.650 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:10:46.046 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:46.046 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:46.054 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:46.054 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:46.056 INFO:tasks.workunit.client.0.smithi083.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:10:46.057 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-12T01:10:46.058 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:46.058 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:46.103 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:46.103 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:46.147 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:46.147 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:46.157 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:10:47.547 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:47.548 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:47.551 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:47.551 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:49.567 INFO:tasks.workunit.client.0.smithi083.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:10:49.968 INFO:tasks.workunit.client.0.smithi083.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:10:49.998 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:49.998 INFO:tasks.workunit.client.0.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:50.035 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.036+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.038+0000 7f2e05924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:50.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.038+0000 7f2e05924800 20 realm 2024-09-12T01:10:50.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.038+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.038+0000 7f2e05924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:50.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.038+0000 7f2e05924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:50.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.038+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.038+0000 7f2e05924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:50.037 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.038+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.039+0000 7f2e05924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:50.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.039+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.039+0000 7f2e05924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:50.038 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.039+0000 7f2e05924800 20 searching for the correct realm 2024-09-12T01:10:50.041 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.043+0000 7f2dfbfff640 0 -- 172.21.15.83:0/59446507 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7f2dec0be240 msgr2=0x7f2dec0c69d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:10:50.248 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.249+0000 7f2e01d57640 0 -- 172.21.15.83:0/59446507 >> [v2:172.21.15.120:6808/566663973,v1:172.21.15.120:6809/566663973] conn(0x55df2011bcf0 msgr2=0x55df2011e190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:50.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.253+0000 7f2e05924800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T01:10:50.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.253+0000 7f2e05924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:50.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.253+0000 7f2e05924800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T01:10:50.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.253+0000 7f2e05924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:50.252 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.253+0000 7f2e05924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:50.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.253+0000 7f2e05924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:50.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.253+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:50.253 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 zone default found 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 4 Realm: () 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 zonegroup default 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.254 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:50.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.254+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.255+0000 7f2e05924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:50.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.255+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.255+0000 7f2e05924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:50.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.255+0000 7f2e05924800 20 started sync module instance, tier type = 2024-09-12T01:10:50.255 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.255+0000 7f2e05924800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T01:10:50.263 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.265+0000 7f2e05924800 20 add_watcher() i=0 2024-09-12T01:10:50.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.265+0000 7f2e05924800 20 add_watcher() i=1 2024-09-12T01:10:50.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.265+0000 7f2e05924800 20 add_watcher() i=2 2024-09-12T01:10:50.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.265+0000 7f2e05924800 20 add_watcher() i=3 2024-09-12T01:10:50.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.265+0000 7f2e05924800 20 add_watcher() i=4 2024-09-12T01:10:50.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.265+0000 7f2e05924800 20 add_watcher() i=5 2024-09-12T01:10:50.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.265+0000 7f2e05924800 20 add_watcher() i=6 2024-09-12T01:10:50.264 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.266+0000 7f2e05924800 20 add_watcher() i=7 2024-09-12T01:10:50.265 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.266+0000 7f2e05924800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:50.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.268+0000 7f2cb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:50.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.268+0000 7f2e05924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:50.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.268+0000 7f2e05924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:50.267 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.268+0000 7f2e05924800 5 note: GC not initialized 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.268+0000 7f2cb67e4640 20 reqs_thread_entry: start 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.268+0000 7f2e05924800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.268+0000 7f2e05924800 20 Filter name: none 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.268+0000 7f2c27fff640 20 reqs_thread_entry: start 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.269+0000 7f2e05924800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.269+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.269+0000 7f2e05924800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.269+0000 7f2e05924800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.269+0000 7f2e05924800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:10:50.268 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.269+0000 7f2e05924800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.783 : miss 2024-09-12T01:10:50.269 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.269+0000 7f2e05924800 20 rados->read ofs=0 len=0 2024-09-12T01:10:50.272 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.270+0000 7f2e05924800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.270+0000 7f2e05924800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.783 info.flags=0x17 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.270+0000 7f2e05924800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.783 to cache LRU end 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.270+0000 7f2e05924800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.270+0000 7f2e05924800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.270+0000 7f2e05924800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:ad4424e4-de7c-4376-b125-e717016a3484.4511.783 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.270+0000 7f2e05924800 20 bucket index object: :.dir.ad4424e4-de7c-4376-b125-e717016a3484.4511.783.0 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.270+0000 7f2e05924800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.270+0000 7f2e05924800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.271+0000 7f2cb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.273+0000 7f2e05924800 20 remove_watcher() i=0 2024-09-12T01:10:50.273 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.273+0000 7f2e05924800 2 removed watcher, disabling cache 2024-09-12T01:10:50.274 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.274+0000 7f2e05924800 20 remove_watcher() i=1 2024-09-12T01:10:50.275 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.276+0000 7f2e05924800 20 remove_watcher() i=2 2024-09-12T01:10:50.276 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.277+0000 7f2e05924800 20 remove_watcher() i=3 2024-09-12T01:10:50.277 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.278+0000 7f2e05924800 20 remove_watcher() i=4 2024-09-12T01:10:50.278 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.279+0000 7f2e05924800 20 remove_watcher() i=5 2024-09-12T01:10:50.279 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.280+0000 7f2e05924800 20 remove_watcher() i=6 2024-09-12T01:10:50.280 INFO:tasks.workunit.client.0.smithi083.stderr:2024-09-12T01:10:50.281+0000 7f2e05924800 20 remove_watcher() i=7 2024-09-12T01:10:50.290 INFO:tasks.workunit.client.0.smithi083.stderr:Deleting bucket versioning-bucket 2024-09-12T01:10:50.292 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:50.292 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:50.297 INFO:tasks.workunit.client.0.smithi083.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:10:50.297 INFO:tasks.workunit.client.0.smithi083.stderr: warnings.warn( 2024-09-12T01:10:50.310 INFO:tasks.workunit.client.0.smithi083.stderr:Completed bucket versioning tests 2024-09-12T01:10:50.310 INFO:tasks.workunit.client.0.smithi083.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T01:10:50.310 INFO:tasks.workunit.client.0.smithi083.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T01:10:50.310 INFO:tasks.workunit.client.0.smithi083.stdout:connected to https://localhost:443 2024-09-12T01:10:50.371 INFO:tasks.workunit.client.0.smithi083.stderr:+ deactivate 2024-09-12T01:10:50.371 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T01:10:50.371 INFO:tasks.workunit.client.0.smithi083.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ export PATH 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ hash -r 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' -n '' ']' 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ unset -f deactivate 2024-09-12T01:10:50.372 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo OK. 2024-09-12T01:10:50.373 INFO:tasks.workunit.client.0.smithi083.stdout:OK. 2024-09-12T01:10:50.373 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:10:50.374 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:10:50.455 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:10:50.455 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:10:50.828 DEBUG:teuthology.parallel:result is None 2024-09-12T01:10:50.828 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:10:50.867 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:10:50.868 DEBUG:teuthology.orchestra.run.smithi083:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:10:50.937 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:10:50.937 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:10:50.951 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:10:51.059 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:10:51.060 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:10:51.060 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:10:51.123 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:10:51.123 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:10:51.181 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:51.181 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:51.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.218+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.220+0000 7f0a55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:51.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.220+0000 7f0a55575800 20 realm 2024-09-12T01:10:51.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.220+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.220+0000 7f0a55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:51.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.220+0000 7f0a55575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:51.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.220+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.220+0000 7f0a55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:51.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.220+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.221+0000 7f0a55575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:51.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.221+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.221+0000 7f0a55575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:51.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.221+0000 7f0a55575800 20 searching for the correct realm 2024-09-12T01:10:51.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.224+0000 7f0a5285e640 0 -- 172.21.15.83:0/3027855554 >> [v2:172.21.15.120:6800/3447039892,v1:172.21.15.120:6801/3447039892] conn(0x5560464fe890 msgr2=0x556046500d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:51.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.227+0000 7f0a5305f640 0 -- 172.21.15.83:0/3027855554 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7f0a4c02a040 msgr2=0x7f0a4c00e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:51.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.435+0000 7f0a55575800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.435+0000 7f0a55575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.435+0000 7f0a55575800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.435+0000 7f0a55575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.435+0000 7f0a55575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.435+0000 7f0a55575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.435+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.435+0000 7f0a55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:51.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 20 zone default found 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 4 Realm: () 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 20 zonegroup default 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.436+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.437+0000 7f0a55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:51.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.437+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.437+0000 7f0a55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:51.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.437+0000 7f0a55575800 20 started sync module instance, tier type = 2024-09-12T01:10:51.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.437+0000 7f0a55575800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T01:10:51.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.447+0000 7f0a55575800 20 add_watcher() i=0 2024-09-12T01:10:51.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.447+0000 7f0a55575800 20 add_watcher() i=1 2024-09-12T01:10:51.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.447+0000 7f0a55575800 20 add_watcher() i=2 2024-09-12T01:10:51.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.447+0000 7f0a55575800 20 add_watcher() i=3 2024-09-12T01:10:51.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.447+0000 7f0a55575800 20 add_watcher() i=4 2024-09-12T01:10:51.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.447+0000 7f0a55575800 20 add_watcher() i=5 2024-09-12T01:10:51.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.447+0000 7f0a55575800 20 add_watcher() i=6 2024-09-12T01:10:51.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.448+0000 7f0a55575800 20 add_watcher() i=7 2024-09-12T01:10:51.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.448+0000 7f0a55575800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:51.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.450+0000 7f0909fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:51.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.450+0000 7f0a55575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:51.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.450+0000 7f0a55575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:51.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.488+0000 7f0908fe1640 20 reqs_thread_entry: start 2024-09-12T01:10:51.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.488+0000 7f0a55575800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:51.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.488+0000 7f0a55575800 20 Filter name: none 2024-09-12T01:10:51.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.489+0000 7f08827fc640 20 reqs_thread_entry: start 2024-09-12T01:10:51.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.489+0000 7f0a55575800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:10:51.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.489+0000 7f0a55575800 20 rados->read ofs=0 len=0 2024-09-12T01:10:51.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.489+0000 7f0a55575800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:10:51.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.489+0000 7f0a55575800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:10:51.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.489+0000 7f0a55575800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:10:51.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.489+0000 7f0a55575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:10:51.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.490+0000 7f0a55575800 10 removing key index: KTOXETYCNZSTGHETGNAA 2024-09-12T01:10:51.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.491+0000 7f0a55575800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:KTOXETYCNZSTGHETGNAA, ofs0, ns] 2024-09-12T01:10:51.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.491+0000 7f0936ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367625 cookie 93871984877904 notifier 8843 bl.length()=170 2024-09-12T01:10:51.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.491+0000 7f0a55575800 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:10:51.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.492+0000 7f0a55575800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:10:51.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.493+0000 7f09367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366393 cookie 93871984882640 notifier 8843 bl.length()=181 2024-09-12T01:10:51.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.493+0000 7f0a55575800 10 removing user buckets index 2024-09-12T01:10:51.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.494+0000 7f0a55575800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:10:51.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.495+0000 7f0936ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367998 cookie 93871984893872 notifier 8843 bl.length()=172 2024-09-12T01:10:51.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.495+0000 7f0a55575800 10 removing user index: tester.client.0 2024-09-12T01:10:51.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.496+0000 7f0a55575800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:10:51.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.496+0000 7f0a55575800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:10:51.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.496+0000 7f09367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367999 cookie 93871984889248 notifier 8843 bl.length()=164 2024-09-12T01:10:51.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.498+0000 7f0909fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:51.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.500+0000 7f0a55575800 20 remove_watcher() i=0 2024-09-12T01:10:51.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.500+0000 7f0a55575800 2 removed watcher, disabling cache 2024-09-12T01:10:51.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.501+0000 7f0a55575800 20 remove_watcher() i=1 2024-09-12T01:10:51.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.502+0000 7f0a55575800 20 remove_watcher() i=2 2024-09-12T01:10:51.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.503+0000 7f0a55575800 20 remove_watcher() i=3 2024-09-12T01:10:51.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.504+0000 7f0a55575800 20 remove_watcher() i=4 2024-09-12T01:10:51.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.505+0000 7f0a55575800 20 remove_watcher() i=5 2024-09-12T01:10:51.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.506+0000 7f0a55575800 20 remove_watcher() i=6 2024-09-12T01:10:51.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:10:51.507+0000 7f0a55575800 20 remove_watcher() i=7 2024-09-12T01:10:51.516 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:10:51.526 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:10:51.574 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:10:51.631 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:10:51.641 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:10:51.641 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:10:51.642 INFO:tasks.rgw.client.0.smithi083.stdout:2024-09-12T01:10:51.643+0000 7fa30a3ec640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45642) UID: 0 2024-09-12T01:10:51.642 INFO:tasks.rgw.client.0.smithi083.stdout:2024-09-12T01:10:51.643+0000 7fa30dc47880 -1 shutting down 2024-09-12T01:11:22.149 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:11:22.150 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:11:22.185 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:11:22.269 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:11:22.350 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:11:22.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:11:22.350 DEBUG:teuthology.orchestra.run.smithi083:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:11:22.450 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:11:22.450 INFO:teuthology.orchestra.run.smithi083.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:11:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.484+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.486+0000 7ff634d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:11:22.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.486+0000 7ff634d2c800 20 realm 2024-09-12T01:11:22.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.486+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.486+0000 7ff634d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:11:22.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.486+0000 7ff634d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:11:22.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.486+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.486+0000 7ff634d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:11:22.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.486+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.487+0000 7ff634d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:11:22.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.487+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.487+0000 7ff634d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:11:22.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.487+0000 7ff634d2c800 20 searching for the correct realm 2024-09-12T01:11:22.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.491+0000 7ff628160640 0 -- 172.21.15.83:0/2086660974 >> [v2:172.21.15.120:6824/1608674593,v1:172.21.15.120:6825/1608674593] conn(0x7ff618001e90 msgr2=0x7ff6180a3850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:11:22.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.495+0000 7ff630961640 0 -- 172.21.15.83:0/2086660974 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff62c04db40 msgr2=0x7ff62c056980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:11:22.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 RGWRados::pool_iterate: got zonegroup_info.6ae48c5c-b0a1-4670-983d-599c5937eb05 2024-09-12T01:11:22.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:11:22.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 RGWRados::pool_iterate: got zone_info.ad4424e4-de7c-4376-b125-e717016a3484 2024-09-12T01:11:22.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:11:22.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:11:22.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:11:22.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:11:22.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:11:22.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.499+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 20 zone default found 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 4 Realm: () 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 4 ZoneGroup: default (6ae48c5c-b0a1-4670-983d-599c5937eb05) 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 4 Zone: default (ad4424e4-de7c-4376-b125-e717016a3484) 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 20 zonegroup default 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:11:22.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.500+0000 7ff634d2c800 20 rados->read ofs=0 len=0 2024-09-12T01:11:22.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.501+0000 7ff634d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:11:22.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.501+0000 7ff634d2c800 20 started sync module instance, tier type = 2024-09-12T01:11:22.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.501+0000 7ff634d2c800 20 started zone id=ad4424e4-de7c-4376-b125-e717016a3484 (name=default) with tier type = 2024-09-12T01:11:22.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.510+0000 7ff634d2c800 20 add_watcher() i=0 2024-09-12T01:11:22.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.510+0000 7ff634d2c800 20 add_watcher() i=1 2024-09-12T01:11:22.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.510+0000 7ff634d2c800 20 add_watcher() i=2 2024-09-12T01:11:22.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.510+0000 7ff634d2c800 20 add_watcher() i=3 2024-09-12T01:11:22.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.510+0000 7ff634d2c800 20 add_watcher() i=4 2024-09-12T01:11:22.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.510+0000 7ff634d2c800 20 add_watcher() i=5 2024-09-12T01:11:22.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.510+0000 7ff634d2c800 20 add_watcher() i=6 2024-09-12T01:11:22.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.511+0000 7ff634d2c800 20 add_watcher() i=7 2024-09-12T01:11:22.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.511+0000 7ff634d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T01:11:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.512+0000 7ff4e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:11:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.512+0000 7ff634d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:11:22.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.512+0000 7ff634d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:11:22.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.549+0000 7ff4e67e4640 20 reqs_thread_entry: start 2024-09-12T01:11:22.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.550+0000 7ff634d2c800 20 init_complete bucket index max shards: 1 2024-09-12T01:11:22.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.550+0000 7ff634d2c800 20 Filter name: none 2024-09-12T01:11:22.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.550+0000 7ff4df7fe640 20 reqs_thread_entry: start 2024-09-12T01:11:22.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.550+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:11:22.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.551+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:22.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.552+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41099' 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2043301053212529391', time=2024-09-12T02:58:53.452857+0000, chain.objs.size()=3 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.deNannAWOHTJE_WtvTm37C0TAVHRMql_0 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.deNannAWOHTJE_WtvTm37C0TAVHRMql_1 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.deNannAWOHTJE_WtvTm37C0TAVHRMql_2 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_EtEgomMkwgB8ISaVJJKfaWW-sLSrKhH', time=2024-09-12T02:58:56.224233+0000, chain.objs.size()=1 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.164__shadow_.NkkAwLRdQhYIa6xeEuQcOYKbYfxgjyQ_0 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.974405208471067461', time=2024-09-12T03:00:38.435831+0000, chain.objs.size()=1 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.238__shadow_.Y4k0wDo-Hyy1q_uhMDBuVevgqXaN-WD_0 2024-09-12T01:11:22.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8073433888733174245', time=2024-09-12T03:00:39.226350+0000, chain.objs.size()=1 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.239__shadow_.VpY5t9MIli0xCMrjnT5sqYhDmgT984i_0 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7272939780325575737', time=2024-09-12T03:00:41.068140+0000, chain.objs.size()=1 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.243__shadow_.Jhj4Pk7Zra4SqvKn9RDCQktsWDEeDbk_0 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5070091226780367671', time=2024-09-12T03:00:43.170547+0000, chain.objs.size()=1 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.246__shadow_.2sY1_fkMBIpyp_xZOwVMv9IFMgsLAak_0 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6141047132199019248', time=2024-09-12T03:00:46.455971+0000, chain.objs.size()=1 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.253__shadow_.1qqs4QaZ7h96na7hQkn0u64OIxBMV7i_0 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11559915200367750051', time=2024-09-12T03:00:49.296516+0000, chain.objs.size()=1 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.259__shadow_.sgRIFuwS03SYL7NYbMVNl3tuWLy22ES_0 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14274137703045011472', time=2024-09-12T03:00:50.681878+0000, chain.objs.size()=1 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.262__shadow_.JvDwbzG33euKHAjGDGDl0aNbwLcvxTM_0 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8375500456355462363', time=2024-09-12T03:00:58.957900+0000, chain.objs.size()=1 2024-09-12T01:11:22.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VMm-gWjMiHLQGKKzRDpVjvSnaZ_-U11_0 2024-09-12T01:11:22.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11791751536681183107', time=2024-09-12T03:00:59.025055+0000, chain.objs.size()=1 2024-09-12T01:11:22.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.otF8sOzkdAi-FnuWx6Vci_wx1sD4TRa_0 2024-09-12T01:11:22.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10683461537749883496', time=2024-09-12T03:00:59.292621+0000, chain.objs.size()=1 2024-09-12T01:11:22.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.M8-VLelrVNd3gnKCQ8MvDEjaeoU0WNQ_0 2024-09-12T01:11:22.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1417445641644431637', time=2024-09-12T03:00:59.414698+0000, chain.objs.size()=1 2024-09-12T01:11:22.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RtcSeUvKz8cx239lKa83tM-Ec9IO1xu_0 2024-09-12T01:11:22.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11554858624933281988', time=2024-09-12T03:00:59.446608+0000, chain.objs.size()=1 2024-09-12T01:11:22.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Ub0iCI4zk3bFyVfO2Fd4_gnRBDzV-d6_0 2024-09-12T01:11:22.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11303218602086191586', time=2024-09-12T03:00:59.464852+0000, chain.objs.size()=1 2024-09-12T01:11:22.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.556+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.EnRGWhWdMHm4gOOd4M2XgloMolxaQYD_0 2024-09-12T01:11:22.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.558+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13036006077181558072', time=2024-09-12T03:00:59.492405+0000, chain.objs.size()=1 2024-09-12T01:11:22.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.558+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZdflyDKDxqxkrMyNuUc87J10P8Jz0Kg_0 2024-09-12T01:11:22.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.558+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.599718774115662759', time=2024-09-12T03:00:59.510787+0000, chain.objs.size()=1 2024-09-12T01:11:22.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.558+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ikbwxX--B1wqpI-APckaEHWQL1BYbaR_0 2024-09-12T01:11:22.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.559+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2775167246971837404', time=2024-09-12T03:00:59.512652+0000, chain.objs.size()=1 2024-09-12T01:11:22.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.560+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lXBM54ifxzy6ClFQM_KB0XSyvbOZzwY_0 2024-09-12T01:11:22.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3450572234997609011', time=2024-09-12T03:00:59.558725+0000, chain.objs.size()=1 2024-09-12T01:11:22.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fy6Mqw9muG8dVrSYMerLbg0-qYTFrGG_0 2024-09-12T01:11:22.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12766358498524809012', time=2024-09-12T03:00:59.667569+0000, chain.objs.size()=1 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7RvEDwx0WLLK9Mc6ETiZYl7m3V5OOKl_0 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16655526555875470959', time=2024-09-12T03:00:59.668251+0000, chain.objs.size()=1 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4RYZqNCNEnxX1enLs-j7tDTdtqRWHN-_0 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7175275297300462312', time=2024-09-12T03:00:59.784734+0000, chain.objs.size()=1 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5I8kQJ8EUgj_R7MnOHT3X_2-zd5fs7s_0 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15382266706014833320', time=2024-09-12T03:00:59.809491+0000, chain.objs.size()=1 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.YVtZwob8nilhc-N82in1VRxFAMirCct_0 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9647282645514313921', time=2024-09-12T03:01:00.014898+0000, chain.objs.size()=1 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.GUqPT1WgQ8sAJE6iUoyCxJ_BunE_msy_0 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1224329672663655282', time=2024-09-12T03:01:00.400429+0000, chain.objs.size()=1 2024-09-12T01:11:22.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xkcJR5PTGDx_28U3tWC7NmSRb4ZFxPo_0 2024-09-12T01:11:22.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.53029029706858333', time=2024-09-12T03:01:00.438539+0000, chain.objs.size()=1 2024-09-12T01:11:22.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MsIEpnjEECgvrrn8YCay_C311fc0iwX_0 2024-09-12T01:11:22.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9135621753814232065', time=2024-09-12T03:01:00.504467+0000, chain.objs.size()=1 2024-09-12T01:11:22.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZeTWexxRQZlGFfoaQrdBbo5LuJERToX_0 2024-09-12T01:11:22.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14066015692392892653', time=2024-09-12T03:01:00.678204+0000, chain.objs.size()=1 2024-09-12T01:11:22.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5XQAIRF17eOtZFlRGScHjRMUDBwNX2A_0 2024-09-12T01:11:22.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18017434666091242350', time=2024-09-12T03:01:00.727331+0000, chain.objs.size()=1 2024-09-12T01:11:22.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.562+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.a31KTGCVQzK0OFzixmav-OCTLVTStVE_0 2024-09-12T01:11:22.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.564+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12610952497913485634', time=2024-09-12T03:01:00.863756+0000, chain.objs.size()=1 2024-09-12T01:11:22.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.564+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._5VWBHu5ttJV3A6SQitk4G1pEMKF21u_0 2024-09-12T01:11:22.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.567+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7149577763560686745', time=2024-09-12T03:01:00.896608+0000, chain.objs.size()=1 2024-09-12T01:11:22.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.567+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.QEJwMs9x5LGQGsiFCEltTEDl6i49XCX_0 2024-09-12T01:11:22.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.567+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12327066445787357600', time=2024-09-12T03:01:00.944764+0000, chain.objs.size()=1 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.567+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5ns4xqcxF1dDvcp7MI5zoI9q0ZeuQz2_0 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.567+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14259998444096561098', time=2024-09-12T03:01:00.958298+0000, chain.objs.size()=1 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.567+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.kfUlnZ2pmM8rut6oB7osmBzk-MbGC7h_0 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6805683395450032448', time=2024-09-12T03:01:02.347238+0000, chain.objs.size()=1 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.266__shadow_.pbuQqhI7dUuz1WZZ_5Ko3hLTIiUoxII_0 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9083097285781341053', time=2024-09-12T03:01:15.875518+0000, chain.objs.size()=1 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.Qyy14zfNqEw3hUuu5go9f_gxbDqI9z6_0 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14035785601246720524', time=2024-09-12T03:01:18.536732+0000, chain.objs.size()=1 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.298__shadow_.Ba0tPU7aRZ9fHpl6SXiOhw0m8gh64_8_0 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16922648158599232045', time=2024-09-12T03:01:19.061567+0000, chain.objs.size()=1 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.299__shadow_.-BPg2hlh1AIZnRjv9yxgFYhIuuzRIWJ_0 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17830814207371051191', time=2024-09-12T03:01:20.061988+0000, chain.objs.size()=1 2024-09-12T01:11:22.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.568+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.301__shadow_.PTl-ZwW6QE20AJk19VRliH87F6zzyKt_0 2024-09-12T01:11:22.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3157858761998844511', time=2024-09-12T03:01:40.119955+0000, chain.objs.size()=1 2024-09-12T01:11:22.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8xiLl5mDOKIl-zo_0lRlxt73s4T6udZ_0 2024-09-12T01:11:22.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.591968711270371363', time=2024-09-12T03:01:40.139052+0000, chain.objs.size()=1 2024-09-12T01:11:22.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ySWFABK0jB6p8zFPmoewAUe98BXh07v_0 2024-09-12T01:11:22.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.570+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16275072094217988853', time=2024-09-12T03:01:40.155192+0000, chain.objs.size()=1 2024-09-12T01:11:22.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.571+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.apqxLeFbr7oiAUaB0Qnlm8oRRjiZMKZ_0 2024-09-12T01:11:22.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.572+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11885646303853366407', time=2024-09-12T03:01:40.204839+0000, chain.objs.size()=1 2024-09-12T01:11:22.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.572+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.j8XZS9s9k5dkDCzedXPM3Cf5e6p69NI_0 2024-09-12T01:11:22.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.572+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.513335265590879996', time=2024-09-12T03:01:40.206121+0000, chain.objs.size()=1 2024-09-12T01:11:22.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.572+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3Tjx1WQ2smyQhm2O28mBPPsBiAVE1vs_0 2024-09-12T01:11:22.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.572+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9073350663847272026', time=2024-09-12T03:01:40.238826+0000, chain.objs.size()=1 2024-09-12T01:11:22.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rwPfzIsCbknPcEbBL5oe5kByHgjo5lj_0 2024-09-12T01:11:22.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.573+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2435948004527670239', time=2024-09-12T03:01:40.241495+0000, chain.objs.size()=1 2024-09-12T01:11:22.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LSFaxuNUQUt_7RVI8bbs_YE0Q7GD34y_0 2024-09-12T01:11:22.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.573+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.601973829981485259', time=2024-09-12T03:01:40.275686+0000, chain.objs.size()=1 2024-09-12T01:11:22.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JCQBiFSK0uf2UIfR4mQXnO_Jeco9zZj_0 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.573+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14529628254334578842', time=2024-09-12T03:01:40.454175+0000, chain.objs.size()=1 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.XGI8O0MOgyzUgnKV1dLJzQGE2awIfUS_0 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10883375477397546926', time=2024-09-12T03:01:40.466042+0000, chain.objs.size()=1 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2Y9jxR0IFWu42UUwqTjqhiYTNzY4U4v_0 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17606971999476910240', time=2024-09-12T03:01:40.486814+0000, chain.objs.size()=1 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.047zC-oDBUMfEHCO5B48ZkMbIxaLvaB_0 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12514184933485138054', time=2024-09-12T03:01:40.518518+0000, chain.objs.size()=1 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.SEPlx39chnAcDV7KkVfIK7Lq-QRjevA_0 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8288671672201735056', time=2024-09-12T03:01:40.653360+0000, chain.objs.size()=1 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.P5RoFzA2Ck9vH5WoWxO4WjHufoUK7un_0 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16483825049093234496', time=2024-09-12T03:01:40.655292+0000, chain.objs.size()=1 2024-09-12T01:11:22.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.izMmF2vGqqhkd18obkHwN6Vjf1woHLP_0 2024-09-12T01:11:22.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.577+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14614547558395397215', time=2024-09-12T03:01:40.702245+0000, chain.objs.size()=1 2024-09-12T01:11:22.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.577+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qtGvfgmTCwGZHKYJ7c4rnEf8SA5fyvX_0 2024-09-12T01:11:22.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.577+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8492145957145663376', time=2024-09-12T03:01:40.915156+0000, chain.objs.size()=1 2024-09-12T01:11:22.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.577+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1vk5MClq1DZuAfq9Pb_Zr-JAcxIZ_hZ_0 2024-09-12T01:11:22.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16865501872303632332', time=2024-09-12T03:01:40.923177+0000, chain.objs.size()=1 2024-09-12T01:11:22.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.znAdvyzM6SdT-Gm4Aklfdd6tX-qxPlk_0 2024-09-12T01:11:22.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14068190165451716781', time=2024-09-12T03:01:41.021948+0000, chain.objs.size()=1 2024-09-12T01:11:22.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.TL7t_p4Mek6voBl7bXkllqv6MJLwWTd_0 2024-09-12T01:11:22.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17614650892009688763', time=2024-09-12T03:01:41.044390+0000, chain.objs.size()=1 2024-09-12T01:11:22.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NSGjcN92qnYU4lrXorLbRa-x51Cy9AU_0 2024-09-12T01:11:22.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7926791777341068975', time=2024-09-12T03:01:41.067473+0000, chain.objs.size()=1 2024-09-12T01:11:22.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.As851AlALvWz4QMRjus60Bh7xTmoAvp_0 2024-09-12T01:11:22.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9965810594390038909', time=2024-09-12T03:01:41.090437+0000, chain.objs.size()=1 2024-09-12T01:11:22.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.961pbkGh6xhNg2RYLYm7OCoHlVut5jC_0 2024-09-12T01:11:22.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13032698827698715562', time=2024-09-12T03:01:41.195683+0000, chain.objs.size()=1 2024-09-12T01:11:22.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kDwsDC17ZfDFT-y-NfMsxgMyHIGN1uZ_0 2024-09-12T01:11:22.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3876541218546329912', time=2024-09-12T03:01:41.230797+0000, chain.objs.size()=1 2024-09-12T01:11:22.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6J23swqvSxJEX3RNgmrXc0iOf5DVzeT_0 2024-09-12T01:11:22.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.38989631676989718', time=2024-09-12T03:01:41.238793+0000, chain.objs.size()=1 2024-09-12T01:11:22.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-irPsDyxLiyeIsdXVR7WzP0fMh80P_K_0 2024-09-12T01:11:22.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1755862251499255534', time=2024-09-12T03:01:41.278064+0000, chain.objs.size()=1 2024-09-12T01:11:22.580 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.SxrG8KEiGGVDZ7ZE3_cG6rMIve5ebuk_0 2024-09-12T01:11:22.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7012178002341261142', time=2024-09-12T03:01:41.448828+0000, chain.objs.size()=1 2024-09-12T01:11:22.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.TjDh3fA8GQ-USPe_GIRsnS1IWXd0K3T_0 2024-09-12T01:11:22.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9239494171019251745', time=2024-09-12T03:01:41.451856+0000, chain.objs.size()=1 2024-09-12T01:11:22.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1eBF-amRLb4GHbFaPBOXf3sUb7OHrvF_0 2024-09-12T01:11:22.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.340345015869225120', time=2024-09-12T03:01:41.472002+0000, chain.objs.size()=1 2024-09-12T01:11:22.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZxmkQ0fvdSxsEhA3QtDobdUEd7B_Vyj_0 2024-09-12T01:11:22.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9439396756832036970', time=2024-09-12T03:01:41.477468+0000, chain.objs.size()=1 2024-09-12T01:11:22.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kMMh8HA6G-WFRrKqVHi0h34V_o_5IFG_0 2024-09-12T01:11:22.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.583+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8897051873994985581', time=2024-09-12T03:01:41.500843+0000, chain.objs.size()=1 2024-09-12T01:11:22.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.583+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.OXWhqhR5zJBzGaK1HpmAVPH-j4jO4UV_0 2024-09-12T01:11:22.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.583+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9216514144482866315', time=2024-09-12T03:01:41.548072+0000, chain.objs.size()=1 2024-09-12T01:11:22.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.583+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2xM_kiFahURz0o9XfJ-Sl0EXKA9bd7n_0 2024-09-12T01:11:22.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.584+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7228608846866573757', time=2024-09-12T03:01:41.552647+0000, chain.objs.size()=1 2024-09-12T01:11:22.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.584+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wBp3iTbZqs0dKlqhgY5AIWeqrogc2aX_0 2024-09-12T01:11:22.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.584+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8567002164278120953', time=2024-09-12T03:01:41.554143+0000, chain.objs.size()=1 2024-09-12T01:11:22.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.584+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qc6VaXK3oNpR7Vi8IBj0a8nqrWvO4-b_0 2024-09-12T01:11:22.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.584+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10424417332775479590', time=2024-09-12T03:01:41.586916+0000, chain.objs.size()=1 2024-09-12T01:11:22.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.584+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.54UD97IyKAMrWemLXOz3h7aWqdJ5qgT_0 2024-09-12T01:11:22.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.584+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1012065152964968256', time=2024-09-12T03:01:41.707887+0000, chain.objs.size()=1 2024-09-12T01:11:22.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.584+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3fMlrqHNToyx8fyTX9bMxa-LQYTRDAw_0 2024-09-12T01:11:22.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11298381692325594052', time=2024-09-12T03:01:41.790138+0000, chain.objs.size()=1 2024-09-12T01:11:22.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dwTik8vabhhSwZ2Y9tHIHM1-Dbrkhb5_0 2024-09-12T01:11:22.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15410229255727549207', time=2024-09-12T03:01:41.857260+0000, chain.objs.size()=1 2024-09-12T01:11:22.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mhfzZmcSdDBIGpIMCO21BuYD2KOtjFA_0 2024-09-12T01:11:22.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15668315555239839327', time=2024-09-12T03:01:41.970214+0000, chain.objs.size()=1 2024-09-12T01:11:22.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._Fp-94tpCd-kMkK1hUsztLHv3OI0CO0_0 2024-09-12T01:11:22.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3735258948307681265', time=2024-09-12T03:01:41.981402+0000, chain.objs.size()=1 2024-09-12T01:11:22.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7NafAQzQNIEcc1V2Qnsp1HK6YqpgIKm_0 2024-09-12T01:11:22.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.589467594802627317', time=2024-09-12T03:01:42.006317+0000, chain.objs.size()=1 2024-09-12T01:11:22.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.588+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6NCt3bkfaZods4n-XyVKhs1KmE44Gys_0 2024-09-12T01:11:22.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4636484374400021906', time=2024-09-12T03:01:42.007540+0000, chain.objs.size()=1 2024-09-12T01:11:22.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sxVpuay9vyNKYwQkUx6DOCAkX5Ut9lO_0 2024-09-12T01:11:22.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5998755242539848122', time=2024-09-12T03:01:42.065361+0000, chain.objs.size()=1 2024-09-12T01:11:22.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.iTmbyZscgfjj25-pv6Jezwpn_y_CW_x_0 2024-09-12T01:11:22.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11099175882362339172', time=2024-09-12T03:01:50.288379+0000, chain.objs.size()=1 2024-09-12T01:11:22.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xHicHS0EpltumjyCFJV4OVkXutY56Ae_0 2024-09-12T01:11:22.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.930820129836931882', time=2024-09-12T03:01:50.560614+0000, chain.objs.size()=1 2024-09-12T01:11:22.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.w5xnOu3jPlRQWWCfe2YLwjbXcsSKeQf_0 2024-09-12T01:11:22.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5874830977943806517', time=2024-09-12T03:01:50.629197+0000, chain.objs.size()=1 2024-09-12T01:11:22.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.590+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lnQo4wMKylBJAmizJKdrj5vtQVrivsA_0 2024-09-12T01:11:22.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.591+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14502791488784406369', time=2024-09-12T03:01:50.698381+0000, chain.objs.size()=1 2024-09-12T01:11:22.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.591+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FOSWV7fAcNwGtH5HDy5GkKlXNU0YyaJ_0 2024-09-12T01:11:22.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.592+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15725026167381003053', time=2024-09-12T03:01:50.703707+0000, chain.objs.size()=1 2024-09-12T01:11:22.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.592+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.osxByKPRK4_BIR9pq1iM0wgZME2Dkj8_0 2024-09-12T01:11:22.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.593+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5633982492768769935', time=2024-09-12T03:01:50.881512+0000, chain.objs.size()=1 2024-09-12T01:11:22.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.593+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Kmm3hqLBBYYCq-VQ4w--XNo15u3CEu0_0 2024-09-12T01:11:22.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.826391372574522599', time=2024-09-12T03:01:50.894731+0000, chain.objs.size()=1 2024-09-12T01:11:22.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CyiBBMAOCfpxhfA4JeC6kTbGzkqdbNa_0 2024-09-12T01:11:22.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4126499578886084691', time=2024-09-12T03:01:50.925998+0000, chain.objs.size()=1 2024-09-12T01:11:22.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pClfTmSqiOD6PEbY6BawBbaGxGkfVNC_0 2024-09-12T01:11:22.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9234976747048564280', time=2024-09-12T03:01:50.949187+0000, chain.objs.size()=1 2024-09-12T01:11:22.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.iMZW6BUm-PjHFoTRL2ZJvgtDKyaoQkS_0 2024-09-12T01:11:22.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.595+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17518386010192395323', time=2024-09-12T03:01:51.007677+0000, chain.objs.size()=1 2024-09-12T01:11:22.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.595+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ImgOrXe56kUS-r5E7SLDlpSZoM-ybnQ_0 2024-09-12T01:11:22.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.595+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1222917746950735530', time=2024-09-12T03:01:51.094975+0000, chain.objs.size()=1 2024-09-12T01:11:22.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.595+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mNM7P7umwyOoeC2k8GcQwfX-R3XVHQs_0 2024-09-12T01:11:22.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.596+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18030128139687113715', time=2024-09-12T03:01:51.375361+0000, chain.objs.size()=1 2024-09-12T01:11:22.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.596+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jyV9ODG2-5bTjJ3ILSyedIwhPXQ4oRz_0 2024-09-12T01:11:22.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5074217077665938763', time=2024-09-12T03:01:51.377827+0000, chain.objs.size()=1 2024-09-12T01:11:22.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7iRY5JQ65e_Qf7Fx1EjOTiqE73mLxm7_0 2024-09-12T01:11:22.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12288626604291392642', time=2024-09-12T03:01:51.429835+0000, chain.objs.size()=1 2024-09-12T01:11:22.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DeBi1AK3Y4aDoUzYaH_zXmx_OgTFI94_0 2024-09-12T01:11:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3892710056550523245', time=2024-09-12T03:01:51.744464+0000, chain.objs.size()=1 2024-09-12T01:11:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DE-s0EN1gLadY-sJOfnCJqFurySNWsT_0 2024-09-12T01:11:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.599+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9784877966715008322', time=2024-09-12T03:01:51.752708+0000, chain.objs.size()=1 2024-09-12T01:11:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.599+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GGk_n1VqT6d6CLiUqywq4EgDqyCT467_0 2024-09-12T01:11:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.599+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10498572653742556586', time=2024-09-12T03:01:51.770229+0000, chain.objs.size()=1 2024-09-12T01:11:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.599+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uyJJ68CYM6haCo1uev9jjt1PHzHz29L_0 2024-09-12T01:11:22.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.599+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8362166082724364066', time=2024-09-12T03:01:51.784903+0000, chain.objs.size()=1 2024-09-12T01:11:22.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.599+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MIYxrlRd50OSrHgZICSdjCpUiSPgt40_0 2024-09-12T01:11:22.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.600+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16868487303811072815', time=2024-09-12T03:01:51.813443+0000, chain.objs.size()=1 2024-09-12T01:11:22.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.600+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qrkFP6k2u9YXjOf33Qa5LTESamrG5lj_0 2024-09-12T01:11:22.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.600+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5642173671534645220', time=2024-09-12T03:01:51.908812+0000, chain.objs.size()=1 2024-09-12T01:11:22.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.600+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9ANAaJAwVUVLqHhV001h-b2MK9YEohb_0 2024-09-12T01:11:22.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.604+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/41099 2024-09-12T01:11:22.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T01:11:22.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11554459471171566525', time=2024-09-12T03:01:51.926059+0000, chain.objs.size()=1 2024-09-12T01:11:22.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Qfk49N6WO_lfHC_6lHc79LTLFHrfC7j_0 2024-09-12T01:11:22.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11130703690852339607', time=2024-09-12T03:01:51.999727+0000, chain.objs.size()=1 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TxKIfXJIOtk__h3W7xvsMJPvftLvpaX_0 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16838952188909034611', time=2024-09-12T03:01:52.014918+0000, chain.objs.size()=1 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.e7zt553hpV9CbFG_wujpeT-zb0k9PRe_0 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14111878199552570086', time=2024-09-12T03:01:52.096457+0000, chain.objs.size()=1 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gf6PPuU6hMUz8_rvr8cEk-txo_xcpdH_0 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11975126733519107601', time=2024-09-12T03:01:52.171086+0000, chain.objs.size()=1 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7N8WIFQ147K-CzXijnPdn8CR3mtIQlK_0 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13971462185899219350', time=2024-09-12T03:01:52.213870+0000, chain.objs.size()=1 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.UTxZROSzALGj2F1WkQtSBUgd11QooIb_0 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18157099580723620459', time=2024-09-12T03:01:52.290227+0000, chain.objs.size()=1 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Zy8SQlJfe3qxgQpcguRyv4to_OpDgZW_0 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11996321366833759342', time=2024-09-12T03:01:52.320317+0000, chain.objs.size()=1 2024-09-12T01:11:22.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.U03sQh3NF3TklJMuxaeQWSaFrafxvBX_0 2024-09-12T01:11:22.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5593221780960599386', time=2024-09-12T03:01:52.323736+0000, chain.objs.size()=1 2024-09-12T01:11:22.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.PGVoJxtQtOhL0PAHGKHORbsNHbS1hW4_0 2024-09-12T01:11:22.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16229223906591332024', time=2024-09-12T03:01:57.741207+0000, chain.objs.size()=1 2024-09-12T01:11:22.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.337__shadow_.R-7OqDxJtR6OCMSbGbOImfGfcHvSCKE_0 2024-09-12T01:11:22.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.818963301652169923', time=2024-09-12T03:02:59.846992+0000, chain.objs.size()=1 2024-09-12T01:11:22.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.460__shadow_.a_lexyYbK4cmHbbU9EE4W5avF8pZlzr_0 2024-09-12T01:11:22.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7748586702876564466', time=2024-09-12T03:03:01.311485+0000, chain.objs.size()=1 2024-09-12T01:11:22.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.462__shadow_.HCgC85Et8Ujqlev0lIppNJ7pwHHFldN_0 2024-09-12T01:11:22.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.610+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8304373044454786190', time=2024-09-12T03:03:04.498662+0000, chain.objs.size()=1 2024-09-12T01:11:22.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.610+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.467__shadow_.BFAxYyuff4mFgjwr9wE-_nVG5sPZNkm_0 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.611+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3117152676159696923', time=2024-09-12T03:03:16.276881+0000, chain.objs.size()=1 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.611+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.497__shadow_.dq-ZV1YVnVnXwlvm7zOsM3r4BkPh2FC_0 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13317523571600421197', time=2024-09-12T03:03:16.837016+0000, chain.objs.size()=1 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.498__shadow_.AC1VETcnN-aSKRCpW2qWtFuA1iBwEzV_0 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8049681513658816948', time=2024-09-12T03:03:25.212628+0000, chain.objs.size()=1 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.516__shadow_.vX1wz4xVai27dxdUytVdm3HM5FgTuCH_0 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2426952904672163080', time=2024-09-12T03:03:31.112154+0000, chain.objs.size()=3 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.522__multipart_mymultipart.2~iFcsrdYSdwKw1GGrh_bWo13okurTkPl.1 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.522__multipart_mymultipart.2~iFcsrdYSdwKw1GGrh_bWo13okurTkPl.2 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.522__multipart_mymultipart.2~iFcsrdYSdwKw1GGrh_bWo13okurTkPl.3 2024-09-12T01:11:22.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~Xh4CeUDYLb_etPtEjQPYa1H8MPgeJmb', time=2024-09-12T03:03:50.787746+0000, chain.objs.size()=1 2024-09-12T01:11:22.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.532__multipart_mymultipart.2~Xh4CeUDYLb_etPtEjQPYa1H8MPgeJmb.1 2024-09-12T01:11:22.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6524525611652081341', time=2024-09-12T03:04:28.793778+0000, chain.objs.size()=2 2024-09-12T01:11:22.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.555__shadow_.N8VsE-2ecedVbZizP-_3zMaejPlvc51_0 2024-09-12T01:11:22.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.555__shadow_.N8VsE-2ecedVbZizP-_3zMaejPlvc51_1 2024-09-12T01:11:22.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1024013315053571023', time=2024-09-12T03:04:30.504836+0000, chain.objs.size()=1 2024-09-12T01:11:22.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.558__shadow_.beyQ6oocjVK_IMTYIBXoXccqdsmtWRQ_0 2024-09-12T01:11:22.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.615+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14776008887509418955', time=2024-09-12T03:04:42.189033+0000, chain.objs.size()=1 2024-09-12T01:11:22.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.615+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:jOZR.lpqlD-6MlPGKz.CEqyviJLdtX8_.rgmZh-60AeYpPFx1o7s0dvdI3RZ8CnV_0 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.616+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7415147389181985231', time=2024-09-12T03:04:55.359047+0000, chain.objs.size()=1 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.616+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:o4Ns961rVgWr3XTGO9Gl1c.BcP6HHaX_.jp1AGe-0k58wuHw2YInhaXqIimS1RVP_0 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13667774914717420854', time=2024-09-12T03:05:01.736319+0000, chain.objs.size()=1 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:sepDDKMiZUp7qpFXQ8Q7uiFV45BS.yG_.NgYxqhhuLyw-cpog6T92Htk_PnPN9In_0 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9978115705413971136', time=2024-09-12T03:05:09.454849+0000, chain.objs.size()=1 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:Xs3a9E4GGwDdgN52qctCR8VFE3o6Gbs_.fVKzC7POiGFLSXETc0VLoduxiJec6mL_0 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8782178406826216949', time=2024-09-12T03:05:12.892172+0000, chain.objs.size()=1 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:IvLgXcU1cYuLsKjkwqXFyb-194BbTym_.Pfu9JP5ocTvKR2mCE-OCQyQpXAoPmwC_0 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2837419692339864497', time=2024-09-12T03:05:14.218706+0000, chain.objs.size()=1 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:3mUPU-2OVEoJFI-RDWClFif0H7LANvP_.y8tZV7qVzJ7pGdC2LPRpxJi6DvO5sGI_0 2024-09-12T01:11:22.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2249854069968579232', time=2024-09-12T03:07:45.610681+0000, chain.objs.size()=1 2024-09-12T01:11:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.632__shadow_.NyuJXAEvMwPs8kNaPa4l8fuEOVixB7p_0 2024-09-12T01:11:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18301877704672413147', time=2024-09-12T03:08:05.044205+0000, chain.objs.size()=1 2024-09-12T01:11:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.671__shadow_.kqdBeBKxfrwwqCtEtjIYeiNmY-KdqAQ_0 2024-09-12T01:11:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2673342514398896733', time=2024-09-12T03:08:15.251847+0000, chain.objs.size()=1 2024-09-12T01:11:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.696__shadow_.NMcoHmbasJqZ8gNZTPeSa7WZcTck3vT_0 2024-09-12T01:11:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1446376673259009141', time=2024-09-12T03:08:16.917529+0000, chain.objs.size()=1 2024-09-12T01:11:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.700__shadow:UFnRIUac5mCtuDCEoPq0wMBWU41VQtw_.8A9optc4kr79ONjTeqYP5mfb85g3nR1_0 2024-09-12T01:11:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2536758174134045625', time=2024-09-12T03:08:21.441098+0000, chain.objs.size()=1 2024-09-12T01:11:22.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.617+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.710__shadow_.Lni2vDCySm6imirUqTW0w4dPA5ZK1q8_0 2024-09-12T01:11:22.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.620+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2131528053436301304', time=2024-09-12T03:08:34.371306+0000, chain.objs.size()=1 2024-09-12T01:11:22.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.620+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.717__shadow:hif55AHxC7qeotIwrMPs-D189PffrCy_.nstUR4F5BT4Nftxr8rn040KIIRDF9Wr_0 2024-09-12T01:11:22.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.621+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1993512788522005947', time=2024-09-12T03:08:44.020637+0000, chain.objs.size()=1 2024-09-12T01:11:22.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.621+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.718__shadow:pSPxwRKDy7-1PzFevLXrBczaJ2CdYnZ_.3TsX_eMv-Wlym8lBbMHJ6HuM5poUCkG_0 2024-09-12T01:11:22.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.625+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:22.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.627+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:11:22.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.628+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:22.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:22.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53484' 2024-09-12T01:11:22.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18151187887788721002', time=2024-09-12T02:58:58.265449+0000, chain.objs.size()=1 2024-09-12T01:11:22.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.172__shadow_.Ncy7a_4_n-ueU1DSAxlmGxNt1v7IsM4_0 2024-09-12T01:11:22.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4065826418236297352', time=2024-09-12T03:00:36.176069+0000, chain.objs.size()=1 2024-09-12T01:11:22.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.234__shadow_.pKzzUziryZy2v0_hkzCYu805ghoNwLZ_0 2024-09-12T01:11:22.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6105389145610034926', time=2024-09-12T03:00:39.223864+0000, chain.objs.size()=1 2024-09-12T01:11:22.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.239__shadow_.k8TJc-Bz0zfyFoEC86jNDWhWtkkZUQ__0 2024-09-12T01:11:22.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13826826024615355873', time=2024-09-12T03:00:48.402330+0000, chain.objs.size()=1 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.257__shadow_.ggQ42G0m6w9sc3hBMoumHLQDpRyHLnj_0 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8775802325508324442', time=2024-09-12T03:00:58.909106+0000, chain.objs.size()=1 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.IJhCAfNcBreQSXvNDCuYIGtPOGMTePA_0 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15377647881367739295', time=2024-09-12T03:00:58.927025+0000, chain.objs.size()=1 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KWL12LYOnHHFnHWkR3BDc1yYWAnEUi1_0 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9097872258551424364', time=2024-09-12T03:00:58.979839+0000, chain.objs.size()=1 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.i5ZEA9u8Lc4VCy3G43LBlWwLBuD9JJP_0 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13002526235877172508', time=2024-09-12T03:00:59.033892+0000, chain.objs.size()=1 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7PaT6rVFCHqbJMvvZuOQP4sHW0E09vm_0 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17728282113918847338', time=2024-09-12T03:00:59.193289+0000, chain.objs.size()=1 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xW6Ma4clbVLVQ-hZ8mIViWSBt4UJrgp_0 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15198814854148238991', time=2024-09-12T03:00:59.197737+0000, chain.objs.size()=1 2024-09-12T01:11:22.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.achQgflA6SfUq7-jNa1NA1s4s0gLwb6_0 2024-09-12T01:11:22.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9990298649432133099', time=2024-09-12T03:00:59.272384+0000, chain.objs.size()=1 2024-09-12T01:11:22.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.630+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BH8FxpnJ_u-KbccoTjnKA5j4a1xTEN8_0 2024-09-12T01:11:22.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.630+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11626495346631443871', time=2024-09-12T03:00:59.399692+0000, chain.objs.size()=1 2024-09-12T01:11:22.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.630+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.aHBMtui-XTbRvs8b4lQ179poh5yb4so_0 2024-09-12T01:11:22.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.632+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5683492061293004398', time=2024-09-12T03:00:59.402879+0000, chain.objs.size()=1 2024-09-12T01:11:22.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.632+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.huAn1yfLl_JGwrId_AHdqcrlxw6ijxV_0 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8870419078037855854', time=2024-09-12T03:00:59.408394+0000, chain.objs.size()=1 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.pXYzGRvs7rq0VjERJgOe9PPSDbiRZUw_0 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10254907665888230666', time=2024-09-12T03:00:59.510393+0000, chain.objs.size()=1 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LVyqAovcn1XOUSBgyqroL4iTeY018ih_0 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11896463609383355774', time=2024-09-12T03:00:59.549504+0000, chain.objs.size()=1 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.kdRtS1_ZjK2-jbt3ACmeI2i-v1JCGaC_0 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12892144265906122272', time=2024-09-12T03:00:59.710711+0000, chain.objs.size()=1 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3qMi1BzqXav7l09setZPQjHr3fa2h75_0 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13063938729392967293', time=2024-09-12T03:00:59.750905+0000, chain.objs.size()=1 2024-09-12T01:11:22.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qfnT_KeTKVLg5mNSy3IQX_dt39JGrqe_0 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8918580349140092502', time=2024-09-12T03:00:59.799750+0000, chain.objs.size()=1 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.b7ozCnm8Y-T7ToyO2xWyGRmpLqTpuPb_0 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17589366213084518799', time=2024-09-12T03:00:59.946586+0000, chain.objs.size()=1 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.pxNty7QZs2CgGqd7Xeyw51vI0bVUQbR_0 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15684602870844024670', time=2024-09-12T03:00:59.957816+0000, chain.objs.size()=1 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UHHOwLtXcg815HzyekAg_THKecP_gVy_0 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14143126199471030080', time=2024-09-12T03:01:00.330272+0000, chain.objs.size()=1 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qgue-3IDY7GtKz4YsOcZduhMwTXZHHE_0 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15230577959967873730', time=2024-09-12T03:01:00.622267+0000, chain.objs.size()=1 2024-09-12T01:11:22.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BRhfk6EP3L9TrlV9CXckEmkxdawxxCd_0 2024-09-12T01:11:22.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.637+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2014287551138055328', time=2024-09-12T03:01:00.712774+0000, chain.objs.size()=1 2024-09-12T01:11:22.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.637+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.w92JpOskfIQ5P7WHnL0Aa2NnERWYIvq_0 2024-09-12T01:11:22.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.638+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10363613692145651618', time=2024-09-12T03:01:00.720161+0000, chain.objs.size()=1 2024-09-12T01:11:22.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.638+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UC-5jLTOeBwugM_YQ5ER0p0mL6T8XIA_0 2024-09-12T01:11:22.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.638+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6196667990940256800', time=2024-09-12T03:01:00.723693+0000, chain.objs.size()=1 2024-09-12T01:11:22.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.638+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FJnf9tFczBeh6TPngfBWGR7LApy6oFL_0 2024-09-12T01:11:22.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8129285094815501936', time=2024-09-12T03:01:00.725241+0000, chain.objs.size()=1 2024-09-12T01:11:22.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.OSCDzgNUstPAwcXhliGpK9ZighW4G8Q_0 2024-09-12T01:11:22.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9264676985407934107', time=2024-09-12T03:01:00.730625+0000, chain.objs.size()=1 2024-09-12T01:11:22.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.33fpIiEjMnq1UL2G0uNHwsZvC5dptx-_0 2024-09-12T01:11:22.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.216184577763347581', time=2024-09-12T03:01:00.854539+0000, chain.objs.size()=1 2024-09-12T01:11:22.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SRoUQR1sTs93EawHVXNKWM_WONZRBVU_0 2024-09-12T01:11:22.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14523982999633399448', time=2024-09-12T03:01:00.868410+0000, chain.objs.size()=1 2024-09-12T01:11:22.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rw5YXV77lZQng24DkiTE6uJMl9pFEWI_0 2024-09-12T01:11:22.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8468669370521998504', time=2024-09-12T03:01:00.915449+0000, chain.objs.size()=1 2024-09-12T01:11:22.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8T5JRh_jpOFrE9DlBk31psV8aN0vRhR_0 2024-09-12T01:11:22.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8733474129496903374', time=2024-09-12T03:01:00.921339+0000, chain.objs.size()=1 2024-09-12T01:11:22.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.639+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.l02aPFqk_YhYkUC7XVHpZyMeSlGBdKW_0 2024-09-12T01:11:22.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.641+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14579386778291328689', time=2024-09-12T03:01:03.769808+0000, chain.objs.size()=1 2024-09-12T01:11:22.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.641+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.269__shadow_.RV8yD8oRAjQCtOkn1JMIjUh6Gr3M5-w_0 2024-09-12T01:11:22.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.641+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11904895469262517840', time=2024-09-12T03:01:06.993089+0000, chain.objs.size()=1 2024-09-12T01:11:22.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.641+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.276__shadow_.2NhOhqdGNm1DiXtUDfXX4wx6LCu1VFn_0 2024-09-12T01:11:22.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.641+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14262946429638602620', time=2024-09-12T03:01:14.316481+0000, chain.objs.size()=1 2024-09-12T01:11:22.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.641+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.291__shadow_.vEJl0yQWW7oXLWBlslbnd0xi3gvrMXT_0 2024-09-12T01:11:22.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.642+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14553905497847170222', time=2024-09-12T03:01:17.090746+0000, chain.objs.size()=1 2024-09-12T01:11:22.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.642+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.295__shadow_.FG2Be6dCyLAgYOE0nlpbwFaSnMPEQ_M_0 2024-09-12T01:11:22.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.643+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4685004703283016054', time=2024-09-12T03:01:23.718721+0000, chain.objs.size()=1 2024-09-12T01:11:22.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.643+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.308__shadow:dnKDEDAzPTM4U5vcQb8xu-dayOHhuOc_.cdXcYt6E3x5lCUUsNnie0FaJY_TlPc__0 2024-09-12T01:11:22.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.643+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1381729713345724922', time=2024-09-12T03:01:40.185067+0000, chain.objs.size()=1 2024-09-12T01:11:22.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.643+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MI42BvR5oF7SS1DwFmGN91vQS_8DTJo_0 2024-09-12T01:11:22.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10595127044390936668', time=2024-09-12T03:01:40.440151+0000, chain.objs.size()=1 2024-09-12T01:11:22.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.o2Zh-XRwmjmOIZgaiulHHE24Rhiowq6_0 2024-09-12T01:11:22.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18231612177046078965', time=2024-09-12T03:01:40.493006+0000, chain.objs.size()=1 2024-09-12T01:11:22.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.y6FkI-A8NTHD4vyN40hk7kRKryHN1Kk_0 2024-09-12T01:11:22.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1130067792436515279', time=2024-09-12T03:01:40.528571+0000, chain.objs.size()=1 2024-09-12T01:11:22.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.RZkVmnUSyXe5YGjaCz3_eIyiK-6mtML_0 2024-09-12T01:11:22.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14113046568649113296', time=2024-09-12T03:01:40.763359+0000, chain.objs.size()=1 2024-09-12T01:11:22.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._-2-Lp1liLlO2WfBKLrMPPc5zh9Lu0c_0 2024-09-12T01:11:22.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9793374575880328791', time=2024-09-12T03:01:40.777064+0000, chain.objs.size()=1 2024-09-12T01:11:22.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JqLUOcMZQizc1ryJOoES9kebQH-WnnR_0 2024-09-12T01:11:22.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.901975670408132973', time=2024-09-12T03:01:41.010005+0000, chain.objs.size()=1 2024-09-12T01:11:22.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.m6QndgTaKkiq58k3zGMNenUe49BoZ3S_0 2024-09-12T01:11:22.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.646+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6032104558766683540', time=2024-09-12T03:01:41.012905+0000, chain.objs.size()=1 2024-09-12T01:11:22.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.646+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Y_nn-jhJzAN09xqAMx7PwIJhq1n-y2y_0 2024-09-12T01:11:22.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.646+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7434775927726179544', time=2024-09-12T03:01:41.215777+0000, chain.objs.size()=1 2024-09-12T01:11:22.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.646+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.d4blnAdGdVF-AnI5q398VVQLTsTQTLW_0 2024-09-12T01:11:22.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.648+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6217301772299067184', time=2024-09-12T03:01:41.230326+0000, chain.objs.size()=1 2024-09-12T01:11:22.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.648+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Drejcqw8ftgZvO2dy0ZTe2Tz85PRX9T_0 2024-09-12T01:11:22.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4753297960050679229', time=2024-09-12T03:01:41.331320+0000, chain.objs.size()=1 2024-09-12T01:11:22.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.r4u5t0QZ8AzkW8DMOScFK8IbVzGFJ1p_0 2024-09-12T01:11:22.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11738617599429695271', time=2024-09-12T03:01:41.349497+0000, chain.objs.size()=1 2024-09-12T01:11:22.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.RJDcyGCZDkmcYWdSbNbNileg9mrbQsD_0 2024-09-12T01:11:22.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9059704004995265763', time=2024-09-12T03:01:41.533376+0000, chain.objs.size()=1 2024-09-12T01:11:22.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.YMR2PmveNDAKehVY7wZHzYx0yo0KRUV_0 2024-09-12T01:11:22.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16799557319601546081', time=2024-09-12T03:01:41.556558+0000, chain.objs.size()=1 2024-09-12T01:11:22.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WJbxWW5GevzTtkFNY707fLkE0L4QQ_8_0 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4069724973378905212', time=2024-09-12T03:01:41.580614+0000, chain.objs.size()=1 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zF-jlAjPVW-4xXkmG2xVv2AqN_tC35B_0 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17565217789534101077', time=2024-09-12T03:01:41.596895+0000, chain.objs.size()=1 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.b3QU23CvDlqNPz2Ia16O7hssJKP-c8H_0 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7054518080472688659', time=2024-09-12T03:01:41.712778+0000, chain.objs.size()=1 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.BmFLb99Zj4s6Nf2BWvzuMHwJhgUqfpq_0 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1144008785553126075', time=2024-09-12T03:01:41.768121+0000, chain.objs.size()=1 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.652+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4MHU3Djr8R3oe80_OxNpmdRY4_gPVU8_0 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.652+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4567131695528797116', time=2024-09-12T03:01:41.788022+0000, chain.objs.size()=1 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.652+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lF0_r2OMX6cTIMoNgP6ncswJIiGRdeL_0 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.652+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7526377308296954747', time=2024-09-12T03:01:41.789578+0000, chain.objs.size()=1 2024-09-12T01:11:22.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.652+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mzjBO-1N9JyF4tHN_BcjIwYzV9NcuuS_0 2024-09-12T01:11:22.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.654+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3380600240618227199', time=2024-09-12T03:01:41.811431+0000, chain.objs.size()=1 2024-09-12T01:11:22.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.654+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WidmP1ohggR70Kfch1MNKWn-Dmjw-lA_0 2024-09-12T01:11:22.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.654+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5182931094772545328', time=2024-09-12T03:01:42.000714+0000, chain.objs.size()=1 2024-09-12T01:11:22.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.654+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fD2hzvArQ3xKyeb_KUK2p9elNpfBofh_0 2024-09-12T01:11:22.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.655+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15710537123558768039', time=2024-09-12T03:01:50.291676+0000, chain.objs.size()=1 2024-09-12T01:11:22.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.655+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.K2GYnf8AtDX0Z7mlgwe5JsjW_9CPAu1_0 2024-09-12T01:11:22.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.657+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5873794598520122399', time=2024-09-12T03:01:50.317890+0000, chain.objs.size()=1 2024-09-12T01:11:22.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.657+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.taRGff6TTTrteOGHbM7gFIOEtm1-4jV_0 2024-09-12T01:11:22.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.657+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7380440637918707677', time=2024-09-12T03:01:50.562395+0000, chain.objs.size()=1 2024-09-12T01:11:22.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.657+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rB740FHc8AD3OBQlhViIkNrqsfq6gKd_0 2024-09-12T01:11:22.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.657+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2652133381161186336', time=2024-09-12T03:01:50.569730+0000, chain.objs.size()=1 2024-09-12T01:11:22.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.657+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QerqdW_anYI7HA8_wt6clW7y6-mgjdZ_0 2024-09-12T01:11:22.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.657+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17693328097305910911', time=2024-09-12T03:01:50.578188+0000, chain.objs.size()=1 2024-09-12T01:11:22.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.657+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.y-wAsJYs5_pSFbVnr4MmjWgVY9KfLl-_0 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17970130904804958544', time=2024-09-12T03:01:50.587597+0000, chain.objs.size()=1 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6flRqH1v4JQkEtSr0n_Z7kjZQ2Cas8Q_0 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7263754098394866640', time=2024-09-12T03:01:50.686143+0000, chain.objs.size()=1 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.keVAeKJMGNSRTCPniqDU8VHheB5ZjhI_0 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.158226776816514186', time=2024-09-12T03:01:50.710912+0000, chain.objs.size()=1 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MwNTRzh1DH8mDkpYN6mwLp0WZuz8X3f_0 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12963685090971538634', time=2024-09-12T03:01:50.818113+0000, chain.objs.size()=1 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.HWGMFqVPG7BLVPVlY4FxPfyePziXmbE_0 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16531962016932827737', time=2024-09-12T03:01:51.114819+0000, chain.objs.size()=1 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9jo9URMicRnn81UBbUAiA-QIIKY8Jn2_0 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17016613889923884730', time=2024-09-12T03:01:51.158767+0000, chain.objs.size()=1 2024-09-12T01:11:22.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.UICLGHiYMvhUGoVsSVReC6KUP0Kf4UX_0 2024-09-12T01:11:22.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6540756014199261278', time=2024-09-12T03:01:51.206473+0000, chain.objs.size()=1 2024-09-12T01:11:22.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.659+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.x8EbHf__BNLBUYcF1y1KrbzJuctm7s__0 2024-09-12T01:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.662+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14942613636976211272', time=2024-09-12T03:01:51.254030+0000, chain.objs.size()=1 2024-09-12T01:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.662+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._OPaLnPCd3N7bDGINYW8MI5FMK7I_Se_0 2024-09-12T01:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.662+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12314684048369622356', time=2024-09-12T03:01:51.272701+0000, chain.objs.size()=1 2024-09-12T01:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.662+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.elNJ4V1VvnetrkSX0y6k-Ed4WixMsUv_0 2024-09-12T01:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.662+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5163558557609869498', time=2024-09-12T03:01:51.361292+0000, chain.objs.size()=1 2024-09-12T01:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.662+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.sspsa8IsV1jWOVVGKKtUEJskACEEnuT_0 2024-09-12T01:11:22.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.662+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16098150907194378524', time=2024-09-12T03:01:51.487404+0000, chain.objs.size()=1 2024-09-12T01:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.662+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.g6VxKBm40zeMfxgPfr5TjAZ0ud1tqrw_0 2024-09-12T01:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.663+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11264778694017712585', time=2024-09-12T03:01:51.504353+0000, chain.objs.size()=1 2024-09-12T01:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.663+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lE-e6CZEgED9tsfktEr_K0puqaW638y_0 2024-09-12T01:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.663+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11246603384062650573', time=2024-09-12T03:01:51.560037+0000, chain.objs.size()=1 2024-09-12T01:11:22.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.663+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rKiV76AygnwFbYa-Aa0S5T_b2eQKakQ_0 2024-09-12T01:11:22.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.663+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16412755192352199176', time=2024-09-12T03:01:51.632259+0000, chain.objs.size()=1 2024-09-12T01:11:22.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.664+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DoNPTb0vpfxs1cCZ1vH95FTIqvwCPmV_0 2024-09-12T01:11:22.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.664+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18375800784202983652', time=2024-09-12T03:01:51.726691+0000, chain.objs.size()=1 2024-09-12T01:11:22.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.664+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Ahh52ci4l8WtcERoyXMDB7lLdesVMEh_0 2024-09-12T01:11:22.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.664+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12811889019294439463', time=2024-09-12T03:01:51.745114+0000, chain.objs.size()=1 2024-09-12T01:11:22.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.664+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jQe0KCc6M_zHXKRojQ7UQAcUlENfLc8_0 2024-09-12T01:11:22.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.664+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8924744663290780614', time=2024-09-12T03:01:51.777171+0000, chain.objs.size()=1 2024-09-12T01:11:22.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.664+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.O91JWb76irymPbes7B9NwDL13Ley-sx_0 2024-09-12T01:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.665+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5792012992338864021', time=2024-09-12T03:01:51.785644+0000, chain.objs.size()=1 2024-09-12T01:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.665+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.V2oH2KcbORZ2UX_iEAqmtQ1nrX6YEe-_0 2024-09-12T01:11:22.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9588367158150412946', time=2024-09-12T03:01:51.795709+0000, chain.objs.size()=1 2024-09-12T01:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hjBR_wSp3jdQx0XPxMux7aJIuyA0DU9_0 2024-09-12T01:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17075793637956063232', time=2024-09-12T03:01:51.947635+0000, chain.objs.size()=1 2024-09-12T01:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DUjDKywWovHj0YVS-8XpLjpI7WeUg1J_0 2024-09-12T01:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15976077246818826405', time=2024-09-12T03:01:51.964392+0000, chain.objs.size()=1 2024-09-12T01:11:22.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hOaDfVfmr3HM7R6roZeKAcZCy0_7oB6_0 2024-09-12T01:11:22.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15142656587713605483', time=2024-09-12T03:01:51.981892+0000, chain.objs.size()=1 2024-09-12T01:11:22.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vpVDJndCHJMBgmNiCtby1vPGPN8qX3F_0 2024-09-12T01:11:22.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2214022352740430857', time=2024-09-12T03:01:52.054727+0000, chain.objs.size()=1 2024-09-12T01:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.y552ioklY_AB1VsZYOubcWHYY8sPs-E_0 2024-09-12T01:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6906110171800500132', time=2024-09-12T03:01:52.207493+0000, chain.objs.size()=1 2024-09-12T01:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6SyHQIgLr8CoCqMEGGMeFp-9rDCyKum_0 2024-09-12T01:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17698808194189734628', time=2024-09-12T03:01:52.254639+0000, chain.objs.size()=1 2024-09-12T01:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LW8enkDmwmu-iC4_YuHnQx0g8svFGEs_0 2024-09-12T01:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16715156555295143606', time=2024-09-12T03:01:52.267476+0000, chain.objs.size()=1 2024-09-12T01:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pJkOR0ukIn6HlZZJQQSQKRCfisP-Exd_0 2024-09-12T01:11:22.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3294334318480748451', time=2024-09-12T03:02:50.100215+0000, chain.objs.size()=1 2024-09-12T01:11:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.444__shadow_.UsksnwMhy8lz5hAr30JxlbfDOyB7_Fr_0 2024-09-12T01:11:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12172079624379490716', time=2024-09-12T03:03:03.909213+0000, chain.objs.size()=1 2024-09-12T01:11:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.466__shadow_.QF9SEddncZ4r-C0ZMcxJzc_1etgX5xm_0 2024-09-12T01:11:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9355211597276114789', time=2024-09-12T03:03:10.091043+0000, chain.objs.size()=1 2024-09-12T01:11:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.3TClb__YeCCr3q6XE0UAqBsK5jhdARi_0 2024-09-12T01:11:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14392269742303854463', time=2024-09-12T03:03:19.459684+0000, chain.objs.size()=1 2024-09-12T01:11:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.669+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.504__shadow:Sxqts83E9ch0mXuzA3cUygir9GtCc0q_.GJXGml4UggGV5JB-2HNawTbAzqH1P1u_0 2024-09-12T01:11:22.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.671+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3842499271145838439', time=2024-09-12T03:03:19.648921+0000, chain.objs.size()=1 2024-09-12T01:11:22.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.671+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.504__shadow:Sxqts83E9ch0mXuzA3cUygir9GtCc0q_.GJXGml4UggGV5JB-2HNawTbAzqH1P1u_0 2024-09-12T01:11:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.674+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~LSGBREqlJRa7Mic__7bh3d74fVsii5v', time=2024-09-12T03:03:52.993326+0000, chain.objs.size()=1 2024-09-12T01:11:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.674+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.536__multipart_mymultipart.2~LSGBREqlJRa7Mic__7bh3d74fVsii5v.3 2024-09-12T01:11:22.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7377600261476882338', time=2024-09-12T03:04:29.523217+0000, chain.objs.size()=1 2024-09-12T01:11:22.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.556__shadow_.muSxhvWBsK8MYTlxWbgaT0fXpg2ySPc_0 2024-09-12T01:11:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~fqgYdIOMsdVlR2PjdXF-GOi9IsRXMPE', time=2024-09-12T03:04:32.864603+0000, chain.objs.size()=1 2024-09-12T01:11:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.562__multipart_mymultipart.2~fqgYdIOMsdVlR2PjdXF-GOi9IsRXMPE.1 2024-09-12T01:11:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16888550962454586241', time=2024-09-12T03:04:46.445100+0000, chain.objs.size()=1 2024-09-12T01:11:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:1VOxuHw-q9dP44PNgRnCW-SgIYYutD6_.y9nm6RxIknzxwJj5mOG8L6-jnEWftFq_0 2024-09-12T01:11:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3220305060085280267', time=2024-09-12T03:04:48.626938+0000, chain.objs.size()=1 2024-09-12T01:11:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.573__shadow:0Bt.8NYaWQ-tnBDjZ7mxyth.SngjxNm_.GV1Tbmp9Too8pBREpIVByjC0efAOAdK_0 2024-09-12T01:11:22.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.679+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/53484 2024-09-12T01:11:22.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.681+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.681+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14774994713240418857', time=2024-09-12T03:04:53.645305+0000, chain.objs.size()=1 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.681+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:o5KF2.1HQTLw-ihTaJbjMy4k8ENaERN_.6QoN9uDdn5z2AZcKZenz0pq_CpoCPjZ_0 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.681+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1983035266956208405', time=2024-09-12T03:04:54.993912+0000, chain.objs.size()=1 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.681+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:H6Ywif019bFu1MacpCKYrEOnUMRhoS7_.Xc54gCBOyKsX0K2YahWXw_EZh080Vro_0 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.681+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13712468664082989890', time=2024-09-12T03:05:12.883625+0000, chain.objs.size()=1 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.681+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:RioZ7VY4pS7GeW2Dvt1wVKpC5YTqfEH_.rPf1iOhO9-69QxEwYqUori0IefQ-YZu_0 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.681+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14052706178227038284', time=2024-09-12T03:05:12.922340+0000, chain.objs.size()=1 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.681+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:cuq5LdZvF74xUzM5fcPZ3l-bIxK26fk_.0Vzeaz88igd_Ag0tZY1Oem8_C8y32rY_0 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12046858980332419830', time=2024-09-12T03:05:14.125777+0000, chain.objs.size()=1 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:KODN.8dZDpGzIgch7yFt-tCcoP7nMV6_.tgb73D62C7eSPLCpdH7jpLDdHwIXAd7_0 2024-09-12T01:11:22.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8846103087174590995', time=2024-09-12T03:05:16.868200+0000, chain.objs.size()=1 2024-09-12T01:11:22.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.586__shadow:bd9gXhQ5Tfulc5seurwW2av6LXFh4lg_.Ifzu1-4NyILOdX8UB3N_8UeDsfStGEv_0 2024-09-12T01:11:22.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8122151980932885163', time=2024-09-12T03:08:02.419507+0000, chain.objs.size()=1 2024-09-12T01:11:22.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.665__shadow_.mmuNOj7zHkxrL9csJiTFT04N2y1jbnc_0 2024-09-12T01:11:22.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12380923029826316266', time=2024-09-12T03:08:18.213579+0000, chain.objs.size()=1 2024-09-12T01:11:22.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.703__multipart_file1.2~WtHNvpC9QiNjleRUj3LzjY0CrFBR-LS.1 2024-09-12T01:11:22.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10348542310625526176', time=2024-09-12T03:08:18.703096+0000, chain.objs.size()=1 2024-09-12T01:11:22.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.682+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.704__shadow:9q5PiPnTUe0TR4T5WNVpWVsnONBJLig_.5VOFrcXQrMCrMAtFPGSEtBZdXS0xynD_0 2024-09-12T01:11:22.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.686+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:22.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.688+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:11:22.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.689+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:22.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.690+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:22.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53320' 2024-09-12T01:11:22.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.997652903758915716', time=2024-09-12T02:58:55.409471+0000, chain.objs.size()=5 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__multipart_foo-FROZEN.2~vlWm_w1Tc5lXkltd5oSjl6MhTS70xTf.1 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_foo-FROZEN.2~vlWm_w1Tc5lXkltd5oSjl6MhTS70xTf.1_1 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__multipart_foo-FROZEN.2~vlWm_w1Tc5lXkltd5oSjl6MhTS70xTf.2 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_foo-FROZEN.2~vlWm_w1Tc5lXkltd5oSjl6MhTS70xTf.2_1 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__multipart_foo-FROZEN.2~vlWm_w1Tc5lXkltd5oSjl6MhTS70xTf.3 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~L_kkq7AiqFJgUDzRtZxSON3oHc3Fu15', time=2024-09-12T02:59:26.819025+0000, chain.objs.size()=2 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.203__multipart_mymultipart.2~L_kkq7AiqFJgUDzRtZxSON3oHc3Fu15.1 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.203__shadow_mymultipart.2~L_kkq7AiqFJgUDzRtZxSON3oHc3Fu15.1_1 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4493175458591232291', time=2024-09-12T03:00:37.116663+0000, chain.objs.size()=1 2024-09-12T01:11:22.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.236__shadow_.1vud9qUPynuMXKHzgnWNFWkTgoHLshj_0 2024-09-12T01:11:22.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17984295169248666844', time=2024-09-12T03:00:43.169788+0000, chain.objs.size()=1 2024-09-12T01:11:22.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.246__shadow_.V60P6oPSmsRpP32kFvIpqLRzGYDXQg2_0 2024-09-12T01:11:22.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12370813087323073728', time=2024-09-12T03:00:44.544119+0000, chain.objs.size()=1 2024-09-12T01:11:22.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.249__shadow_.g1129mWbuuY7X2FgiMfZJbrYnbuzMwj_0 2024-09-12T01:11:22.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17894878915486463102', time=2024-09-12T03:00:45.060208+0000, chain.objs.size()=1 2024-09-12T01:11:22.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.250__shadow_.93iC_bZlru1uaxZBZszjW0DTO08lRGx_0 2024-09-12T01:11:22.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10946850911388638831', time=2024-09-12T03:00:45.502777+0000, chain.objs.size()=1 2024-09-12T01:11:22.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.251__shadow_.1SfFuy7geXjp_YXSMBk07l-8QAzdHKw_0 2024-09-12T01:11:22.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4277563202590536', time=2024-09-12T03:00:47.883051+0000, chain.objs.size()=1 2024-09-12T01:11:22.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.256__shadow_.ZWPE1__SCbotvYVJ3MvTtjvQPaMHBto_0 2024-09-12T01:11:22.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13552332922573675490', time=2024-09-12T03:00:58.943279+0000, chain.objs.size()=1 2024-09-12T01:11:22.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DMjQ5eUgQaLfVnDzZ8eW6SkS584n8xo_0 2024-09-12T01:11:22.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.871845680700576533', time=2024-09-12T03:00:58.985565+0000, chain.objs.size()=1 2024-09-12T01:11:22.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.t04CAKRtCjk2BiTM_xEgQiso5GvIFOd_0 2024-09-12T01:11:22.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10367276408788494212', time=2024-09-12T03:00:59.127409+0000, chain.objs.size()=1 2024-09-12T01:11:22.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.q1lmTUZRyH3V5p9l26Wz4d7wOApcWhk_0 2024-09-12T01:11:22.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13535423289255683024', time=2024-09-12T03:00:59.148873+0000, chain.objs.size()=1 2024-09-12T01:11:22.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.694+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Vd3mBk7jvpPZBlGSYQkjAORKfhM2-mZ_0 2024-09-12T01:11:22.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.695+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14655693750829915782', time=2024-09-12T03:00:59.181108+0000, chain.objs.size()=1 2024-09-12T01:11:22.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.695+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.12gWBweAp6CFCkL8Q2rGX5ComDOo4xe_0 2024-09-12T01:11:22.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.695+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17508012876476117658', time=2024-09-12T03:00:59.211199+0000, chain.objs.size()=1 2024-09-12T01:11:22.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.695+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.yXSdqDnv62XkpmTD-sgyzQmKHKzQNmC_0 2024-09-12T01:11:22.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8602413061612466742', time=2024-09-12T03:00:59.245606+0000, chain.objs.size()=1 2024-09-12T01:11:22.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9LJyHkd6ecolDBr-3U7LkMpJEEmwRo5_0 2024-09-12T01:11:22.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12804263200087856382', time=2024-09-12T03:00:59.283066+0000, chain.objs.size()=1 2024-09-12T01:11:22.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6WWvRp5NO_WTYtYU3IM96JT_O4h5byF_0 2024-09-12T01:11:22.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10962441575698320103', time=2024-09-12T03:00:59.406595+0000, chain.objs.size()=1 2024-09-12T01:11:22.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5eh18mz1yxF2Mhjh9gDD0wW0YwC760m_0 2024-09-12T01:11:22.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8130571086806856862', time=2024-09-12T03:00:59.461389+0000, chain.objs.size()=1 2024-09-12T01:11:22.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dq8Xu894kEfv8CNyzdat1KysCBFqK5h_0 2024-09-12T01:11:22.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10802232535703560713', time=2024-09-12T03:00:59.516658+0000, chain.objs.size()=1 2024-09-12T01:11:22.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.R6-NHg_ZNDW7InwhXj5-bd1F3Irgfag_0 2024-09-12T01:11:22.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9170221810812486414', time=2024-09-12T03:00:59.524451+0000, chain.objs.size()=1 2024-09-12T01:11:22.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uuzOIDS0QCaXJCUsNWkUTkoGi7ivenu_0 2024-09-12T01:11:22.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13390122712806649072', time=2024-09-12T03:00:59.701001+0000, chain.objs.size()=1 2024-09-12T01:11:22.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.E3EgxCY0t3xlgYeGFWaFsZSALnOk4AL_0 2024-09-12T01:11:22.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9149190973799886342', time=2024-09-12T03:00:59.786673+0000, chain.objs.size()=1 2024-09-12T01:11:22.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KgGL3uQTCC-NTxQ_M-QTvumGPF_CPHB_0 2024-09-12T01:11:22.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5439750283117463298', time=2024-09-12T03:00:59.817886+0000, chain.objs.size()=1 2024-09-12T01:11:22.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bpAI8-NsdYHdB8O0m-RGu0-6RT4pq0X_0 2024-09-12T01:11:22.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14946114024059811596', time=2024-09-12T03:01:00.030903+0000, chain.objs.size()=1 2024-09-12T01:11:22.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.olg1Rm0kcWcMuERUVpvDU4BNUjL0fUd_0 2024-09-12T01:11:22.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12058600722529962978', time=2024-09-12T03:01:00.089544+0000, chain.objs.size()=1 2024-09-12T01:11:22.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.700+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.I7bOe_A-VndGUQAq97QssIsTIgawzdh_0 2024-09-12T01:11:22.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.701+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7578366052276788149', time=2024-09-12T03:01:00.108942+0000, chain.objs.size()=1 2024-09-12T01:11:22.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.701+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tsHzXGUJY_b0RoU3xYig8YefCo7Tw6K_0 2024-09-12T01:11:22.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.701+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9228802305285723014', time=2024-09-12T03:01:00.326731+0000, chain.objs.size()=1 2024-09-12T01:11:22.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.701+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.91_CNM6pfnvYk7qskqyKleme55jxMxn_0 2024-09-12T01:11:22.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6033536724671372817', time=2024-09-12T03:01:00.387073+0000, chain.objs.size()=1 2024-09-12T01:11:22.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.b6VfOddFaHjORniLP9XfAtUfBfHh_xo_0 2024-09-12T01:11:22.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.288455342527789967', time=2024-09-12T03:01:00.418676+0000, chain.objs.size()=1 2024-09-12T01:11:22.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MAp3lxBsmNlamebHKn5oM9_aZM6peYJ_0 2024-09-12T01:11:22.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.704+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13630977369897987576', time=2024-09-12T03:01:00.459232+0000, chain.objs.size()=1 2024-09-12T01:11:22.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.704+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WTcLkOR192N6t8S2NFX2GZrPfnSBwZl_0 2024-09-12T01:11:22.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.704+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15663866896381140569', time=2024-09-12T03:01:00.476610+0000, chain.objs.size()=1 2024-09-12T01:11:22.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.704+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.w2LwhtLJYPGgEWBCzw87g5L8uDwdAGA_0 2024-09-12T01:11:22.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.704+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3603049255445899917', time=2024-09-12T03:01:00.592170+0000, chain.objs.size()=1 2024-09-12T01:11:22.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.704+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4VXCFEr28_RG9F2SVt6KEn8COfAzHVU_0 2024-09-12T01:11:22.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.704+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2618948952166632711', time=2024-09-12T03:01:00.603082+0000, chain.objs.size()=1 2024-09-12T01:11:22.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.704+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RluBNXvbquaA_Ga4ab3coz9f4Ol5ZXK_0 2024-09-12T01:11:22.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.705+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4808860859902173958', time=2024-09-12T03:01:00.738718+0000, chain.objs.size()=1 2024-09-12T01:11:22.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.705+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Ds30JeW1n2YupCMCW1bNtKUNE_-wigP_0 2024-09-12T01:11:22.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.705+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2411060628218825252', time=2024-09-12T03:01:00.740246+0000, chain.objs.size()=1 2024-09-12T01:11:22.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.705+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SXPE-KulU3yIIQtx2mPQxAiUUnJxIiT_0 2024-09-12T01:11:22.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.705+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17471286025224113493', time=2024-09-12T03:01:00.874804+0000, chain.objs.size()=1 2024-09-12T01:11:22.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.705+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.12uv2Z5RJkUhNhtuT-E-dA4qZTJcGXw_0 2024-09-12T01:11:22.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.705+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4475294306817317', time=2024-09-12T03:01:00.902115+0000, chain.objs.size()=1 2024-09-12T01:11:22.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.705+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.d0qrNlj8H0QnpnbNbUvQ1M5spfI2Aw3_0 2024-09-12T01:11:22.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.706+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3327973278831215856', time=2024-09-12T03:01:00.934443+0000, chain.objs.size()=1 2024-09-12T01:11:22.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.706+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.EpH4NufVKK_MPLKUZW0tpUfRoaVHFOQ_0 2024-09-12T01:11:22.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.707+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15911010407616954820', time=2024-09-12T03:01:05.161996+0000, chain.objs.size()=1 2024-09-12T01:11:22.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.272__shadow_.YpPNsL-lFSdKUe_0zNcSVoviuLdM41M_0 2024-09-12T01:11:22.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.707+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7776228102486502403', time=2024-09-12T03:01:07.919669+0000, chain.objs.size()=1 2024-09-12T01:11:22.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.278__shadow_.wpr8O9GT9pr6ce4wVjcPsk8JFe6DJwd_0 2024-09-12T01:11:22.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.709+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.479188281795731840', time=2024-09-12T03:01:07.920381+0000, chain.objs.size()=1 2024-09-12T01:11:22.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.709+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.278__shadow_.f1Xtsr-X0DQ-tjSW6Eep4j6FabLRx3I_0 2024-09-12T01:11:22.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.709+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12465323280880127280', time=2024-09-12T03:01:09.867319+0000, chain.objs.size()=1 2024-09-12T01:11:22.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.709+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.282__shadow_.GGs-tNThFUQtPyhnPq0ISSY5Nq95inK_0 2024-09-12T01:11:22.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.709+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11512534760430274621', time=2024-09-12T03:01:15.862974+0000, chain.objs.size()=1 2024-09-12T01:11:22.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.709+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.e-l4tPURRzXc304DnoGT-eXeW6at4nU_0 2024-09-12T01:11:22.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.710+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15152425724042440568', time=2024-09-12T03:01:16.646473+0000, chain.objs.size()=1 2024-09-12T01:11:22.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.710+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.YU607jYT7HdZmGsi2K_U-cX4Q75L4L-_0 2024-09-12T01:11:22.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.710+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14065809210224319897', time=2024-09-12T03:01:16.669808+0000, chain.objs.size()=1 2024-09-12T01:11:22.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.710+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.0VbkIIHaLG54AaTQNefgDJmFLDL1ifK_0 2024-09-12T01:11:22.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.710+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16328643745749326220', time=2024-09-12T03:01:17.576748+0000, chain.objs.size()=1 2024-09-12T01:11:22.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.710+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.296__shadow_.kxlHaC8PPy_OVd0SiGNXz2QO_Q_lN3E_0 2024-09-12T01:11:22.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17870651360839353236', time=2024-09-12T03:01:20.063085+0000, chain.objs.size()=1 2024-09-12T01:11:22.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.301__shadow_.cHfb2tqJ0EJzsHITAEMcy0ZvmOQ1FhP_0 2024-09-12T01:11:22.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5126742542139039967', time=2024-09-12T03:01:21.996289+0000, chain.objs.size()=1 2024-09-12T01:11:22.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.305__shadow_.Qjk38YteM3zxeoBJB3iKIUqGtPkAifl_0 2024-09-12T01:11:22.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11702797100743930174', time=2024-09-12T03:01:29.457964+0000, chain.objs.size()=1 2024-09-12T01:11:22.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.320__shadow:lXm64kO4q3KFHbO91iwhFLkc56gg7fL_.1xweVmPE0V9Mc6vbKYgWMkq7ieAuIXo_0 2024-09-12T01:11:22.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16546302269038676193', time=2024-09-12T03:01:40.111356+0000, chain.objs.size()=1 2024-09-12T01:11:22.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.iQoeYj9-fBvlQHH3KEfbbdzVNU4Arfx_0 2024-09-12T01:11:22.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11264627956665915609', time=2024-09-12T03:01:40.113928+0000, chain.objs.size()=1 2024-09-12T01:11:22.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.711+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.XvBsdcgJgHg7CLc1NgG7L23lbfL2fVS_0 2024-09-12T01:11:22.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.712+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9215666502431495008', time=2024-09-12T03:01:40.139414+0000, chain.objs.size()=1 2024-09-12T01:11:22.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.712+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ldSVmE7T8XG2wCsJp2MaZgU1U6oMcdL_0 2024-09-12T01:11:22.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.714+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12637457740933708973', time=2024-09-12T03:01:40.202065+0000, chain.objs.size()=1 2024-09-12T01:11:22.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.714+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.YTJ-F-oUDfrbu-I9jDoDksFI2zF5uFS_0 2024-09-12T01:11:22.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.714+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13968977489219938942', time=2024-09-12T03:01:40.409455+0000, chain.objs.size()=1 2024-09-12T01:11:22.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.714+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wCmDq_j8eRiqnJAM3uephs3HYTB4woi_0 2024-09-12T01:11:22.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.714+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8814927161666334587', time=2024-09-12T03:01:40.415882+0000, chain.objs.size()=1 2024-09-12T01:11:22.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.714+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.HaHycJjvjJEWmQIHjbYa-5D7VAuN5fC_0 2024-09-12T01:11:22.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.714+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10417618013478291225', time=2024-09-12T03:01:40.475646+0000, chain.objs.size()=1 2024-09-12T01:11:22.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.714+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0-Wj5KF1vaXX3GOoMq4b0rsBaRtzWxK_0 2024-09-12T01:11:22.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.715+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3787635816486920328', time=2024-09-12T03:01:40.483322+0000, chain.objs.size()=1 2024-09-12T01:11:22.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.715+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GILSt-rnbi4tyh7F392DMzTjAXH7rBN_0 2024-09-12T01:11:22.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.715+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6829677130247819674', time=2024-09-12T03:01:40.542285+0000, chain.objs.size()=1 2024-09-12T01:11:22.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.715+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2lloj9yb7b2SL7ztzaC6c_lvyOcatCl_0 2024-09-12T01:11:22.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6019044876213546185', time=2024-09-12T03:01:40.546971+0000, chain.objs.size()=1 2024-09-12T01:11:22.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8NRxdzM3joFsQsUJJOzJiY0WX-eiHPZ_0 2024-09-12T01:11:22.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18319625157374688092', time=2024-09-12T03:01:40.547977+0000, chain.objs.size()=1 2024-09-12T01:11:22.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.a7dCItyo2WLxt6M8iYDONfDl_lVjK-Y_0 2024-09-12T01:11:22.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8001519349196408658', time=2024-09-12T03:01:40.647592+0000, chain.objs.size()=1 2024-09-12T01:11:22.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.9GweTCB1SGJjQr40R1jnYFUuXIjMGBn_0 2024-09-12T01:11:22.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15982329778140640110', time=2024-09-12T03:01:40.648413+0000, chain.objs.size()=1 2024-09-12T01:11:22.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.D_zBKkIvi0P26VkXzbjOeFVm9NXWpIq_0 2024-09-12T01:11:22.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3007052552738117025', time=2024-09-12T03:01:40.706020+0000, chain.objs.size()=1 2024-09-12T01:11:22.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ym_YLfIKLfJxLZi9_o0LXtgM1Qxvc-Y_0 2024-09-12T01:11:22.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.988683578203862269', time=2024-09-12T03:01:40.725369+0000, chain.objs.size()=1 2024-09-12T01:11:22.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.717+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eMjqLhnVlUaNHqQ8XNs3W213EoErtJ5_0 2024-09-12T01:11:22.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10660844644950115361', time=2024-09-12T03:01:40.735390+0000, chain.objs.size()=1 2024-09-12T01:11:22.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eLgzTNxeKFeRqp7ZO-VdrmVy5JxAoYG_0 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.138621682534765274', time=2024-09-12T03:01:40.803935+0000, chain.objs.size()=1 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.84DMmvBC7o2fTtcjEyDuWUSrAvsR0SX_0 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3071686610468662814', time=2024-09-12T03:01:40.825976+0000, chain.objs.size()=1 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zWV_2RVp_NieP8GrVOL0RYgNFcUTxQz_0 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17097579974218080934', time=2024-09-12T03:01:40.933289+0000, chain.objs.size()=1 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uIs0_MJvxp43Ux6Xf0Td4BzLzg2ygpD_0 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7554539058004207267', time=2024-09-12T03:01:40.972552+0000, chain.objs.size()=1 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zXEoQcnLtVBYsLnUIBleM61mrPdNo9E_0 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4072435202703276939', time=2024-09-12T03:01:41.255814+0000, chain.objs.size()=1 2024-09-12T01:11:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NDorNgEqEOZZ6zqKxYlvL_e5c4N1_vr_0 2024-09-12T01:11:22.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5899616698023691037', time=2024-09-12T03:01:41.292215+0000, chain.objs.size()=1 2024-09-12T01:11:22.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.RzUHubp2NdTsKW8d-1mZkYiNO-BNQUe_0 2024-09-12T01:11:22.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13270613621094725790', time=2024-09-12T03:01:41.320110+0000, chain.objs.size()=1 2024-09-12T01:11:22.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.9q1dqk6H5m89A_zXJNR74XyLjB2FEbN_0 2024-09-12T01:11:22.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.659490955245344436', time=2024-09-12T03:01:41.445847+0000, chain.objs.size()=1 2024-09-12T01:11:22.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.722+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QOjH5Eu8LOPpiMttJugBJyhFKPJFAAt_0 2024-09-12T01:11:22.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.723+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5445474314577760091', time=2024-09-12T03:01:41.457193+0000, chain.objs.size()=1 2024-09-12T01:11:22.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.723+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.RkIWwI6ZsSZq2YlEP4tqXqZFkLY5ovo_0 2024-09-12T01:11:22.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.723+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13168664926205636147', time=2024-09-12T03:01:41.466744+0000, chain.objs.size()=1 2024-09-12T01:11:22.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.723+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.XZOMOz10HYhgMeMchIS9QzX-kEQJ_Rv_0 2024-09-12T01:11:22.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.724+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.825237793313616006', time=2024-09-12T03:01:41.500281+0000, chain.objs.size()=1 2024-09-12T01:11:22.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.724+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.33No-nYcdhQhUFjAs4f9cjgJmqI2wx6_0 2024-09-12T01:11:22.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17015534178236076784', time=2024-09-12T03:01:41.593480+0000, chain.objs.size()=1 2024-09-12T01:11:22.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.9ymggc3a1-S4pB1wnNaeIxms3HcJHhU_0 2024-09-12T01:11:22.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.727+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1394158202565682905', time=2024-09-12T03:01:41.626121+0000, chain.objs.size()=1 2024-09-12T01:11:22.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.727+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.XG443ZcggKMDL-0WE1yQwumJjt81ez6_0 2024-09-12T01:11:22.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.727+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13875698517802687004', time=2024-09-12T03:01:41.704921+0000, chain.objs.size()=1 2024-09-12T01:11:22.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.727+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.gL2wMjosSVwUjMCK0RwfSGj-CDxlDIR_0 2024-09-12T01:11:22.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5930409361273584182', time=2024-09-12T03:01:41.722042+0000, chain.objs.size()=1 2024-09-12T01:11:22.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.AMZKaLU5M_zJfa9ZZoLVu4vTNIBAgcN_0 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12509465711044349020', time=2024-09-12T03:01:41.726064+0000, chain.objs.size()=1 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lLfZqjloJmvJMjdD6Db1shRq1aKFey4_0 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2724058623840209675', time=2024-09-12T03:01:41.738179+0000, chain.objs.size()=1 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5--dEXjX6ZVnbqdVsuNL-4cr2KSiJFc_0 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6499355770313635552', time=2024-09-12T03:01:41.777401+0000, chain.objs.size()=1 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PKqiprAaect4WC1ji2Y-pdhSDta_JfJ_0 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4803730496352140815', time=2024-09-12T03:01:41.852648+0000, chain.objs.size()=1 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jM6vlfoWliKh5W8dZfF5GF-XusFpb3l_0 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18427893230979709230', time=2024-09-12T03:01:41.990301+0000, chain.objs.size()=1 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.u_EeLxUgAqCTLM3scJO7mB4XjKzBZIa_0 2024-09-12T01:11:22.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17203210771236619208', time=2024-09-12T03:01:41.992509+0000, chain.objs.size()=1 2024-09-12T01:11:22.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aRRsJKmDnl6tQeOx8-edfPjAHYPCark_0 2024-09-12T01:11:22.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15564326541645224466', time=2024-09-12T03:01:42.083900+0000, chain.objs.size()=1 2024-09-12T01:11:22.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.728+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.xw3LETnUFraiv6-pZsIDHerIr0ih1WM_0 2024-09-12T01:11:22.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7108605559465369785', time=2024-09-12T03:01:42.101558+0000, chain.objs.size()=1 2024-09-12T01:11:22.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bzJi_NAGrSWPww1OQXIlUMJiKfJEtbH_0 2024-09-12T01:11:22.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6547636466063563983', time=2024-09-12T03:01:50.228708+0000, chain.objs.size()=1 2024-09-12T01:11:22.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.izRh3EpugQigvxMl99tFBlE41mueG9G_0 2024-09-12T01:11:22.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13968501931687089839', time=2024-09-12T03:01:50.301521+0000, chain.objs.size()=1 2024-09-12T01:11:22.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.b6vX4tqj3ldL2JA0zriX91pyCUDApzj_0 2024-09-12T01:11:22.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15735746115977955665', time=2024-09-12T03:01:50.344271+0000, chain.objs.size()=1 2024-09-12T01:11:22.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.98zszFKd6rbEfoQlud340n7M1iH9w8g_0 2024-09-12T01:11:22.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14783842108014751870', time=2024-09-12T03:01:50.376958+0000, chain.objs.size()=1 2024-09-12T01:11:22.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.bCflxuQhkofbOM2Ap0FSoeWX9aElghq_0 2024-09-12T01:11:22.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6754032483356479094', time=2024-09-12T03:01:50.378944+0000, chain.objs.size()=1 2024-09-12T01:11:22.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-P7UYod5FDogmFsUqcn1gVBSCet4t02_0 2024-09-12T01:11:22.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9718916702164396825', time=2024-09-12T03:01:50.413657+0000, chain.objs.size()=1 2024-09-12T01:11:22.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0Ab7ILSvQr3ZQ7X6CTVdxgb-mlV7QHv_0 2024-09-12T01:11:22.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6382595363216695868', time=2024-09-12T03:01:50.534072+0000, chain.objs.size()=1 2024-09-12T01:11:22.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jPFllV1WjE5g_wZPaaRipK7BEjRBtT5_0 2024-09-12T01:11:22.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1061865392118017628', time=2024-09-12T03:01:50.551768+0000, chain.objs.size()=1 2024-09-12T01:11:22.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IRPlp_pw64pqHt94aBohjMwDPfIwo-m_0 2024-09-12T01:11:22.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16971025925664636982', time=2024-09-12T03:01:50.622748+0000, chain.objs.size()=1 2024-09-12T01:11:22.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6PCtSF5dqJWc2uc29ndlqnDumN5KPZi_0 2024-09-12T01:11:22.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16907932594281680526', time=2024-09-12T03:01:50.657714+0000, chain.objs.size()=1 2024-09-12T01:11:22.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.733+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.5t3z7BbA_CyAc78S03J4_NuFn-UGAsZ_0 2024-09-12T01:11:22.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6147339557636748334', time=2024-09-12T03:01:50.659709+0000, chain.objs.size()=1 2024-09-12T01:11:22.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.E8qesFJjidGHblKwhgHmzE0gT-Zf6nr_0 2024-09-12T01:11:22.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.737+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11176240327703260202', time=2024-09-12T03:01:50.663320+0000, chain.objs.size()=1 2024-09-12T01:11:22.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.737+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pD_mnI6z4vRvR5YZxGwRY7ximpuL2Fb_0 2024-09-12T01:11:22.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.740+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/53320 2024-09-12T01:11:22.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=45, truncated=0, next_marker='' 2024-09-12T01:11:22.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2906177653173087313', time=2024-09-12T03:01:50.672168+0000, chain.objs.size()=1 2024-09-12T01:11:22.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rc3dgRNeWDN6C_AUX5B_dwfmav9MCvj_0 2024-09-12T01:11:22.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13674242831744668647', time=2024-09-12T03:01:50.683705+0000, chain.objs.size()=1 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.k9jnwgfjyBd_3zlncIhhQNlvJnaAdxR_0 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9152179366710451512', time=2024-09-12T03:01:50.854347+0000, chain.objs.size()=1 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.nMDa9mEF1ATCxT_bw4gYf2ns39cJqW8_0 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14346243342204588170', time=2024-09-12T03:01:51.133427+0000, chain.objs.size()=1 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9oW0aNrpEmWxkShen7G10uy6FYFg18v_0 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16746375325584937817', time=2024-09-12T03:01:51.136682+0000, chain.objs.size()=1 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.410_vMaxVVZisZUmG0yLJ5aCMAH2ats_0 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1226495287283110785', time=2024-09-12T03:01:51.227312+0000, chain.objs.size()=1 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.D8khqYi5QxPliXInJR3PxtQTZz6gKVH_0 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11178948695144722372', time=2024-09-12T03:01:51.240860+0000, chain.objs.size()=1 2024-09-12T01:11:22.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DvwVYG38Ir_42SkWJEE7AdRUM5yGEOt_0 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14074569190992713545', time=2024-09-12T03:01:51.259410+0000, chain.objs.size()=1 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JjoArcbem6lO8tJWC3tdOXEdKOLrvW-_0 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10922459781632007149', time=2024-09-12T03:01:51.265183+0000, chain.objs.size()=1 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.UMvt0dYRhMbHn-e3MpopqJwPatcHjgm_0 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7387055647989500511', time=2024-09-12T03:01:51.491846+0000, chain.objs.size()=1 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zbRNuFcVkeKyFLiURoPBmFuexkq33wv_0 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14198751147053130144', time=2024-09-12T03:01:51.524648+0000, chain.objs.size()=1 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oIe1wHT5KYbo4SqQhompr2kMNdKC3z-_0 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5881910662015152650', time=2024-09-12T03:01:51.548378+0000, chain.objs.size()=1 2024-09-12T01:11:22.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FBvxQu4mC504B44WP_Qju1-uagQAD6C_0 2024-09-12T01:11:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.745+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15665306503374916297', time=2024-09-12T03:01:51.640618+0000, chain.objs.size()=1 2024-09-12T01:11:22.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.745+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.n6MQGbGBfqSVN6PrYXQxVdkFAxfuYJ0_0 2024-09-12T01:11:22.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.746+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12997602305103201702', time=2024-09-12T03:01:51.713733+0000, chain.objs.size()=1 2024-09-12T01:11:22.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.746+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0d_T64SIQZWPFGkKUTGph-Mj5MzQuD4_0 2024-09-12T01:11:22.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.746+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6309469927631933118', time=2024-09-12T03:01:51.789491+0000, chain.objs.size()=1 2024-09-12T01:11:22.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.746+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Wb8BHjsA0VIiTcFntmMyc3fvVDc-BJz_0 2024-09-12T01:11:22.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.747+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4119913048966299543', time=2024-09-12T03:01:51.801795+0000, chain.objs.size()=1 2024-09-12T01:11:22.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.747+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ki2XRBKGodf3YaK3S-P3ZauuPfkjkoz_0 2024-09-12T01:11:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.747+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16776983636658409565', time=2024-09-12T03:01:51.904108+0000, chain.objs.size()=1 2024-09-12T01:11:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.747+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LOZBR5zBS7-mtBH8-BUGx7GWCCVz8zA_0 2024-09-12T01:11:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10497608572069123166', time=2024-09-12T03:01:51.913341+0000, chain.objs.size()=1 2024-09-12T01:11:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.j6RUyc_k-suykO4tdIoSXXOaZG3OV8w_0 2024-09-12T01:11:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16003002893117747642', time=2024-09-12T03:01:51.939155+0000, chain.objs.size()=1 2024-09-12T01:11:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.97rg8RtMzqTdIAeqWBDpB0mWjsQTOeM_0 2024-09-12T01:11:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4053400149531807771', time=2024-09-12T03:01:51.966145+0000, chain.objs.size()=1 2024-09-12T01:11:22.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.K3dOky7ryr2mpg8gslhjohazcwGE6hB_0 2024-09-12T01:11:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9982963223826823296', time=2024-09-12T03:01:52.185791+0000, chain.objs.size()=1 2024-09-12T01:11:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xeUX3bjv-BC0onNEnoM3JO_2Zx6eW3M_0 2024-09-12T01:11:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7306661586948518976', time=2024-09-12T03:01:52.219493+0000, chain.objs.size()=1 2024-09-12T01:11:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.60AgWLIvlqxtoZdIuSRJeb-StgpH4lg_0 2024-09-12T01:11:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6930745118021079975', time=2024-09-12T03:01:52.235709+0000, chain.objs.size()=1 2024-09-12T01:11:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.748+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.27D8dY5RanEyesg6JdBNVT6bYowNuWk_0 2024-09-12T01:11:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.749+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9614879427792101695', time=2024-09-12T03:01:52.243285+0000, chain.objs.size()=1 2024-09-12T01:11:22.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.749+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.2pkBTkNy0JNbyoFoE_Ofw1zbnoyi7R-_0 2024-09-12T01:11:22.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.751+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4869987516812656731', time=2024-09-12T03:01:52.263543+0000, chain.objs.size()=1 2024-09-12T01:11:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.751+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tr-2Nrs5ZLmIAqdP8sK9DvwSI7FI2gU_0 2024-09-12T01:11:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.751+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13007895895402700247', time=2024-09-12T03:01:52.304005+0000, chain.objs.size()=1 2024-09-12T01:11:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.751+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.bc4EVnpIEr3Cqor8C7wekgu8w781Kgi_0 2024-09-12T01:11:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.752+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15053127386165076206', time=2024-09-12T03:03:03.909184+0000, chain.objs.size()=1 2024-09-12T01:11:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.752+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.466__shadow_.QLE822d0P2vD0U2qevVH51-WQNzMXBI_0 2024-09-12T01:11:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.752+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12353591213881682809', time=2024-09-12T03:03:04.498409+0000, chain.objs.size()=1 2024-09-12T01:11:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.752+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.467__shadow_.HJAB_6loJ2--eoTsrZ-kPJbUF0bwt_z_0 2024-09-12T01:11:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.752+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11527439639797777614', time=2024-09-12T03:03:10.081878+0000, chain.objs.size()=1 2024-09-12T01:11:22.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.752+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.wBOtNpJdsQcMu8iazV4a2-EclpC1gy0_0 2024-09-12T01:11:22.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16367936847157830727', time=2024-09-12T03:03:10.615997+0000, chain.objs.size()=1 2024-09-12T01:11:22.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.485__shadow_.YSM8IA7rJVuaW1z3LAMhykSBESDBCPg_0 2024-09-12T01:11:22.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16968965645942417935', time=2024-09-12T03:03:12.917921+0000, chain.objs.size()=1 2024-09-12T01:11:22.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.489__shadow_.FAa2IVyEvJ50-x_iAVEc-8rYFYyB8pC_0 2024-09-12T01:11:22.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8479460676264003400', time=2024-09-12T03:03:26.795802+0000, chain.objs.size()=1 2024-09-12T01:11:22.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.519__multipart_mymultipart.2~wCJlB51RE_rVWNjepIstr1TsaHxDocG.1 2024-09-12T01:11:22.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14985717883816385180', time=2024-09-12T03:03:27.564343+0000, chain.objs.size()=1 2024-09-12T01:11:22.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.519__multipart_mymultipart.2~IFDPen69BSN4P7bhHIabPcQQrKJPKgp.1 2024-09-12T01:11:22.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7694441159766618320', time=2024-09-12T03:03:48.353046+0000, chain.objs.size()=4 2024-09-12T01:11:22.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.528__multipart_mymultipart.2~owioZugnDho4dA76T8O7-TGNwBvye7n.1 2024-09-12T01:11:22.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.753+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.528__multipart_mymultipart.2~owioZugnDho4dA76T8O7-TGNwBvye7n.2 2024-09-12T01:11:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.528__multipart_mymultipart.2~owioZugnDho4dA76T8O7-TGNwBvye7n.3 2024-09-12T01:11:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.528__multipart_mymultipart.2~owioZugnDho4dA76T8O7-TGNwBvye7n.4 2024-09-12T01:11:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16282492011081121488', time=2024-09-12T03:03:48.828994+0000, chain.objs.size()=1 2024-09-12T01:11:22.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.529__shadow_.bd1KAneWUg8_rVVCq0Y4C3qE0dnYFzz_0 2024-09-12T01:11:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3233939770244749232', time=2024-09-12T03:04:29.346788+0000, chain.objs.size()=1 2024-09-12T01:11:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.556__shadow_.rOILj2wLy2u6MqUB-SPLHbpegAxM1Ua_0 2024-09-12T01:11:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5744480730561862850', time=2024-09-12T03:04:45.207329+0000, chain.objs.size()=1 2024-09-12T01:11:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:UgmjZ4ASaxSfoQ74QfNkY0dH3H6EYws_.xAGFK6jEPtV1YKPnF4NSkIbcW6sCcM-_0 2024-09-12T01:11:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14086863873754446004', time=2024-09-12T03:05:04.420926+0000, chain.objs.size()=1 2024-09-12T01:11:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:tqjBYy.s7JmWLlm.rt2YL.0PTPYeDy8_.Thfq1-GB1EfnttTABl6nvqzhuKIhPiM_0 2024-09-12T01:11:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.758+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.670993117997349998', time=2024-09-12T03:05:05.806835+0000, chain.objs.size()=1 2024-09-12T01:11:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.758+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:5CObTrNiCy8x7x4Lu8tfXij7UxOL5FL_.D5c3mT2xRvgS2H2Of3exhUU5eUPAx2l_0 2024-09-12T01:11:22.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.758+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15123058668230870044', time=2024-09-12T03:05:11.517464+0000, chain.objs.size()=4 2024-09-12T01:11:22.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.758+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~2LrlD7Ch5UhJA-AH-6jjcvN3IoB-AmJ.1 2024-09-12T01:11:22.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.758+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~2LrlD7Ch5UhJA-AH-6jjcvN3IoB-AmJ.2 2024-09-12T01:11:22.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.759+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~2LrlD7Ch5UhJA-AH-6jjcvN3IoB-AmJ.3 2024-09-12T01:11:22.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.759+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~2LrlD7Ch5UhJA-AH-6jjcvN3IoB-AmJ.4 2024-09-12T01:11:22.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.761+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7028164408034454866', time=2024-09-12T03:05:14.128551+0000, chain.objs.size()=1 2024-09-12T01:11:22.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.761+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:WBLHDfO6KhjnXTdmndnHZx0DgbEODNf_.tSE5sgYv1WcD8JDQ5TTnTeDT59hNQSn_0 2024-09-12T01:11:22.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.761+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10997248887965310288', time=2024-09-12T03:05:14.217968+0000, chain.objs.size()=1 2024-09-12T01:11:22.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.761+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:WBLHDfO6KhjnXTdmndnHZx0DgbEODNf_.tSE5sgYv1WcD8JDQ5TTnTeDT59hNQSn_0 2024-09-12T01:11:22.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9556919002599714734', time=2024-09-12T03:05:17.995065+0000, chain.objs.size()=1 2024-09-12T01:11:22.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.588__shadow:Y0HyKy5zt8wYCPXSJQhY5KEUkxkuSMd_.wmGny1R22w4RYmwLPH5z64psYDx_BRt_0 2024-09-12T01:11:22.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4986008253886017848', time=2024-09-12T03:06:36.784357+0000, chain.objs.size()=1 2024-09-12T01:11:22.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.618__shadow_.U1nsZTK_WSzJftRaksUEDmcIrnBONE__0 2024-09-12T01:11:22.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10999936452569901053', time=2024-09-12T03:07:56.004453+0000, chain.objs.size()=1 2024-09-12T01:11:22.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.653__shadow_.MpwIyFrfNCP2KWt8rv6dgrwWMz2wYlY_0 2024-09-12T01:11:22.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.766+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:22.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.768+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:11:22.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.769+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:22.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:22.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47987' 2024-09-12T01:11:22.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12832081920957715788', time=2024-09-12T02:59:09.451517+0000, chain.objs.size()=1 2024-09-12T01:11:22.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.178__shadow_.rROyOvJz5ty9gUeLRCrTcq8NNXgrWhu_0 2024-09-12T01:11:22.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3386472638589820856', time=2024-09-12T03:00:41.067534+0000, chain.objs.size()=1 2024-09-12T01:11:22.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.243__shadow_.Jyjm0ewC26MmxJo1IPga9Z-0uWAMBw1_0 2024-09-12T01:11:22.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4876214134246504085', time=2024-09-12T03:00:41.888206+0000, chain.objs.size()=1 2024-09-12T01:11:22.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.244__shadow_.Ssxhz_h-6_DI7gU_RbIsYgn0ybOByyN_0 2024-09-12T01:11:22.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5689884008344226863', time=2024-09-12T03:00:43.168922+0000, chain.objs.size()=1 2024-09-12T01:11:22.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.246__shadow_.6HbFQIj5Ca999LRTDcj5s6oe_ASx61V_0 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7245793184147529883', time=2024-09-12T03:00:58.861761+0000, chain.objs.size()=1 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.QyxLR-B9WVnLGOyi4Fv7gMR6wrE6duM_0 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17801445130761554394', time=2024-09-12T03:00:58.977113+0000, chain.objs.size()=1 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.gK-ECMH0KujpYedNhsuNtWNNabqZ-pt_0 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16849747203384321838', time=2024-09-12T03:00:59.174543+0000, chain.objs.size()=1 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ebIPA1GTOY5MxaTv7lQbitynR9mMd5U_0 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10958758492161181257', time=2024-09-12T03:00:59.187923+0000, chain.objs.size()=1 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4bzLyN-pFebT3Xcop-Xco9wHEkAn6d0_0 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16024942814317162998', time=2024-09-12T03:00:59.202278+0000, chain.objs.size()=1 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.USWV35E9_7pV0cGa18aHv0TrpEwUzFX_0 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11839707534657602038', time=2024-09-12T03:00:59.217759+0000, chain.objs.size()=1 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.yMfjNPLO8r__UAeXHc4L-UlHWelO_nB_0 2024-09-12T01:11:22.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16274784138029729730', time=2024-09-12T03:00:59.256317+0000, chain.objs.size()=1 2024-09-12T01:11:22.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Dk2wSgDPPFn3tHQibmMEkp5FRYpzOof_0 2024-09-12T01:11:22.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13897826727546820494', time=2024-09-12T03:00:59.274819+0000, chain.objs.size()=1 2024-09-12T01:11:22.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.771+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TdUuyHxdIDe6BuOQ_skIFFZgTamz7ag_0 2024-09-12T01:11:22.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.774+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7746190867618528745', time=2024-09-12T03:00:59.482407+0000, chain.objs.size()=1 2024-09-12T01:11:22.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.774+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JmteOyRjpWNozgRG5GAdeZAUzvnV5jS_0 2024-09-12T01:11:22.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2187473622836051074', time=2024-09-12T03:00:59.498167+0000, chain.objs.size()=1 2024-09-12T01:11:22.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.OBq2G7ZWneEYxuA5l0GeovFL9qVKkC7_0 2024-09-12T01:11:22.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9255564273395117497', time=2024-09-12T03:00:59.503159+0000, chain.objs.size()=1 2024-09-12T01:11:22.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RO0LXfFO-09jbM-4Y775C1Wqcj7TywM_0 2024-09-12T01:11:22.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5532514717721143730', time=2024-09-12T03:00:59.557782+0000, chain.objs.size()=1 2024-09-12T01:11:22.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.k_Vsi_z3bsUldfLyWszjklVGXYtUiyz_0 2024-09-12T01:11:22.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14666827859921766227', time=2024-09-12T03:00:59.663367+0000, chain.objs.size()=1 2024-09-12T01:11:22.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hKvbOTghS9e8AeGX0siSnGmKzqt9EIV_0 2024-09-12T01:11:22.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13638066941061419321', time=2024-09-12T03:00:59.672827+0000, chain.objs.size()=1 2024-09-12T01:11:22.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CjpE5Im4BQaISjkGA-tGS0N7a1jlKee_0 2024-09-12T01:11:22.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13736629474416020516', time=2024-09-12T03:00:59.723690+0000, chain.objs.size()=1 2024-09-12T01:11:22.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.775+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SIiFWVJULUdC3SiwXDf5lillkL-U2hU_0 2024-09-12T01:11:22.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.776+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1130634399693570676', time=2024-09-12T03:00:59.751355+0000, chain.objs.size()=1 2024-09-12T01:11:22.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.776+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bSKVZCWajPsz-5twsoGSKz4_nLnapy-_0 2024-09-12T01:11:22.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.776+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1940880846681444097', time=2024-09-12T03:00:59.936635+0000, chain.objs.size()=1 2024-09-12T01:11:22.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.776+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cHTWQe4QJzO_JFOa1Gylfzw7oibFIHr_0 2024-09-12T01:11:22.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.776+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11422650053066737106', time=2024-09-12T03:00:59.963019+0000, chain.objs.size()=1 2024-09-12T01:11:22.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.776+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6oosN05FRR15iM2gyBRZNj731qgPYhu_0 2024-09-12T01:11:22.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.776+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6823830869504239480', time=2024-09-12T03:01:00.007923+0000, chain.objs.size()=1 2024-09-12T01:11:22.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.776+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.w2Qw4AQydIGwbCCwHnBf5ancw1SFEfi_0 2024-09-12T01:11:22.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.779+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4571882524881236598', time=2024-09-12T03:01:00.020852+0000, chain.objs.size()=1 2024-09-12T01:11:22.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.779+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.AEV_oykGOfmsNDi2WaxPYZck2KcSwuL_0 2024-09-12T01:11:22.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.779+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.636937800259038147', time=2024-09-12T03:01:00.036639+0000, chain.objs.size()=1 2024-09-12T01:11:22.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.779+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rIeWdxKjgxghZ_fkT_zAve1hglLsmdV_0 2024-09-12T01:11:22.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7288647434017468702', time=2024-09-12T03:01:00.086605+0000, chain.objs.size()=1 2024-09-12T01:11:22.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.kKTlL8RxehPtgtKmtoAcgNr_ufeJ1st_0 2024-09-12T01:11:22.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5296380062613258699', time=2024-09-12T03:01:00.352771+0000, chain.objs.size()=1 2024-09-12T01:11:22.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sMXo2bCz2c3ZSu-bftOuqhHhQJTm-pK_0 2024-09-12T01:11:22.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2637667697848862250', time=2024-09-12T03:01:00.396571+0000, chain.objs.size()=1 2024-09-12T01:11:22.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fmBDo88klmpP2pnVpzdn2nCRJQyrmCJ_0 2024-09-12T01:11:22.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4632289086234803512', time=2024-09-12T03:01:00.615997+0000, chain.objs.size()=1 2024-09-12T01:11:22.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.iREngfKdSWiKSj5D1nLjSjXDJPCocaI_0 2024-09-12T01:11:22.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14047873801839880227', time=2024-09-12T03:01:00.620227+0000, chain.objs.size()=1 2024-09-12T01:11:22.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._3UbkY1vJqnomrQV_JlX7AjICbjYaz1_0 2024-09-12T01:11:22.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7261585640484811365', time=2024-09-12T03:01:00.644358+0000, chain.objs.size()=1 2024-09-12T01:11:22.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._yjhvjxwQwRnLGQ-EXihRr4FW3ZhgvM_0 2024-09-12T01:11:22.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8941339170244799407', time=2024-09-12T03:01:00.646845+0000, chain.objs.size()=1 2024-09-12T01:11:22.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.f3qAM17wSGx0az0zHMinQdKsAS7bgyz_0 2024-09-12T01:11:22.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15493874550849557200', time=2024-09-12T03:01:00.651534+0000, chain.objs.size()=1 2024-09-12T01:11:22.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vv3bkshm6hUvoig9Lk40qPiNmDWtuH9_0 2024-09-12T01:11:22.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9449278299777083434', time=2024-09-12T03:01:00.676110+0000, chain.objs.size()=1 2024-09-12T01:11:22.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.781+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.x2237iIqg0FOqZR05AxXT1S_G_Vo8pr_0 2024-09-12T01:11:22.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5199855511483673052', time=2024-09-12T03:01:00.685565+0000, chain.objs.size()=1 2024-09-12T01:11:22.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.z7jg3DHb_IaP2qU3A_32nu9U2xkctAf_0 2024-09-12T01:11:22.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6393501652575472549', time=2024-09-12T03:01:00.743620+0000, chain.objs.size()=1 2024-09-12T01:11:22.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uqbKENfrElMKvKtO4OfY0khtz5LLHYO_0 2024-09-12T01:11:22.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13973410733320369260', time=2024-09-12T03:01:00.859090+0000, chain.objs.size()=1 2024-09-12T01:11:22.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-0Apw_dY_PQBCagjEk5xvbFMTxBaDKz_0 2024-09-12T01:11:22.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13618922388989335330', time=2024-09-12T03:01:00.930770+0000, chain.objs.size()=1 2024-09-12T01:11:22.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CPmrcVr4z7XVIgOK0naoZz77oNTocpy_0 2024-09-12T01:11:22.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.176971996884328309', time=2024-09-12T03:01:00.967808+0000, chain.objs.size()=1 2024-09-12T01:11:22.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.filZWLMx5HEhkYtbOf2vcuWd1H5ePLL_0 2024-09-12T01:11:22.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13679831766098967663', time=2024-09-12T03:01:09.379115+0000, chain.objs.size()=1 2024-09-12T01:11:22.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.281__shadow_.AJxFi4NTdsXxD8J_ZBG43i7sg3pwItX_0 2024-09-12T01:11:22.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2790248564976558877', time=2024-09-12T03:01:20.551060+0000, chain.objs.size()=1 2024-09-12T01:11:22.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.302__shadow_.n-usdHb-p9EMYLn8x3s6u6yfD-xC1Q-_0 2024-09-12T01:11:22.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7646053905044212029', time=2024-09-12T03:01:29.452419+0000, chain.objs.size()=1 2024-09-12T01:11:22.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.786+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.320__shadow:5DBYleBx2rede7Q8hhluXZRrT2khCen_.TEFkQQN4wF4OkjW2hMxi2YohdjRHM-8_0 2024-09-12T01:11:22.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.787+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15266360443600636627', time=2024-09-12T03:01:40.119327+0000, chain.objs.size()=1 2024-09-12T01:11:22.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.787+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.I6xYfn_WNgOwoIKUZAXdyR8YEN-Djve_0 2024-09-12T01:11:22.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.787+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7521106916979883739', time=2024-09-12T03:01:40.135834+0000, chain.objs.size()=1 2024-09-12T01:11:22.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.787+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zzmdJlG-SFyNyz4sDF0mkeTR6SWmR9L_0 2024-09-12T01:11:22.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.787+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9766264583847504322', time=2024-09-12T03:01:40.400966+0000, chain.objs.size()=1 2024-09-12T01:11:22.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.787+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.H-_x7tpLkal6v7JXORE2F8J_Dkl2Xyy_0 2024-09-12T01:11:22.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.789+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8123898656868951714', time=2024-09-12T03:01:40.437567+0000, chain.objs.size()=1 2024-09-12T01:11:22.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.789+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zjvuMivlUmdqSMC-nwjCD0u23D7K9E-_0 2024-09-12T01:11:22.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.789+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7811437059615750337', time=2024-09-12T03:01:40.643018+0000, chain.objs.size()=1 2024-09-12T01:11:22.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.790+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eZ1HVwaHcMv8HCKZSMeemXP8g3Xsfqi_0 2024-09-12T01:11:22.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.790+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3310648679705655682', time=2024-09-12T03:01:40.708514+0000, chain.objs.size()=1 2024-09-12T01:11:22.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.790+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Z0QQo4xmlYXWbJkwlBoLdBZamvXLGVL_0 2024-09-12T01:11:22.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7553592587981988900', time=2024-09-12T03:01:40.729860+0000, chain.objs.size()=1 2024-09-12T01:11:22.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vbfo1Qg5kquSvQeLkhKfeUnf4RhnaX4_0 2024-09-12T01:11:22.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14010510871691149309', time=2024-09-12T03:01:40.739334+0000, chain.objs.size()=1 2024-09-12T01:11:22.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.OdEkX68qDcPrDCTa9AezE-lNf2vafN__0 2024-09-12T01:11:22.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3737573820651138433', time=2024-09-12T03:01:40.748726+0000, chain.objs.size()=1 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qwDmCPuxOk1iDMTIa-BVE4NmwcLWajq_0 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1996508824386683344', time=2024-09-12T03:01:40.920533+0000, chain.objs.size()=1 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3Z8LAbdMh0drfxZX8Z4hhPv7tdVAwuA_0 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7377647300326804850', time=2024-09-12T03:01:40.929623+0000, chain.objs.size()=1 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qvgiCcjiUIPrz9t02xE7Tjkkj57pKWH_0 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14961050821726530722', time=2024-09-12T03:01:40.972536+0000, chain.objs.size()=1 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.UMe_kAF05IpmPUD0Xf0Kj6EPMo4DpI__0 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7859436263153783175', time=2024-09-12T03:01:41.075987+0000, chain.objs.size()=1 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LnZskYE2a_FnPOdKUFpwOmfmn_0iVdT_0 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13430795503798773348', time=2024-09-12T03:01:41.274443+0000, chain.objs.size()=1 2024-09-12T01:11:22.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.792+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kIam4Bw_yBOGrMvjdcQq4ye74of2s9N_0 2024-09-12T01:11:22.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.794+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15879483172509575336', time=2024-09-12T03:01:41.469981+0000, chain.objs.size()=1 2024-09-12T01:11:22.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.794+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-8C3zuAtmdzJyGR5MO_v67e1IBhg9-z_0 2024-09-12T01:11:22.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.795+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13042020364803099151', time=2024-09-12T03:01:41.471831+0000, chain.objs.size()=1 2024-09-12T01:11:22.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.795+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mHLmbV4Jq3ir4y0sJI1QC5HicvFSV62_0 2024-09-12T01:11:22.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.796+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13075151707586454616', time=2024-09-12T03:01:41.518141+0000, chain.objs.size()=1 2024-09-12T01:11:22.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.796+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sqS6dE50hfWwl4MPOg37Agj_hiPEfk9_0 2024-09-12T01:11:22.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6427538351484856890', time=2024-09-12T03:01:41.535019+0000, chain.objs.size()=1 2024-09-12T01:11:22.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.M3f6S816H4kZ2h5TcTa4yFYqCjluaKI_0 2024-09-12T01:11:22.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3336045026506897999', time=2024-09-12T03:01:41.544172+0000, chain.objs.size()=1 2024-09-12T01:11:22.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tsYI5whxumUHph1W-Yrczo65LipExvj_0 2024-09-12T01:11:22.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2361613474647773587', time=2024-09-12T03:01:41.564477+0000, chain.objs.size()=1 2024-09-12T01:11:22.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.flQt5kuCIpoqyyfByOyuYXojMKG3kdM_0 2024-09-12T01:11:22.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11452605777407516696', time=2024-09-12T03:01:41.590893+0000, chain.objs.size()=1 2024-09-12T01:11:22.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.L_-p8WTbGdci_q4hgMYw2KNNmovwYif_0 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8850601230886211426', time=2024-09-12T03:01:41.735862+0000, chain.objs.size()=1 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bBcFlobvcQB0WC5ulIErVMa4FlAkWbF_0 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1462112579466844968', time=2024-09-12T03:01:41.746005+0000, chain.objs.size()=1 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aZ3yXBO7mp71dV4GrpdwwUXKV_r5U-l_0 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.112901896395278915', time=2024-09-12T03:01:41.781618+0000, chain.objs.size()=1 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FZT0yJ9DUL7r3vI0VQsccPHRF29nD5t_0 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.798+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13461178393897194139', time=2024-09-12T03:01:41.782976+0000, chain.objs.size()=1 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.798+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.iBs5Ra6M3mPDk5dPR8-bDRdg7KqxX_9_0 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.798+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8673235683068849531', time=2024-09-12T03:01:41.822595+0000, chain.objs.size()=1 2024-09-12T01:11:22.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.798+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4JoLBiaay61znmHY-Xeimvl7gIKcSnp_0 2024-09-12T01:11:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.799+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.712262800297917877', time=2024-09-12T03:01:41.839166+0000, chain.objs.size()=1 2024-09-12T01:11:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.799+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PUMXQpBuUxZGzUwc7-jlblBh8Tnid0__0 2024-09-12T01:11:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.800+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13354168802802724997', time=2024-09-12T03:01:41.867783+0000, chain.objs.size()=1 2024-09-12T01:11:22.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.800+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-loYBvvC9TrwzUiIgeJs2Fkr_GI2LZS_0 2024-09-12T01:11:22.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.800+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7969781697699626522', time=2024-09-12T03:01:41.889344+0000, chain.objs.size()=1 2024-09-12T01:11:22.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.800+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.AnApaQYEJTpRl6co8TcL-ehFzDMDWD8_0 2024-09-12T01:11:22.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.801+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12629346945257289931', time=2024-09-12T03:01:41.972563+0000, chain.objs.size()=1 2024-09-12T01:11:22.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.801+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.BLp0hZlvw2rU20VIors8TecH8Bdphjk_0 2024-09-12T01:11:22.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.801+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7391169606017562889', time=2024-09-12T03:01:42.106515+0000, chain.objs.size()=1 2024-09-12T01:11:22.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.801+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.cGuOUza2Y1cNohFTPMchAmar_ws0et-_0 2024-09-12T01:11:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5383166601138074590', time=2024-09-12T03:01:50.249542+0000, chain.objs.size()=1 2024-09-12T01:11:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pV680u3qqKmGL5VF839tjF2gxWpDVz9_0 2024-09-12T01:11:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17498836974262471523', time=2024-09-12T03:01:50.274421+0000, chain.objs.size()=1 2024-09-12T01:11:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.nK9YVof3mVOMNGLZOh3URkEuhs-fk7h_0 2024-09-12T01:11:22.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9367473640178462101', time=2024-09-12T03:01:50.291117+0000, chain.objs.size()=1 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.31KBgPlttmGgDhS1A-bdEV1qetdNMpM_0 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6618386916472205995', time=2024-09-12T03:01:50.369395+0000, chain.objs.size()=1 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tKIZeAwRdRQItp-SCqLNT2R6gx8pDD8_0 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4943039664649459950', time=2024-09-12T03:01:50.573882+0000, chain.objs.size()=1 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GylDTuWU-qoNTatff_s4BOs9EQZvMVj_0 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4263659956082497125', time=2024-09-12T03:01:50.646677+0000, chain.objs.size()=1 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.803+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.aVCaNf5_MYxCUjqjz2A8iZKoplYz2EN_0 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4921228896274805273', time=2024-09-12T03:01:50.728065+0000, chain.objs.size()=1 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.u7XZZuqnxrDI3a14GRfbsluG4gyErOZ_0 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11175938507252076511', time=2024-09-12T03:01:50.847441+0000, chain.objs.size()=1 2024-09-12T01:11:22.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CuyJK0aISqqA9-9w-pVSrDLtIK05zKy_0 2024-09-12T01:11:22.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17539563027560831105', time=2024-09-12T03:01:50.885990+0000, chain.objs.size()=1 2024-09-12T01:11:22.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.v0FY_ovZv05D8nZBQw0MNw5oH8XaQbD_0 2024-09-12T01:11:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3854086560815800921', time=2024-09-12T03:01:50.933759+0000, chain.objs.size()=1 2024-09-12T01:11:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pZ57fZoI9_hs3vuqbiolX8EPnNwtmK3_0 2024-09-12T01:11:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13419835679401203830', time=2024-09-12T03:01:50.955722+0000, chain.objs.size()=1 2024-09-12T01:11:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7VOfElQzXwC_74pu78OTJ0VoxvKzKUg_0 2024-09-12T01:11:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11646221673756265992', time=2024-09-12T03:01:51.244633+0000, chain.objs.size()=1 2024-09-12T01:11:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OgP3s6VkEo0Dwfs_Z5Zcwqd4S_hqpaC_0 2024-09-12T01:11:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14997903928825184469', time=2024-09-12T03:01:51.285627+0000, chain.objs.size()=1 2024-09-12T01:11:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gpEmbpUGxh4FvnGJItHn1UqCaGZ1Peb_0 2024-09-12T01:11:22.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14225258503213799235', time=2024-09-12T03:01:51.373109+0000, chain.objs.size()=1 2024-09-12T01:11:22.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4-rRF7Z17mn1xTR_q7KgcOLhu6YoS_Y_0 2024-09-12T01:11:22.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3245396272842123108', time=2024-09-12T03:01:51.394355+0000, chain.objs.size()=1 2024-09-12T01:11:22.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FkzBg5lAGOTpxwDLqRpdilbZCiSEHbX_0 2024-09-12T01:11:22.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7082639238126378573', time=2024-09-12T03:01:51.443334+0000, chain.objs.size()=1 2024-09-12T01:11:22.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KkUGrWHnctYpU0IpaYBoV8ZeJGHfegQ_0 2024-09-12T01:11:22.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2739331881140436188', time=2024-09-12T03:01:51.485955+0000, chain.objs.size()=1 2024-09-12T01:11:22.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.808+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.39jb6nLP6Z0N4klUZMJ-L_bzfwh-3TN_0 2024-09-12T01:11:22.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.809+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3039732033508621789', time=2024-09-12T03:01:51.494513+0000, chain.objs.size()=1 2024-09-12T01:11:22.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.809+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ViU7CiZL0ZVu7RUE-V50xzA6sNFR2Wq_0 2024-09-12T01:11:22.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.811+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2538309915011458395', time=2024-09-12T03:01:51.543525+0000, chain.objs.size()=1 2024-09-12T01:11:22.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.811+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kMCUFC_tzD4YptFUGsJawNWbxO_TcH9_0 2024-09-12T01:11:22.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12869896571384267509', time=2024-09-12T03:01:51.691692+0000, chain.objs.size()=1 2024-09-12T01:11:22.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FWtOD-Z6c4NPWEoALbMVet5PnsbaMHt_0 2024-09-12T01:11:22.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4776120957058923586', time=2024-09-12T03:01:51.736818+0000, chain.objs.size()=1 2024-09-12T01:11:22.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9x3zAhhSeuuZSWnFrGbdGNMngAs7Drj_0 2024-09-12T01:11:22.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6526550554254346273', time=2024-09-12T03:01:51.989728+0000, chain.objs.size()=1 2024-09-12T01:11:22.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.67yhUH3GZndfNV21qQgtDjhy8QTH73N_0 2024-09-12T01:11:22.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12476727571298970561', time=2024-09-12T03:01:52.004681+0000, chain.objs.size()=1 2024-09-12T01:11:22.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uNHDepC08HTXZv-FfKzO8m-KjLDmyE7_0 2024-09-12T01:11:22.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15809042481861308562', time=2024-09-12T03:01:52.169152+0000, chain.objs.size()=1 2024-09-12T01:11:22.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LRfzKnXKfVbX-hgwPJ9bHJHW9Le0n-m_0 2024-09-12T01:11:22.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15393292258958767809', time=2024-09-12T03:01:52.200304+0000, chain.objs.size()=1 2024-09-12T01:11:22.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.814+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lK85ZQFIeDTnJkkCQZKfsoWJ72mPmb-_0 2024-09-12T01:11:22.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2226225120335274463', time=2024-09-12T03:01:52.224036+0000, chain.objs.size()=1 2024-09-12T01:11:22.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3lWw1EK8ClrGUusTnoU7RqaiDmucbol_0 2024-09-12T01:11:22.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13302657912033708149', time=2024-09-12T03:01:52.265146+0000, chain.objs.size()=1 2024-09-12T01:11:22.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.i_zhnLP5m3EwMJXm0WnU-5DtMY7LXSi_0 2024-09-12T01:11:22.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.819+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47987 2024-09-12T01:11:22.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:11:22.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10842994557487007592', time=2024-09-12T03:01:52.293787+0000, chain.objs.size()=1 2024-09-12T01:11:22.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Cr4S5BgqzTcSdvkDRie6lx5jzcEe__q_0 2024-09-12T01:11:22.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.368933297821468400', time=2024-09-12T03:01:53.656816+0000, chain.objs.size()=1 2024-09-12T01:11:22.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.328__shadow_.xhZVwcytha9jmSBCMVXMyeUqM2kggyC_0 2024-09-12T01:11:22.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.237718786734664012', time=2024-09-12T03:02:19.872190+0000, chain.objs.size()=1 2024-09-12T01:11:22.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.385__shadow_.PsWQddpwtTVzRqfvvS2dNO-R_GVy8VR_0 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14326322520258721939', time=2024-09-12T03:02:59.846754+0000, chain.objs.size()=1 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.460__shadow_.HFzYK98Zeon1ywF4VyiJ00Lx16z3zvk_0 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13738535563605714163', time=2024-09-12T03:03:03.155286+0000, chain.objs.size()=1 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.465__shadow_.1vqxkm8SMx6UV59P47XuKF46qp2hzw1_0 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8526518200853345320', time=2024-09-12T03:03:10.079599+0000, chain.objs.size()=1 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.7U2aKGzvesAmM5bLL92dRMI5DWjrf2j_0 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12987034058085766269', time=2024-09-12T03:03:17.668324+0000, chain.objs.size()=1 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.501__shadow_.E-cNUwHPrh8bns0nCXUiCLY4OqPkLXX_0 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7912761349420592541', time=2024-09-12T03:03:46.994922+0000, chain.objs.size()=4 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~A3P47_gBcXbccDu80Sy9Vcm9c2yOqOw.1 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__shadow_mymultipart.2~A3P47_gBcXbccDu80Sy9Vcm9c2yOqOw.1_1 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~A3P47_gBcXbccDu80Sy9Vcm9c2yOqOw.2 2024-09-12T01:11:22.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__shadow_mymultipart.2~A3P47_gBcXbccDu80Sy9Vcm9c2yOqOw.2_1 2024-09-12T01:11:22.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16170449973867290997', time=2024-09-12T03:04:26.120819+0000, chain.objs.size()=1 2024-09-12T01:11:22.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.551__shadow_.HNbcFFNDTibkgtCgZTY3IcMRI--h43g_0 2024-09-12T01:11:22.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7228728284399268258', time=2024-09-12T03:04:28.076056+0000, chain.objs.size()=1 2024-09-12T01:11:22.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.554__shadow_.LAVvxxzEBuhJxCZ-RnVK4lRPLynCDms_0 2024-09-12T01:11:22.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14943154517177839729', time=2024-09-12T03:04:32.754175+0000, chain.objs.size()=1 2024-09-12T01:11:22.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.562__multipart_mymultipart.2~sg8D9E1AESatjmUVih5h4W7-XLLfa-r.1 2024-09-12T01:11:22.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4807300632102954126', time=2024-09-12T03:04:52.981690+0000, chain.objs.size()=1 2024-09-12T01:11:22.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.576__shadow_.Uki_i59WPHKrvw3PdKw1KQmjFpoV2al_0 2024-09-12T01:11:22.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13993286610229254654', time=2024-09-12T03:05:00.191091+0000, chain.objs.size()=1 2024-09-12T01:11:22.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:uKm0fujTZ-QVhTtlUaL-tgobxE.r9p5_.qrK5fxtxgWVq8oMLn11YKSJgmSzkoEl_0 2024-09-12T01:11:22.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12404390079400469365', time=2024-09-12T03:05:09.123444+0000, chain.objs.size()=1 2024-09-12T01:11:22.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.826+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:3KLJ-jKZ5nYIkoBv-nApE1kaLLNHw1w_.c1zKVw3_IRu8OUARVYmEvMWU5Zj98mB_0 2024-09-12T01:11:22.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.827+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6738249044373616565', time=2024-09-12T03:05:18.040771+0000, chain.objs.size()=1 2024-09-12T01:11:22.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.827+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.588__shadow:v1K8AvfovSvrmxpfv7J.81WcYvEypv6_.zB4IxN2AoEjr6q2ofJhjmwtg8h5E6Gu_0 2024-09-12T01:11:22.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.827+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11259516126044791856', time=2024-09-12T03:07:55.541306+0000, chain.objs.size()=1 2024-09-12T01:11:22.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.827+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.652__shadow_.EMXvcnxOhzL15EGnlLk_ozVxnoLB5aF_0 2024-09-12T01:11:22.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:22.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.834+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:11:22.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.835+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:22.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.836+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:22.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=96, truncated=0, next_marker='' 2024-09-12T01:11:22.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_zUgKJfqT872FvXazXppL3Xm_P4EfPvN', time=2024-09-12T02:58:53.554644+0000, chain.objs.size()=3 2024-09-12T01:11:22.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.eC1nFbzna8-1WmqXIWN-4D9p2qO-Egb_0 2024-09-12T01:11:22.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.eC1nFbzna8-1WmqXIWN-4D9p2qO-Egb_1 2024-09-12T01:11:22.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.eC1nFbzna8-1WmqXIWN-4D9p2qO-Egb_2 2024-09-12T01:11:22.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_QDubMaR_zQBFD2WrRWUj5RNAs8PYkW5', time=2024-09-12T02:58:53.864260+0000, chain.objs.size()=3 2024-09-12T01:11:22.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.vBAM3ZS28gFst8pCaLRY-_iAGSYGf2L_0 2024-09-12T01:11:22.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.vBAM3ZS28gFst8pCaLRY-_iAGSYGf2L_1 2024-09-12T01:11:22.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.vBAM3ZS28gFst8pCaLRY-_iAGSYGf2L_2 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18223556228531246349', time=2024-09-12T03:00:42.725337+0000, chain.objs.size()=1 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.245__shadow_.CKmVYUXsMlvHD6Q0XXCHRRTjSl8lBnV_0 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6914630525878329422', time=2024-09-12T03:00:44.103981+0000, chain.objs.size()=1 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.248__shadow_.TFwHMigeFRd42wr_LQfDl3MajNAOCWm_0 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9114407928288015057', time=2024-09-12T03:00:58.896696+0000, chain.objs.size()=1 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3_2AFV89unLyWLF_lfvtyM-yxyqEeHs_0 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15517934787293872477', time=2024-09-12T03:00:58.909943+0000, chain.objs.size()=1 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eVhA6tTqKB7y96DwYLV7CHUo9L0967p_0 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16779816750253702858', time=2024-09-12T03:00:58.971685+0000, chain.objs.size()=1 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.zMEkijFwIMZlYim_oE2MF9TacJdW9uN_0 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14481468486482659294', time=2024-09-12T03:00:59.023633+0000, chain.objs.size()=1 2024-09-12T01:11:22.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KjUnnZdWvaGNt3OPVN64jGEH2S80tCR_0 2024-09-12T01:11:22.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.841+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2655815728105669803', time=2024-09-12T03:00:59.134437+0000, chain.objs.size()=1 2024-09-12T01:11:22.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KOTecoacknUu8Thd-049ae8Tx9M-ekI_0 2024-09-12T01:11:22.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.841+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14983551751649320504', time=2024-09-12T03:00:59.171044+0000, chain.objs.size()=1 2024-09-12T01:11:22.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.zbOhZJhE-_lTed5mp-VyGJGYdBNnlVE_0 2024-09-12T01:11:22.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10011880979593583548', time=2024-09-12T03:00:59.205948+0000, chain.objs.size()=1 2024-09-12T01:11:22.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.OkYaed7WBeCHXZrzlYJOqg9IcHLLTHb_0 2024-09-12T01:11:22.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1396311443287528222', time=2024-09-12T03:00:59.274929+0000, chain.objs.size()=1 2024-09-12T01:11:22.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LxSeeRglaeBRutalwumD-OWqa_H62QO_0 2024-09-12T01:11:22.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4655224382484236598', time=2024-09-12T03:00:59.302176+0000, chain.objs.size()=1 2024-09-12T01:11:22.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.OGxYmk680S7RSmQPzHFSVTCANQymQ_2_0 2024-09-12T01:11:22.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15216338232358230204', time=2024-09-12T03:00:59.546665+0000, chain.objs.size()=1 2024-09-12T01:11:22.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.yPWzKl5lVNkHVyILpTZfErkuTQFD1Jc_0 2024-09-12T01:11:22.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11056322689062640035', time=2024-09-12T03:00:59.548482+0000, chain.objs.size()=1 2024-09-12T01:11:22.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.842+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UPucUKIUm3j20LbZbAs_OJEYH0SJvZR_0 2024-09-12T01:11:22.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.844+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11976648899020298461', time=2024-09-12T03:00:59.836394+0000, chain.objs.size()=1 2024-09-12T01:11:22.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.844+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MhdBal5SICB6m71JbEYm2plZn7-VXhN_0 2024-09-12T01:11:22.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.844+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17670638975475906574', time=2024-09-12T03:00:59.934703+0000, chain.objs.size()=1 2024-09-12T01:11:22.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.844+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JMslDD-Hx2voRHaxynyxDU0MUq7jhbx_0 2024-09-12T01:11:22.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.844+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3992124713789941158', time=2024-09-12T03:00:59.970666+0000, chain.objs.size()=1 2024-09-12T01:11:22.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.844+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jZ66v-jcU8MXfZ2dZ4hFQ3j36J1oqtU_0 2024-09-12T01:11:22.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.844+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10047515047322522356', time=2024-09-12T03:00:59.987459+0000, chain.objs.size()=1 2024-09-12T01:11:22.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.844+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lbNmnnS9hn5SsJfbnU5xChkFz5q1bKY_0 2024-09-12T01:11:22.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.845+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3002611051498428116', time=2024-09-12T03:01:00.045731+0000, chain.objs.size()=1 2024-09-12T01:11:22.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.845+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.B9rVaBjDDWfENTzXiTyNXxKXKv3JXll_0 2024-09-12T01:11:22.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.845+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18082639149334665776', time=2024-09-12T03:01:00.064869+0000, chain.objs.size()=1 2024-09-12T01:11:22.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.845+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.88tvodJXPij_-05DeZxUSTFcjQS_WJe_0 2024-09-12T01:11:22.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.845+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16377705491709062075', time=2024-09-12T03:01:00.359062+0000, chain.objs.size()=1 2024-09-12T01:11:22.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.845+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CgEw3cpXSxoTPIT7kITA7maNJRMs56s_0 2024-09-12T01:11:22.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.847+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13236507703950740353', time=2024-09-12T03:01:00.390320+0000, chain.objs.size()=1 2024-09-12T01:11:22.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MPogFmG_XOUgC1d3e0HiHKevoTwWHcw_0 2024-09-12T01:11:22.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.847+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13639812210384672351', time=2024-09-12T03:01:00.592282+0000, chain.objs.size()=1 2024-09-12T01:11:22.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.XVKnVQi4vnJXe0vZ0l9npsGIQyEJk_U_0 2024-09-12T01:11:22.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.847+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.371216442993216140', time=2024-09-12T03:01:00.629449+0000, chain.objs.size()=1 2024-09-12T01:11:22.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eNEVBZR4vj8jdjSPceT_jM9t1Lvhklt_0 2024-09-12T01:11:22.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.848+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15257984586238287895', time=2024-09-12T03:01:00.643838+0000, chain.objs.size()=1 2024-09-12T01:11:22.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.848+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.XXGekmpzE5EP-lCKGazSukLgBhBqpxS_0 2024-09-12T01:11:22.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.848+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12320183550067539381', time=2024-09-12T03:01:00.706202+0000, chain.objs.size()=1 2024-09-12T01:11:22.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.848+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8qRexCh9Jj5zs3mvknPyynW-sNQ-s6C_0 2024-09-12T01:11:22.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.848+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13594588060619685498', time=2024-09-12T03:01:00.760736+0000, chain.objs.size()=1 2024-09-12T01:11:22.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.848+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dmqxLW238NK88dtJh2u--Xivp9yC5Jg_0 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.697048953597740415', time=2024-09-12T03:01:00.775059+0000, chain.objs.size()=1 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oSu-Teu1NGgnRoQNNhY5OKra2CclXvT_0 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.606204373661657360', time=2024-09-12T03:01:00.907344+0000, chain.objs.size()=1 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cXbITtYHTGoov3QcQVM7uJnDOTFDcxf_0 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8884106960308557905', time=2024-09-12T03:01:00.942479+0000, chain.objs.size()=1 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SxxUVSmaG68ghTtvI-8UO9Wt89XJKnB_0 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4993783805414185901', time=2024-09-12T03:01:02.347490+0000, chain.objs.size()=1 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.266__shadow_.tisfx-xFxiSnXxfsOsfuGvN6fQx51TH_0 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13560538339267554165', time=2024-09-12T03:01:09.379582+0000, chain.objs.size()=1 2024-09-12T01:11:22.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.281__shadow_.aYqY51mFh0vvXowrfHS2sNKdN88E6-Q_0 2024-09-12T01:11:22.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10002874397053154198', time=2024-09-12T03:01:10.816395+0000, chain.objs.size()=1 2024-09-12T01:11:22.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.284__shadow_.4SuouXpVFr0mv1tEU5CofqFy-L3hpMJ_0 2024-09-12T01:11:22.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4237057156411694902', time=2024-09-12T03:01:15.870908+0000, chain.objs.size()=1 2024-09-12T01:11:22.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.fcTYdGzoNN4ZgT6irN2AlrcVNKy_FP1_0 2024-09-12T01:11:22.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14474413902396624631', time=2024-09-12T03:01:40.212599+0000, chain.objs.size()=1 2024-09-12T01:11:22.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.852+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Tko0Sxgnts2y8rq0HWvcQISO87XAq7o_0 2024-09-12T01:11:22.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6523491171421306282', time=2024-09-12T03:01:40.230324+0000, chain.objs.size()=1 2024-09-12T01:11:22.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.HYxramnoGCu-mlnVWfOR0X1EZ4yxv4q_0 2024-09-12T01:11:22.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14150812646910402257', time=2024-09-12T03:01:40.263491+0000, chain.objs.size()=1 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ikW6FRhSwrSJrWlqC4eXhQgaZeX2Uy7_0 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5256077885101829516', time=2024-09-12T03:01:40.284190+0000, chain.objs.size()=1 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.gCG4D45cjpHWhLp0dDmpLNnKdncB-E7_0 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5999180333812034919', time=2024-09-12T03:01:40.292062+0000, chain.objs.size()=1 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8XjGT45LfVUMSq3EWt9-TSRmbrpzvq5_0 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13399870045563368042', time=2024-09-12T03:01:40.387111+0000, chain.objs.size()=1 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JZVoNDIw_4JN5jYB4qUc55ulJW2nOxP_0 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1779257465035738524', time=2024-09-12T03:01:40.415694+0000, chain.objs.size()=1 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nDey3NTNFkZzSeDtqKB773NyMDDG231_0 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2260340836523826939', time=2024-09-12T03:01:40.462572+0000, chain.objs.size()=1 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.u2bCBm7wbfoORs_TAtxP98_HO-dnOnK_0 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12067043678543965695', time=2024-09-12T03:01:40.506947+0000, chain.objs.size()=1 2024-09-12T01:11:22.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zbC131ebDs1gqT53Zf49cfLcjoQ7wwo_0 2024-09-12T01:11:22.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7529639943457886182', time=2024-09-12T03:01:40.688768+0000, chain.objs.size()=1 2024-09-12T01:11:22.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZiTzs8C4T79SowmpggKgqYIG7n_BS7__0 2024-09-12T01:11:22.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.857+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12846472763879252824', time=2024-09-12T03:01:40.968399+0000, chain.objs.size()=1 2024-09-12T01:11:22.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.857+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3aJVdMuRhZPEH0-3XQBNkV092t3sz8d_0 2024-09-12T01:11:22.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.857+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9730296504635591353', time=2024-09-12T03:01:41.040622+0000, chain.objs.size()=1 2024-09-12T01:11:22.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.857+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3P-dWqw5dCKb-S3Vg62jUDcytty-GJi_0 2024-09-12T01:11:22.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.859+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17031941773193134204', time=2024-09-12T03:01:41.048379+0000, chain.objs.size()=1 2024-09-12T01:11:22.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.859+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.HhhAi7cfF2ATAb6pVHix91CGbu7s-yU_0 2024-09-12T01:11:22.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.862+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3133802882832948371', time=2024-09-12T03:01:41.306098+0000, chain.objs.size()=1 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.862+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dQxINUSChUUEIUE4fmbbKLmarEFtpQS_0 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.862+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2640878481611356000', time=2024-09-12T03:01:41.352500+0000, chain.objs.size()=1 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.862+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-k0ym6hXTM_KXQnyiMr1q5jLxKeB4Da_0 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.862+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8991530632440408119', time=2024-09-12T03:01:41.494269+0000, chain.objs.size()=1 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.862+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6bUzWnhE4wjCCydFTcSaRBweFDFoCwI_0 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.862+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6148689427029077745', time=2024-09-12T03:01:41.583393+0000, chain.objs.size()=1 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.862+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PZgrwW-LAidQ-27CvYSM0caL8ySAQjK_0 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14277026713929595902', time=2024-09-12T03:01:41.755138+0000, chain.objs.size()=1 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tfX3_UNwlzk55z0Vxpz5qH7zx610nZ__0 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11119447114104655478', time=2024-09-12T03:01:41.763528+0000, chain.objs.size()=1 2024-09-12T01:11:22.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PvkekffyNvCRyBky0H37Vz_pgx4mxi-_0 2024-09-12T01:11:22.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18119606917925006552', time=2024-09-12T03:01:41.778078+0000, chain.objs.size()=1 2024-09-12T01:11:22.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jtrPh21vZxgxZywo2QckJ04OwFLt9H9_0 2024-09-12T01:11:22.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14070681240207342599', time=2024-09-12T03:01:41.802122+0000, chain.objs.size()=1 2024-09-12T01:11:22.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pi9M3rxu1eoSqk3RDmKOqpb3zrwDJiu_0 2024-09-12T01:11:22.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2061562922468367280', time=2024-09-12T03:01:41.821879+0000, chain.objs.size()=1 2024-09-12T01:11:22.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pNii21_RUihksraJPTKcgUSL4PgTytr_0 2024-09-12T01:11:22.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.865+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4921955011275507698', time=2024-09-12T03:01:41.848407+0000, chain.objs.size()=1 2024-09-12T01:11:22.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.865+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.A66L5s-dh-M9r1QnVul3um_ZUgl3xts_0 2024-09-12T01:11:22.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.865+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10378619806832009484', time=2024-09-12T03:01:42.093435+0000, chain.objs.size()=1 2024-09-12T01:11:22.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.865+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3aKzGBWqDlWDy7iKLPgo7TjjdJ8GPhY_0 2024-09-12T01:11:22.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.866+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5687156674178746991', time=2024-09-12T03:01:42.099073+0000, chain.objs.size()=1 2024-09-12T01:11:22.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.866+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ES8yrOL-W8VvMJtUDpKdfvDOC-QQLWi_0 2024-09-12T01:11:22.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.866+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14482160076118595644', time=2024-09-12T03:01:50.227235+0000, chain.objs.size()=1 2024-09-12T01:11:22.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.866+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tbJL4lufA_0ujKGEpkjUFjVLaBZWejs_0 2024-09-12T01:11:22.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.866+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10682982589313819106', time=2024-09-12T03:01:50.299887+0000, chain.objs.size()=1 2024-09-12T01:11:22.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.866+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.SW1JqXlckDH8BGy0hh4I8JSDupafPlm_0 2024-09-12T01:11:22.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.867+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15613406470491295872', time=2024-09-12T03:01:50.314167+0000, chain.objs.size()=1 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ydkFXk7w4FnbCRMwBQQiwJewzbbSVue_0 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3216615458884249760', time=2024-09-12T03:01:50.342455+0000, chain.objs.size()=1 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tjYE_h_m_EduTamphywWr3b-WecXaKP_0 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16912398063773925368', time=2024-09-12T03:01:50.375484+0000, chain.objs.size()=1 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lSBJzKews2UNE9y8clMsEwefmlpSw-T_0 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17763435425016340330', time=2024-09-12T03:01:50.390518+0000, chain.objs.size()=1 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Dcc4uPb52Hk-VKQDw3XVffJuFy0TWv3_0 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18404674423867937925', time=2024-09-12T03:01:50.652083+0000, chain.objs.size()=1 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._vXjQqf-hMzxzdY0aYUHO9C3t3WDLl3_0 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8652023416627961401', time=2024-09-12T03:01:50.672752+0000, chain.objs.size()=1 2024-09-12T01:11:22.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ssJIQLPP3mBQrG96GCi4PMQmT4QrGFe_0 2024-09-12T01:11:22.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.869+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13449422278479102256', time=2024-09-12T03:01:50.932616+0000, chain.objs.size()=1 2024-09-12T01:11:22.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.869+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hjUMdeP7wEih3QouqLRRtA15_8gLX0H_0 2024-09-12T01:11:22.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.870+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.663097027268738249', time=2024-09-12T03:01:50.991194+0000, chain.objs.size()=1 2024-09-12T01:11:22.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.870+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.C5p4lz3EHEylPMd7OUmaSrmfY0ucFjD_0 2024-09-12T01:11:22.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.870+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3436754942202108727', time=2024-09-12T03:01:51.007976+0000, chain.objs.size()=1 2024-09-12T01:11:22.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.870+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.RXMCtQeZm7vUxe1nxffFqfSOJrh1ijl_0 2024-09-12T01:11:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.871+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17519832594415126042', time=2024-09-12T03:01:51.147888+0000, chain.objs.size()=1 2024-09-12T01:11:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.871+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.WuIrh25QzZTRgjFBRTfAsii6ta6PInN_0 2024-09-12T01:11:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.871+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11970066028441285225', time=2024-09-12T03:01:51.148742+0000, chain.objs.size()=1 2024-09-12T01:11:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.871+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ueVUBXua2eALvAS8P9tRrcOadi7rPVt_0 2024-09-12T01:11:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.871+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.45763277606245662', time=2024-09-12T03:01:51.150563+0000, chain.objs.size()=1 2024-09-12T01:11:22.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.871+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kRzXhCWgjY-oyRg9aXY-ykUxYeEOqZt_0 2024-09-12T01:11:22.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.871+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4435601433155370426', time=2024-09-12T03:01:51.167333+0000, chain.objs.size()=1 2024-09-12T01:11:22.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.871+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.u4SRHGznSWpumdpdcS2sqVpm52RsWkl_0 2024-09-12T01:11:22.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.872+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10805122027628246615', time=2024-09-12T03:01:51.240429+0000, chain.objs.size()=1 2024-09-12T01:11:22.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.872+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.usFSjUdYzqL0_1CgY7DJr3Eh_9koF2v_0 2024-09-12T01:11:22.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.873+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3815446101975017156', time=2024-09-12T03:01:51.424058+0000, chain.objs.size()=1 2024-09-12T01:11:22.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.873+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.aePeZZ89ABMsZv4nEHYEr15zA20XgBF_0 2024-09-12T01:11:22.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.874+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11352697570876471252', time=2024-09-12T03:01:51.448540+0000, chain.objs.size()=1 2024-09-12T01:11:22.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.874+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jG1YKGgUR5-oAJK8IxEbnr5FfKgPeFr_0 2024-09-12T01:11:22.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.874+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12813211581070991720', time=2024-09-12T03:01:51.482267+0000, chain.objs.size()=1 2024-09-12T01:11:22.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.874+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LgzAxDXVmrRet2KqgmnVlY_NFK4nadW_0 2024-09-12T01:11:22.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.874+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13666934159700019124', time=2024-09-12T03:01:51.969176+0000, chain.objs.size()=1 2024-09-12T01:11:22.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.874+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.EZ4yNiFOWpUFODF6WQcb5g2N-3-Wxhz_0 2024-09-12T01:11:22.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.876+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4347573602861128804', time=2024-09-12T03:01:52.057316+0000, chain.objs.size()=1 2024-09-12T01:11:22.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.876+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xh5VitMzLwBvTct_OBDnj7CtKwRiVqE_0 2024-09-12T01:11:22.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6451460413455008435', time=2024-09-12T03:01:52.220287+0000, chain.objs.size()=1 2024-09-12T01:11:22.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lWqUOalGPcDj-tE-QiafZ85kixxwq9A_0 2024-09-12T01:11:22.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.768886488063262328', time=2024-09-12T03:01:52.251174+0000, chain.objs.size()=1 2024-09-12T01:11:22.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.k5PnDYkXa-JonIN0jS_Br1sReDWW3LC_0 2024-09-12T01:11:22.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6784254158448375916', time=2024-09-12T03:01:52.258293+0000, chain.objs.size()=1 2024-09-12T01:11:22.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-GBuY2R8o1Bq6PU_9CZAlC7THt7lgDb_0 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15467006541315294030', time=2024-09-12T03:01:54.528680+0000, chain.objs.size()=1 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.330__shadow_.jaZtu3Kun28ZP59h-bfLH-q376pGWoL_0 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1882839535884478085', time=2024-09-12T03:03:10.614535+0000, chain.objs.size()=1 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.485__shadow_.6lrCalF9Zowo7b3ayfiD2KcTAE3CX3B_0 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4439995049429941535', time=2024-09-12T03:03:19.459684+0000, chain.objs.size()=1 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.504__shadow:Sxqts83E9ch0mXuzA3cUygir9GtCc0q_.GJXGml4UggGV5JB-2HNawTbAzqH1P1u_0 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb', time=2024-09-12T03:03:47.561581+0000, chain.objs.size()=10 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.1 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.2 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.3 2024-09-12T01:11:22.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.878+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.4 2024-09-12T01:11:22.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.880+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.5 2024-09-12T01:11:22.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.6 2024-09-12T01:11:22.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.7 2024-09-12T01:11:22.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.8 2024-09-12T01:11:22.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.9 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.527__multipart_mymultipart.2~J_69Ct02bO9joJCBOIkoay1zLlcPLxb.10 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18377322037016465181', time=2024-09-12T03:04:42.746603+0000, chain.objs.size()=1 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:.fpphs6ysd6i2T7j6KsWwSChyqKuHhM_.WGq_ROR8bNw8ol-RgHDAOwf1vJLFdhV_0 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14172622296437337727', time=2024-09-12T03:04:44.196697+0000, chain.objs.size()=1 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:A2pW-oFNrE94Pk9fIqi6Gh.2U16-Sgu_.9h6QjofS-hOo4Xt0mSAZU9IdtIdzYZu_0 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9106253594187428699', time=2024-09-12T03:05:03.476534+0000, chain.objs.size()=1 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:vu88nM8GN2W.XlibYdQwBPMFVwvM6w5_._byripTYV7p-5ANt0du9JW4XwDtcLFO_0 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4237849631323912286', time=2024-09-12T03:07:38.592714+0000, chain.objs.size()=1 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.621__shadow_.HI6_JErnXa3httMpv_oyDjXCoWn58CP_0 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx', time=2024-09-12T03:07:42.814996+0000, chain.objs.size()=12 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__multipart_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.1 2024-09-12T01:11:22.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.883+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__shadow_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.1_1 2024-09-12T01:11:22.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__multipart_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.2 2024-09-12T01:11:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.888+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__shadow_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.2_1 2024-09-12T01:11:22.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.888+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__multipart_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.3 2024-09-12T01:11:22.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.888+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__shadow_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.3_1 2024-09-12T01:11:22.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.888+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__multipart_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.4 2024-09-12T01:11:22.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.888+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__shadow_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.4_1 2024-09-12T01:11:22.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.890+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__multipart_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.5 2024-09-12T01:11:22.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.890+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__shadow_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.5_1 2024-09-12T01:11:22.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.890+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__multipart_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.6 2024-09-12T01:11:22.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.890+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.626__shadow_multipart_enc.2~fqtlRbVcQ5863ddyGTRiINTf9Tj8Yhx.6_1 2024-09-12T01:11:22.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.890+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9367741431337467554', time=2024-09-12T03:08:20.985427+0000, chain.objs.size()=1 2024-09-12T01:11:22.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.890+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.709__shadow:w..KqPAg66d-UzyODOsv4wMueZWvC24_.eIcsQkSg3Lr5UpbYh-9TsaPMM8fFlu3_0 2024-09-12T01:11:22.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.890+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7881350152352707265', time=2024-09-12T03:08:51.966976+0000, chain.objs.size()=1 2024-09-12T01:11:22.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.890+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.735__shadow_.FvxK_XD5x9qctHZ9e-e7nooTgQAU2dq_0 2024-09-12T01:11:22.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.892+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~QkZnORf65SZsOMDPgytrhMSKQBvX3W8', time=2024-09-12T03:08:56.639391+0000, chain.objs.size()=1 2024-09-12T01:11:22.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.892+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.743__multipart_mymultipart.2~QkZnORf65SZsOMDPgytrhMSKQBvX3W8.1 2024-09-12T01:11:22.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.896+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:22.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.899+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:11:22.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.900+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:22.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.901+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:22.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/57292' 2024-09-12T01:11:22.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14525008450427278249', time=2024-09-12T03:00:34.737543+0000, chain.objs.size()=1 2024-09-12T01:11:22.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.231__shadow_.dYhb26dHpxJN66jcW9MrMLnONB_qe_g_0 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.259928543513516077', time=2024-09-12T03:00:46.933002+0000, chain.objs.size()=1 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.254__shadow_.v3DgVuZvm4uFwem7SWkoYfsO7gw8250_0 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16426181012995104378', time=2024-09-12T03:00:47.883484+0000, chain.objs.size()=1 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.256__shadow_.F_-S8Tzq5GAAi_s1ry6UCWBHa9SQTE-_0 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11512247296019619235', time=2024-09-12T03:00:50.682189+0000, chain.objs.size()=1 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.262__shadow_.vXg5DOvGuS1M_zfdpQzeEl5wvc6p9Er_0 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14559351887563883651', time=2024-09-12T03:00:58.917097+0000, chain.objs.size()=1 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dKgjpueD9V4kN2eLZaT-Tax3qchLU3M_0 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3385664553496810615', time=2024-09-12T03:00:58.955517+0000, chain.objs.size()=1 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xdlbUcRJ_m__X15M4usRRXfHSGIp1vw_0 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15361088915546234458', time=2024-09-12T03:00:58.980620+0000, chain.objs.size()=1 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tzD7gtehhSIXpZ_FpRJSZbL0n0dkdlO_0 2024-09-12T01:11:22.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1991988971592966730', time=2024-09-12T03:00:59.144323+0000, chain.objs.size()=1 2024-09-12T01:11:22.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DvLdeMqjQGq1GMqHtUxO5F93OzRY269_0 2024-09-12T01:11:22.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.832026978556166664', time=2024-09-12T03:00:59.191864+0000, chain.objs.size()=1 2024-09-12T01:11:22.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rrwoFNu6ZUJHkXkknhwH3iIUm_mwJXw_0 2024-09-12T01:11:22.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2662206994399265473', time=2024-09-12T03:00:59.450336+0000, chain.objs.size()=1 2024-09-12T01:11:22.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bk2OYkCC0yZ1Cd5oKkX8k4Um0lIgzo9_0 2024-09-12T01:11:22.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4455454881569524688', time=2024-09-12T03:00:59.657147+0000, chain.objs.size()=1 2024-09-12T01:11:22.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.w02CtDwFQWUsjp4P6TEyIbKRB0MAkTk_0 2024-09-12T01:11:22.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16767083118399360393', time=2024-09-12T03:00:59.748799+0000, chain.objs.size()=1 2024-09-12T01:11:22.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.902+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8-19gLnq8LWP2Xq2USOYqPzcmgNnMrt_0 2024-09-12T01:11:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.906+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18111103363743221081', time=2024-09-12T03:00:59.761306+0000, chain.objs.size()=1 2024-09-12T01:11:22.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.906+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.PO9XJhLXpc3oDM8txa-1v_VLz5jPB2E_0 2024-09-12T01:11:22.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14360165465234718455', time=2024-09-12T03:00:59.769171+0000, chain.objs.size()=1 2024-09-12T01:11:22.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Tb-RAkCc8jDYNV8ViOPyqygtHQU2Frx_0 2024-09-12T01:11:22.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1232402891377147730', time=2024-09-12T03:00:59.780546+0000, chain.objs.size()=1 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cdbh2A6wA3HP2tgKb2pMZHTIgrlAvYz_0 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5712913700123588823', time=2024-09-12T03:00:59.813117+0000, chain.objs.size()=1 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BnTOAXkIHWttvltz6-qUyj3HAbHeogG_0 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15134921366243944770', time=2024-09-12T03:00:59.827417+0000, chain.objs.size()=1 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4trYJ07dY8YE1fXVzT6Uk01ZjWgIzGQ_0 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6662086731760544458', time=2024-09-12T03:00:59.845287+0000, chain.objs.size()=1 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eItGv6wwLUjqP9FLrAppKu7n_WSley7_0 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12521533046523107375', time=2024-09-12T03:00:59.933331+0000, chain.objs.size()=1 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oICnAsXYVr-gFzAv7SV83rH_sI1QntM_0 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14199512298523740070', time=2024-09-12T03:00:59.979743+0000, chain.objs.size()=1 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Ag03fjuaeYLVmx_sz0o86shX4Xzd19Y_0 2024-09-12T01:11:22.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13789790352060691237', time=2024-09-12T03:00:59.995969+0000, chain.objs.size()=1 2024-09-12T01:11:22.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.HrtZkQWJIbmhu_OfcvhsoKyCoiJrZ0I_0 2024-09-12T01:11:22.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17296123061246488690', time=2024-09-12T03:01:00.070050+0000, chain.objs.size()=1 2024-09-12T01:11:22.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.40F2wpk0wgdXB-apsOqMPEQTwvnbmdf_0 2024-09-12T01:11:22.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17543991976660355423', time=2024-09-12T03:01:00.080660+0000, chain.objs.size()=1 2024-09-12T01:11:22.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.908+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bYSSddGcgevJJOcCkvSlJpmIbvbrRZk_0 2024-09-12T01:11:22.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.909+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14491506816288295641', time=2024-09-12T03:01:00.100850+0000, chain.objs.size()=1 2024-09-12T01:11:22.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.909+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.PgOdIaOAu236lNr1EZregx2bsk9oXle_0 2024-09-12T01:11:22.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11899984354771250538', time=2024-09-12T03:01:00.589388+0000, chain.objs.size()=1 2024-09-12T01:11:22.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.a3oSABiyypB_wIFkawWV7YXqmo6kmW8_0 2024-09-12T01:11:22.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17761736876712942768', time=2024-09-12T03:01:00.675748+0000, chain.objs.size()=1 2024-09-12T01:11:22.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.PE4o68BocvRFxvxBf1UG21zCuwKN-jb_0 2024-09-12T01:11:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.913+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4661857384313824666', time=2024-09-12T03:01:00.695277+0000, chain.objs.size()=1 2024-09-12T01:11:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.913+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vd0Z4_Rd7eXkL1VepZCtTG89oWNkjiU_0 2024-09-12T01:11:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.913+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16866898623778351186', time=2024-09-12T03:01:00.722653+0000, chain.objs.size()=1 2024-09-12T01:11:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.913+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TK5oQzuCgq2D2Y0dUzilbKRPeoe_0hc_0 2024-09-12T01:11:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.913+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8621974119249943242', time=2024-09-12T03:01:03.769424+0000, chain.objs.size()=1 2024-09-12T01:11:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.913+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.269__shadow_.rKmv-FkarCKvloJzghbSXYkb3Kq5xXU_0 2024-09-12T01:11:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.913+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8673076134522677090', time=2024-09-12T03:01:08.891311+0000, chain.objs.size()=1 2024-09-12T01:11:22.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.913+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.280__shadow_.MtlmHRWy7WFXJavaO7KWzazzEZJhzvM_0 2024-09-12T01:11:22.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.914+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1954761952452922082', time=2024-09-12T03:01:09.867875+0000, chain.objs.size()=1 2024-09-12T01:11:22.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.914+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.282__shadow_.DI7KFm6oMAtKDXy7GDHZCgAJ45biEP1_0 2024-09-12T01:11:22.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.914+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7155159761488505765', time=2024-09-12T03:01:11.331034+0000, chain.objs.size()=1 2024-09-12T01:11:22.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.914+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.285__shadow_.mxLRuT-H3_RAuAEHOyOe3k86pvElzXN_0 2024-09-12T01:11:22.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.914+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2426617546706404888', time=2024-09-12T03:01:17.091021+0000, chain.objs.size()=1 2024-09-12T01:11:22.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.915+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.295__shadow_.erZRjlKpVLnx42bashlBTqfifbCoKZC_0 2024-09-12T01:11:22.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.915+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18337918612067188705', time=2024-09-12T03:01:40.118039+0000, chain.objs.size()=1 2024-09-12T01:11:22.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.915+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.v5KbYidJSXPXW0oa1ioVtxiY4Xm5xb5_0 2024-09-12T01:11:22.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.915+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2304296144236076524', time=2024-09-12T03:01:40.119207+0000, chain.objs.size()=1 2024-09-12T01:11:22.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.915+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.teXkS4NH1SSi40XPK6QDGOWmZI0P2a-_0 2024-09-12T01:11:22.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.916+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18436872359874347428', time=2024-09-12T03:01:40.221916+0000, chain.objs.size()=1 2024-09-12T01:11:22.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.916+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ARRUuTj_98r0bFueS1saAFGBFo1PFep_0 2024-09-12T01:11:22.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.918+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4251433617522698197', time=2024-09-12T03:01:40.251591+0000, chain.objs.size()=1 2024-09-12T01:11:22.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.918+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zO75CJrfG5Q0DhGn4Q4tILGB-Ma4sf__0 2024-09-12T01:11:22.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13492275540498815889', time=2024-09-12T03:01:40.256294+0000, chain.objs.size()=1 2024-09-12T01:11:22.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dGK7WIFrmzei6KS0OHtHle61Lkv7nwt_0 2024-09-12T01:11:22.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14026450169814406025', time=2024-09-12T03:01:40.393260+0000, chain.objs.size()=1 2024-09-12T01:11:22.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.m7hjBCoB1jR5f0R1-0mN_G2pyrg_gwI_0 2024-09-12T01:11:22.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17627996696785715185', time=2024-09-12T03:01:40.421857+0000, chain.objs.size()=1 2024-09-12T01:11:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Qkvfl4CTRdVKZl_J4rm0lZFQOLUgkpy_0 2024-09-12T01:11:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3920048044411458624', time=2024-09-12T03:01:40.441602+0000, chain.objs.size()=1 2024-09-12T01:11:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mA7DZVG7mqGVYo35Me14sJ4JXfWc0b3_0 2024-09-12T01:11:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17085614546225819241', time=2024-09-12T03:01:40.452895+0000, chain.objs.size()=1 2024-09-12T01:11:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.24y5zEAbXKhG3RMEKAlStAhi9q4sYQg_0 2024-09-12T01:11:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15402081145083258837', time=2024-09-12T03:01:40.478367+0000, chain.objs.size()=1 2024-09-12T01:11:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.T-41GfF0uS1s6gVmEjR-k1BKC3ey2Ls_0 2024-09-12T01:11:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1285837787932137604', time=2024-09-12T03:01:40.479390+0000, chain.objs.size()=1 2024-09-12T01:11:22.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.920+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eaus350Q0uN8oDpMoq-NvfmfjxU8e1h_0 2024-09-12T01:11:22.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.921+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9709664194314591274', time=2024-09-12T03:01:40.489290+0000, chain.objs.size()=1 2024-09-12T01:11:22.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.921+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vM_R0SGhpvUO1rg9G03K3GwN50HmfZA_0 2024-09-12T01:11:22.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.921+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2490623683894461677', time=2024-09-12T03:01:40.504924+0000, chain.objs.size()=1 2024-09-12T01:11:22.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.921+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.SjYIF0cPzYPZejMR5h9v-fzyq280ZCV_0 2024-09-12T01:11:22.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.923+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10214247055518675806', time=2024-09-12T03:01:40.519773+0000, chain.objs.size()=1 2024-09-12T01:11:22.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.923+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KV_E4XXKykZdSpQi0whBDxpk0fxufk4_0 2024-09-12T01:11:22.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.924+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14791266133046251094', time=2024-09-12T03:01:40.676544+0000, chain.objs.size()=1 2024-09-12T01:11:22.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.924+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GGoyCeKfITidUpzu4d-0GCuTB7WqQqj_0 2024-09-12T01:11:22.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.926+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2808170126278094409', time=2024-09-12T03:01:40.799638+0000, chain.objs.size()=1 2024-09-12T01:11:22.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.926+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-ezcqQxNQBR3zo8_XpvY1CdixwokUCx_0 2024-09-12T01:11:22.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11702038592846377891', time=2024-09-12T03:01:40.811398+0000, chain.objs.size()=1 2024-09-12T01:11:22.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fuPomg-CiRQ4RCOb_B9ATAmh8Q4ruig_0 2024-09-12T01:11:22.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5686666249500261769', time=2024-09-12T03:01:40.819713+0000, chain.objs.size()=1 2024-09-12T01:11:22.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.W16QNbqZ6_82Qx6kyQqv9ZuyK-lnu4A_0 2024-09-12T01:11:22.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16374699987514887401', time=2024-09-12T03:01:40.939075+0000, chain.objs.size()=1 2024-09-12T01:11:22.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MN9CcOQQ70FEYm0OdKZMHYkqHk4V4bc_0 2024-09-12T01:11:22.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8121176970629663232', time=2024-09-12T03:01:40.961596+0000, chain.objs.size()=1 2024-09-12T01:11:22.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.YJvpdQ5VnQFO2UUJrGPuau07LVxCb3C_0 2024-09-12T01:11:22.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8185276923522509779', time=2024-09-12T03:01:41.012502+0000, chain.objs.size()=1 2024-09-12T01:11:22.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.TxZkZ0Pf0mX6M8DMzY6AehWCV3WOgAo_0 2024-09-12T01:11:22.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9711787906905207841', time=2024-09-12T03:01:41.288996+0000, chain.objs.size()=1 2024-09-12T01:11:22.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.19UhaxunzQrwmmaXMqjowBBve1tLWjg_0 2024-09-12T01:11:22.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2016483174928841053', time=2024-09-12T03:01:41.310232+0000, chain.objs.size()=1 2024-09-12T01:11:22.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PlhK3IQonCOmNpfVK0MhSM39eIxQZHH_0 2024-09-12T01:11:22.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11407550552175680082', time=2024-09-12T03:01:41.476248+0000, chain.objs.size()=1 2024-09-12T01:11:22.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7oBR76TClmG1gcnIez5u9TMgkG8mrkq_0 2024-09-12T01:11:22.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7842713604110231607', time=2024-09-12T03:01:41.606318+0000, chain.objs.size()=1 2024-09-12T01:11:22.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.927+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JKoq0Q9b669CPnh-aM1KXVEoG2u0PmO_0 2024-09-12T01:11:22.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.929+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15650491106056305714', time=2024-09-12T03:01:41.740365+0000, chain.objs.size()=1 2024-09-12T01:11:22.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.929+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._Cdq4l96fWeKZgm_aul4uXH_ggo77Mn_0 2024-09-12T01:11:22.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.929+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8895832188227634289', time=2024-09-12T03:01:41.812872+0000, chain.objs.size()=1 2024-09-12T01:11:22.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.929+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PQPXSaUHJC21jujW2G7znJzFgX2dejz_0 2024-09-12T01:11:22.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4058118109242313635', time=2024-09-12T03:01:41.879812+0000, chain.objs.size()=1 2024-09-12T01:11:22.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.cXudra9oZuriVLlvm7714b7x1ca4knh_0 2024-09-12T01:11:22.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14865096681077302735', time=2024-09-12T03:01:41.969510+0000, chain.objs.size()=1 2024-09-12T01:11:22.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KIMCfE5YjDtyElAa-iCUeMue_NPs2Bi_0 2024-09-12T01:11:22.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5985813185029006130', time=2024-09-12T03:01:41.979990+0000, chain.objs.size()=1 2024-09-12T01:11:22.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jtgWFe7uQYB1_-WbqTwvbF_hM6Q7rG6_0 2024-09-12T01:11:22.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.932+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17609532915242268524', time=2024-09-12T03:01:50.286102+0000, chain.objs.size()=1 2024-09-12T01:11:22.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.932+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IdhWEgcgJKhOo-KanfhrLzGX7DVaZ-X_0 2024-09-12T01:11:22.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.932+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5002908373777003524', time=2024-09-12T03:01:50.317385+0000, chain.objs.size()=1 2024-09-12T01:11:22.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.932+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gMloYBZhmF4PzAXHLiqTnRkuLxzwOoh_0 2024-09-12T01:11:22.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.932+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8182027890629447646', time=2024-09-12T03:01:50.320337+0000, chain.objs.size()=1 2024-09-12T01:11:22.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.932+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fn4Bi4yLz904AFxZoWGPqgxxxdufABe_0 2024-09-12T01:11:22.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10135570211002529762', time=2024-09-12T03:01:50.368894+0000, chain.objs.size()=1 2024-09-12T01:11:22.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QBqu1qtKYiZeJHb6qgZPXYrU3S-mPP-_0 2024-09-12T01:11:22.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13587798046441959982', time=2024-09-12T03:01:50.398222+0000, chain.objs.size()=1 2024-09-12T01:11:22.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.q9c9rwAhM-ev-CekCPx7CYSe1GoiAoG_0 2024-09-12T01:11:22.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6407390119978503418', time=2024-09-12T03:01:50.562958+0000, chain.objs.size()=1 2024-09-12T01:11:22.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.dEaJwxaFkQ5-M0t_6qj4gzTjNlvT6XZ_0 2024-09-12T01:11:22.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15789329552991795902', time=2024-09-12T03:01:50.572802+0000, chain.objs.size()=1 2024-09-12T01:11:22.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3_Y5k6Cyk1XJSUXwuasWpDKRqO4HTB5_0 2024-09-12T01:11:22.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2494101142115725320', time=2024-09-12T03:01:50.718725+0000, chain.objs.size()=1 2024-09-12T01:11:22.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.934+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ivmm4BCfrQsC8SC3jmAXo4OMasVpw6Q_0 2024-09-12T01:11:22.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.935+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15443003703263103343', time=2024-09-12T03:01:50.882212+0000, chain.objs.size()=1 2024-09-12T01:11:22.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.935+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ar5tJug7Xzu4dErNoetmZ5S64zZtBjj_0 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8167855485011522023', time=2024-09-12T03:01:50.899921+0000, chain.objs.size()=1 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.PuQW8rA7pnJvYH54J96tCF08dnp812D_0 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7582680402162138575', time=2024-09-12T03:01:51.093221+0000, chain.objs.size()=1 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KyPeUG6MNT8ARI__w9xtaZqBIct89Lg_0 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16242297582257437933', time=2024-09-12T03:01:51.139254+0000, chain.objs.size()=1 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fXua4lSR7gzlOZg89xP_AmkuwRrl6_m_0 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17329328348912942304', time=2024-09-12T03:01:51.158244+0000, chain.objs.size()=1 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ksUUSJV_odxbEenv4he6xklHNQxTd1y_0 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5766393921823139715', time=2024-09-12T03:01:51.180155+0000, chain.objs.size()=1 2024-09-12T01:11:22.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.yrXcCaponUOsRhuWfCA814Zhy6uEbS7_0 2024-09-12T01:11:22.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.938+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13451716831173256332', time=2024-09-12T03:01:51.245438+0000, chain.objs.size()=1 2024-09-12T01:11:22.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.938+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ea9CUHCdF6Be5xD1HGv7LcwpQXoBpG8_0 2024-09-12T01:11:22.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.938+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17244901348593488722', time=2024-09-12T03:01:51.269719+0000, chain.objs.size()=1 2024-09-12T01:11:22.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.938+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oPKR6rxqaoYRZpHGZyy6JYCIz-GasGW_0 2024-09-12T01:11:22.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.938+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.634307573916542482', time=2024-09-12T03:01:51.380983+0000, chain.objs.size()=1 2024-09-12T01:11:22.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.938+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LiqCqdFkjtZZ1LUNnyInae-xBKt6PRo_0 2024-09-12T01:11:22.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.938+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9573490578543879587', time=2024-09-12T03:01:51.397221+0000, chain.objs.size()=1 2024-09-12T01:11:22.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.938+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.BQPQcOX5M-vjuz9Q5Y7pw4kCEc5BLAv_0 2024-09-12T01:11:22.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7360711233425719601', time=2024-09-12T03:01:51.399182+0000, chain.objs.size()=1 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mmHUoNv5LAdK48mmSXGYtysueqo6GcB_0 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5459215362517177063', time=2024-09-12T03:01:51.469707+0000, chain.objs.size()=1 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jLqvKI3GYAdiwWIeNkV3C8JDv2LAdAi_0 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6740469235569584610', time=2024-09-12T03:01:51.535413+0000, chain.objs.size()=1 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uGkrsP3YH-65K2FGVqpExSDO-AusONT_0 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11194859940469561549', time=2024-09-12T03:01:51.640402+0000, chain.objs.size()=1 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AdZnPyf55oqW9ey68SV2OJfDob1PigP_0 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7868754304127429280', time=2024-09-12T03:01:51.688248+0000, chain.objs.size()=1 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.940+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.RaJqyJvRjjMifR-p_urEwbzgzUDncAr_0 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.941+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2596955964083523272', time=2024-09-12T03:01:51.696509+0000, chain.objs.size()=1 2024-09-12T01:11:22.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.941+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.cgPl7NHJb-yUDal5PlY8cdDbRCHq8WC_0 2024-09-12T01:11:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.941+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18002607717367695080', time=2024-09-12T03:01:51.718450+0000, chain.objs.size()=1 2024-09-12T01:11:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.941+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tnfTAWPP51Lg6vahsMQuYn_cipqWFwD_0 2024-09-12T01:11:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.942+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2944271096403465206', time=2024-09-12T03:01:51.753015+0000, chain.objs.size()=1 2024-09-12T01:11:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.942+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.x8hEcLrlwsIynrw8YxNMubWpLzlqoNo_0 2024-09-12T01:11:22.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6867641401325932811', time=2024-09-12T03:01:51.788930+0000, chain.objs.size()=1 2024-09-12T01:11:22.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lwovOaFoTHbbJUntW5bQRFsen3pYr0I_0 2024-09-12T01:11:22.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17948677875645766419', time=2024-09-12T03:01:51.798006+0000, chain.objs.size()=1 2024-09-12T01:11:22.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CXAA4-juehSRTUP35YSoq1aJqvRFVsb_0 2024-09-12T01:11:22.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7615313142585283794', time=2024-09-12T03:01:51.822572+0000, chain.objs.size()=1 2024-09-12T01:11:22.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.f0Fo7UufbIdTWx0FCPo8w1yZQv0J54d_0 2024-09-12T01:11:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.945+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8606359750830244950', time=2024-09-12T03:01:51.956609+0000, chain.objs.size()=1 2024-09-12T01:11:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.945+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.P7Ukg0ohlwJ5gbcVUEuVs3VcU379k6B_0 2024-09-12T01:11:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.945+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5472725803267949083', time=2024-09-12T03:01:51.973293+0000, chain.objs.size()=1 2024-09-12T01:11:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.945+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-9i1BvRTtRuXKVrVHq_zcfXTFuOKYls_0 2024-09-12T01:11:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.945+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16390972884801031302', time=2024-09-12T03:01:52.041554+0000, chain.objs.size()=1 2024-09-12T01:11:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.945+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.31FfNQfLzAQp7RztcTognLMjAYQC6d4_0 2024-09-12T01:11:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6023239996873729245', time=2024-09-12T03:01:52.050019+0000, chain.objs.size()=1 2024-09-12T01:11:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.B-WNdhsPPcj4nQeeOoZzNDELeRaXrh7_0 2024-09-12T01:11:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10003194080413122749', time=2024-09-12T03:01:52.172018+0000, chain.objs.size()=1 2024-09-12T01:11:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0JfTRJb9SBduf-UaI4Tp85vEuCmsSsh_0 2024-09-12T01:11:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14256760606123360454', time=2024-09-12T03:01:52.179482+0000, chain.objs.size()=1 2024-09-12T01:11:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AMeZyamxsvQpVa9R6GgWmlUfOXLaXBJ_0 2024-09-12T01:11:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15087427205419980725', time=2024-09-12T03:01:52.180200+0000, chain.objs.size()=1 2024-09-12T01:11:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LmgMNIWttfgpsYgY-ers9PU2NHw0bay_0 2024-09-12T01:11:22.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15573078984687028084', time=2024-09-12T03:01:52.297245+0000, chain.objs.size()=1 2024-09-12T01:11:22.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.946+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kahFnX14ax7C3HeiwVmp_sz7fRjHhM9_0 2024-09-12T01:11:22.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.951+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/57292 2024-09-12T01:11:22.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:11:22.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17336643072613885187', time=2024-09-12T03:02:11.974301+0000, chain.objs.size()=1 2024-09-12T01:11:22.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.371__shadow_.jCWtqeQwtBqMA8mNbFDTKOArN-LRLEU_0 2024-09-12T01:11:22.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16964984927432461489', time=2024-09-12T03:03:04.285935+0000, chain.objs.size()=1 2024-09-12T01:11:22.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.467__shadow_.tmn8nx6kGIEC64XW6Y4L2mOjhNcRa1T_0 2024-09-12T01:11:22.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6580360990656070422', time=2024-09-12T03:03:04.497981+0000, chain.objs.size()=1 2024-09-12T01:11:22.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.467__shadow_.N8tOz3dpd5nII8obuS81yl44gpV_B73_0 2024-09-12T01:11:22.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1414709537087101713', time=2024-09-12T03:03:10.080915+0000, chain.objs.size()=1 2024-09-12T01:11:22.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.OVk5i8zdudqNJNZfAFc7x6xp9Vi_AOo_0 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14850069499411517745', time=2024-09-12T03:03:44.204932+0000, chain.objs.size()=5 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~8ZCd6yoRv8JnNGrELJIXF1a-sbPicIy.1 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__shadow_mymultipart.2~8ZCd6yoRv8JnNGrELJIXF1a-sbPicIy.1_1 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~8ZCd6yoRv8JnNGrELJIXF1a-sbPicIy.2 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__shadow_mymultipart.2~8ZCd6yoRv8JnNGrELJIXF1a-sbPicIy.2_1 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~8ZCd6yoRv8JnNGrELJIXF1a-sbPicIy.3 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14599434042916383913', time=2024-09-12T03:04:31.705411+0000, chain.objs.size()=1 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.560__shadow_.Qhq8M110VeUN1KEHvntUPOG4Gtd4JPY_0 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2511006995832937312', time=2024-09-12T03:04:33.487191+0000, chain.objs.size()=1 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.563__shadow_.V0dkwtiYuSjDmXHDfDvMn4ti2FJ0dqS_0 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4188292113409563239', time=2024-09-12T03:04:37.855587+0000, chain.objs.size()=3 2024-09-12T01:11:22.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.954+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.564__shadow_.sBYDb80YnzKGS1YK22W1sFiB-vOd3OK_0 2024-09-12T01:11:22.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.958+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.564__shadow_.sBYDb80YnzKGS1YK22W1sFiB-vOd3OK_1 2024-09-12T01:11:22.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.958+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.564__shadow_.sBYDb80YnzKGS1YK22W1sFiB-vOd3OK_2 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17060158361471954532', time=2024-09-12T03:04:57.275122+0000, chain.objs.size()=1 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:4p742cvHWNQXFqNdec-2uzH4sGtlNVl_.2G6DaXGsDNLvw-pOK12icUQvuzjR0cY_0 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18165764805182009129', time=2024-09-12T03:05:01.332383+0000, chain.objs.size()=1 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:3UHJXt3ZM1.ogusscHamiPCCw3-Mlb8_.I-NEV-DH92DzjjVDGYeMVKSC6DtSwLT_0 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10247793048427015582', time=2024-09-12T03:05:14.137403+0000, chain.objs.size()=1 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:WBLHDfO6KhjnXTdmndnHZx0DgbEODNf_.tSE5sgYv1WcD8JDQ5TTnTeDT59hNQSn_0 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18006684708322959516', time=2024-09-12T03:07:46.077728+0000, chain.objs.size()=1 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.633__shadow_.JdvJWpWBHohERytEA3zuMpANTdYdX7o_0 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14326499055533477610', time=2024-09-12T03:08:01.779162+0000, chain.objs.size()=1 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.664__shadow_.P3Vy-CZdpIQdqN7q04KdtfNNDlSCDHJ_0 2024-09-12T01:11:22.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1952369108663017390', time=2024-09-12T03:08:23.118479+0000, chain.objs.size()=1 2024-09-12T01:11:22.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.714__shadow:U.LJ1NfZnkg4WDtRS1xzTWAarCABAlZ_.E4vaw4C6wCsCEfvaSwppSqBVcnNI_OQ_0 2024-09-12T01:11:22.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.963+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:22.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.966+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:11:22.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.967+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:22.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.968+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:22.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46590' 2024-09-12T01:11:22.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1770764053498592572', time=2024-09-12T02:59:11.207892+0000, chain.objs.size()=1 2024-09-12T01:11:22.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.182__shadow_.RtA4Mm98-l9OBtTVsvnjX-sDMGwsDwp_0 2024-09-12T01:11:22.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10839525594777536017', time=2024-09-12T03:00:43.628137+0000, chain.objs.size()=1 2024-09-12T01:11:22.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.247__shadow_.aCigNDj-pDv0lXtalXZGzwyVRfvH80O_0 2024-09-12T01:11:22.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1119778546530433153', time=2024-09-12T03:00:48.848722+0000, chain.objs.size()=1 2024-09-12T01:11:22.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.258__shadow_.KURZ1sb-ozh9IPKBvGNoulkYcr66rKt_0 2024-09-12T01:11:22.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17074067212949285277', time=2024-09-12T03:00:50.681926+0000, chain.objs.size()=1 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.262__shadow_.huJzqr3RXHKv_kuNZ-Bm8bKwkfHAM4U_0 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3661006152295042599', time=2024-09-12T03:00:58.917905+0000, chain.objs.size()=1 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.R5YxTr57osAgbgPfdbrM_DWF_cHZ_-1_0 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9296320971524941389', time=2024-09-12T03:00:59.024234+0000, chain.objs.size()=1 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4h0IoG0xtv1kW2davUGFs5aH1-qAI4a_0 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13177748189544740768', time=2024-09-12T03:00:59.028354+0000, chain.objs.size()=1 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eaO-rtVmPzFJcWhjWEybHCreAKnvhY-_0 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17828309231844993104', time=2024-09-12T03:00:59.130715+0000, chain.objs.size()=1 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vNGGTqXkO_ph_WSINMm2uVjz7uYmMo8_0 2024-09-12T01:11:22.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7075462388249536002', time=2024-09-12T03:00:59.154722+0000, chain.objs.size()=1 2024-09-12T01:11:22.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qiguu41qmD_6fcLOCyFdymVbyRZ6_0j_0 2024-09-12T01:11:22.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11651249717499715497', time=2024-09-12T03:00:59.172557+0000, chain.objs.size()=1 2024-09-12T01:11:22.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5jfezd_1nX652ELKpaG9a4QMQ1plMCP_0 2024-09-12T01:11:22.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9078823147841989858', time=2024-09-12T03:00:59.214433+0000, chain.objs.size()=1 2024-09-12T01:11:22.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3F_skkE3k5vRbsNUdtrYoItSSnP7s0s_0 2024-09-12T01:11:22.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15241386492958529398', time=2024-09-12T03:00:59.215062+0000, chain.objs.size()=1 2024-09-12T01:11:22.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KYhvOhCKJXq6z_hKXiUq5fMNpqD7p6U_0 2024-09-12T01:11:22.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10387107364282920558', time=2024-09-12T03:00:59.244552+0000, chain.objs.size()=1 2024-09-12T01:11:22.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.10NPsxZd8rfrLzkbDAqB6rmEA5vJGXs_0 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.853489907692430313', time=2024-09-12T03:00:59.284828+0000, chain.objs.size()=1 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5iq1n9tjTPTwHhcDfEyw8Q05cdDtbsN_0 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12432926172796703839', time=2024-09-12T03:00:59.436830+0000, chain.objs.size()=1 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.klI7RTDeH2vsEy1bkFhN5S-aHW_ubAx_0 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10876371230722130583', time=2024-09-12T03:00:59.495659+0000, chain.objs.size()=1 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UURXYXsJL8haZhY4RnVCp5atQ0XDmaK_0 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13063257903029318185', time=2024-09-12T03:00:59.506032+0000, chain.objs.size()=1 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4HhZMR0U_WecQdGOV9cw0wOw4OlOhdk_0 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7863167463586071939', time=2024-09-12T03:00:59.683961+0000, chain.objs.size()=1 2024-09-12T01:11:22.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tnzUeEKoEkSjcUaATnYptjYqvd5c0Sw_0 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11799191045190948461', time=2024-09-12T03:00:59.686943+0000, chain.objs.size()=1 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.b_BrFQ-sS1rL69knZy_b_ifSjzmnQKv_0 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.356865599415133488', time=2024-09-12T03:00:59.691914+0000, chain.objs.size()=1 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._D_5Uk_yi5wt1itWnN_5Dk8DMGymaBA_0 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11274999151189284215', time=2024-09-12T03:00:59.692719+0000, chain.objs.size()=1 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1s_ECIuq3mS1aEG7HoLxaW3wvrx4etg_0 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10970154272035746105', time=2024-09-12T03:00:59.703724+0000, chain.objs.size()=1 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BGTSO3cL96vBc2bE7OPEQH5Vr-iJhyM_0 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1091812373984469861', time=2024-09-12T03:00:59.940915+0000, chain.objs.size()=1 2024-09-12T01:11:22.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9Cv9ZIbtmtCxGbBNgArh5N3dPaFxA2M_0 2024-09-12T01:11:22.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.977+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1570930191995321059', time=2024-09-12T03:00:59.996081+0000, chain.objs.size()=1 2024-09-12T01:11:22.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.977+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Oot9ArPDAlL0prpI3g2_O1g2HT8V0CN_0 2024-09-12T01:11:22.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.977+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15930953612960059476', time=2024-09-12T03:00:59.996953+0000, chain.objs.size()=1 2024-09-12T01:11:22.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.977+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DAvu6LExmYoxzFZf6tKZiYWloNP58je_0 2024-09-12T01:11:22.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.978+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.838475527276828850', time=2024-09-12T03:01:00.024548+0000, chain.objs.size()=1 2024-09-12T01:11:22.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.978+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._dM_5tJNxapabtUJTHy8kDbYvNLzGQ7_0 2024-09-12T01:11:22.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3923607949470113843', time=2024-09-12T03:01:00.056025+0000, chain.objs.size()=1 2024-09-12T01:11:22.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.EueImSTbFVAfADXxG-3HONG2VENCkUG_0 2024-09-12T01:11:22.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3522053219962885722', time=2024-09-12T03:01:00.062516+0000, chain.objs.size()=1 2024-09-12T01:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.t6SrIgTMrxpFBQYhxSYTu4BgcnfchkJ_0 2024-09-12T01:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16265954215319082325', time=2024-09-12T03:01:00.339381+0000, chain.objs.size()=1 2024-09-12T01:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.NHbZ5lXCtv7vQgGyIi2crXGZ_oPseNy_0 2024-09-12T01:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10802634912863456129', time=2024-09-12T03:01:00.345912+0000, chain.objs.size()=1 2024-09-12T01:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.l1ttDABb0Nh-7rGH8nT_SNpTO6Ti_98_0 2024-09-12T01:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6632152501751798945', time=2024-09-12T03:01:00.356070+0000, chain.objs.size()=1 2024-09-12T01:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.laAYZ-6qZBbcCneLxbGQ3cEUcnahX1K_0 2024-09-12T01:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12148580933533663115', time=2024-09-12T03:01:00.360075+0000, chain.objs.size()=1 2024-09-12T01:11:22.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.W1xuyOo5Gcr0ntdHHYOvORsLyMcc2Eo_0 2024-09-12T01:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11693131388036911569', time=2024-09-12T03:01:00.473379+0000, chain.objs.size()=1 2024-09-12T01:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tXOLa6p_DE3J6c_1gMRU2fTDLyyKfCs_0 2024-09-12T01:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1765518510909263227', time=2024-09-12T03:01:00.485686+0000, chain.objs.size()=1 2024-09-12T01:11:22.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.979+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xoBfqwE18ng_FDNJ2WHdtmMhrKqhsSW_0 2024-09-12T01:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.982+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4760754176113968923', time=2024-09-12T03:01:00.506605+0000, chain.objs.size()=1 2024-09-12T01:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.982+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2d7zmKOLUxvQp4aFM8FXgc_1hL4RWz2_0 2024-09-12T01:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.982+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11676373999616034085', time=2024-09-12T03:01:00.624530+0000, chain.objs.size()=1 2024-09-12T01:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.982+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.IeqGe9dTHKUwc2wCBq0ugEiWitSMZFf_0 2024-09-12T01:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.982+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18347775430839519780', time=2024-09-12T03:01:00.746218+0000, chain.objs.size()=1 2024-09-12T01:11:22.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.982+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WOLEApxOlF2Ywu70PVRfmHIKqE_PCf4_0 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1392526205301323813', time=2024-09-12T03:01:00.750637+0000, chain.objs.size()=1 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ukWjagRcZ_MLqEwLK1L8AGROwyO9VKG_0 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1580127369495955065', time=2024-09-12T03:01:00.774040+0000, chain.objs.size()=1 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.n-04EgGBi4QJa8XOdenKtbBtQSTOeJe_0 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14578374386447704581', time=2024-09-12T03:01:00.853055+0000, chain.objs.size()=1 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SnTH_9lLvctfXbgMuG0fR_0dOByoPrs_0 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15193530383818181309', time=2024-09-12T03:01:00.880732+0000, chain.objs.size()=1 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ondtloYrZy8g6FaJC58-Rw02g9zYCeJ_0 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7207881275572962245', time=2024-09-12T03:01:00.924642+0000, chain.objs.size()=1 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9Ez3gnBbBs5s24eMWgzEK1enEfQWiOl_0 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11378446560874617958', time=2024-09-12T03:01:00.954756+0000, chain.objs.size()=1 2024-09-12T01:11:22.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.983+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.S46enKDqR5PAzb3XLRWVMYnV2ODrMsy_0 2024-09-12T01:11:22.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.984+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8656241517690508820', time=2024-09-12T03:01:00.969568+0000, chain.objs.size()=1 2024-09-12T01:11:22.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.984+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tBvgpnFqIwc-ffA-mRjesHVYh3yUUKL_0 2024-09-12T01:11:22.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.984+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6147564735944264908', time=2024-09-12T03:01:00.974045+0000, chain.objs.size()=1 2024-09-12T01:11:22.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.984+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.nE3VKDzky7gE3oH3bDisgQAqNGD0rku_0 2024-09-12T01:11:22.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.987+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2132152471405551461', time=2024-09-12T03:01:07.437980+0000, chain.objs.size()=1 2024-09-12T01:11:22.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.987+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.277__shadow_.Aa2O6iJZy8rqguFPZopEOUt3zf3AT5j_0 2024-09-12T01:11:22.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.988+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14728539687083220129', time=2024-09-12T03:01:08.396796+0000, chain.objs.size()=1 2024-09-12T01:11:22.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.988+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.279__shadow_.ChInIq15rZAvtProBo4ijerFIjXexCL_0 2024-09-12T01:11:22.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.988+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14443930073334394675', time=2024-09-12T03:01:15.844991+0000, chain.objs.size()=1 2024-09-12T01:11:22.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.988+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.SavIWwmqOdJcTMBdAT27Rk_Qsk-birC_0 2024-09-12T01:11:22.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.989+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7026658728894258493', time=2024-09-12T03:01:15.874747+0000, chain.objs.size()=1 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.989+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.-afh830HeLcf3ivNBU5ifGUxVwJQlTi_0 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.989+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3851338406633429214', time=2024-09-12T03:01:16.638059+0000, chain.objs.size()=1 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.989+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.pblDCbIpBsvXOEnlOlxrRMq1eE7HACI_0 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.989+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4854961522714605444', time=2024-09-12T03:01:16.665193+0000, chain.objs.size()=1 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.989+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.rqbrVkz4oOnlyxHMc_wHcnS8PgLXQZ7_0 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.989+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9693146552844303516', time=2024-09-12T03:01:16.669002+0000, chain.objs.size()=1 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.989+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.6ysbzEbZMmu94mMoWP3eF8S9EyL8gl9_0 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.990+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10716669106061818196', time=2024-09-12T03:01:17.575618+0000, chain.objs.size()=1 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.990+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.296__shadow_.h3UhI0bsJtEfCgowra-qOL5kuv0Ajdp_0 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.990+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16389158165313128252', time=2024-09-12T03:01:20.550915+0000, chain.objs.size()=1 2024-09-12T01:11:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.990+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.302__shadow_.sw38y2p8Vw19LYuJusGe2fpywJQacxh_0 2024-09-12T01:11:22.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.990+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16659254047574477392', time=2024-09-12T03:01:40.124503+0000, chain.objs.size()=1 2024-09-12T01:11:22.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.990+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.x1aEMxVm0WOS83RxvS2qMAT_7f6JC03_0 2024-09-12T01:11:22.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.990+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14920162015811322823', time=2024-09-12T03:01:40.186610+0000, chain.objs.size()=1 2024-09-12T01:11:22.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.990+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rUtkLSr2UmKHlegPufcAN1YxJAoAd02_0 2024-09-12T01:11:22.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.991+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5118293826528822304', time=2024-09-12T03:01:40.197174+0000, chain.objs.size()=1 2024-09-12T01:11:22.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.991+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JqJEVb3veF5mD6ZIxxo-_oawAp0w8jO_0 2024-09-12T01:11:22.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.992+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5279740404462215581', time=2024-09-12T03:01:40.222763+0000, chain.objs.size()=1 2024-09-12T01:11:22.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.992+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.YDc55IjN5bIQ-EXvfXuL-yviDeWhBGQ_0 2024-09-12T01:11:22.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.993+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13036138666007043551', time=2024-09-12T03:01:40.231201+0000, chain.objs.size()=1 2024-09-12T01:11:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.993+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aXJflPjHyDonFctneOOBgTuUTd_Imwi_0 2024-09-12T01:11:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.994+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6948924611307024431', time=2024-09-12T03:01:40.247425+0000, chain.objs.size()=1 2024-09-12T01:11:22.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.994+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vLtIlYPvBbDOSBVNlpodndKH8Qji8Kv_0 2024-09-12T01:11:22.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10470521599093671210', time=2024-09-12T03:01:40.264877+0000, chain.objs.size()=1 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lbgjhbhWRNCXEPEFChkgRlKBQy6zXs2_0 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11675603963936066904', time=2024-09-12T03:01:40.271356+0000, chain.objs.size()=1 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qKpSOgjTH_Z6D_lr_42qtwjFrSKEQut_0 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12565851541659502385', time=2024-09-12T03:01:40.433311+0000, chain.objs.size()=1 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jiSCfTgAyRXaMVDRvJG80zysUYVIlTQ_0 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12621681753777401548', time=2024-09-12T03:01:40.454476+0000, chain.objs.size()=1 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kH_kk9ZE5B30OlgmjB9eGx-cMKKvciM_0 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2695836331800186179', time=2024-09-12T03:01:40.701041+0000, chain.objs.size()=1 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Wz5vFMN55ttvOEuGlSdurbkucketvGY_0 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7072078784388070271', time=2024-09-12T03:01:40.716913+0000, chain.objs.size()=1 2024-09-12T01:11:22.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4ecFkdoEkCXBRCfVcu8hlpxLii8QSwr_0 2024-09-12T01:11:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.738295470810921783', time=2024-09-12T03:01:40.791984+0000, chain.objs.size()=1 2024-09-12T01:11:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZOKOr_UncSKr6RLXtLPg9oz9MlroFOz_0 2024-09-12T01:11:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8886782449518101451', time=2024-09-12T03:01:40.909029+0000, chain.objs.size()=1 2024-09-12T01:11:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.996+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.DkGm2SZerXcMTnXbmgUkCPoqL28voMk_0 2024-09-12T01:11:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.997+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9894814336784545611', time=2024-09-12T03:01:40.985509+0000, chain.objs.size()=1 2024-09-12T01:11:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.997+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MVyy6scxuWZkD1ANAgRaGNacmUbJl04_0 2024-09-12T01:11:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.997+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6160422976512409504', time=2024-09-12T03:01:41.024124+0000, chain.objs.size()=1 2024-09-12T01:11:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.997+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wyhwA1ze_V0LIT28sMsa8_FR-SEErD6_0 2024-09-12T01:11:22.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.997+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16704299660594286378', time=2024-09-12T03:01:41.081149+0000, chain.objs.size()=1 2024-09-12T01:11:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:22.997+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.n-e1rlY5_1V-2Z4IVVf3FEzJje-sC_x_0 2024-09-12T01:11:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.000+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3166389980281465528', time=2024-09-12T03:01:41.202823+0000, chain.objs.size()=1 2024-09-12T01:11:22.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.000+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LcyZDm46FzroeHIbZbuVhy3bvMgXmDn_0 2024-09-12T01:11:23.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18192819106085585949', time=2024-09-12T03:01:41.229315+0000, chain.objs.size()=1 2024-09-12T01:11:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vMxyAtgPD0EydV_pVKQpoHmFibjFigo_0 2024-09-12T01:11:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13592713737256692627', time=2024-09-12T03:01:41.241177+0000, chain.objs.size()=1 2024-09-12T01:11:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.abd5kjUVb113HXLjX650hVvFO2iwTWQ_0 2024-09-12T01:11:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.681068975373402520', time=2024-09-12T03:01:41.249012+0000, chain.objs.size()=1 2024-09-12T01:11:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.q24e6ZFtiuCzbmspz8KwtEMiMXOnecu_0 2024-09-12T01:11:23.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.716220497603018163', time=2024-09-12T03:01:41.313712+0000, chain.objs.size()=1 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hk5FYivPRI_x30XkNQwuWKAuiGdNGdH_0 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10985212328315543876', time=2024-09-12T03:01:41.314738+0000, chain.objs.size()=1 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jGz2r0feUDnvExX8rlC5fPEY4oJ9OT5_0 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1151470679607613501', time=2024-09-12T03:01:41.331246+0000, chain.objs.size()=1 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hVq4oytGK9mfoRutT_olrTKyWipPrn7_0 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6051083452653806305', time=2024-09-12T03:01:41.341445+0000, chain.objs.size()=1 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.TmGyX0G7nqAgkP4jd2vRCwMxyqknOsI_0 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11958214776605608183', time=2024-09-12T03:01:41.444326+0000, chain.objs.size()=1 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.oEiQLVvpshIZFqwUd7k7lB5kX188Xyx_0 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17940661911441868210', time=2024-09-12T03:01:41.461999+0000, chain.objs.size()=1 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Jn4vOYJRXPo0e1O-Tigp1UTHwnL19Ox_0 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8216482828137090067', time=2024-09-12T03:01:41.465067+0000, chain.objs.size()=1 2024-09-12T01:11:23.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.iUecflvnnND1HW7-jE2Uhxh1FMsTL-r_0 2024-09-12T01:11:23.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.006+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7318077918402419034', time=2024-09-12T03:01:41.468448+0000, chain.objs.size()=1 2024-09-12T01:11:23.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.006+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.X3aQnX9Uva3IABUEEF78URXZFg7jiDS_0 2024-09-12T01:11:23.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.006+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7708718799349259108', time=2024-09-12T03:01:41.741685+0000, chain.objs.size()=1 2024-09-12T01:11:23.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.006+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.VL_j5NSZQnIeyGurCX2t5wAo5_6UfVp_0 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15185017541696936613', time=2024-09-12T03:01:41.761455+0000, chain.objs.size()=1 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZAmIDT9Yh2XDe9XxKiJC5ZJ69vvPXdq_0 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11055219316214824129', time=2024-09-12T03:01:41.784985+0000, chain.objs.size()=1 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.xd5_Vm-C1bHt1jwD-68yWbvTUzfKd3O_0 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1464251751913222682', time=2024-09-12T03:01:41.791698+0000, chain.objs.size()=1 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hJm2j2K_o2XuzLBK0FCOOBekonECSR7_0 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12247954706659440008', time=2024-09-12T03:01:41.835764+0000, chain.objs.size()=1 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-kIoojEWjBPskG6hyVmH0ksYB9GVu7T_0 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4797670473413452195', time=2024-09-12T03:01:41.852742+0000, chain.objs.size()=1 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.W9Aw8gmGmOILbSmeqHUrBTzs4yv2A9F_0 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7857785428015450367', time=2024-09-12T03:01:41.876966+0000, chain.objs.size()=1 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.008+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.h0bfAlsYx99Mxe32No6NyaeIp2vTn0B_0 2024-09-12T01:11:23.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.009+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18422430863859625481', time=2024-09-12T03:01:41.983213+0000, chain.objs.size()=1 2024-09-12T01:11:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.009+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MiQJkmtMuJJXSRfiZgeNMImfAiTJilY_0 2024-09-12T01:11:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.010+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6516700921018530936', time=2024-09-12T03:01:41.983988+0000, chain.objs.size()=1 2024-09-12T01:11:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.010+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.R_unY7iGom0kkH6OPMUih8JGP7YTqHX_0 2024-09-12T01:11:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.010+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5909662159678331797', time=2024-09-12T03:01:50.232477+0000, chain.objs.size()=1 2024-09-12T01:11:23.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.010+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.NVdwguKGBa8w_5faTljSHFMsw43H2cQ_0 2024-09-12T01:11:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.012+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15948211038271449810', time=2024-09-12T03:01:50.252503+0000, chain.objs.size()=1 2024-09-12T01:11:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.012+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.B41wske7uwchDPYg1-l5nf3Qroie2dL_0 2024-09-12T01:11:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.012+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10843628574783282659', time=2024-09-12T03:01:50.253246+0000, chain.objs.size()=1 2024-09-12T01:11:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.012+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.d2gzkSBKTehTphMnO3dZiwSKwyqLPy1_0 2024-09-12T01:11:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.012+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17276159851936664339', time=2024-09-12T03:01:50.334516+0000, chain.objs.size()=1 2024-09-12T01:11:23.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.012+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.nm3ea-IdD4H96O29S1JhtNBTQtI0GnP_0 2024-09-12T01:11:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.013+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7706765563934620299', time=2024-09-12T03:01:50.350837+0000, chain.objs.size()=1 2024-09-12T01:11:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.013+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Ooa5nN4usEfqmxQqOV5-v47tGpGy1XK_0 2024-09-12T01:11:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.013+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6870898781553255755', time=2024-09-12T03:01:50.355733+0000, chain.objs.size()=1 2024-09-12T01:11:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.013+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.sGet_DGLSdSKUxXs5HmX157T0hnbsqB_0 2024-09-12T01:11:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.013+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16307097334680452649', time=2024-09-12T03:01:50.539049+0000, chain.objs.size()=1 2024-09-12T01:11:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.013+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FZNzc80chTnegV9KoXMkrhV0c4GRyfj_0 2024-09-12T01:11:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.013+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17831756665862406548', time=2024-09-12T03:01:50.540588+0000, chain.objs.size()=1 2024-09-12T01:11:23.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.013+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Z_I4OUs7N40tGKjnXK_GybYugILUAvG_0 2024-09-12T01:11:23.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.018+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/46590 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=47, truncated=0, next_marker='' 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14881482592722303020', time=2024-09-12T03:01:50.544753+0000, chain.objs.size()=1 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lGhW3xCP5GRb7Kl8xihWuey6m_1WZet_0 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17326319690040602173', time=2024-09-12T03:01:50.638347+0000, chain.objs.size()=1 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mvm-4KsvfByYUyezGRa7UXxiD_Jb_mD_0 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2362778628936121850', time=2024-09-12T03:01:50.707684+0000, chain.objs.size()=1 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hYC9lcBu0DKYtgUOIGmHBxQjF6AkXVl_0 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17314536533296806114', time=2024-09-12T03:01:50.841801+0000, chain.objs.size()=1 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JGISjoJNjjt76xKH0pxEUyTYU_29RVJ_0 2024-09-12T01:11:23.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.819821256000699730', time=2024-09-12T03:01:50.858982+0000, chain.objs.size()=1 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Z1Vq-V5-5W4RPZKxutgBwli_Q2JthlT_0 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1732356317134399964', time=2024-09-12T03:01:50.974045+0000, chain.objs.size()=1 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jH_JrI5R7rrXMaznJwNdJmTtrD94pJq_0 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3767222132449554720', time=2024-09-12T03:01:50.982046+0000, chain.objs.size()=1 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3OBkRkvPRlH7hPq-qrplO0K8NjRz4JV_0 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6057747490159957935', time=2024-09-12T03:01:51.171133+0000, chain.objs.size()=1 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.791wkwWi4YiF7S2nB-CQ2RoMx679VRZ_0 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.627788119025906336', time=2024-09-12T03:01:51.189169+0000, chain.objs.size()=1 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LXkSotv90_mizflitwKxaRDeZnxAdCh_0 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12788975449307072572', time=2024-09-12T03:01:51.201682+0000, chain.objs.size()=1 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.020+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.YcNrUszMRT2ZD0djT13LfQs4L4LP6gy_0 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.021+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.163435423200560538', time=2024-09-12T03:01:51.231816+0000, chain.objs.size()=1 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.021+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Fy2XnMvtFSY9eDYCJV6AjbOMCxKXGeG_0 2024-09-12T01:11:23.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.021+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3270944553152914722', time=2024-09-12T03:01:51.274920+0000, chain.objs.size()=1 2024-09-12T01:11:23.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.021+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8oshdNF1W3z5STsqE4I3e5KwRNxKO0o_0 2024-09-12T01:11:23.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.024+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3599586009382634228', time=2024-09-12T03:01:51.359208+0000, chain.objs.size()=1 2024-09-12T01:11:23.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.024+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.emCMPW87d6fxbl39IiZ6_qDdCPASLIz_0 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8552997706080622648', time=2024-09-12T03:01:51.389177+0000, chain.objs.size()=1 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.R6JzBmbfFXuHGGScaw8pRP74z5W6aLr_0 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4116714332008868006', time=2024-09-12T03:01:51.392685+0000, chain.objs.size()=1 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fUI0wy0dE296nl16plAVQ_zhR1rLXQT_0 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7817503086965705545', time=2024-09-12T03:01:51.415974+0000, chain.objs.size()=1 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.y3cvvx34tZGvVSzE3lmo_pTpP9wROEn_0 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12974559522161078254', time=2024-09-12T03:01:51.447948+0000, chain.objs.size()=1 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GD4K2QNUHVJeWOW5AqVMKQhGfyzN9d7_0 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13461075468495482755', time=2024-09-12T03:01:51.501259+0000, chain.objs.size()=1 2024-09-12T01:11:23.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Be4VrEbWoA_rsfPZCoybq-QHNV6o0QO_0 2024-09-12T01:11:23.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17475071739955401662', time=2024-09-12T03:01:51.506421+0000, chain.objs.size()=1 2024-09-12T01:11:23.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tMJ79HcynJT0jMswI27tM7vq8D_vQkD_0 2024-09-12T01:11:23.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9032608916615585114', time=2024-09-12T03:01:51.652556+0000, chain.objs.size()=1 2024-09-12T01:11:23.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.025+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CnfwksI3LXAuXWUv8SKNj9lVL92mWwV_0 2024-09-12T01:11:23.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.026+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11842144769429353887', time=2024-09-12T03:01:51.678356+0000, chain.objs.size()=1 2024-09-12T01:11:23.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.026+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._qcwTRrHrftAv3Nw_K1bfwZMCQeWc8X_0 2024-09-12T01:11:23.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.026+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5858898549674498948', time=2024-09-12T03:01:51.710046+0000, chain.objs.size()=1 2024-09-12T01:11:23.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.026+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zZ2nDx8Glug9HwU_cazlB-tUcchfEZk_0 2024-09-12T01:11:23.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.026+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8764773345153666965', time=2024-09-12T03:01:51.714166+0000, chain.objs.size()=1 2024-09-12T01:11:23.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.026+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.PmVL6Fyrv9Ir6SC9lqsRbc7ivIl7bIw_0 2024-09-12T01:11:23.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.027+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9369233396539771069', time=2024-09-12T03:01:51.757835+0000, chain.objs.size()=1 2024-09-12T01:11:23.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.027+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.x8crmWi5fMbBhBfACgMXD2vDAUyvFf1_0 2024-09-12T01:11:23.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.029+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.592154858757154662', time=2024-09-12T03:01:51.768847+0000, chain.objs.size()=1 2024-09-12T01:11:23.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.029+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.o1TaLbBtgYkqGEEt6Ut2bmG9jSBYekS_0 2024-09-12T01:11:23.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.029+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17613335457787123207', time=2024-09-12T03:01:51.926440+0000, chain.objs.size()=1 2024-09-12T01:11:23.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.029+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.VrLuj6W6iCh6dmF-n_vjTJo7sJ3qGIx_0 2024-09-12T01:11:23.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.029+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5870975935455377343', time=2024-09-12T03:01:52.008241+0000, chain.objs.size()=1 2024-09-12T01:11:23.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.029+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.VDFKt-Xl71wt66ttVH3L0BCtAP7YSug_0 2024-09-12T01:11:23.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.030+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8573577310298004748', time=2024-09-12T03:01:52.200213+0000, chain.objs.size()=1 2024-09-12T01:11:23.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.030+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.b3uQ-SLtnhc-WfTRIllSD0dusQvClMm_0 2024-09-12T01:11:23.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.030+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1799634620090398602', time=2024-09-12T03:01:52.279909+0000, chain.objs.size()=1 2024-09-12T01:11:23.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.030+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QC8dACMnQv_eQ5VKLfYzLQpkFUtqxYh_0 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14337985013247048028', time=2024-09-12T03:01:52.314091+0000, chain.objs.size()=1 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.p-ulHhvbOls8ii0c3Rnwl0tcEf8MFik_0 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11054312834798541075', time=2024-09-12T03:02:12.771870+0000, chain.objs.size()=1 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.373__shadow_.BPm8BKWbPFDwBLrevftSq_rxXwECpiR_0 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13570871589605418714', time=2024-09-12T03:02:13.260716+0000, chain.objs.size()=1 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.374__shadow_.17kwmgOJTOFMMc2n3a0X_Qp0bO_EPv0_0 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1673861351161721802', time=2024-09-12T03:02:52.873618+0000, chain.objs.size()=1 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.448__shadow_.uIU6vKb4QAEmSYelZHyqm2UitMjFl5G_0 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17493337560612073071', time=2024-09-12T03:03:04.339975+0000, chain.objs.size()=1 2024-09-12T01:11:23.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.031+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.467__shadow_.JlFabJzdVEDSJ7vQNJMigKx-CIKaF59_0 2024-09-12T01:11:23.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.033+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12949239143188377618', time=2024-09-12T03:03:10.092156+0000, chain.objs.size()=1 2024-09-12T01:11:23.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.033+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.wXWoDCX_ANHVHn1T_TRfHtasfhr2it7_0 2024-09-12T01:11:23.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.034+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1363055208320327636', time=2024-09-12T03:03:21.917553+0000, chain.objs.size()=6 2024-09-12T01:11:23.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.034+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.1 2024-09-12T01:11:23.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.034+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.2 2024-09-12T01:11:23.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.035+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.3 2024-09-12T01:11:23.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.035+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.4 2024-09-12T01:11:23.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.035+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.5 2024-09-12T01:11:23.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.037+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.6 2024-09-12T01:11:23.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.037+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6841877574247156328', time=2024-09-12T03:03:22.109557+0000, chain.objs.size()=6 2024-09-12T01:11:23.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.037+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.1 2024-09-12T01:11:23.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.037+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.2 2024-09-12T01:11:23.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.037+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.3 2024-09-12T01:11:23.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.037+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.4 2024-09-12T01:11:23.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.037+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.5 2024-09-12T01:11:23.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.038+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.6 2024-09-12T01:11:23.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.038+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12865228661319319263', time=2024-09-12T03:03:27.466003+0000, chain.objs.size()=1 2024-09-12T01:11:23.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.038+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.518__shadow_.Ghhnpog19X4h1uVkdIv_tRmMOCGDCse_0 2024-09-12T01:11:23.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.038+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3238325863825233482', time=2024-09-12T03:04:32.380928+0000, chain.objs.size()=1 2024-09-12T01:11:23.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.038+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.561__shadow_.KiwReN7oPjntSgKgqlIMhbuYrrTvO1c_0 2024-09-12T01:11:23.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.039+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2570350701229701458', time=2024-09-12T03:04:33.068537+0000, chain.objs.size()=1 2024-09-12T01:11:23.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.039+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.562__multipart_mymultipart.vxrdff44Ryzsmdzp5wxYm5yiusZ3gaaF.1 2024-09-12T01:11:23.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.040+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10030240074784930559', time=2024-09-12T03:04:38.852175+0000, chain.objs.size()=1 2024-09-12T01:11:23.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.040+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.566__shadow_.vtoHHltEU_LGBgXf5yV0D1oNb-PPlcv_0 2024-09-12T01:11:23.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.041+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12774996643002485352', time=2024-09-12T03:04:44.613825+0000, chain.objs.size()=1 2024-09-12T01:11:23.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.041+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:BQxssMJ8m5jCHHNL0DkhWlr0uvScdul_.HexiA6rgUOflhOTuhEmQFN-OEgoIEdD_0 2024-09-12T01:11:23.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.041+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18281069576341808699', time=2024-09-12T03:05:12.904991+0000, chain.objs.size()=1 2024-09-12T01:11:23.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.041+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:AVlfOvawuQOSr0ltkFYwgjmdABaxBZk_.fOY9W89iH4spj7yAeoDt_UtX2bSf7y5_0 2024-09-12T01:11:23.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.041+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8597346852490983327', time=2024-09-12T03:05:18.044470+0000, chain.objs.size()=1 2024-09-12T01:11:23.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.041+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.588__shadow:7ZjPhET7ozcLURLVD7x4kMFwU-w7jm0_.L3Fx2yaQsznELYtCJGOE5_yvQwcRFLT_0 2024-09-12T01:11:23.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16729948888458888969', time=2024-09-12T03:07:44.231844+0000, chain.objs.size()=1 2024-09-12T01:11:23.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.629__shadow_.AFAvywZCKzWSgmYJwznfvq2igNEbMQr_0 2024-09-12T01:11:23.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2230789877363446501', time=2024-09-12T03:08:03.793530+0000, chain.objs.size()=1 2024-09-12T01:11:23.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.667__shadow_.qyYLL0jVRMXVkMfe3_sgdDKwin1zokM_0 2024-09-12T01:11:23.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6075675848300410406', time=2024-09-12T03:08:15.712306+0000, chain.objs.size()=1 2024-09-12T01:11:23.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.697__shadow:DrYLSnHqnjFe3nUgwjjqXBCZkQbqMhM_.0AoeBaIk5nEYEcJNZGexP-roehtA58y_0 2024-09-12T01:11:23.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.046+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.049+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:11:23.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.051+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56907' 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7053642054907846857', time=2024-09-12T02:58:53.763695+0000, chain.objs.size()=3 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.slaXL7O_YMTPqRQv98olActmria-yAy_0 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.slaXL7O_YMTPqRQv98olActmria-yAy_1 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.slaXL7O_YMTPqRQv98olActmria-yAy_2 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15468374806196503839', time=2024-09-12T02:58:57.072257+0000, chain.objs.size()=1 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.167__shadow_.Wp1btDOWhBmVNpZ_U94aupkZJYqBshg_0 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1227077251315922391', time=2024-09-12T03:00:36.631243+0000, chain.objs.size()=1 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.235__shadow_.AFw5BKzUIjcMaNVwK7VybHj77yl_95m_0 2024-09-12T01:11:23.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5017110305378674250', time=2024-09-12T03:00:44.545495+0000, chain.objs.size()=1 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.249__shadow_.GIZc17Ox1JvHEWsmxQwLmBlA6O1r_pT_0 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10999124334471040078', time=2024-09-12T03:00:44.546472+0000, chain.objs.size()=1 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.249__shadow_.ZKKbu9171F74LrQYWSkKL_0fAFMZvH7_0 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17876910792080122430', time=2024-09-12T03:00:46.931451+0000, chain.objs.size()=1 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.254__shadow_.-pHGnoqQPNqaorL0l8vgqebYibbR9Dn_0 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12528642559375745678', time=2024-09-12T03:00:46.933795+0000, chain.objs.size()=1 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.254__shadow_.NdveEKBNxtOcGa42arq2SKL8ic_7Nzx_0 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9621497687031079918', time=2024-09-12T03:00:46.934474+0000, chain.objs.size()=1 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.254__shadow_.xwP3ZCBB1jp94_KnkPRHp4imTH6oy_2_0 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16632445594670277271', time=2024-09-12T03:00:50.681575+0000, chain.objs.size()=1 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.262__shadow_.xdCQzewTcK7yQMGh3PyriLixW5sYE5S_0 2024-09-12T01:11:23.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9950895544460407314', time=2024-09-12T03:00:58.952414+0000, chain.objs.size()=1 2024-09-12T01:11:23.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.052+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eMaYylpIMHF20iYQXypwz5zE0iujs3W_0 2024-09-12T01:11:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10276937775664170663', time=2024-09-12T03:00:58.980227+0000, chain.objs.size()=1 2024-09-12T01:11:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.0OVpPJc_2pG2LVI3QsbSQf1hdJqWJKB_0 2024-09-12T01:11:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4198189013130365912', time=2024-09-12T03:00:59.021161+0000, chain.objs.size()=1 2024-09-12T01:11:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SI2EmUT4IMVbVaWIgGcbyKCzhiPnkcA_0 2024-09-12T01:11:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3239937021745196662', time=2024-09-12T03:00:59.042947+0000, chain.objs.size()=1 2024-09-12T01:11:23.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5u-dO5bISBOU8D2JituDTV_vK7eW99u_0 2024-09-12T01:11:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17029811227256092997', time=2024-09-12T03:00:59.130989+0000, chain.objs.size()=1 2024-09-12T01:11:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.buYTZCWwCK7QGXSSQ9CrsoDxKl4HqS1_0 2024-09-12T01:11:23.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.719973117204825149', time=2024-09-12T03:00:59.136212+0000, chain.objs.size()=1 2024-09-12T01:11:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3poMddbj6oVdxNKAkQ-B__XEEnQCxR7_0 2024-09-12T01:11:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10892534384292624825', time=2024-09-12T03:00:59.225874+0000, chain.objs.size()=1 2024-09-12T01:11:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.P470WIWNXg_kB_B7dUcvrCsqxhP6ABg_0 2024-09-12T01:11:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17869536007086510043', time=2024-09-12T03:00:59.249534+0000, chain.objs.size()=1 2024-09-12T01:11:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5h1J05_mzcLuamxoCDy_7y5suVCdpis_0 2024-09-12T01:11:23.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16153088766301491726', time=2024-09-12T03:00:59.456348+0000, chain.objs.size()=1 2024-09-12T01:11:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.B45M0JTTNzV9KUWyzy132MK54tUdlpw_0 2024-09-12T01:11:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6126604012673971639', time=2024-09-12T03:00:59.467583+0000, chain.objs.size()=1 2024-09-12T01:11:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eLI5tuFDCRiikjv1mHOjWFsvSsymGrw_0 2024-09-12T01:11:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17108062252497381871', time=2024-09-12T03:00:59.485851+0000, chain.objs.size()=1 2024-09-12T01:11:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.k4r3axwePWOs2o2uP_2Z447bD2eaBpN_0 2024-09-12T01:11:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6768457853790299464', time=2024-09-12T03:00:59.537970+0000, chain.objs.size()=1 2024-09-12T01:11:23.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.057+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hZc7aFUnCn6Qgpfz_lXJyvmdB9vHFBv_0 2024-09-12T01:11:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.060+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16581449936504995507', time=2024-09-12T03:00:59.660970+0000, chain.objs.size()=1 2024-09-12T01:11:23.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.060+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mRTyrL3t2xkpRLNoqJM_C7rJK9rkZWd_0 2024-09-12T01:11:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15204660990336792911', time=2024-09-12T03:00:59.670000+0000, chain.objs.size()=1 2024-09-12T01:11:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.gS9rH-K93PiVtplbflTXVPiH_6E_Hc3_0 2024-09-12T01:11:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7409625435366815285', time=2024-09-12T03:00:59.687417+0000, chain.objs.size()=1 2024-09-12T01:11:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rv8X-X-P_Xl_1Fx_t0rJormQP4DZ-WZ_0 2024-09-12T01:11:23.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14425417268650623736', time=2024-09-12T03:00:59.763339+0000, chain.objs.size()=1 2024-09-12T01:11:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mqEQuK5jMlS_y2skcOLzxCoBdNV1tWg_0 2024-09-12T01:11:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14472138159658921576', time=2024-09-12T03:01:00.004421+0000, chain.objs.size()=1 2024-09-12T01:11:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wgEiyJb9fqI3pI0QU9bwG2QA76niuks_0 2024-09-12T01:11:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8838239541815344461', time=2024-09-12T03:01:00.061707+0000, chain.objs.size()=1 2024-09-12T01:11:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uE6ZSx5dl4w92-zZZvuc_iKiACefQrx_0 2024-09-12T01:11:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.062+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5683081010378762509', time=2024-09-12T03:01:00.071223+0000, chain.objs.size()=1 2024-09-12T01:11:23.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.062+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lrw_i-KuSO3l96wjYGFSnBSkyyV1xC9_0 2024-09-12T01:11:23.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17970200453754629402', time=2024-09-12T03:01:00.077450+0000, chain.objs.size()=1 2024-09-12T01:11:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.heo-zwle50rs4spRhl5R5WfGWip9yOC_0 2024-09-12T01:11:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15940211399365995307', time=2024-09-12T03:01:00.246694+0000, chain.objs.size()=1 2024-09-12T01:11:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BUpSx6LyANXnTDc89x6XJXPsfRrY1oE_0 2024-09-12T01:11:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7594681330484388811', time=2024-09-12T03:01:00.330542+0000, chain.objs.size()=1 2024-09-12T01:11:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.g_HgHDUsce1JCfcVO0pC1XuMczLuusb_0 2024-09-12T01:11:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6942464229858866215', time=2024-09-12T03:01:00.334971+0000, chain.objs.size()=1 2024-09-12T01:11:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.QWsiUAdSKKBBdoTPs_WRlDaUce0-Oiq_0 2024-09-12T01:11:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14720806398363967116', time=2024-09-12T03:01:00.733146+0000, chain.objs.size()=1 2024-09-12T01:11:23.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.064+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ch5Ntvnb8sPc63jCgmBpyJDuJ0qDyce_0 2024-09-12T01:11:23.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.065+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11287532758408916095', time=2024-09-12T03:01:00.851610+0000, chain.objs.size()=1 2024-09-12T01:11:23.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.065+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2P7IKb1LPv1iYtOBau3gYi1IKl9IFpG_0 2024-09-12T01:11:23.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.065+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14038928571239892634', time=2024-09-12T03:01:00.929294+0000, chain.objs.size()=1 2024-09-12T01:11:23.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.065+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JheXD3xIbvdUVyhONtSbx_p4_CU-wjW_0 2024-09-12T01:11:23.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.065+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2988504984316996116', time=2024-09-12T03:01:00.991199+0000, chain.objs.size()=1 2024-09-12T01:11:23.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.065+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.b9MZPcIsPntVj7zg4CMBekIP2SuPp9m_0 2024-09-12T01:11:23.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.066+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6646487941309132228', time=2024-09-12T03:01:03.769639+0000, chain.objs.size()=1 2024-09-12T01:11:23.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.066+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.269__shadow_.4qGI36sV3kZx7a2WYnGg96baS47bWA4_0 2024-09-12T01:11:23.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.066+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4117767805536141198', time=2024-09-12T03:01:07.439487+0000, chain.objs.size()=1 2024-09-12T01:11:23.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.066+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.277__shadow_.EZrNJmJkvbxwQagjD7oqkuwJgSrV4gS_0 2024-09-12T01:11:23.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.068+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1339278802715901269', time=2024-09-12T03:01:14.315151+0000, chain.objs.size()=1 2024-09-12T01:11:23.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.068+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.291__shadow_.DqGpzaLN-YOBLcnBPsEHfq1Dbd7ouRw_0 2024-09-12T01:11:23.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.068+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13390415369873399812', time=2024-09-12T03:01:16.646367+0000, chain.objs.size()=1 2024-09-12T01:11:23.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.068+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.H6Tg_omr1WD1nowjdZigU94-YqUjazQ_0 2024-09-12T01:11:23.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.068+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17253731082324113069', time=2024-09-12T03:01:16.662113+0000, chain.objs.size()=1 2024-09-12T01:11:23.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.068+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.cdhNg3qL1QsVLL0VhFDig32RiMfaCn-_0 2024-09-12T01:11:23.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.068+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3535638009326841055', time=2024-09-12T03:01:18.537208+0000, chain.objs.size()=1 2024-09-12T01:11:23.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.068+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.298__shadow_.UbMZJPs22MztWxFGIdgpgLk23chnuc4_0 2024-09-12T01:11:23.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.068+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7100816622566878183', time=2024-09-12T03:01:19.062896+0000, chain.objs.size()=1 2024-09-12T01:11:23.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.069+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.299__shadow_.0VicGKdyeDfo4RFQBUexWMfmwGqN5Nj_0 2024-09-12T01:11:23.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.069+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11380428471862805676', time=2024-09-12T03:01:21.061180+0000, chain.objs.size()=1 2024-09-12T01:11:23.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.069+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.303__shadow_.NxSUmFHn1BXagM8sZhWK9ORroeMJda__0 2024-09-12T01:11:23.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4910576746414654324', time=2024-09-12T03:01:21.513887+0000, chain.objs.size()=1 2024-09-12T01:11:23.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.304__shadow_.U_YJClxfjr3ZG3xhyRR4-lbPptxbH6j_0 2024-09-12T01:11:23.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9358260156706871660', time=2024-09-12T03:01:23.719490+0000, chain.objs.size()=1 2024-09-12T01:11:23.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.308__shadow:D1ROSJwxdU1f.a0x-WuVuaBgeAQ2OKP_.EOUzsXFRXnqzjfXZa7Wg3ChVotao7zs_0 2024-09-12T01:11:23.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17109280374884403379', time=2024-09-12T03:01:26.593105+0000, chain.objs.size()=1 2024-09-12T01:11:23.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.314__shadow_.YICD4kzy-VjstL_9CMQL2QzPPenI4Iz_0 2024-09-12T01:11:23.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3908694011945700096', time=2024-09-12T03:01:40.152994+0000, chain.objs.size()=1 2024-09-12T01:11:23.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dNs5An1TLgeSh7PpaMAlB0caBUDRWuY_0 2024-09-12T01:11:23.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7176226979306280110', time=2024-09-12T03:01:40.431530+0000, chain.objs.size()=1 2024-09-12T01:11:23.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lFYNTyLQ6eAIGLyOAYh7ntdMXiaH2hl_0 2024-09-12T01:11:23.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5282868715617312319', time=2024-09-12T03:01:40.460029+0000, chain.objs.size()=1 2024-09-12T01:11:23.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.072+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1p5qSAXNAQmv4XHggBiS7pqHdvEwwKR_0 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4370139232677566570', time=2024-09-12T03:01:40.653695+0000, chain.objs.size()=1 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LLH3DvXBRiWoztfmE3rTFaMgbFsPNpp_0 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16610991891195959710', time=2024-09-12T03:01:40.663531+0000, chain.objs.size()=1 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.H-cmovuN8DuyxR4MBn06yskqcGMSCeJ_0 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12484100131482113640', time=2024-09-12T03:01:40.666497+0000, chain.objs.size()=1 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.voiA7tDFQ26VJPQchUHV7UPGfUcuM3Y_0 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14115285273446486654', time=2024-09-12T03:01:40.705109+0000, chain.objs.size()=1 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JcJxjwC-B9_wlirMlLLXN23Yryrqv_8_0 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13346941460895231490', time=2024-09-12T03:01:40.725314+0000, chain.objs.size()=1 2024-09-12T01:11:23.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.073+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.W7rXkeCD8dQlLvRwzBU9SjMx67-FzCD_0 2024-09-12T01:11:23.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10913281942372935602', time=2024-09-12T03:01:40.764415+0000, chain.objs.size()=1 2024-09-12T01:11:23.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qXCYKYmBLXRiN55x5c3y3B1xoiDotU0_0 2024-09-12T01:11:23.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17474437647496610740', time=2024-09-12T03:01:40.774617+0000, chain.objs.size()=1 2024-09-12T01:11:23.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ynIxmYGBh3VQ0iyoblAw7REbS72jyh8_0 2024-09-12T01:11:23.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3835229477449390028', time=2024-09-12T03:01:40.905611+0000, chain.objs.size()=1 2024-09-12T01:11:23.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FQ0iuLluJ1PiKhNBS7rK_LOSyrSub6r_0 2024-09-12T01:11:23.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7658663866642467130', time=2024-09-12T03:01:40.907021+0000, chain.objs.size()=1 2024-09-12T01:11:23.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mS4Kz5VQLLWLzNecXBBYLWmLkaROhBD_0 2024-09-12T01:11:23.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4127685078593741482', time=2024-09-12T03:01:40.954340+0000, chain.objs.size()=1 2024-09-12T01:11:23.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.y8aS6ZgXZGxvyI99LqaBhDb-njKsSH5_0 2024-09-12T01:11:23.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5806129017479913388', time=2024-09-12T03:01:40.987475+0000, chain.objs.size()=1 2024-09-12T01:11:23.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mtWysSTDVxy2QkrcdzuU-RdoB7isx2s_0 2024-09-12T01:11:23.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15754096664117499736', time=2024-09-12T03:01:41.024621+0000, chain.objs.size()=1 2024-09-12T01:11:23.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lyqWO5GhbX7p9epGqjhhO6k8qCwX-MA_0 2024-09-12T01:11:23.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.080+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3088621824812068222', time=2024-09-12T03:01:41.082239+0000, chain.objs.size()=1 2024-09-12T01:11:23.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.080+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fzQS-tbzYmpvc8rPOVmojGkddYNWeH6_0 2024-09-12T01:11:23.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.080+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6361329235316962851', time=2024-09-12T03:01:41.190260+0000, chain.objs.size()=1 2024-09-12T01:11:23.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.080+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.05cmCvs0_Gt3WYVfe2WGw-Dmpm81xGC_0 2024-09-12T01:11:23.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.081+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11103240574582509277', time=2024-09-12T03:01:41.282516+0000, chain.objs.size()=1 2024-09-12T01:11:23.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.081+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ra9AiwOoQh9WAELcAKRWPCEqNTqfie2_0 2024-09-12T01:11:23.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.081+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14771978843061557552', time=2024-09-12T03:01:41.312028+0000, chain.objs.size()=1 2024-09-12T01:11:23.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.081+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0d7841sWsUOqewxceqRicQudmo5wFrj_0 2024-09-12T01:11:23.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.082+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10398134955204784944', time=2024-09-12T03:01:41.331301+0000, chain.objs.size()=1 2024-09-12T01:11:23.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.082+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pN8oduuX5Z0hwr2kctf-mE40fHnO7m3_0 2024-09-12T01:11:23.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.082+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6537164566653952395', time=2024-09-12T03:01:41.452432+0000, chain.objs.size()=1 2024-09-12T01:11:23.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.082+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.T21CUebesAz9ocuDLC0_3sjcM-4dhvI_0 2024-09-12T01:11:23.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.082+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10055565246978642291', time=2024-09-12T03:01:41.459219+0000, chain.objs.size()=1 2024-09-12T01:11:23.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.082+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KKlH_0wAdnhbLODt9hhiSEaGcV2_DQY_0 2024-09-12T01:11:23.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17969269142938108762', time=2024-09-12T03:01:41.485818+0000, chain.objs.size()=1 2024-09-12T01:11:23.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.SgPHb0pjRFfq9coUNj-gzZ0pgdaKe6i_0 2024-09-12T01:11:23.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6026885945833034815', time=2024-09-12T03:01:41.512476+0000, chain.objs.size()=1 2024-09-12T01:11:23.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QkU6TLWFonq_rb1dValsryXJlc9V2sl_0 2024-09-12T01:11:23.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12390268069175657487', time=2024-09-12T03:01:41.539744+0000, chain.objs.size()=1 2024-09-12T01:11:23.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MsvLon8mF8aVqUdDD7_lGTQMFg2VQXR_0 2024-09-12T01:11:23.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9387597229117117398', time=2024-09-12T03:01:41.556736+0000, chain.objs.size()=1 2024-09-12T01:11:23.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tr_m3n2qFazt1v8DI605Xa3tEJqvMOU_0 2024-09-12T01:11:23.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1274800412998192544', time=2024-09-12T03:01:41.705868+0000, chain.objs.size()=1 2024-09-12T01:11:23.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EJ9WQ0L_orn7yj2JFlM5uwtQKJcS4Kx_0 2024-09-12T01:11:23.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6509857154904466830', time=2024-09-12T03:01:41.706655+0000, chain.objs.size()=1 2024-09-12T01:11:23.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tEbLXbEo2obpBpeu1U58glIhU9F4aGi_0 2024-09-12T01:11:23.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8744558695753286303', time=2024-09-12T03:01:41.715491+0000, chain.objs.size()=1 2024-09-12T01:11:23.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.085+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.HWXgnDeEzJzWJHqEjPls6p9nw0vKDl2_0 2024-09-12T01:11:23.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15216856858012664222', time=2024-09-12T03:01:41.740344+0000, chain.objs.size()=1 2024-09-12T01:11:23.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.oeNSPQF3MEbqDI02qhF31ISgYvlDDMN_0 2024-09-12T01:11:23.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11791244318549155425', time=2024-09-12T03:01:41.746790+0000, chain.objs.size()=1 2024-09-12T01:11:23.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.529v5thazEE8cGsK721lfy3wDnAYrOo_0 2024-09-12T01:11:23.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.089+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11599565544919129273', time=2024-09-12T03:01:41.886149+0000, chain.objs.size()=1 2024-09-12T01:11:23.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.089+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Lj2LXHUqjdLbNdYNAwfOQwyvCSnjvOJ_0 2024-09-12T01:11:23.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.089+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4755884003718838066', time=2024-09-12T03:01:41.966650+0000, chain.objs.size()=1 2024-09-12T01:11:23.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.089+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.YWEz4ZQiAw7YOoy1LyNfNhZU2fRyCd4_0 2024-09-12T01:11:23.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.091+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12209796458307891934', time=2024-09-12T03:01:42.028845+0000, chain.objs.size()=1 2024-09-12T01:11:23.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.091+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4-hACBpGQWSlmCeIyVDXE_A9WA5ZpgN_0 2024-09-12T01:11:23.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.091+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.883458248598371278', time=2024-09-12T03:01:42.076355+0000, chain.objs.size()=1 2024-09-12T01:11:23.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.091+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vO5ksRZyiTMP4JvtkvojW-d6--3iyT2_0 2024-09-12T01:11:23.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2965932660741646349', time=2024-09-12T03:01:42.101196+0000, chain.objs.size()=1 2024-09-12T01:11:23.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JgqWtTe_Bt9Rogovv__pzXxY0RQb59p_0 2024-09-12T01:11:23.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12208370681217050332', time=2024-09-12T03:01:50.216480+0000, chain.objs.size()=1 2024-09-12T01:11:23.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3YLmsu0A4kPzwPJxzZMi38UuITRETS4_0 2024-09-12T01:11:23.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17210177303509079965', time=2024-09-12T03:01:50.268871+0000, chain.objs.size()=1 2024-09-12T01:11:23.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.F6TTRKyG6fCosJl1WmF0SLAh81gW0RD_0 2024-09-12T01:11:23.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5016378140869178918', time=2024-09-12T03:01:50.534392+0000, chain.objs.size()=1 2024-09-12T01:11:23.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.v-_VCQ9uktLOcP4ZSISmLuNMWR1S5ME_0 2024-09-12T01:11:23.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17558108283123964133', time=2024-09-12T03:01:50.585402+0000, chain.objs.size()=1 2024-09-12T01:11:23.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._B4nA4QnQ0RhMyEt-m_slj6LHf-855S_0 2024-09-12T01:11:23.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13799255022217767729', time=2024-09-12T03:01:50.597024+0000, chain.objs.size()=1 2024-09-12T01:11:23.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xx-DddVWveR56BVXyYJZC7psO3WY0uI_0 2024-09-12T01:11:23.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.651952803449770980', time=2024-09-12T03:01:50.619518+0000, chain.objs.size()=1 2024-09-12T01:11:23.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.092+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Dw88UxHa7c0EBzUvLNk23I9cTwXKRHZ_0 2024-09-12T01:11:23.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.093+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16701094977880596407', time=2024-09-12T03:01:50.686408+0000, chain.objs.size()=1 2024-09-12T01:11:23.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.093+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.WTsZ7v0a0oZ-_BRY2QMXwLXF47oGXki_0 2024-09-12T01:11:23.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.094+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4461919641771123377', time=2024-09-12T03:01:50.823325+0000, chain.objs.size()=1 2024-09-12T01:11:23.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.094+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.NaQUTVxs_vai_0HUdH2hN4cWGgRADH7_0 2024-09-12T01:11:23.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.096+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1066464599348473498', time=2024-09-12T03:01:50.839870+0000, chain.objs.size()=1 2024-09-12T01:11:23.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.096+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.XDqBk-JI-f__yEhGDWlFH2ktFhUgyIT_0 2024-09-12T01:11:23.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.096+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17696074413227894850', time=2024-09-12T03:01:50.900192+0000, chain.objs.size()=1 2024-09-12T01:11:23.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.096+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rACsCNw0VvqIIKwSqPlhV8kjSJ7xCuW_0 2024-09-12T01:11:23.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.096+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9845012484858639230', time=2024-09-12T03:01:51.107288+0000, chain.objs.size()=1 2024-09-12T01:11:23.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.096+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qcQUd9uauZhhBIgCnnMAxdEnXZD6DR9_0 2024-09-12T01:11:23.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10713256901789319411', time=2024-09-12T03:01:51.113604+0000, chain.objs.size()=1 2024-09-12T01:11:23.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.aeM1mRansuVcKea7FeGpoZbahqRaTqd_0 2024-09-12T01:11:23.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12314091437029564776', time=2024-09-12T03:01:51.116973+0000, chain.objs.size()=1 2024-09-12T01:11:23.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JB8FoARr80txl3LBbqd7l0E1asG-NTG_0 2024-09-12T01:11:23.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15451315354656891475', time=2024-09-12T03:01:51.155434+0000, chain.objs.size()=1 2024-09-12T01:11:23.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QnVoqYYnnnxZJHFYUe5SytkExIN4f29_0 2024-09-12T01:11:23.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5479357527334767616', time=2024-09-12T03:01:51.278482+0000, chain.objs.size()=1 2024-09-12T01:11:23.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.eebGFNKXf5VuVvq68RNfJYbKYn3tqb-_0 2024-09-12T01:11:23.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.905794838901494782', time=2024-09-12T03:01:51.430908+0000, chain.objs.size()=1 2024-09-12T01:11:23.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KKT24FzxO8q5ubwr78l3k054zY9dOSr_0 2024-09-12T01:11:23.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17144119416470586639', time=2024-09-12T03:01:51.432526+0000, chain.objs.size()=1 2024-09-12T01:11:23.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.097+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pFRg3ew-HSrSgibPRgSNwwN_r4FXQ2S_0 2024-09-12T01:11:23.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.104+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/56907 2024-09-12T01:11:23.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T01:11:23.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1370616379173273605', time=2024-09-12T03:01:51.443546+0000, chain.objs.size()=1 2024-09-12T01:11:23.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Jz-K_NyBJ0PqMkKmYIcM83a8RcCQ4gS_0 2024-09-12T01:11:23.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15202671019779405084', time=2024-09-12T03:01:51.463322+0000, chain.objs.size()=1 2024-09-12T01:11:23.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.cgmBsHAaTdVju8C_rvdBJ3GKaTg0n5n_0 2024-09-12T01:11:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5638804339961206933', time=2024-09-12T03:01:51.479198+0000, chain.objs.size()=1 2024-09-12T01:11:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.byaqXHzNs5DB8La9NkDukdLelOcmX-d_0 2024-09-12T01:11:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9439341606872903477', time=2024-09-12T03:01:51.688887+0000, chain.objs.size()=1 2024-09-12T01:11:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.f30uz75rqjl0a-XTgjoN9t7kJq_ZNw1_0 2024-09-12T01:11:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17451620734357149732', time=2024-09-12T03:01:51.707197+0000, chain.objs.size()=1 2024-09-12T01:11:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.WEL23yfpXx48JeeBqr7At8DLxcyLuAr_0 2024-09-12T01:11:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10928824025927385914', time=2024-09-12T03:01:51.813467+0000, chain.objs.size()=1 2024-09-12T01:11:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.sFUqb1F9gP5lk7jtm3TSPEUWBq43Y9f_0 2024-09-12T01:11:23.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11758872050603471835', time=2024-09-12T03:01:51.819341+0000, chain.objs.size()=1 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-L9NPKOn_EdaPvGZfmoW0tZQ2PzaKdq_0 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17861971490427858300', time=2024-09-12T03:01:51.945038+0000, chain.objs.size()=1 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JLOh4KGibE1gczppDgnpUXBNbj0zQTq_0 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9148790991102996021', time=2024-09-12T03:01:51.970610+0000, chain.objs.size()=1 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.i9ytEQe59VsShDiWGnVVqflzkhGJSkg_0 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5275004042820327960', time=2024-09-12T03:01:51.992510+0000, chain.objs.size()=1 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3LNnoCQWO-yArYeWwGTXp1Ur1pTcKfm_0 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16081893270046453641', time=2024-09-12T03:01:52.010713+0000, chain.objs.size()=1 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.01JtfpvrJBWuWJzXWvbMKcNmstkLGzB_0 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10598387454741398795', time=2024-09-12T03:01:52.051918+0000, chain.objs.size()=1 2024-09-12T01:11:23.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.106+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.WBHsbvNDZ5PbiE0rmtg299qxohYGVYM_0 2024-09-12T01:11:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.109+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7086432043904179354', time=2024-09-12T03:01:52.185952+0000, chain.objs.size()=1 2024-09-12T01:11:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.109+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kwuCTU2o7_2nVJKSCsNvJFXciJwEont_0 2024-09-12T01:11:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.109+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9671367099321237679', time=2024-09-12T03:01:52.214819+0000, chain.objs.size()=1 2024-09-12T01:11:23.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.109+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tYKwgCUeOmxHyq-PHeV39_OkYFRbpTS_0 2024-09-12T01:11:23.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.344266753279223115', time=2024-09-12T03:01:52.238729+0000, chain.objs.size()=1 2024-09-12T01:11:23.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TdOA8xyvCB3ecPTqVR4sH0ppRPxcFAX_0 2024-09-12T01:11:23.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1912487336577786558', time=2024-09-12T03:01:52.275393+0000, chain.objs.size()=1 2024-09-12T01:11:23.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.YawK_4KB36kkfF0vjeEannzPOZz4hjY_0 2024-09-12T01:11:23.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9230489970056824772', time=2024-09-12T03:01:59.007667+0000, chain.objs.size()=1 2024-09-12T01:11:23.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.340__shadow_.pqywiIL8mzbZY5IzCIppstyxQ-FoMGv_0 2024-09-12T01:11:23.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6780239333336241730', time=2024-09-12T03:02:02.288366+0000, chain.objs.size()=1 2024-09-12T01:11:23.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.347__shadow_._6t5Sn-9_usiwX2cSTl-V1pILrB0EUQ_0 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17938357684258173369', time=2024-09-12T03:02:14.764948+0000, chain.objs.size()=1 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.375__shadow_.mHuZNpf-Mihs7NAEkc_IdS7yc7DXmY5_0 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18302802770557599657', time=2024-09-12T03:02:17.132831+0000, chain.objs.size()=1 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.380__shadow_.DzD65qBgM7I0isVuBQDlybpG5dM8Bhb_0 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17174927908946302041', time=2024-09-12T03:02:49.559640+0000, chain.objs.size()=1 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.111+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.443__shadow_.zwHzFeRPQgHprXlI87K1RHHLpN5QiOf_0 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.112+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3351987210870763547', time=2024-09-12T03:02:59.134902+0000, chain.objs.size()=1 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.112+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.459__shadow_.uu_MnHziGXwPLVR7aGWvMNUev6XStbN_0 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.112+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3870725832416762499', time=2024-09-12T03:03:03.312598+0000, chain.objs.size()=1 2024-09-12T01:11:23.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.112+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.465__shadow_.BF-thdVaQgDOYRm3NaIVX2Q1-cb7JTp_0 2024-09-12T01:11:23.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.114+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.156754173478294919', time=2024-09-12T03:03:08.930957+0000, chain.objs.size()=1 2024-09-12T01:11:23.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.114+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.482__shadow_.uYa5V1bAxFmTBA31rRgWGRpqNTCuQlk_0 2024-09-12T01:11:23.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.115+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18116797173429642805', time=2024-09-12T03:03:19.458767+0000, chain.objs.size()=1 2024-09-12T01:11:23.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.115+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.504__shadow:Sxqts83E9ch0mXuzA3cUygir9GtCc0q_.GJXGml4UggGV5JB-2HNawTbAzqH1P1u_0 2024-09-12T01:11:23.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.115+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13337104600992110597', time=2024-09-12T03:04:40.905556+0000, chain.objs.size()=1 2024-09-12T01:11:23.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.115+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:evWLg3la37mA7UJq686Q81O5ed6k.Ge_.1p8Aglqe0XGbe1tyT-978idyLXSSDo__0 2024-09-12T01:11:23.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.115+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1330831113610916946', time=2024-09-12T03:04:45.627907+0000, chain.objs.size()=1 2024-09-12T01:11:23.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.115+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:9BFlq-9Wm6LDD5YRs5o2Sih27TD7RxN_.gh7QYpr7sTqeM-KeKyXA792J5kzIAvh_0 2024-09-12T01:11:23.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.116+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5205707875423540672', time=2024-09-12T03:04:46.777370+0000, chain.objs.size()=1 2024-09-12T01:11:23.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.116+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:9MYvoD--YSHjL2bVcE334277JXgzxcR_.oHGqpAKHhImxVXOO3selP4FBlEpU9Zx_0 2024-09-12T01:11:23.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.116+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9931673963694574666', time=2024-09-12T03:04:50.774674+0000, chain.objs.size()=1 2024-09-12T01:11:23.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.116+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow:IVS7zAxhguuWo.9-QadqHf8vhiDHroI_.IBlbS3TwdE4Xht_B-kF8i2ZbgX1qT0V_0 2024-09-12T01:11:23.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.116+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10080360229227997406', time=2024-09-12T03:04:56.387843+0000, chain.objs.size()=1 2024-09-12T01:11:23.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.116+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:ZQnHroB7LdqhJPhpCaDrb.diCrCTli7_.6ppBiUH70cxqhIz9tPFI1aH_zuuChFi_0 2024-09-12T01:11:23.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.116+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18010816220019724716', time=2024-09-12T03:04:59.332581+0000, chain.objs.size()=1 2024-09-12T01:11:23.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.116+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:oNGKa6iK3rxHxetboTlpE050DTklgQ6_.r4unpBzD1OBx7tf1wQQ-qT2tBuTw_k3_0 2024-09-12T01:11:23.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.117+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13445526379794554757', time=2024-09-12T03:05:05.190807+0000, chain.objs.size()=1 2024-09-12T01:11:23.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.117+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:z1qG1lw3rz8AfBAz4ac3tYTwUvrxOKk_.fdc_kMK4mnRZcsnBxia3E15-f3ACCVh_0 2024-09-12T01:11:23.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.117+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.908241610722775210', time=2024-09-12T03:05:31.635436+0000, chain.objs.size()=12 2024-09-12T01:11:23.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.117+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__multipart_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.1 2024-09-12T01:11:23.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.117+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__shadow_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.1_1 2024-09-12T01:11:23.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.119+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__multipart_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.2 2024-09-12T01:11:23.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.119+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__shadow_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.2_1 2024-09-12T01:11:23.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.119+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__multipart_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.3 2024-09-12T01:11:23.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.119+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__shadow_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.3_1 2024-09-12T01:11:23.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.123+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__multipart_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.4 2024-09-12T01:11:23.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.123+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__shadow_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.4_1 2024-09-12T01:11:23.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.123+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__multipart_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.5 2024-09-12T01:11:23.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.123+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__shadow_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.5_1 2024-09-12T01:11:23.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.123+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__multipart_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.6 2024-09-12T01:11:23.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.123+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.614__shadow_multipart_enc.2~Dtd14AzgweEBWHugTbepbi73CKYTzAX.6_1 2024-09-12T01:11:23.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.128+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.131+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:11:23.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.132+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49877' 2024-09-12T01:11:23.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_ljMRvgbqFg5Dua0mgkCmlhThW7iVwgX', time=2024-09-12T02:58:54.019375+0000, chain.objs.size()=1 2024-09-12T01:11:23.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.fxUUTLDdBQ4DiI1Zeev1ONerFPFzryl_0 2024-09-12T01:11:23.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_hdibY5bBDCVCbth_NgZBunZpzpHmSSS', time=2024-09-12T02:58:55.681482+0000, chain.objs.size()=1 2024-09-12T01:11:23.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.5jz1I2SMVwYrGIUIchzSqtx1JRp9tHI_0 2024-09-12T01:11:23.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.438191579015247056', time=2024-09-12T03:00:42.721818+0000, chain.objs.size()=1 2024-09-12T01:11:23.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.245__shadow_.q7V-gJ9jRloGY9JDrLgKNF2c_fAFW0b_0 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14172018095037352112', time=2024-09-12T03:00:44.103766+0000, chain.objs.size()=1 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.248__shadow_.3_6K9YsVRW5wdjvBy-raEoDdFbvo7OE_0 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13458381858677116795', time=2024-09-12T03:00:45.502361+0000, chain.objs.size()=1 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.251__shadow_.2SPgbWPb9uOLPdPL0wcWbN8e4EhMH6K_0 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15986228606015805501', time=2024-09-12T03:00:58.904097+0000, chain.objs.size()=1 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.zDc0v1AntB6KURgM1BaTrAf5X2Hx5Qr_0 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11809530199007558307', time=2024-09-12T03:00:58.986297+0000, chain.objs.size()=1 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7Kj2jnJEOWuB5xHIZrp-CePGm8Cnva5_0 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14835438488629302195', time=2024-09-12T03:00:58.994986+0000, chain.objs.size()=1 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jmIepZH4AifxP-zHw7uWr5HSWvmzkJL_0 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10542568615785881914', time=2024-09-12T03:00:59.135115+0000, chain.objs.size()=1 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.HkKT-R8-E3b79CtKAJaGg_PvNkVxttE_0 2024-09-12T01:11:23.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4106414357190522692', time=2024-09-12T03:00:59.150907+0000, chain.objs.size()=1 2024-09-12T01:11:23.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7GcL-I9K0wa4IIxJLVGlmqQ4VQ89MPI_0 2024-09-12T01:11:23.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16926220512718013305', time=2024-09-12T03:00:59.168720+0000, chain.objs.size()=1 2024-09-12T01:11:23.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hZ0Tyt178IMfBuOpFS46N0pCE0JyEvJ_0 2024-09-12T01:11:23.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10972930154743966948', time=2024-09-12T03:00:59.208140+0000, chain.objs.size()=1 2024-09-12T01:11:23.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.133+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.yAzWFFCiw10B_Vtru-aMEz1p-aEzIMu_0 2024-09-12T01:11:23.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13122818183846784187', time=2024-09-12T03:00:59.228030+0000, chain.objs.size()=1 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tOkUewdgPUrASO_L7RfKtMAoYG7DlhO_0 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17085289829124805664', time=2024-09-12T03:00:59.232828+0000, chain.objs.size()=1 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lYPaPKV7MzBLP-comgyd6YJ42ekcNeA_0 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11974721109338527249', time=2024-09-12T03:00:59.258644+0000, chain.objs.size()=1 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uQHWY_qph_TxcD1TK3JPj15bZKhWiuH_0 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17939959990181269283', time=2024-09-12T03:00:59.459437+0000, chain.objs.size()=1 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KI7agi_UpPs_0ZTI4nQRWCsZZQhAfw9_0 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8696126783758959877', time=2024-09-12T03:00:59.468287+0000, chain.objs.size()=1 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WjxD8NE8ny9LjbBiujAFkQ_vm_XYljJ_0 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15064491144660369565', time=2024-09-12T03:00:59.508215+0000, chain.objs.size()=1 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.QDzqotucgihif6-4MYb7kRBH0qRCJQt_0 2024-09-12T01:11:23.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16048059239344837528', time=2024-09-12T03:00:59.522388+0000, chain.objs.size()=1 2024-09-12T01:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MUtAg7kCUCFFTqmA-K6XnDT2QeNMDSL_0 2024-09-12T01:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16042434025117885530', time=2024-09-12T03:00:59.573570+0000, chain.objs.size()=1 2024-09-12T01:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.137+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FX7Ba14eoPHDRqO1qO-crRmcepRXcaa_0 2024-09-12T01:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.138+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10251394101741850734', time=2024-09-12T03:00:59.574372+0000, chain.objs.size()=1 2024-09-12T01:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.138+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Hr1ALG2i41fm2vYV6HeCYjiENe4QksF_0 2024-09-12T01:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.138+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17278303138993910001', time=2024-09-12T03:00:59.735347+0000, chain.objs.size()=1 2024-09-12T01:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.138+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rEY-GyzAvFY9oX02gf7FSMW4FsrkN0l_0 2024-09-12T01:11:23.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.138+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17511926489891918760', time=2024-09-12T03:00:59.768093+0000, chain.objs.size()=1 2024-09-12T01:11:23.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.138+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DYIf7GDNpulN5yOnw_0ej2Oqdv0LZA4_0 2024-09-12T01:11:23.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.141+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5200432927110508398', time=2024-09-12T03:00:59.772578+0000, chain.objs.size()=1 2024-09-12T01:11:23.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.141+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vnJdgsrBw-Sq1TXl24mhXkzgx_BIgjE_0 2024-09-12T01:11:23.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.141+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7579039776856455992', time=2024-09-12T03:00:59.836720+0000, chain.objs.size()=1 2024-09-12T01:11:23.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.141+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.apq9Vfk97V_0bea-7IL2qym5xd_p5fU_0 2024-09-12T01:11:23.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.142+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6912625138415189508', time=2024-09-12T03:00:59.963184+0000, chain.objs.size()=1 2024-09-12T01:11:23.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.142+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ui0KqHAy-rR5xSErjBHG0eqAAdgnEVS_0 2024-09-12T01:11:23.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.142+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6435651011191669136', time=2024-09-12T03:01:00.035707+0000, chain.objs.size()=1 2024-09-12T01:11:23.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.142+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.d-2qNwiPHF1OtUc4mKXsFBgq7jSdbAE_0 2024-09-12T01:11:23.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.142+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7804742789598221373', time=2024-09-12T03:01:00.041078+0000, chain.objs.size()=1 2024-09-12T01:11:23.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.142+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FTadt_LXjjf5lGRxhvsBVduQOPKZ6-K_0 2024-09-12T01:11:23.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.143+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6117918386961262663', time=2024-09-12T03:01:00.073792+0000, chain.objs.size()=1 2024-09-12T01:11:23.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.143+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9MQjoQ08cRFSyxi1FpeBXAvYFOZ6Nq4_0 2024-09-12T01:11:23.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.143+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6667523895815311799', time=2024-09-12T03:01:00.341313+0000, chain.objs.size()=1 2024-09-12T01:11:23.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.143+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.XGjV1XfWnqUBSIp8_2QG6Gyb7ULZW5k_0 2024-09-12T01:11:23.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.143+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8287678498339664845', time=2024-09-12T03:01:00.350398+0000, chain.objs.size()=1 2024-09-12T01:11:23.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.143+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cz9uLva7hcA0z_hev_7Ch0gGrUW46zI_0 2024-09-12T01:11:23.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.144+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1966805384104121288', time=2024-09-12T03:01:00.380448+0000, chain.objs.size()=1 2024-09-12T01:11:23.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.144+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sqZyRH88XZ9_zBC3BWuatiFm5CSf0en_0 2024-09-12T01:11:23.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.144+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18417976754644793815', time=2024-09-12T03:01:00.381197+0000, chain.objs.size()=1 2024-09-12T01:11:23.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.144+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CSJjTtG1B6aV-zonXjwBBfe-mXvu5Hn_0 2024-09-12T01:11:23.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.144+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9430822382380312465', time=2024-09-12T03:01:00.483642+0000, chain.objs.size()=1 2024-09-12T01:11:23.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.144+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.l2FuLh4BHsyYaMkBkrUJNfxH8Pic6QR_0 2024-09-12T01:11:23.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.145+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16496377897916942062', time=2024-09-12T03:01:00.598747+0000, chain.objs.size()=1 2024-09-12T01:11:23.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.145+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BwyDGClSa6CvzC3i_NT5v7SCJFz46Ph_0 2024-09-12T01:11:23.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.146+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9613268905532272603', time=2024-09-12T03:01:00.664664+0000, chain.objs.size()=1 2024-09-12T01:11:23.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.146+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FaNS2O-x0zyfjPCCOitfj2E8Pimljf6_0 2024-09-12T01:11:23.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.146+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15070263112625778224', time=2024-09-12T03:01:00.922048+0000, chain.objs.size()=1 2024-09-12T01:11:23.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.146+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.p1aiAjaX06Pzh2ZS_NNe3nfKAzXK1FE_0 2024-09-12T01:11:23.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.146+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9010608298463366166', time=2024-09-12T03:01:02.347877+0000, chain.objs.size()=1 2024-09-12T01:11:23.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.146+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.266__shadow_.mFIFtI8gq8INCot8OhmDJ4oLoMA2Kwf_0 2024-09-12T01:11:23.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.147+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16170230537975985745', time=2024-09-12T03:01:10.815820+0000, chain.objs.size()=1 2024-09-12T01:11:23.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.147+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.284__shadow_.rSvkMeY0VOo0bfXm3nhs5PtB6ZVrpPn_0 2024-09-12T01:11:23.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.147+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18386560871730903287', time=2024-09-12T03:01:15.853469+0000, chain.objs.size()=1 2024-09-12T01:11:23.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.147+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.Q56AHTXH3fVCVnnIOACQ4rg1fI4D9XK_0 2024-09-12T01:11:23.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.147+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11087753578709679321', time=2024-09-12T03:01:15.868136+0000, chain.objs.size()=1 2024-09-12T01:11:23.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.147+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.ZtVN1NEZYGqMoxUhidlsJTmx4U3nie0_0 2024-09-12T01:11:23.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.148+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4345236763735537899', time=2024-09-12T03:01:16.663689+0000, chain.objs.size()=1 2024-09-12T01:11:23.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.148+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.3b-KVLEL22aYRzj6c2oq1Y9BOHlOjkZ_0 2024-09-12T01:11:23.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.149+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4881136583245145515', time=2024-09-12T03:01:18.064332+0000, chain.objs.size()=1 2024-09-12T01:11:23.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.149+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.297__shadow_.ZZXR9Px6mCJLvmBdWx3z5NWgP3mEhrA_0 2024-09-12T01:11:23.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.149+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10863525376936598891', time=2024-09-12T03:01:19.062096+0000, chain.objs.size()=1 2024-09-12T01:11:23.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.149+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.299__shadow_.CSCqf-cQr4EdzolX8pJ6skJQ8Kz0D9c_0 2024-09-12T01:11:23.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.149+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16918712664301332132', time=2024-09-12T03:01:21.061425+0000, chain.objs.size()=1 2024-09-12T01:11:23.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.149+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.303__shadow_.veMHfAjatRLAWldFeHNRX0J3pCLEWxo_0 2024-09-12T01:11:23.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.150+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13449534322167737078', time=2024-09-12T03:01:22.436560+0000, chain.objs.size()=1 2024-09-12T01:11:23.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.150+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.306__shadow_.c0JzAdb5ydMnZxzgdIpXfcU2mnGzWm0_0 2024-09-12T01:11:23.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.150+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9922575266269714334', time=2024-09-12T03:01:23.050739+0000, chain.objs.size()=1 2024-09-12T01:11:23.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.150+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.307__shadow_.xdA5CkSflPsp7iOts_H1WxExErWfi3I_0 2024-09-12T01:11:23.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3324384468416463257', time=2024-09-12T03:01:29.974610+0000, chain.objs.size()=1 2024-09-12T01:11:23.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.322__shadow_.QugnNubtIGH8OJr375JtVG4EjQXjysI_0 2024-09-12T01:11:23.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14780535120526964626', time=2024-09-12T03:01:40.107290+0000, chain.objs.size()=1 2024-09-12T01:11:23.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.AfTom6tC8YVa13cKRiaroBwS1FwSOYP_0 2024-09-12T01:11:23.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7655912925004507429', time=2024-09-12T03:01:40.156118+0000, chain.objs.size()=1 2024-09-12T01:11:23.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jZgc9uIavEuH1DbC1_ysAW4bvIGfono_0 2024-09-12T01:11:23.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17710201568863775310', time=2024-09-12T03:01:40.165767+0000, chain.objs.size()=1 2024-09-12T01:11:23.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GB6F2R8fXeHPQT315U4wZ-H2Iv3Kt9z_0 2024-09-12T01:11:23.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8352285312879480682', time=2024-09-12T03:01:40.194151+0000, chain.objs.size()=1 2024-09-12T01:11:23.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0YWJ-mm6sJ-jjDQ3HG85od2AZx1GQkV_0 2024-09-12T01:11:23.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.154+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1260685388592371081', time=2024-09-12T03:01:40.463686+0000, chain.objs.size()=1 2024-09-12T01:11:23.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.154+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Mr_SX0eMB3iSzMCx2jQ8IPVp9ZjOo-w_0 2024-09-12T01:11:23.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.154+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17078277505700168782', time=2024-09-12T03:01:40.478369+0000, chain.objs.size()=1 2024-09-12T01:11:23.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.154+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rwY2Ez34IQyg6nSzP-32gLgsrpa2dWL_0 2024-09-12T01:11:23.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.154+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6777449296452518358', time=2024-09-12T03:01:40.483980+0000, chain.objs.size()=1 2024-09-12T01:11:23.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.154+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ugw2Yodtyp06AYpz_4iBI6BsKGmHf7z_0 2024-09-12T01:11:23.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.154+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14466500245114307342', time=2024-09-12T03:01:40.490789+0000, chain.objs.size()=1 2024-09-12T01:11:23.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.154+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3qufO0vCusv2bGM5xVaMG5984tUq5u9_0 2024-09-12T01:11:23.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.156+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1491505506216372783', time=2024-09-12T03:01:40.641641+0000, chain.objs.size()=1 2024-09-12T01:11:23.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.156+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PpYFdct_ZCZid-ZdoLqP0cpjy0gZlWQ_0 2024-09-12T01:11:23.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.157+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11457320084219752007', time=2024-09-12T03:01:40.654867+0000, chain.objs.size()=1 2024-09-12T01:11:23.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.157+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZaICb3OHBE2ZRGkC-l4EDG0dRgCnB7H_0 2024-09-12T01:11:23.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16987105983852602842', time=2024-09-12T03:01:40.683678+0000, chain.objs.size()=1 2024-09-12T01:11:23.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4AV9NdDJ6jPyLrFWH-Q3PmhEOWhKbvE_0 2024-09-12T01:11:23.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5417066489236099660', time=2024-09-12T03:01:40.691129+0000, chain.objs.size()=1 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4vqzqc_G8mIdX8LfSvcJQzoCgV-9skt_0 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9172680694536321762', time=2024-09-12T03:01:40.740964+0000, chain.objs.size()=1 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kWcvgDtdbczYzgUoMJi60D49sREZ_p2_0 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.26696052730490101', time=2024-09-12T03:01:40.926199+0000, chain.objs.size()=1 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.xrz72s5KH5DsOO03ri_XGGt1367yRL1_0 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16293191375886232095', time=2024-09-12T03:01:41.018277+0000, chain.objs.size()=1 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aTeCGjszDIwR3YhWLqplhsvFt4hMam3_0 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14338003277738400793', time=2024-09-12T03:01:41.028288+0000, chain.objs.size()=1 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.B8XJ2TPX4k4maTVlekal8oIDj66HOl__0 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16831069638170779027', time=2024-09-12T03:01:41.206526+0000, chain.objs.size()=1 2024-09-12T01:11:23.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.159+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.k8QLSyXDu-NBl9JP1vxcQDvxE_wuL2Y_0 2024-09-12T01:11:23.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.160+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16521393589525354252', time=2024-09-12T03:01:41.244468+0000, chain.objs.size()=1 2024-09-12T01:11:23.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.160+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.08umK-2e0C77s49SleasZWq9XZrKrxC_0 2024-09-12T01:11:23.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.160+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.323433265115769190', time=2024-09-12T03:01:41.263279+0000, chain.objs.size()=1 2024-09-12T01:11:23.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.160+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.N0tTJfF9fPcdMXh5Q1u5WcJlH4XrrUB_0 2024-09-12T01:11:23.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.160+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5691406175992901370', time=2024-09-12T03:01:41.266671+0000, chain.objs.size()=1 2024-09-12T01:11:23.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.160+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kVIG8mmz79wyXzlZQPlJPSZN-sM-f1n_0 2024-09-12T01:11:23.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.162+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14341239028341161121', time=2024-09-12T03:01:41.313202+0000, chain.objs.size()=1 2024-09-12T01:11:23.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.162+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rrADMubBpkYt8JngU65_saiSHaOZrzd_0 2024-09-12T01:11:23.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.164+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16374960653267389800', time=2024-09-12T03:01:41.488670+0000, chain.objs.size()=1 2024-09-12T01:11:23.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.164+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0n1yWXnukmc8YcbF2jc8hdpsDY_1UOp_0 2024-09-12T01:11:23.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.164+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13644314361332138080', time=2024-09-12T03:01:41.514037+0000, chain.objs.size()=1 2024-09-12T01:11:23.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.164+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Imko3ufpNQW3uRINyNA4rQRIpml4DAp_0 2024-09-12T01:11:23.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.165+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.734032491283924376', time=2024-09-12T03:01:41.605171+0000, chain.objs.size()=1 2024-09-12T01:11:23.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.165+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-s_bGSx2TCmRweCy1BA9IMWDx5rw1gn_0 2024-09-12T01:11:23.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.165+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5090682668020246707', time=2024-09-12T03:01:41.622651+0000, chain.objs.size()=1 2024-09-12T01:11:23.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.165+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ly8wfmcSb-bOanXU_lBOXXAOTdSiZZJ_0 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.121510306581683017', time=2024-09-12T03:01:41.780714+0000, chain.objs.size()=1 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.RpnzTtbnfeNdodJxEjVEehGgBPWHaHe_0 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4011661517557284670', time=2024-09-12T03:01:41.828816+0000, chain.objs.size()=1 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Is1974Uf7wa1vxnc8mv9f0FfsXXIdqr_0 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.672823033198475282', time=2024-09-12T03:01:41.891285+0000, chain.objs.size()=1 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Y5hXhMowYXzf0pSd1iRKuvuzQPGeEZ4_0 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10184516092870308102', time=2024-09-12T03:01:42.012833+0000, chain.objs.size()=1 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qkz-_Uj4nl0SCpuUSNfqRSVNXu3uo4R_0 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13951905665930200039', time=2024-09-12T03:01:42.013613+0000, chain.objs.size()=1 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WaS1Fy1Tf18uGIH9Rd_sooNAwNUsN-e_0 2024-09-12T01:11:23.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3281052943013329741', time=2024-09-12T03:01:42.080576+0000, chain.objs.size()=1 2024-09-12T01:11:23.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6__TzeYbEH0PVy4jEo9eYyPNPpAK73B_0 2024-09-12T01:11:23.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9666600273237923800', time=2024-09-12T03:01:50.238787+0000, chain.objs.size()=1 2024-09-12T01:11:23.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.167+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.h8zKN-oyZtdnMQJ09QKPSRWC8HPKEz2_0 2024-09-12T01:11:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.813488934299554810', time=2024-09-12T03:01:50.265299+0000, chain.objs.size()=1 2024-09-12T01:11:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TmA7V7e0Iy5l-OgUGOrFTEsC6yGrtfL_0 2024-09-12T01:11:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1505128957030983475', time=2024-09-12T03:01:50.268002+0000, chain.objs.size()=1 2024-09-12T01:11:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.R1yNczjLM6-jK8Mad2xUVAWdpGuWrLk_0 2024-09-12T01:11:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9923195550300592466', time=2024-09-12T03:01:50.324063+0000, chain.objs.size()=1 2024-09-12T01:11:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MSgxzriH_YYlvsdtXhHV53_rJyQM-WJ_0 2024-09-12T01:11:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6633650071930284790', time=2024-09-12T03:01:50.347803+0000, chain.objs.size()=1 2024-09-12T01:11:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.prSi7nyVyi3pYCHzA32TWi_TdrdL1XW_0 2024-09-12T01:11:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5481094973313870367', time=2024-09-12T03:01:50.611272+0000, chain.objs.size()=1 2024-09-12T01:11:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.X2iQH0B0ioPVHb3Jmhtug9pfoC23oJ4_0 2024-09-12T01:11:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9463254567736135208', time=2024-09-12T03:01:50.616071+0000, chain.objs.size()=1 2024-09-12T01:11:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.170+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.iPFCwtwM3Xw9O4sWOVTldBvJ9DdORvJ_0 2024-09-12T01:11:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.171+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16601556089887472897', time=2024-09-12T03:01:50.643650+0000, chain.objs.size()=1 2024-09-12T01:11:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.171+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JiyqIyw7xRlSug04jMBdtJOPq2yKy8W_0 2024-09-12T01:11:23.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.172+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16424482535559204959', time=2024-09-12T03:01:50.679498+0000, chain.objs.size()=1 2024-09-12T01:11:23.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.172+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.NutIBhzCTq5r-IA8f4p-JvkZ3AkeuPa_0 2024-09-12T01:11:23.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.172+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18403049296457527980', time=2024-09-12T03:01:50.690058+0000, chain.objs.size()=1 2024-09-12T01:11:23.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.172+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xGqBCm49gd_GcP_8Y27tSSmrjriSLLZ_0 2024-09-12T01:11:23.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.173+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15645754441616837414', time=2024-09-12T03:01:50.877708+0000, chain.objs.size()=1 2024-09-12T01:11:23.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.173+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.cqiC5RKb5dcbkKKIZOkMQbDRlgfmc7__0 2024-09-12T01:11:23.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.173+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.883742964208446824', time=2024-09-12T03:01:50.889766+0000, chain.objs.size()=1 2024-09-12T01:11:23.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.173+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-Gw-ARBwhSZim1gOzyEGrjB8QkZVrJX_0 2024-09-12T01:11:23.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.175+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17797180832669262039', time=2024-09-12T03:01:50.910789+0000, chain.objs.size()=1 2024-09-12T01:11:23.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.175+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qAVSBR80Qew6ON1AdahZH517XQhDODX_0 2024-09-12T01:11:23.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.175+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8635881158236874849', time=2024-09-12T03:01:50.924930+0000, chain.objs.size()=1 2024-09-12T01:11:23.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.175+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.HbQ3RGrwM-87DQJL270MWOQwo4TSnBf_0 2024-09-12T01:11:23.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3199586016515967618', time=2024-09-12T03:01:50.936828+0000, chain.objs.size()=1 2024-09-12T01:11:23.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.bSBnMQhTWnKSBHEC4zPgk-ZR-bhbqbi_0 2024-09-12T01:11:23.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15739462047682040405', time=2024-09-12T03:01:50.968373+0000, chain.objs.size()=1 2024-09-12T01:11:23.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xUwnsEmFpLN1AG5Y1R8kPBEzjxcxguB_0 2024-09-12T01:11:23.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16139811337939905630', time=2024-09-12T03:01:50.970290+0000, chain.objs.size()=1 2024-09-12T01:11:23.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-iKffaeaQBk9GEN1PW1sOpLqWsxZ8RX_0 2024-09-12T01:11:23.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15078114720030006531', time=2024-09-12T03:01:50.985081+0000, chain.objs.size()=1 2024-09-12T01:11:23.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Ldulm9EVY9iYuahtjwx54V81bn3ODcB_0 2024-09-12T01:11:23.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1787673373281535706', time=2024-09-12T03:01:50.996699+0000, chain.objs.size()=1 2024-09-12T01:11:23.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.YVaB21IPnGbug60Lyhq4451RAl9ZYem_0 2024-09-12T01:11:23.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.739727829990651830', time=2024-09-12T03:01:51.098080+0000, chain.objs.size()=1 2024-09-12T01:11:23.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.176+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.bbpZn_tPSDKyaDEatg1TUXcAJnYNWQc_0 2024-09-12T01:11:23.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.177+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10535509077416302180', time=2024-09-12T03:01:51.116358+0000, chain.objs.size()=1 2024-09-12T01:11:23.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.177+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.h9Gv4vu8OhEBdIkPIzzPZH68oaCRmtn_0 2024-09-12T01:11:23.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.181+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/49877 2024-09-12T01:11:23.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T01:11:23.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16861899777451077475', time=2024-09-12T03:01:51.122804+0000, chain.objs.size()=1 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.iLNe1laxwlsuSYIdXBVkgOsA_smXUiW_0 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9465383294740292724', time=2024-09-12T03:01:51.196106+0000, chain.objs.size()=1 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.VzV4LjZYtD3pVIMChYpu95ughVpggho_0 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10791788223084751557', time=2024-09-12T03:01:51.259724+0000, chain.objs.size()=1 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.E_jmYnMVC_SOeJolLuTDMfYqKj_Iizx_0 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11797456380224932345', time=2024-09-12T03:01:51.409158+0000, chain.objs.size()=1 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.PasPS-HY5vSok5oSfsl6T_BzJ2x6Hyz_0 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5751659025706510290', time=2024-09-12T03:01:51.419911+0000, chain.objs.size()=1 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1NOnVR7ff_Op0jCe3RezDUZ8nNeki7N_0 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17864559664416483319', time=2024-09-12T03:01:51.437438+0000, chain.objs.size()=1 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ZIdzfWHYYUa_x6M1mAwm-Ld44HaaYJi_0 2024-09-12T01:11:23.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15470115718241337732', time=2024-09-12T03:01:51.440354+0000, chain.objs.size()=1 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lZftQte6u4IT7Cuiz6hiYNHyeD844Di_0 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3691017623600081616', time=2024-09-12T03:01:51.721657+0000, chain.objs.size()=1 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.aPLiqxoUnOVWv_dDWiDicaklItfAQsl_0 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1083240999590861391', time=2024-09-12T03:01:51.725874+0000, chain.objs.size()=1 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pq_QYG81noDPHqH_5bulUMuRhhuYhVX_0 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11005063163221663643', time=2024-09-12T03:01:51.783763+0000, chain.objs.size()=1 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3zciK9YsjeVK5M6uK3rnd0Wo6t3WDVw_0 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7694121678271709157', time=2024-09-12T03:01:51.818560+0000, chain.objs.size()=1 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uyul0iPpk_O6TwzhCiE7aluTRRwyebY_0 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1944478652975594313', time=2024-09-12T03:01:51.910410+0000, chain.objs.size()=1 2024-09-12T01:11:23.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.187+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IcvvLiMwA_FArsxcNUVexBFsJs6VarE_0 2024-09-12T01:11:23.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17159918768431822704', time=2024-09-12T03:01:51.925151+0000, chain.objs.size()=1 2024-09-12T01:11:23.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ae6IXgrh5r7er6IpuVbs5bAFN8XZA02_0 2024-09-12T01:11:23.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4748169591528566923', time=2024-09-12T03:01:51.940187+0000, chain.objs.size()=1 2024-09-12T01:11:23.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ftrq7OiBb2LxI39Hjfkge_mRk8Hb2XJ_0 2024-09-12T01:11:23.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9519285145941316983', time=2024-09-12T03:01:51.969166+0000, chain.objs.size()=1 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Zf4ztf61NscGY5lIhHfiF3m8vD62CR8_0 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17143693620818251258', time=2024-09-12T03:01:52.017372+0000, chain.objs.size()=1 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oK5VNe6kZpHP10fsPn5kjxMClQS6nW__0 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11703000662311870044', time=2024-09-12T03:01:52.075127+0000, chain.objs.size()=1 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.SljDr0opAlHsUpPI5MZvwXBDyI2ihS__0 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1199816343688746541', time=2024-09-12T03:01:52.251342+0000, chain.objs.size()=1 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AVn2iUoyCApaa-xbIrpUW0FtGH_Rr9h_0 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5968460846640094555', time=2024-09-12T03:02:16.801168+0000, chain.objs.size()=1 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.379__shadow_.xc21sBr8bvdBAs1SuOEjkeRE3PuVqmd_0 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16990103464985085108', time=2024-09-12T03:02:47.982951+0000, chain.objs.size()=1 2024-09-12T01:11:23.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.440__shadow_.cvnRRzgGkaQrT9Q-iI8J2g_9ZavCsZI_0 2024-09-12T01:11:23.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.192+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.449927664696613808', time=2024-09-12T03:03:12.919022+0000, chain.objs.size()=1 2024-09-12T01:11:23.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.192+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.489__shadow_.FAa2IVyEvJ50-x_iAVEc-8rYFYyB8pC_0 2024-09-12T01:11:23.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.192+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8118891914182495516', time=2024-09-12T03:03:16.276968+0000, chain.objs.size()=1 2024-09-12T01:11:23.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.192+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.497__shadow_.dq-ZV1YVnVnXwlvm7zOsM3r4BkPh2FC_0 2024-09-12T01:11:23.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.192+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5635094865790984364', time=2024-09-12T03:03:27.464873+0000, chain.objs.size()=1 2024-09-12T01:11:23.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.192+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.518__shadow_.RyRsuBLlIODVZ1ZMHDZaXc53UCLGOf0_0 2024-09-12T01:11:23.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.195+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.333809540625209594', time=2024-09-12T03:03:29.359615+0000, chain.objs.size()=6 2024-09-12T01:11:23.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.195+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.520__multipart_mymultipart.2~5FAmFD5KwdVnPB5l-905HOmj0OGU73z.1 2024-09-12T01:11:23.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.196+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.520__multipart_mymultipart.2~5FAmFD5KwdVnPB5l-905HOmj0OGU73z.2 2024-09-12T01:11:23.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.196+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.520__multipart_mymultipart.2~5FAmFD5KwdVnPB5l-905HOmj0OGU73z.3 2024-09-12T01:11:23.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.196+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.520__multipart_mymultipart.2~5FAmFD5KwdVnPB5l-905HOmj0OGU73z.4 2024-09-12T01:11:23.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.196+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.520__multipart_mymultipart.2~5FAmFD5KwdVnPB5l-905HOmj0OGU73z.5 2024-09-12T01:11:23.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.520__multipart_mymultipart.2~5FAmFD5KwdVnPB5l-905HOmj0OGU73z.6 2024-09-12T01:11:23.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14223471681904264302', time=2024-09-12T03:03:31.855093+0000, chain.objs.size()=1 2024-09-12T01:11:23.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.521__shadow:qiLVX-nWHNUCvQVvEJ3nynCo5R.FAQh_.D289sgfbHc_oqn_rPwFT23R_XFh2J7B_0 2024-09-12T01:11:23.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3547618733964829467', time=2024-09-12T03:04:42.417974+0000, chain.objs.size()=1 2024-09-12T01:11:23.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:4pGcDx3QGtQyuxf3yN-9NLnhcZs6VeP_.M_T30gebys6lDpWW77O3LmevAHJ-xMV_0 2024-09-12T01:11:23.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2269857929314478420', time=2024-09-12T03:04:43.608078+0000, chain.objs.size()=1 2024-09-12T01:11:23.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:z6d89y3tdxLnk6oQV0DCf5tAyNXFDEk_.a_ohi0Nl-0mk9kNZ9OFBzxSZAz8fmnM_0 2024-09-12T01:11:23.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10990542697172783527', time=2024-09-12T03:04:50.195168+0000, chain.objs.size()=1 2024-09-12T01:11:23.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow_.Z4faNYJdWWz7fKbWVwWyPb-MeQWmiL4_0 2024-09-12T01:11:23.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16425781743268347647', time=2024-09-12T03:05:11.719789+0000, chain.objs.size()=4 2024-09-12T01:11:23.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.197+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~bZN8G2Iqd6uOmMhT07jSuNyvUWh7mhf.1 2024-09-12T01:11:23.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.200+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~bZN8G2Iqd6uOmMhT07jSuNyvUWh7mhf.2 2024-09-12T01:11:23.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.201+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~bZN8G2Iqd6uOmMhT07jSuNyvUWh7mhf.3 2024-09-12T01:11:23.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.201+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~bZN8G2Iqd6uOmMhT07jSuNyvUWh7mhf.4 2024-09-12T01:11:23.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.201+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1875654626438435405', time=2024-09-12T03:05:12.897814+0000, chain.objs.size()=1 2024-09-12T01:11:23.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.201+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:TM1aOX1cqZAoyW6w-B5ajAKhop66x7T_.rIGi7scB1XB4L1sWdoMjd-sGGE8NLy7_0 2024-09-12T01:11:23.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.202+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10854297606144494641', time=2024-09-12T03:05:17.498247+0000, chain.objs.size()=1 2024-09-12T01:11:23.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.202+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.587__shadow:jp1MbFDDB00jDAujj4ma9Su6WNWqK8v_._ED7rYIzURsBzo-YOSGzrz-TG11UvwE_0 2024-09-12T01:11:23.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.202+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15532146588807608385', time=2024-09-12T03:05:18.105191+0000, chain.objs.size()=1 2024-09-12T01:11:23.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.202+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.588__shadow:Lmt-QXum5r3Ry1VH3oqSVhTHdg.OuLB_.hHQzGnr5YGPYqC2ZZ9vngh7GSfxZPU__0 2024-09-12T01:11:23.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.202+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.663143430458526673', time=2024-09-12T03:07:41.212135+0000, chain.objs.size()=12 2024-09-12T01:11:23.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.202+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__multipart_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.1 2024-09-12T01:11:23.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.202+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__shadow_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.1_1 2024-09-12T01:11:23.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.204+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__multipart_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.2 2024-09-12T01:11:23.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.204+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__shadow_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.2_1 2024-09-12T01:11:23.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.204+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__multipart_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.3 2024-09-12T01:11:23.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.204+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__shadow_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.3_1 2024-09-12T01:11:23.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.204+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__multipart_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.4 2024-09-12T01:11:23.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.204+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__shadow_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.4_1 2024-09-12T01:11:23.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.204+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__multipart_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.5 2024-09-12T01:11:23.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.206+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__shadow_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.5_1 2024-09-12T01:11:23.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.207+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__multipart_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.6 2024-09-12T01:11:23.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.209+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.624__shadow_multipart_enc.2~RXWzs5-Ft7f7ZscFV8OzRK-T61v4Qjm.6_1 2024-09-12T01:11:23.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.212+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.215+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:11:23.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.216+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.217+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.217+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47489' 2024-09-12T01:11:23.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.217+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_1VAyse6x78bApF914Ow-FYJrJALcSLr', time=2024-09-12T02:58:57.011557+0000, chain.objs.size()=3 2024-09-12T01:11:23.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.217+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.166__shadow_.hsCL2cOl0YJ4B7mdColLXFc7M6OKBOX_0 2024-09-12T01:11:23.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.166__shadow_.hsCL2cOl0YJ4B7mdColLXFc7M6OKBOX_1 2024-09-12T01:11:23.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.166__shadow_.hsCL2cOl0YJ4B7mdColLXFc7M6OKBOX_2 2024-09-12T01:11:23.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11489473352216722304', time=2024-09-12T02:59:27.816452+0000, chain.objs.size()=1 2024-09-12T01:11:23.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.205__shadow_.s9d-P7ClbD_gj9JplkVBo4A69VcJKg1_0 2024-09-12T01:11:23.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3973828160254286866', time=2024-09-12T03:00:35.269875+0000, chain.objs.size()=1 2024-09-12T01:11:23.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.232__shadow_.OyyafDNtatJXTB07lKlrbfXU3SA1bZv_0 2024-09-12T01:11:23.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9723976307722004071', time=2024-09-12T03:00:37.559421+0000, chain.objs.size()=1 2024-09-12T01:11:23.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.237__shadow_.N06ZY0vYgQfxcLz5FY3RhQI1GLJUnTB_0 2024-09-12T01:11:23.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7671601274814811571', time=2024-09-12T03:00:37.560123+0000, chain.objs.size()=1 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.237__shadow_.pcfRbV3Coe_UR4jtPFNs0DikICZki6w_0 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18181816862111568322', time=2024-09-12T03:00:40.583071+0000, chain.objs.size()=1 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.242__shadow_.4rgUTXwI99RSTwTvuvadsckFwGPA25U_0 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8193265616618155341', time=2024-09-12T03:00:58.869411+0000, chain.objs.size()=1 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eLEZb27qqicG-fybB7a3c7oWPzaEsgh_0 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14912301769012772097', time=2024-09-12T03:00:58.912625+0000, chain.objs.size()=1 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.kIg3kh5I163UD-v6b_fa6eP4E6cl6ah_0 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18152772620715610017', time=2024-09-12T03:00:58.921706+0000, chain.objs.size()=1 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Isg8j8TGNB5qySU27PdRpmQGqzKwJ20_0 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2164981544910128558', time=2024-09-12T03:00:58.924841+0000, chain.objs.size()=1 2024-09-12T01:11:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tMn1kYreucID6MpcbzWqOmTml5c_5dI_0 2024-09-12T01:11:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11393656673071507653', time=2024-09-12T03:00:58.949360+0000, chain.objs.size()=1 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uTCB5z6u-hsHkrbQGkpOdb0TJ3g7mXk_0 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13322620410520882557', time=2024-09-12T03:00:59.003123+0000, chain.objs.size()=1 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WW5keYhD-s5gKBGRrpkmfKfHwLVCTKp_0 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14123016996637909430', time=2024-09-12T03:00:59.030700+0000, chain.objs.size()=1 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KO8cAGKHevAYYCvPMbfut25GpD9zu27_0 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8320986303382760579', time=2024-09-12T03:00:59.040284+0000, chain.objs.size()=1 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6AG39DbJZWLrOCtImV6IA8Ock_A_wb__0 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16507065657629587851', time=2024-09-12T03:00:59.136242+0000, chain.objs.size()=1 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Etj2CCDDPbANCwKZmICwcdLkQSUmah8_0 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7732820233442264737', time=2024-09-12T03:00:59.154656+0000, chain.objs.size()=1 2024-09-12T01:11:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KgjeUTzWEDsFJqzMxqWTqTW5bG_vsAc_0 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13076378754985375598', time=2024-09-12T03:00:59.238876+0000, chain.objs.size()=1 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3DsD2pQ0UjAoox80Lz6pmOor7aP2G5b_0 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10166734424043315508', time=2024-09-12T03:00:59.266808+0000, chain.objs.size()=1 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.falL8YAvNHkeXwIkVRIP0NU9kcLu7cC_0 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2297810192500024437', time=2024-09-12T03:00:59.283601+0000, chain.objs.size()=1 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ngwb-OQ8rg5-gOwU0JfFytaFuRlHg0r_0 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2671398367206175020', time=2024-09-12T03:00:59.290651+0000, chain.objs.size()=1 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.F2jL_9PeVKK3R3Wyc5CpbXyP9eWpzpP_0 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13533459153128727981', time=2024-09-12T03:00:59.408116+0000, chain.objs.size()=1 2024-09-12T01:11:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._evOJ5nS5OvrcrzCFPszpOGt8OD7i8d_0 2024-09-12T01:11:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3522496511301428500', time=2024-09-12T03:00:59.412024+0000, chain.objs.size()=1 2024-09-12T01:11:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MFuEEPjGhdZZZIqAoUzPMrFSGWk3qGv_0 2024-09-12T01:11:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6371498629222746241', time=2024-09-12T03:00:59.436228+0000, chain.objs.size()=1 2024-09-12T01:11:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.43L1cQIMnxlv6lZlUntN6-Lu5zgt3-q_0 2024-09-12T01:11:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12541104689190316712', time=2024-09-12T03:00:59.467747+0000, chain.objs.size()=1 2024-09-12T01:11:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.B089OQ3LNC0UzJxZ9RfmPJE33ncKv4g_0 2024-09-12T01:11:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4381055121363368161', time=2024-09-12T03:00:59.657453+0000, chain.objs.size()=1 2024-09-12T01:11:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.gSiPsW9cLbnWtpvHynXEDHl2mNPWXjE_0 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1079671220325123278', time=2024-09-12T03:00:59.769204+0000, chain.objs.size()=1 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dkEI01aGboyK-R_7VF0YBHONXy9FM1i_0 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13859484367538935371', time=2024-09-12T03:00:59.777883+0000, chain.objs.size()=1 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-Hreei9mNT0rVHIyW-FSXvkoUDpFEsm_0 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12576634388397222914', time=2024-09-12T03:00:59.788400+0000, chain.objs.size()=1 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2II5BrkH4KZdY092bZFQzZsblkQuy18_0 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4906533329481472090', time=2024-09-12T03:00:59.929828+0000, chain.objs.size()=1 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8dFlDdaLK18u9rvRnxwvw3jNHH6jtQm_0 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5790163833386179404', time=2024-09-12T03:01:00.030248+0000, chain.objs.size()=1 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.pFAG6ZXzsAadomUtvWQwLKAwdJIKAvj_0 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10793758911235588703', time=2024-09-12T03:01:00.407444+0000, chain.objs.size()=1 2024-09-12T01:11:23.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.0giXyDpG6GMpoP5QFG1uHvCCKiuIRnf_0 2024-09-12T01:11:23.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.401683343309358291', time=2024-09-12T03:01:00.481467+0000, chain.objs.size()=1 2024-09-12T01:11:23.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.X2K5oPe-OpXzf2tLJMK80cvXNXWgl1T_0 2024-09-12T01:11:23.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.232+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17308530766957062539', time=2024-09-12T03:01:00.490221+0000, chain.objs.size()=1 2024-09-12T01:11:23.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.232+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vugRjnGauWeiJgAT92b-EHT_IKoImuA_0 2024-09-12T01:11:23.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.233+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.740063503638993419', time=2024-09-12T03:01:00.498536+0000, chain.objs.size()=1 2024-09-12T01:11:23.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.233+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JlCz9RQU5eQK7Eqzc2ewYMKUhS8G1A0_0 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9194476619387845303', time=2024-09-12T03:01:00.508347+0000, chain.objs.size()=1 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BTm4nSma7lLAlpooUeCyQpRceO04Bvx_0 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2691652444714872762', time=2024-09-12T03:01:00.605631+0000, chain.objs.size()=1 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZWPC9DABiu_gIh3hM00o-uKE8Q92Vsp_0 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5445894964819026890', time=2024-09-12T03:01:00.630288+0000, chain.objs.size()=1 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TRB-y4VWtRl7wufJEvKRmGL3WIdxm-K_0 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15695097398465909519', time=2024-09-12T03:01:00.659048+0000, chain.objs.size()=1 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.AY9_izOfJ6fKuKvSHJEE1gtq5VM7uXx_0 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2376267251082291390', time=2024-09-12T03:01:00.667689+0000, chain.objs.size()=1 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1FKEAC3SIEqvhcE-abvqwFD_NH4uJrN_0 2024-09-12T01:11:23.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9095797266303601814', time=2024-09-12T03:01:00.848539+0000, chain.objs.size()=1 2024-09-12T01:11:23.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lmoBdH8Vc1MlwgExScu21-Vn_NSjwGQ_0 2024-09-12T01:11:23.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16688978136073878237', time=2024-09-12T03:01:00.877476+0000, chain.objs.size()=1 2024-09-12T01:11:23.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DhSyz2Uq1LAHEszd-ZK9_P25pdBTnsK_0 2024-09-12T01:11:23.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11417034457494314095', time=2024-09-12T03:01:00.878575+0000, chain.objs.size()=1 2024-09-12T01:11:23.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ehx1kTUm-j0SC1tHK5w9UhFcL_UJXl1_0 2024-09-12T01:11:23.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1348006324014947822', time=2024-09-12T03:01:00.982895+0000, chain.objs.size()=1 2024-09-12T01:11:23.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Kd1Kws8GOsEOelamIsFyzl65uUgF4bX_0 2024-09-12T01:11:23.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.238+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6713465177586606178', time=2024-09-12T03:01:00.988645+0000, chain.objs.size()=1 2024-09-12T01:11:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.238+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MFpvrn6ZmyXUI1O_UBOqk1P8VWVdRIc_0 2024-09-12T01:11:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.238+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6095759491583139450', time=2024-09-12T03:01:05.629402+0000, chain.objs.size()=1 2024-09-12T01:11:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.238+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.273__shadow_.fKfw2WjG0nrYxHaOFZbgog-Se-_tDpa_0 2024-09-12T01:11:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.238+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9487863552823721928', time=2024-09-12T03:01:08.398481+0000, chain.objs.size()=1 2024-09-12T01:11:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.238+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.279__shadow_.Y0-YpPHB-3IIlWAU6a6YsS--ScZ1-4t_0 2024-09-12T01:11:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.238+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11483226979926207803', time=2024-09-12T03:01:12.934962+0000, chain.objs.size()=1 2024-09-12T01:11:23.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.238+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.288__shadow_.Bveua756Q2skZjrjV38EHfO8K2JbKu1_0 2024-09-12T01:11:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12539910163538255962', time=2024-09-12T03:01:15.055600+0000, chain.objs.size()=1 2024-09-12T01:11:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.292__shadow_.mkZ1ZndoQD7g5uWGiiQts-ukX4twfAV_0 2024-09-12T01:11:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13063471130496813814', time=2024-09-12T03:01:15.844482+0000, chain.objs.size()=1 2024-09-12T01:11:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.3AGh6YdRt3eZ3n03hgCN_UYqHWEI-lV_0 2024-09-12T01:11:23.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5361744483100419753', time=2024-09-12T03:01:15.856652+0000, chain.objs.size()=1 2024-09-12T01:11:23.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.VXOzdPm-UXj5nEplfhCivz84GIJXjAB_0 2024-09-12T01:11:23.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.395054449648136812', time=2024-09-12T03:01:15.857506+0000, chain.objs.size()=1 2024-09-12T01:11:23.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.1QcTpvWiGdxcFCJcYXUW0mvoTS0DMRZ_0 2024-09-12T01:11:23.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6810618553356371538', time=2024-09-12T03:01:18.536280+0000, chain.objs.size()=1 2024-09-12T01:11:23.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.240+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.298__shadow_.RJxYUMD_BJCalhuBlXyoKPYtGv_5qLu_0 2024-09-12T01:11:23.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.242+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12850690935809298386', time=2024-09-12T03:01:19.578148+0000, chain.objs.size()=1 2024-09-12T01:11:23.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.242+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.300__shadow_.36Tacx66RRMHJas9zEOC4L2jZ-TC5LZ_0 2024-09-12T01:11:23.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.242+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2101402837622251883', time=2024-09-12T03:01:22.435583+0000, chain.objs.size()=1 2024-09-12T01:11:23.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.242+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.306__shadow_.PHY0g8TwoO0w7VsE7hE09ZiUTh-Qvsa_0 2024-09-12T01:11:23.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6217505162066987620', time=2024-09-12T03:01:29.973793+0000, chain.objs.size()=1 2024-09-12T01:11:23.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.322__shadow_.NSEk1nytyTbAhV8-LOncAgzyxYWV0lq_0 2024-09-12T01:11:23.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.245+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7466006816361030034', time=2024-09-12T03:01:30.584169+0000, chain.objs.size()=1 2024-09-12T01:11:23.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.245+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.323__shadow_.xMwjPnAu_XH4RiWqa5tHou5i1nM0ts3_0 2024-09-12T01:11:23.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.245+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10145917561828368709', time=2024-09-12T03:01:40.105678+0000, chain.objs.size()=1 2024-09-12T01:11:23.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.245+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.VqGC6bi0mKH3-h5tNfb7oIWaQcV-Px6_0 2024-09-12T01:11:23.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.245+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14057768017185099844', time=2024-09-12T03:01:40.113838+0000, chain.objs.size()=1 2024-09-12T01:11:23.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.245+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.XU3PSXykTxH7vi4wyYwpAWR-4OQUtU-_0 2024-09-12T01:11:23.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.245+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18059068920953747839', time=2024-09-12T03:01:40.180703+0000, chain.objs.size()=1 2024-09-12T01:11:23.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.245+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LWhNF-P889SULCmuPIZlQJykmt4JPXV_0 2024-09-12T01:11:23.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.246+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.638389072475257765', time=2024-09-12T03:01:40.234452+0000, chain.objs.size()=1 2024-09-12T01:11:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-sN1k00TieBujW8BYona5LpQ8irlu0X_0 2024-09-12T01:11:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14831217928678752897', time=2024-09-12T03:01:40.260321+0000, chain.objs.size()=1 2024-09-12T01:11:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Im7ou6d3war0riW-RY6DoHyDNBKGnQj_0 2024-09-12T01:11:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6177998672128453509', time=2024-09-12T03:01:40.403250+0000, chain.objs.size()=1 2024-09-12T01:11:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EMJtT5ViH-VvC2up0cvjpcXLzALdhBu_0 2024-09-12T01:11:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15588346029268427262', time=2024-09-12T03:01:40.449832+0000, chain.objs.size()=1 2024-09-12T01:11:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tkb7txUsLgh0BC3ktPTePwIQnu4SYZR_0 2024-09-12T01:11:23.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1584979333234744935', time=2024-09-12T03:01:40.472090+0000, chain.objs.size()=1 2024-09-12T01:11:23.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3YZqiabrgiMQXE1s0kE-3e2QVnjXT9b_0 2024-09-12T01:11:23.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6989704981334358548', time=2024-09-12T03:01:40.500816+0000, chain.objs.size()=1 2024-09-12T01:11:23.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.m03LRcSwOwpUrZFmLPjir06juqmyI4F_0 2024-09-12T01:11:23.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4527761795209092423', time=2024-09-12T03:01:40.517429+0000, chain.objs.size()=1 2024-09-12T01:11:23.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.247+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.cRWcRkDFJp9qIuq0cjfuWl-KRDPRYva_0 2024-09-12T01:11:23.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1424374889014044214', time=2024-09-12T03:01:40.938738+0000, chain.objs.size()=1 2024-09-12T01:11:23.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JQaLBXK8ykeD8h1WUIGIJ5V-242QfDs_0 2024-09-12T01:11:23.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13486938149315111734', time=2024-09-12T03:01:40.965678+0000, chain.objs.size()=1 2024-09-12T01:11:23.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.W4B09OAuNaCmNNagA_SIkXbbOt4oMSX_0 2024-09-12T01:11:23.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.250+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8577794670472895882', time=2024-09-12T03:01:41.023981+0000, chain.objs.size()=1 2024-09-12T01:11:23.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.250+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.HzUduVrs4zxftbuzzffuUAPKS5wvzfa_0 2024-09-12T01:11:23.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10252657048905844517', time=2024-09-12T03:01:41.041102+0000, chain.objs.size()=1 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._FCH9vRB-nIrNVJiLmHMbEdLbLwOj8Y_0 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10974190228552337811', time=2024-09-12T03:01:41.178153+0000, chain.objs.size()=1 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PrEvf2PI2CVIrURadQH6yXo8SNhVt7B_0 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17234725441318831383', time=2024-09-12T03:01:41.192612+0000, chain.objs.size()=1 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aKZS8ZS18acQ6JyqosNrWlYqNGvl_cC_0 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16805570653732886028', time=2024-09-12T03:01:41.251365+0000, chain.objs.size()=1 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kHAtZKwA6Zvv4iYDDctCwNMyhehFhgM_0 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9261988847420722391', time=2024-09-12T03:01:41.258235+0000, chain.objs.size()=1 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0fkKQA6qfq0n2O4TCY_gc9wyYkZbSWR_0 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7598260210857046738', time=2024-09-12T03:01:41.301924+0000, chain.objs.size()=1 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8P6J7xiokdMVs7xlgNFwYTOu8kmdrNd_0 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5391881804374522735', time=2024-09-12T03:01:41.436986+0000, chain.objs.size()=1 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.R7yY5cTfwEluff0rc3xzR299au3kNM7_0 2024-09-12T01:11:23.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6041665424059068520', time=2024-09-12T03:01:41.444357+0000, chain.objs.size()=1 2024-09-12T01:11:23.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1pgA-Blc6adixIsi3IsB3n9cABym9Bp_0 2024-09-12T01:11:23.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.254+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14015003927974196583', time=2024-09-12T03:01:41.475675+0000, chain.objs.size()=1 2024-09-12T01:11:23.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.254+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.f5bMpaR14EJ6TJOt2ayMbkBLsze7ajz_0 2024-09-12T01:11:23.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.254+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9805522575771102732', time=2024-09-12T03:01:41.531011+0000, chain.objs.size()=1 2024-09-12T01:11:23.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.254+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hwVvPn0KmphYBDzqIuhciAxfkeg71rW_0 2024-09-12T01:11:23.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.254+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12231366760319321936', time=2024-09-12T03:01:41.794919+0000, chain.objs.size()=1 2024-09-12T01:11:23.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.254+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zeMbx9F6vdFBR7m0Y4jnjwJTYccBJ1r_0 2024-09-12T01:11:23.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.256+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.797100336131487822', time=2024-09-12T03:01:41.797789+0000, chain.objs.size()=1 2024-09-12T01:11:23.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.256+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.61YNQSxXJwcAVSW64xSNBWoaBRZaC3d_0 2024-09-12T01:11:23.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.256+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9020786574431023164', time=2024-09-12T03:01:41.814757+0000, chain.objs.size()=1 2024-09-12T01:11:23.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.256+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.9pY2olfORraPS37nntKa110NkdMi3lS_0 2024-09-12T01:11:23.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.257+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18167466679963625194', time=2024-09-12T03:01:41.865136+0000, chain.objs.size()=1 2024-09-12T01:11:23.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.257+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.IvytJ8aQr9IgcUh4CrZWWT8GunX1-av_0 2024-09-12T01:11:23.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.257+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2410783549120360574', time=2024-09-12T03:01:41.866835+0000, chain.objs.size()=1 2024-09-12T01:11:23.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.257+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.685CwoEgEa8HhEIYt-qoj5XsPcufsJf_0 2024-09-12T01:11:23.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.257+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14429967180008180991', time=2024-09-12T03:01:41.871622+0000, chain.objs.size()=1 2024-09-12T01:11:23.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.257+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uozs4PfWzkUoWdPCRPQh5dm1iA0cjVw_0 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7985300356319118704', time=2024-09-12T03:01:41.873402+0000, chain.objs.size()=1 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ewxx2hbw7sgVvqTkKIi022Q07py5Kgq_0 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10270558533225628146', time=2024-09-12T03:01:41.896324+0000, chain.objs.size()=1 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lkjvlmfmDCjSo_pgsBL44ERTudfuIzv_0 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.862586897854430510', time=2024-09-12T03:01:42.044266+0000, chain.objs.size()=1 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bjbR_lCJGeI7b9AXxn9dzRmNICjg-7a_0 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12184804734952035677', time=2024-09-12T03:01:42.049676+0000, chain.objs.size()=1 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nUrfpI9z8NeV2uodk4J0r0L0ds0HiyG_0 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5341355776640822988', time=2024-09-12T03:01:42.088581+0000, chain.objs.size()=1 2024-09-12T01:11:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.SK1udDtuy6QMBndDd1izhRjzLlcYfzw_0 2024-09-12T01:11:23.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.259+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1264890413524643377', time=2024-09-12T03:01:50.219505+0000, chain.objs.size()=1 2024-09-12T01:11:23.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.259+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3gwaMwDVFZ1PXZKIzwE73mpjpZlK0t8_0 2024-09-12T01:11:23.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.259+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17267778159815601612', time=2024-09-12T03:01:50.232097+0000, chain.objs.size()=1 2024-09-12T01:11:23.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.259+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AXP1SyMk7fiLoqte8MvQmZaHUe5HiGK_0 2024-09-12T01:11:23.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.261+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16087130454564019910', time=2024-09-12T03:01:50.399253+0000, chain.objs.size()=1 2024-09-12T01:11:23.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.261+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rll4yPMaHFw3GNlUWsB9W1rlGx3OBme_0 2024-09-12T01:11:23.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.261+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2628312722014924998', time=2024-09-12T03:01:50.633216+0000, chain.objs.size()=1 2024-09-12T01:11:23.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.261+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tzwjH-mJ_Z3PzFPxxOwF-CAWcxbYsn4_0 2024-09-12T01:11:23.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.262+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11511405480136993723', time=2024-09-12T03:01:50.678214+0000, chain.objs.size()=1 2024-09-12T01:11:23.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.262+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.o1xs6eB4bff9H0yB76Bx1h0xYre0-kN_0 2024-09-12T01:11:23.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.262+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10947571621130701055', time=2024-09-12T03:01:50.693323+0000, chain.objs.size()=1 2024-09-12T01:11:23.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.262+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rB-s3UpjrHBn2pFG7ei9Gc9KPJWj-Qq_0 2024-09-12T01:11:23.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.264+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4293886817387987942', time=2024-09-12T03:01:50.714524+0000, chain.objs.size()=1 2024-09-12T01:11:23.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.264+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QJ9dbH-ZpyNiVwmr9_iQT-im0Gt7iC5_0 2024-09-12T01:11:23.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.265+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4832441001145182943', time=2024-09-12T03:01:50.863960+0000, chain.objs.size()=1 2024-09-12T01:11:23.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.265+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xCJTm0l8ruNVp-UCev11vPWGhgPL55t_0 2024-09-12T01:11:23.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.265+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4162504492025767516', time=2024-09-12T03:01:50.911688+0000, chain.objs.size()=1 2024-09-12T01:11:23.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.265+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.yEzTSynUTtgOeuBIy2S0YK6ihDgGj4C_0 2024-09-12T01:11:23.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.265+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12119616351519525198', time=2024-09-12T03:01:50.918076+0000, chain.objs.size()=1 2024-09-12T01:11:23.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.265+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6molaRHfiucXplRvyLF5ZIDXtgr-Eut_0 2024-09-12T01:11:23.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.269+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47489 2024-09-12T01:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=46, truncated=0, next_marker='' 2024-09-12T01:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4105621296010681639', time=2024-09-12T03:01:50.987479+0000, chain.objs.size()=1 2024-09-12T01:11:23.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xIGMcBjonN4UB0ELhnLXl1QWdPAEiU2_0 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9629030231702987397', time=2024-09-12T03:01:51.091259+0000, chain.objs.size()=1 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pshduGj5uz4Hbdu2viyXMPnDhIiGNAj_0 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5792884130192674795', time=2024-09-12T03:01:51.099345+0000, chain.objs.size()=1 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qaqC7RZuJo3oUjxX2pTsd9iEoxvlpHe_0 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2065786349332021333', time=2024-09-12T03:01:51.105712+0000, chain.objs.size()=1 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.dG79jxeryPQUXW7E8YfeQkOPT4MJ0yC_0 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8075984088471272059', time=2024-09-12T03:01:51.236784+0000, chain.objs.size()=1 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zZazzMbrxdCnrl60J_e_UFdjGWJ01Uj_0 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15795124703224594696', time=2024-09-12T03:01:51.362623+0000, chain.objs.size()=1 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AzEaA0k_-keQoOq3bV9613At5j1mZ5u_0 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14987247941381740815', time=2024-09-12T03:01:51.389388+0000, chain.objs.size()=1 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.755RRrDYCPRSJxbvBBA62LhTWTQZ3R0_0 2024-09-12T01:11:23.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12293325788405437927', time=2024-09-12T03:01:51.423921+0000, chain.objs.size()=1 2024-09-12T01:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hQmsnHX3iJmaO8E6f23ubIvkKOuY89x_0 2024-09-12T01:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5475853556072911235', time=2024-09-12T03:01:51.458077+0000, chain.objs.size()=1 2024-09-12T01:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oRFvRIdO7RhCAMEX3sksuDyZ6FxW1R__0 2024-09-12T01:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8213487883202642794', time=2024-09-12T03:01:51.476075+0000, chain.objs.size()=1 2024-09-12T01:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FOLeR-yw4rYqr4JbfMNbG7TqS2TgOeH_0 2024-09-12T01:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17157517508587642705', time=2024-09-12T03:01:51.653837+0000, chain.objs.size()=1 2024-09-12T01:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.wkEw7Lfr1LL5880FWpJmv6ayn6iXN0e_0 2024-09-12T01:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2539348961630705139', time=2024-09-12T03:01:51.667620+0000, chain.objs.size()=1 2024-09-12T01:11:23.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.272+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TQmTWVJIIQGRszZciftaWJaFeeFCDH6_0 2024-09-12T01:11:23.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.275+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1918236693510925580', time=2024-09-12T03:01:51.701871+0000, chain.objs.size()=1 2024-09-12T01:11:23.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.275+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rR-PhuofTEURxb3ad_CcGJqh1ILR9kj_0 2024-09-12T01:11:23.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1277213372424840487', time=2024-09-12T03:01:51.729357+0000, chain.objs.size()=1 2024-09-12T01:11:23.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Y9fG2H4qqPAzZNH1mGCvgy70Bopugon_0 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14228257064538992554', time=2024-09-12T03:01:51.774101+0000, chain.objs.size()=1 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qzcvsPskB3oJCJn9rmypNGFDVutwOx-_0 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2390135536276048159', time=2024-09-12T03:01:51.801587+0000, chain.objs.size()=1 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8i63aHAaW64yVBZFTI3GcFTH8m9ENqW_0 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10731607314636334943', time=2024-09-12T03:01:51.907133+0000, chain.objs.size()=1 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3xArWpYWbRTN5iRJjZl-N6t36eIW7IK_0 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5945221681224028810', time=2024-09-12T03:01:51.908386+0000, chain.objs.size()=1 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jpS-7R_b2cXA6YNcZhdkkK9d7iuL6Ss_0 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2319529118722805663', time=2024-09-12T03:01:51.945082+0000, chain.objs.size()=1 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fG7Lh2j2O1DwQ3r-rL13OicY5PAjAxq_0 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11287688460781777213', time=2024-09-12T03:01:51.974955+0000, chain.objs.size()=1 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6cxEPk_-DfrsP7GI2iL8nGIUgtSn4vx_0 2024-09-12T01:11:23.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17647938302240965550', time=2024-09-12T03:01:51.982858+0000, chain.objs.size()=1 2024-09-12T01:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.276+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CwRijDO7iZ3ld8PxKPMEkRg62IkScFe_0 2024-09-12T01:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.277+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14197601613683077003', time=2024-09-12T03:01:52.061944+0000, chain.objs.size()=1 2024-09-12T01:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.277+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.w2pZnsRKuW5Fnga-kfmLPqGraKurFzj_0 2024-09-12T01:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.277+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10222504510443531577', time=2024-09-12T03:01:52.062663+0000, chain.objs.size()=1 2024-09-12T01:11:23.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.277+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.e6L08VzcQe3uLFnmr6DsYAv2tM5kAT5_0 2024-09-12T01:11:23.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.280+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16729270662718271638', time=2024-09-12T03:01:52.082322+0000, chain.objs.size()=1 2024-09-12T01:11:23.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.280+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ni7uwPoAwnR5iApFICRvhGyxrpiXofd_0 2024-09-12T01:11:23.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14420648853416974637', time=2024-09-12T03:01:52.182773+0000, chain.objs.size()=1 2024-09-12T01:11:23.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.eRVrcvJTDeafYibT8cFOze5kw29HUbU_0 2024-09-12T01:11:23.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.101928675889883583', time=2024-09-12T03:01:52.225459+0000, chain.objs.size()=1 2024-09-12T01:11:23.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pfArfKU1Qdq-djGSCGgc3U2UxF8Ssmv_0 2024-09-12T01:11:23.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2792631702064416009', time=2024-09-12T03:01:52.272064+0000, chain.objs.size()=1 2024-09-12T01:11:23.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.feV9NCH2qOisTn1dBOq72H6tbkqGBoV_0 2024-09-12T01:11:23.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3102876662234899056', time=2024-09-12T03:01:52.316875+0000, chain.objs.size()=1 2024-09-12T01:11:23.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TF14lYvxalBjq29Ih2lc-9Bof8sxDXJ_0 2024-09-12T01:11:23.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2563022918578503882', time=2024-09-12T03:02:11.521964+0000, chain.objs.size()=1 2024-09-12T01:11:23.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.370__shadow_.y1pJnxB_jL2wvxuPKde-Dh4Ksg1Ch6q_0 2024-09-12T01:11:23.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8215663004806603728', time=2024-09-12T03:02:46.006790+0000, chain.objs.size()=1 2024-09-12T01:11:23.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.281+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.436__shadow_.GmPj2Yp7Dc7vwX141Cc0Tknuvi7nf_k_0 2024-09-12T01:11:23.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.282+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15203655068912033692', time=2024-09-12T03:03:01.311970+0000, chain.objs.size()=1 2024-09-12T01:11:23.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.282+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.462__shadow_.FUliJGy8H6ig7ckoT5jKkNXBL1Wlx8v_0 2024-09-12T01:11:23.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4160302329096102406', time=2024-09-12T03:03:03.100568+0000, chain.objs.size()=1 2024-09-12T01:11:23.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.465__shadow_.TROl_iS4xnJWxNVmSax0eXK5BdindSa_0 2024-09-12T01:11:23.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9269939128175765142', time=2024-09-12T03:03:03.313277+0000, chain.objs.size()=1 2024-09-12T01:11:23.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.465__shadow_.evZ2YP7bxJyWxkcCiA1GGxtFAhyTuET_0 2024-09-12T01:11:23.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3301121227372818929', time=2024-09-12T03:03:22.109176+0000, chain.objs.size()=6 2024-09-12T01:11:23.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.1 2024-09-12T01:11:23.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.286+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.2 2024-09-12T01:11:23.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.286+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.3 2024-09-12T01:11:23.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.286+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.4 2024-09-12T01:11:23.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.287+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.5 2024-09-12T01:11:23.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.287+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.6 2024-09-12T01:11:23.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.287+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15534079895418043354', time=2024-09-12T03:03:27.463836+0000, chain.objs.size()=2 2024-09-12T01:11:23.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.287+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.518__shadow_.UJYgaqW-ZpFSZUyGMB46tX3OrbheAtN_0 2024-09-12T01:11:23.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.287+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.518__shadow_.UJYgaqW-ZpFSZUyGMB46tX3OrbheAtN_1 2024-09-12T01:11:23.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.288+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7363566006710598658', time=2024-09-12T03:04:27.393640+0000, chain.objs.size()=1 2024-09-12T01:11:23.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.288+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.553__shadow_.t02th-k7FRmNJu2upKVEh8txw7PpGGQ_0 2024-09-12T01:11:23.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.288+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13226529937952896318', time=2024-09-12T03:04:27.952658+0000, chain.objs.size()=1 2024-09-12T01:11:23.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.288+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.554__shadow_._PRpgcO1XE55CFtgdSpjyRI-zPmSFQv_0 2024-09-12T01:11:23.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.288+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12767667893976083926', time=2024-09-12T03:04:39.360190+0000, chain.objs.size()=1 2024-09-12T01:11:23.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.288+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.567__shadow_.f4ald6QD8jUZ_YwMwXynhvCT3zdY_B6_0 2024-09-12T01:11:23.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.288+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3286265317458162501', time=2024-09-12T03:05:14.129747+0000, chain.objs.size()=1 2024-09-12T01:11:23.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.288+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:3mUPU-2OVEoJFI-RDWClFif0H7LANvP_.y8tZV7qVzJ7pGdC2LPRpxJi6DvO5sGI_0 2024-09-12T01:11:23.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.290+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7059279630147406323', time=2024-09-12T03:05:14.682440+0000, chain.objs.size()=1 2024-09-12T01:11:23.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.290+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.583__shadow:5f2tsMODD1h2MDnqY9BKGquX8xFcS5a_.mwjuIAT1cCyeZwLjLkoGrx01L00JgG1_0 2024-09-12T01:11:23.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.292+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11731425291844592006', time=2024-09-12T03:05:15.311718+0000, chain.objs.size()=1 2024-09-12T01:11:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.292+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.584__shadow:I4MHjXl2tSz-FLSy6ANsRyj4UZJlThA_.MFPxxMA2xsKLLjHdWMgW3awouR8n2eS_0 2024-09-12T01:11:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.292+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16125421285298552104', time=2024-09-12T03:05:25.715669+0000, chain.objs.size()=1 2024-09-12T01:11:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.292+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.606__shadow_.19Qk_trea2Qw1foqJf3P7xTfNwmw7xE_0 2024-09-12T01:11:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.293+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2653687750579170384', time=2024-09-12T03:05:26.614981+0000, chain.objs.size()=1 2024-09-12T01:11:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.293+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.608__shadow_.mAgEXmUa2tAHXhXIw2AmXVBboDFJC4B_0 2024-09-12T01:11:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.293+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14271665111825784625', time=2024-09-12T03:07:37.648160+0000, chain.objs.size()=1 2024-09-12T01:11:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.293+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.619__shadow_.K4PSocWg9Bl8KCUjSgluKFz4jXleCQh_0 2024-09-12T01:11:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.293+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13048309942655227559', time=2024-09-12T03:07:43.772595+0000, chain.objs.size()=1 2024-09-12T01:11:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.293+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.628__shadow_.zytgDnSPRCAU9ODbmxGIrQ75iLQXr___0 2024-09-12T01:11:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.293+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5002610199781589027', time=2024-09-12T03:08:44.495826+0000, chain.objs.size()=1 2024-09-12T01:11:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.293+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.719__shadow_.BBRUKGcjv2KNXstRiliPOGPHWAjI7HD_0 2024-09-12T01:11:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.298+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.300+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:11:23.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.302+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.303+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42943' 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7769329435523357352', time=2024-09-12T02:58:53.188956+0000, chain.objs.size()=1 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.2fXQNiqlSU30o-XCA-z5FTwOVRMbFob_0 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13705904188992857052', time=2024-09-12T03:00:37.560673+0000, chain.objs.size()=1 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.237__shadow_.cX9Tx6tiknAAZViFXRiWGR6XiTf4k80_0 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8228312662950732534', time=2024-09-12T03:00:43.627436+0000, chain.objs.size()=1 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.247__shadow_.85t7UtNYYr9Wg859GpBH1qoeweeqfTj_0 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9386561255571018897', time=2024-09-12T03:00:45.061125+0000, chain.objs.size()=1 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.250__shadow_.VQUuci8FnlPxxZWuxe3VdbGpapKBkmz_0 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14874224743423374195', time=2024-09-12T03:00:47.410320+0000, chain.objs.size()=1 2024-09-12T01:11:23.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.255__shadow_.YiSprFbi_m3kydnVYPUqV3lEYRBh_Gp_0 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6270470106065310721', time=2024-09-12T03:00:58.866508+0000, chain.objs.size()=1 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wolbJvgoU5BVRdCbNufFvhnfHiwb03p_0 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15293757788374092926', time=2024-09-12T03:00:58.892214+0000, chain.objs.size()=1 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tYY4owdMwel1w-z2yw40JIF3BVSrYwZ_0 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13229611074965525199', time=2024-09-12T03:00:59.206430+0000, chain.objs.size()=1 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.XbGymdT0erTdbq2D7yqZuXB_R9HeLf-_0 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15567440387237252990', time=2024-09-12T03:00:59.235851+0000, chain.objs.size()=1 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.i5QyiQJAX4WynpXLJMxCSv2_6UFIxxB_0 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9501943759804715708', time=2024-09-12T03:00:59.295561+0000, chain.objs.size()=1 2024-09-12T01:11:23.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.gK-bX_h-GFRE40iMnRbGHbJ1c_Y4mXu_0 2024-09-12T01:11:23.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1166861287070094199', time=2024-09-12T03:00:59.422426+0000, chain.objs.size()=1 2024-09-12T01:11:23.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DnpiS8K0HA2U-SAPXW9jueY2llj3RmW_0 2024-09-12T01:11:23.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12164768117634226427', time=2024-09-12T03:00:59.440199+0000, chain.objs.size()=1 2024-09-12T01:11:23.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CAluEsmpWgtSe92BxDsrn1vFLxoUrgu_0 2024-09-12T01:11:23.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.308+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1980866615771112360', time=2024-09-12T03:00:59.471436+0000, chain.objs.size()=1 2024-09-12T01:11:23.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.308+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RTIeZzQHC2qMe2pyvhKR-bCvJDwd8VF_0 2024-09-12T01:11:23.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.308+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8559738667053000738', time=2024-09-12T03:00:59.474722+0000, chain.objs.size()=1 2024-09-12T01:11:23.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.308+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JiNgpS5XOMtkGR4kSjrRumgLrMGxLxv_0 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10538456498165707757', time=2024-09-12T03:00:59.483940+0000, chain.objs.size()=1 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9r0rmFiS3H-hOzrl_ywpzO2AXpqBFpb_0 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3871361844740958403', time=2024-09-12T03:00:59.487486+0000, chain.objs.size()=1 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.03V4wCWkEXW7DQPYSeQxdfger7z6eAj_0 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.905708361205736119', time=2024-09-12T03:00:59.515824+0000, chain.objs.size()=1 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._rJWmQsbYuymZnQ-xTmSDALw8bQNztZ_0 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2112840283300605837', time=2024-09-12T03:00:59.715019+0000, chain.objs.size()=1 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.YRmfUTVrr9zbiptWSYfWdFJMH3m6Yxf_0 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2788875637871865605', time=2024-09-12T03:00:59.747383+0000, chain.objs.size()=1 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4NhbrxR4IIDy7MqsFoSs59rM_yCyoq-_0 2024-09-12T01:11:23.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12152431526401153673', time=2024-09-12T03:00:59.813422+0000, chain.objs.size()=1 2024-09-12T01:11:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.gEGVp3CHCFlaKb_bGGI2GviIledo8td_0 2024-09-12T01:11:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12885571799966803821', time=2024-09-12T03:01:00.045376+0000, chain.objs.size()=1 2024-09-12T01:11:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hoCp7Ix8P22EHE9uUmyXGInAp7-HK9P_0 2024-09-12T01:11:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3747725124013105751', time=2024-09-12T03:01:00.370502+0000, chain.objs.size()=1 2024-09-12T01:11:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZKRRlUUPwksUp7V_RlEWIlswbrfE-iZ_0 2024-09-12T01:11:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15609640375324129505', time=2024-09-12T03:01:00.392191+0000, chain.objs.size()=1 2024-09-12T01:11:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Q0iEVi84O7RcWPiEExqpjXydTNvpM6C_0 2024-09-12T01:11:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2802236932568659516', time=2024-09-12T03:01:00.409462+0000, chain.objs.size()=1 2024-09-12T01:11:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.YFcSNhTabEjMTg3Cs_cUuRCZUUCQsBW_0 2024-09-12T01:11:23.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.313+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12581274333711272194', time=2024-09-12T03:01:00.424523+0000, chain.objs.size()=1 2024-09-12T01:11:23.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.313+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oxIuYQWR7AdMcFUAPJ5F8L6WO2bS9GZ_0 2024-09-12T01:11:23.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.316+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6641748281106548799', time=2024-09-12T03:01:00.487829+0000, chain.objs.size()=1 2024-09-12T01:11:23.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.316+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oCNG374k3xQIDckJF3Ez-kzdwyXLliF_0 2024-09-12T01:11:23.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.317+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16751579831588110785', time=2024-09-12T03:01:00.494956+0000, chain.objs.size()=1 2024-09-12T01:11:23.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.317+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2z0_wGejhHjrKRwGRueqf0nLNBi3h0M_0 2024-09-12T01:11:23.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8744574995281741379', time=2024-09-12T03:01:00.773563+0000, chain.objs.size()=1 2024-09-12T01:11:23.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hnQxRNtKwo8IKPPkFnUSnWk9-OZz8Hn_0 2024-09-12T01:11:23.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17079796342575657492', time=2024-09-12T03:01:00.852503+0000, chain.objs.size()=1 2024-09-12T01:11:23.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.YAe63NWjSaz_syq4OKf4jDZg1M2SVDn_0 2024-09-12T01:11:23.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8513161063717428417', time=2024-09-12T03:01:00.853298+0000, chain.objs.size()=1 2024-09-12T01:11:23.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ydaHrdafqRF1I1HFYtmOP6FTz96IfE7_0 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5714007434989371665', time=2024-09-12T03:01:00.875676+0000, chain.objs.size()=1 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UFFpAWWLgqvQSnwA9mgBmSBWu-1xQZP_0 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11130227559936869553', time=2024-09-12T03:01:00.915762+0000, chain.objs.size()=1 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UjdZHlQ__n1oP1XvC6I_spHyWKjlJRj_0 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15641234885178200120', time=2024-09-12T03:01:00.962400+0000, chain.objs.size()=1 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TWRIZgPn0C5QR4rwvPlFy8tjNUN3tDO_0 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3451307423187742167', time=2024-09-12T03:01:01.907249+0000, chain.objs.size()=1 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.265__shadow_.7UsAMQbiblzB-0PDPjiJj16zSz6s8hP_0 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12811557840364546003', time=2024-09-12T03:01:04.206091+0000, chain.objs.size()=1 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.270__shadow_.-gmqHntE-tgS4uKhbna51mZxpNkd4R4_0 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17426697071733150404', time=2024-09-12T03:01:05.629124+0000, chain.objs.size()=1 2024-09-12T01:11:23.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.318+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.273__shadow_._KsN8rxusjuPUzJfEKkThLnM7e1T_nt_0 2024-09-12T01:11:23.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3191973836084761540', time=2024-09-12T03:01:11.923783+0000, chain.objs.size()=1 2024-09-12T01:11:23.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.286__shadow_.zOwS2abvzoiFwkJ1XoW9YvxZgUeuNPS_0 2024-09-12T01:11:23.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.321+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11002268354591950511', time=2024-09-12T03:01:13.839377+0000, chain.objs.size()=1 2024-09-12T01:11:23.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.321+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.290__shadow_.XJd6P_EN_1_4Lc90F2z9qSFeTTwWCSQ_0 2024-09-12T01:11:23.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17794385774929496359', time=2024-09-12T03:01:16.644740+0000, chain.objs.size()=1 2024-09-12T01:11:23.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.gkA4A3Lr09tLkBjc28c5kaI4f2Pom-w_0 2024-09-12T01:11:23.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14689917681713812187', time=2024-09-12T03:01:17.089307+0000, chain.objs.size()=1 2024-09-12T01:11:23.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.295__shadow_.r-XzGNxegUdGhGqnZ017F6jRjy5vX8j_0 2024-09-12T01:11:23.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11617479076716471038', time=2024-09-12T03:01:17.575315+0000, chain.objs.size()=1 2024-09-12T01:11:23.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.296__shadow_.cbrzt-7m4RnD6ATV0fktkEAL6Dlb-3I_0 2024-09-12T01:11:23.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14719717607044227080', time=2024-09-12T03:01:21.513251+0000, chain.objs.size()=1 2024-09-12T01:11:23.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.304__shadow_.HP2QrUR78W8MBem4jE-RO7mZftRm8Yi_0 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6688213600233418756', time=2024-09-12T03:01:40.128631+0000, chain.objs.size()=1 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Z_UTwZlvSNssZ9_BbAK92iHuFLoy5lu_0 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16131237468150787580', time=2024-09-12T03:01:40.184862+0000, chain.objs.size()=1 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yhDV48BeHnjxHapImITM819oGL3F8_L_0 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.101414145518813436', time=2024-09-12T03:01:40.191366+0000, chain.objs.size()=1 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.AgpJ07E2vjqCcoCs6awsMsmdXMQX78d_0 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3731733806986376016', time=2024-09-12T03:01:40.223009+0000, chain.objs.size()=1 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.F3rVimsgNLtBMYNyxorYlY4o9dpui_i_0 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14686317942669254271', time=2024-09-12T03:01:40.259948+0000, chain.objs.size()=1 2024-09-12T01:11:23.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.325+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.na00Pfy_0MTqQJIkcojg-D696jTtwxv_0 2024-09-12T01:11:23.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.326+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4678605639415275541', time=2024-09-12T03:01:40.394783+0000, chain.objs.size()=1 2024-09-12T01:11:23.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.326+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jJKjri83PFGYiaId6n9jiyu4uhGIBbZ_0 2024-09-12T01:11:23.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.326+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8938750616148594207', time=2024-09-12T03:01:40.396781+0000, chain.objs.size()=1 2024-09-12T01:11:23.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.326+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yyDaCPdkhiPA4AiD1tvVpMb5rw3RMU2_0 2024-09-12T01:11:23.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.328+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5202876812691179994', time=2024-09-12T03:01:40.467463+0000, chain.objs.size()=1 2024-09-12T01:11:23.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.328+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vLJ8AH-onq8-Uqyxi5VEdjc-n-9s1G7_0 2024-09-12T01:11:23.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.328+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7049323360629080012', time=2024-09-12T03:01:40.507100+0000, chain.objs.size()=1 2024-09-12T01:11:23.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.328+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.d-gxVmjq9g7UrgUHH99_XNTlNnWvQCh_0 2024-09-12T01:11:23.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.329+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3360959547221452100', time=2024-09-12T03:01:40.657948+0000, chain.objs.size()=1 2024-09-12T01:11:23.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.329+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vhIJU3mmFIUXL2NLar-sbVUCvS-AW5b_0 2024-09-12T01:11:23.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.329+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14617183862164174870', time=2024-09-12T03:01:40.711237+0000, chain.objs.size()=1 2024-09-12T01:11:23.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.329+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pm8JWyIXFSAlU3bw8hkgntxbFEmBIl9_0 2024-09-12T01:11:23.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8883185747039184077', time=2024-09-12T03:01:40.733628+0000, chain.objs.size()=1 2024-09-12T01:11:23.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5XsE2JDy44mTwUEcCNVHpaEeQlyX6Xe_0 2024-09-12T01:11:23.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18296257191323952766', time=2024-09-12T03:01:40.764053+0000, chain.objs.size()=1 2024-09-12T01:11:23.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FSl-RGfyRbw5oFmm43a34hX-1iQ_hHf_0 2024-09-12T01:11:23.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1256646777765202661', time=2024-09-12T03:01:40.795769+0000, chain.objs.size()=1 2024-09-12T01:11:23.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EiD-ZDidTWS6FffYt5W4GpLpPU0g7mB_0 2024-09-12T01:11:23.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16941058682131427500', time=2024-09-12T03:01:40.937723+0000, chain.objs.size()=1 2024-09-12T01:11:23.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.CvyRlPbvnzhi0eoUipOkdpIiD6Sqoq3_0 2024-09-12T01:11:23.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6477788266495295809', time=2024-09-12T03:01:40.981137+0000, chain.objs.size()=1 2024-09-12T01:11:23.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mC7Cxrb7FZD4oehX3s2FXEDLcqO4llO_0 2024-09-12T01:11:23.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6465662770261768855', time=2024-09-12T03:01:40.997917+0000, chain.objs.size()=1 2024-09-12T01:11:23.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.330+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5-FjKxsGGgvPryy8NNWtBp5HgKQPWPF_0 2024-09-12T01:11:23.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.332+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12800596613649180676', time=2024-09-12T03:01:41.032237+0000, chain.objs.size()=1 2024-09-12T01:11:23.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.332+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WS_sW6pqmaBslcKOyXiobtwHVZjtnKp_0 2024-09-12T01:11:23.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.333+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9074558561984636801', time=2024-09-12T03:01:41.060138+0000, chain.objs.size()=1 2024-09-12T01:11:23.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.333+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.S47fssVTsJWquOMH_As1f_h_eg9FfdL_0 2024-09-12T01:11:23.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.333+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.601000490433615762', time=2024-09-12T03:01:41.069438+0000, chain.objs.size()=1 2024-09-12T01:11:23.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.OJqaSFyRUnJ4lndHc3aCL2fe5p37DeK_0 2024-09-12T01:11:23.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15361751153145962398', time=2024-09-12T03:01:41.220099+0000, chain.objs.size()=1 2024-09-12T01:11:23.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kiPJs0jP-vIiuuhqj_Cc0XnMgWYPbji_0 2024-09-12T01:11:23.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1537064509284511373', time=2024-09-12T03:01:41.289235+0000, chain.objs.size()=1 2024-09-12T01:11:23.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bqFV3quDaa3C81y4EzCwCnvo8_AtZfD_0 2024-09-12T01:11:23.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8215080632748722858', time=2024-09-12T03:01:41.301535+0000, chain.objs.size()=1 2024-09-12T01:11:23.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._SvugSNiMGdNuczsOKCzMK7R759jmQv_0 2024-09-12T01:11:23.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16140191595845135146', time=2024-09-12T03:01:41.306742+0000, chain.objs.size()=1 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.g1Svmu6KZ9kYiknEraEXqzMFFgqgge4_0 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7363294457425800455', time=2024-09-12T03:01:41.355606+0000, chain.objs.size()=1 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.049gxSw_Ld0s7i1_5pKtVwWjCo9hrIj_0 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2488364899967852769', time=2024-09-12T03:01:41.364414+0000, chain.objs.size()=1 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NlaYsdkpzK_D7GZgdiwgk4NUG5lWbDw_0 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10576064421608635080', time=2024-09-12T03:01:41.490729+0000, chain.objs.size()=1 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.13Gqn83JywxnVLL2dJsUbx9jRmyDZdh_0 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2958899972570213668', time=2024-09-12T03:01:41.546383+0000, chain.objs.size()=1 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FGYburblbaGjLVXRzHobjJazVnV0b5E_0 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12099218758703037113', time=2024-09-12T03:01:41.559292+0000, chain.objs.size()=1 2024-09-12T01:11:23.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.335+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JHqjEK3mvwl75T3LlbN63GZGFE-ZcXr_0 2024-09-12T01:11:23.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.338+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7275030236724177146', time=2024-09-12T03:01:41.568376+0000, chain.objs.size()=1 2024-09-12T01:11:23.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.338+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rZ0A3PseFzSEfx3UaPyoz7uieLxTeoF_0 2024-09-12T01:11:23.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.358294911291720728', time=2024-09-12T03:01:41.751797+0000, chain.objs.size()=1 2024-09-12T01:11:23.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ejR_z5VHblJw9AdQkN4yqIuiXfwBq8Q_0 2024-09-12T01:11:23.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11299188080893246423', time=2024-09-12T03:01:41.763233+0000, chain.objs.size()=1 2024-09-12T01:11:23.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.HpiEjV_d5DZWlEwUXn9zch9pM-MLvpZ_0 2024-09-12T01:11:23.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10067467864877654640', time=2024-09-12T03:01:41.771497+0000, chain.objs.size()=1 2024-09-12T01:11:23.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hC3zbSwjMah5Q9cGo7ArVe0EhTnUA_9_0 2024-09-12T01:11:23.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.341+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3231095173964533748', time=2024-09-12T03:01:41.852895+0000, chain.objs.size()=1 2024-09-12T01:11:23.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.341+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Y3lDPpuq75wsJKTZo7-mhBpPb3Vc9ej_0 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.341+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14964637171105764183', time=2024-09-12T03:01:50.219739+0000, chain.objs.size()=1 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.341+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ItPjD0uhvfh5iPGA1iWSlQeweM7dX-N_0 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.341+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11145367998629062116', time=2024-09-12T03:01:50.253859+0000, chain.objs.size()=1 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.341+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LCTVzX-XTvctNHufL_SUjkyX1vZAp6__0 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7872705189561075844', time=2024-09-12T03:01:50.378905+0000, chain.objs.size()=1 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GETK9Zgwo2YuakvCRK-XDO9ledNrmax_0 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.578088247601528825', time=2024-09-12T03:01:50.383745+0000, chain.objs.size()=1 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xABEqUNsdiYPwpbP_-aaY2dtRUf4es6_0 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12236097162647452482', time=2024-09-12T03:01:50.602057+0000, chain.objs.size()=1 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.t9mCKeJ4mhIuejEVBgbPHcnH3hM1RH-_0 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15495343832004575676', time=2024-09-12T03:01:50.646194+0000, chain.objs.size()=1 2024-09-12T01:11:23.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oVrWg5MoR74sYts8mNTdePjI6NNRplW_0 2024-09-12T01:11:23.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12526430958181589633', time=2024-09-12T03:01:50.681210+0000, chain.objs.size()=1 2024-09-12T01:11:23.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.342+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.WEGFUC6xVwKH16E80dDB4llPV2Ue7Rq_0 2024-09-12T01:11:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.343+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14898995377312576390', time=2024-09-12T03:01:50.699483+0000, chain.objs.size()=1 2024-09-12T01:11:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.343+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.5DZEZwPEjIUkBKQL6RlMI2VBFAQ_7f7_0 2024-09-12T01:11:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.343+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8567681199626409065', time=2024-09-12T03:01:50.710445+0000, chain.objs.size()=1 2024-09-12T01:11:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.343+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0diUV7ycgZ734LHEUniYFpSpHXcH1iL_0 2024-09-12T01:11:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.344+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16936423568693397470', time=2024-09-12T03:01:50.723683+0000, chain.objs.size()=1 2024-09-12T01:11:23.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.344+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Xjk-W9A9Vn7ZxhXv8FlqLHTe8WLdaPW_0 2024-09-12T01:11:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15059776693965603903', time=2024-09-12T03:01:50.815229+0000, chain.objs.size()=1 2024-09-12T01:11:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.C6FrJn76jeruZsYL6GNmIOC-9Vbiddg_0 2024-09-12T01:11:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6109075418185363283', time=2024-09-12T03:01:50.827854+0000, chain.objs.size()=1 2024-09-12T01:11:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mq4ky4gilIVGXM-_EOP881wNNPcUEKZ_0 2024-09-12T01:11:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8175633555557721445', time=2024-09-12T03:01:50.854529+0000, chain.objs.size()=1 2024-09-12T01:11:23.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._m-giT_7mWROs6G1nkphIIgI09mbsql_0 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9513483918282236199', time=2024-09-12T03:01:50.863122+0000, chain.objs.size()=1 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rdJKmoQowiCLM-roJ0RjYlWVMV61BcH_0 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16055431911198004163', time=2024-09-12T03:01:50.872887+0000, chain.objs.size()=1 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Pq5whicQJiX6pPk1oH-EWThNQozzdNS_0 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16237675308724616390', time=2024-09-12T03:01:50.902688+0000, chain.objs.size()=1 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.wAl64yoKo4CitNohq0zrEWsj_AqlQTX_0 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13585749859294791778', time=2024-09-12T03:01:50.907911+0000, chain.objs.size()=1 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fkfi5ehfgpJFEb1sJoauKKqCVghq33Z_0 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11388697503962603570', time=2024-09-12T03:01:50.965322+0000, chain.objs.size()=1 2024-09-12T01:11:23.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ikGu6I5dt6Rn_agtCHSRvjyTMzaGRp6_0 2024-09-12T01:11:23.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7980107436080906477', time=2024-09-12T03:01:51.001861+0000, chain.objs.size()=1 2024-09-12T01:11:23.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.346+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7_hdQmzE8a-47yLDqKDabmz_piN7-iW_0 2024-09-12T01:11:23.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.348+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11576787742057918301', time=2024-09-12T03:01:51.126642+0000, chain.objs.size()=1 2024-09-12T01:11:23.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.348+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CnhN4Jzsfh0LpCe0MomLvlQGmhv8x3E_0 2024-09-12T01:11:23.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.348+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16946395396852505766', time=2024-09-12T03:01:51.182489+0000, chain.objs.size()=1 2024-09-12T01:11:23.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.348+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vWrU8KkP0hLXTi5kNeTjmcCwCcVYfOM_0 2024-09-12T01:11:23.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.352+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4347741960454159451', time=2024-09-12T03:01:51.198385+0000, chain.objs.size()=1 2024-09-12T01:11:23.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.352+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.R57Zt8iomn6vDy-BF5w7cbcqNzWdpo2_0 2024-09-12T01:11:23.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.352+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8564466881078169677', time=2024-09-12T03:01:51.199853+0000, chain.objs.size()=1 2024-09-12T01:11:23.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.352+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.w0_qr_szQa178ztFvn0QA9_U3rBntkw_0 2024-09-12T01:11:23.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.352+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.838635786645651234', time=2024-09-12T03:01:51.224981+0000, chain.objs.size()=1 2024-09-12T01:11:23.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.352+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ZRGD4Nr4szwsAOzwHTv0njpxJEXfx5E_0 2024-09-12T01:11:23.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.356+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/42943 2024-09-12T01:11:23.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T01:11:23.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.24136485595399495', time=2024-09-12T03:01:51.548487+0000, chain.objs.size()=1 2024-09-12T01:11:23.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.sHwVwZbdmFY13AtLzEE_2FjpI_EuMRG_0 2024-09-12T01:11:23.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2438868076858823667', time=2024-09-12T03:01:51.553382+0000, chain.objs.size()=1 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0wDAXHRWP6FnNzIUvdzWlOnfp8qid3N_0 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10401921221843706340', time=2024-09-12T03:01:51.657049+0000, chain.objs.size()=1 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.EtYMGEDC8ILVj2LXBTzqMTbtNEV-mFT_0 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9391468667771505227', time=2024-09-12T03:01:51.702078+0000, chain.objs.size()=1 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.o3jifyELTZL6t4f005OLvoF_Xy3v9V0_0 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3398156711810215948', time=2024-09-12T03:01:51.745989+0000, chain.objs.size()=1 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8hpGLWcr97JUuXEe01RuCGJGShNeQzg_0 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3101895288887818080', time=2024-09-12T03:01:51.810544+0000, chain.objs.size()=1 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.efHJ_yaWZbS8bkMwy7db6krom49AHvh_0 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13712464474309606087', time=2024-09-12T03:01:51.911192+0000, chain.objs.size()=1 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vCKGCMTu1KRvhM2MtEUIg-td2IS3xdk_0 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14954593957884114520', time=2024-09-12T03:01:51.915632+0000, chain.objs.size()=1 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FZEhwbceZgpaOaBqbUbPH0pvrFmV7DW_0 2024-09-12T01:11:23.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1664108877288901544', time=2024-09-12T03:01:51.931825+0000, chain.objs.size()=1 2024-09-12T01:11:23.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CoqLNgbCyc0kxiW1X4_byNDEkSt2Lmm_0 2024-09-12T01:11:23.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5467407415315736719', time=2024-09-12T03:01:52.048591+0000, chain.objs.size()=1 2024-09-12T01:11:23.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.59qiSw13-VZbSZS7GssZ_t0eYAuVsex_0 2024-09-12T01:11:23.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12035579577802403958', time=2024-09-12T03:01:52.050298+0000, chain.objs.size()=1 2024-09-12T01:11:23.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LR_0oCeBRAMFA1RcWHT1HkkeD0F7r7p_0 2024-09-12T01:11:23.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5899374384810059976', time=2024-09-12T03:01:52.076788+0000, chain.objs.size()=1 2024-09-12T01:11:23.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.358+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IJajzvHcDPf8LfO4XxUfDOrhR3bZEbq_0 2024-09-12T01:11:23.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5107528591442316828', time=2024-09-12T03:01:52.283197+0000, chain.objs.size()=1 2024-09-12T01:11:23.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.loFpZ_2VGafmKeXau4oOQD--RfHf5ob_0 2024-09-12T01:11:23.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3180108999161235626', time=2024-09-12T03:01:56.832858+0000, chain.objs.size()=1 2024-09-12T01:11:23.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.335__shadow_.BCigTWYZ_AcRt2PydasdrYIwC7bQqYq_0 2024-09-12T01:11:23.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.264348204673581170', time=2024-09-12T03:01:57.296250+0000, chain.objs.size()=1 2024-09-12T01:11:23.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.336__shadow_.IGuAWFrEkvCQ6BWWNK5uFPH8J0iZXNB_0 2024-09-12T01:11:23.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12064597911752897271', time=2024-09-12T03:02:32.898398+0000, chain.objs.size()=1 2024-09-12T01:11:23.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.410__shadow_.A5G4dyOLprvRDcupEslmIEvV67xljPy_0 2024-09-12T01:11:23.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5843467399550966063', time=2024-09-12T03:02:57.725892+0000, chain.objs.size()=1 2024-09-12T01:11:23.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.457__shadow_.SiUKAiUKq_2IhpnuGQy80QFUgOXFXpR_0 2024-09-12T01:11:23.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1590811804877916416', time=2024-09-12T03:03:02.715569+0000, chain.objs.size()=1 2024-09-12T01:11:23.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.362+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.464__shadow_.UkeFnFS9e3V_KhnaJNEBBLJMazE4txp_0 2024-09-12T01:11:23.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.364+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5132016274966815843', time=2024-09-12T03:03:11.731281+0000, chain.objs.size()=1 2024-09-12T01:11:23.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.364+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.487__shadow_.yyhwpghiqqs7bJeF8HLCmWKok2uvJ3G_0 2024-09-12T01:11:23.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.364+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2361622519919681623', time=2024-09-12T03:03:22.014214+0000, chain.objs.size()=6 2024-09-12T01:11:23.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.364+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.1 2024-09-12T01:11:23.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.364+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.2 2024-09-12T01:11:23.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.364+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.3 2024-09-12T01:11:23.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.364+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.4 2024-09-12T01:11:23.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.366+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.5 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.6 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3879852589082541729', time=2024-09-12T03:03:23.881876+0000, chain.objs.size()=1 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.513__shadow_.8T2BHiZGXRjK2JRcZHYim91qY9cCGmU_0 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2536348070267503509', time=2024-09-12T03:03:46.685471+0000, chain.objs.size()=3 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~NMvM2-b9kA-DEeGUqWjzUpBZEU62brZ.1 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~NMvM2-b9kA-DEeGUqWjzUpBZEU62brZ.2 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~NMvM2-b9kA-DEeGUqWjzUpBZEU62brZ.3 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15012763607603152718', time=2024-09-12T03:04:31.260886+0000, chain.objs.size()=1 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.559__shadow_.Ep-5nq54f9UdacZNrB6uB-B3ZqQJJve_0 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5201293001041985316', time=2024-09-12T03:04:42.603792+0000, chain.objs.size()=1 2024-09-12T01:11:23.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.368+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:5B4QLpChO74LygIhi60imotL3jh5U9b_.M_pB9JgY7Xw8mgge9A5GanA4JMCiccI_0 2024-09-12T01:11:23.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.369+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5052623011414495863', time=2024-09-12T03:04:49.357524+0000, chain.objs.size()=1 2024-09-12T01:11:23.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.369+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.574__shadow_.c_EgHU3ZUBGLIxDckz1K1vrV3FI0y3v_0 2024-09-12T01:11:23.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.369+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8711619747535531914', time=2024-09-12T03:04:51.137220+0000, chain.objs.size()=1 2024-09-12T01:11:23.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.369+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow:kULqgpXbXkqAbfNBnnJv4MPZw4ArjjT_.I0TktOt_NACLK0ecHO-604lh3h0NXQ5_0 2024-09-12T01:11:23.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.369+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18180361544004495252', time=2024-09-12T03:04:58.638421+0000, chain.objs.size()=1 2024-09-12T01:11:23.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.369+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:JJM1hZbsD9UFeDcpeAmjzWYFL7aqpF4_.0rfweONEKRALzAVylS9Mta89Wz7bu0c_0 2024-09-12T01:11:23.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.369+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11467208290858704130', time=2024-09-12T03:04:59.849603+0000, chain.objs.size()=1 2024-09-12T01:11:23.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.369+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:ehyNAG4sX4tO0zvP8ffhlghTPcbYOvq_.Jx_x3s_3FPFoUZSfdw2IM63ORcquThh_0 2024-09-12T01:11:23.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.371+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7139867571824285604', time=2024-09-12T03:05:14.677771+0000, chain.objs.size()=1 2024-09-12T01:11:23.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.371+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.583__shadow:E3TsZgxyy0DPXmda145CYMr4vuZMSAz_.V-5JWYf4tvg24jF_AeOp9WinnNw5-Az_0 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6541058178250517449', time=2024-09-12T03:05:16.863008+0000, chain.objs.size()=1 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.586__shadow:qq89p8B-SQ3MJHZdlvKjgEAT2Mkyh4X_.yAv4oKU3M-O4uGrPGi0N5MFhVOkdedd_0 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13594427766890872672', time=2024-09-12T03:05:17.988081+0000, chain.objs.size()=1 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.588__shadow:MwmBNpc0LisvwqTtbgDA1PzV4NmtfUt_.a5oRzobOJe_i-NqiRtx-9fODHj2ap9t_0 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13719846371824718810', time=2024-09-12T03:05:18.037449+0000, chain.objs.size()=1 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.588__shadow:AVur5pv0kJZ4PX85ZmERVmFCF1mSbwl_.NWT3iP70pV20N9OiVmW0SeZ6RC3Tfbv_0 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10436116910949128536', time=2024-09-12T03:06:36.623883+0000, chain.objs.size()=1 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.618__shadow_.plkd0d44QIv7NuCpPjbRzykFhbXu_1V_0 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8830933745273784699', time=2024-09-12T03:07:56.537088+0000, chain.objs.size()=1 2024-09-12T01:11:23.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.654__shadow_.gm--tban1cBsolWnx5HrIUvtshob2FV_0 2024-09-12T01:11:23.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14947159549687908235', time=2024-09-12T03:08:04.545977+0000, chain.objs.size()=1 2024-09-12T01:11:23.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.669__shadow_.6pbs0MUdNz4x4VfrV1sfqByiHkTgE4v_0 2024-09-12T01:11:23.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.373+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18359969879017591658', time=2024-09-12T03:08:13.491631+0000, chain.objs.size()=1 2024-09-12T01:11:23.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.373+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.692__shadow_.I1Uh0WN1c627hpwORJBnoqIUCX3m4jP_0 2024-09-12T01:11:23.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.374+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8777355747878608717', time=2024-09-12T03:08:17.322987+0000, chain.objs.size()=1 2024-09-12T01:11:23.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.374+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.701__shadow:X.wLqgI17KZCkr5tqOmiNph0kYrLcap_.4ODTO0qcyboCDacYDYw0wPH789_yGHp_0 2024-09-12T01:11:23.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.378+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.380+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:11:23.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.382+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.382+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47562' 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2060096104496351589', time=2024-09-12T02:59:25.908416+0000, chain.objs.size()=1 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.201__shadow_.J-iiT4ZSb0PpM4D90Hck8eNXvXJxU6g_0 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6059409608265670805', time=2024-09-12T02:59:27.304799+0000, chain.objs.size()=1 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.204__shadow_.twcNpnOuF7hUD6orLUZnWvYbPf3Q4qr_0 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16991223319898877789', time=2024-09-12T03:00:41.890047+0000, chain.objs.size()=1 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.244__shadow_.SMIbLfqIPDoE5MH_LUgxa-rvG6G6v36_0 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14830343698424289803', time=2024-09-12T03:00:42.724472+0000, chain.objs.size()=1 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.245__shadow_.oA71_GYLXuPwzj4PGScYiCmMWHwYohn_0 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15946349518306157725', time=2024-09-12T03:00:43.169580+0000, chain.objs.size()=1 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.246__shadow_.Ad7X7c9xZHSSOvKMce-wEcJCmARI69w_0 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7977650167277411785', time=2024-09-12T03:00:44.105643+0000, chain.objs.size()=1 2024-09-12T01:11:23.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.248__shadow_.JZGkDiFzDnYN53PQdNxrCAWcVW7lqmE_0 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10746086724771554605', time=2024-09-12T03:00:48.401073+0000, chain.objs.size()=1 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.257__shadow_.aDcZ2cPr2vU_ZyAhftk4cfwXqlEsjIp_0 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9592680973308133769', time=2024-09-12T03:00:58.880296+0000, chain.objs.size()=1 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.nAmqNKu5oVa1xhsOaUlpRgBw4PX4K8l_0 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5784818258078248866', time=2024-09-12T03:00:58.897940+0000, chain.objs.size()=1 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.02oe5JYAH0MXR3j5rMFPOdpswfogsMN_0 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10079336672529518151', time=2024-09-12T03:00:58.936542+0000, chain.objs.size()=1 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.C3qYyKuQqIcWnjLGq93Wq1yEdc4ljv__0 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3551678703831486619', time=2024-09-12T03:00:58.948183+0000, chain.objs.size()=1 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4xNXdE-AoIKCGY7Sm841vC3BQ54uR6V_0 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13456349464248263147', time=2024-09-12T03:00:59.002477+0000, chain.objs.size()=1 2024-09-12T01:11:23.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.383+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rz0zCtrmvNcxslrQ34UVOv55u_tgEVJ_0 2024-09-12T01:11:23.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.386+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8866700756165783731', time=2024-09-12T03:00:59.139284+0000, chain.objs.size()=1 2024-09-12T01:11:23.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.386+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ODYmwn4UA6pbmCY7PZDWxmAVCkO6BIa_0 2024-09-12T01:11:23.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.386+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4308239628076502348', time=2024-09-12T03:00:59.170828+0000, chain.objs.size()=1 2024-09-12T01:11:23.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.386+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6Dk-Y3clmqKLSoE4s6skkrKhcNCreH7_0 2024-09-12T01:11:23.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.386+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10222449055539333758', time=2024-09-12T03:00:59.196543+0000, chain.objs.size()=1 2024-09-12T01:11:23.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.386+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2DxRKCwJxSFKr_Xx9m078ydfGUq6Wrp_0 2024-09-12T01:11:23.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15097954634896305987', time=2024-09-12T03:00:59.197638+0000, chain.objs.size()=1 2024-09-12T01:11:23.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LW4KKqCNa3qCm7KOMALce4VefUZAwno_0 2024-09-12T01:11:23.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4334920298261230804', time=2024-09-12T03:00:59.238727+0000, chain.objs.size()=1 2024-09-12T01:11:23.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tnLHA7_7fV-v5UlgM9tUqeqpPydFDA0_0 2024-09-12T01:11:23.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7348746694498662256', time=2024-09-12T03:00:59.297489+0000, chain.objs.size()=1 2024-09-12T01:11:23.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.muhcXNTDUhjV7mg-d9jD7at8BItZ8z-_0 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17419342196216237780', time=2024-09-12T03:00:59.435854+0000, chain.objs.size()=1 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VdWY0MF6Bm6KHw6KKefZ1F5PdL7puNm_0 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1698448985799804796', time=2024-09-12T03:00:59.479678+0000, chain.objs.size()=1 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.pVIcegZlPWZ4ZZGKrw57VZ3OiXBDKcD_0 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16968743822030608947', time=2024-09-12T03:00:59.497573+0000, chain.objs.size()=1 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tvVxMUmneg6jZsYkYFVf04gcBtjEmkA_0 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2239514050709286827', time=2024-09-12T03:00:59.561881+0000, chain.objs.size()=1 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.OWwrWDIvzTAO1PAl3BodFJ0i2yiKQ5u_0 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13449976554788556527', time=2024-09-12T03:00:59.575018+0000, chain.objs.size()=1 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hFThZcLGkB8Qegv3ai1Dd-T18zm-W-e_0 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5292987587427421625', time=2024-09-12T03:00:59.826467+0000, chain.objs.size()=1 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Qf4hKG9wiI2ruLu4ny0FP7PT1PMIg8h_0 2024-09-12T01:11:23.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16432411639812280677', time=2024-09-12T03:00:59.943615+0000, chain.objs.size()=1 2024-09-12T01:11:23.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.p3tkPsYJwHvY_cB8XtzYDYyDwWtmioY_0 2024-09-12T01:11:23.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5527967166466601128', time=2024-09-12T03:00:59.994381+0000, chain.objs.size()=1 2024-09-12T01:11:23.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.389+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tltbiHORQ2Yshe77diogRMWRhsi1m7s_0 2024-09-12T01:11:23.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.392+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16966622995680601212', time=2024-09-12T03:01:00.011117+0000, chain.objs.size()=1 2024-09-12T01:11:23.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.392+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VmdVjiqX4dxxfvBhsjSlMjT9IIc8wB6_0 2024-09-12T01:11:23.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.394+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9955969396536002956', time=2024-09-12T03:01:00.324611+0000, chain.objs.size()=1 2024-09-12T01:11:23.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.394+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1zR4P7VyRtgMjWso0CJjwPKBnabEQ_Z_0 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9638218688204281770', time=2024-09-12T03:01:00.348420+0000, chain.objs.size()=1 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.H9YqmdeuomXXbZ2N4JnNuoC8iuvTArT_0 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6133061063348927252', time=2024-09-12T03:01:00.440562+0000, chain.objs.size()=1 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hse_WU35z6-SkkK-V1w4rHEiyjIuKSJ_0 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2771447005234360299', time=2024-09-12T03:01:00.443114+0000, chain.objs.size()=1 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oePYC3dmF8K48CgMYR8jlJMBRvnAew6_0 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1514615548872684191', time=2024-09-12T03:01:00.616930+0000, chain.objs.size()=1 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RCX64zfphevrIDW-Wy8aXAGpOc9_VcE_0 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4795006458298845834', time=2024-09-12T03:01:00.707049+0000, chain.objs.size()=1 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.n599xrrqEG6hzYWRfvIiFNj9pCK03LT_0 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16981401683626468213', time=2024-09-12T03:01:00.855721+0000, chain.objs.size()=1 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Z6X9P00E-WTQRLNwDFiQMrDIU1S4NG9_0 2024-09-12T01:11:23.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14933487561068075643', time=2024-09-12T03:01:00.875709+0000, chain.objs.size()=1 2024-09-12T01:11:23.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.aykQlnxK5ppqc-2Xu1H9WAIuBqcWASo_0 2024-09-12T01:11:23.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8901512762868764174', time=2024-09-12T03:01:00.883973+0000, chain.objs.size()=1 2024-09-12T01:11:23.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.395+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._awiXJmNYnPrFVe8fDxdJLMdybomjdM_0 2024-09-12T01:11:23.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.396+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11860392823814777627', time=2024-09-12T03:01:03.301079+0000, chain.objs.size()=1 2024-09-12T01:11:23.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.396+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.268__shadow_.b1izKeCrrtUBipXx8c2PZDp0LRxC31x_0 2024-09-12T01:11:23.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.400+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12480175701106547583', time=2024-09-12T03:01:07.437946+0000, chain.objs.size()=1 2024-09-12T01:11:23.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.400+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.277__shadow_.hfiAPAiXSZ2labkFYOjz5NSyzKYrmH6_0 2024-09-12T01:11:23.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.400+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10993216702459514050', time=2024-09-12T03:01:11.332701+0000, chain.objs.size()=1 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.400+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.285__shadow_.NMitxqIuePyFBb--ALNnz9ii3gABccq_0 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.400+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13731466713674153415', time=2024-09-12T03:01:15.849562+0000, chain.objs.size()=1 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.400+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.TDt4_4ZkbQcxrubtq7iousfFfqLcldl_0 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.400+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8960689465745283516', time=2024-09-12T03:01:15.870212+0000, chain.objs.size()=1 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.400+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.mYBZuWU-8tOM7ylDqFKw9Z_2njAcC8t_0 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16663570317325232800', time=2024-09-12T03:01:17.090268+0000, chain.objs.size()=1 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.295__shadow_.Llgs2_vw0G45UZMUQQ9IHWcCHENG_cz_0 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.433949026512558585', time=2024-09-12T03:01:22.437323+0000, chain.objs.size()=1 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.306__shadow_.l8wIBlU6pilUcidKBSq_P3b-wxYgqD5_0 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9997838072547974731', time=2024-09-12T03:01:40.173487+0000, chain.objs.size()=1 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.gt555tOa0xafgc3JmJ0MeDkQ9IRQbhO_0 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.556888595578318423', time=2024-09-12T03:01:40.217637+0000, chain.objs.size()=1 2024-09-12T01:11:23.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.oWNcB94-Tas6SrMKHXBKprbb--XvVVl_0 2024-09-12T01:11:23.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4469887675912411079', time=2024-09-12T03:01:40.252651+0000, chain.objs.size()=1 2024-09-12T01:11:23.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.V4nprgHLpYF4PQikAPMxwuxfg1KzJXa_0 2024-09-12T01:11:23.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17879739518331990244', time=2024-09-12T03:01:40.274477+0000, chain.objs.size()=1 2024-09-12T01:11:23.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.i8q9mYZmCpf9ubaxBqF9ALTvUSRJPWo_0 2024-09-12T01:11:23.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14657362064474435557', time=2024-09-12T03:01:40.391189+0000, chain.objs.size()=1 2024-09-12T01:11:23.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.401+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.AMX5-xf1PGmyg98bvf8iZvdfS-tIsZ3_0 2024-09-12T01:11:23.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16162427646619533743', time=2024-09-12T03:01:40.431953+0000, chain.objs.size()=1 2024-09-12T01:11:23.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5lw9cIIceYmw9OhBD6HWtQeSxDTl67k_0 2024-09-12T01:11:23.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.954266417376688571', time=2024-09-12T03:01:40.489407+0000, chain.objs.size()=1 2024-09-12T01:11:23.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.91AZzibKDtCjPE2gTD57-9mnPt91t5G_0 2024-09-12T01:11:23.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11037261006885536861', time=2024-09-12T03:01:40.527021+0000, chain.objs.size()=1 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.CHsTGejIDvCVhMHccq-ESgk7A9VaCqG_0 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11100151721600735961', time=2024-09-12T03:01:40.653231+0000, chain.objs.size()=1 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kEvxAJRoaJM0keRTKCcHNgU6DaxmvLi_0 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12315608416317161641', time=2024-09-12T03:01:40.692269+0000, chain.objs.size()=1 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4PMPRRiYuMJdn5qNohVRt6UKn9_Vdt-_0 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1462012591845753288', time=2024-09-12T03:01:40.706861+0000, chain.objs.size()=1 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KRs9In7oOoFwHKBuA3qnEUUvDip525G_0 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3642794888887379655', time=2024-09-12T03:01:40.760512+0000, chain.objs.size()=1 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.AcZWuRHGjhHiOhVfBZ-htkr-mOKmjIe_0 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.29858571420285870', time=2024-09-12T03:01:40.817336+0000, chain.objs.size()=1 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.405+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zGTdAaPE7lGGvj1mTZGhPW0vAK3ZxNe_0 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.406+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6264518965694590107', time=2024-09-12T03:01:40.910703+0000, chain.objs.size()=1 2024-09-12T01:11:23.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.406+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pIO8KD12-hb0OkZELoPB2yNgYauFAEx_0 2024-09-12T01:11:23.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.409+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12936288089798154815', time=2024-09-12T03:01:40.916612+0000, chain.objs.size()=1 2024-09-12T01:11:23.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.409+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.f5klNq0xT_L7SsK64NXeQfEVymE_oGh_0 2024-09-12T01:11:23.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.409+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17445586537258908890', time=2024-09-12T03:01:40.929475+0000, chain.objs.size()=1 2024-09-12T01:11:23.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.409+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8lvtLQIsh_-X9Ng6_Yv8ieoiXSEzcV1_0 2024-09-12T01:11:23.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.409+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8868252041773100465', time=2024-09-12T03:01:40.960069+0000, chain.objs.size()=1 2024-09-12T01:11:23.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.409+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.o0WkguUYf-PYM3QKnBITJiFnyCQoHir_0 2024-09-12T01:11:23.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.409+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11724281455492213404', time=2024-09-12T03:01:41.180597+0000, chain.objs.size()=1 2024-09-12T01:11:23.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.409+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rQzFV5fxd9txUFtY5aQKncA7YpIvN5e_0 2024-09-12T01:11:23.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.410+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17160708350660929897', time=2024-09-12T03:01:41.201357+0000, chain.objs.size()=1 2024-09-12T01:11:23.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.410+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.V_NndGrcaqf9JdEzS0Cjo4FRgrsz5jZ_0 2024-09-12T01:11:23.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.411+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8197169673656940593', time=2024-09-12T03:01:41.210398+0000, chain.objs.size()=1 2024-09-12T01:11:23.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.411+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Y78dYSXmZKkBv_PRAUQZJ6IFn_3beXq_0 2024-09-12T01:11:23.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.411+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1803666872168725689', time=2024-09-12T03:01:41.277679+0000, chain.objs.size()=1 2024-09-12T01:11:23.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.411+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MdU-TqZGf4vUVWUjnMmFMUcIBLZ4p9J_0 2024-09-12T01:11:23.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8692919777449762954', time=2024-09-12T03:01:41.344229+0000, chain.objs.size()=1 2024-09-12T01:11:23.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZYI6Lhsy4M4UvddrXHyEWmarn_WXN_G_0 2024-09-12T01:11:23.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9584459205545805952', time=2024-09-12T03:01:41.483596+0000, chain.objs.size()=1 2024-09-12T01:11:23.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-RuYFxDg139gYgyejSgAEwOPIpSr-CV_0 2024-09-12T01:11:23.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17456222224380587141', time=2024-09-12T03:01:41.581003+0000, chain.objs.size()=1 2024-09-12T01:11:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qu88j1MyWY95Xjft5TOHKfqQx3uoDE-_0 2024-09-12T01:11:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15785691672191675447', time=2024-09-12T03:01:41.595711+0000, chain.objs.size()=1 2024-09-12T01:11:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.p1UUzOcP13ggdECAyMieCq2EYVm-MUe_0 2024-09-12T01:11:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5344703963924801037', time=2024-09-12T03:01:41.613822+0000, chain.objs.size()=1 2024-09-12T01:11:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.X2ejif7zrrbVYw7OTOutofsmhniLhfO_0 2024-09-12T01:11:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10969358803507897239', time=2024-09-12T03:01:41.767934+0000, chain.objs.size()=1 2024-09-12T01:11:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.413+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.s8nZWhsF1LRiOWmTLTR1m6Hbw_QL85I_0 2024-09-12T01:11:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.415+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11980335878123259049', time=2024-09-12T03:01:41.770732+0000, chain.objs.size()=1 2024-09-12T01:11:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.415+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rrR026g7wzWn0jhTr0iUKLQuBmCvGWn_0 2024-09-12T01:11:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.416+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13581934949294828268', time=2024-09-12T03:01:41.816709+0000, chain.objs.size()=1 2024-09-12T01:11:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.416+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.47kNbcluMz1vz_jilxSjCxjP_30oo8m_0 2024-09-12T01:11:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.416+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12432241951234821732', time=2024-09-12T03:01:41.830291+0000, chain.objs.size()=1 2024-09-12T01:11:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.416+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.M0KWEAoRJI202hajCKHKIGDfoAcy-iZ_0 2024-09-12T01:11:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.416+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1717789342668209227', time=2024-09-12T03:01:42.062448+0000, chain.objs.size()=1 2024-09-12T01:11:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.416+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.d9wWusWSotbMUc-6gjm9x9hMhynkzfx_0 2024-09-12T01:11:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.416+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14424608528569975330', time=2024-09-12T03:01:42.066870+0000, chain.objs.size()=1 2024-09-12T01:11:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.416+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._0b_FJj2f5ys7VgYsdBd5rYzAzNVFls_0 2024-09-12T01:11:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.417+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12075421554556740247', time=2024-09-12T03:01:50.218413+0000, chain.objs.size()=1 2024-09-12T01:11:23.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.417+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.HqmBXGi6SdjQXPmrpoZdmpndEAxcnJ8_0 2024-09-12T01:11:23.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7346535862109651579', time=2024-09-12T03:01:50.240629+0000, chain.objs.size()=1 2024-09-12T01:11:23.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AKq9R-gFasKgQAP2T5w2gGs5tQiI_tD_0 2024-09-12T01:11:23.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17853767525444285853', time=2024-09-12T03:01:50.282740+0000, chain.objs.size()=1 2024-09-12T01:11:23.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.T6_D6Hh9R98UQRa-Ag7L-i-ti8WfIis_0 2024-09-12T01:11:23.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8695619035194320304', time=2024-09-12T03:01:50.321245+0000, chain.objs.size()=1 2024-09-12T01:11:23.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mND5uHt5TW5cYT_egU1R9RnKnWjAiwy_0 2024-09-12T01:11:23.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11718288170425102665', time=2024-09-12T03:01:50.334532+0000, chain.objs.size()=1 2024-09-12T01:11:23.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Lg2ift4siHNIeocR3jHEjWPMTxzmnzb_0 2024-09-12T01:11:23.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10747573765755319391', time=2024-09-12T03:01:50.386486+0000, chain.objs.size()=1 2024-09-12T01:11:23.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.K2ybWUs9DKkuQIsz7yQjsFcyVWXyqth_0 2024-09-12T01:11:23.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7093684887379552236', time=2024-09-12T03:01:50.544953+0000, chain.objs.size()=1 2024-09-12T01:11:23.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.418+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IcQiv-eEdBbpmk2sA-M8ngsdDbm_I8k_0 2024-09-12T01:11:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.420+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9356265130933417471', time=2024-09-12T03:01:50.566426+0000, chain.objs.size()=1 2024-09-12T01:11:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.420+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._CFIwvcckc5-m8wDdjb8ek5RH2EonBV_0 2024-09-12T01:11:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.420+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6283631352504889064', time=2024-09-12T03:01:50.628696+0000, chain.objs.size()=1 2024-09-12T01:11:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.420+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.H4I2GZj-lBcLVjk8PruVu769XtmNdk6_0 2024-09-12T01:11:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.421+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12254412148179494873', time=2024-09-12T03:01:50.651822+0000, chain.objs.size()=1 2024-09-12T01:11:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.421+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.eC9ZEo28PEdy10VrsU6CoAUdh-Funoe_0 2024-09-12T01:11:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.421+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16790298210335348008', time=2024-09-12T03:01:50.664093+0000, chain.objs.size()=1 2024-09-12T01:11:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.421+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.n6EMJtqTxppcsFnYEq7-AyApiLNMMlP_0 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11566807757692106317', time=2024-09-12T03:01:50.717810+0000, chain.objs.size()=1 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6b7gWWOsU_VTejvaFrFFvfEm-G22DxE_0 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4642936500856438790', time=2024-09-12T03:01:50.890195+0000, chain.objs.size()=1 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.L-nNq4Cx0Ahw4hsHkOstoR3kHSCPbr1_0 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5290973180462379111', time=2024-09-12T03:01:50.904467+0000, chain.objs.size()=1 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._CqZ21KuRTxtL-faZaPpvf-6O6F-CaJ_0 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7975007075259702197', time=2024-09-12T03:01:50.937140+0000, chain.objs.size()=1 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tXHEL9aXGof9dwmptIojSHk0QKKaFsG_0 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6330837449765571336', time=2024-09-12T03:01:50.975716+0000, chain.objs.size()=1 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DUzetfPdjBUr4ntYuP20A7CoZqMQqa0_0 2024-09-12T01:11:23.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10498646678083171496', time=2024-09-12T03:01:50.997012+0000, chain.objs.size()=1 2024-09-12T01:11:23.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.31lHXS098HIQyJNgoX9HKT0_Kr6WPcZ_0 2024-09-12T01:11:23.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3700686207515189076', time=2024-09-12T03:01:51.087372+0000, chain.objs.size()=1 2024-09-12T01:11:23.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.423+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.av-vRWhbq2gBu4Ux3DPbsfASqmY4tb1_0 2024-09-12T01:11:23.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.424+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9561314439954669987', time=2024-09-12T03:01:51.092377+0000, chain.objs.size()=1 2024-09-12T01:11:23.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.424+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.flXCekz0DaPGkBUdkqk3C6IvDJ8TIHR_0 2024-09-12T01:11:23.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.426+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16327582755970450722', time=2024-09-12T03:01:51.107761+0000, chain.objs.size()=1 2024-09-12T01:11:23.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.426+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ERtEu0tfd2fYUkXK-_Z4fPB72F0eO3Q_0 2024-09-12T01:11:23.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.426+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10332026799475687794', time=2024-09-12T03:01:51.215938+0000, chain.objs.size()=1 2024-09-12T01:11:23.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.426+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4FvpWHdHQPljqvnojii2l16VXNQFdXz_0 2024-09-12T01:11:23.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.426+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14968336378076320959', time=2024-09-12T03:01:51.220425+0000, chain.objs.size()=1 2024-09-12T01:11:23.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.426+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CHTQrF82rkENsZkijw-Eh9YKntNZ9PS_0 2024-09-12T01:11:23.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16839467823095337600', time=2024-09-12T03:01:51.226348+0000, chain.objs.size()=1 2024-09-12T01:11:23.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.C8MCYE6HF-1vLK3sXxm6SSgUXULa_mh_0 2024-09-12T01:11:23.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16394244870178935099', time=2024-09-12T03:01:51.236397+0000, chain.objs.size()=1 2024-09-12T01:11:23.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.G0m5zoXPvZRwXqc5jZowAbOQu670K0m_0 2024-09-12T01:11:23.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.429+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1811853725868688632', time=2024-09-12T03:01:51.266445+0000, chain.objs.size()=1 2024-09-12T01:11:23.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.429+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.O-zwu14oOrlMxgX3GaY4fwi9dui1lLp_0 2024-09-12T01:11:23.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47562 2024-09-12T01:11:23.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:11:23.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17906388777027592669', time=2024-09-12T03:01:51.473878+0000, chain.objs.size()=1 2024-09-12T01:11:23.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.EzZARRYO3PNqsoScNCIymk9MxtuwFkh_0 2024-09-12T01:11:23.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3179137560151267034', time=2024-09-12T03:01:51.644306+0000, chain.objs.size()=1 2024-09-12T01:11:23.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.phWTRbzP6THqSFdvchkNbGqj7kE2SkB_0 2024-09-12T01:11:23.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.172971167032646324', time=2024-09-12T03:01:51.645909+0000, chain.objs.size()=1 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6jRFAONwV-jYRj2jVhtUtNf2H7TnArj_0 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9690617860323225691', time=2024-09-12T03:01:51.672446+0000, chain.objs.size()=1 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LVt0JYznXDfmmW795erAmRsmNYH73Zw_0 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2579587062023617708', time=2024-09-12T03:01:51.697222+0000, chain.objs.size()=1 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.yByC0IS7tWNZJEFoWJB-7X26UAu5pCx_0 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17041455792910637442', time=2024-09-12T03:01:51.772096+0000, chain.objs.size()=1 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.onLCEzirgpptFzN2H9fgM8WE8_VIOA__0 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.161669252255398459', time=2024-09-12T03:01:52.248702+0000, chain.objs.size()=1 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.PYOpdFfzqJJEA5hy_Z5LGKuNnbAszda_0 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17906541724157372588', time=2024-09-12T03:01:52.258770+0000, chain.objs.size()=1 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-T0OQ25UCvp-FXBbkVyiWWUqtszvJ9p_0 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1495901516953948987', time=2024-09-12T03:01:52.328312+0000, chain.objs.size()=1 2024-09-12T01:11:23.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.es8usvu4SoYYBl9xqtE3v3BVEDZ221w_0 2024-09-12T01:11:23.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4740185324431354994', time=2024-09-12T03:01:56.362647+0000, chain.objs.size()=1 2024-09-12T01:11:23.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.334__shadow_.ceDiRDLy3ecjpnd1vnBMXO52bPSiUMz_0 2024-09-12T01:11:23.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7617175764218308268', time=2024-09-12T03:02:19.286744+0000, chain.objs.size()=1 2024-09-12T01:11:23.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.384__shadow_.YrjwAnpu8-_V7bKye3vBGCbYm4eSeMx_0 2024-09-12T01:11:23.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2239423076147596388', time=2024-09-12T03:02:22.584275+0000, chain.objs.size()=1 2024-09-12T01:11:23.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.391__shadow_.S2Jha2etdrPP19Uud8svXkiYrMPTIHk_0 2024-09-12T01:11:23.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.438+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10761577487360162317', time=2024-09-12T03:02:56.311987+0000, chain.objs.size()=1 2024-09-12T01:11:23.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.438+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.455__shadow_.wSOhIQg3Cw7Qvm36xpxgcDpdyrN4yCU_0 2024-09-12T01:11:23.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.439+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15912963095418978114', time=2024-09-12T03:03:10.082384+0000, chain.objs.size()=1 2024-09-12T01:11:23.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.439+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.Q1mwR8TEcWJSApQk_4ui0MuHjCB6ZC2_0 2024-09-12T01:11:23.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.439+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1348626970973402511', time=2024-09-12T03:04:42.912766+0000, chain.objs.size()=1 2024-09-12T01:11:23.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.439+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:UwT2OSkd4Wkao5QmUCP.Mvhl.RpnTil_.ZPLiZ75A-eJPxAHhsqkZ9TI7fYhvXa8_0 2024-09-12T01:11:23.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.439+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17894826864370483288', time=2024-09-12T03:04:51.458615+0000, chain.objs.size()=1 2024-09-12T01:11:23.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.439+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow:ZLKkjZXqFlEVO58KIha34qRyqSXGSr3_.6aYhXGFj0uCwI2T24AfAuDckMQeFUy-_0 2024-09-12T01:11:23.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.439+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2079991566609385149', time=2024-09-12T03:08:16.516960+0000, chain.objs.size()=1 2024-09-12T01:11:23.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.439+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.699__shadow:ukvsFHjMF3fGyxBY8wzARciyt9MSuzA_.8aaoFlgujslxprt5gJP4YOISV0NZmXB_0 2024-09-12T01:11:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.440+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.647770408877255592', time=2024-09-12T03:08:22.732030+0000, chain.objs.size()=1 2024-09-12T01:11:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.440+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.713__shadow:Jv9EnweUNnkCT55ee1JkjktchkmSFeh_.ESHmecapPVsEL-1oYtrXYqR22O10Wll_0 2024-09-12T01:11:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.440+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5738340429761240184', time=2024-09-12T03:08:53.143726+0000, chain.objs.size()=10 2024-09-12T01:11:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.440+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.1 2024-09-12T01:11:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.440+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.2 2024-09-12T01:11:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.440+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.3 2024-09-12T01:11:23.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.440+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.4 2024-09-12T01:11:23.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.440+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.5 2024-09-12T01:11:23.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.442+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.6 2024-09-12T01:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.443+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.7 2024-09-12T01:11:23.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.444+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.8 2024-09-12T01:11:23.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.445+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.9 2024-09-12T01:11:23.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.445+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.736__multipart_foo.2~KcKXoqEFnbUhQa_rjQXXo6owNJYSB9g.10 2024-09-12T01:11:23.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.449+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.451+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:11:23.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.453+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.453+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48906' 2024-09-12T01:11:23.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_zI4fqwzgjKMFpzo2Zb10U5s6g7Ew7aT', time=2024-09-12T02:58:54.008563+0000, chain.objs.size()=3 2024-09-12T01:11:23.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.i5QM874Y9uiyoCb4bnl7eQfSzAOK6zM_0 2024-09-12T01:11:23.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.i5QM874Y9uiyoCb4bnl7eQfSzAOK6zM_1 2024-09-12T01:11:23.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.i5QM874Y9uiyoCb4bnl7eQfSzAOK6zM_2 2024-09-12T01:11:23.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_N40zCjmlPDWjuihK3Gw4IEfPvmsZveh', time=2024-09-12T02:58:54.462883+0000, chain.objs.size()=1 2024-09-12T01:11:23.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.JTup9lt6t3y0AwLs_KsTANuee9iQXBQ_0 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13485095168721230398', time=2024-09-12T03:00:34.741493+0000, chain.objs.size()=1 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.231__shadow_.YgWY5tIoGoAcZ0TCJflGT4v3j8HFu1q_0 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12979149604662109327', time=2024-09-12T03:00:36.175106+0000, chain.objs.size()=1 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.234__shadow_.ceqPHwkUPuQLZY1J8zQ1v-LxujwQqyW_0 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16776211949550577221', time=2024-09-12T03:00:38.432904+0000, chain.objs.size()=1 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.238__shadow_._1TTZB4_WNQMv02-lFbSM133C8LDYNe_0 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4910601474882370619', time=2024-09-12T03:00:45.978806+0000, chain.objs.size()=1 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.252__shadow_.YRKWfqxiS3HxWizrge5Ukt2oNGbjF_v_0 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4084260991626065954', time=2024-09-12T03:00:46.455423+0000, chain.objs.size()=1 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.253__shadow_.ilH8Xmozj6fsTDqph-ri-1ALVpoMaYa_0 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5363635157531861766', time=2024-09-12T03:00:47.410122+0000, chain.objs.size()=1 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.255__shadow_.Zb_8nhlHnKlJMuj_CM92SeeC9AG0ST0_0 2024-09-12T01:11:23.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3451810928291469806', time=2024-09-12T03:00:58.989492+0000, chain.objs.size()=1 2024-09-12T01:11:23.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LqXXbnzaaPjLKK0dLiCSn5CblQ_38kU_0 2024-09-12T01:11:23.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14023139808603407118', time=2024-09-12T03:00:59.009161+0000, chain.objs.size()=1 2024-09-12T01:11:23.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.OQACT06M2DnVm93hR5E6C3uDZmZhE_c_0 2024-09-12T01:11:23.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.457+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4865706055896744000', time=2024-09-12T03:00:59.147923+0000, chain.objs.size()=1 2024-09-12T01:11:23.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.457+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.yopPTeSOF9kToi_wyOCrjmoeaNKyuAh_0 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11833286783182786678', time=2024-09-12T03:00:59.220250+0000, chain.objs.size()=1 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.utIVvIoTjjUJNCauFor_72m8oxRxoCV_0 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16853963023801388171', time=2024-09-12T03:00:59.247639+0000, chain.objs.size()=1 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8Kpeqg9gs1nXYyzs4Gaim8eU52Q6Z74_0 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4245663382590155109', time=2024-09-12T03:00:59.254686+0000, chain.objs.size()=1 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FSEYaxMzyz7kKWpncgffQIN-NCTQaZc_0 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13581796536448131059', time=2024-09-12T03:00:59.307959+0000, chain.objs.size()=1 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fa1GZXbSczdfBstCvGw_BH3BZhbst9W_0 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7933214029918700982', time=2024-09-12T03:00:59.399631+0000, chain.objs.size()=1 2024-09-12T01:11:23.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6ceOoInqVcwCy5yOwd1EZiO6QVY2f_w_0 2024-09-12T01:11:23.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12823428142676741608', time=2024-09-12T03:00:59.413393+0000, chain.objs.size()=1 2024-09-12T01:11:23.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Be5kt0OO8ItbixsCx8WB2A_S1vU-73k_0 2024-09-12T01:11:23.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17433818421608285643', time=2024-09-12T03:00:59.473390+0000, chain.objs.size()=1 2024-09-12T01:11:23.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.458+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rOIFDF42Wo4O-NGU11iwVKHqIfxEPux_0 2024-09-12T01:11:23.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2940575473611164487', time=2024-09-12T03:00:59.489539+0000, chain.objs.size()=1 2024-09-12T01:11:23.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Zk-_hT1u3ui9C4elLyPIOBXvm3v_K6V_0 2024-09-12T01:11:23.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15609409912017998098', time=2024-09-12T03:00:59.492900+0000, chain.objs.size()=1 2024-09-12T01:11:23.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dRln09cf9fq-EwPm63zUf20BtJX3bw8_0 2024-09-12T01:11:23.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5724678847928586024', time=2024-09-12T03:00:59.528894+0000, chain.objs.size()=1 2024-09-12T01:11:23.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sHwUtwky37T1D7lKei1WmjuDSKKERef_0 2024-09-12T01:11:23.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.462+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17824867404951245637', time=2024-09-12T03:00:59.738946+0000, chain.objs.size()=1 2024-09-12T01:11:23.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.462+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JIf3GZbk6zHBuBl-C7oAkItnF2JrEgJ_0 2024-09-12T01:11:23.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.463+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18166722957606691816', time=2024-09-12T03:00:59.794695+0000, chain.objs.size()=1 2024-09-12T01:11:23.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.463+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BiypkJveyKA8QNO3S4mpFmXz79XBYmX_0 2024-09-12T01:11:23.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11332813155505767924', time=2024-09-12T03:00:59.842139+0000, chain.objs.size()=1 2024-09-12T01:11:23.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3sgEMV2Ielw5JkWv5ETAAfpT74sLVQc_0 2024-09-12T01:11:23.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.846322053694985359', time=2024-09-12T03:00:59.994336+0000, chain.objs.size()=1 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.W4daGw5bFu-ZGpU8teeCiHhgWqIX7fe_0 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1290468438864226300', time=2024-09-12T03:00:59.995140+0000, chain.objs.size()=1 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mtbr8tu4_9VnPAcPsuRhAKCm5owo7Bj_0 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.357865686081161906', time=2024-09-12T03:01:00.014896+0000, chain.objs.size()=1 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.D6Kk3hnrqv83YL_ueut2eeiFA7kHRd6_0 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18308001916399641937', time=2024-09-12T03:01:00.020278+0000, chain.objs.size()=1 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.j6-DeSSIBZmKOzSQ3g9V2EH4xLkBB_5_0 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14187184428290006949', time=2024-09-12T03:01:00.246200+0000, chain.objs.size()=1 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.iKB9K6flWkRwvv-9-X7MERkkI01_JnW_0 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.464+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15216296746944479150', time=2024-09-12T03:01:00.351649+0000, chain.objs.size()=1 2024-09-12T01:11:23.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.465+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jv8asGhXOBkNj0MnFS5IhE4nc7bgtc-_0 2024-09-12T01:11:23.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.466+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5426466931949627828', time=2024-09-12T03:01:00.365577+0000, chain.objs.size()=1 2024-09-12T01:11:23.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.466+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.z7FNf5mUB_a7Vp8TOF74wtgnOyvdNMz_0 2024-09-12T01:11:23.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.466+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15709360046347887914', time=2024-09-12T03:01:00.389571+0000, chain.objs.size()=1 2024-09-12T01:11:23.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.466+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.51sLR_6jKe7lykRC2KyX2YQH_XQCoBk_0 2024-09-12T01:11:23.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.467+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4376431651672794297', time=2024-09-12T03:01:00.405199+0000, chain.objs.size()=1 2024-09-12T01:11:23.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.467+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uZmDhErRxxVkhwPkvWYN5br_oBOJLaL_0 2024-09-12T01:11:23.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.467+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17387703235250290518', time=2024-09-12T03:01:00.469946+0000, chain.objs.size()=1 2024-09-12T01:11:23.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.467+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Wve31ZOe_MNgV5Utmjz-Kys-Vy2HLBs_0 2024-09-12T01:11:23.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.468+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10786755800587895191', time=2024-09-12T03:01:00.502384+0000, chain.objs.size()=1 2024-09-12T01:11:23.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.468+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.YD5enrUrVtlg0DIIcr4ABjjC7t7s2zm_0 2024-09-12T01:11:23.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.468+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5840806921369588987', time=2024-09-12T03:01:00.859954+0000, chain.objs.size()=1 2024-09-12T01:11:23.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.468+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.PmgbXFY_FFklEd423wLPBKtR_eY6b4s_0 2024-09-12T01:11:23.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10720251864820294241', time=2024-09-12T03:01:00.916022+0000, chain.objs.size()=1 2024-09-12T01:11:23.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bzAAJIBwGypI1pwPWD2TJeM0-vug2By_0 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9073134150704083307', time=2024-09-12T03:01:00.929466+0000, chain.objs.size()=1 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.PSWfF7QZ-vTgdG9O9ZgfanCZHuHcv03_0 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14138844916797671754', time=2024-09-12T03:01:00.985454+0000, chain.objs.size()=1 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.P_XE2rS5vWuLYQ3qfMHMC3BDljDJPEi_0 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5847857126702216789', time=2024-09-12T03:01:11.331172+0000, chain.objs.size()=1 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.285__shadow_.D65nZtIKuCxki1HTIsWH-XpZx5vJKeK_0 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16955175954970240060', time=2024-09-12T03:01:15.848305+0000, chain.objs.size()=1 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.hf_nD7m4V-_6HxZushIMQlWhUTk1nl8_0 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9120831035570827358', time=2024-09-12T03:01:15.865211+0000, chain.objs.size()=1 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.whQ7xaG4a5InhxWJnuCWZBKa3PKxy7q_0 2024-09-12T01:11:23.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13741161896529871733', time=2024-09-12T03:01:16.651839+0000, chain.objs.size()=1 2024-09-12T01:11:23.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.K3KjISqeF-f0V7SWCmaih9_vZ4MgbU7_0 2024-09-12T01:11:23.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8866230610334076188', time=2024-09-12T03:01:40.159054+0000, chain.objs.size()=1 2024-09-12T01:11:23.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MF5DJWr91QhF4z6ccX-qJrKu2Oyu4Ru_0 2024-09-12T01:11:23.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18012623028115958914', time=2024-09-12T03:01:40.228116+0000, chain.objs.size()=1 2024-09-12T01:11:23.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.li0vr_9tX6cG6S1xRLgZHT0oKeYepTK_0 2024-09-12T01:11:23.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14731287087492932833', time=2024-09-12T03:01:40.409610+0000, chain.objs.size()=1 2024-09-12T01:11:23.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.C0uNQ2MZWqQo0FGhsTFKbPdmW6SOkJ5_0 2024-09-12T01:11:23.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6273845858665103478', time=2024-09-12T03:01:40.438837+0000, chain.objs.size()=1 2024-09-12T01:11:23.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.471+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NJDpzMNRR977MwY5xlt0N-KmtJMm4bi_0 2024-09-12T01:11:23.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.475+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8861704510461541797', time=2024-09-12T03:01:40.523765+0000, chain.objs.size()=1 2024-09-12T01:11:23.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.475+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GntzJ8bSSD4ncZbB_PH77atFsoQT5Q-_0 2024-09-12T01:11:23.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.476+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14925962715185292169', time=2024-09-12T03:01:40.550823+0000, chain.objs.size()=1 2024-09-12T01:11:23.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.476+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nl1VDes35g-nr2am8ilnSm4tW6Pad8t_0 2024-09-12T01:11:23.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.476+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13296811133742518782', time=2024-09-12T03:01:40.641650+0000, chain.objs.size()=1 2024-09-12T01:11:23.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.476+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.meJ_DQxUa6tFWObqqL7gqTSGl-lzY-S_0 2024-09-12T01:11:23.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11524775203773065659', time=2024-09-12T03:01:40.683732+0000, chain.objs.size()=1 2024-09-12T01:11:23.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dshVkTYgYx1oQ7F9lNm6iBn7r-6BR5m_0 2024-09-12T01:11:23.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11045962640066622499', time=2024-09-12T03:01:40.700869+0000, chain.objs.size()=1 2024-09-12T01:11:23.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.u5lSHEyfOmlMaIg-319xd4tNFsU7Dtl_0 2024-09-12T01:11:23.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3373719165978793124', time=2024-09-12T03:01:40.788202+0000, chain.objs.size()=1 2024-09-12T01:11:23.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Kp4NyT69fctlVWKmpy_KfNZB-8dW49m_0 2024-09-12T01:11:23.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10112667923982542933', time=2024-09-12T03:01:41.013053+0000, chain.objs.size()=1 2024-09-12T01:11:23.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bFk7tIKcsWATNLa8arJmtV6pCv2sEGF_0 2024-09-12T01:11:23.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7927301501606125308', time=2024-09-12T03:01:41.027868+0000, chain.objs.size()=1 2024-09-12T01:11:23.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZpK9KvEeSdruilzfCL7TPq_5AGYThBP_0 2024-09-12T01:11:23.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12555433632558779670', time=2024-09-12T03:01:41.033451+0000, chain.objs.size()=1 2024-09-12T01:11:23.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.djMATlLZE8-DJv1bR24yF_gfLGuLxIl_0 2024-09-12T01:11:23.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.223631596082213882', time=2024-09-12T03:01:41.063268+0000, chain.objs.size()=1 2024-09-12T01:11:23.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LtbZBbPrGYuK9PkxCFH4nPq8XOzM64g_0 2024-09-12T01:11:23.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11733087291837779961', time=2024-09-12T03:01:41.100176+0000, chain.objs.size()=1 2024-09-12T01:11:23.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.477+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.p3lDQnRk7I1RrfwSVInH88FoWsytwZV_0 2024-09-12T01:11:23.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.480+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11083059157751638790', time=2024-09-12T03:01:41.217860+0000, chain.objs.size()=1 2024-09-12T01:11:23.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.cZGe-VOqnCI4UCYl8us7bW_KbVFeY1B_0 2024-09-12T01:11:23.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2542588146086689814', time=2024-09-12T03:01:41.245544+0000, chain.objs.size()=1 2024-09-12T01:11:23.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rMWZahhN9eyi67nEOc-6LBEu80o0WTF_0 2024-09-12T01:11:23.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4600766167603317751', time=2024-09-12T03:01:41.303115+0000, chain.objs.size()=1 2024-09-12T01:11:23.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vOiFXPJoYCpkcsUoWrdkqIfcKLUk410_0 2024-09-12T01:11:23.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2167655021911730837', time=2024-09-12T03:01:41.454569+0000, chain.objs.size()=1 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ksGf9CITxm7YPuer-lfm2sTu57s0bwK_0 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3412078703842818600', time=2024-09-12T03:01:41.455405+0000, chain.objs.size()=1 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wVOv2y5MIecbBs3_Z_nDAo7M26v1ZSG_0 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14168502424193027787', time=2024-09-12T03:01:41.529450+0000, chain.objs.size()=1 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.euB15YfVE2ReYjy21EO0_K53nugfIP9_0 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5268973859400433775', time=2024-09-12T03:01:41.550859+0000, chain.objs.size()=1 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Q6IHnKePYE0kPZ69B4Jo25VYojM0qWd_0 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11317528462765645992', time=2024-09-12T03:01:41.572715+0000, chain.objs.size()=1 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7ST-p4u-3OnzbcGWf0ci9-vVPVa5nNG_0 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6616637111627979423', time=2024-09-12T03:01:41.790614+0000, chain.objs.size()=1 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1HRZkDKhiS8CH3Jkpqfs2MwiiVS7Dgg_0 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16409979210858957495', time=2024-09-12T03:01:41.817828+0000, chain.objs.size()=1 2024-09-12T01:11:23.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fZ6n2BEbUwBrz9kzC9fl5omoVR8wytR_0 2024-09-12T01:11:23.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6015429668723208504', time=2024-09-12T03:01:41.857058+0000, chain.objs.size()=1 2024-09-12T01:11:23.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.481+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sxMcVZcelNREudc9yhFmKSWAyNMMqvl_0 2024-09-12T01:11:23.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15684812494805760165', time=2024-09-12T03:01:41.887564+0000, chain.objs.size()=1 2024-09-12T01:11:23.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GJNS5nMzxI1VtKOFZdUo9lcaBMzDuhZ_0 2024-09-12T01:11:23.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9614714265679761918', time=2024-09-12T03:01:42.003796+0000, chain.objs.size()=1 2024-09-12T01:11:23.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kjToNY0i13SDk19XfKq5QF5y74WKn5L_0 2024-09-12T01:11:23.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.442132214429248257', time=2024-09-12T03:01:42.046484+0000, chain.objs.size()=1 2024-09-12T01:11:23.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.y6AP3oNsnK7TCjU5Othq46Dzr4DcDCO_0 2024-09-12T01:11:23.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15913333938682238484', time=2024-09-12T03:01:42.080763+0000, chain.objs.size()=1 2024-09-12T01:11:23.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4nLvP_CPztkHOA00dGKXLoTrwPg4tfB_0 2024-09-12T01:11:23.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1027328192458039395', time=2024-09-12T03:01:50.297814+0000, chain.objs.size()=1 2024-09-12T01:11:23.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.HcmtHAgaDwnacTxx6_A7IoEdyimb3G9_0 2024-09-12T01:11:23.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3190688103940978233', time=2024-09-12T03:01:50.302280+0000, chain.objs.size()=1 2024-09-12T01:11:23.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.v3X8ErxN_rgkGAU6j0DbkzB2yxK67Qp_0 2024-09-12T01:11:23.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4865617613238087648', time=2024-09-12T03:01:50.304835+0000, chain.objs.size()=1 2024-09-12T01:11:23.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xuKIXoZA6_RByFuFNrDGrhoEE2bIH-0_0 2024-09-12T01:11:23.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15660511628788168979', time=2024-09-12T03:01:50.545276+0000, chain.objs.size()=1 2024-09-12T01:11:23.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.487+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0JUTcK0aFeiTuNog9ewWROMjQ3i2hVH_0 2024-09-12T01:11:23.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.488+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12290185257972763619', time=2024-09-12T03:01:50.591353+0000, chain.objs.size()=1 2024-09-12T01:11:23.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.488+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1RBP-z2cyz7KP7zcp8I46hKfPQQ2nqe_0 2024-09-12T01:11:23.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.488+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12482563433845357329', time=2024-09-12T03:01:50.626173+0000, chain.objs.size()=1 2024-09-12T01:11:23.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.488+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4EK2dj0sNPS9b7uqoN3lfaV0iovXe6p_0 2024-09-12T01:11:23.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.488+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6150117448257892732', time=2024-09-12T03:01:50.943093+0000, chain.objs.size()=1 2024-09-12T01:11:23.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.488+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7UA7aHY5dI0NAG8KYA4DNvPzAfmBBsW_0 2024-09-12T01:11:23.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.491+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4872835791761148204', time=2024-09-12T03:01:50.980923+0000, chain.objs.size()=1 2024-09-12T01:11:23.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.491+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.g5v4NvL00143kn3elSnSCnass1Gzu6H_0 2024-09-12T01:11:23.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.491+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3941473596302337808', time=2024-09-12T03:01:51.000688+0000, chain.objs.size()=1 2024-09-12T01:11:23.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.491+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.E6U88YBs3zDQT2K0lwqaO6DTvhi42Ab_0 2024-09-12T01:11:23.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2582433073506631719', time=2024-09-12T03:01:51.463617+0000, chain.objs.size()=1 2024-09-12T01:11:23.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._myj2iB-pbH-XzE-YhOPz4yS5lTDpzv_0 2024-09-12T01:11:23.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6032298624087637050', time=2024-09-12T03:01:51.520645+0000, chain.objs.size()=1 2024-09-12T01:11:23.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.aDH40aifMZFoWC8jEEMaoHEuvAzQ3A9_0 2024-09-12T01:11:23.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16376322671069781832', time=2024-09-12T03:01:51.527679+0000, chain.objs.size()=1 2024-09-12T01:11:23.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lUBILsUic20xhVPk9dpIFdC0NuXwDsp_0 2024-09-12T01:11:23.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16764785486189556715', time=2024-09-12T03:01:51.722236+0000, chain.objs.size()=1 2024-09-12T01:11:23.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oxnWR6aVhLppHYQo3H_SWYmdi-_5zm9_0 2024-09-12T01:11:23.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15009469885225663655', time=2024-09-12T03:01:51.725943+0000, chain.objs.size()=1 2024-09-12T01:11:23.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Esw0TbbnF8-FlvT-ssToPSakb_6IsFF_0 2024-09-12T01:11:23.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17681579362846875989', time=2024-09-12T03:01:51.826751+0000, chain.objs.size()=1 2024-09-12T01:11:23.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.2nECleyNZ98TABHaD6sW7mR-IVNgTBC_0 2024-09-12T01:11:23.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16814013403586845257', time=2024-09-12T03:01:51.914274+0000, chain.objs.size()=1 2024-09-12T01:11:23.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.492+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.5Wkyy0qnvWu5LiGND1nYSgCdrBRiiu0_0 2024-09-12T01:11:23.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.493+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8407489472780284955', time=2024-09-12T03:01:51.922077+0000, chain.objs.size()=1 2024-09-12T01:11:23.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.493+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FfnmhElRPYOUfd_T3N9Zhhf2jZnj0yO_0 2024-09-12T01:11:23.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.493+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.144939723357897744', time=2024-09-12T03:01:52.023691+0000, chain.objs.size()=1 2024-09-12T01:11:23.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.493+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.r9YCdIP4kVQNIk2QflDCcU4V48EinRP_0 2024-09-12T01:11:23.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11286026797946160379', time=2024-09-12T03:01:52.091836+0000, chain.objs.size()=1 2024-09-12T01:11:23.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lNy091E0e5_DeVQcoCo54woprkwz9OB_0 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3070955006456785715', time=2024-09-12T03:01:52.097946+0000, chain.objs.size()=1 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LL5GjWbHFI1SHcL-2AWVf0EDktbrTLv_0 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6845694953872640788', time=2024-09-12T03:01:52.188857+0000, chain.objs.size()=1 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-AzhVNlxy1ObPA5FtON2XmMcGzRrSBq_0 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1508627746374246767', time=2024-09-12T03:01:52.206469+0000, chain.objs.size()=1 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Rhby4DcgcoP6EtT5o38pnzPbh9nngaq_0 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11348490671176286681', time=2024-09-12T03:02:22.584381+0000, chain.objs.size()=1 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.391__shadow_.WkvPz2UCCC0w0ciHr3r7dH2IsaBkuEa_0 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2594764671801151248', time=2024-09-12T03:03:03.750273+0000, chain.objs.size()=1 2024-09-12T01:11:23.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.498+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.466__shadow_.ZkPIrRMEaH6O1rckhJd8PaOUzjq8zdz_0 2024-09-12T01:11:23.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.499+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16796564567265078127', time=2024-09-12T03:03:10.082739+0000, chain.objs.size()=1 2024-09-12T01:11:23.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.499+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.H6yZ9vReyIgVrGcvm_JWdizbrvR4rbH_0 2024-09-12T01:11:23.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.499+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5351977378307013206', time=2024-09-12T03:03:12.237541+0000, chain.objs.size()=1 2024-09-12T01:11:23.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.499+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.488__shadow_.PzIqFoAFJh0FNYMTL9xM43DyFWd_ME8_0 2024-09-12T01:11:23.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.499+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10330541740634841127', time=2024-09-12T03:03:13.460112+0000, chain.objs.size()=1 2024-09-12T01:11:23.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.499+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.490__shadow_.7FCpMx0fHh9EK1Hct15LJcu5jTMouiB_0 2024-09-12T01:11:23.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.504+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48906 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1890183145614014271', time=2024-09-12T03:03:38.886352+0000, chain.objs.size()=6 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~NCzFz2Dn0SQDzIPmD6w93dNMJVxBDMQ.1 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~NCzFz2Dn0SQDzIPmD6w93dNMJVxBDMQ.2 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.M-J3jndaKBEECpv_Dp-iwWwv07EwPwpG.3 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~NCzFz2Dn0SQDzIPmD6w93dNMJVxBDMQ.4 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~NCzFz2Dn0SQDzIPmD6w93dNMJVxBDMQ.5 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~NCzFz2Dn0SQDzIPmD6w93dNMJVxBDMQ.6 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14706922618954425146', time=2024-09-12T03:04:51.738461+0000, chain.objs.size()=1 2024-09-12T01:11:23.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow:.9rGhXHUECYt.D7p9F9dBcJLmQI0nPB_.ongXFxounvv-6YM-1ZyL7j5Q_8H6uv1_0 2024-09-12T01:11:23.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3579771989076797046', time=2024-09-12T03:07:46.617532+0000, chain.objs.size()=1 2024-09-12T01:11:23.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.506+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.634__shadow_.DmRuYD-is4-edW3IHJzu9zQ1MlMTdAq_0 2024-09-12T01:11:23.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.507+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3021677133903959487', time=2024-09-12T03:08:00.968553+0000, chain.objs.size()=6 2024-09-12T01:11:23.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.507+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.661__multipart_bar.2~CrCazA91yUyqkkKwNYv5qqCn2gPPjbA.1 2024-09-12T01:11:23.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.507+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.661__multipart_bar.2~CrCazA91yUyqkkKwNYv5qqCn2gPPjbA.2 2024-09-12T01:11:23.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.507+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.661__multipart_bar.2~CrCazA91yUyqkkKwNYv5qqCn2gPPjbA.3 2024-09-12T01:11:23.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.507+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.661__multipart_bar.2~CrCazA91yUyqkkKwNYv5qqCn2gPPjbA.4 2024-09-12T01:11:23.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.509+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.661__multipart_bar.2~CrCazA91yUyqkkKwNYv5qqCn2gPPjbA.5 2024-09-12T01:11:23.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.510+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.661__multipart_bar.2~CrCazA91yUyqkkKwNYv5qqCn2gPPjbA.6 2024-09-12T01:11:23.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.512+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7975246528002729862', time=2024-09-12T03:08:01.167156+0000, chain.objs.size()=6 2024-09-12T01:11:23.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.512+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.663__multipart_foo.2~vLgDWR1x-uCZxXTlEwMJsAEMmjABE7_.1 2024-09-12T01:11:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.513+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.663__multipart_foo.2~vLgDWR1x-uCZxXTlEwMJsAEMmjABE7_.2 2024-09-12T01:11:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.513+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.663__multipart_foo.2~vLgDWR1x-uCZxXTlEwMJsAEMmjABE7_.3 2024-09-12T01:11:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.513+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.663__multipart_foo.2~vLgDWR1x-uCZxXTlEwMJsAEMmjABE7_.4 2024-09-12T01:11:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.513+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.663__multipart_foo.2~vLgDWR1x-uCZxXTlEwMJsAEMmjABE7_.5 2024-09-12T01:11:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.513+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.663__multipart_foo.2~vLgDWR1x-uCZxXTlEwMJsAEMmjABE7_.6 2024-09-12T01:11:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.513+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13813945346962495139', time=2024-09-12T03:08:16.078120+0000, chain.objs.size()=1 2024-09-12T01:11:23.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.513+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.698__shadow:50Sasyf7owmFvsVWeZ2lw87YPaS.b6E_.79hRn0oq0XQo0yBQ0WwR5thK0SRU_ll_0 2024-09-12T01:11:23.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.513+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9170252992519063974', time=2024-09-12T03:10:46.115892+0000, chain.objs.size()=1 2024-09-12T01:11:23.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.513+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.783__shadow_.updIUS0y3XtAy3Xmrg9uvGwMr5L-abf_0 2024-09-12T01:11:23.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.518+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.520+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:11:23.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58773' 2024-09-12T01:11:23.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14384065678535261178', time=2024-09-12T02:58:47.599533+0000, chain.objs.size()=1 2024-09-12T01:11:23.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.148__shadow_.46Z8ep1SXL4EFZ5qc_adG2qVb11JOwM_0 2024-09-12T01:11:23.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5798875789601942613', time=2024-09-12T02:58:51.395648+0000, chain.objs.size()=1 2024-09-12T01:11:23.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.158__shadow:j-RkKHywykyQed4hILcoGuDyv2TVhAj_.0nAvNmmdfKtt5OxprsrFKpeAW6xQkZ1_0 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9812325537229059385', time=2024-09-12T03:00:41.062247+0000, chain.objs.size()=1 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.243__shadow_.OMU1rZyoOlLMuWiJ73uCYYNqeNjTBbH_0 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16407464500713329153', time=2024-09-12T03:00:58.866089+0000, chain.objs.size()=1 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.AjEiA5-NMk6vU6SeXp5zGqp8UHk4TkS_0 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11808960419892333829', time=2024-09-12T03:00:58.880199+0000, chain.objs.size()=1 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qbtEGcmuGo1wH3GYhaQtCrriWRFXyUV_0 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.660271730575093876', time=2024-09-12T03:00:58.920937+0000, chain.objs.size()=1 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BvelceFxdAiDijfebgxSw8QMea6vJUZ_0 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10718875216097315920', time=2024-09-12T03:00:58.944384+0000, chain.objs.size()=1 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.pJPotDsU7L4SjGnIvItxk7m55VzjI75_0 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18433307966539745439', time=2024-09-12T03:00:58.961406+0000, chain.objs.size()=1 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UVSQ0_CxeZQpFf2yXbTxLhF97oGIf44_0 2024-09-12T01:11:23.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3324454141921160389', time=2024-09-12T03:00:58.962013+0000, chain.objs.size()=1 2024-09-12T01:11:23.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZfysM3hFNUdKQ6xcAG-eDXDXjtmV101_0 2024-09-12T01:11:23.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.783217190234596293', time=2024-09-12T03:00:58.966583+0000, chain.objs.size()=1 2024-09-12T01:11:23.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.gLhQ-i5s31dxb4bSOMsq9iSEZVH-Fbc_0 2024-09-12T01:11:23.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9359032947629936846', time=2024-09-12T03:00:59.035825+0000, chain.objs.size()=1 2024-09-12T01:11:23.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-RDcy76Ov4u-SioDw2T4qbOwLnn_2nO_0 2024-09-12T01:11:23.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6575243142738694169', time=2024-09-12T03:00:59.169152+0000, chain.objs.size()=1 2024-09-12T01:11:23.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.X9SQIWhCBV9o3-gPHgnk0E50hgsnf3V_0 2024-09-12T01:11:23.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.527+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7903316423382680931', time=2024-09-12T03:00:59.179369+0000, chain.objs.size()=1 2024-09-12T01:11:23.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.527+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.osweaYwTttmVjsbFq4tA6U_woLS3WCO_0 2024-09-12T01:11:23.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.527+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4968827552323311845', time=2024-09-12T03:00:59.224821+0000, chain.objs.size()=1 2024-09-12T01:11:23.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.527+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vMOtk6Z1b70z2nNrs6Oxu-y6utCp-RJ_0 2024-09-12T01:11:23.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7734931073915166022', time=2024-09-12T03:00:59.244953+0000, chain.objs.size()=1 2024-09-12T01:11:23.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JSSNCGNhnYXk6vCVjKjiQ_aUUtWlW6P_0 2024-09-12T01:11:23.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2525447802499997040', time=2024-09-12T03:00:59.395760+0000, chain.objs.size()=1 2024-09-12T01:11:23.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.QFpY_vnO0DwpFTVHty8fXrY31x7gHqn_0 2024-09-12T01:11:23.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8008814781900765436', time=2024-09-12T03:00:59.407351+0000, chain.objs.size()=1 2024-09-12T01:11:23.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.W7W15rDvtrcfpKbsTisF3uEWmq6hxT9_0 2024-09-12T01:11:23.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4277110554585629041', time=2024-09-12T03:00:59.515201+0000, chain.objs.size()=1 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Ixu_Rold-1GR1SFwhBCa1nZKxGzMEbs_0 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13190286830505451286', time=2024-09-12T03:00:59.674489+0000, chain.objs.size()=1 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cVyrPtSCqamBgbU7fakDecHuvZHq_WD_0 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.529+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7552883105372294960', time=2024-09-12T03:00:59.715399+0000, chain.objs.size()=1 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.529+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Ixpd-iVDIl9OMJMWOfqxqv_ADoUrBai_0 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.529+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12958897541508836499', time=2024-09-12T03:00:59.744656+0000, chain.objs.size()=1 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.529+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xK6Yzcf69sbVOxQEFe4aG6b4A3c6xMM_0 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.529+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14735104155730851608', time=2024-09-12T03:00:59.806554+0000, chain.objs.size()=1 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.529+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jJdrRfJwh0m5aeE-8TJWxUC6yYBI6Zy_0 2024-09-12T01:11:23.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.529+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10370115685710104421', time=2024-09-12T03:00:59.831837+0000, chain.objs.size()=1 2024-09-12T01:11:23.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.529+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2XD-0jVznKk28YhGUIDytqndVQcNuhF_0 2024-09-12T01:11:23.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.532+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5922270699631287012', time=2024-09-12T03:00:59.840704+0000, chain.objs.size()=1 2024-09-12T01:11:23.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.532+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bXCLQigioSf9zZJHK2KK064_Q0p0BeE_0 2024-09-12T01:11:23.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.532+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2860244989321094017', time=2024-09-12T03:00:59.942094+0000, chain.objs.size()=1 2024-09-12T01:11:23.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.532+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FlyHodMDagia89VqZLxTrd5gzbn-GrD_0 2024-09-12T01:11:23.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.532+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11232728201097421962', time=2024-09-12T03:00:59.960619+0000, chain.objs.size()=1 2024-09-12T01:11:23.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.532+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5btm2fvEUOJmE0ZUAI0gzdX0L-ssnvt_0 2024-09-12T01:11:23.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.532+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12438460028059367505', time=2024-09-12T03:00:59.973998+0000, chain.objs.size()=1 2024-09-12T01:11:23.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.532+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.yoOcigG1DxWR-_Xdo4O9igDWGzlz7J-_0 2024-09-12T01:11:23.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5250979420523525235', time=2024-09-12T03:01:00.012217+0000, chain.objs.size()=1 2024-09-12T01:11:23.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jpfsIbuvLzOzLBNQi57T1eEOiJhDQD3_0 2024-09-12T01:11:23.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6855538507534673682', time=2024-09-12T03:01:00.042690+0000, chain.objs.size()=1 2024-09-12T01:11:23.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Iyw_Ni_AaDhUdU0vuHThhAXisPPqDxH_0 2024-09-12T01:11:23.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17035079148947643055', time=2024-09-12T03:01:00.073343+0000, chain.objs.size()=1 2024-09-12T01:11:23.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UnhBh1ZuQk7AXNANJlJ5FGqfvmi42IY_0 2024-09-12T01:11:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.534+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2995823872021317366', time=2024-09-12T03:01:00.443491+0000, chain.objs.size()=1 2024-09-12T01:11:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.534+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qjHOHuKYEOt-kyYrFdwL_Cx56u3ADiC_0 2024-09-12T01:11:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.534+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15354687120057934535', time=2024-09-12T03:01:00.446256+0000, chain.objs.size()=1 2024-09-12T01:11:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.534+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.meo1RxyElbJz4IIUU_RSet9vgQZ43s0_0 2024-09-12T01:11:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.534+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18376306806177259013', time=2024-09-12T03:01:00.488437+0000, chain.objs.size()=1 2024-09-12T01:11:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.534+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-kz56ImRSWdKHz8_VmQixE-JOmFSrxM_0 2024-09-12T01:11:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.534+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8371706151622362194', time=2024-09-12T03:01:00.596845+0000, chain.objs.size()=1 2024-09-12T01:11:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.534+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.u35YgW9qKiGoqcuBUEugPy3dtfBJ7Jd_0 2024-09-12T01:11:23.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.536+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15806568370211760991', time=2024-09-12T03:01:00.617919+0000, chain.objs.size()=1 2024-09-12T01:11:23.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.536+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.kDYg6fg2kXjpyR9FwKDgL0kXiM9OjUj_0 2024-09-12T01:11:23.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.536+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11400493912931695092', time=2024-09-12T03:01:00.671305+0000, chain.objs.size()=1 2024-09-12T01:11:23.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.536+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TKVkA7PRMpmX2851N9S1s0hn0i660kV_0 2024-09-12T01:11:23.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.536+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10479643242560871847', time=2024-09-12T03:01:00.686563+0000, chain.objs.size()=1 2024-09-12T01:11:23.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.536+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._ui8ixOcdf-QvcYJJV_Yt--5kkmUL43_0 2024-09-12T01:11:23.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.536+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13555259196886137182', time=2024-09-12T03:01:00.692599+0000, chain.objs.size()=1 2024-09-12T01:11:23.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.536+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.11Qsw2_CVwy35hwfHTppaNB78zIp0u2_0 2024-09-12T01:11:23.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.537+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17626812487725830647', time=2024-09-12T03:01:00.762939+0000, chain.objs.size()=1 2024-09-12T01:11:23.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.537+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VtHc1gA3jEHzmPFYxm8y5Czu8rXnmu-_0 2024-09-12T01:11:23.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.540+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17560355597250653568', time=2024-09-12T03:01:00.865129+0000, chain.objs.size()=1 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.540+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5Dqii4kNYl2_5b35O7-IBYibFMrofMI_0 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.540+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3135443489426623540', time=2024-09-12T03:01:00.895846+0000, chain.objs.size()=1 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.540+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.doeb4EL9dc7buU0ggUFNVCWSsm-Q_mF_0 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1930529269574713646', time=2024-09-12T03:01:00.942107+0000, chain.objs.size()=1 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.zPj64cCw2QbBkHUOdHth5mwZJmbeAWk_0 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.155821703011529659', time=2024-09-12T03:01:01.434792+0000, chain.objs.size()=1 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.264__shadow_.ohIpUx3qvAqumDF4K1J2ncOFj0ZiYpG_0 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11478778868680141366', time=2024-09-12T03:01:05.629839+0000, chain.objs.size()=1 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.273__shadow_.31GYHRjChZsBRANAe3A_hBKUc8SLtKT_0 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11657810395809047431', time=2024-09-12T03:01:06.547844+0000, chain.objs.size()=1 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.275__shadow_.1JQ3IRWpULhJuROlKuWjHqUY2rsXAqZ_0 2024-09-12T01:11:23.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1861163733618293552', time=2024-09-12T03:01:13.838797+0000, chain.objs.size()=1 2024-09-12T01:11:23.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.290__shadow_.nA01QFZpP6H-Y_jc7O0fhzzhlyvO_an_0 2024-09-12T01:11:23.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.44581572531906128', time=2024-09-12T03:01:15.846578+0000, chain.objs.size()=1 2024-09-12T01:11:23.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.541+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.Ahaun3g5viW3ghRF1Ee1FpTrI5D-F8G_0 2024-09-12T01:11:23.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.542+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15833765041805369899', time=2024-09-12T03:01:16.638648+0000, chain.objs.size()=1 2024-09-12T01:11:23.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.542+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_._IqQHu5Y1Wr_QyjZ8l3Jrdr6tD-mL83_0 2024-09-12T01:11:23.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.542+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17333326421374059443', time=2024-09-12T03:01:21.060806+0000, chain.objs.size()=1 2024-09-12T01:11:23.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.542+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.303__shadow_.ReeyaRnqYELv0jUYDV0WZIy5aCb_rL__0 2024-09-12T01:11:23.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.544+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4951368745156924630', time=2024-09-12T03:01:21.995564+0000, chain.objs.size()=1 2024-09-12T01:11:23.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.544+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.305__shadow_.RG1rnEhTxePmModbMMubgleTE1FaDHt_0 2024-09-12T01:11:23.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.545+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14778565471766363538', time=2024-09-12T03:01:40.110600+0000, chain.objs.size()=1 2024-09-12T01:11:23.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.545+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.95l__g3P3WTblx3YprlxQ0ZCvHXEhqn_0 2024-09-12T01:11:23.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.545+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3453750836318297297', time=2024-09-12T03:01:40.116447+0000, chain.objs.size()=1 2024-09-12T01:11:23.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.545+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1kg6l-i7dqIWzNFO5D23k-QZf9IW0gl_0 2024-09-12T01:11:23.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.545+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5592873097754513523', time=2024-09-12T03:01:40.171593+0000, chain.objs.size()=1 2024-09-12T01:11:23.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.545+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.J7SIC9roRGZFPNvAklnxc3Vfwp0GUpX_0 2024-09-12T01:11:23.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.545+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15640486805542847605', time=2024-09-12T03:01:40.286676+0000, chain.objs.size()=1 2024-09-12T01:11:23.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.545+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.T-Ff53Vfu-1HFntAH1Y38x5Bk8-pHSN_0 2024-09-12T01:11:23.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.546+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5863916016978200622', time=2024-09-12T03:01:40.408558+0000, chain.objs.size()=1 2024-09-12T01:11:23.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.546+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WujB47lYn-bTQ-fiuGt6BuM3m6U4Wjp_0 2024-09-12T01:11:23.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.546+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1496050044527796632', time=2024-09-12T03:01:40.440802+0000, chain.objs.size()=1 2024-09-12T01:11:23.545 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.546+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.gLYwMJaKJXlzEUnpknruuE4UODUC6YK_0 2024-09-12T01:11:23.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.548+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12876435712411556306', time=2024-09-12T03:01:40.443723+0000, chain.objs.size()=1 2024-09-12T01:11:23.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.548+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.H0xufY7NojZ-_OcbS-vIl1uDDzGh4D6_0 2024-09-12T01:11:23.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.548+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13356368859034445714', time=2024-09-12T03:01:40.492460+0000, chain.objs.size()=1 2024-09-12T01:11:23.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.548+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.VsMvpqVWYwz1BrO4l6cH4U4cZXi1Vi6_0 2024-09-12T01:11:23.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.548+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15072754329116433940', time=2024-09-12T03:01:40.651604+0000, chain.objs.size()=1 2024-09-12T01:11:23.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.548+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uajJzXobIckXJ5FjNY9z_t8ZufwjEkK_0 2024-09-12T01:11:23.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.548+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8228140695409440394', time=2024-09-12T03:01:40.660253+0000, chain.objs.size()=1 2024-09-12T01:11:23.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.548+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.i8hGbhH7d4miUFvzSyHhqlmcqWzDRwj_0 2024-09-12T01:11:23.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2257862809980953549', time=2024-09-12T03:01:40.755344+0000, chain.objs.size()=1 2024-09-12T01:11:23.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KZr-CKbpsKtkbWP0ZDfAfI9VnlU75pg_0 2024-09-12T01:11:23.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4365119233470830809', time=2024-09-12T03:01:40.810977+0000, chain.objs.size()=1 2024-09-12T01:11:23.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4bch5dx2crlRCb3kekYDcGxEzYEE4Bc_0 2024-09-12T01:11:23.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7385030894367275443', time=2024-09-12T03:01:40.959977+0000, chain.objs.size()=1 2024-09-12T01:11:23.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ynFJ7nkoDueliINo0N0Nvd83NxhumIo_0 2024-09-12T01:11:23.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6095922151857468288', time=2024-09-12T03:01:41.015540+0000, chain.objs.size()=1 2024-09-12T01:11:23.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.xHYHOdG3neE3sRE8-KLCbeeGHjVSgG8_0 2024-09-12T01:11:23.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6872643657883925886', time=2024-09-12T03:01:41.037036+0000, chain.objs.size()=1 2024-09-12T01:11:23.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Wi8osvvErjtYBk57WdzPElaydB3Z0de_0 2024-09-12T01:11:23.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10066163333514888965', time=2024-09-12T03:01:41.175148+0000, chain.objs.size()=1 2024-09-12T01:11:23.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.550+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ac8X_sjwXdZKDhsNIMfWFftf9AWBYG5_0 2024-09-12T01:11:23.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.551+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13662249774011595462', time=2024-09-12T03:01:41.190705+0000, chain.objs.size()=1 2024-09-12T01:11:23.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.551+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1G8op_4xMRz9cXIylRb2bVoKR4H-LsK_0 2024-09-12T01:11:23.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.552+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7620518290691092209', time=2024-09-12T03:01:41.270606+0000, chain.objs.size()=1 2024-09-12T01:11:23.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.552+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lAL2q39c_cvLZlNl2VQnUjDcvSqlK9v_0 2024-09-12T01:11:23.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.552+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6948237157756977365', time=2024-09-12T03:01:41.280004+0000, chain.objs.size()=1 2024-09-12T01:11:23.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.552+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Q26ufAAyPz2S1yTkBzva--0QpZ1pzpB_0 2024-09-12T01:11:23.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.552+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12049009611841197946', time=2024-09-12T03:01:41.339550+0000, chain.objs.size()=1 2024-09-12T01:11:23.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.552+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.UkNTkUn2PntunW35d34HPewoH7G6gz__0 2024-09-12T01:11:23.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.552+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.585993677809610671', time=2024-09-12T03:01:41.448448+0000, chain.objs.size()=1 2024-09-12T01:11:23.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.552+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eeprfeia7neACJHaz5vwexUS-SE2ngL_0 2024-09-12T01:11:23.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5084255239966539776', time=2024-09-12T03:01:41.495772+0000, chain.objs.size()=1 2024-09-12T01:11:23.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZH5knx0b9_S7J8YaytSelMakNpx7ozF_0 2024-09-12T01:11:23.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17604829940789923694', time=2024-09-12T03:01:41.522277+0000, chain.objs.size()=1 2024-09-12T01:11:23.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.685TLRMAK0lyt4Hig3EckFr-DdHOBBy_0 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12588849628674697544', time=2024-09-12T03:01:41.718636+0000, chain.objs.size()=1 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KjAA4z74A45R-zXb8XRYDZeyoq6DS81_0 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9264790513019381952', time=2024-09-12T03:01:41.808403+0000, chain.objs.size()=1 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.DEGwKUrZJpLm5VTLr_gPPl_kHD8Sai1_0 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1416415887259661830', time=2024-09-12T03:01:41.995251+0000, chain.objs.size()=1 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5jA9g5y4XH5eookHhl8ng6YkXvdJZOX_0 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17838364108141603010', time=2024-09-12T03:01:42.009606+0000, chain.objs.size()=1 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.H1rPXyfAgAxcKVSB19nGeVZZ9Ek_0nh_0 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5770973588946956932', time=2024-09-12T03:01:42.073522+0000, chain.objs.size()=1 2024-09-12T01:11:23.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.usZSbBUgeL2BqG9tdcCOH6sg3d24dyD_0 2024-09-12T01:11:23.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8530825811882274232', time=2024-09-12T03:01:50.227006+0000, chain.objs.size()=1 2024-09-12T01:11:23.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0cpT4gRECOVOSOntktsNCMTvjuTLG89_0 2024-09-12T01:11:23.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14638335564797270688', time=2024-09-12T03:01:50.253421+0000, chain.objs.size()=1 2024-09-12T01:11:23.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.s0X1BQW2JjFkOT-hP3PzGGNk5cJhaui_0 2024-09-12T01:11:23.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9084235211911445729', time=2024-09-12T03:01:50.306593+0000, chain.objs.size()=1 2024-09-12T01:11:23.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DRHJwkyok1CH_gyDsmVVE1ac-LN1K5v_0 2024-09-12T01:11:23.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16665204739117603329', time=2024-09-12T03:01:50.533047+0000, chain.objs.size()=1 2024-09-12T01:11:23.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4FkcjVkJJu6gknqycNQTlTgwZ7G2SKw_0 2024-09-12T01:11:23.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.558+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1151697958170573109', time=2024-09-12T03:01:50.548116+0000, chain.objs.size()=1 2024-09-12T01:11:23.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.558+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JqLdYRicEfbg6F6ysuo_IEJF_RUnCCg_0 2024-09-12T01:11:23.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.558+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.486088724741751522', time=2024-09-12T03:01:50.656157+0000, chain.objs.size()=1 2024-09-12T01:11:23.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.558+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KCvAT3L9222h21zs42shkRSKO31WE9T_0 2024-09-12T01:11:23.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12569165306658719297', time=2024-09-12T03:01:50.719651+0000, chain.objs.size()=1 2024-09-12T01:11:23.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.t6Wo0FaeN3RCJYSL_YIYpEDCVstWGQR_0 2024-09-12T01:11:23.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10488392943244596984', time=2024-09-12T03:01:50.728621+0000, chain.objs.size()=1 2024-09-12T01:11:23.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.88IsGuIjuuIoaabvc2QyaNzwyF2hW8F_0 2024-09-12T01:11:23.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10055955035490899027', time=2024-09-12T03:01:50.824379+0000, chain.objs.size()=1 2024-09-12T01:11:23.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pDZeEXkf3kUT9Kkoi4Fjwb-GUyVwjED_0 2024-09-12T01:11:23.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10668850150826807460', time=2024-09-12T03:01:50.831436+0000, chain.objs.size()=1 2024-09-12T01:11:23.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Q6njbyuaevM9Z8hEkdl_6Jw9SmGdqEA_0 2024-09-12T01:11:23.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15873879506302185546', time=2024-09-12T03:01:50.850919+0000, chain.objs.size()=1 2024-09-12T01:11:23.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vioEaIn_TzMH9U5yUKlDDajVaOcc-WA_0 2024-09-12T01:11:23.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12186799771463008937', time=2024-09-12T03:01:50.869305+0000, chain.objs.size()=1 2024-09-12T01:11:23.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.561+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.or2v9IBGJpUjBOZ8-Up8nhu3OVRImsJ_0 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14818426556979713815', time=2024-09-12T03:01:50.894680+0000, chain.objs.size()=1 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MV4UpLo3AyW6f7lsNA7_Q1rgVw58pgc_0 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12261196488661023563', time=2024-09-12T03:01:50.915018+0000, chain.objs.size()=1 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oRsYd019CNJjhhn2awfTg5TccWVRNxY_0 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.340177375541345775', time=2024-09-12T03:01:51.101842+0000, chain.objs.size()=1 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ixCshjpSoqIFdzXIs9B0UDz-rxuLWh0_0 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17298187977422202570', time=2024-09-12T03:01:51.130435+0000, chain.objs.size()=1 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.drwthEVspMhEVoy0JlAdubs2zuCh6dv_0 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4511982466542080130', time=2024-09-12T03:01:51.197694+0000, chain.objs.size()=1 2024-09-12T01:11:23.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.564+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9lfIzDLwAOqpT61F2hxk2V-XOwS-eot_0 2024-09-12T01:11:23.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.566+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9506843922043672710', time=2024-09-12T03:01:51.249375+0000, chain.objs.size()=1 2024-09-12T01:11:23.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.566+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pMOVAq5n7dBmaL2SxxH5fYZjUMMAjn1_0 2024-09-12T01:11:23.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.567+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.180560811594098620', time=2024-09-12T03:01:51.366349+0000, chain.objs.size()=1 2024-09-12T01:11:23.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.567+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gPLmKYeklXTwOECzkBRGrzJLdU4nWGo_0 2024-09-12T01:11:23.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.567+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10979312289865619656', time=2024-09-12T03:01:51.373005+0000, chain.objs.size()=1 2024-09-12T01:11:23.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.567+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.euGdEELDe_q5K1y28CVTPRu8CLZLnIo_0 2024-09-12T01:11:23.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.567+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3815383130819217031', time=2024-09-12T03:01:51.469539+0000, chain.objs.size()=1 2024-09-12T01:11:23.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.567+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.giYQQm7gZQszl-nAg5euXJjkqrqorzU_0 2024-09-12T01:11:23.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.567+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16906062364054567879', time=2024-09-12T03:01:51.483742+0000, chain.objs.size()=1 2024-09-12T01:11:23.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.567+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.dLhlgT0EGHPOKvbQwESm2CDBlpd1Fsx_0 2024-09-12T01:11:23.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.571+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/58773 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18306859514878593209', time=2024-09-12T03:01:51.517694+0000, chain.objs.size()=1 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TV7uJfLMECWd-wiakNTG8qnBtlWmGeg_0 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10517498012590886514', time=2024-09-12T03:01:51.634938+0000, chain.objs.size()=1 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QjnxgHCPl125mEIwQ-pfiTZ1ysDpcle_0 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13850731106299459160', time=2024-09-12T03:01:51.663727+0000, chain.objs.size()=1 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vmli46qh6O-_YWPt_EVsj4rw12HOnEs_0 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.776083683359396621', time=2024-09-12T03:01:51.683991+0000, chain.objs.size()=1 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rtppjN1fljslBsDbgLzGDGsABSeraKW_0 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8843322200790297856', time=2024-09-12T03:01:51.785035+0000, chain.objs.size()=1 2024-09-12T01:11:23.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.VIEQksVvEVSwCbX-Qjxidbp46jWtkBO_0 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12463339153671455260', time=2024-09-12T03:01:51.942445+0000, chain.objs.size()=1 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uefC1teo7Zbyh2Ht3ZOGUUFirNEg01v_0 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12267588910309846141', time=2024-09-12T03:01:51.956988+0000, chain.objs.size()=1 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QU91ZKXIdSpmLRkgLMprsQULXEPrcq3_0 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15369100741516759736', time=2024-09-12T03:01:52.004321+0000, chain.objs.size()=1 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tYq5d1Rza_s7GoOhTVY7hVQ1slV3g4s_0 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17628574617075156986', time=2024-09-12T03:01:52.012464+0000, chain.objs.size()=1 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oDmtc0L1jFRB9oYBpYAS3SiQrnDwYca_0 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6461960318418044402', time=2024-09-12T03:01:52.028085+0000, chain.objs.size()=1 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.RGazULkKCOwvCjYMqLUKNNJZD0ES04C_0 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14286065431666803944', time=2024-09-12T03:01:52.031962+0000, chain.objs.size()=1 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AWJGQCa3XmwZwRLI11oECAKrSUyr6jH_0 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3756693038660378383', time=2024-09-12T03:01:52.050421+0000, chain.objs.size()=1 2024-09-12T01:11:23.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4VH0v7L8ucMxfTTUlUNxWeAF4OsoHuq_0 2024-09-12T01:11:23.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.577+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2219007921072420475', time=2024-09-12T03:01:52.068635+0000, chain.objs.size()=1 2024-09-12T01:11:23.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.577+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ngmWGe0w1qWfsRZV79PRdVOLfgPw_DZ_0 2024-09-12T01:11:23.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.577+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9633031697214803470', time=2024-09-12T03:01:52.212845+0000, chain.objs.size()=1 2024-09-12T01:11:23.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.577+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.o7IFlawOxyg7PF5RWLSKlNuh1LCkKPP_0 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6284062839033424895', time=2024-09-12T03:02:05.259548+0000, chain.objs.size()=1 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.354__shadow_.WnO_qnMlFq42mQugWtbevuLcfA9AVxe_0 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15276392429689918006', time=2024-09-12T03:02:18.835284+0000, chain.objs.size()=1 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.383__shadow_.sKe-svLCAh0Ia5KzJXUGpWuudm3DWMX_0 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3004281373055871446', time=2024-09-12T03:02:32.435027+0000, chain.objs.size()=1 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.409__shadow_.-pzGiIFqOMQNh3UeJ_EGt2kerock5Oz_0 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17458432223539405248', time=2024-09-12T03:03:08.930410+0000, chain.objs.size()=1 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.482__shadow_.83MvkL8pQYuj2fQeyZ9dz8ujKSrRyjG_0 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8392883581310884952', time=2024-09-12T03:03:44.311791+0000, chain.objs.size()=2 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~vM5LA8ZKKDCBzFxVbuOtfIBb12wIZ3N.1 2024-09-12T01:11:23.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~vM5LA8ZKKDCBzFxVbuOtfIBb12wIZ3N.2 2024-09-12T01:11:23.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~n78K6rrAblWSPDfpI0sI-6xOW1vwGGq', time=2024-09-12T03:03:49.463191+0000, chain.objs.size()=2 2024-09-12T01:11:23.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.530__multipart_mymultipart.2~n78K6rrAblWSPDfpI0sI-6xOW1vwGGq.1 2024-09-12T01:11:23.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.530__multipart_mymultipart.2~n78K6rrAblWSPDfpI0sI-6xOW1vwGGq.2 2024-09-12T01:11:23.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9469327333942511930', time=2024-09-12T03:04:30.125882+0000, chain.objs.size()=1 2024-09-12T01:11:23.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.557__shadow_.6Y04rnxStfa_wlHjSroVjca7S5ZqJ70_0 2024-09-12T01:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16983372266549766356', time=2024-09-12T03:04:31.868044+0000, chain.objs.size()=1 2024-09-12T01:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.560__shadow_.Hi9tjJUrwZSpkHPpQZCSBsOajNH68z__0 2024-09-12T01:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7609049865171203277', time=2024-09-12T03:04:47.381035+0000, chain.objs.size()=1 2024-09-12T01:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.571__shadow:-eSMNF1jrcMhuLQ-OFE2YQm8F1tDbpN_.-VY1ig8cN56Ei8coOoi_e7MTE_naWiX_0 2024-09-12T01:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5613884405397994013', time=2024-09-12T03:05:12.888109+0000, chain.objs.size()=1 2024-09-12T01:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:YvYX0FNn1TZuCUN8Zsjg6X0m9qZo7Xt_.2scim4p2jqnJ_ruOhfeeh7YdSPkrC87_0 2024-09-12T01:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5495132307595803649', time=2024-09-12T03:05:17.494613+0000, chain.objs.size()=1 2024-09-12T01:11:23.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.587__shadow:i24t9kvGDzJfvr-hSRh15NonFAySEQ1_.qzkWkkaZOzuNs8fTsmZXbfvayXyV76q_0 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17633015678077236224', time=2024-09-12T03:05:21.881642+0000, chain.objs.size()=1 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.597__shadow_.MbYZp8IZIO_X3T04GKwCfnpstWZ1hcV_0 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3869605167895299037', time=2024-09-12T03:07:45.116910+0000, chain.objs.size()=1 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.631__shadow_.pT8Z0vfqu8g7rYf3o-tUsu01LjOPxbr_0 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8908764485348900590', time=2024-09-12T03:07:58.298529+0000, chain.objs.size()=1 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.657__shadow_.lljiR5J7bjbGqHfpn2wl_iC6jScKEBr_0 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16643403387532418251', time=2024-09-12T03:08:02.419700+0000, chain.objs.size()=1 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.665__shadow_.l4UEr8DzuUqGFd3oEak0kbkb6BhjXE2_0 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9745065348439381802', time=2024-09-12T03:08:03.694537+0000, chain.objs.size()=1 2024-09-12T01:11:23.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.667__shadow_.cffQl7MMWQqrgkdTMuYBfD_0ZcG6F4m_0 2024-09-12T01:11:23.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6221683227278572954', time=2024-09-12T03:08:45.043156+0000, chain.objs.size()=1 2024-09-12T01:11:23.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.583+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.720__shadow_.rphlDs8pOXdXacDLqTYB_JpTIky6mmk_0 2024-09-12T01:11:23.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.588+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.591+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:11:23.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.592+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.593+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51073' 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9209146141295684502', time=2024-09-12T02:58:51.972743+0000, chain.objs.size()=3 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.159__shadow_.Z4tNYm4sWlx4kuncK2guljdxGGqQCj9_0 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.159__shadow_.Z4tNYm4sWlx4kuncK2guljdxGGqQCj9_1 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.159__shadow_.Z4tNYm4sWlx4kuncK2guljdxGGqQCj9_2 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_zI_VDL8S82FgtMTXBV2pBrLVo6VTQDR', time=2024-09-12T02:58:53.245206+0000, chain.objs.size()=1 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.cPeU1A6G5HyrX9lF-QHLzcvYfptBR50_0 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14834425085312981530', time=2024-09-12T03:00:34.146906+0000, chain.objs.size()=1 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.229__shadow_.Yq9TbhjxsIw0zquTghvudN3eiEYROJ8_0 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3791625468598761254', time=2024-09-12T03:00:42.725875+0000, chain.objs.size()=1 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.245__shadow_.Xi4PT3UAhbqxMMrG-QPzhA6T1pPFYlt_0 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17528239749449076796', time=2024-09-12T03:00:47.883737+0000, chain.objs.size()=1 2024-09-12T01:11:23.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.256__shadow_.NQ2E9Qfix7ToVIYHR8tI4y0sAfafYCM_0 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7725515021020844997', time=2024-09-12T03:00:47.884859+0000, chain.objs.size()=1 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.256__shadow_.Pr2gU80ox_hKL2OQ3z0HGuNDvY-qitd_0 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13482143087895825005', time=2024-09-12T03:00:49.745666+0000, chain.objs.size()=1 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.260__shadow_.i1j7aouaVTgAOWuUAnetRMhTc1xeplX_0 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1552016060279359415', time=2024-09-12T03:00:58.932479+0000, chain.objs.size()=1 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5MkYltJ0XXzKq4w2PQGzNDOJCp4--UP_0 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1373882480399936182', time=2024-09-12T03:00:59.037390+0000, chain.objs.size()=1 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.80Zx5uz424uXxUYJeCeAYm86lJbgGKY_0 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4731854450760995253', time=2024-09-12T03:00:59.042074+0000, chain.objs.size()=1 2024-09-12T01:11:23.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bdRsHl0iVSV2hiX0E3Vd7kibjumoY3p_0 2024-09-12T01:11:23.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1875006993989288318', time=2024-09-12T03:00:59.141135+0000, chain.objs.size()=1 2024-09-12T01:11:23.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5k4G8n8fiNfe8mjmew2IMWEu5OpxuGc_0 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15018396011661604554', time=2024-09-12T03:00:59.279454+0000, chain.objs.size()=1 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.L7AZwkuR4nNy8VC8sTLi-iKobRys5Zt_0 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12896057338151792412', time=2024-09-12T03:00:59.288021+0000, chain.objs.size()=1 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5f6ByUtuoWgTVwkCDPtJ2Gpgg0cw86b_0 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8233896243586385415', time=2024-09-12T03:00:59.398281+0000, chain.objs.size()=1 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.gG-rsIhQNugS1neLnY4RvmLx8TFhc7w_0 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3679145998427623769', time=2024-09-12T03:00:59.427596+0000, chain.objs.size()=1 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DpgrC7aDKcWBeAQ4TU9z0pLZTZeakuF_0 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1952679401003488166', time=2024-09-12T03:00:59.500955+0000, chain.objs.size()=1 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bxNDDzGlxd6pnDv-0cBU1x7XBtqKKzx_0 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11166331401979920729', time=2024-09-12T03:00:59.534084+0000, chain.objs.size()=1 2024-09-12T01:11:23.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Xh9ys_XTsBMjIpRERmC8ufi3J43TuB9_0 2024-09-12T01:11:23.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10942153475339945482', time=2024-09-12T03:00:59.543671+0000, chain.objs.size()=1 2024-09-12T01:11:23.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.l399BEsPvKV__z4OXwjtINf01Mvy2WL_0 2024-09-12T01:11:23.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11188600706798850837', time=2024-09-12T03:00:59.567593+0000, chain.objs.size()=1 2024-09-12T01:11:23.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Hb-tWHCI7gw4spEyD0z_EC2T-xi0KRd_0 2024-09-12T01:11:23.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8050544460945899980', time=2024-09-12T03:00:59.690055+0000, chain.objs.size()=1 2024-09-12T01:11:23.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7rcw2lItNDDTHhGM0TIl-xIfFOk_WD6_0 2024-09-12T01:11:23.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17376435474320247165', time=2024-09-12T03:00:59.952459+0000, chain.objs.size()=1 2024-09-12T01:11:23.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uoN7s-GaZbC1GZ_-7E2BDNe2xLGjHdd_0 2024-09-12T01:11:23.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.601+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7472638003552735317', time=2024-09-12T03:00:59.975941+0000, chain.objs.size()=1 2024-09-12T01:11:23.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.601+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TfJBIQINVO1ID_HhxFAJmcphK1rAU9w_0 2024-09-12T01:11:23.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.601+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1033874660756857022', time=2024-09-12T03:01:00.037918+0000, chain.objs.size()=1 2024-09-12T01:11:23.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.601+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.C2ti2j15YCQDXSIw-vE0KH_gWZqTRUp_0 2024-09-12T01:11:23.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.601+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3818417235424424759', time=2024-09-12T03:01:00.047575+0000, chain.objs.size()=1 2024-09-12T01:11:23.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.601+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8TjkUQ4gQIFb4rmILmD7Ykz5Yz1KNdm_0 2024-09-12T01:11:23.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.601+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8438806903535890892', time=2024-09-12T03:01:00.053390+0000, chain.objs.size()=1 2024-09-12T01:11:23.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.601+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Gxhys3nqmUmzRg80xBAOY8-R9jo5Kze_0 2024-09-12T01:11:23.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.602+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7603113321361078510', time=2024-09-12T03:01:00.097168+0000, chain.objs.size()=1 2024-09-12T01:11:23.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.602+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.z16kiORXz9yM5-k6q5sRRZrNXWA6nXN_0 2024-09-12T01:11:23.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.603+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17346094058898075163', time=2024-09-12T03:01:00.323479+0000, chain.objs.size()=1 2024-09-12T01:11:23.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.603+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Oy-NyXaEArkZlA7hsdL0GZJMCt1r_4v_0 2024-09-12T01:11:23.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.603+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14351415384443413137', time=2024-09-12T03:01:00.336164+0000, chain.objs.size()=1 2024-09-12T01:11:23.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.603+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LqGqOZT0HoRgVGFCF0C3z6_qrXlEHl5_0 2024-09-12T01:11:23.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.604+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8208737545627807049', time=2024-09-12T03:01:00.375957+0000, chain.objs.size()=1 2024-09-12T01:11:23.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.604+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZnfQyemkmLV7jiDCVHvK0SK70HtWjus_0 2024-09-12T01:11:23.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.604+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12351624120646620791', time=2024-09-12T03:01:00.406798+0000, chain.objs.size()=1 2024-09-12T01:11:23.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.604+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ovSdodtFiiK7zbksIZJ34Te-tH9LpVK_0 2024-09-12T01:11:23.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.604+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13297860765391498363', time=2024-09-12T03:01:00.427594+0000, chain.objs.size()=1 2024-09-12T01:11:23.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.604+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.98V17embizPjflDLbzvYoqNpWws0vNB_0 2024-09-12T01:11:23.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.605+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1563378747171926727', time=2024-09-12T03:01:00.435771+0000, chain.objs.size()=1 2024-09-12T01:11:23.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.605+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LsH4577sG_yFESGc313dfz7oahnv2Wf_0 2024-09-12T01:11:23.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2705054140337688962', time=2024-09-12T03:01:00.450218+0000, chain.objs.size()=1 2024-09-12T01:11:23.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cAqqQvGwVKpW9kyvsiXrSCpGzbyvVhm_0 2024-09-12T01:11:23.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.607+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14060927192216707098', time=2024-09-12T03:01:00.499605+0000, chain.objs.size()=1 2024-09-12T01:11:23.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.607+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fT_T94dEeBog1DTPQnA3xJwndCaYdyD_0 2024-09-12T01:11:23.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9053556870848201651', time=2024-09-12T03:01:00.614514+0000, chain.objs.size()=1 2024-09-12T01:11:23.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VI45VX5o4EIY-ygskk7FR_fFQhIQ3Y7_0 2024-09-12T01:11:23.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9525653816235129381', time=2024-09-12T03:01:00.647626+0000, chain.objs.size()=1 2024-09-12T01:11:23.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rvTQA17x9XO2Nqpg5eNAbmdYdeROKi9_0 2024-09-12T01:11:23.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5050534118396241044', time=2024-09-12T03:01:00.708778+0000, chain.objs.size()=1 2024-09-12T01:11:23.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xm3r3Uo2A3lMEXYG3HrTXhgLRBH-476_0 2024-09-12T01:11:23.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6822919270594376927', time=2024-09-12T03:01:00.770191+0000, chain.objs.size()=1 2024-09-12T01:11:23.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.okgl9WjTBLW7wdPHwx82a8uxJU97qLn_0 2024-09-12T01:11:23.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17797579483915888306', time=2024-09-12T03:01:00.911908+0000, chain.objs.size()=1 2024-09-12T01:11:23.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.pb7z7o1bMTorr-HqVWz8kcxoADL750n_0 2024-09-12T01:11:23.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1780499486955301469', time=2024-09-12T03:01:00.933717+0000, chain.objs.size()=1 2024-09-12T01:11:23.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.IPUt-IybdMNn2A-f4ZCY0Y99wOzjthT_0 2024-09-12T01:11:23.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14190184016120433608', time=2024-09-12T03:01:00.971740+0000, chain.objs.size()=1 2024-09-12T01:11:23.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oTvalmLtcPCBwBVsl7iD31J21GjQ-ni_0 2024-09-12T01:11:23.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1198371990718986489', time=2024-09-12T03:01:00.994323+0000, chain.objs.size()=1 2024-09-12T01:11:23.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.IUcFtL8PbleQhkr259gaNUteMAppZ0W_0 2024-09-12T01:11:23.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10692383618294970943', time=2024-09-12T03:01:00.998554+0000, chain.objs.size()=1 2024-09-12T01:11:23.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RRUvzDZMn7uEjP3NwEyGIgtsp121KOM_0 2024-09-12T01:11:23.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.611+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17002179222960620129', time=2024-09-12T03:01:09.379894+0000, chain.objs.size()=1 2024-09-12T01:11:23.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.611+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.281__shadow_.UjeST50P1_f3AJQbhaNzlwSZoSN2xXI_0 2024-09-12T01:11:23.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.611+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12142559483998111281', time=2024-09-12T03:01:13.392132+0000, chain.objs.size()=1 2024-09-12T01:11:23.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.611+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.289__shadow_.3K6L_-exeUQVEEhgS0ptS95hoVyVALE_0 2024-09-12T01:11:23.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.612+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4563091600778815673', time=2024-09-12T03:01:13.840720+0000, chain.objs.size()=1 2024-09-12T01:11:23.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.612+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.290__shadow_.rNbvj1XnZI6tWXjKT7cGdGf4WM-gjb8_0 2024-09-12T01:11:23.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.613+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15069903898077487655', time=2024-09-12T03:01:15.858913+0000, chain.objs.size()=1 2024-09-12T01:11:23.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.613+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.gUEMaQOLmCJiKHyhfZozJ3Oy5k8TBCq_0 2024-09-12T01:11:23.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.613+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3031579995086002882', time=2024-09-12T03:01:16.670975+0000, chain.objs.size()=1 2024-09-12T01:11:23.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.613+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.530Dq_N3gyMIAaOTdRpIwJ9yklxzfsY_0 2024-09-12T01:11:23.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.613+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8579795406450054598', time=2024-09-12T03:01:20.550774+0000, chain.objs.size()=1 2024-09-12T01:11:23.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.613+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.302__shadow_.bm8d6J0jCMXSW6Ub1kIg22sChycKOKh_0 2024-09-12T01:11:23.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.147822051221072438', time=2024-09-12T03:01:40.137696+0000, chain.objs.size()=1 2024-09-12T01:11:23.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JUE_ZwHHEWCiDsH7tC4L1bcaquLs9Sn_0 2024-09-12T01:11:23.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3661409588172661344', time=2024-09-12T03:01:40.180531+0000, chain.objs.size()=1 2024-09-12T01:11:23.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Y8iHy-xD6MNNKzo6s-fSAeP9gKJgFpS_0 2024-09-12T01:11:23.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7221770627746179750', time=2024-09-12T03:01:40.247022+0000, chain.objs.size()=1 2024-09-12T01:11:23.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uZUv8QtnYHxIOZJs4VQVqURWZMdoSOD_0 2024-09-12T01:11:23.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14337308151169235158', time=2024-09-12T03:01:40.517408+0000, chain.objs.size()=1 2024-09-12T01:11:23.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.T9c9FUnsJfVGGLN3--EXqr8dgYn9RAU_0 2024-09-12T01:11:23.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11353613267217181323', time=2024-09-12T03:01:40.526444+0000, chain.objs.size()=1 2024-09-12T01:11:23.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EbFM8TdIbxuf7WYXqI_wRKo593Y54RZ_0 2024-09-12T01:11:23.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10691198161537340018', time=2024-09-12T03:01:40.554616+0000, chain.objs.size()=1 2024-09-12T01:11:23.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.615+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mRKKRG8LpL8oqa1ZCoYmgG-8iR5SyZX_0 2024-09-12T01:11:23.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1419901806632693487', time=2024-09-12T03:01:40.710991+0000, chain.objs.size()=1 2024-09-12T01:11:23.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.iN8sqXuX2L0dmUY2v5FPrZTfkf3u9IJ_0 2024-09-12T01:11:23.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11692397574247085139', time=2024-09-12T03:01:40.768713+0000, chain.objs.size()=1 2024-09-12T01:11:23.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.j_pPLxL3Alejp4Jn_qxryPe9Y2lTr2e_0 2024-09-12T01:11:23.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7695303842911162439', time=2024-09-12T03:01:40.955050+0000, chain.objs.size()=1 2024-09-12T01:11:23.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.iq3u9HU-VmGp9Sf81ksMRReKyZvLQjq_0 2024-09-12T01:11:23.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13010046718039035486', time=2024-09-12T03:01:40.995474+0000, chain.objs.size()=1 2024-09-12T01:11:23.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8FXREV2i3lq8pMR5XR0vywRCLD43Iuu_0 2024-09-12T01:11:23.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9014487085864304161', time=2024-09-12T03:01:40.999943+0000, chain.objs.size()=1 2024-09-12T01:11:23.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.itHtYo2OOt0OA8fKOhEQ6JzmvFuIcvD_0 2024-09-12T01:11:23.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7929802860741420543', time=2024-09-12T03:01:41.001532+0000, chain.objs.size()=1 2024-09-12T01:11:23.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.618+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eJfg3bYGwIvpUEhrWZFbwjOI4p9-Sdz_0 2024-09-12T01:11:23.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.620+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6309829434240285295', time=2024-09-12T03:01:41.048476+0000, chain.objs.size()=1 2024-09-12T01:11:23.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.620+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7jXteyQBstPH3M7yv8IfWGw0y6wFTxh_0 2024-09-12T01:11:23.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.620+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11174767625580003291', time=2024-09-12T03:01:41.055262+0000, chain.objs.size()=1 2024-09-12T01:11:23.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.620+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sFJUhDrZDYKyDswGZa2WM1cC0D5wd5U_0 2024-09-12T01:11:23.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.620+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16955682994859713337', time=2024-09-12T03:01:41.177817+0000, chain.objs.size()=1 2024-09-12T01:11:23.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.620+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-slHeQcS4Uj7keEfL2JEs_pwm2_PinC_0 2024-09-12T01:11:23.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.620+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13455914610439017012', time=2024-09-12T03:01:41.253907+0000, chain.objs.size()=1 2024-09-12T01:11:23.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.620+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zHPs0NJSiXs7C9QWk4Hfw_sqWXVUVUW_0 2024-09-12T01:11:23.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.621+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17529790403691277154', time=2024-09-12T03:01:41.295406+0000, chain.objs.size()=1 2024-09-12T01:11:23.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.621+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jYPL4tTOdLzdYl7jXWonV1D2jReq9ac_0 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8510407671781451843', time=2024-09-12T03:01:41.297783+0000, chain.objs.size()=1 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GlDo8QuUA27mguxw2ygeCiCxxhmq-eA_0 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4862108737085196615', time=2024-09-12T03:01:41.508512+0000, chain.objs.size()=1 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sMUOBL-5jjW16CKiQHVibhyCK0_L5M0_0 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7958286890136672485', time=2024-09-12T03:01:41.510007+0000, chain.objs.size()=1 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.OLOT3TTUcWuqeiDBEQfYHB6cL__hfYi_0 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10518137609093338475', time=2024-09-12T03:01:41.881918+0000, chain.objs.size()=1 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QUB1eAES2D8zzNLpDE3kQUUpbnXgino_0 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8152166112991002253', time=2024-09-12T03:01:41.966876+0000, chain.objs.size()=1 2024-09-12T01:11:23.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fUtcVrSqYHg2marh7hXjWDnlIBJAIgY_0 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4043442711773251834', time=2024-09-12T03:01:42.008362+0000, chain.objs.size()=1 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4t2FOUC2uJI6Ya6sWaRozaoVglrVryh_0 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10200287523030654261', time=2024-09-12T03:01:42.030507+0000, chain.objs.size()=1 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.UQY6YRNWuhtMHq_Uj7Ram45-mtcS4xH_0 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11516624056563134747', time=2024-09-12T03:01:42.083671+0000, chain.objs.size()=1 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.BRlfdR6DYTDrvSfSFvqSTuo-fSSLtpD_0 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10282708403589296650', time=2024-09-12T03:01:42.095653+0000, chain.objs.size()=1 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.svBE0tFyVIOsP56gQErzmbaoVZhrMiE_0 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16960092893482719092', time=2024-09-12T03:01:42.110292+0000, chain.objs.size()=1 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aLtAhGNecEHVwD88HS8T67KClhHpzZC_0 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8907891756197254143', time=2024-09-12T03:01:50.227262+0000, chain.objs.size()=1 2024-09-12T01:11:23.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.624+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kL9nNNrHgfGq7QUGdtYxqB_-FHmtvw2_0 2024-09-12T01:11:23.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.628+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10389656230423237059', time=2024-09-12T03:01:50.336755+0000, chain.objs.size()=1 2024-09-12T01:11:23.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.628+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DGKfIAtXvGzAXb77KixeYJWpSj_OB7g_0 2024-09-12T01:11:23.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.628+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10732382884424986311', time=2024-09-12T03:01:50.618865+0000, chain.objs.size()=1 2024-09-12T01:11:23.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.628+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.YIQqdVMeyXoX0_jGcYHr3Z81jN9GKqp_0 2024-09-12T01:11:23.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.628+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.214399274736649725', time=2024-09-12T03:01:50.732594+0000, chain.objs.size()=1 2024-09-12T01:11:23.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.628+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.a9yg98EyzUbtO0FC-Ad96yXECgallHb_0 2024-09-12T01:11:23.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10740580658164752759', time=2024-09-12T03:01:50.939600+0000, chain.objs.size()=1 2024-09-12T01:11:23.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.M3Z4pWsbOKXkRSm5Mgu_HvmtbqeYcy4_0 2024-09-12T01:11:23.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14212962254924236539', time=2024-09-12T03:01:50.963005+0000, chain.objs.size()=1 2024-09-12T01:11:23.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OTievr3DmR3KSCBriz2fu60QHl4zotC_0 2024-09-12T01:11:23.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7101590921035261375', time=2024-09-12T03:01:51.178340+0000, chain.objs.size()=1 2024-09-12T01:11:23.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9Me9pLEG5rhqp0Lb0XkyFJHtHSIw-wG_0 2024-09-12T01:11:23.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15900407240094653154', time=2024-09-12T03:01:51.403388+0000, chain.objs.size()=1 2024-09-12T01:11:23.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AdxHvgpjUgorxTfz_ak8fH4ZX5DRDXL_0 2024-09-12T01:11:23.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.631+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11041552984111167933', time=2024-09-12T03:01:51.433288+0000, chain.objs.size()=1 2024-09-12T01:11:23.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.631+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TWGa5yPspAVGcgyWbs-sMqx6560F2n6_0 2024-09-12T01:11:23.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.631+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14126868817875659104', time=2024-09-12T03:01:51.437406+0000, chain.objs.size()=1 2024-09-12T01:11:23.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.631+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.iEwCzow2QTds_7JrdcBeaxLgFWKcPyL_0 2024-09-12T01:11:23.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.631+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13117279479528097647', time=2024-09-12T03:01:51.446960+0000, chain.objs.size()=1 2024-09-12T01:11:23.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.631+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mgf_OD9CXBQ6zLeJpAjkCiHpEIYshqw_0 2024-09-12T01:11:23.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.631+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16935207802114372903', time=2024-09-12T03:01:51.499244+0000, chain.objs.size()=1 2024-09-12T01:11:23.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.631+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Ik0mM-dAQ1k0X1fvJN4fQqckNXd3aAt_0 2024-09-12T01:11:23.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.633+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14540924521185635317', time=2024-09-12T03:01:51.659609+0000, chain.objs.size()=1 2024-09-12T01:11:23.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.633+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Itb5PAYODGioyfuqst9tPVXWzZDTsL8_0 2024-09-12T01:11:23.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.633+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15613203422175947463', time=2024-09-12T03:01:51.684370+0000, chain.objs.size()=1 2024-09-12T01:11:23.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.633+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Nwnyo5SGOR2cj2cA810tG9x1MSKPvNf_0 2024-09-12T01:11:23.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.633+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.146028390122611506', time=2024-09-12T03:01:51.930616+0000, chain.objs.size()=1 2024-09-12T01:11:23.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.633+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.g-UeX6rRmr0thaBF3SXkKaH6Ut7mU81_0 2024-09-12T01:11:23.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.633+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10180189592427411408', time=2024-09-12T03:01:51.956889+0000, chain.objs.size()=1 2024-09-12T01:11:23.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.633+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GbQ6LDMTymrXEFMxKKDLU3fe9BeRWIZ_0 2024-09-12T01:11:23.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.634+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17847773426474520233', time=2024-09-12T03:01:51.964570+0000, chain.objs.size()=1 2024-09-12T01:11:23.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.I4fgQtWDQK0QU1o3k8aSOeXefPMPno-_0 2024-09-12T01:11:23.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.635+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3100908271909563426', time=2024-09-12T03:01:51.979496+0000, chain.objs.size()=1 2024-09-12T01:11:23.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.635+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3vBik5YcR4xqC4Fe_vO5OKc-E6_J8WS_0 2024-09-12T01:11:23.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.635+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5108814205473575220', time=2024-09-12T03:01:52.001112+0000, chain.objs.size()=1 2024-09-12T01:11:23.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.635+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QlzOuEBCyYJdY3gsm_O8TnhHHvQXBzB_0 2024-09-12T01:11:23.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.637+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15465852234051733870', time=2024-09-12T03:01:52.042125+0000, chain.objs.size()=1 2024-09-12T01:11:23.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.637+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qPhtfAMn9qsAPWYG8Od8bch8aGZ1PDD_0 2024-09-12T01:11:23.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.637+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16816931903947667089', time=2024-09-12T03:01:52.171615+0000, chain.objs.size()=1 2024-09-12T01:11:23.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.637+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._9-u8dF39OLrwP5QqWH2H1seyABb2ji_0 2024-09-12T01:11:23.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.637+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12491832123111093041', time=2024-09-12T03:02:15.270770+0000, chain.objs.size()=1 2024-09-12T01:11:23.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.637+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.376__shadow_.RTqVVn-j_bQRYJ4jV0YqwBq28N6Oruh_0 2024-09-12T01:11:23.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.637+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14376684983620402135', time=2024-09-12T03:02:31.984893+0000, chain.objs.size()=1 2024-09-12T01:11:23.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.637+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.408__shadow_.dMZhXDsMRDcQ5HcKtbKpdRS5vJ4tokd_0 2024-09-12T01:11:23.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.638+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3124467625348170565', time=2024-09-12T03:03:02.027821+0000, chain.objs.size()=1 2024-09-12T01:11:23.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.638+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.463__shadow_.F6YjyOjWOnHV_Gllpcy4Xl-vmoFuPnV_0 2024-09-12T01:11:23.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.641+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/51073 2024-09-12T01:11:23.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:11:23.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15672892827900651449', time=2024-09-12T03:04:43.919944+0000, chain.objs.size()=1 2024-09-12T01:11:23.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:OzvMA9EhNzVOiqK6qUNwjKT5SztsMwh_.bVfEXmqsY_GJtSyFUqeesT21Byuf2Dx_0 2024-09-12T01:11:23.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3126767037835866586', time=2024-09-12T03:04:44.757143+0000, chain.objs.size()=1 2024-09-12T01:11:23.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:SXI48sYQNXHOijzqu1Tm-1n7wlKPcvk_.sKTLTmNMrcAP3Bfq66G24cSDfZikXXm_0 2024-09-12T01:11:23.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17743809098397612607', time=2024-09-12T03:05:02.427387+0000, chain.objs.size()=1 2024-09-12T01:11:23.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:ohHiV.2Lrmuees7mu8h0ec1dfRGUtD9_.dSFOoQorJSjv8Q2CMjxVKt8aabr5vNp_0 2024-09-12T01:11:23.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12705227628218437453', time=2024-09-12T03:05:08.295168+0000, chain.objs.size()=1 2024-09-12T01:11:23.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:YrLzDs23nRINGHuIxEqFRg-eCRX20X1_.vmWO8cTHrqoNpDqdWikDXivz9YhL_sp_0 2024-09-12T01:11:23.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9551848966632424073', time=2024-09-12T03:08:02.934684+0000, chain.objs.size()=1 2024-09-12T01:11:23.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.666__shadow_.xap5165U3ZxfegSyx_HD2lIdq_BUKJf_0 2024-09-12T01:11:23.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16865566926534855061', time=2024-09-12T03:08:54.859001+0000, chain.objs.size()=1 2024-09-12T01:11:23.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.740__shadow_.GkjMDtsmmAVJXNoBvo8U2WgmDAB8t_z_0 2024-09-12T01:11:23.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.646+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.649+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:11:23.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46043' 2024-09-12T01:11:23.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9414221716394994468', time=2024-09-12T02:58:48.185322+0000, chain.objs.size()=1 2024-09-12T01:11:23.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.152__shadow_.01jkbMbQsUGr9zis-tY8szg50Q89Acv_0 2024-09-12T01:11:23.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2865540375395954298', time=2024-09-12T02:58:53.038251+0000, chain.objs.size()=3 2024-09-12T01:11:23.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__multipart_mymultipart-STANDARD.2~j2QaveyJeGqDOhk6XDJ1NUajY5vXk_y.1 2024-09-12T01:11:23.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__multipart_mymultipart-STANDARD.2~j2QaveyJeGqDOhk6XDJ1NUajY5vXk_y.2 2024-09-12T01:11:23.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__multipart_mymultipart-STANDARD.2~j2QaveyJeGqDOhk6XDJ1NUajY5vXk_y.3 2024-09-12T01:11:23.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3297944981860127584', time=2024-09-12T02:59:24.397398+0000, chain.objs.size()=1 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.198__shadow_.YJiViQmRbS1bgH2BMIjASYGtIO-5Ioe_0 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15522959092239016503', time=2024-09-12T03:00:47.410189+0000, chain.objs.size()=1 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.255__shadow_.3a8DJ9wq03ptuYDq808mBva9QUdmywz_0 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12263776978893010942', time=2024-09-12T03:00:58.872934+0000, chain.objs.size()=1 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hLK11zNK_YKpXTjRAY9IpHQry260J6x_0 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4009225811805838551', time=2024-09-12T03:00:58.900335+0000, chain.objs.size()=1 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xGZ89JgMrSV0K0XZ1Z1-FsGRmkHtcA-_0 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3883641941679614086', time=2024-09-12T03:00:58.955097+0000, chain.objs.size()=1 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ICntMIZJvhqOXTAypMHD3hvK3eCeUm8_0 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14869435235440258924', time=2024-09-12T03:00:59.184432+0000, chain.objs.size()=1 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bTQ3m7YbLAaX5OgBjsbK1HOkcSHB6An_0 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17310041275825794515', time=2024-09-12T03:00:59.188640+0000, chain.objs.size()=1 2024-09-12T01:11:23.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ElkOB0c9h3xWUnEsKTbOZ_H2_bl8ohx_0 2024-09-12T01:11:23.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17749117322230164116', time=2024-09-12T03:00:59.209875+0000, chain.objs.size()=1 2024-09-12T01:11:23.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.651+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.E2jDkePzrJwszKfNdMaqvnb81Me0hk3_0 2024-09-12T01:11:23.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.655+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16896693440205171586', time=2024-09-12T03:00:59.212881+0000, chain.objs.size()=1 2024-09-12T01:11:23.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.655+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Sp6dVLUPVsqLf0TK2b4KObeKAFrMuyV_0 2024-09-12T01:11:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11348322648593343508', time=2024-09-12T03:00:59.262735+0000, chain.objs.size()=1 2024-09-12T01:11:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UP982Js_dLIxZ8xzgFXXWWFdJxgQJuU_0 2024-09-12T01:11:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6181956882686145256', time=2024-09-12T03:00:59.277817+0000, chain.objs.size()=1 2024-09-12T01:11:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Luw-KV8-QEhCMDDUkuz5XZuyOH_WMVH_0 2024-09-12T01:11:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.663611725144843730', time=2024-09-12T03:00:59.403087+0000, chain.objs.size()=1 2024-09-12T01:11:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mtlWbmX8barGwFL9AALK7S5kyzVK2eP_0 2024-09-12T01:11:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9876479222730757251', time=2024-09-12T03:00:59.407410+0000, chain.objs.size()=1 2024-09-12T01:11:23.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tz9OUd1B7IJEGGtjykykbrTYofpMwh0_0 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6476910825727655480', time=2024-09-12T03:00:59.500056+0000, chain.objs.size()=1 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MaRLEC-0rSrNkkhmMpGAIy0rfl9tteF_0 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13231770880596255337', time=2024-09-12T03:00:59.547170+0000, chain.objs.size()=1 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6O804DThAoEY2BK7VCVTTkpWKCV9UVC_0 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6394573283219092662', time=2024-09-12T03:00:59.564097+0000, chain.objs.size()=1 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ppFMNFKEDFb0S5PNgZzu43l2q0v2DpF_0 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1136193202468996843', time=2024-09-12T03:00:59.656681+0000, chain.objs.size()=1 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mXb7uU0COtcsFhEKAKi1xeg5sbb9X9X_0 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10600197286518270817', time=2024-09-12T03:00:59.692020+0000, chain.objs.size()=1 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wPdKlkexMUckbmeiXOjLy3L3Q31jIf5_0 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8739970064962578264', time=2024-09-12T03:00:59.738562+0000, chain.objs.size()=1 2024-09-12T01:11:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.656+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.zPoVzlbNlYz6hb7bT8qh44U2wfmSZGb_0 2024-09-12T01:11:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.660+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14611705704473260212', time=2024-09-12T03:00:59.743714+0000, chain.objs.size()=1 2024-09-12T01:11:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.660+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.0r4_Zb6GDrRybyThdXdo-jlHTtZSg2i_0 2024-09-12T01:11:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6630874775489687616', time=2024-09-12T03:00:59.953048+0000, chain.objs.size()=1 2024-09-12T01:11:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3JrTeVRX_EhvjSR6ysPofW2nY56diy0_0 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16332698445649888516', time=2024-09-12T03:00:59.956295+0000, chain.objs.size()=1 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.53axz5wBdiWmtzH4645ixhr6ZV0P6OX_0 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4610062894634967831', time=2024-09-12T03:01:00.059044+0000, chain.objs.size()=1 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SjF-Upc9QRN3goUVmogOT1jgfPntvh__0 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5730433560727854828', time=2024-09-12T03:01:00.083768+0000, chain.objs.size()=1 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Siaxcb5QGkLOWmuRLybq88uHaZ84reC_0 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.822623026826881488', time=2024-09-12T03:01:00.093339+0000, chain.objs.size()=1 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Aux4x0OsDbOWr15Ek_VjvkZ9EO7iYzN_0 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15409637763235244446', time=2024-09-12T03:01:00.462067+0000, chain.objs.size()=1 2024-09-12T01:11:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.661+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2BiSAq6t4AZzb4vvVCiIvXLMYcbjAvw_0 2024-09-12T01:11:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.662+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7296852249411203731', time=2024-09-12T03:01:00.594532+0000, chain.objs.size()=1 2024-09-12T01:11:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.662+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.EbRiwNq-LcCM92LhjsNwb4uv8V7_pUZ_0 2024-09-12T01:11:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.662+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10669022086155592805', time=2024-09-12T03:01:00.606547+0000, chain.objs.size()=1 2024-09-12T01:11:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.662+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wg_FDcM3eY9GAVVp8iRwKY8ZsAS9H9l_0 2024-09-12T01:11:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.662+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4778871207201737421', time=2024-09-12T03:01:00.641875+0000, chain.objs.size()=1 2024-09-12T01:11:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.662+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.O6LhO87WDF46BFbYPW-pmhXPfTgsZKq_0 2024-09-12T01:11:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.662+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1195747992127804524', time=2024-09-12T03:01:00.652298+0000, chain.objs.size()=1 2024-09-12T01:11:23.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.662+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.O4tAARqtA70ct7l3FkKWsixbi9P4b9m_0 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8084154086440179405', time=2024-09-12T03:01:00.668435+0000, chain.objs.size()=1 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Kd5CaBiKkNw1Ean1XTP0sbf0QK9XaUv_0 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10800351561531664901', time=2024-09-12T03:01:00.703474+0000, chain.objs.size()=1 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UrpgUTswpQIAFy35UeeTc8vjOKdaqbr_0 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16662586519450140387', time=2024-09-12T03:01:00.739305+0000, chain.objs.size()=1 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZoAnHVTSOG0vNQ6OSPEDuLFFCRMlnCy_0 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4932186869526984305', time=2024-09-12T03:01:00.898828+0000, chain.objs.size()=1 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Jw6TIsTLKD1lr49OTUEgPN8FyK8g-Km_0 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7886210695355790064', time=2024-09-12T03:01:00.982199+0000, chain.objs.size()=1 2024-09-12T01:11:23.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8NL9ZweMHXcPTJJQLZI1d15RPgpm8eO_0 2024-09-12T01:11:23.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4109208916710183276', time=2024-09-12T03:01:03.301018+0000, chain.objs.size()=1 2024-09-12T01:11:23.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.268__shadow_.gOCCsWpZndEo9ndobemk56XbmmiSAG3_0 2024-09-12T01:11:23.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3437954437170200913', time=2024-09-12T03:01:08.397683+0000, chain.objs.size()=1 2024-09-12T01:11:23.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.279__shadow_.DbYRQxZLN5vQ-XZHMp9TQ18_v85MdfF_0 2024-09-12T01:11:23.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5447554347009162638', time=2024-09-12T03:01:08.891161+0000, chain.objs.size()=1 2024-09-12T01:11:23.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.280__shadow_.UhrTCSqtiRHZGutaeTlzWYKpPq7Kn8E_0 2024-09-12T01:11:23.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.668+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6555975059998035453', time=2024-09-12T03:01:11.921652+0000, chain.objs.size()=1 2024-09-12T01:11:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.668+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.286__shadow_.WJtVoMtBamDDrhgHv7LQQce4dfZfLGk_0 2024-09-12T01:11:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.668+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6271243588483521773', time=2024-09-12T03:01:12.441549+0000, chain.objs.size()=1 2024-09-12T01:11:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.668+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.287__shadow_.ejAWsqbDwYi4eenmGmz3fBuUpzyUdXI_0 2024-09-12T01:11:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.668+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6458327387606468112', time=2024-09-12T03:01:13.838701+0000, chain.objs.size()=1 2024-09-12T01:11:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.668+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.290__shadow_.ENwB-KAW8SRn6LTjNbQ498rMviIzQ9f_0 2024-09-12T01:11:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.671+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10405712721941214891', time=2024-09-12T03:01:15.866431+0000, chain.objs.size()=1 2024-09-12T01:11:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.671+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.7OYM52zd4JzhJxHygTw4d10pASWVpkw_0 2024-09-12T01:11:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.671+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14143782020339421262', time=2024-09-12T03:01:16.667653+0000, chain.objs.size()=1 2024-09-12T01:11:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.671+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.T1p0GWskSwSkjVuLDRADB1GTe2ithEE_0 2024-09-12T01:11:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.671+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13415205004846610151', time=2024-09-12T03:01:19.061362+0000, chain.objs.size()=1 2024-09-12T01:11:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.671+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.299__shadow_.kfyVh6Pdna7PYQp1gWU4qjZeH2HjNY5_0 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15087539586266186668', time=2024-09-12T03:01:21.996285+0000, chain.objs.size()=1 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.305__shadow_._XMt1LYT5G8YLD0_CIWi7_10TIR9zMl_0 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9511253253726558873', time=2024-09-12T03:01:40.128737+0000, chain.objs.size()=1 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PkhPHV_lj7_BHXRT-898iwnbkcOFkho_0 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7312995317409961064', time=2024-09-12T03:01:40.175695+0000, chain.objs.size()=1 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0cFUxnGrTbBBsNYaxBfTs3iPbSdaLHj_0 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14493843028343737464', time=2024-09-12T03:01:40.201438+0000, chain.objs.size()=1 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nmemzyYwUncEwMlcFbKohMXadzw22Xm_0 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10980731875712655259', time=2024-09-12T03:01:40.246202+0000, chain.objs.size()=1 2024-09-12T01:11:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.672+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rVx26rfIGPiStGJialYrCtx0UDHhxZb_0 2024-09-12T01:11:23.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9347086363954150228', time=2024-09-12T03:01:40.261056+0000, chain.objs.size()=1 2024-09-12T01:11:23.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Tc25MZbbfdIq6T2kAxdfY5RybuSrANm_0 2024-09-12T01:11:23.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10125305566861654010', time=2024-09-12T03:01:40.280244+0000, chain.objs.size()=1 2024-09-12T01:11:23.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bMzqxHqDIU7-XqiUvH_cE4niPmzuFJT_0 2024-09-12T01:11:23.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12281893485990668908', time=2024-09-12T03:01:40.492449+0000, chain.objs.size()=1 2024-09-12T01:11:23.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mAHNk090COFwIYHz23mheRKt7_ZrPhB_0 2024-09-12T01:11:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1086093505115262080', time=2024-09-12T03:01:40.514424+0000, chain.objs.size()=1 2024-09-12T01:11:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.w13ORhkJtteVox6hDK6MtYul9XyXK-__0 2024-09-12T01:11:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8631150719401236602', time=2024-09-12T03:01:40.530691+0000, chain.objs.size()=1 2024-09-12T01:11:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.K6gI_3Y2soFOrMubDfLGl3Q1h29sx-M_0 2024-09-12T01:11:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7105040386588103357', time=2024-09-12T03:01:40.557557+0000, chain.objs.size()=1 2024-09-12T01:11:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.675+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.s0vKEzy-qolCwcV1z_1HBJL-NHBxyQ-_0 2024-09-12T01:11:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16590330787188885807', time=2024-09-12T03:01:40.680665+0000, chain.objs.size()=1 2024-09-12T01:11:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zQsx7LRlSt9b8jv6XDzWHzB5NFX7B1r_0 2024-09-12T01:11:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.677+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13575315904070684247', time=2024-09-12T03:01:40.681477+0000, chain.objs.size()=1 2024-09-12T01:11:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.677+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0KJtN5e_R8D_oNpTmfylYuNOE_wiwjI_0 2024-09-12T01:11:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.677+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10186639854853435088', time=2024-09-12T03:01:40.720877+0000, chain.objs.size()=1 2024-09-12T01:11:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.677+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eE1LGvbWyeg9ao1r1DJF1h_ppB7D5Sb_0 2024-09-12T01:11:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.677+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4082397238260319555', time=2024-09-12T03:01:40.737574+0000, chain.objs.size()=1 2024-09-12T01:11:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.677+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.biO2RYsyELTb7s1wmK6ah-4Dt29fN03_0 2024-09-12T01:11:23.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.679+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13331656864792613137', time=2024-09-12T03:01:40.782916+0000, chain.objs.size()=1 2024-09-12T01:11:23.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.679+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Z-kmWrTPq5tyCM71iTgBukqxvci5STT_0 2024-09-12T01:11:23.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.680+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12645755796502129162', time=2024-09-12T03:01:40.796070+0000, chain.objs.size()=1 2024-09-12T01:11:23.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.680+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EPiO1CUt5IoX53fRofHguOxvn7gISMQ_0 2024-09-12T01:11:23.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.680+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.314381026715709060', time=2024-09-12T03:01:40.799559+0000, chain.objs.size()=1 2024-09-12T01:11:23.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.680+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.J7oMCAQVJxYeKwTKc_vplqpPdpavq38_0 2024-09-12T01:11:23.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.680+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14267045763188580068', time=2024-09-12T03:01:40.910992+0000, chain.objs.size()=1 2024-09-12T01:11:23.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.680+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8485zYnvw7reRtxeJMtw8CX3gSGzy3p_0 2024-09-12T01:11:23.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.680+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6835003150416625194', time=2024-09-12T03:01:40.916385+0000, chain.objs.size()=1 2024-09-12T01:11:23.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.680+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2KtU4rDEmuKCbbVyGehl7u51uoQdjgI_0 2024-09-12T01:11:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.681+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4278038723608986942', time=2024-09-12T03:01:40.937085+0000, chain.objs.size()=1 2024-09-12T01:11:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.681+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.anKr01LSQ7H8m-asObp6Lh6q_2DIk7l_0 2024-09-12T01:11:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.681+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18080381825708348102', time=2024-09-12T03:01:40.948629+0000, chain.objs.size()=1 2024-09-12T01:11:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.681+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._SJ9gRCkKmfeG3BLGk39Nqcx1UwQZuT_0 2024-09-12T01:11:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.681+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16236386456262658068', time=2024-09-12T03:01:40.977610+0000, chain.objs.size()=1 2024-09-12T01:11:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.681+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.CFt4GzJTBbkuLAC7EVECgNgoGmbnSmh_0 2024-09-12T01:11:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.684+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10572042477532499199', time=2024-09-12T03:01:41.079431+0000, chain.objs.size()=1 2024-09-12T01:11:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sCZu8D8DdnD2t1Er8qgWWxqE9cA5sIb_0 2024-09-12T01:11:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12747257731839461238', time=2024-09-12T03:01:41.092402+0000, chain.objs.size()=1 2024-09-12T01:11:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LdHX3mQWixpBuKyheMXXL76Fv4Hfcec_0 2024-09-12T01:11:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.589419314697442971', time=2024-09-12T03:01:41.175414+0000, chain.objs.size()=1 2024-09-12T01:11:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WMLlB9vTd4cURinX8aF56yGH1WOMsN7_0 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16325220007251911178', time=2024-09-12T03:01:41.215522+0000, chain.objs.size()=1 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dBkrfzTDqoeYcCLrvVh077Sf9vW-ePx_0 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18240859457879798720', time=2024-09-12T03:01:41.287505+0000, chain.objs.size()=1 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Osvwh6tnq4otaeUsaGj8mrlcojjAUVo_0 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17018060291609093750', time=2024-09-12T03:01:41.322670+0000, chain.objs.size()=1 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sYXogORsXzx7ScRMIbm2h6gA-MbxHN2_0 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15598884595682118588', time=2024-09-12T03:01:41.358019+0000, chain.objs.size()=1 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7FgQy69c0uD9vdeHroP46WReRPu84RZ_0 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.22729696703563319', time=2024-09-12T03:01:41.498349+0000, chain.objs.size()=1 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.685+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.svGmThp2VKQxTvy57wva8GMKqdxHMLV_0 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.686+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12135375734202313221', time=2024-09-12T03:01:41.543537+0000, chain.objs.size()=1 2024-09-12T01:11:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.686+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.E3Ztb5IJSpE5S1rd2ddxXklvCgUznbD_0 2024-09-12T01:11:23.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.686+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6394602457012746667', time=2024-09-12T03:01:41.557903+0000, chain.objs.size()=1 2024-09-12T01:11:23.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.686+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aetTOvFRxtGsuGVNIcFrTmWMfDMVSeN_0 2024-09-12T01:11:23.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.687+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14133185050503410148', time=2024-09-12T03:01:41.568560+0000, chain.objs.size()=1 2024-09-12T01:11:23.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.687+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ebi1Lh8zu1DV4uAQXJ_yxufhwuQ1t4u_0 2024-09-12T01:11:23.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.689+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6724223330216634466', time=2024-09-12T03:01:41.700088+0000, chain.objs.size()=1 2024-09-12T01:11:23.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.689+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.plzuY1Olo9TOuUwMCIqHiIS1bepWQip_0 2024-09-12T01:11:23.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.690+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5114092344972280652', time=2024-09-12T03:01:41.706687+0000, chain.objs.size()=1 2024-09-12T01:11:23.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.690+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7WXYxOP_gSLeditpqqncnsLm_6OZqM9_0 2024-09-12T01:11:23.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.690+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12517708932336219113', time=2024-09-12T03:01:41.872695+0000, chain.objs.size()=1 2024-09-12T01:11:23.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.690+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.UJf0cYhwzSW2cY_EQOZ3S5_txKyDJn2_0 2024-09-12T01:11:23.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.690+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14741438010747319970', time=2024-09-12T03:01:41.881513+0000, chain.objs.size()=1 2024-09-12T01:11:23.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.690+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sGn2vPceVGd7PBAuruABkhaq2XmiPie_0 2024-09-12T01:11:23.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.691+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16281018896637794407', time=2024-09-12T03:01:41.973399+0000, chain.objs.size()=1 2024-09-12T01:11:23.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.691+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lleYpY6spVhY12J1SqAVDj2iI9PSuJn_0 2024-09-12T01:11:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9622014884597712691', time=2024-09-12T03:01:41.979295+0000, chain.objs.size()=1 2024-09-12T01:11:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.y-yMVADdIRJ8d989KWscb0GaogLH4tL_0 2024-09-12T01:11:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16058864052864691794', time=2024-09-12T03:01:41.992517+0000, chain.objs.size()=1 2024-09-12T01:11:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qKRJt46G2zluRds3DMV2f0M3WT7UygO_0 2024-09-12T01:11:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5175157499617289958', time=2024-09-12T03:01:41.996993+0000, chain.objs.size()=1 2024-09-12T01:11:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PKuBaFJH1-Gt2dWHnG4I9V7EUJqYlrP_0 2024-09-12T01:11:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3682040620730891888', time=2024-09-12T03:01:50.400058+0000, chain.objs.size()=1 2024-09-12T01:11:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AO37DncRRVO_FOIMVhR7Nxvkj9YVNwO_0 2024-09-12T01:11:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13227054729081130899', time=2024-09-12T03:01:50.402333+0000, chain.objs.size()=1 2024-09-12T01:11:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1SaCh6hPkSfvZRsrlMP97M9FKO-A8si_0 2024-09-12T01:11:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1926709851971299289', time=2024-09-12T03:01:50.821353+0000, chain.objs.size()=1 2024-09-12T01:11:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.692+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8HDxZUfaFmTbVj3dIWgwQPU6Il1mbgo_0 2024-09-12T01:11:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.694+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16428032690965803558', time=2024-09-12T03:01:50.929297+0000, chain.objs.size()=1 2024-09-12T01:11:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.694+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lobXrwvLkGnrFdk-8VqYgkTEjvKSEJ8_0 2024-09-12T01:11:23.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.695+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5706042467478730847', time=2024-09-12T03:01:50.940311+0000, chain.objs.size()=1 2024-09-12T01:11:23.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.695+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OeguP0Tu6Ctk0PLdlexEfHitx7fougZ_0 2024-09-12T01:11:23.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.695+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17018492845445354722', time=2024-09-12T03:01:51.124231+0000, chain.objs.size()=1 2024-09-12T01:11:23.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.695+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tdSolCb5geqfqn5zYgMpy8hRY1zywjE_0 2024-09-12T01:11:23.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8603255635562768969', time=2024-09-12T03:01:51.174033+0000, chain.objs.size()=1 2024-09-12T01:11:23.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Le4tgzl2D_tDix3OpYAqDzt_Uud23dO_0 2024-09-12T01:11:23.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.838970060123680661', time=2024-09-12T03:01:51.208304+0000, chain.objs.size()=1 2024-09-12T01:11:23.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mJmd8rVdloVNh6NfXjTvgRCdGc_qcCV_0 2024-09-12T01:11:23.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3731336912395120303', time=2024-09-12T03:01:51.386060+0000, chain.objs.size()=1 2024-09-12T01:11:23.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ni32XPi9e-2lOjSNUw8bxRmht6GQspd_0 2024-09-12T01:11:23.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.697+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1762184698993317560', time=2024-09-12T03:01:51.429391+0000, chain.objs.size()=1 2024-09-12T01:11:23.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.697+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1sjpXFN5rPWnuYO2WZ2hFBIqhS_Miaa_0 2024-09-12T01:11:23.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.697+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8207226669536497610', time=2024-09-12T03:01:51.467097+0000, chain.objs.size()=1 2024-09-12T01:11:23.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.697+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ekOAr5U5D4nuEQVor_M6wuVNli-W6LX_0 2024-09-12T01:11:23.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.697+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3938500807130064136', time=2024-09-12T03:01:51.549947+0000, chain.objs.size()=1 2024-09-12T01:11:23.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.697+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CLRMDym4BeSFIRRRR4EZfvXv7ppW0Nn_0 2024-09-12T01:11:23.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.701+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/46043 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18319185871124506965', time=2024-09-12T03:01:51.681866+0000, chain.objs.size()=1 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.aiFep4pQ44SX_lsbpNds-Bt456BsdyL_0 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16969685301261757736', time=2024-09-12T03:01:51.693734+0000, chain.objs.size()=1 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KNuaMU9HUFO4eP-RQCm_rI82VwuZXAm_0 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13283613695477806030', time=2024-09-12T03:01:51.740473+0000, chain.objs.size()=1 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.b13YSk9HAFT-X_rn1Oi1r4hYwefcm2K_0 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2317614407318793221', time=2024-09-12T03:01:51.794582+0000, chain.objs.size()=1 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OKypHICeAmSw-azhWmvCE8tWS2kVu47_0 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6459266646322165305', time=2024-09-12T03:01:51.810347+0000, chain.objs.size()=1 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LWqNoJpVpwFSH4--touZESCeXQJ1Xv1_0 2024-09-12T01:11:23.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9891327571296318666', time=2024-09-12T03:01:51.826793+0000, chain.objs.size()=1 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.VvRPWOJyF5ZTlDKtg75D6IoXPZMIiuL_0 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.902150824840080559', time=2024-09-12T03:01:52.037306+0000, chain.objs.size()=1 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6p1Gv6T-1CosFE1dj3w130ukMpvEkjy_0 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11440740098663813206', time=2024-09-12T03:01:52.058219+0000, chain.objs.size()=1 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ZIpXBpvZyZ_dT8YIkAL8FdI2Vy_9wub_0 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2052909487787448774', time=2024-09-12T03:01:52.183826+0000, chain.objs.size()=1 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0olTZAuliY_mGYeTlls_Aa79iDs_Qj3_0 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14387783199389681138', time=2024-09-12T03:01:52.205573+0000, chain.objs.size()=1 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.XstXklX3jBezXEjIBw9dvpwuI7jFuCF_0 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12288970477096446979', time=2024-09-12T03:01:52.235539+0000, chain.objs.size()=1 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.2FWphZjwwFV-TNhLwHTlfVj8i9_bwwE_0 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1203225723998149631', time=2024-09-12T03:01:52.292153+0000, chain.objs.size()=1 2024-09-12T01:11:23.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.5LG9FQ5lpM7K-yecG7-IEBM8a4IXdIZ_0 2024-09-12T01:11:23.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.706+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5939341895850876833', time=2024-09-12T03:01:56.251771+0000, chain.objs.size()=1 2024-09-12T01:11:23.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.706+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.334__shadow_.BNk1WUo7Bnwxuql0ZvyAtSBVW3wdjK2_0 2024-09-12T01:11:23.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.707+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1564955676082169540', time=2024-09-12T03:01:59.434057+0000, chain.objs.size()=1 2024-09-12T01:11:23.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.341__shadow_.ReQRXmCSzH8Yh95n_z2JihT60ktpU8m_0 2024-09-12T01:11:23.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.707+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16745312209780613849', time=2024-09-12T03:01:59.930572+0000, chain.objs.size()=1 2024-09-12T01:11:23.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.342__shadow_.0b98F92c_NdTZvENoi9O69AQ2H3Ag5m_0 2024-09-12T01:11:23.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18000012312745044810', time=2024-09-12T03:02:54.837318+0000, chain.objs.size()=1 2024-09-12T01:11:23.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.452__shadow_._oHpSlN7HFYE7d458H_YT0u3iPo53Iw_0 2024-09-12T01:11:23.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4036267921349326884', time=2024-09-12T03:02:57.014884+0000, chain.objs.size()=1 2024-09-12T01:11:23.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.456__shadow_.57eOLNg7NsrTDtd-2Zw_XF_nnPx6_y2_0 2024-09-12T01:11:23.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18244192234700526041', time=2024-09-12T03:03:17.567030+0000, chain.objs.size()=1 2024-09-12T01:11:23.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.500__shadow_.Ek_eSOK7z2xBXEyPrMd5jIvFSii-WA7_0 2024-09-12T01:11:23.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6617979662338765010', time=2024-09-12T03:03:35.123548+0000, chain.objs.size()=6 2024-09-12T01:11:23.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.adZ8e1yq-G5OGqDRio8GHaeo3uQR8G2w.1 2024-09-12T01:11:23.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~0oy_SLn4ibCqzpG6YIrW3r0mcoDOTVa.2 2024-09-12T01:11:23.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.708+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~0oy_SLn4ibCqzpG6YIrW3r0mcoDOTVa.3 2024-09-12T01:11:23.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.710+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~0oy_SLn4ibCqzpG6YIrW3r0mcoDOTVa.4 2024-09-12T01:11:23.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.710+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~0oy_SLn4ibCqzpG6YIrW3r0mcoDOTVa.5 2024-09-12T01:11:23.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.712+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~0oy_SLn4ibCqzpG6YIrW3r0mcoDOTVa.6 2024-09-12T01:11:23.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.713+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~MvWzRhnaSGay4sHPUq690PrGuH4udAb', time=2024-09-12T03:03:38.878260+0000, chain.objs.size()=1 2024-09-12T01:11:23.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.713+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~MvWzRhnaSGay4sHPUq690PrGuH4udAb.2 2024-09-12T01:11:23.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.713+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~MvWzRhnaSGay4sHPUq690PrGuH4udAb', time=2024-09-12T03:03:38.879707+0000, chain.objs.size()=1 2024-09-12T01:11:23.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.713+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~MvWzRhnaSGay4sHPUq690PrGuH4udAb.3 2024-09-12T01:11:23.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.713+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2858007313176437646', time=2024-09-12T03:03:46.327153+0000, chain.objs.size()=3 2024-09-12T01:11:23.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.713+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~KFyhS1VCgWuWsrhDfzRx_d9YcTR-GvL.1 2024-09-12T01:11:23.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.713+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~KFyhS1VCgWuWsrhDfzRx_d9YcTR-GvL.2 2024-09-12T01:11:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.715+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~KFyhS1VCgWuWsrhDfzRx_d9YcTR-GvL.3 2024-09-12T01:11:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.715+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15769790161486406525', time=2024-09-12T03:04:31.064936+0000, chain.objs.size()=1 2024-09-12T01:11:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.715+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.559__shadow_.F3m4Gw21lmMuvr5zmwDQ4lPU54X7RfG_0 2024-09-12T01:11:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.715+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3380116728743700184', time=2024-09-12T03:05:00.881725+0000, chain.objs.size()=1 2024-09-12T01:11:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.715+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:2KlWkh6GIjh82e-LTYYUI.h3lPRDV0B_.MIKvIR1M1FTaEU75CoQwOnSyE3wCZTW_0 2024-09-12T01:11:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.716+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2876451913245838111', time=2024-09-12T03:05:07.934365+0000, chain.objs.size()=1 2024-09-12T01:11:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.716+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:3y3HqwlmpAunDBOlTI7PwTyAcTnVTzx_.0ttzOv3VyKvwU7Kk274FMpaE7PWvtvv_0 2024-09-12T01:11:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.716+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1505468253512572469', time=2024-09-12T03:07:57.133775+0000, chain.objs.size()=1 2024-09-12T01:11:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.716+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.655__shadow_.sFYW1ZpupWP-g-dfgjnWgbmFXrzxk1h_0 2024-09-12T01:11:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.716+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16812312928975541354', time=2024-09-12T03:08:01.067889+0000, chain.objs.size()=6 2024-09-12T01:11:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.716+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.662__multipart_baz.2~B17b-gMls5r2_-LWPL5rcog54nMg7Jg.1 2024-09-12T01:11:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.716+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.662__multipart_baz.2~B17b-gMls5r2_-LWPL5rcog54nMg7Jg.2 2024-09-12T01:11:23.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.720+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.662__multipart_baz.2~B17b-gMls5r2_-LWPL5rcog54nMg7Jg.3 2024-09-12T01:11:23.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.720+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.662__multipart_baz.2~B17b-gMls5r2_-LWPL5rcog54nMg7Jg.4 2024-09-12T01:11:23.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.720+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.662__multipart_baz.2~B17b-gMls5r2_-LWPL5rcog54nMg7Jg.5 2024-09-12T01:11:23.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.720+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.662__multipart_baz.2~B17b-gMls5r2_-LWPL5rcog54nMg7Jg.6 2024-09-12T01:11:23.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.720+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9450948945607095167', time=2024-09-12T03:08:04.444730+0000, chain.objs.size()=1 2024-09-12T01:11:23.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.720+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.669__shadow_.xCm0ZLwLv17n_PB4CDVrP2qUhPGKyVx_0 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16645223838699047164', time=2024-09-12T03:08:05.575514+0000, chain.objs.size()=1 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.672__shadow_.tzbD4teIovWsEIsR3H4A_DRYFvK0loj_0 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10180650727347201357', time=2024-09-12T03:08:13.992790+0000, chain.objs.size()=1 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.693__shadow:qgk2BTkynimbopM8bIQrotFylLCUffc_.vFnZtSYEZkcqfUP9HCOz3QXGKTtEYcZ_0 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17802367598171192774', time=2024-09-12T03:08:19.644811+0000, chain.objs.size()=1 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.706__shadow:wbHtpz9kXhUROITRokSJyFc4HZ9Lryq_.jfUqZ3P_VJCo-KYGl8g_Qf3PWOCaosh_0 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9907510928551074732', time=2024-09-12T03:08:20.510876+0000, chain.objs.size()=1 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.708__shadow:gBAf7H57hzj8aNMt5DWR4ufWevfu-gD_.-isCNOXrs5igzibUlIzgH3veIkvK95F_0 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~lwjeSTdMUyCgWUQYqQW9xyuYbMHAiOf', time=2024-09-12T03:08:56.646113+0000, chain.objs.size()=1 2024-09-12T01:11:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.723+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.743__multipart_mymultipart2.2~lwjeSTdMUyCgWUQYqQW9xyuYbMHAiOf.1 2024-09-12T01:11:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.727+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.729+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:11:23.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45268' 2024-09-12T01:11:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10492715988359281607', time=2024-09-12T02:58:51.967359+0000, chain.objs.size()=3 2024-09-12T01:11:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.159__shadow_.RuMJgt65oheQnra62C6C45-JdTSY1gO_0 2024-09-12T01:11:23.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.159__shadow_.RuMJgt65oheQnra62C6C45-JdTSY1gO_1 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.159__shadow_.RuMJgt65oheQnra62C6C45-JdTSY1gO_2 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7117930319967933327', time=2024-09-12T02:58:57.244325+0000, chain.objs.size()=1 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.167__shadow_.utNXh3mxn2tP7BQTX7ejTTuPSBG3yNJ_0 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3751625006310993565', time=2024-09-12T02:58:58.081474+0000, chain.objs.size()=1 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.171__shadow_.WfSMeRylHtzTaV-eYvB9Rbxmc8oEDXk_0 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18016974181864072854', time=2024-09-12T02:59:10.373557+0000, chain.objs.size()=1 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.180__shadow_.hZIGQzc70GCCL4XPFykBABW4F9fZZE2_0 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8510693078886673255', time=2024-09-12T03:00:36.176182+0000, chain.objs.size()=1 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.234__shadow_.UXIvbCdAJX3DJLzpe5-nypUdse0Owkk_0 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4041799087941440200', time=2024-09-12T03:00:36.176983+0000, chain.objs.size()=1 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.234__shadow_.D75AWb_nSRCQ7Pz8gdoHdGuBY6ndlQo_0 2024-09-12T01:11:23.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16062380303534138429', time=2024-09-12T03:00:46.457391+0000, chain.objs.size()=1 2024-09-12T01:11:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.253__shadow_.tkRglrybQvflSh1dn8JaXNxI0HOMIG7_0 2024-09-12T01:11:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1543812950000967262', time=2024-09-12T03:00:58.866616+0000, chain.objs.size()=1 2024-09-12T01:11:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.S-bgHWO4fHw5-jaTvXP9L4SgxnpChaj_0 2024-09-12T01:11:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14000868968321669921', time=2024-09-12T03:00:58.889077+0000, chain.objs.size()=1 2024-09-12T01:11:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lXhPDv50hKWAz0zfd4jMNSoV-mGbWFI_0 2024-09-12T01:11:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5577658815111744102', time=2024-09-12T03:00:58.911101+0000, chain.objs.size()=1 2024-09-12T01:11:23.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.732+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jreo7XjBQTAM6-I4GwXIWn5viwNB8hB_0 2024-09-12T01:11:23.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3978353938001736501', time=2024-09-12T03:00:58.952944+0000, chain.objs.size()=1 2024-09-12T01:11:23.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.M80TuJO0CRXqk4GJ0LFA018mKaA8t6U_0 2024-09-12T01:11:23.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13274589776166219611', time=2024-09-12T03:00:58.966142+0000, chain.objs.size()=1 2024-09-12T01:11:23.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.P-8RasF1EdkshNneh7kCVu4xBqeZcx1_0 2024-09-12T01:11:23.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8667001480663402181', time=2024-09-12T03:00:58.994478+0000, chain.objs.size()=1 2024-09-12T01:11:23.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.88yYIYHyWNTdFnu-nsAyumKRQKWBCGu_0 2024-09-12T01:11:23.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14151693933851353909', time=2024-09-12T03:00:59.270559+0000, chain.objs.size()=1 2024-09-12T01:11:23.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jmZjyKV_pOhsuyDGTXklCP1XiWgtES9_0 2024-09-12T01:11:23.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16664581281081055663', time=2024-09-12T03:00:59.460858+0000, chain.objs.size()=1 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.J86NsDTU0rZHJTNiucFJxBV7-PhvOrd_0 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13478744775803773483', time=2024-09-12T03:00:59.472530+0000, chain.objs.size()=1 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.EBkWEW-PLbJZtZv6-iEp0YwtNlnZssw_0 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9909465609233518410', time=2024-09-12T03:00:59.552133+0000, chain.objs.size()=1 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.kSZhb0pNFlZz74r8GMaJ8xE821YTlEa_0 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14953853040162772760', time=2024-09-12T03:00:59.566708+0000, chain.objs.size()=1 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3jA7hVpg3I0mJwoWVexJHXpW2aPCvTd_0 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14508203013831265343', time=2024-09-12T03:00:59.682477+0000, chain.objs.size()=1 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wfR2qoMRobTLaFlI9q9RTo1JZ4FimDo_0 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.737+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15038407730859161722', time=2024-09-12T03:00:59.709868+0000, chain.objs.size()=1 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.737+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cCcGmyJ0FNmhgATvMtYATdZ0WcdKMjY_0 2024-09-12T01:11:23.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.737+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12458140132384439254', time=2024-09-12T03:00:59.721010+0000, chain.objs.size()=1 2024-09-12T01:11:23.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.737+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.e8CQiSfLeUWRZRK1Vd6vhy44KsD8dfK_0 2024-09-12T01:11:23.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.739+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14792396560104773894', time=2024-09-12T03:00:59.764051+0000, chain.objs.size()=1 2024-09-12T01:11:23.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.739+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4nORIdhRL8xcshRunogTF_jCGswCNFT_0 2024-09-12T01:11:23.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.739+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12957432598304733083', time=2024-09-12T03:00:59.783970+0000, chain.objs.size()=1 2024-09-12T01:11:23.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.739+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._nqZHAV7HpDfAXaAZbxpJ57Xf-W3Ere_0 2024-09-12T01:11:23.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.741+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14572841828275314527', time=2024-09-12T03:00:59.808531+0000, chain.objs.size()=1 2024-09-12T01:11:23.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.741+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9ddobjANeL4HzedieBfbulVrj3cLUvk_0 2024-09-12T01:11:23.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.741+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16586758471725112701', time=2024-09-12T03:00:59.935156+0000, chain.objs.size()=1 2024-09-12T01:11:23.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.741+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-qBHIH0eUasbYKgOlyfzT170rI9hEat_0 2024-09-12T01:11:23.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9727937211245263880', time=2024-09-12T03:00:59.949538+0000, chain.objs.size()=1 2024-09-12T01:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tJ5HlMbTVBpa9cp0X45ZArDK20Iu1xl_0 2024-09-12T01:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6133248278143435692', time=2024-09-12T03:01:00.015879+0000, chain.objs.size()=1 2024-09-12T01:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UdKhujty6cgZWvv4hO1TT2hZNAv2nju_0 2024-09-12T01:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13703314127351333846', time=2024-09-12T03:01:00.480302+0000, chain.objs.size()=1 2024-09-12T01:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dM2tInPdF3HR7EDWQNcGw-6tWlvUNwm_0 2024-09-12T01:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8431848493110143381', time=2024-09-12T03:01:00.506253+0000, chain.objs.size()=1 2024-09-12T01:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.egOagJAFiIgdUnAGKSqaHWpVZTxPMW5_0 2024-09-12T01:11:23.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9546983606785808389', time=2024-09-12T03:01:00.593076+0000, chain.objs.size()=1 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mlZ6OqA4hazoGEWIUEt7DA3PN0DR0GH_0 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1597383386047048231', time=2024-09-12T03:01:00.638170+0000, chain.objs.size()=1 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.t3bt32gkioo41a4ZQJLVW7wNZZnGIPi_0 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4095697582599239614', time=2024-09-12T03:01:00.655346+0000, chain.objs.size()=1 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.yCp4R7juADGxvXXD3MYez1iysfcxi3I_0 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4921719722535858400', time=2024-09-12T03:01:00.855632+0000, chain.objs.size()=1 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-HMbBb16Iy9Z7VtOgmcEqtKxBMgqVkU_0 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1164607221201980532', time=2024-09-12T03:01:00.872840+0000, chain.objs.size()=1 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cQ67H1j9XDuPirjsAVVg0IdUSwZxPEs_0 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3960138171285640422', time=2024-09-12T03:01:17.576204+0000, chain.objs.size()=1 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.296__shadow_.sn3UFfmqvKJrmYkf4MdMFJXaFob_Wjb_0 2024-09-12T01:11:23.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12097335626293186036', time=2024-09-12T03:01:19.576648+0000, chain.objs.size()=1 2024-09-12T01:11:23.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.744+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.300__shadow_.4ADHQ0FG3ipZIJWfNQ43D68dyEWdEFy_0 2024-09-12T01:11:23.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.747+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12756662439488889064', time=2024-09-12T03:01:29.451534+0000, chain.objs.size()=1 2024-09-12T01:11:23.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.747+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.320__shadow:J5zmIhVNNN992L7Sft2-V8ug3iA4eqf_.AlyjaLAZWv84lreehpJZfJtQZZDM5tY_0 2024-09-12T01:11:23.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.749+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10271252650469580871', time=2024-09-12T03:01:30.583474+0000, chain.objs.size()=1 2024-09-12T01:11:23.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.749+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.323__shadow_.3GezpHSoM_Pnru5dyvLvZkQrwRm-MgI_0 2024-09-12T01:11:23.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.749+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16118601556157058427', time=2024-09-12T03:01:40.154204+0000, chain.objs.size()=1 2024-09-12T01:11:23.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.749+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dPSfGLFzF8jvG1phsLZLfE1M2PaiWuE_0 2024-09-12T01:11:23.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.749+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7122968411866002419', time=2024-09-12T03:01:40.228984+0000, chain.objs.size()=1 2024-09-12T01:11:23.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.749+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qb_nYkX5uk3iKGoWnq4LypDdItRZhyh_0 2024-09-12T01:11:23.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.749+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12956182804581013925', time=2024-09-12T03:01:40.266585+0000, chain.objs.size()=1 2024-09-12T01:11:23.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.749+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.xCNT88enUfg5YkPmg-hSSoHlxRlN0L3_0 2024-09-12T01:11:23.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.750+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13213480531189409762', time=2024-09-12T03:01:40.273273+0000, chain.objs.size()=1 2024-09-12T01:11:23.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.750+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ErfmdNyolx4HcFe7dCARtoZM3BaLh2D_0 2024-09-12T01:11:23.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.750+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16472665704723560848', time=2024-09-12T03:01:40.375422+0000, chain.objs.size()=1 2024-09-12T01:11:23.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.750+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.r-ge3-GnUa1UKKS_8vjhs4JZYhN4CFM_0 2024-09-12T01:11:23.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.750+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11229474078628303025', time=2024-09-12T03:01:40.433083+0000, chain.objs.size()=1 2024-09-12T01:11:23.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.750+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4HclDdsTc0oGkCpaUlJLrnZC2UD_cQG_0 2024-09-12T01:11:23.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.751+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10800256893269178496', time=2024-09-12T03:01:40.468862+0000, chain.objs.size()=1 2024-09-12T01:11:23.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.751+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7kQx5RZKn9XIvdmVVlib7YcoE1epBK__0 2024-09-12T01:11:23.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.751+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12360104310023477622', time=2024-09-12T03:01:40.501876+0000, chain.objs.size()=1 2024-09-12T01:11:23.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.751+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fTOR3DPLC9N4c2NsXLuDjbnizuMU5Gz_0 2024-09-12T01:11:23.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.751+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15608867000280941103', time=2024-09-12T03:01:40.527395+0000, chain.objs.size()=1 2024-09-12T01:11:23.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.751+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yZBnXQNkDTGBxNpUDfaflP5sfS6HcMf_0 2024-09-12T01:11:23.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.752+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7597699202133672312', time=2024-09-12T03:01:40.641605+0000, chain.objs.size()=1 2024-09-12T01:11:23.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.752+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.UCLN-LMyqG1uq4fZdQiBX9bf5UX2lAF_0 2024-09-12T01:11:23.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.752+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1837932887618999535', time=2024-09-12T03:01:40.694245+0000, chain.objs.size()=1 2024-09-12T01:11:23.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.752+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PVL0BHejTYvAErbmgqq5ogAYt_tC-qW_0 2024-09-12T01:11:23.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.753+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4808942552966906531', time=2024-09-12T03:01:40.773493+0000, chain.objs.size()=1 2024-09-12T01:11:23.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.753+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.suBKAFCd9jPJ1TM4kHXzuaQHGBgfmh9_0 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7165762971960833297', time=2024-09-12T03:01:40.778618+0000, chain.objs.size()=1 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.XkZiLwjxABWSLPvxV1fFYkQdSeSys89_0 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15796075751717762053', time=2024-09-12T03:01:40.814027+0000, chain.objs.size()=1 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Z4vay39RqASJoDC81XvAp93-k5f2pGs_0 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1538222737883898711', time=2024-09-12T03:01:40.923453+0000, chain.objs.size()=1 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nCd3sj2UZRfY54yUw4Ex1Rt2cPNvyNg_0 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2286670684592035150', time=2024-09-12T03:01:40.942436+0000, chain.objs.size()=1 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.paH0bKKS5otqn4Jpto51c19YaEhYnr3_0 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4664293227505299777', time=2024-09-12T03:01:40.968392+0000, chain.objs.size()=1 2024-09-12T01:11:23.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.755+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.P-ovutogrnklUicLw6kzPhnliDh3TZi_0 2024-09-12T01:11:23.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11460368276427931415', time=2024-09-12T03:01:40.976734+0000, chain.objs.size()=1 2024-09-12T01:11:23.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qpaibL396o7HrGaycDTFL_osjQUPgjO_0 2024-09-12T01:11:23.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5493437150195621374', time=2024-09-12T03:01:41.085905+0000, chain.objs.size()=1 2024-09-12T01:11:23.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-1YxN5mTUYDn3lNbyt1GIzPVsm9fIue_0 2024-09-12T01:11:23.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2040033218953001243', time=2024-09-12T03:01:41.292934+0000, chain.objs.size()=1 2024-09-12T01:11:23.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JoQ6Ff_XSQ6X1_o17f4jTiUYXDYEEM-_0 2024-09-12T01:11:23.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.758+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.267738444311429865', time=2024-09-12T03:01:41.363605+0000, chain.objs.size()=1 2024-09-12T01:11:23.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.758+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.u4QMu6jx1y58x72y9Rq7gqUPDdbjXM2_0 2024-09-12T01:11:23.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.758+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13396508812214138018', time=2024-09-12T03:01:41.533672+0000, chain.objs.size()=1 2024-09-12T01:11:23.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.758+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LmJV4IpyQ4ECho1lUGYojBPlxsie99K_0 2024-09-12T01:11:23.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.758+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1589104093190085903', time=2024-09-12T03:01:41.592785+0000, chain.objs.size()=1 2024-09-12T01:11:23.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.758+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.e3_w05mPVh--DW-gKqsOcsJvr0ueVUr_0 2024-09-12T01:11:23.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.760+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.154190180344770680', time=2024-09-12T03:01:41.621402+0000, chain.objs.size()=1 2024-09-12T01:11:23.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.760+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ev_AsW2dmiGP5WdbVtv6d5pQsz5ULG4_0 2024-09-12T01:11:23.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8786815386442123830', time=2024-09-12T03:01:41.757510+0000, chain.objs.size()=1 2024-09-12T01:11:23.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hkB1lT2rlztIeycCIPg6Tj5CdBHA_Ft_0 2024-09-12T01:11:23.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14434819850274603092', time=2024-09-12T03:01:41.800828+0000, chain.objs.size()=1 2024-09-12T01:11:23.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.OfzAUCdGia7u3EvRFJCFVd2Jbvt8WFk_0 2024-09-12T01:11:23.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11811697368417324976', time=2024-09-12T03:01:42.019705+0000, chain.objs.size()=1 2024-09-12T01:11:23.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5eEkOaXPaHw5H699-ZgOe13F5ae4uPb_0 2024-09-12T01:11:23.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1121092335767651711', time=2024-09-12T03:01:42.032866+0000, chain.objs.size()=1 2024-09-12T01:11:23.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.gcZsn8ep-jwFurJDuL7xdufYu5InNj8_0 2024-09-12T01:11:23.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12776993489856323685', time=2024-09-12T03:01:42.117260+0000, chain.objs.size()=1 2024-09-12T01:11:23.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tUP2l7sx4usdqDwSt7Ea7FGXJXR0vI8_0 2024-09-12T01:11:23.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2520761054561075078', time=2024-09-12T03:01:50.294955+0000, chain.objs.size()=1 2024-09-12T01:11:23.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GR46qk9gZQfkMEvbyAciRVw3DrsP119_0 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14035934272703098520', time=2024-09-12T03:01:50.310306+0000, chain.objs.size()=1 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MmL2l3dtJfmhs5FS76JRew43m9xYjRe_0 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12202033727357428291', time=2024-09-12T03:01:50.361301+0000, chain.objs.size()=1 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tlYzzCV3TUKTOCo1HI21Sqn70v5kyAU_0 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17231451841020586930', time=2024-09-12T03:01:50.545697+0000, chain.objs.size()=1 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.USasuUItZC13fyyeqzS_5gbNOaFat1Q_0 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11189511897683610514', time=2024-09-12T03:01:50.581774+0000, chain.objs.size()=1 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.WJpJaBKc6v6CU0V-2O2QZxPE2YpbC8o_0 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6562242701133036466', time=2024-09-12T03:01:50.587244+0000, chain.objs.size()=1 2024-09-12T01:11:23.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.763+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mWfimFzTgwF2q16gW-iApQozkgOo0-E_0 2024-09-12T01:11:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.766+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16683101423773874503', time=2024-09-12T03:01:50.816967+0000, chain.objs.size()=1 2024-09-12T01:11:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.766+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.e5KTpPj4epa3awm-NKoTGIbSWS1iTbc_0 2024-09-12T01:11:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.767+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7290913674065650426', time=2024-09-12T03:01:50.847622+0000, chain.objs.size()=1 2024-09-12T01:11:23.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.767+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1cmUFIlQgztdlq94OVEH7wdiW-b1ki9_0 2024-09-12T01:11:23.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.768+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8554798752433158253', time=2024-09-12T03:01:50.922191+0000, chain.objs.size()=1 2024-09-12T01:11:23.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.768+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pUVT2ntWpXZ6edQDYsnAnxZf-Un1oR-_0 2024-09-12T01:11:23.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.768+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16011850809734707540', time=2024-09-12T03:01:51.096541+0000, chain.objs.size()=1 2024-09-12T01:11:23.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.768+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.u9XSY1Bb7uX4L-GHBRwjFc6PtqNKh3E_0 2024-09-12T01:11:23.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.768+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5995778725306788042', time=2024-09-12T03:01:51.110642+0000, chain.objs.size()=1 2024-09-12T01:11:23.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.768+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-Il4VvJVjqRbxN25_7nBjUyGLgOw-N7_0 2024-09-12T01:11:23.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.769+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9570639013624694118', time=2024-09-12T03:01:51.133603+0000, chain.objs.size()=1 2024-09-12T01:11:23.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.769+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hi9pM9FDJCbQhN5d_1BV2r1ix0oDwQA_0 2024-09-12T01:11:23.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.769+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.587644064120348802', time=2024-09-12T03:01:51.140916+0000, chain.objs.size()=1 2024-09-12T01:11:23.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.769+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.i9abaYLJr7xCtfCVMXGtwE4YYQAxzB4_0 2024-09-12T01:11:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9407570512351566772', time=2024-09-12T03:01:51.147199+0000, chain.objs.size()=1 2024-09-12T01:11:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OxQY7rw5kf8uplgEOOdABEwSmKMTSEP_0 2024-09-12T01:11:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13927710315199883361', time=2024-09-12T03:01:51.162447+0000, chain.objs.size()=1 2024-09-12T01:11:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FtmSZ-NcayiOa4ohxO0Z6O0Dtkp73JL_0 2024-09-12T01:11:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3578821735158780493', time=2024-09-12T03:01:51.172530+0000, chain.objs.size()=1 2024-09-12T01:11:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9jZgzKai6thCnqijAyAeW5FuJy5y5TC_0 2024-09-12T01:11:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17365211488039437764', time=2024-09-12T03:01:51.183413+0000, chain.objs.size()=1 2024-09-12T01:11:23.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JSukSyhiRNCWItIbIpTzVqfb_JDS6Fw_0 2024-09-12T01:11:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16856308062083691824', time=2024-09-12T03:01:51.205432+0000, chain.objs.size()=1 2024-09-12T01:11:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tKogO_r6039-GS70u5tF8itPwbwkXr9_0 2024-09-12T01:11:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7024097746556369360', time=2024-09-12T03:01:51.212083+0000, chain.objs.size()=1 2024-09-12T01:11:23.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4gtwQ765m2NN4itEToFKMDMrk_JK-R8_0 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4422204766978615152', time=2024-09-12T03:01:51.380935+0000, chain.objs.size()=1 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.wVLVZ7GdquULE7_9UcSubcWoCigHZry_0 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1114162014647829440', time=2024-09-12T03:01:51.418318+0000, chain.objs.size()=1 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Z12SkQU_2lL6Y9JGgxWr2BLsWJNMagf_0 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3643926716116214617', time=2024-09-12T03:01:51.458140+0000, chain.objs.size()=1 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Rg4S8UTpUhdhDEnMoZ_8MXhRVVgvk5j_0 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16892633882658601410', time=2024-09-12T03:01:51.472538+0000, chain.objs.size()=1 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vS7B-kjjiDmU3_g-PuzA9HuooemjAGx_0 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13961116368388703845', time=2024-09-12T03:01:51.474262+0000, chain.objs.size()=1 2024-09-12T01:11:23.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.773+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8z3NQ_NwYBiIEe8wc0RKq4MIS2s4fip_0 2024-09-12T01:11:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4852946810804498604', time=2024-09-12T03:01:51.477808+0000, chain.objs.size()=1 2024-09-12T01:11:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.e0HIBA7U3NyLxKo4zuwxSAgGUE0oUo1_0 2024-09-12T01:11:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1336431058200021687', time=2024-09-12T03:01:51.491321+0000, chain.objs.size()=1 2024-09-12T01:11:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3-mlF8M05WbD5C6hVfoP5tgu_8M6q-d_0 2024-09-12T01:11:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13603626041764238161', time=2024-09-12T03:01:51.667190+0000, chain.objs.size()=1 2024-09-12T01:11:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.igViTRMtloxHmEYKLg6b5ydOM-vz1sh_0 2024-09-12T01:11:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3017411774946443350', time=2024-09-12T03:01:51.668990+0000, chain.objs.size()=1 2024-09-12T01:11:23.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gPBvBL7clByedNiIzzwbnHMVXg8_trg_0 2024-09-12T01:11:23.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7219534222921791555', time=2024-09-12T03:01:51.670536+0000, chain.objs.size()=1 2024-09-12T01:11:23.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ABOZ7iiRw7LIo8G2v5RrPimagVf5yZT_0 2024-09-12T01:11:23.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7093564414751639389', time=2024-09-12T03:01:51.672105+0000, chain.objs.size()=1 2024-09-12T01:11:23.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.774+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zkKF7HnR1gnxKxUAsWR_P0Gz__fq8rk_0 2024-09-12T01:11:23.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.778+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14356740835524615418', time=2024-09-12T03:01:51.678505+0000, chain.objs.size()=1 2024-09-12T01:11:23.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.778+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.UPpL44LpwbMK82oeT2WoX8CS8r0_PCn_0 2024-09-12T01:11:23.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.778+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15005673014229505345', time=2024-09-12T03:01:51.721321+0000, chain.objs.size()=1 2024-09-12T01:11:23.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.778+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.RHUwtFw_tinq7UWA8G0hI5SZheGrSbk_0 2024-09-12T01:11:23.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.778+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7217365859501756212', time=2024-09-12T03:01:51.737508+0000, chain.objs.size()=1 2024-09-12T01:11:23.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.778+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.5Q59_1cQ84PpmYz-Jz9l1NQweHpaZeD_0 2024-09-12T01:11:23.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.782+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/45268 2024-09-12T01:11:23.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:11:23.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3195030760029799652', time=2024-09-12T03:01:51.762017+0000, chain.objs.size()=1 2024-09-12T01:11:23.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.HvKFhlqStV_KX3kISXx_B-978ir_D-r_0 2024-09-12T01:11:23.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.842082801900476343', time=2024-09-12T03:01:51.765939+0000, chain.objs.size()=1 2024-09-12T01:11:23.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.XAAl_RU9rA7TT6tbVc4Hucxax4pcKwJ_0 2024-09-12T01:11:23.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1438609681667629940', time=2024-09-12T03:01:51.807732+0000, chain.objs.size()=1 2024-09-12T01:11:23.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1w95-j6Z44s1uR3Zbg6XjojTNjXiG6J_0 2024-09-12T01:11:23.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6873387884903465719', time=2024-09-12T03:01:52.086682+0000, chain.objs.size()=1 2024-09-12T01:11:23.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.wSa9j3aR4cL-l5KJzpfQuPQaEfl8CCQ_0 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6006411833280405434', time=2024-09-12T03:01:52.299247+0000, chain.objs.size()=1 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KEtEud6MmYV7We5ZVu4sfT6Nz59MSfk_0 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11902355691344118435', time=2024-09-12T03:02:16.104165+0000, chain.objs.size()=1 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.378__shadow_._ykpQq9MgtvpTc4_6G_u_R1voYvfEqc_0 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12401907354126588005', time=2024-09-12T03:02:17.286500+0000, chain.objs.size()=1 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.380__shadow_.TNmyrlCU9IPZXCqtR6FX63eXwwE9JDg_0 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11355282448451884110', time=2024-09-12T03:03:03.908829+0000, chain.objs.size()=1 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.466__shadow_.p_RkZphhSR_bXA0D-FBpW-QSIk8t7BV_0 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8226822978393910105', time=2024-09-12T03:03:16.125058+0000, chain.objs.size()=1 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.497__shadow_.dq-ZV1YVnVnXwlvm7zOsM3r4BkPh2FC_0 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18318961435852147129', time=2024-09-12T03:03:49.045046+0000, chain.objs.size()=2 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.529__multipart_mymultipart.2~EgkJwAnShRp49Rd1RU_L7n68plz89e2.1 2024-09-12T01:11:23.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.529__multipart_mymultipart.2~EgkJwAnShRp49Rd1RU_L7n68plz89e2.2 2024-09-12T01:11:23.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6270278029329776689', time=2024-09-12T03:04:09.342571+0000, chain.objs.size()=1 2024-09-12T01:11:23.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.538__shadow_.cKEOiq3FoqiZ3pqfZepjY6tnEWNin3l_0 2024-09-12T01:11:23.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.788+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10893385556834724058', time=2024-09-12T03:04:47.270603+0000, chain.objs.size()=1 2024-09-12T01:11:23.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.788+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.571__shadow:V0-5rekpNyAVX87421BD7vUq1b5W3vV_.NcvgCO6mevNvRhJLfaAm8Khqz9Ni4Wf_0 2024-09-12T01:11:23.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.788+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4546318099662039330', time=2024-09-12T03:05:04.826748+0000, chain.objs.size()=1 2024-09-12T01:11:23.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.788+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:EGD8thPsDhiIFUZ8VYmyLMphRXZSOAu_.W0a3YREx9UF6T1_xLj7qBOvUJzDPAYl_0 2024-09-12T01:11:23.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.788+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8091289648473312598', time=2024-09-12T03:05:14.143326+0000, chain.objs.size()=1 2024-09-12T01:11:23.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.788+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:KODN.8dZDpGzIgch7yFt-tCcoP7nMV6_.tgb73D62C7eSPLCpdH7jpLDdHwIXAd7_0 2024-09-12T01:11:23.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.789+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3472037434041851481', time=2024-09-12T03:05:25.244565+0000, chain.objs.size()=1 2024-09-12T01:11:23.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.789+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.605__shadow_.tzmRLVFluXE_J1sK2jz_KzgvPcBFAMn_0 2024-09-12T01:11:23.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.789+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8468727773944318292', time=2024-09-12T03:07:53.231794+0000, chain.objs.size()=1 2024-09-12T01:11:23.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.789+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.648__shadow_.PAM6oqBzZO92pEOdWETT0qjHqza72UC_0 2024-09-12T01:11:23.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.793+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.795+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:11:23.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.796+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=99, truncated=0, next_marker='' 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4600155042661854858', time=2024-09-12T02:58:51.978179+0000, chain.objs.size()=1 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.159__shadow_.3u-7jbfIjOf5nk5XkTFsWI2q5-xIk97_0 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7164367066601292925', time=2024-09-12T03:00:38.432099+0000, chain.objs.size()=1 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.238__shadow_.RaFySblqipMSXV7rwpSiYDh60M4jm5I_0 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9287589458022569515', time=2024-09-12T03:00:39.671535+0000, chain.objs.size()=1 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.240__shadow_.ik0Gn6Pb2CHdeGR5zZERHauCFWpXNfK_0 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1101625890557649838', time=2024-09-12T03:00:49.295234+0000, chain.objs.size()=1 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.259__shadow_.KNKQssHhJfaUDYu7ZJ6yg7hLIrD7YK4_0 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1931430111654790316', time=2024-09-12T03:00:58.870672+0000, chain.objs.size()=1 2024-09-12T01:11:23.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.797+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KspviGLkH9Vv0wzOq6rx5Xi086PrxKY_0 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2068358457869757459', time=2024-09-12T03:00:59.027400+0000, chain.objs.size()=1 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Tg_LCPx-rsFoA_ybLeWdJN5Z-V423GN_0 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16616004627556163425', time=2024-09-12T03:00:59.147499+0000, chain.objs.size()=1 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BMv6ymx6niwTKv9Te_j1DMMWbgx9R1v_0 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2878334367045529234', time=2024-09-12T03:00:59.542695+0000, chain.objs.size()=1 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.YNQYME3d8o468jmx-ToiBUEuC9bVmSH_0 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4993846959107507725', time=2024-09-12T03:00:59.754355+0000, chain.objs.size()=1 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CZcgFM--KXJrlKXZQBEneyA6BDZH_ff_0 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9834554492661961270', time=2024-09-12T03:00:59.837931+0000, chain.objs.size()=1 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FpH_885ZaBeRQGs-khcRI1HFnQCvxPD_0 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11364190707684072855', time=2024-09-12T03:00:59.926035+0000, chain.objs.size()=1 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.nHDmzylmRueBxKO_7v55DN0kmYlRDsk_0 2024-09-12T01:11:23.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15782212098682482405', time=2024-09-12T03:00:59.936099+0000, chain.objs.size()=1 2024-09-12T01:11:23.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.798+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.s9ilPWIWxbjJ2f3Vm2ZZyXtkM_0c3b5_0 2024-09-12T01:11:23.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14182071798798714680', time=2024-09-12T03:00:59.989623+0000, chain.objs.size()=1 2024-09-12T01:11:23.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7uIVAjdaXgVLaqQSX-jm2WPOrKPtZG0_0 2024-09-12T01:11:23.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5278934108237082689', time=2024-09-12T03:01:00.246549+0000, chain.objs.size()=1 2024-09-12T01:11:23.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1WD7RGBTG9AwT-I-iMkfz4XdEP3IiOf_0 2024-09-12T01:11:23.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7318402422900887764', time=2024-09-12T03:01:00.328738+0000, chain.objs.size()=1 2024-09-12T01:11:23.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5t50lyOUWj2fQqNhqWiWQyUURgcszqc_0 2024-09-12T01:11:23.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4051643275116089923', time=2024-09-12T03:01:00.373653+0000, chain.objs.size()=1 2024-09-12T01:11:23.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UTCYSpQfPqYivoW3htXiWEudlxXdjRl_0 2024-09-12T01:11:23.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12823129451133717938', time=2024-09-12T03:01:00.422371+0000, chain.objs.size()=1 2024-09-12T01:11:23.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6Cp0UJBcnAIJx33HU2lIcf0HtnuoA2Y_0 2024-09-12T01:11:23.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.801+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13658341254466868876', time=2024-09-12T03:01:00.493696+0000, chain.objs.size()=1 2024-09-12T01:11:23.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.802+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.IReVj6HSF9Utpg7oleb2RyPfLosd2S5_0 2024-09-12T01:11:23.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.802+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7321721548061235364', time=2024-09-12T03:01:00.600401+0000, chain.objs.size()=1 2024-09-12T01:11:23.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.802+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.gQ_u-OzsZykv-Afh8XKT1t1dIeXzeLQ_0 2024-09-12T01:11:23.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.802+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9747995090965058283', time=2024-09-12T03:01:00.673468+0000, chain.objs.size()=1 2024-09-12T01:11:23.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.802+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cy6AtCVsm3xBXCIuRnizbIT4fYAsrug_0 2024-09-12T01:11:23.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.803+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14162117304045728603', time=2024-09-12T03:01:00.686989+0000, chain.objs.size()=1 2024-09-12T01:11:23.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.803+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2O7rLczZq_xWCrOf_3Mkd4J28_OMyTL_0 2024-09-12T01:11:23.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.803+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3095426287372841522', time=2024-09-12T03:01:00.893165+0000, chain.objs.size()=1 2024-09-12T01:11:23.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.804+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BYhZG8NO7HYgN547v-rdsXwlbx8AE0H_0 2024-09-12T01:11:23.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.804+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2968036352185522791', time=2024-09-12T03:01:04.654654+0000, chain.objs.size()=1 2024-09-12T01:11:23.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.804+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.271__shadow_.Hhh8klWQKmliKov8aFFjT3T0Jhp3mCC_0 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11410472265197162796', time=2024-09-12T03:01:15.870770+0000, chain.objs.size()=1 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.dezkpY2e9jl2gRnrsbT9V75W8_fzrMC_0 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18212265210171297006', time=2024-09-12T03:01:16.644727+0000, chain.objs.size()=1 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.u7V2llfBMT_wim6pV4wcMhZrMsLvU5T_0 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17692525791136619693', time=2024-09-12T03:01:16.656927+0000, chain.objs.size()=1 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.DLpBSDdoUnU0JtPey9aCHT3S2LrMsOM_0 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1566261871757786290', time=2024-09-12T03:01:18.063315+0000, chain.objs.size()=1 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.297__shadow_.ZFoWBfnx6ZbN5arYr_yncLYaT8wwZBX_0 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1645564648231001856', time=2024-09-12T03:01:21.513894+0000, chain.objs.size()=1 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.304__shadow_.mdfw4mitWczZl6lsmSXGrGzdlJ9Vfee_0 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10733004128388566934', time=2024-09-12T03:01:40.149314+0000, chain.objs.size()=1 2024-09-12T01:11:23.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hg0_DD15MHY1314lS9EUBL6gMz7s7uC_0 2024-09-12T01:11:23.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13963449582533513280', time=2024-09-12T03:01:40.216911+0000, chain.objs.size()=1 2024-09-12T01:11:23.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.xfymcyGpW05gE1BEA8axaz3h41aKU7T_0 2024-09-12T01:11:23.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1851541473435457755', time=2024-09-12T03:01:40.223104+0000, chain.objs.size()=1 2024-09-12T01:11:23.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.806+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Cg7nZnRYYqLP2739RscsRWehrGrrT2G_0 2024-09-12T01:11:23.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.807+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8898473661029985509', time=2024-09-12T03:01:40.377122+0000, chain.objs.size()=1 2024-09-12T01:11:23.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.807+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.R8Dt8S0UWziT8UYZBc9t-2jeUHkt1Uq_0 2024-09-12T01:11:23.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.807+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.948045351231529028', time=2024-09-12T03:01:40.562847+0000, chain.objs.size()=1 2024-09-12T01:11:23.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.807+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.56P4iro_ZAENoJhsT2nTaY6ONs2hpnb_0 2024-09-12T01:11:23.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.809+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16754436191875807803', time=2024-09-12T03:01:40.668560+0000, chain.objs.size()=1 2024-09-12T01:11:23.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.809+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.DKfXDLLZT85h5Ats1vOCFQr1r6ur7D4_0 2024-09-12T01:11:23.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.810+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14154630881241067011', time=2024-09-12T03:01:40.823064+0000, chain.objs.size()=1 2024-09-12T01:11:23.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.810+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.XZKW3W9EEsowwrCpRe6IopgWt_WzC1I_0 2024-09-12T01:11:23.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16662657880890210383', time=2024-09-12T03:01:40.949989+0000, chain.objs.size()=1 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-LRhT7nlZyETUKIz69fPNTID5r2eV-I_0 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7195206876076114426', time=2024-09-12T03:01:41.000225+0000, chain.objs.size()=1 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Pih7nmiffx8AgaX3YnMSHZvvopTtwZJ_0 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14440443836131295974', time=2024-09-12T03:01:41.085134+0000, chain.objs.size()=1 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WhJgKY-iLERZ26mBfGL--YgTuUTymJA_0 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6593346378283552595', time=2024-09-12T03:01:41.089037+0000, chain.objs.size()=1 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Oc1jTU47EBy14hf0-ciIQOLsZ8Kazlo_0 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6347763182894476749', time=2024-09-12T03:01:41.233719+0000, chain.objs.size()=1 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.m_c78QQVwDqsaptRUjamTO4qPMjot0z_0 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9170547694006245970', time=2024-09-12T03:01:41.321803+0000, chain.objs.size()=1 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5OFx1KnTFL7UU8FBCWp8I8C-pKGLsM4_0 2024-09-12T01:11:23.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12981943152709056548', time=2024-09-12T03:01:41.334413+0000, chain.objs.size()=1 2024-09-12T01:11:23.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5J7wI0OHkSGF1udtu-b5Hj4WH35QCE5_0 2024-09-12T01:11:23.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11368249610243004866', time=2024-09-12T03:01:41.468490+0000, chain.objs.size()=1 2024-09-12T01:11:23.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ENBVjCu5lbConKcP_j8PVLlWknIwg8T_0 2024-09-12T01:11:23.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.814+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3304697346059894298', time=2024-09-12T03:01:41.608056+0000, chain.objs.size()=1 2024-09-12T01:11:23.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.814+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.L-tIsScdv9YVK5V8woPcqE7xOkHQhYb_0 2024-09-12T01:11:23.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10117503704157918995', time=2024-09-12T03:01:41.611303+0000, chain.objs.size()=1 2024-09-12T01:11:23.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Wzx-mo1vxJ_uf2TTl5CrjfMdXAQdXvr_0 2024-09-12T01:11:23.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15247204969341248678', time=2024-09-12T03:01:42.035784+0000, chain.objs.size()=1 2024-09-12T01:11:23.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fwQPC8Te16godgIkjLCuyOLFgnjPI-V_0 2024-09-12T01:11:23.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.816+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11020122400626727370', time=2024-09-12T03:01:42.070401+0000, chain.objs.size()=1 2024-09-12T01:11:23.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.816+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.l0LdFCi_jglO-pU6L95g1Jt1Vnca2-g_0 2024-09-12T01:11:23.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16651229854148843287', time=2024-09-12T03:01:42.087803+0000, chain.objs.size()=1 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.v9Dd_tPtenXh92zZKjOxviVCsDDsF1M_0 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13335774430621436555', time=2024-09-12T03:01:42.096155+0000, chain.objs.size()=1 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hMKNzGqMTNl45HavhVbKUL3MT34lixS_0 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17834992633362712629', time=2024-09-12T03:01:50.257799+0000, chain.objs.size()=1 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Z8oAqU_rQwg3gMF71mKtxcRvCDQ6ISC_0 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5718171927998094039', time=2024-09-12T03:01:50.357945+0000, chain.objs.size()=1 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.f8aF8S5yzPa4BXFJvqd2j2n-ntEikRt_0 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2917988987270327185', time=2024-09-12T03:01:50.365794+0000, chain.objs.size()=1 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gKdrSk-J4VxMWzdoj1clnssZPrCL7nu_0 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12062868289117944799', time=2024-09-12T03:01:50.393961+0000, chain.objs.size()=1 2024-09-12T01:11:23.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9Jlk-3nir81M9-FGNY5rR7rpVNDQ2gN_0 2024-09-12T01:11:23.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1994195472473546900', time=2024-09-12T03:01:50.541975+0000, chain.objs.size()=1 2024-09-12T01:11:23.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qxtxSGEe86yvhfEB3nJ4tIwBBHTRn1d_0 2024-09-12T01:11:23.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7747793160656621941', time=2024-09-12T03:01:50.546542+0000, chain.objs.size()=1 2024-09-12T01:11:23.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.817+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gwYDQsuYBjPApI3av_IN9kcV_TPLCAY_0 2024-09-12T01:11:23.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.818+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13978404861589147730', time=2024-09-12T03:01:50.600625+0000, chain.objs.size()=1 2024-09-12T01:11:23.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.818+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._gVGrCNALTV1iVP0aj1EtXTdWksmP_b_0 2024-09-12T01:11:23.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5535945897307645223', time=2024-09-12T03:01:50.604268+0000, chain.objs.size()=1 2024-09-12T01:11:23.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jwF7hOBlsM5VH8LimLk3rgEPT4B0aYv_0 2024-09-12T01:11:23.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8928995640437763010', time=2024-09-12T03:01:50.860082+0000, chain.objs.size()=1 2024-09-12T01:11:23.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Pw_coJsJJ63rJdbPFK_V1AT1gjC0T-E_0 2024-09-12T01:11:23.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10534804914165213515', time=2024-09-12T03:01:50.905164+0000, chain.objs.size()=1 2024-09-12T01:11:23.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.SSBndvTgGuIW7yFGyCVrUdUQefXZPSJ_0 2024-09-12T01:11:23.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14450391704627833343', time=2024-09-12T03:01:50.919473+0000, chain.objs.size()=1 2024-09-12T01:11:23.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Yn5qJ97xtU5ajpUlhP_eJlg7j2JbMTs_0 2024-09-12T01:11:23.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11371717475579744958', time=2024-09-12T03:01:50.970413+0000, chain.objs.size()=1 2024-09-12T01:11:23.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-P0yePb74PtXmQhyaNx21gDL0wWcw8J_0 2024-09-12T01:11:23.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10009822325529207422', time=2024-09-12T03:01:51.151743+0000, chain.objs.size()=1 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hHIqrlIwOlIbtpb1ZNDaARqiu4DfjBh_0 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3694972752494640114', time=2024-09-12T03:01:51.153686+0000, chain.objs.size()=1 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8O6ztCZZy2Yy8Ip4GGvWE_9T5WQ8sYH_0 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17650488630829107350', time=2024-09-12T03:01:51.166643+0000, chain.objs.size()=1 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qoFGgt2UKZ_-2PhSmSmx7K56_ic46Rn_0 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10751543967955557496', time=2024-09-12T03:01:51.414178+0000, chain.objs.size()=1 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Vw0ZIXee2peSPJzwPAtb7tYTfVrK-JL_0 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7920999549856386714', time=2024-09-12T03:01:51.463360+0000, chain.objs.size()=1 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tkHfYXo3add57NVJzHIyMuyaDKjHreK_0 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.840984808541295202', time=2024-09-12T03:01:51.632526+0000, chain.objs.size()=1 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.824+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KvTbh7koe4LugRBTQamAfQOMKB52aOV_0 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.825+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16292939162695512704', time=2024-09-12T03:01:51.676821+0000, chain.objs.size()=1 2024-09-12T01:11:23.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.825+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Q7wh8BXqgF_v4_BDYVh2kHCV84FiT5K_0 2024-09-12T01:11:23.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.828+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15001092687823032251', time=2024-09-12T03:01:51.749707+0000, chain.objs.size()=1 2024-09-12T01:11:23.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.828+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jZT0wthhfRB7GVbqJB04h7rrCijO4ag_0 2024-09-12T01:11:23.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15024651328291505800', time=2024-09-12T03:01:51.800060+0000, chain.objs.size()=1 2024-09-12T01:11:23.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uKx7nrHxYywB6CJ4Xx5kP5GDwOTeVK4_0 2024-09-12T01:11:23.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16076988694694065724', time=2024-09-12T03:01:52.028131+0000, chain.objs.size()=1 2024-09-12T01:11:23.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.bSVQHD_egyPTiovlQddBB8_v1hq2mRe_0 2024-09-12T01:11:23.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15786596633177637777', time=2024-09-12T03:01:52.178625+0000, chain.objs.size()=1 2024-09-12T01:11:23.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pvLzC7IOOAul6s0Lzu7zwuBSMu7qKcX_0 2024-09-12T01:11:23.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3126638016008633540', time=2024-09-12T03:01:52.191284+0000, chain.objs.size()=1 2024-09-12T01:11:23.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QVyGMTYXqgr7jXgTpy4meKEkTUUriKD_0 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9553765355234290308', time=2024-09-12T03:01:52.209427+0000, chain.objs.size()=1 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JHarvv5BoFvYFjLzaT0YNX0C9LMHS2K_0 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13951065733405471808', time=2024-09-12T03:01:52.312328+0000, chain.objs.size()=1 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.aRLFB19AFfIqRHfwYPurzu2W881dh6N_0 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8103960283401866308', time=2024-09-12T03:01:54.476570+0000, chain.objs.size()=1 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.330__shadow_.emVOUZpvOflAhEpAA00aEw_V4b8reV1_0 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12988990373016054680', time=2024-09-12T03:01:55.932096+0000, chain.objs.size()=1 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.333__shadow_.p1OMXtgegYZU4u_9q66yDGaus1Lgpfm_0 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13694801085512547021', time=2024-09-12T03:02:18.173894+0000, chain.objs.size()=1 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.382__shadow_.s-NweuVWagv8F8Nl8qOy04iHf5fSKsP_0 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3726187796871131564', time=2024-09-12T03:02:26.203067+0000, chain.objs.size()=1 2024-09-12T01:11:23.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.395__shadow:TNcz7liXL9WFmV6V9LnOSb1rxFarg6D_.DpSC7x51vAIiwHbvo9RGR84-ECOj6bY_0 2024-09-12T01:11:23.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.834+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11286936036753008279', time=2024-09-12T03:03:02.027782+0000, chain.objs.size()=1 2024-09-12T01:11:23.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.834+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.463__shadow_.NDhZy1UhtSJuov-sgd_8qt41HdQ3TjM_0 2024-09-12T01:11:23.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.834+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7744637251973203700', time=2024-09-12T03:03:10.611853+0000, chain.objs.size()=1 2024-09-12T01:11:23.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.834+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.485__shadow_.Ri9tsjlJiE2HoxQDTvFav7q-W3F-T9A_0 2024-09-12T01:11:23.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.835+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6739153290241911240', time=2024-09-12T03:03:12.237056+0000, chain.objs.size()=1 2024-09-12T01:11:23.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.835+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.488__shadow_.PzIqFoAFJh0FNYMTL9xM43DyFWd_ME8_0 2024-09-12T01:11:23.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.835+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5118302603363173715', time=2024-09-12T03:03:14.498477+0000, chain.objs.size()=1 2024-09-12T01:11:23.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.835+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.492__shadow_._TQb6I8IMGRr6X-uV3vhHSnIWU-F-_m_0 2024-09-12T01:11:23.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.835+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.912155829733687252', time=2024-09-12T03:03:16.836788+0000, chain.objs.size()=1 2024-09-12T01:11:23.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.835+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.498__shadow_.AC1VETcnN-aSKRCpW2qWtFuA1iBwEzV_0 2024-09-12T01:11:23.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.836+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18380842769519357227', time=2024-09-12T03:03:16.935693+0000, chain.objs.size()=1 2024-09-12T01:11:23.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.499__shadow_.9cg7y97FG7U6nRxs0tp43CArY47pzwB_0 2024-09-12T01:11:23.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.836+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3466425283060171888', time=2024-09-12T03:03:16.936403+0000, chain.objs.size()=1 2024-09-12T01:11:23.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.499__shadow_.9cg7y97FG7U6nRxs0tp43CArY47pzwB_0 2024-09-12T01:11:23.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.836+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10987759259557969030', time=2024-09-12T03:03:21.916804+0000, chain.objs.size()=6 2024-09-12T01:11:23.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.1 2024-09-12T01:11:23.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.2 2024-09-12T01:11:23.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.3 2024-09-12T01:11:23.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.4 2024-09-12T01:11:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.839+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.5 2024-09-12T01:11:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.839+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.6 2024-09-12T01:11:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.839+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.972526826332218420', time=2024-09-12T03:03:45.273123+0000, chain.objs.size()=2 2024-09-12T01:11:23.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.839+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~2cY7F8O1aSolFTfjC6QSQ6S-W1DMbmZ.1 2024-09-12T01:11:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.840+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__shadow_mymultipart.2~2cY7F8O1aSolFTfjC6QSQ6S-W1DMbmZ.1_1 2024-09-12T01:11:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.840+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~Gmd4_F0pixdx8K2IniJJRwa11Ahc_YL', time=2024-09-12T03:03:50.794631+0000, chain.objs.size()=2 2024-09-12T01:11:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.840+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.532__multipart_mymultipart.2~Gmd4_F0pixdx8K2IniJJRwa11Ahc_YL.1 2024-09-12T01:11:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.840+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.532__multipart_mymultipart.2~Gmd4_F0pixdx8K2IniJJRwa11Ahc_YL.2 2024-09-12T01:11:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.840+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~OOam80B3o8e85SjenTdoEsX0ISGCWuL', time=2024-09-12T03:03:52.377217+0000, chain.objs.size()=1 2024-09-12T01:11:23.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.840+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.535__multipart_mymultipart.2~OOam80B3o8e85SjenTdoEsX0ISGCWuL.1 2024-09-12T01:11:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.841+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1134298613144229011', time=2024-09-12T03:04:38.359859+0000, chain.objs.size()=1 2024-09-12T01:11:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.565__shadow_.kJjQ2wz0rbCqxOIY-T6XKbr1K0DJmig_0 2024-09-12T01:11:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.841+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17380288367160722886', time=2024-09-12T03:05:00.042571+0000, chain.objs.size()=1 2024-09-12T01:11:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:2hA5Gh5S6o4SnBmXwrTuLGUy3ErZDIr_.KuEDJUEy2zpZnoCukefAws7O4i1qg3w_0 2024-09-12T01:11:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.841+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14486209327810508679', time=2024-09-12T03:05:03.280555+0000, chain.objs.size()=1 2024-09-12T01:11:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:L.RcLLRgOAbmc3cWO28bdhlV-OvMLWT_.q62ks6uyS_cd13Nrqb_rpxVkr4ljehl_0 2024-09-12T01:11:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.841+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2450891714998364378', time=2024-09-12T03:05:14.128118+0000, chain.objs.size()=1 2024-09-12T01:11:23.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:3mUPU-2OVEoJFI-RDWClFif0H7LANvP_.y8tZV7qVzJ7pGdC2LPRpxJi6DvO5sGI_0 2024-09-12T01:11:23.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.843+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12067389995204535546', time=2024-09-12T03:05:35.974624+0000, chain.objs.size()=1 2024-09-12T01:11:23.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.843+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.617__shadow_.sFJ6zpOEZ1jKDlX45KxUmqsRV845RPQ_0 2024-09-12T01:11:23.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.843+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3882280035547245610', time=2024-09-12T03:07:43.283676+0000, chain.objs.size()=1 2024-09-12T01:11:23.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.843+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.627__shadow_.QgED_WcXG1hTSvFVB321a-wRuIZUZ19_0 2024-09-12T01:11:23.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.844+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11961302495707142315', time=2024-09-12T03:07:49.081858+0000, chain.objs.size()=1 2024-09-12T01:11:23.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.844+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.640__shadow_.xQOVKBMZ_EzMbHpHY8J7atH8nZEWDpi_0 2024-09-12T01:11:23.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.846+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8385979229914040810', time=2024-09-12T03:08:01.781079+0000, chain.objs.size()=1 2024-09-12T01:11:23.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.846+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.664__shadow_.MSXcXO5Na-l4c_0CknYUabFScvr1AQQ_0 2024-09-12T01:11:23.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.846+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14129045011082346085', time=2024-09-12T03:08:08.760581+0000, chain.objs.size()=1 2024-09-12T01:11:23.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.846+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.680__shadow_.EevYxBy3nQztuXDz1xytZtA5QmJt6GR_0 2024-09-12T01:11:23.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.848+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.851+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:11:23.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49981' 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_kegsTtLNrthPVpGc9nvlq_E_GYmlfPv', time=2024-09-12T02:58:57.006241+0000, chain.objs.size()=3 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.166__shadow_.M9dmwuM8OoymzD7XyVYNh-B4bTsj0AK_0 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.166__shadow_.M9dmwuM8OoymzD7XyVYNh-B4bTsj0AK_1 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.166__shadow_.M9dmwuM8OoymzD7XyVYNh-B4bTsj0AK_2 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9488550673511215585', time=2024-09-12T03:00:35.270634+0000, chain.objs.size()=1 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.232__shadow_.YbcxtmfJAN7qhxiSDB-T5I5HMjpKNg5_0 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16583004082582915637', time=2024-09-12T03:00:41.888219+0000, chain.objs.size()=1 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.244__shadow_.JAIUI3RzQjc6g_AAEynnjxePSfgZf4X_0 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6176084864822131780', time=2024-09-12T03:00:41.889641+0000, chain.objs.size()=1 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.244__shadow_.36kLjC3GlZy_A0ANp7Cly2rCeXRIi_e_0 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15158524185091737435', time=2024-09-12T03:00:41.892836+0000, chain.objs.size()=1 2024-09-12T01:11:23.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.244__shadow_.p0cnbW5oOep0gNXgihzpDGW22iYPaVe_0 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10252608246958033286', time=2024-09-12T03:00:42.723489+0000, chain.objs.size()=1 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.245__shadow_.aTfTBvicsjEAs1JJHCl7bdS376tCttU_0 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3600867171645470357', time=2024-09-12T03:00:58.914797+0000, chain.objs.size()=1 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UAy8F6dLa_0zXZLRzSjqRPRzkLiQW21_0 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15998838069393955506', time=2024-09-12T03:00:58.923225+0000, chain.objs.size()=1 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.gbgn3XkvKLarOvsgSCPXEVbQSGP3vM9_0 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8557064393328713590', time=2024-09-12T03:00:58.939264+0000, chain.objs.size()=1 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5gabWTZjDXLDVcpEu3nTKZ9UklCvdVp_0 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5884369683179016990', time=2024-09-12T03:00:58.942563+0000, chain.objs.size()=1 2024-09-12T01:11:23.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ArSFjV27nWAkP8saL-RrT7p2ynMpSiD_0 2024-09-12T01:11:23.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.856+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9354076308276566397', time=2024-09-12T03:00:59.129488+0000, chain.objs.size()=1 2024-09-12T01:11:23.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.0aF3gcqxHMc-q61FN0nn6gg24lDKtGP_0 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12107783355585215915', time=2024-09-12T03:00:59.140676+0000, chain.objs.size()=1 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.btpp4fbPffvHqWb00eYaQ2DrRSGJnO6_0 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3662676293462447877', time=2024-09-12T03:00:59.223152+0000, chain.objs.size()=1 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sSSF9ic-MD-OOGDSfN_CckqnXIrNmqP_0 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12264753670689104378', time=2024-09-12T03:00:59.252095+0000, chain.objs.size()=1 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.th7uvZqxCrYJY2EH0SilA0z8X2IZljd_0 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2505713972008575331', time=2024-09-12T03:00:59.294999+0000, chain.objs.size()=1 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.iFVGM5WY27sCLJ9ODyry-7dfHZgv2RM_0 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14361477807056631691', time=2024-09-12T03:00:59.297718+0000, chain.objs.size()=1 2024-09-12T01:11:23.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.857+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.x_DtMdjVv7HP2IBWIqqWv-D2XlT4kWZ_0 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11676021854639234792', time=2024-09-12T03:00:59.308558+0000, chain.objs.size()=1 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-k9jKNKa9z8J-rCH2B3nckPLVCbWuz5_0 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17033422030222984769', time=2024-09-12T03:00:59.663278+0000, chain.objs.size()=1 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7BQdKTrq7YnQZ9e1_d-rBkLttcERXhp_0 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3430504835408306459', time=2024-09-12T03:00:59.668659+0000, chain.objs.size()=1 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1zndjN95ZJ9ruatVMQYY3Trv_aJYXEQ_0 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16026558473398075666', time=2024-09-12T03:00:59.685186+0000, chain.objs.size()=1 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JM3x0fLWSL372F1mxgdnQ82ZMeRqXC-_0 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2511954752207910220', time=2024-09-12T03:00:59.720709+0000, chain.objs.size()=1 2024-09-12T01:11:23.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.858+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Q9LqIr5f2VAQZs-rH2yCe7cdm3fc_j__0 2024-09-12T01:11:23.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.862+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4640723716389533142', time=2024-09-12T03:00:59.764974+0000, chain.objs.size()=1 2024-09-12T01:11:23.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.862+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ygtpqb-9k1jeBM2vaW5yWXDZ8P4ov7t_0 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10884336067235243768', time=2024-09-12T03:00:59.790819+0000, chain.objs.size()=1 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.N4ZBXdXwSgA6xNW_T8zqKmEI18GLj8J_0 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11846634527151722159', time=2024-09-12T03:00:59.821738+0000, chain.objs.size()=1 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.spmqUfmp2yXy2GD_FzkuKRB0MYfsmR3_0 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9349248145285297126', time=2024-09-12T03:00:59.852259+0000, chain.objs.size()=1 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-_kaW7IGy0vs0e5tG51bmBGo8HzWArm_0 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6744349749560886817', time=2024-09-12T03:00:59.928194+0000, chain.objs.size()=1 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.s7HKtQzUPswC9sq85TmT-nTILi_jZxI_0 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.282801746934851121', time=2024-09-12T03:00:59.996938+0000, chain.objs.size()=1 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.idDCMWIP-KEcOXBijyGaPe6W2H0Fkxw_0 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13135946485481913057', time=2024-09-12T03:01:00.017617+0000, chain.objs.size()=1 2024-09-12T01:11:23.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sYAeDfhBDh6FKFchdhKQINcqLAHXj5C_0 2024-09-12T01:11:23.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.864+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18304085079585677688', time=2024-09-12T03:01:00.065036+0000, chain.objs.size()=1 2024-09-12T01:11:23.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.864+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hHg2ysW6d6SyaVJj877rhVPVWEnkdh7_0 2024-09-12T01:11:23.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.864+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8036401546951695406', time=2024-09-12T03:01:00.088711+0000, chain.objs.size()=1 2024-09-12T01:11:23.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.864+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.d6dUDsV4osZ00yB241dZQN768lDXAgq_0 2024-09-12T01:11:23.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.864+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17243644397250776521', time=2024-09-12T03:01:00.352640+0000, chain.objs.size()=1 2024-09-12T01:11:23.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.864+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.yzTufT0U-2rgYlYJJdr2OsggQvw2das_0 2024-09-12T01:11:23.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.864+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7171964038434274051', time=2024-09-12T03:01:00.363291+0000, chain.objs.size()=1 2024-09-12T01:11:23.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.864+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6R6WgLyuI31-6nYFCk7lNdVO9xP9kNN_0 2024-09-12T01:11:23.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5161161899859160278', time=2024-09-12T03:01:00.420395+0000, chain.objs.size()=1 2024-09-12T01:11:23.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JK7clZINnx0jj45vDEgWS1EKraxrLRU_0 2024-09-12T01:11:23.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5389164531248665168', time=2024-09-12T03:01:00.430123+0000, chain.objs.size()=1 2024-09-12T01:11:23.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.zZFY6Zl9iSRdR9jSjzgc6jCNdnXzPzS_0 2024-09-12T01:11:23.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10990620649291726974', time=2024-09-12T03:01:00.441951+0000, chain.objs.size()=1 2024-09-12T01:11:23.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.biRxJYoqqz9EvdAL5azk8--oUDPvI7G_0 2024-09-12T01:11:23.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9773026027679203126', time=2024-09-12T03:01:00.465236+0000, chain.objs.size()=1 2024-09-12T01:11:23.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.OqvPFsNljGBoSTq0fNMMWoYr-x-XTuC_0 2024-09-12T01:11:23.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5106362758543808611', time=2024-09-12T03:01:00.470516+0000, chain.objs.size()=1 2024-09-12T01:11:23.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.867+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1RWnYKOY6NDs4n4WCEyWeio4d1pPLAH_0 2024-09-12T01:11:23.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9804293140351694820', time=2024-09-12T03:01:00.609750+0000, chain.objs.size()=1 2024-09-12T01:11:23.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.nWGeBoH9U5BRb5BF3apWdGF_3HtCYuL_0 2024-09-12T01:11:23.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14004824505241297683', time=2024-09-12T03:01:00.687525+0000, chain.objs.size()=1 2024-09-12T01:11:23.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2NNROKuF6FF6d39HT4Gvho-SLZap9sx_0 2024-09-12T01:11:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1990662565790586797', time=2024-09-12T03:01:00.696759+0000, chain.objs.size()=1 2024-09-12T01:11:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.g_yFUQSRT3kj2lR_lOmkUYiFzkNw6fs_0 2024-09-12T01:11:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5361957704125414023', time=2024-09-12T03:01:00.715094+0000, chain.objs.size()=1 2024-09-12T01:11:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._luivqu1ouf6VVz-kVLxWVjB_TqNmwv_0 2024-09-12T01:11:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5175045479551160119', time=2024-09-12T03:01:00.732213+0000, chain.objs.size()=1 2024-09-12T01:11:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qEkkiPpmuDZympQ3YBlirEhuIWkCGxS_0 2024-09-12T01:11:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.868+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12379794436733180328', time=2024-09-12T03:01:00.859255+0000, chain.objs.size()=1 2024-09-12T01:11:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.869+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ufKWyhK8HPNu5hC3ct1ACRSzmDT5V24_0 2024-09-12T01:11:23.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.871+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9625792249847256402', time=2024-09-12T03:01:00.859853+0000, chain.objs.size()=1 2024-09-12T01:11:23.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.871+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.c-rvYrRW9iyNrYo1xoqFL-T7MM7K00O_0 2024-09-12T01:11:23.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.871+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10902539571723753217', time=2024-09-12T03:01:00.890586+0000, chain.objs.size()=1 2024-09-12T01:11:23.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.871+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mOTD27b0oKgyLMpbULTs94jO3fYdJmU_0 2024-09-12T01:11:23.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.871+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16080688700534791016', time=2024-09-12T03:01:00.959629+0000, chain.objs.size()=1 2024-09-12T01:11:23.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.871+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FDIdeOiYgLiteBWCOhQmlKQO1uVvFTK_0 2024-09-12T01:11:23.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.873+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.398652616722363132', time=2024-09-12T03:01:00.986093+0000, chain.objs.size()=1 2024-09-12T01:11:23.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.873+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZC06wX6GD8hQIgw7mDKK-Odb0L5ChOi_0 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7255386863246836703', time=2024-09-12T03:01:01.435566+0000, chain.objs.size()=1 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.264__shadow_.aJRiRUHhzOtglcuRXiR3uyLYpLr7uWh_0 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12048867558981232902', time=2024-09-12T03:01:04.654876+0000, chain.objs.size()=1 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.271__shadow_.3FjeBCyX16DM5T70xfXwxhZ7jbTjiph_0 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17364306095405901187', time=2024-09-12T03:01:06.546772+0000, chain.objs.size()=1 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.275__shadow_.5JsxV38epKjv8fUOc9oxm0gppE_SmhB_0 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3597547584772525362', time=2024-09-12T03:01:07.438306+0000, chain.objs.size()=1 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.277__shadow_.0OQ1ZZDPhJvvszZDrGogeuMIOP_bRuO_0 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6712555889387247859', time=2024-09-12T03:01:07.918061+0000, chain.objs.size()=1 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.278__shadow_.KxRphNolWmjlEKbPPHMwVLr0se1fXhC_0 2024-09-12T01:11:23.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13739095288123817695', time=2024-09-12T03:01:12.442924+0000, chain.objs.size()=1 2024-09-12T01:11:23.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.287__shadow_.kd2_Ywj7tONff2JcOtAJtgLqqaDXsBt_0 2024-09-12T01:11:23.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15622988114998047274', time=2024-09-12T03:01:15.854300+0000, chain.objs.size()=1 2024-09-12T01:11:23.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.TnWfM9t8aotuzqe3AeOP5GfFWkiIfqH_0 2024-09-12T01:11:23.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16077813330573067236', time=2024-09-12T03:01:15.862209+0000, chain.objs.size()=1 2024-09-12T01:11:23.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.3IodLHN7yaz8k_pSSBPo1rpwuBCItsz_0 2024-09-12T01:11:23.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3338533071139384634', time=2024-09-12T03:01:16.648382+0000, chain.objs.size()=1 2024-09-12T01:11:23.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.875+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.IscQsrXhW_yPWtTAHRGzx55i1IWocyn_0 2024-09-12T01:11:23.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.880+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.84718832746030370', time=2024-09-12T03:01:40.119587+0000, chain.objs.size()=1 2024-09-12T01:11:23.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.880+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.x5aHLP97D3cnJ9-K8G7-p-dIVGkwGLL_0 2024-09-12T01:11:23.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.880+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17196725738630744199', time=2024-09-12T03:01:40.143883+0000, chain.objs.size()=1 2024-09-12T01:11:23.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.880+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rltMd407pCWK_usebcqkaNWzXaHYlE1_0 2024-09-12T01:11:23.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.880+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11629056157169279958', time=2024-09-12T03:01:40.278568+0000, chain.objs.size()=1 2024-09-12T01:11:23.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.880+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7EklB1UbRxaOOuUNLk8DrFgfgalmg7v_0 2024-09-12T01:11:23.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.880+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.650303591821763834', time=2024-09-12T03:01:40.415062+0000, chain.objs.size()=1 2024-09-12T01:11:23.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.880+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.oGANu80VkRBH5us3aENPpTaBQfngugX_0 2024-09-12T01:11:23.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16035455859835470872', time=2024-09-12T03:01:40.499257+0000, chain.objs.size()=1 2024-09-12T01:11:23.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-i4HaRjUuXP2B7NjoJ7NVlhOJ7KxBNh_0 2024-09-12T01:11:23.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2749249006020488409', time=2024-09-12T03:01:40.666378+0000, chain.objs.size()=1 2024-09-12T01:11:23.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.xj6869YzyNJ8xvmp9FhRHnDjJF5kBWF_0 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14724140216722414142', time=2024-09-12T03:01:40.685469+0000, chain.objs.size()=1 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FNsQGs8ZxYBJCBU68kCbGur4bj-MD4o_0 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.58226373796020546', time=2024-09-12T03:01:40.736138+0000, chain.objs.size()=1 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rgud_2CF1r5o00VCxRajksYB-8IHq8e_0 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10044949312566147540', time=2024-09-12T03:01:40.750686+0000, chain.objs.size()=1 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PWO5bCWjdyOSGnWNkbHchRCeEbIWOWG_0 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14237139016890632049', time=2024-09-12T03:01:40.768065+0000, chain.objs.size()=1 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dtpPfXifo9PBIfDbD0z8MXhDa3J4IPK_0 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2993419820426548467', time=2024-09-12T03:01:40.778972+0000, chain.objs.size()=1 2024-09-12T01:11:23.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.881+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.348NBXrDvPquzkEVfsbINjOj_FwYJeM_0 2024-09-12T01:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.884+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9581387667860201981', time=2024-09-12T03:01:40.824034+0000, chain.objs.size()=1 2024-09-12T01:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.884+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ofv8Ecx38nHxsXL3E-ydjuSPn0h8wT3_0 2024-09-12T01:11:23.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.885+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9114538129092996800', time=2024-09-12T03:01:40.957161+0000, chain.objs.size()=1 2024-09-12T01:11:23.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.885+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qU-DjMitjB6aPLnR1RTl81CDcwS1qUo_0 2024-09-12T01:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6870011728573587798', time=2024-09-12T03:01:41.010466+0000, chain.objs.size()=1 2024-09-12T01:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wLMIxkDb32i_auGl3hEWdFAMcCJDV35_0 2024-09-12T01:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7434821390310769554', time=2024-09-12T03:01:41.039032+0000, chain.objs.size()=1 2024-09-12T01:11:23.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.9QGVpEMFr84ZayFA51FjQmB8mhO6lJF_0 2024-09-12T01:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11193308530307218541', time=2024-09-12T03:01:41.074457+0000, chain.objs.size()=1 2024-09-12T01:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.TsZbMav8Q3Glirt7MVgqorg5RJyFa1O_0 2024-09-12T01:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9345483918443541675', time=2024-09-12T03:01:41.077613+0000, chain.objs.size()=1 2024-09-12T01:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NUn-KxkXi3Xt_W_96z8ga7kKmA-Lmge_0 2024-09-12T01:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2490276226911151283', time=2024-09-12T03:01:41.175892+0000, chain.objs.size()=1 2024-09-12T01:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.RmeIcNC42Kc51G3VSzUiBESDunVkYyX_0 2024-09-12T01:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6618548724188838186', time=2024-09-12T03:01:41.180635+0000, chain.objs.size()=1 2024-09-12T01:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jL1PrT1VG48nr3vH8UKEMXNPr4K4T5E_0 2024-09-12T01:11:23.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16837909089956433056', time=2024-09-12T03:01:41.187555+0000, chain.objs.size()=1 2024-09-12T01:11:23.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.u1lvgVr1gMY1HU_7qRRmiZpe_KE-Eft_0 2024-09-12T01:11:23.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16282693238316085753', time=2024-09-12T03:01:41.266638+0000, chain.objs.size()=1 2024-09-12T01:11:23.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.irkE1amjVDBpJ1SrRyHhb6VZuizzSE0_0 2024-09-12T01:11:23.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2890794390162155875', time=2024-09-12T03:01:41.480778+0000, chain.objs.size()=1 2024-09-12T01:11:23.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.BFomPpvXIfWXd7g96lXfHffqcIbXwRV_0 2024-09-12T01:11:23.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16108712045985331333', time=2024-09-12T03:01:41.496673+0000, chain.objs.size()=1 2024-09-12T01:11:23.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.887+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tcb3qKwp5w57J3KWM8jkDPZbFt-6dOp_0 2024-09-12T01:11:23.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.890+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15637827920806823461', time=2024-09-12T03:01:41.524827+0000, chain.objs.size()=1 2024-09-12T01:11:23.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.890+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fms7SPW90F0AHci-NNTAAq0H-Knjz7q_0 2024-09-12T01:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.891+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10935714394948780573', time=2024-09-12T03:01:41.576476+0000, chain.objs.size()=1 2024-09-12T01:11:23.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.891+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wfn8V6G4gVqNOwSRtfCcj4yzqhXCa-e_0 2024-09-12T01:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9994648003574850619', time=2024-09-12T03:01:41.598071+0000, chain.objs.size()=1 2024-09-12T01:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GYfPTVOFF7nGYA38ZgIzTnQvT4a3yGf_0 2024-09-12T01:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4919989644630809892', time=2024-09-12T03:01:41.713083+0000, chain.objs.size()=1 2024-09-12T01:11:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ki5qc7czDqytBxD8OEVAQsrYtSqTAVa_0 2024-09-12T01:11:23.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3351614608804632170', time=2024-09-12T03:01:41.745698+0000, chain.objs.size()=1 2024-09-12T01:11:23.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7Z4sZWMTv9ELoZlvQ1cXzWI37CKpA5G_0 2024-09-12T01:11:23.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.248262717604470126', time=2024-09-12T03:01:41.819157+0000, chain.objs.size()=1 2024-09-12T01:11:23.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hDiAMnYpphbUhJTk0KJ73t4TGp0ifJ2_0 2024-09-12T01:11:23.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7015651876384268728', time=2024-09-12T03:01:41.845418+0000, chain.objs.size()=1 2024-09-12T01:11:23.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.892+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ika-6uLJWHNHd3BnSBpwtJNWgfSeERF_0 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16827827112204089484', time=2024-09-12T03:01:42.021898+0000, chain.objs.size()=1 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1B_eqA4zb64gSnW2n8kSYwc6O_raYCA_0 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16128819253790531146', time=2024-09-12T03:01:42.037569+0000, chain.objs.size()=1 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ohlknfgk79scMEP7QRrFnXJWZhDNawk_0 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.253778239655766531', time=2024-09-12T03:01:42.058851+0000, chain.objs.size()=1 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qQf_YiCl2lnuWwN79LrDRYpjsCiA53K_0 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13405631067718967760', time=2024-09-12T03:01:42.068833+0000, chain.objs.size()=1 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eT3zDuNji4_eKNDc1_SuyboOqrJomeH_0 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3950314552870312727', time=2024-09-12T03:01:42.102935+0000, chain.objs.size()=1 2024-09-12T01:11:23.892 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.893+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sOEEJFHxfbdJjKscBr2c1TegMTBlZzc_0 2024-09-12T01:11:23.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13412594325053254498', time=2024-09-12T03:01:42.114178+0000, chain.objs.size()=1 2024-09-12T01:11:23.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.VdBbB0P4BySDe-FCCGZSG6OcNYphHvl_0 2024-09-12T01:11:23.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10426223780091637684', time=2024-09-12T03:01:50.240907+0000, chain.objs.size()=1 2024-09-12T01:11:23.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.F686BCvyKq0H0lKRLMgN5mVC_XAj4HT_0 2024-09-12T01:11:23.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15904518840167218138', time=2024-09-12T03:01:50.278702+0000, chain.objs.size()=1 2024-09-12T01:11:23.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.iU64aPYgKlw6w_DYtz5LAWsYKaYyaGg_0 2024-09-12T01:11:23.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15147561586123582641', time=2024-09-12T03:01:50.534930+0000, chain.objs.size()=1 2024-09-12T01:11:23.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qkIvSumOzl-WCqT5Ng2Z6Nc4P5p90_S_0 2024-09-12T01:11:23.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13204565406398289582', time=2024-09-12T03:01:50.554586+0000, chain.objs.size()=1 2024-09-12T01:11:23.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.897+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.O42yy6iDwtWG9uLmMygYPEdW8JmRFHp_0 2024-09-12T01:11:23.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.900+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11346584886931657360', time=2024-09-12T03:01:50.573237+0000, chain.objs.size()=1 2024-09-12T01:11:23.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.900+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IryGNserN4-OzwNN9pcpzspDCSFuLUD_0 2024-09-12T01:11:23.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.900+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18173309655031512298', time=2024-09-12T03:01:50.618791+0000, chain.objs.size()=1 2024-09-12T01:11:23.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.900+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.k57Usvm3Bpw6PkkPyiQ-TY-DWJxr68h_0 2024-09-12T01:11:23.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.900+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14747822714279514466', time=2024-09-12T03:01:50.827219+0000, chain.objs.size()=1 2024-09-12T01:11:23.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.900+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kbP0M4SvFw3oR28BfLaNi33YuglWAKx_0 2024-09-12T01:11:23.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.901+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17958831622863249251', time=2024-09-12T03:01:50.838805+0000, chain.objs.size()=1 2024-09-12T01:11:23.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.901+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.XL18jIv9WjlGANqjcp8Bp-DsY5w6a5e_0 2024-09-12T01:11:23.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.904+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/49981 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13795229657173393413', time=2024-09-12T03:01:50.928949+0000, chain.objs.size()=1 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.RWkb-4EaAVXiQfTpRx47KEm-YVwa4wo_0 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13387283682847607764', time=2024-09-12T03:01:50.942400+0000, chain.objs.size()=1 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.I19Ar59vF7jGZX5LZdbUhaSTZd6Br-M_0 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3733059940056181612', time=2024-09-12T03:01:51.007128+0000, chain.objs.size()=1 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GeI_SWW3mkcXqRjezjCgDXlBqEvU-zw_0 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9759456829168536573', time=2024-09-12T03:01:51.176879+0000, chain.objs.size()=1 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.VqydiShZt7meDC7BUT4MSYke_qbWyhT_0 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1459824965346654535', time=2024-09-12T03:01:51.216341+0000, chain.objs.size()=1 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.S_CB1jlGIXOVBFiNlERCFKTpqjuL2JB_0 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12888677809329679348', time=2024-09-12T03:01:51.228953+0000, chain.objs.size()=1 2024-09-12T01:11:23.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oZVCcdUaixPRV_VU9CC_UMQnwi1BrrU_0 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17672691006648902454', time=2024-09-12T03:01:51.367637+0000, chain.objs.size()=1 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.2FiHLmik_UYhbRxAhjwGsd2Dc38kWoQ_0 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8224980708622678712', time=2024-09-12T03:01:51.413570+0000, chain.objs.size()=1 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.dSMF_jYJBEgpnbwbQalQTl_r8oauudv_0 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18421941205838801980', time=2024-09-12T03:01:51.442134+0000, chain.objs.size()=1 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-R6_uvbsUU6TgMpuhrQXrOgzdaAQk3b_0 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3332509177748317286', time=2024-09-12T03:01:51.516819+0000, chain.objs.size()=1 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7amo2tn-Bd_Ujom3xwCscTMpRdJ5RXo_0 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.74487339569647579', time=2024-09-12T03:01:51.636339+0000, chain.objs.size()=1 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CkE2_cC5vvhL7H2W5CjWchqGiPHqsgJ_0 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16918130790463556358', time=2024-09-12T03:01:51.704875+0000, chain.objs.size()=1 2024-09-12T01:11:23.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.907+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.bFwYcIyTzuhkCGr1W6FARgOwTz3PP5o_0 2024-09-12T01:11:23.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.910+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6106580192311361816', time=2024-09-12T03:01:51.715459+0000, chain.objs.size()=1 2024-09-12T01:11:23.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.910+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.z8SuNU79-nP3ZGGOnbzyolP-maxrT6Y_0 2024-09-12T01:11:23.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.911+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4174432224942577700', time=2024-09-12T03:01:51.804474+0000, chain.objs.size()=1 2024-09-12T01:11:23.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.911+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Pj2flUKpteDh6_J5h6FTSd_abkYqpH8_0 2024-09-12T01:11:23.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.911+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11911190469553290073', time=2024-09-12T03:01:51.940233+0000, chain.objs.size()=1 2024-09-12T01:11:23.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.911+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.e5_P0FQLKt0dAflb8zXtIufAsVGExm-_0 2024-09-12T01:11:23.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11284302032957215787', time=2024-09-12T03:01:51.949129+0000, chain.objs.size()=1 2024-09-12T01:11:23.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9g9aJ19CnQdas_pT0eyk5D0U7LMb796_0 2024-09-12T01:11:23.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9531445339339663058', time=2024-09-12T03:01:51.973599+0000, chain.objs.size()=1 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KK5HKW9OweRors22B3eiS85GFUBBvQ5_0 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8397942534028337680', time=2024-09-12T03:01:51.989143+0000, chain.objs.size()=1 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.af4nJxDYlMzKSRSP5VA8KbYUkIwMKkx_0 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13165175648141879192', time=2024-09-12T03:01:52.093073+0000, chain.objs.size()=1 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6zTx-NDKp_k17nivBQjilZhTvF6hoXn_0 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3378129663754425266', time=2024-09-12T03:02:00.852684+0000, chain.objs.size()=1 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.344__shadow_.Q2CO0bbo4AxL6_LwWbc4mTRwuru_3h__0 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7562913938253833078', time=2024-09-12T03:02:12.351250+0000, chain.objs.size()=1 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.372__shadow_.Alr9B-9oPZLGAHKZp1PGu6OKSvu-6TA_0 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10452985892083562518', time=2024-09-12T03:02:44.262096+0000, chain.objs.size()=1 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.432__shadow_.L1e--lqoEje7Mw_YtGbuTPQr0IuTgZa_0 2024-09-12T01:11:23.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10609656068229121989', time=2024-09-12T03:02:48.497238+0000, chain.objs.size()=1 2024-09-12T01:11:23.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.912+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.441__shadow_.XtT9_jI0TZyDgmKWCuGcT9wd0bWJRjz_0 2024-09-12T01:11:23.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.915+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8934611712755269781', time=2024-09-12T03:02:49.047971+0000, chain.objs.size()=1 2024-09-12T01:11:23.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.915+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.442__shadow_.kXAWR7QDsu5GresC1A3LyFSaUg4zJYj_0 2024-09-12T01:11:23.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.915+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5636080347306431929', time=2024-09-12T03:03:10.087266+0000, chain.objs.size()=1 2024-09-12T01:11:23.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.915+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.voud8I_OD4kkYR2vIBr-bDZx22SAI_g_0 2024-09-12T01:11:23.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.916+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16839231724748017521', time=2024-09-12T03:03:23.148740+0000, chain.objs.size()=1 2024-09-12T01:11:23.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.916+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.512__multipart_mymultipart.2~RnoB8qItk_nQs4S21OEXoY8DH_IzHdO.1 2024-09-12T01:11:23.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.916+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16316147971045174841', time=2024-09-12T03:03:43.567622+0000, chain.objs.size()=1 2024-09-12T01:11:23.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.916+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~Glp_-jFagImkrI2qoJZudLJtcjnO3f_.1 2024-09-12T01:11:23.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.918+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8436275771454315265', time=2024-09-12T03:04:41.415189+0000, chain.objs.size()=1 2024-09-12T01:11:23.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.918+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:.5vVJtIDpYzr9Hswn01z8jSbsVvbEXr_.r7iUUpuXh8JJ4xMoGQ_zbxp5lqii2Vj_0 2024-09-12T01:11:23.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14101367045982178111', time=2024-09-12T03:04:43.750747+0000, chain.objs.size()=1 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:w4KkAk78RtxyxnqBfyHUW-XbWNzQLvV_.cTaQU0TLdw910SDusc85p_gYEBCmTZ8_0 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1141323284696470643', time=2024-09-12T03:04:49.456930+0000, chain.objs.size()=1 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.574__shadow_.sRPofn4i8ICAk2wQqQLGKCwKq7BGk0x_0 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8159992532362400517', time=2024-09-12T03:04:56.535068+0000, chain.objs.size()=1 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:exp.vY4ic0GG6HUc6NZquEflkvhq11u_.DiEI2PtyzNf1Kw_PH17RMeQFBmfHp9x_0 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10236141103960897823', time=2024-09-12T03:05:05.527839+0000, chain.objs.size()=1 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:ZCP4oKf2i7RNcPoJM3f89BKqyrr63GD_.Uj6hMF7s-DIojcG4QSza0i3Dxs7n5ze_0 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9145971207042997693', time=2024-09-12T03:05:11.255925+0000, chain.objs.size()=4 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~NAF55EnG4S8CUXqYh_0gT5TbjvLlytp.1 2024-09-12T01:11:23.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.919+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~NAF55EnG4S8CUXqYh_0gT5TbjvLlytp.2 2024-09-12T01:11:23.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.920+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~NAF55EnG4S8CUXqYh_0gT5TbjvLlytp.3 2024-09-12T01:11:23.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.920+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.579__multipart_testobj.2~NAF55EnG4S8CUXqYh_0gT5TbjvLlytp.4 2024-09-12T01:11:23.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.921+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4939148234913355144', time=2024-09-12T03:05:15.307378+0000, chain.objs.size()=1 2024-09-12T01:11:23.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.921+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.584__shadow:CK2CQvufw4pQWp12Vb76SKm1HUTuQPD_.TiuHOi4ez9FnCtFgM6HjDIfEq3BxMkR_0 2024-09-12T01:11:23.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.921+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18286901723712411777', time=2024-09-12T03:08:02.933763+0000, chain.objs.size()=1 2024-09-12T01:11:23.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.921+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.666__shadow_.Pn_QzPUXrDcZlVvVeLDtLUc2wLcvcte_0 2024-09-12T01:11:23.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.922+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10200295054314742932', time=2024-09-12T03:08:03.793422+0000, chain.objs.size()=1 2024-09-12T01:11:23.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.922+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.667__shadow_.i7tuc-eGEzWTuZTC6W0c7Mw3JzYtzkb_0 2024-09-12T01:11:23.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.923+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14563380430908928407', time=2024-09-12T03:08:33.903501+0000, chain.objs.size()=1 2024-09-12T01:11:23.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.923+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.716__shadow:-jIbXW2fqkpB0DSyu2SkJHo6kQO4YM-_.zcJ-evhVP4IG9iohVC4eTOog6-nsOl5_0 2024-09-12T01:11:23.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.926+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.929+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:11:23.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.930+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.930+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47091' 2024-09-12T01:11:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_WNFT3I9ukPUHsy_xgZUunWYG5w7J3Ob', time=2024-09-12T02:58:54.014041+0000, chain.objs.size()=3 2024-09-12T01:11:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.1hhEuaAXcRinwc8KTt0E3e1nfPm78gr_0 2024-09-12T01:11:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.1hhEuaAXcRinwc8KTt0E3e1nfPm78gr_1 2024-09-12T01:11:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.161__shadow_.1hhEuaAXcRinwc8KTt0E3e1nfPm78gr_2 2024-09-12T01:11:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2864821089446675607', time=2024-09-12T02:58:56.165648+0000, chain.objs.size()=1 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.163__shadow_.UuhKPpUCWiPyC0zQEed_rk3kjxaHdgF_0 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14925319079234488115', time=2024-09-12T02:59:12.037661+0000, chain.objs.size()=1 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.184__shadow_.Vi_DmHBJ2_dFz1-65l38TZUqF1MrNdL_0 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5730667140057143538', time=2024-09-12T03:00:43.626195+0000, chain.objs.size()=1 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.247__shadow_.wTxGqOrHK96D80UkFzpIUGMQf9VeofB_0 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16245096909228104177', time=2024-09-12T03:00:47.409059+0000, chain.objs.size()=1 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.255__shadow_.5IUWLaLTd20J2fF0joEQ_FqIkOR0Ccy_0 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10098700535937881120', time=2024-09-12T03:00:58.862995+0000, chain.objs.size()=1 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2IVrWCONJaVgkLCL2Em0JehzKr4IJNH_0 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14502733203474611496', time=2024-09-12T03:00:59.013335+0000, chain.objs.size()=1 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lqktnouMv2aSSmSfbjRyaBx12aq4AAe_0 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2851662716362703378', time=2024-09-12T03:00:59.143299+0000, chain.objs.size()=1 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UgQWgQT3Dv0c0rJNjxTlLmETQmJds22_0 2024-09-12T01:11:23.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17518821753066845806', time=2024-09-12T03:00:59.199949+0000, chain.objs.size()=1 2024-09-12T01:11:23.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Ci_L2Giz6TgSjOd8YVcCDyXkEn2_o9u_0 2024-09-12T01:11:23.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1895157912018708493', time=2024-09-12T03:00:59.394947+0000, chain.objs.size()=1 2024-09-12T01:11:23.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.931+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.iJbAmGy15pKiVrXzqTfKfZm6kaXks5J_0 2024-09-12T01:11:23.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.934+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3741275866617277269', time=2024-09-12T03:00:59.451726+0000, chain.objs.size()=1 2024-09-12T01:11:23.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.934+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.zP8Wxk4etgOToa5rzWwLOuNW0pBMROj_0 2024-09-12T01:11:23.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16983618245546670688', time=2024-09-12T03:00:59.525902+0000, chain.objs.size()=1 2024-09-12T01:11:23.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MA0uJzNk-2pm9dNIzvzIz9ymbpQIRk4_0 2024-09-12T01:11:23.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15584467778742602517', time=2024-09-12T03:00:59.660270+0000, chain.objs.size()=1 2024-09-12T01:11:23.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.43nKKfS811V5r-EUWiFQzHOPSnhGWRS_0 2024-09-12T01:11:23.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17406592032903408121', time=2024-09-12T03:00:59.660960+0000, chain.objs.size()=1 2024-09-12T01:11:23.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.GaxFvEmLaVZiP9WoNAcIaeCd6Y-pg50_0 2024-09-12T01:11:23.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2031712921722389333', time=2024-09-12T03:00:59.686820+0000, chain.objs.size()=1 2024-09-12T01:11:23.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DEdro-VGTfnTr261d1fCduLqcxfyLaI_0 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1713204708375827415', time=2024-09-12T03:00:59.726990+0000, chain.objs.size()=1 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fUrnxpygOH-yePIPkVngSEpJAcrMY3C_0 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10275688903218162648', time=2024-09-12T03:00:59.803175+0000, chain.objs.size()=1 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hWvFjbiFdJzU5dzM04Fqq-ZUt1YFMBO_0 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5790906621580415727', time=2024-09-12T03:00:59.964394+0000, chain.objs.size()=1 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hRfgn2SACoNMVnpOdU_HI8S4Z-l0kD-_0 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9520083350384742971', time=2024-09-12T03:00:59.990647+0000, chain.objs.size()=1 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jNXevXYW5CTIra0sBwSA6Jn0T6aA4Ur_0 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8224242254084356543', time=2024-09-12T03:01:00.332965+0000, chain.objs.size()=1 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JGsLwisR6RGmCrsJLfvPNnALjWg-fcb_0 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.39685226401254107', time=2024-09-12T03:01:00.401111+0000, chain.objs.size()=1 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CXIlvoNhxX4JjSTBomZMrhdxchYI4V0_0 2024-09-12T01:11:23.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6630418122403343078', time=2024-09-12T03:01:00.416812+0000, chain.objs.size()=1 2024-09-12T01:11:23.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.936+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RrMCHCth2ufUkIOtPv0z3tn1xxMEJT9_0 2024-09-12T01:11:23.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.939+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6524858326044781890', time=2024-09-12T03:01:00.464493+0000, chain.objs.size()=1 2024-09-12T01:11:23.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.939+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.yxu6fr76MVr-ZI37wJ3Ze6TnWorQJs__0 2024-09-12T01:11:23.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.940+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16965612783549953705', time=2024-09-12T03:01:00.471144+0000, chain.objs.size()=1 2024-09-12T01:11:23.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.940+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9zPK_x8JRso5fw82u8CU81l1EF0dfAR_0 2024-09-12T01:11:23.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.941+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15971932246671715912', time=2024-09-12T03:01:00.588922+0000, chain.objs.size()=1 2024-09-12T01:11:23.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.941+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.H9l9R2kjCV28ObtnNLq13D5ehe4JZu0_0 2024-09-12T01:11:23.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.941+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14291558505895865140', time=2024-09-12T03:01:00.757669+0000, chain.objs.size()=1 2024-09-12T01:11:23.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.941+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ERvvsDgOBdOh6P403J29b5n7OhUz7T7_0 2024-09-12T01:11:23.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3806549924580376989', time=2024-09-12T03:01:00.766718+0000, chain.objs.size()=1 2024-09-12T01:11:23.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.NcvIY2O-nmwilj064H2GJsp7YHfBUIO_0 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14719216348225956473', time=2024-09-12T03:01:00.909243+0000, chain.objs.size()=1 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.XLoG-sl8u8qblCY3dKeAiFwQNUoXUgc_0 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3872991673029859965', time=2024-09-12T03:01:00.920179+0000, chain.objs.size()=1 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jHtBmgNMnOXxP6wIh1EQznfSdCZqtPo_0 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5742978831022446951', time=2024-09-12T03:01:00.948748+0000, chain.objs.size()=1 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.L2OPCrvaDc7n0-oN3Rt1R3yvWIVCXjb_0 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6484425050073198416', time=2024-09-12T03:01:00.996889+0000, chain.objs.size()=1 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VzK4GZi4fxlEZ77Gdgjhm08qr2D1-kj_0 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15745248234247948377', time=2024-09-12T03:01:02.832495+0000, chain.objs.size()=1 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.267__shadow_.G5YMhLVwX2DixD6G3_b8nFU6IPElt7k_0 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4502671301864884531', time=2024-09-12T03:01:05.162478+0000, chain.objs.size()=1 2024-09-12T01:11:23.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.272__shadow_.kV_318E9aafvjBby50gdDlPSkTrnFSC_0 2024-09-12T01:11:23.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8015778028497533103', time=2024-09-12T03:01:10.814988+0000, chain.objs.size()=1 2024-09-12T01:11:23.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.943+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.284__shadow_.YHLl6qC1wGY0Yl-5Yh7LQCHsil9wNDT_0 2024-09-12T01:11:23.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.944+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8532538765618710518', time=2024-09-12T03:01:12.931875+0000, chain.objs.size()=1 2024-09-12T01:11:23.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.944+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.288__shadow_.T9kCUaf9qm1Wm_La8b8m8CqkcMBSh_c_0 2024-09-12T01:11:23.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.947+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8342673087966261754', time=2024-09-12T03:01:19.577275+0000, chain.objs.size()=1 2024-09-12T01:11:23.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.947+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.300__shadow_.GZEWvy8ubMk40mIitWFI4QALRnRJKmw_0 2024-09-12T01:11:23.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9563281022084624191', time=2024-09-12T03:01:23.050792+0000, chain.objs.size()=1 2024-09-12T01:11:23.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.307__shadow_.xbOgWwl63wzGpW9QcZUqdW89KQJsXOe_0 2024-09-12T01:11:23.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13432953576396637915', time=2024-09-12T03:01:40.125717+0000, chain.objs.size()=1 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.cYKO9RQz6Z65yPq02WiWi0rgNuHY__t_0 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16320839194375040855', time=2024-09-12T03:01:40.174283+0000, chain.objs.size()=1 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bgrgfnR30Olhj5zAJluhX6DQ4rTOhnj_0 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4175273536162596757', time=2024-09-12T03:01:40.203147+0000, chain.objs.size()=1 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.s0FA0AbAqD-kWQReM5gJN6jjEc1bAyM_0 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.76484061868459638', time=2024-09-12T03:01:40.240774+0000, chain.objs.size()=1 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LUFY24EK-kfOZsZF5Fhbm47APrBOntY_0 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10736998917321491436', time=2024-09-12T03:01:40.252272+0000, chain.objs.size()=1 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.BdE8YOCf_6gysgpCMbZ_2d_OsE7dtnE_0 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3020468930821513580', time=2024-09-12T03:01:40.385587+0000, chain.objs.size()=1 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZBZHPgm7fMfVqc_Sw1rPDkcci9y9fY2_0 2024-09-12T01:11:23.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8645861932882870343', time=2024-09-12T03:01:40.419878+0000, chain.objs.size()=1 2024-09-12T01:11:23.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.k-p70Y_wsRtzSqNMfB5hLrSAj8cn5Qx_0 2024-09-12T01:11:23.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11214189138925612192', time=2024-09-12T03:01:40.473682+0000, chain.objs.size()=1 2024-09-12T01:11:23.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.VFdtryx7E98WxIoJB3B_xcern5hqpJV_0 2024-09-12T01:11:23.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5845986262962453701', time=2024-09-12T03:01:40.742214+0000, chain.objs.size()=1 2024-09-12T01:11:23.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.949+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tVNDmJDKtxIz-ZK3sRaEXjwKqmiMEA__0 2024-09-12T01:11:23.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.951+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9517125615190644829', time=2024-09-12T03:01:40.760119+0000, chain.objs.size()=1 2024-09-12T01:11:23.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.951+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tED4hUQkju7sHQyt8Vg0hNL8BrG3WfJ_0 2024-09-12T01:11:23.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4710028791618199474', time=2024-09-12T03:01:40.784512+0000, chain.objs.size()=1 2024-09-12T01:11:23.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zdzCOBBvxh5OMWX4fwnQEuYXMoyACd4_0 2024-09-12T01:11:23.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9986534768337933775', time=2024-09-12T03:01:40.792082+0000, chain.objs.size()=1 2024-09-12T01:11:23.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.IzY1npNRDlam29p_auLcwaPZ4qtcdDZ_0 2024-09-12T01:11:23.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4295727796511447082', time=2024-09-12T03:01:40.806228+0000, chain.objs.size()=1 2024-09-12T01:11:23.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.d7UQN2_KqnxhcLmx_yRH1hSQCwQr1Vp_0 2024-09-12T01:11:23.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11443461177160456683', time=2024-09-12T03:01:40.914425+0000, chain.objs.size()=1 2024-09-12T01:11:23.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LMfEz86d1kLWclKeoKfbeMYC4vpQE6n_0 2024-09-12T01:11:23.955 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1728916914768663934', time=2024-09-12T03:01:41.052620+0000, chain.objs.size()=1 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lyHFXu7rXkdijptsLCJXMnP3bj8sjCY_0 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10938794715911237314', time=2024-09-12T03:01:41.087680+0000, chain.objs.size()=1 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.a_i7QFlYzxmCI69wrFERpkl1d1WxGDP_0 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15117362781911510269', time=2024-09-12T03:01:41.187856+0000, chain.objs.size()=1 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.OawjNfb3r-3hd2qKJXfwt0fL8JQFWXW_0 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8353742275971900750', time=2024-09-12T03:01:41.188572+0000, chain.objs.size()=1 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.TZDQZKkBCvL5QODP8ZgTcib8_5gP4zt_0 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13402293390302206693', time=2024-09-12T03:01:41.209637+0000, chain.objs.size()=1 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Pids9SF6hiyO2upPS7m6EYtuR2e3oWu_0 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1547685372210562565', time=2024-09-12T03:01:41.353668+0000, chain.objs.size()=1 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FTNzgmnLUzxK_0kPttsrVk-Fi--eIXL_0 2024-09-12T01:11:23.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8416984746966333956', time=2024-09-12T03:01:41.444589+0000, chain.objs.size()=1 2024-09-12T01:11:23.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.956+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.saMknZWfFUUR8vYAxMSJiVpX3Wa46AS_0 2024-09-12T01:11:23.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3928250463194704911', time=2024-09-12T03:01:41.494441+0000, chain.objs.size()=1 2024-09-12T01:11:23.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5v27kDGiJWJE_ZMDo0MJXwzIAXbrog4_0 2024-09-12T01:11:23.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9942547870894003754', time=2024-09-12T03:01:41.535938+0000, chain.objs.size()=1 2024-09-12T01:11:23.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Cj9Wx1o3fepWX-ioG40kHHtHNF1_4R3_0 2024-09-12T01:11:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5085731820475597999', time=2024-09-12T03:01:41.811017+0000, chain.objs.size()=1 2024-09-12T01:11:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.n85VpwgVDctyIFjaonoxdDG-vH6HTaS_0 2024-09-12T01:11:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17701758426017233182', time=2024-09-12T03:01:41.824493+0000, chain.objs.size()=1 2024-09-12T01:11:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rYlGDSWxe62Ze9JN-m4INQHDiNRatwa_0 2024-09-12T01:11:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13230591606492428599', time=2024-09-12T03:01:41.876833+0000, chain.objs.size()=1 2024-09-12T01:11:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.959+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.M1Rhx1q61ADiV7ojgarICohWD7PPzGR_0 2024-09-12T01:11:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11264444987479802750', time=2024-09-12T03:01:41.973367+0000, chain.objs.size()=1 2024-09-12T01:11:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5DLJmjedpyAmAdlWqDoL9UWpxPTUyEz_0 2024-09-12T01:11:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13097178226741637197', time=2024-09-12T03:01:41.982023+0000, chain.objs.size()=1 2024-09-12T01:11:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ztq1Dl3vGT2R7NgCkkDOWe14ErPoDaS_0 2024-09-12T01:11:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8980100629998624263', time=2024-09-12T03:01:42.092879+0000, chain.objs.size()=1 2024-09-12T01:11:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0Sg4hip2xA34EhAi5zQz9qwMCfuz8Eh_0 2024-09-12T01:11:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6945275320837013993', time=2024-09-12T03:01:42.115534+0000, chain.objs.size()=1 2024-09-12T01:11:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.BBwjJPtUD0NNUMrEdQGbCL7KNnk2BSJ_0 2024-09-12T01:11:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1474351876044394104', time=2024-09-12T03:01:50.215407+0000, chain.objs.size()=1 2024-09-12T01:11:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MekEPAuehPgki3Zxm8CNOk__eGkMih6_0 2024-09-12T01:11:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.489426294783489939', time=2024-09-12T03:01:50.267139+0000, chain.objs.size()=1 2024-09-12T01:11:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.961+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gNmNlalype36O-IjaKxh4zppi2HxnAt_0 2024-09-12T01:11:23.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.964+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1783605837770765829', time=2024-09-12T03:01:50.278768+0000, chain.objs.size()=1 2024-09-12T01:11:23.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.964+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fPVoZjCtONiIhEdwyEr5HAB-mTGl7oI_0 2024-09-12T01:11:23.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.964+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3376814459314408181', time=2024-09-12T03:01:50.285467+0000, chain.objs.size()=1 2024-09-12T01:11:23.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.964+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zIUxODhzRQqHFAtbWdAC7SANRmDpV1J_0 2024-09-12T01:11:23.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.964+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17561123848357761112', time=2024-09-12T03:01:50.330512+0000, chain.objs.size()=1 2024-09-12T01:11:23.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.964+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gaa99_D_Rpy1KR03LSKqnpPlgDEgLT7_0 2024-09-12T01:11:23.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.965+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2949790876948159910', time=2024-09-12T03:01:50.350848+0000, chain.objs.size()=1 2024-09-12T01:11:23.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.965+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.RWsvgBu6r2arTQaaljHpS5zLRzvYs0p_0 2024-09-12T01:11:23.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.966+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17436493704657785701', time=2024-09-12T03:01:50.389490+0000, chain.objs.size()=1 2024-09-12T01:11:23.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.966+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Y4METBdAinBLv9jQOsjEgr8nAQrjKed_0 2024-09-12T01:11:23.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.966+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6487004030612367336', time=2024-09-12T03:01:50.408298+0000, chain.objs.size()=1 2024-09-12T01:11:23.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.966+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.HjO54yxYifzvtLwSenqYG8S_OmQIUyA_0 2024-09-12T01:11:23.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.966+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7084911841218402536', time=2024-09-12T03:01:50.718807+0000, chain.objs.size()=1 2024-09-12T01:11:23.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.966+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KC0bVz1PNW58dq704gQuILyoCXvWELJ_0 2024-09-12T01:11:23.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.966+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11622285904290722948', time=2024-09-12T03:01:50.824269+0000, chain.objs.size()=1 2024-09-12T01:11:23.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.966+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3FzrOxFtvVYMsr0WuZx4Xygzlw51DD1_0 2024-09-12T01:11:23.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17843470441161567083', time=2024-09-12T03:01:50.831659+0000, chain.objs.size()=1 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qM2K6bxEECGmgfJwzy0CW3yTs03jE0n_0 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2631564162255994944', time=2024-09-12T03:01:50.945040+0000, chain.objs.size()=1 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.YoN8GGyWWBNB3U0FErQLiaiUgOah1rU_0 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7907806836092670562', time=2024-09-12T03:01:50.991260+0000, chain.objs.size()=1 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JdBe-pt0KM0lV5UNjmA9PgqMTKrYxBu_0 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8528738011941733184', time=2024-09-12T03:01:51.089475+0000, chain.objs.size()=1 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Adm-I1q5fPxldwFho6yqS5V_EWhgkEQ_0 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.843841104403995436', time=2024-09-12T03:01:51.123603+0000, chain.objs.size()=1 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OC6ytlGcVmYm3K7qgG_gN3aApYKtzI6_0 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11944220087387670575', time=2024-09-12T03:01:51.261815+0000, chain.objs.size()=1 2024-09-12T01:11:23.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.969+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.HKaqg89FKjDaAfl4K931KKF4nn0G77n_0 2024-09-12T01:11:23.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.971+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6686776153625115552', time=2024-09-12T03:01:51.430076+0000, chain.objs.size()=1 2024-09-12T01:11:23.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.971+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.itd4UCMfW4lPP9G3em0WOLPfvR5wO_s_0 2024-09-12T01:11:23.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.972+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2068195368095338021', time=2024-09-12T03:01:51.496681+0000, chain.objs.size()=1 2024-09-12T01:11:23.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.972+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.P0FVJzi_54PqzpzAtIFAom2r5gTduWm_0 2024-09-12T01:11:23.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.972+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13543388911753962007', time=2024-09-12T03:01:51.521168+0000, chain.objs.size()=1 2024-09-12T01:11:23.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.972+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.wGFNnNPCXG5ZrtcPuovV8vpiMe-iqYt_0 2024-09-12T01:11:23.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.972+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12497552518853122905', time=2024-09-12T03:01:51.530291+0000, chain.objs.size()=1 2024-09-12T01:11:23.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.972+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.o-7OwPPjMRKKbbRor10J55obQ3k3VEh_0 2024-09-12T01:11:23.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.972+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11660857971684596828', time=2024-09-12T03:01:51.535203+0000, chain.objs.size()=1 2024-09-12T01:11:23.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.972+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OJMyGfAq6kZ0k5K6NJKqh1EjItqc74z_0 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1540080261350847763', time=2024-09-12T03:01:51.548053+0000, chain.objs.size()=1 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ntYpuxU6prxjZ6kbErfPFJONQDRGYjC_0 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11941281980347729659', time=2024-09-12T03:01:51.675701+0000, chain.objs.size()=1 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MTPfzGVtaEI9gGkdNUo9mQaPyLw7OMh_0 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7108782363177682081', time=2024-09-12T03:01:51.707257+0000, chain.objs.size()=1 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.X3DnLy70wmIJxuKomxELtglrcL4yJeV_0 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2234345274818650873', time=2024-09-12T03:01:51.733870+0000, chain.objs.size()=1 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.O8VdmACxMKMbMCur3fxu2cTTLb4QsJH_0 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15781009612246242384', time=2024-09-12T03:01:51.766140+0000, chain.objs.size()=1 2024-09-12T01:11:23.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.974+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.yR0d1cxKfT9J7TTHcJgMMuPiCAB365d_0 2024-09-12T01:11:23.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.977+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4037596122462085525', time=2024-09-12T03:01:51.818319+0000, chain.objs.size()=1 2024-09-12T01:11:23.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.977+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.cCG961jaS3BZgSato24yb1T3ugmSfAr_0 2024-09-12T01:11:23.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.977+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15302999629589148426', time=2024-09-12T03:01:51.938806+0000, chain.objs.size()=1 2024-09-12T01:11:23.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.977+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IfVAQUuWSoTuXymJEQtLzTAoFaNpA8d_0 2024-09-12T01:11:23.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7540948440324022492', time=2024-09-12T03:01:52.023340+0000, chain.objs.size()=1 2024-09-12T01:11:23.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.n3haBIL7FKdPS0O0rW9sIV_5rywQdns_0 2024-09-12T01:11:23.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9167362205651588107', time=2024-09-12T03:01:52.077476+0000, chain.objs.size()=1 2024-09-12T01:11:23.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.dQtlqM0n6VhqcqM0VnS5zQqun7tADKX_0 2024-09-12T01:11:23.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1431765958503574894', time=2024-09-12T03:01:52.088061+0000, chain.objs.size()=1 2024-09-12T01:11:23.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GpD7Krl8bqOwps4PUKk3nNrPVzbEaNN_0 2024-09-12T01:11:23.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16053578221019363716', time=2024-09-12T03:01:52.223932+0000, chain.objs.size()=1 2024-09-12T01:11:23.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kvNwN5C-oFxcEH5DMUpe4QNqYb6rENO_0 2024-09-12T01:11:23.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12945747584479139577', time=2024-09-12T03:01:52.266111+0000, chain.objs.size()=1 2024-09-12T01:11:23.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.978+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.dLD8U3yrBqHX3jJsidCWfaD3tD0TyXF_0 2024-09-12T01:11:23.981 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.983+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47091 2024-09-12T01:11:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:11:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2903744659714713333', time=2024-09-12T03:01:52.307500+0000, chain.objs.size()=1 2024-09-12T01:11:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.65C83lpn40zytDu1e-zPIkrGFX_BXjc_0 2024-09-12T01:11:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12744950438025119513', time=2024-09-12T03:02:01.811881+0000, chain.objs.size()=1 2024-09-12T01:11:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.346__shadow_.UvUXRPM4LNu-WnDS_afVOmCsjENexdB_0 2024-09-12T01:11:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3019291739793126252', time=2024-09-12T03:02:57.014066+0000, chain.objs.size()=1 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.456__shadow_.uQ8sEJ7LUgGrsCKdIJvTrKFg7_RRTGK_0 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9416666012148252587', time=2024-09-12T03:02:59.135648+0000, chain.objs.size()=1 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.459__shadow_.-zQoXKXydJnX_Ex4cRXY-icHl0rQCTC_0 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5464998171064872466', time=2024-09-12T03:03:00.602002+0000, chain.objs.size()=1 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.461__shadow_.zCP2ykTZbsE_K4jomy3NGyi8pC00MNI_0 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6478484075969622304', time=2024-09-12T03:03:14.598453+0000, chain.objs.size()=1 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.492__shadow_._TQb6I8IMGRr6X-uV3vhHSnIWU-F-_m_0 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10930804122277690847', time=2024-09-12T03:03:31.862220+0000, chain.objs.size()=1 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.521__shadow:N75oZ.0bboOTjAi8JC6mH8kKsA0m.uq_.xiuxv6QQVtcGLmpXgzdbtZZSjdT_oOp_0 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~NCzFz2Dn0SQDzIPmD6w93dNMJVxBDMQ', time=2024-09-12T03:03:37.351252+0000, chain.objs.size()=1 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~NCzFz2Dn0SQDzIPmD6w93dNMJVxBDMQ.3 2024-09-12T01:11:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16421799089860499854', time=2024-09-12T03:04:41.184451+0000, chain.objs.size()=1 2024-09-12T01:11:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:TIUCfTuvA4gZUqqpD-U1P-3F18Kn9EM_.x97lg7vBgrxwlMbqd2ISj75H7WtUJZI_0 2024-09-12T01:11:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6739981117306585910', time=2024-09-12T03:04:41.913863+0000, chain.objs.size()=1 2024-09-12T01:11:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:.Ocnh-tjhbuLr.okGFkqaYnekbBp6ay_.CDGjK60VPFR9pZ3Tth3zlKuDoDSW40f_0 2024-09-12T01:11:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15513948931962832455', time=2024-09-12T03:05:12.930808+0000, chain.objs.size()=1 2024-09-12T01:11:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:ftJidGsqVoRVlJeb0T.wsSue97BnSmE_.MW19BQVtd6VenQt3u774MGJZXsgsV0p_0 2024-09-12T01:11:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13252682488383688043', time=2024-09-12T03:05:16.873363+0000, chain.objs.size()=1 2024-09-12T01:11:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.985+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.586__shadow:8a0eYlNV5UUiQJdVbZebOtbJlhhW3zL_.ZkSbfrWkjgiRCIpnpZo9umvgeBfzmvV_0 2024-09-12T01:11:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.989+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7185174954411829831', time=2024-09-12T03:07:50.391355+0000, chain.objs.size()=1 2024-09-12T01:11:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.989+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.643__shadow_.m-udPa8x3IANF4Eba_39MtfqEwWGEQA_0 2024-09-12T01:11:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.989+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18313609392272835349', time=2024-09-12T03:07:52.603072+0000, chain.objs.size()=2 2024-09-12T01:11:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.989+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.647__shadow_.IBKG_bg_DoNY_4o8ZazoQQXamvY1uY4_0 2024-09-12T01:11:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.990+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.647__shadow_.IBKG_bg_DoNY_4o8ZazoQQXamvY1uY4_1 2024-09-12T01:11:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.990+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16352576979016834271', time=2024-09-12T03:08:19.078962+0000, chain.objs.size()=1 2024-09-12T01:11:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.990+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.705__shadow:ssQ-4XlIyZSvzdlGzOtd5fS1ky1UPnv_.EvadspqF2dcbg_jQmnxiFqYhmnTxT8K_0 2024-09-12T01:11:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.990+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14800465097267278802', time=2024-09-12T03:08:57.813195+0000, chain.objs.size()=1 2024-09-12T01:11:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.990+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.745__shadow_.zZHJNpEfiz1h3RoouhWOlb9WPziAXkM_0 2024-09-12T01:11:23.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.993+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:23.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.996+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:11:23.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.997+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:23.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.998+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:23.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45471' 2024-09-12T01:11:23.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8994292146223097939', time=2024-09-12T03:00:36.631258+0000, chain.objs.size()=1 2024-09-12T01:11:23.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.235__shadow_.yHF9L589yyIQ90yfsQcCLQ84WYKniTM_0 2024-09-12T01:11:23.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10351378890286550611', time=2024-09-12T03:00:44.545422+0000, chain.objs.size()=1 2024-09-12T01:11:23.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.249__shadow_.NNS3Vr_hLJlAINF1oNsPwc1zlcBjPIx_0 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.323477872995178906', time=2024-09-12T03:00:58.861811+0000, chain.objs.size()=1 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vR4UCTWzmYMAQ9CzmgzXUUHgTZC-m_4_0 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8252633919485124955', time=2024-09-12T03:00:58.885655+0000, chain.objs.size()=1 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lhiRMHxU0ShkEKfkoIvAQyUyAMX3CVa_0 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14017282995042600882', time=2024-09-12T03:00:58.886321+0000, chain.objs.size()=1 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eJDk-AEutu6jSlkBXnqN2210sH7aAu7_0 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5239102495319949384', time=2024-09-12T03:00:58.902309+0000, chain.objs.size()=1 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KzSmAst18nkLIpZjmGgvPiPArLhl0NR_0 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.976811038196194638', time=2024-09-12T03:00:58.938210+0000, chain.objs.size()=1 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2T4yQ-R-BVMK8Pn1RIYp_68ivghc3bG_0 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.677737085470345482', time=2024-09-12T03:00:58.947438+0000, chain.objs.size()=1 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eDLCStqdlomNUU8DwL5RhlJGKDRTTqS_0 2024-09-12T01:11:23.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3927725023521333524', time=2024-09-12T03:00:58.997575+0000, chain.objs.size()=1 2024-09-12T01:11:24.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1Fpk-9oI5LSTF9Ejpde1Lbc6xKVYpSn_0 2024-09-12T01:11:24.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9174738811725584638', time=2024-09-12T03:00:59.005784+0000, chain.objs.size()=1 2024-09-12T01:11:24.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Qa5pp0DSeBAhv_wwFeETaMNsevoeM7G_0 2024-09-12T01:11:24.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3669043922218540570', time=2024-09-12T03:00:59.135097+0000, chain.objs.size()=1 2024-09-12T01:11:24.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ppytkm3LPvXkhB7A_rtxobIGbe6qIn__0 2024-09-12T01:11:24.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6427856660444518715', time=2024-09-12T03:00:59.166195+0000, chain.objs.size()=1 2024-09-12T01:11:24.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:23.999+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dfBnuTH8thhJF-sHFM4b098fg0t321j_0 2024-09-12T01:11:24.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5246448624067516939', time=2024-09-12T03:00:59.179033+0000, chain.objs.size()=1 2024-09-12T01:11:24.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qoM6uo2E0pwLWlCS3eqeHbwB7K0cCmR_0 2024-09-12T01:11:24.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13318503723019744416', time=2024-09-12T03:00:59.202542+0000, chain.objs.size()=1 2024-09-12T01:11:24.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jKPefJYHzecP34DeYv042wtf9e4B68p_0 2024-09-12T01:11:24.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.002+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9482347925544903326', time=2024-09-12T03:00:59.253702+0000, chain.objs.size()=1 2024-09-12T01:11:24.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.002+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.h4fYXjbKO3kOj7wAVoXOL-owq3X_aR2_0 2024-09-12T01:11:24.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.004+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12422425144690930953', time=2024-09-12T03:00:59.257054+0000, chain.objs.size()=1 2024-09-12T01:11:24.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.004+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZZVjeT0p5BnAZ9JAthPk_jFksgUBt0q_0 2024-09-12T01:11:24.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.004+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13854360536685280254', time=2024-09-12T03:00:59.395891+0000, chain.objs.size()=1 2024-09-12T01:11:24.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.004+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.UPTgYyCca-4-KHklxf4zok9vakR0M3O_0 2024-09-12T01:11:24.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10051452755693389312', time=2024-09-12T03:00:59.432601+0000, chain.objs.size()=1 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Bl9fYp5jmcQnLte0NlNRic3qZxB1vl__0 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13058967822046587112', time=2024-09-12T03:00:59.664814+0000, chain.objs.size()=1 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JUcYLLRA95AEpi0-HC5FybvUK4kVK2J_0 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9912516084234679357', time=2024-09-12T03:00:59.680533+0000, chain.objs.size()=1 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cfC2-frQJJfUlAog5FdURtQS89zm0Dz_0 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15284348875918761320', time=2024-09-12T03:00:59.805700+0000, chain.objs.size()=1 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3ms8_dBnt5Voj4aVMjy8WRvWKGULHr1_0 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16234567132533766980', time=2024-09-12T03:00:59.942503+0000, chain.objs.size()=1 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1mlf6sSYcAkAXwluze35mm10FNH0Gsz_0 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6014456876787954522', time=2024-09-12T03:00:59.948114+0000, chain.objs.size()=1 2024-09-12T01:11:24.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.005+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dQS_fIY3MQkZL1gFIxEB1ZiBm_Ydkfi_0 2024-09-12T01:11:24.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.007+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10037175195568265285', time=2024-09-12T03:00:59.979693+0000, chain.objs.size()=1 2024-09-12T01:11:24.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.007+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RA2Ufperx4ZLvP3ir9hN2FU_3RMD065_0 2024-09-12T01:11:24.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.007+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15249223752912214406', time=2024-09-12T03:01:00.031441+0000, chain.objs.size()=1 2024-09-12T01:11:24.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.007+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.T8q5EiG4YTOYQIivw8wIGQh_FbMleNh_0 2024-09-12T01:11:24.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.008+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5820597346512778764', time=2024-09-12T03:01:00.081095+0000, chain.objs.size()=1 2024-09-12T01:11:24.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.008+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WQmuCe9YJlTPJ6Osb423kBW0ZzCHYwQ_0 2024-09-12T01:11:24.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.008+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6530647922841409226', time=2024-09-12T03:01:00.245930+0000, chain.objs.size()=1 2024-09-12T01:11:24.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.008+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.brlu-yQhDzBgSbw7x3iNwuhkpwIFGl5_0 2024-09-12T01:11:24.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.008+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7802576376108597354', time=2024-09-12T03:01:00.337523+0000, chain.objs.size()=1 2024-09-12T01:11:24.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.008+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8BvZ5pM4SoTRN1NiAmQJ1TFjwrxX1ti_0 2024-09-12T01:11:24.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.009+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18118006469589802483', time=2024-09-12T03:01:00.344625+0000, chain.objs.size()=1 2024-09-12T01:11:24.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.009+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jyxzOgjMMGGGzyiOhbnq_KHhl-_MIaX_0 2024-09-12T01:11:24.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.009+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13346711495809205179', time=2024-09-12T03:01:00.355793+0000, chain.objs.size()=1 2024-09-12T01:11:24.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.009+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.I_9wuaO9a951_Sef0urUyLAFHhommF8_0 2024-09-12T01:11:24.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.010+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16955715157974014724', time=2024-09-12T03:01:00.384614+0000, chain.objs.size()=1 2024-09-12T01:11:24.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.010+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Zky75hONnvE68Pd011zG_YSDUjtmgm1_0 2024-09-12T01:11:24.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.010+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13194886160143416171', time=2024-09-12T03:01:00.458176+0000, chain.objs.size()=1 2024-09-12T01:11:24.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.010+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uLZBOFm_eC-L079S5qvWolCTfOEtXFv_0 2024-09-12T01:11:24.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.010+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9792744149204811140', time=2024-09-12T03:01:00.461345+0000, chain.objs.size()=1 2024-09-12T01:11:24.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.010+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rXZf-BuAdz2iqYMZH6OFsLikdgiTk2b_0 2024-09-12T01:11:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.012+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6927770209265859192', time=2024-09-12T03:01:00.473784+0000, chain.objs.size()=1 2024-09-12T01:11:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.012+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.aj5PLY5zjnuAPU8udharqI2ofGy32yK_0 2024-09-12T01:11:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.012+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8542025832058011347', time=2024-09-12T03:01:00.478991+0000, chain.objs.size()=1 2024-09-12T01:11:24.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.012+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Kg5e3ycrQ95IHbLywDtqb2Y7nEfzH3G_0 2024-09-12T01:11:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.012+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5881533921715648342', time=2024-09-12T03:01:00.510962+0000, chain.objs.size()=1 2024-09-12T01:11:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.012+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dEWZ-5E3fv4zNtAROEMdtA2NkaKrtBE_0 2024-09-12T01:11:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.012+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2311191076695933808', time=2024-09-12T03:01:00.597133+0000, chain.objs.size()=1 2024-09-12T01:11:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.012+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1aIu3VK8b5NXRBfeFUidbc3pI-0VVFi_0 2024-09-12T01:11:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.013+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3900324038734609390', time=2024-09-12T03:01:00.599289+0000, chain.objs.size()=1 2024-09-12T01:11:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.013+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MHbYS2hWZUffFLBYy2OvY5_dB-7eDh9_0 2024-09-12T01:11:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.013+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6472658978843006425', time=2024-09-12T03:01:00.602702+0000, chain.objs.size()=1 2024-09-12T01:11:24.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.013+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.EfJBId_yb8yCFGShI_r2MKcSRHe3imk_0 2024-09-12T01:11:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.014+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12750616091833085148', time=2024-09-12T03:01:00.648612+0000, chain.objs.size()=1 2024-09-12T01:11:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.014+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vERJg4wIP_52iZghWTBKh95pC27ImQ__0 2024-09-12T01:11:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.014+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12428196975216310620', time=2024-09-12T03:01:00.668836+0000, chain.objs.size()=1 2024-09-12T01:11:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.014+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uYVHuhbBhYqY1gLI6lZCVze8RHh1N3R_0 2024-09-12T01:11:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.015+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13121550157844219059', time=2024-09-12T03:01:00.699144+0000, chain.objs.size()=1 2024-09-12T01:11:24.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.015+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Ld368dA6wnkGJljAcFdiWowOC6PFc5a_0 2024-09-12T01:11:24.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.016+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18140135205471563764', time=2024-09-12T03:01:00.702282+0000, chain.objs.size()=1 2024-09-12T01:11:24.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.016+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ehasmhLTKHQxCgPmfJIZMMT9CjElF5f_0 2024-09-12T01:11:24.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.016+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11622211237847472591', time=2024-09-12T03:01:00.710330+0000, chain.objs.size()=1 2024-09-12T01:11:24.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.016+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.U0003eiVhNvOYB2E_b-sNwt2E4T9V6t_0 2024-09-12T01:11:24.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.379762582109001407', time=2024-09-12T03:01:00.745141+0000, chain.objs.size()=1 2024-09-12T01:11:24.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RgQQPL3hOY4knecUgUHhKw15OPd77HA_0 2024-09-12T01:11:24.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2813338771171202730', time=2024-09-12T03:01:00.758384+0000, chain.objs.size()=1 2024-09-12T01:11:24.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ru2AaJAowR5M73b77xjhAHaaaOLOabt_0 2024-09-12T01:11:24.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3662548835015544615', time=2024-09-12T03:01:00.765081+0000, chain.objs.size()=1 2024-09-12T01:11:24.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.X3SNMSjBlWZ8bwrkBc4LlPebxySVRWS_0 2024-09-12T01:11:24.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13065344944902182518', time=2024-09-12T03:01:00.844445+0000, chain.objs.size()=1 2024-09-12T01:11:24.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.06wNSoGEDQhzFQTwG9YZG7DqN6AjFC4_0 2024-09-12T01:11:24.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8209869181729084888', time=2024-09-12T03:01:00.936284+0000, chain.objs.size()=1 2024-09-12T01:11:24.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WxCgixipebBAaWIP7aXNttsTgqNf77H_0 2024-09-12T01:11:24.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11670731878118032424', time=2024-09-12T03:01:00.958145+0000, chain.objs.size()=1 2024-09-12T01:11:24.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cWynTnpZ3jGrXFj7k5gKcKHh25wUe_N_0 2024-09-12T01:11:24.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12979189013442922330', time=2024-09-12T03:01:01.434989+0000, chain.objs.size()=1 2024-09-12T01:11:24.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.018+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.264__shadow_.5DTqgkONyHllLgH8RYorhTaxLdUO8Bq_0 2024-09-12T01:11:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.019+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17370244700816460834', time=2024-09-12T03:01:02.831488+0000, chain.objs.size()=1 2024-09-12T01:11:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.019+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.267__shadow_.h3YByW5FsDCdFlFsz_iY4OiueqrI5Y2_0 2024-09-12T01:11:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.019+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13592228552479329531', time=2024-09-12T03:01:04.207377+0000, chain.objs.size()=1 2024-09-12T01:11:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.019+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.270__shadow_.yisqCFf0UeJk3bUjM7JWHMQ50EPEWPO_0 2024-09-12T01:11:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.021+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15240035614240987077', time=2024-09-12T03:01:13.390882+0000, chain.objs.size()=1 2024-09-12T01:11:24.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.021+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.289__shadow_.Ud-rK-7R_7m-b4KVCFCxxa3SQmzHXYk_0 2024-09-12T01:11:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.021+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6379990363562038400', time=2024-09-12T03:01:23.718846+0000, chain.objs.size()=1 2024-09-12T01:11:24.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.021+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.308__shadow:qRMWQExH6tzfMkhPR4gThKZCv2C2xrU_.R3JWB_gBu_XAlcqeJSbtd2L1hKs1ZtX_0 2024-09-12T01:11:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.022+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3870894003177253735', time=2024-09-12T03:01:29.457121+0000, chain.objs.size()=1 2024-09-12T01:11:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.022+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.320__shadow:.yTpJ195AUhS1Dw2kjjpEoavo5Q1nJJ_.O8WyM8A7tmaDiHqSrQu0RtVNTYYXuSy_0 2024-09-12T01:11:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.022+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15909025966873233468', time=2024-09-12T03:01:40.133706+0000, chain.objs.size()=1 2024-09-12T01:11:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.022+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2Vh3BDt-pGNTPyV7kt9sJtWswX4WuuQ_0 2024-09-12T01:11:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.022+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17046437914504383189', time=2024-09-12T03:01:40.267709+0000, chain.objs.size()=1 2024-09-12T01:11:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.022+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._Zk_VmWvdbV9yjoWG05XGUhkbrQvaIw_0 2024-09-12T01:11:24.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.022+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6138368819026380007', time=2024-09-12T03:01:40.379617+0000, chain.objs.size()=1 2024-09-12T01:11:24.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.022+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JqyklO6sCA-A0ZyPwyEmc6udMqLpB1m_0 2024-09-12T01:11:24.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.023+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17787482501577879623', time=2024-09-12T03:01:40.386819+0000, chain.objs.size()=1 2024-09-12T01:11:24.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.023+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fl40fQhDfKnqdPWtUR8bi283FEFVxm__0 2024-09-12T01:11:24.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.023+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16907204303863019212', time=2024-09-12T03:01:40.424823+0000, chain.objs.size()=1 2024-09-12T01:11:24.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.023+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.TJsZT_ntOWhrBfaUCicrW7JtoJztwnR_0 2024-09-12T01:11:24.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.023+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15218707350563130152', time=2024-09-12T03:01:40.502956+0000, chain.objs.size()=1 2024-09-12T01:11:24.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.023+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.chDOH-6DP80d8xGfLOltuYM7HiB4nSb_0 2024-09-12T01:11:24.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.025+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12084446545471052713', time=2024-09-12T03:01:40.509256+0000, chain.objs.size()=1 2024-09-12T01:11:24.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.025+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uKzAdpb6XM_Ne8FmGt8Qh8-1a4GG0Wh_0 2024-09-12T01:11:24.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.025+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14464929400072847878', time=2024-09-12T03:01:40.538090+0000, chain.objs.size()=1 2024-09-12T01:11:24.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.025+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._BkjvGyiC4u7q9k0fYvDuonCsCWV__Y_0 2024-09-12T01:11:24.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13572432723649812906', time=2024-09-12T03:01:40.550901+0000, chain.objs.size()=1 2024-09-12T01:11:24.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JCvdpUhnGbX3r6-JdIs8cTdtfogfn38_0 2024-09-12T01:11:24.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9230556194675811192', time=2024-09-12T03:01:40.648528+0000, chain.objs.size()=1 2024-09-12T01:11:24.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.57o4PSEAxm7L8CN28dBUih8WTSJx3Hr_0 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2943644000501133352', time=2024-09-12T03:01:40.661358+0000, chain.objs.size()=1 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QSfQqNsd2t3thZz_dOgFxagaF8REq5A_0 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1072484017348596794', time=2024-09-12T03:01:40.695041+0000, chain.objs.size()=1 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.IkDYPQPU3Bk_Y-LONOhiYFVldB9OJEK_0 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1807934945566797612', time=2024-09-12T03:01:40.698867+0000, chain.objs.size()=1 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sQrDjkBYk6XB9C7Ynr1ckvIPTkDokP1_0 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4769361826085212663', time=2024-09-12T03:01:40.815275+0000, chain.objs.size()=1 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FHXzw-wwk17xrN5bZOsZ8PvvBrM5jvS_0 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5355123150788293287', time=2024-09-12T03:01:40.821780+0000, chain.objs.size()=1 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Gj2kJX-uy1IabyNMS3WM-1cljIABxPb_0 2024-09-12T01:11:24.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13386053319707987350', time=2024-09-12T03:01:40.919377+0000, chain.objs.size()=1 2024-09-12T01:11:24.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.cUwFg3mZ7hZIeDyZvcoQ29v-WUWhwEN_0 2024-09-12T01:11:24.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5155562764877726318', time=2024-09-12T03:01:40.994081+0000, chain.objs.size()=1 2024-09-12T01:11:24.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uPMJOV22CC0h2g7oRSaQyC4_k2Jfu6M_0 2024-09-12T01:11:24.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1413966697352871324', time=2024-09-12T03:01:41.197574+0000, chain.objs.size()=1 2024-09-12T01:11:24.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.028+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.G8PDCu38xr13L9-oSmhucnebWrQ7cSV_0 2024-09-12T01:11:24.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.030+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5038162724770826972', time=2024-09-12T03:01:41.216323+0000, chain.objs.size()=1 2024-09-12T01:11:24.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.030+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.neCtBrE7Mv_1Kq8aRBMpALlC8O7ts2f_0 2024-09-12T01:11:24.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.032+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5301848844317195559', time=2024-09-12T03:01:41.284709+0000, chain.objs.size()=1 2024-09-12T01:11:24.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.032+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Hbvxtc3Cby7rbupqf6MfHkIKYw2sg2y_0 2024-09-12T01:11:24.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.032+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15492826396680889283', time=2024-09-12T03:01:41.298706+0000, chain.objs.size()=1 2024-09-12T01:11:24.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.032+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ni63ZDgCyzZ-pQbuOOb1nwWH3DpBDjA_0 2024-09-12T01:11:24.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.032+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13637833716069705356', time=2024-09-12T03:01:41.444505+0000, chain.objs.size()=1 2024-09-12T01:11:24.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.032+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LGEfKuvCqovvudYL3Ub2tE7Sv13ck3v_0 2024-09-12T01:11:24.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.033+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5745840660993814566', time=2024-09-12T03:01:41.448159+0000, chain.objs.size()=1 2024-09-12T01:11:24.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.033+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uZdkKW5pFjUAv06PHX-tX5LLLu5yrJ4_0 2024-09-12T01:11:24.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.033+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11673317354846071669', time=2024-09-12T03:01:41.526731+0000, chain.objs.size()=1 2024-09-12T01:11:24.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.033+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tV9UkCUc9nIv64BTkng3gB-3tdlZNL3_0 2024-09-12T01:11:24.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.033+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13097035793774091972', time=2024-09-12T03:01:41.562621+0000, chain.objs.size()=1 2024-09-12T01:11:24.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.033+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vhGUto82vwbDqtNNqqVIs678nP8AKCI_0 2024-09-12T01:11:24.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.033+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13748703679748728018', time=2024-09-12T03:01:41.619634+0000, chain.objs.size()=1 2024-09-12T01:11:24.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.033+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ri8AK6YOPU9KmdZGfei8eq5m9tpDRwi_0 2024-09-12T01:11:24.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5235241729742812965', time=2024-09-12T03:01:41.712643+0000, chain.objs.size()=1 2024-09-12T01:11:24.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uf-a9LQirCv4TLD_2CIbncU8NlF5ocQ_0 2024-09-12T01:11:24.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.697239821290519408', time=2024-09-12T03:01:41.863713+0000, chain.objs.size()=1 2024-09-12T01:11:24.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ifa5VzJ3J87IzWmuClfiqtIOQ2mawvf_0 2024-09-12T01:11:24.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1699830191518744383', time=2024-09-12T03:01:41.890155+0000, chain.objs.size()=1 2024-09-12T01:11:24.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.btaTyKcI8bIHEtCTwyM3SZYSGrZjA1y_0 2024-09-12T01:11:24.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6270509940051213418', time=2024-09-12T03:01:41.893084+0000, chain.objs.size()=1 2024-09-12T01:11:24.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.cU8ewPeMOVX3cs1JsRsydCgvKGgOX5y_0 2024-09-12T01:11:24.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14300861542283846134', time=2024-09-12T03:01:41.975107+0000, chain.objs.size()=1 2024-09-12T01:11:24.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.036+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-WOg8dHnpoFVhRmlMKfIv76jln4cl_k_0 2024-09-12T01:11:24.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8739500584856011151', time=2024-09-12T03:01:41.977523+0000, chain.objs.size()=1 2024-09-12T01:11:24.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0DhH-hm9GyVequ41tT0QGwI-SM_uiXm_0 2024-09-12T01:11:24.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1057434192438018566', time=2024-09-12T03:01:42.037097+0000, chain.objs.size()=1 2024-09-12T01:11:24.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6rMZhrsefXewBCNDgFpDy0UVimV9kZ-_0 2024-09-12T01:11:24.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11467786997133311729', time=2024-09-12T03:01:42.043725+0000, chain.objs.size()=1 2024-09-12T01:11:24.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.RsMJntHvv-YQ1rYbkjC_P4RR3rN8Lp6_0 2024-09-12T01:11:24.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4349992154378956359', time=2024-09-12T03:01:50.227199+0000, chain.objs.size()=1 2024-09-12T01:11:24.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-bdCJL01dyPqDGbRAhojNRcpkKVTfeP_0 2024-09-12T01:11:24.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.450036085552001225', time=2024-09-12T03:01:50.236298+0000, chain.objs.size()=1 2024-09-12T01:11:24.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.i9M67mSXDXboxoKsvxj6yIHp5Xp4Twv_0 2024-09-12T01:11:24.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16995630469721303704', time=2024-09-12T03:01:50.247102+0000, chain.objs.size()=1 2024-09-12T01:11:24.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.038+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.XN9sKvDmfZM6xZX2Knfp8J9m3NH6fdF_0 2024-09-12T01:11:24.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14611290876105721496', time=2024-09-12T03:01:50.252615+0000, chain.objs.size()=1 2024-09-12T01:11:24.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zpcUYD--GwmUWKOBTvf1W3FD-cOf_Mk_0 2024-09-12T01:11:24.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11354546356164060241', time=2024-09-12T03:01:50.314441+0000, chain.objs.size()=1 2024-09-12T01:11:24.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DZX1L4mp-_URGJPXnIuF9cW_KaQ_ZA2_0 2024-09-12T01:11:24.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8568955659540331381', time=2024-09-12T03:01:50.381130+0000, chain.objs.size()=1 2024-09-12T01:11:24.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uroN4hiQBkx_7zLSqH6-ISlx5mMg1lo_0 2024-09-12T01:11:24.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3644051988407639919', time=2024-09-12T03:01:50.387374+0000, chain.objs.size()=1 2024-09-12T01:11:24.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1OVntw6sdWqL5ginZrGgCtHzQIDHQ7I_0 2024-09-12T01:11:24.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2293364063396876119', time=2024-09-12T03:01:50.610361+0000, chain.objs.size()=1 2024-09-12T01:11:24.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.30KlRiMfRVmDUshHRJtA6VBllnW4NTn_0 2024-09-12T01:11:24.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3171463679884545813', time=2024-09-12T03:01:50.655271+0000, chain.objs.size()=1 2024-09-12T01:11:24.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fQk7Xk3F94fOdf2VZ3tZtqfllv4ft_X_0 2024-09-12T01:11:24.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6401740308281362758', time=2024-09-12T03:01:50.667397+0000, chain.objs.size()=1 2024-09-12T01:11:24.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.042+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.o52d_h8sSR4357W6ipOa2e2q2wAgQXr_0 2024-09-12T01:11:24.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.047+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/45471 2024-09-12T01:11:24.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-12T01:11:24.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17016301883878052460', time=2024-09-12T03:01:50.699974+0000, chain.objs.size()=1 2024-09-12T01:11:24.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gXgUk871vtxOayg6XkHBoKnbXlBRr4r_0 2024-09-12T01:11:24.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11738920985408709199', time=2024-09-12T03:01:50.728266+0000, chain.objs.size()=1 2024-09-12T01:11:24.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IES5RX191Rj9gxRiJ09c6o7I8BVpNl5_0 2024-09-12T01:11:24.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13200499567412877575', time=2024-09-12T03:01:50.852065+0000, chain.objs.size()=1 2024-09-12T01:11:24.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Y-f0TRjpkrEzHIQdKyGS98o1LNjKg8X_0 2024-09-12T01:11:24.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11312478158032500689', time=2024-09-12T03:01:50.857442+0000, chain.objs.size()=1 2024-09-12T01:11:24.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qVaEauLSeMULGEEx14cr7XucLmoBK0O_0 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17779042120416920053', time=2024-09-12T03:01:50.868980+0000, chain.objs.size()=1 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.B3WWFZ-liAxyPk_182JBnIUu6HWuRLP_0 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9365890434124395169', time=2024-09-12T03:01:50.925604+0000, chain.objs.size()=1 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.wJfxM78OKsZNU9o0jSLbxxVuj_tD7o3_0 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14530782525090631301', time=2024-09-12T03:01:50.951999+0000, chain.objs.size()=1 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.R017By3OGfR9440LcbzyKlQ41kJ87wV_0 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7917507280324498730', time=2024-09-12T03:01:51.003612+0000, chain.objs.size()=1 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fa14TdVbuAOPVZPZMY6MUDE8vAjUUXe_0 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8346793690360725714', time=2024-09-12T03:01:51.086408+0000, chain.objs.size()=1 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6EUYFuQ2eReaWHw2aQLA8y64-AyLSsF_0 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.967733117838217081', time=2024-09-12T03:01:51.103609+0000, chain.objs.size()=1 2024-09-12T01:11:24.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vbPhGDjpGtxZYi_yWDeOdwRkBVtcfIt_0 2024-09-12T01:11:24.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10836708838693193225', time=2024-09-12T03:01:51.164128+0000, chain.objs.size()=1 2024-09-12T01:11:24.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ulzGyH5zCxuvwz5HBjyPxz1fvWSe7K__0 2024-09-12T01:11:24.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6475914209422375916', time=2024-09-12T03:01:51.187779+0000, chain.objs.size()=1 2024-09-12T01:11:24.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.050+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.XqW-vH00yqT24wEO2R6COw9qXtoEc9L_0 2024-09-12T01:11:24.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.054+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8131629308457648443', time=2024-09-12T03:01:51.214183+0000, chain.objs.size()=1 2024-09-12T01:11:24.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.054+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Q4S1WbID0-gkBmBuuJTdM5bkhPjfYrG_0 2024-09-12T01:11:24.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.054+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10665317708003962011', time=2024-09-12T03:01:51.260426+0000, chain.objs.size()=1 2024-09-12T01:11:24.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.054+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.YyGn9L46k62cLffliN0Bdg4-bLC-frZ_0 2024-09-12T01:11:24.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.054+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6642413044166809467', time=2024-09-12T03:01:51.376021+0000, chain.objs.size()=1 2024-09-12T01:11:24.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.054+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.c4GPq2b5IGqPcKBCcjhyFnjBm5PU8cK_0 2024-09-12T01:11:24.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.054+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8840861822406147220', time=2024-09-12T03:01:51.697994+0000, chain.objs.size()=1 2024-09-12T01:11:24.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.054+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.SzzrVwuPzSS5jkBZ90inlUi0KdITDNx_0 2024-09-12T01:11:24.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6570332513582529245', time=2024-09-12T03:01:51.709447+0000, chain.objs.size()=1 2024-09-12T01:11:24.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Zc92viwP87tQ87i6AIjO4nbc_9_pstI_0 2024-09-12T01:11:24.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7017411602680571354', time=2024-09-12T03:01:51.733457+0000, chain.objs.size()=1 2024-09-12T01:11:24.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Y3650FWe3IoZ9GPWwUwPJXftBHYgWlG_0 2024-09-12T01:11:24.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15415209257738347843', time=2024-09-12T03:01:51.758783+0000, chain.objs.size()=1 2024-09-12T01:11:24.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4OODyz1snoP1la0GCi02o3eT2Lm_xk0_0 2024-09-12T01:11:24.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.665451576830565045', time=2024-09-12T03:01:51.805542+0000, chain.objs.size()=1 2024-09-12T01:11:24.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mA0FPQg-uEATRH8pk1lP0-fnlOoM_BH_0 2024-09-12T01:11:24.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7670107750527179178', time=2024-09-12T03:01:51.977229+0000, chain.objs.size()=1 2024-09-12T01:11:24.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zxRayYoLDe6R1KzV0vWqgPzM-y3_Tnf_0 2024-09-12T01:11:24.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8063890272164427761', time=2024-09-12T03:01:51.994398+0000, chain.objs.size()=1 2024-09-12T01:11:24.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ff6BguzvmLEFEgDRGnSdI8VBMrUXiU2_0 2024-09-12T01:11:24.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18069372269495288010', time=2024-09-12T03:01:52.099400+0000, chain.objs.size()=1 2024-09-12T01:11:24.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.055+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GO624NlTcr9jXXaF0ow1YBJdXYHXZam_0 2024-09-12T01:11:24.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1553761784872708481', time=2024-09-12T03:01:52.326005+0000, chain.objs.size()=1 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.shMDonqk9XOucqqGieLpFE_J60cSMTJ_0 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14284692891112192212', time=2024-09-12T03:03:21.917745+0000, chain.objs.size()=6 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.1 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.2 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.3 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.4 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.5 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.508__multipart_srcmultipart.2~af5CBSLuM6SBbqDlErtUssqseQ_k71b.6 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7632905992434946363', time=2024-09-12T03:04:28.659888+0000, chain.objs.size()=2 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.555__shadow_.tIZfHQd81DzR5LpoH1mm4t_11xdCZvd_0 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.555__shadow_.tIZfHQd81DzR5LpoH1mm4t_11xdCZvd_1 2024-09-12T01:11:24.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17413568576822980764', time=2024-09-12T03:04:29.922207+0000, chain.objs.size()=1 2024-09-12T01:11:24.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.557__shadow_.AfBk9yrLhBQFqacRWeaJ73x7SwQsiIb_0 2024-09-12T01:11:24.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.968818823199806156', time=2024-09-12T03:04:47.417608+0000, chain.objs.size()=1 2024-09-12T01:11:24.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.061+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.571__shadow:BvDXnMkyhLTre775-JAJwPQ81y075Ct_.-XswUKBEtitBOXv2S3VttoHkBYX9TEB_0 2024-09-12T01:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9143852504570954781', time=2024-09-12T03:04:50.178238+0000, chain.objs.size()=1 2024-09-12T01:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow_.FZ24HvDJ2ajqMDdqP1BkGquIs_slbnB_0 2024-09-12T01:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17846327181556844282', time=2024-09-12T03:04:52.318454+0000, chain.objs.size()=1 2024-09-12T01:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow:WeSt3i.yu.mgWz8OJTWy4YlwvRWtvtq_.yW7zRL5wpzlwonJowBUfexjecrH3W0y_0 2024-09-12T01:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6051274694011664120', time=2024-09-12T03:05:07.075233+0000, chain.objs.size()=1 2024-09-12T01:11:24.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:rnKnt0jX799issol.9YaVNLvKsT91VW_.l5Hz9-FY3FH4tSPP3N2MovgyhrvJJeQ_0 2024-09-12T01:11:24.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17691835341823423886', time=2024-09-12T03:05:09.312196+0000, chain.objs.size()=1 2024-09-12T01:11:24.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:GqUSjIKBMCw6O0abJPQYuz3M5OFYKqp_.ROd2-tPWBSltjGIAwOSfZngu9dkw7eo_0 2024-09-12T01:11:24.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14254701142451313547', time=2024-09-12T03:07:48.494544+0000, chain.objs.size()=1 2024-09-12T01:11:24.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.065+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.638__shadow_.Z5KnhaCi69BpvgQdi7-pyHOHqE_QWRo_0 2024-09-12T01:11:24.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.066+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2291447543797482251', time=2024-09-12T03:08:02.419573+0000, chain.objs.size()=1 2024-09-12T01:11:24.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.066+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.665__shadow_.cd6yV8lpbmQpuz0ZVjczuuic5XSRU4c_0 2024-09-12T01:11:24.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.066+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10694857238166914777', time=2024-09-12T03:08:08.760908+0000, chain.objs.size()=1 2024-09-12T01:11:24.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.066+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.680__shadow_.gtiOv2yusoOqTWPWMYlZQsHaLtgUk5W_0 2024-09-12T01:11:24.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.066+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8593871563245177214', time=2024-09-12T03:08:17.718542+0000, chain.objs.size()=1 2024-09-12T01:11:24.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.066+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.702__shadow:FZWtgl2hCl77l5CuBpHI0pl5Do8DEZc_.GGNQwoy9XS7ZOvbxKs-kkqoKBWOYNb__0 2024-09-12T01:11:24.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.070+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.073+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:11:24.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.074+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.075+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51465' 2024-09-12T01:11:24.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11310150679861401217', time=2024-09-12T02:59:14.611975+0000, chain.objs.size()=1 2024-09-12T01:11:24.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.190__shadow_.h9j_l7NMID1zCa1XOAgqIxyv_jDjsqJ_0 2024-09-12T01:11:24.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7554699525680556786', time=2024-09-12T03:00:37.560106+0000, chain.objs.size()=1 2024-09-12T01:11:24.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.237__shadow_.Lf0YvqECYjjLRps3DpgHNNpUUuYwyen_0 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2115411184943070571', time=2024-09-12T03:00:45.502328+0000, chain.objs.size()=1 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.251__shadow_.UFox8l2FtS-suCMapRjI7Uoy-rFERoX_0 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5441203430101595191', time=2024-09-12T03:00:45.978297+0000, chain.objs.size()=1 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.252__shadow_.s2x3hKIGdYh3AOlNygOfSCEGhkrx1Al_0 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17374171130514965440', time=2024-09-12T03:00:50.206298+0000, chain.objs.size()=1 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.261__shadow_.l5repH_JIfqwiDeOR0lVS9hr_GtyAVP_0 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16004362256609579766', time=2024-09-12T03:00:58.963242+0000, chain.objs.size()=1 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jFIdz02uxFRUHmslQ9vb0UyADqD8gWK_0 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12714910175181490319', time=2024-09-12T03:00:58.987372+0000, chain.objs.size()=1 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.klh9NuhGyzh6GPovx6Nv9HZazroivAI_0 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17285893900255597857', time=2024-09-12T03:00:58.998052+0000, chain.objs.size()=1 2024-09-12T01:11:24.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DhBelXN5VYFBMVDEDlQPS_aaucpaSaD_0 2024-09-12T01:11:24.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2571624345093451634', time=2024-09-12T03:00:59.003362+0000, chain.objs.size()=1 2024-09-12T01:11:24.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Jo2OsN-oSXiPD5b6MyDRI9qGy9mG7om_0 2024-09-12T01:11:24.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10025625192956399', time=2024-09-12T03:00:59.007845+0000, chain.objs.size()=1 2024-09-12T01:11:24.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.0kmcA1MeWAsaWdAY3lLqk79hgnXrBGu_0 2024-09-12T01:11:24.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15629134841120042122', time=2024-09-12T03:00:59.017663+0000, chain.objs.size()=1 2024-09-12T01:11:24.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2GIqFwSdXK5XQX0ZbyCXrjsV_oK8T8__0 2024-09-12T01:11:24.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14447429792545354116', time=2024-09-12T03:00:59.126582+0000, chain.objs.size()=1 2024-09-12T01:11:24.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.076+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Y5Weuqnh0GdI6ceTZghebluZda9vVnq_0 2024-09-12T01:11:24.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2016366898516813368', time=2024-09-12T03:00:59.203962+0000, chain.objs.size()=1 2024-09-12T01:11:24.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jfRgMuwrHll-OyId_bDORx4sR5CPHfg_0 2024-09-12T01:11:24.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16099296482721096786', time=2024-09-12T03:00:59.229684+0000, chain.objs.size()=1 2024-09-12T01:11:24.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sp0RMnYPiFcBtW847tWk3ptyTJ3fjjK_0 2024-09-12T01:11:24.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12989817938085674084', time=2024-09-12T03:00:59.402162+0000, chain.objs.size()=1 2024-09-12T01:11:24.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ClKabxUXbvnrn9O0ss9M6pR3d2bMW6b_0 2024-09-12T01:11:24.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8071165557019534493', time=2024-09-12T03:00:59.418106+0000, chain.objs.size()=1 2024-09-12T01:11:24.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wZa-nwFOP0OVJXq2EddA666cWqPb747_0 2024-09-12T01:11:24.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7318777065092432685', time=2024-09-12T03:00:59.431410+0000, chain.objs.size()=1 2024-09-12T01:11:24.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.PNPg1lYTyzJDwafh-mkTMRzqCxaIdOk_0 2024-09-12T01:11:24.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8138257641621251689', time=2024-09-12T03:00:59.448517+0000, chain.objs.size()=1 2024-09-12T01:11:24.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.079+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fOjYjwTh_hDvMZCAfeVbxAsSiXQA3Pr_0 2024-09-12T01:11:24.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17996821212971720064', time=2024-09-12T03:00:59.492302+0000, chain.objs.size()=1 2024-09-12T01:11:24.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ET-i-MONELBqiBkDoyxEVaWVrry-Z1D_0 2024-09-12T01:11:24.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6172482114981938758', time=2024-09-12T03:00:59.571739+0000, chain.objs.size()=1 2024-09-12T01:11:24.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Omhrs_soG5aUFJW9BnAujilolZo6hrL_0 2024-09-12T01:11:24.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12551984935811083056', time=2024-09-12T03:00:59.664094+0000, chain.objs.size()=1 2024-09-12T01:11:24.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.c7TjE5qvB4ttrlgPjwX_Dn04B_WSCXg_0 2024-09-12T01:11:24.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3934862344357337724', time=2024-09-12T03:00:59.665922+0000, chain.objs.size()=1 2024-09-12T01:11:24.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.E1yo5tGvjpUkm_3o4WqQmZvztWtUgUw_0 2024-09-12T01:11:24.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8784091221987329392', time=2024-09-12T03:00:59.727408+0000, chain.objs.size()=1 2024-09-12T01:11:24.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2fJNJrAMCEMOCe0Fzy2_oeCxGzEkF1L_0 2024-09-12T01:11:24.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13533471720301378937', time=2024-09-12T03:00:59.930046+0000, chain.objs.size()=1 2024-09-12T01:11:24.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.082+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Uv47WJCopm8wPEas1LgxKXETOO-5mNX_0 2024-09-12T01:11:24.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.084+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12286309769132521432', time=2024-09-12T03:00:59.960128+0000, chain.objs.size()=1 2024-09-12T01:11:24.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.084+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mbNYiefDnkwefwVGY5w3TEVaut8bYIl_0 2024-09-12T01:11:24.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.084+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1964483702036744463', time=2024-09-12T03:01:00.014499+0000, chain.objs.size()=1 2024-09-12T01:11:24.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.084+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rad13Up7Nq21paJep80-KaHDX_5lqEI_0 2024-09-12T01:11:24.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6133014073891515159', time=2024-09-12T03:01:00.041424+0000, chain.objs.size()=1 2024-09-12T01:11:24.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MxjyBYzN2vBNI-N4Kqg-Rgrjl7mByao_0 2024-09-12T01:11:24.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1383612845755575999', time=2024-09-12T03:01:00.371299+0000, chain.objs.size()=1 2024-09-12T01:11:24.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fG5dYh4bunCP3SBX-y-3UigsZXfadDs_0 2024-09-12T01:11:24.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.939043325687060944', time=2024-09-12T03:01:00.401901+0000, chain.objs.size()=1 2024-09-12T01:11:24.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wa82F9UgZ27ZEUSShCr1onwx5tI0KQE_0 2024-09-12T01:11:24.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9730030334839427915', time=2024-09-12T03:01:00.431973+0000, chain.objs.size()=1 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jQY2Tdqcz7quCQV5iNkghIwBVrakIW3_0 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16754205453689618412', time=2024-09-12T03:01:00.696228+0000, chain.objs.size()=1 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.agHvjlhXMyGeoj79a0H7xvGS7VEaNpW_0 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.348749486527592818', time=2024-09-12T03:01:00.753669+0000, chain.objs.size()=1 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6xQEFkbivmgPOQvdtMfUSy9El1N9XJ__0 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8774406914073888260', time=2024-09-12T03:01:00.940890+0000, chain.objs.size()=1 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Z6SX09KIPBzmMaj_oW2QKbKdxbs3djH_0 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4664893071626866255', time=2024-09-12T03:01:00.946344+0000, chain.objs.size()=1 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.H-amJ_zEgjIdOrR_eBFUMISJ-drpqJM_0 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8742131459743643622', time=2024-09-12T03:01:01.906752+0000, chain.objs.size()=1 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.265__shadow_.mHw-d9J0w7xTkY0-LbSFQfDMFwCSKdl_0 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9943329425766417633', time=2024-09-12T03:01:06.097417+0000, chain.objs.size()=1 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.274__shadow_.UZx5MP-HifarI65wlIpNmw_k6gtcYXc_0 2024-09-12T01:11:24.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9960651299713902950', time=2024-09-12T03:01:09.379263+0000, chain.objs.size()=1 2024-09-12T01:11:24.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.087+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.281__shadow_.pEMEbMFbow6ASVyBKUzzXZWGMw4yx-E_0 2024-09-12T01:11:24.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.091+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16854903592492344888', time=2024-09-12T03:01:10.323974+0000, chain.objs.size()=1 2024-09-12T01:11:24.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.091+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.283__shadow_.bO0pELNeZErb4559K68q418wxEr3SsL_0 2024-09-12T01:11:24.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.093+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12970080055260897564', time=2024-09-12T03:01:12.442043+0000, chain.objs.size()=1 2024-09-12T01:11:24.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.093+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.287__shadow_.i3QFHrXPfr47PKbUroVMkryaLfHdE5s_0 2024-09-12T01:11:24.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12134686959939487560', time=2024-09-12T03:01:12.444261+0000, chain.objs.size()=1 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.287__shadow_.ZwOghcEjGh5QyIAAJ-W0K8dJ5iQy5bA_0 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17903470336796800327', time=2024-09-12T03:01:16.646733+0000, chain.objs.size()=1 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.eyH1SY6b9RusFz7VmXKNuTzo89wjioq_0 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9865630370419096508', time=2024-09-12T03:01:16.652361+0000, chain.objs.size()=1 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.vo_8_QxQLZyV4kJuAbRfQnoEfS_L2_0_0 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12369765886644606943', time=2024-09-12T03:01:18.063065+0000, chain.objs.size()=1 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.297__shadow_.FB_EB0KT37ybP0b06wXRlJvY2Ijyl7J_0 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2130469763065495227', time=2024-09-12T03:01:40.151539+0000, chain.objs.size()=1 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5g4GFNMbKbVAuZ8dZnKmJYqEBqL-oyD_0 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6236501716997835857', time=2024-09-12T03:01:40.196171+0000, chain.objs.size()=1 2024-09-12T01:11:24.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nV2xxZKKZSoTc8hpoNIDFNApDR5mc9C_0 2024-09-12T01:11:24.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3213590579940988120', time=2024-09-12T03:01:40.216285+0000, chain.objs.size()=1 2024-09-12T01:11:24.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.VtJdtqWDNpetDNOz30-fgIinXu-JoaU_0 2024-09-12T01:11:24.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4954639970319668065', time=2024-09-12T03:01:40.234135+0000, chain.objs.size()=1 2024-09-12T01:11:24.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.CrEp7njwuqNM_xHg4ZzoDSJ5ppom77j_0 2024-09-12T01:11:24.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3727854635182840128', time=2024-09-12T03:01:40.392116+0000, chain.objs.size()=1 2024-09-12T01:11:24.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.A2_WvMkEok93DEcRo4ZDUx8_UoP28WE_0 2024-09-12T01:11:24.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8170811873722836134', time=2024-09-12T03:01:40.418745+0000, chain.objs.size()=1 2024-09-12T01:11:24.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.095+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dh73uYk_R5LG32tdoEF1M1SSc8dvjg3_0 2024-09-12T01:11:24.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.097+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13752454871262733759', time=2024-09-12T03:01:40.427000+0000, chain.objs.size()=1 2024-09-12T01:11:24.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.097+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.27swcmiUPFSDTNjaKOrzUVPHkXP51Fw_0 2024-09-12T01:11:24.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.098+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16895104397244890206', time=2024-09-12T03:01:40.466197+0000, chain.objs.size()=1 2024-09-12T01:11:24.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.098+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8tPIb12_AG8NASwObxXr-oyzaUKmWdB_0 2024-09-12T01:11:24.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.098+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8196639926097660488', time=2024-09-12T03:01:40.786610+0000, chain.objs.size()=1 2024-09-12T01:11:24.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.098+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0XudRz-pPo7_xETHlxZOt2vqTohnBoo_0 2024-09-12T01:11:24.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.098+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2092662094162916209', time=2024-09-12T03:01:40.807374+0000, chain.objs.size()=1 2024-09-12T01:11:24.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.098+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.l9tshEdLmvzCz-aKCu9fVgjWizJZ5m0_0 2024-09-12T01:11:24.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.099+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1417277065006371590', time=2024-09-12T03:01:40.905987+0000, chain.objs.size()=1 2024-09-12T01:11:24.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.099+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PV0bQWofxZD9TZ7U5mt3objGYz9Q0Gz_0 2024-09-12T01:11:24.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.099+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10110190926092386530', time=2024-09-12T03:01:40.934671+0000, chain.objs.size()=1 2024-09-12T01:11:24.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.099+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.X1s8slXLsnAF7TmgF-nshvUPhw5AAb__0 2024-09-12T01:11:24.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12755563161924437029', time=2024-09-12T03:01:40.949548+0000, chain.objs.size()=1 2024-09-12T01:11:24.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7TYMR9rz3E72qCT7j1swCj7ZfdRLGpw_0 2024-09-12T01:11:24.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2462392668707614901', time=2024-09-12T03:01:41.005248+0000, chain.objs.size()=1 2024-09-12T01:11:24.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.twSBcWWsKnDd4cVUhY-wGjBNKt6UXnx_0 2024-09-12T01:11:24.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10685867530685045101', time=2024-09-12T03:01:41.079215+0000, chain.objs.size()=1 2024-09-12T01:11:24.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7Oo2BbKnsTfLCi1x7NtC6geMb2toMqV_0 2024-09-12T01:11:24.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4788042520206915495', time=2024-09-12T03:01:41.209191+0000, chain.objs.size()=1 2024-09-12T01:11:24.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1aycvs4ZuKOLwossSLjBO5lLwSPNqXb_0 2024-09-12T01:11:24.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3613530923835072202', time=2024-09-12T03:01:41.210524+0000, chain.objs.size()=1 2024-09-12T01:11:24.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.101+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.S1YPMrKvlDFOfvZ-94i-ilUmG23QEG7_0 2024-09-12T01:11:24.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.102+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10489395613353653555', time=2024-09-12T03:01:41.238075+0000, chain.objs.size()=1 2024-09-12T01:11:24.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.102+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wAoey4I2J4uVo22rslQaLUsByotLYCz_0 2024-09-12T01:11:24.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.103+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4413623417445419303', time=2024-09-12T03:01:41.255704+0000, chain.objs.size()=1 2024-09-12T01:11:24.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.103+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.woKIZyicY_-gSbk5KocMW8Rfjov7S29_0 2024-09-12T01:11:24.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.103+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12711431722667533743', time=2024-09-12T03:01:41.272310+0000, chain.objs.size()=1 2024-09-12T01:11:24.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.103+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nepXAqgMXOcB4W3vGGlQ7enErLlwqh5_0 2024-09-12T01:11:24.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8536518395345920487', time=2024-09-12T03:01:41.353756+0000, chain.objs.size()=1 2024-09-12T01:11:24.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.IxWSLY-MwpWeoMd51lJ6iFycZi5UaTG_0 2024-09-12T01:11:24.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12997751219227130887', time=2024-09-12T03:01:41.509030+0000, chain.objs.size()=1 2024-09-12T01:11:24.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mrUiHQkOysgRDjM32e1R0TEwpAkcg7O_0 2024-09-12T01:11:24.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5323636690272014914', time=2024-09-12T03:01:41.587024+0000, chain.objs.size()=1 2024-09-12T01:11:24.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3nw0SRoLasE3TzlGl6rmyACWJpa8wAo_0 2024-09-12T01:11:24.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18275419906379697937', time=2024-09-12T03:01:41.848516+0000, chain.objs.size()=1 2024-09-12T01:11:24.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dCUndZJmX78iIqWJGBdBQDZi5MoWE2G_0 2024-09-12T01:11:24.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6594355624038996252', time=2024-09-12T03:01:41.860547+0000, chain.objs.size()=1 2024-09-12T01:11:24.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.105+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.UeR3N3q96EoTChWKJpxBCGMWux22Ni7_0 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3082968377396660633', time=2024-09-12T03:01:41.875769+0000, chain.objs.size()=1 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.iVE0urYxzljSbfhWs9y7sZC1NQYisO2_0 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3803020563420664789', time=2024-09-12T03:01:42.012964+0000, chain.objs.size()=1 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5T_X-yEenOeRp7E3OzASPluGqbSz4IK_0 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13279706095063290134', time=2024-09-12T03:01:42.105763+0000, chain.objs.size()=1 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.OQeYD4rCuTCOqr4Q3YJT9oYbsGynN0t_0 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1214255047952879588', time=2024-09-12T03:01:42.112901+0000, chain.objs.size()=1 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3dG4qCjXC6V2hQIsRHWiSwMch4XYCiA_0 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15918746271189250980', time=2024-09-12T03:01:50.257004+0000, chain.objs.size()=1 2024-09-12T01:11:24.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tLcjFc73ZfyToIszXFgkNbJ7f4zZtR7_0 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18192880589023555339', time=2024-09-12T03:01:50.351654+0000, chain.objs.size()=1 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.EsltXMSErcbGbnEf7oaYSPc-LD5Rhxq_0 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14734966442969285271', time=2024-09-12T03:01:50.363867+0000, chain.objs.size()=1 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DkxMxMuvlDT2TguahuNXkA3vKNh7REa_0 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3624860777593213597', time=2024-09-12T03:01:50.374203+0000, chain.objs.size()=1 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4trsHOu4rTJOvPltbDW0y8AWReDAITi_0 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10955298158108529836', time=2024-09-12T03:01:50.395585+0000, chain.objs.size()=1 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._IctjHDd-X76ooduCg8-JTiavkyK04C_0 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9934197358332018134', time=2024-09-12T03:01:50.637862+0000, chain.objs.size()=1 2024-09-12T01:11:24.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.108+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.wn83L7PJo8Y2a93_NbZvhcO1PwlTs8O_0 2024-09-12T01:11:24.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.109+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9481164556157712717', time=2024-09-12T03:01:50.714645+0000, chain.objs.size()=1 2024-09-12T01:11:24.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.109+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pl5RRXfHbDgaMMLf-THouArpi2-mBMB_0 2024-09-12T01:11:24.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.112+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4825609900988790631', time=2024-09-12T03:01:50.876377+0000, chain.objs.size()=1 2024-09-12T01:11:24.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.112+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.eU4uodORYplT33w3FrVzB80gVpPRGN6_0 2024-09-12T01:11:24.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.112+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.707679847498407570', time=2024-09-12T03:01:51.094906+0000, chain.objs.size()=1 2024-09-12T01:11:24.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.112+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.YKdMSy6_m32LrzFZ_Tp_Jc9vAzGtvPH_0 2024-09-12T01:11:24.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.112+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15430334973167434638', time=2024-09-12T03:01:51.112458+0000, chain.objs.size()=1 2024-09-12T01:11:24.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.112+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pWdaeFB2pIuiwdBveRsdsGdJ5VtmJyh_0 2024-09-12T01:11:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13560414688338970878', time=2024-09-12T03:01:51.172265+0000, chain.objs.size()=1 2024-09-12T01:11:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.siYaq-3L_gKSBqorVoC4c0pJlb3H0O__0 2024-09-12T01:11:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15551419310149245581', time=2024-09-12T03:01:51.220257+0000, chain.objs.size()=1 2024-09-12T01:11:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Vu6YmQX7-q4q04pA8CfCfmsrxQrSmfu_0 2024-09-12T01:11:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15410544122243984873', time=2024-09-12T03:01:51.249698+0000, chain.objs.size()=1 2024-09-12T01:11:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.yl600zMAiDr6IYFYbtLHLxD9OYvlc5V_0 2024-09-12T01:11:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9791680653292906991', time=2024-09-12T03:01:51.273520+0000, chain.objs.size()=1 2024-09-12T01:11:24.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tbacKJmMKNu8GDF4oHX8Foct3a72z_W_0 2024-09-12T01:11:24.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11278343990520056037', time=2024-09-12T03:01:51.494631+0000, chain.objs.size()=1 2024-09-12T01:11:24.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.114+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.P0Y9B3zH2yYCFhSrsc6Bsoueg4hEmF4_0 2024-09-12T01:11:24.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.115+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17090241786927188573', time=2024-09-12T03:01:51.641230+0000, chain.objs.size()=1 2024-09-12T01:11:24.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.115+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oF-3kFD4xCYHYHhGMPMfgVvQQKgHWbQ_0 2024-09-12T01:11:24.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.116+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8575976493509246696', time=2024-09-12T03:01:51.646298+0000, chain.objs.size()=1 2024-09-12T01:11:24.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.116+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.eJ7F-aFl7Y-tan_QKzDKwTqK2c7ed9Q_0 2024-09-12T01:11:24.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.117+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6469503020767077765', time=2024-09-12T03:01:51.770707+0000, chain.objs.size()=1 2024-09-12T01:11:24.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.117+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.NcjOLmqo9Z-xnuobWLLGR27TDFIynhE_0 2024-09-12T01:11:24.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.117+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.557940091257691208', time=2024-09-12T03:01:51.810477+0000, chain.objs.size()=1 2024-09-12T01:11:24.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.117+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mvHmjt2bu2PJrAe5sgFDEoOJuRiyG1q_0 2024-09-12T01:11:24.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.117+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14724252859563675351', time=2024-09-12T03:01:51.929741+0000, chain.objs.size()=1 2024-09-12T01:11:24.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.117+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.plOX5TFJ7UIj1ql5__FTq-dpZrDFRtz_0 2024-09-12T01:11:24.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.121+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16537142075790843753', time=2024-09-12T03:01:52.008985+0000, chain.objs.size()=1 2024-09-12T01:11:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.121+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Tw8y1ovJQMeqKT71Otnv5Kl725yzGWp_0 2024-09-12T01:11:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.121+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17185306508051232591', time=2024-09-12T03:01:52.175455+0000, chain.objs.size()=1 2024-09-12T01:11:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.121+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-kFpA8uULHfJ8zfvKub-RmH-G6Q3fKV_0 2024-09-12T01:11:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.121+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5062245501379896937', time=2024-09-12T03:01:52.188173+0000, chain.objs.size()=1 2024-09-12T01:11:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.121+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.XJiNl2X0MHV9alI1kIwd7hTJWIzIOsv_0 2024-09-12T01:11:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.121+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17597353684252406604', time=2024-09-12T03:01:52.200261+0000, chain.objs.size()=1 2024-09-12T01:11:24.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.121+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xS06qvMvZQ3b8Ctf_x8-1DFMEglnosb_0 2024-09-12T01:11:24.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.124+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4977450335730264682', time=2024-09-12T03:01:54.109837+0000, chain.objs.size()=1 2024-09-12T01:11:24.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.124+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.329__shadow_.66jAJCx5fOR2-qEPQR98NGMDf7otVmm_0 2024-09-12T01:11:24.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.124+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5568467785904890229', time=2024-09-12T03:01:55.054172+0000, chain.objs.size()=1 2024-09-12T01:11:24.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.124+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.331__shadow_.OAVr10230Aa7kzzBDoKI4susrhKD0iq_0 2024-09-12T01:11:24.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.124+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6236539261748255656', time=2024-09-12T03:03:15.742673+0000, chain.objs.size()=1 2024-09-12T01:11:24.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.124+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.496__shadow_.40cYCyNdyMdMu9bz8xDjoxOJVo72FM-_0 2024-09-12T01:11:24.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.124+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10887633386675991606', time=2024-09-12T03:03:19.554768+0000, chain.objs.size()=1 2024-09-12T01:11:24.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.124+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.504__shadow:Sxqts83E9ch0mXuzA3cUygir9GtCc0q_.GJXGml4UggGV5JB-2HNawTbAzqH1P1u_0 2024-09-12T01:11:24.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.127+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/51465 2024-09-12T01:11:24.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.130+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:11:24.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.130+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17037884130287002048', time=2024-09-12T03:04:46.632871+0000, chain.objs.size()=1 2024-09-12T01:11:24.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.130+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:7ZsXnAv2obUrBb1gtOOdpIqqbP6juIw_.Wo1vr1nw-AzcgicDgEewFAoqGKvaObA_0 2024-09-12T01:11:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.130+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15837566794070057878', time=2024-09-12T03:04:48.684384+0000, chain.objs.size()=1 2024-09-12T01:11:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.130+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.573__shadow_.vlzwU3v2BDPactKotA_RQmciYdvKFQx_0 2024-09-12T01:11:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.130+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9364035266465443058', time=2024-09-12T03:08:23.477125+0000, chain.objs.size()=1 2024-09-12T01:11:24.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.130+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.715__shadow:sF8.2kW8Bq-fK2pIs3fFbD3hrTt8J6V_.uTl2KLhOef-Mk-byrZRruh671LFwc9Q_0 2024-09-12T01:11:24.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.132+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.134+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:11:24.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.135+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47594' 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_1XinFrtWcVgvPU302pSkWAwFOXjYiPt', time=2024-09-12T02:58:55.676064+0000, chain.objs.size()=3 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.VMg-hr1c4ws6cUmrV-ktsR7_g6ye8Bb_0 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.VMg-hr1c4ws6cUmrV-ktsR7_g6ye8Bb_1 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.VMg-hr1c4ws6cUmrV-ktsR7_g6ye8Bb_2 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15647962368437735182', time=2024-09-12T03:00:36.630227+0000, chain.objs.size()=1 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.235__shadow_.k4aCSG_7MQFJxYLY8-xYAoifJUCJdtK_0 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11121512232145395134', time=2024-09-12T03:00:39.221518+0000, chain.objs.size()=1 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.239__shadow_.SrbGKD-aPS67ujIJ-hT--FOu5El5mC1_0 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9682666095645369917', time=2024-09-12T03:00:39.222302+0000, chain.objs.size()=1 2024-09-12T01:11:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.239__shadow_.eiK56GAFLGd38UKskUJuyuq-SvHKy4a_0 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18342030293744770903', time=2024-09-12T03:00:40.094246+0000, chain.objs.size()=1 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.241__shadow_.zJ04iBEEJBunj3tXw1BV-h-H-TXAQof_0 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10780191276105251934', time=2024-09-12T03:00:40.582525+0000, chain.objs.size()=1 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.242__shadow_.YjFjXo9IMh1BHVViqZQI2ZZPjmZbpMl_0 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13890112744856639951', time=2024-09-12T03:00:43.627200+0000, chain.objs.size()=1 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.247__shadow_.oNEj6TpcuAApGnj-KBns4LGEqWMurCH_0 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7723700011620363986', time=2024-09-12T03:00:46.455208+0000, chain.objs.size()=1 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.253__shadow_.WlU01WwD2qk1WcED1SvoWF8lOoY53h7_0 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9778179994406698386', time=2024-09-12T03:00:48.850415+0000, chain.objs.size()=1 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.258__shadow_.9NXDS4si8M1yNXa53-uSbCG-rQYmk3k_0 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3617792281999227594', time=2024-09-12T03:00:58.872928+0000, chain.objs.size()=1 2024-09-12T01:11:24.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.136+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.K55HKj4gjlqcPFGE-B70bt5uvQiyLzK_0 2024-09-12T01:11:24.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.140+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5804712644293538667', time=2024-09-12T03:00:58.888286+0000, chain.objs.size()=1 2024-09-12T01:11:24.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.140+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.PT8VRFsPqz3rsJSr9sgjqOi-rZWdUxm_0 2024-09-12T01:11:24.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.140+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11057015932273908389', time=2024-09-12T03:00:58.927864+0000, chain.objs.size()=1 2024-09-12T01:11:24.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.140+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.aR9YCKBGE9cu4k6x002w9x2B_LeVIgH_0 2024-09-12T01:11:24.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.140+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16423615735656309245', time=2024-09-12T03:00:58.931412+0000, chain.objs.size()=1 2024-09-12T01:11:24.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.140+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eEcCttB-MsSGfgz2TVh1A33lfgm-Kmd_0 2024-09-12T01:11:24.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.140+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1694698292505904151', time=2024-09-12T03:00:59.145835+0000, chain.objs.size()=1 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eNNnv11f-IhDSwkMg3vsfBPqn5PuVXs_0 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14636584903100380175', time=2024-09-12T03:00:59.183674+0000, chain.objs.size()=1 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TSnHOz5QRQPEWrkASjeqFFQYRIs7r0F_0 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5316892742126523507', time=2024-09-12T03:00:59.189108+0000, chain.objs.size()=1 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6xaYu76i5Ry6qZZxP86lQJh7DEEWdSN_0 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9959371189726305597', time=2024-09-12T03:00:59.219857+0000, chain.objs.size()=1 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.iF83asUtPoyAB4c-aURexzaDCowvOCG_0 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11199249674063313634', time=2024-09-12T03:00:59.301643+0000, chain.objs.size()=1 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eSL0D_xY4ynH3pjTPg6RXD_q0tygBn0_0 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9058995029195661925', time=2024-09-12T03:00:59.427683+0000, chain.objs.size()=1 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZBl5n3S-5YDfNoD7p10Xcf53eUclm0B_0 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6169680606150812266', time=2024-09-12T03:00:59.703945+0000, chain.objs.size()=1 2024-09-12T01:11:24.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.141+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fph9rCbAu1f_LLvwXosddsdM3F7BceK_0 2024-09-12T01:11:24.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.143+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9957840814330882918', time=2024-09-12T03:00:59.752218+0000, chain.objs.size()=1 2024-09-12T01:11:24.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.143+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CPPedIMpb6AhnxXrLLXAHt23OUhlElN_0 2024-09-12T01:11:24.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.143+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14754390131445267914', time=2024-09-12T03:00:59.779465+0000, chain.objs.size()=1 2024-09-12T01:11:24.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.143+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Zq_KXQ3kcWnLOS-6VMzS1Hek02UjqwB_0 2024-09-12T01:11:24.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5086812234396070882', time=2024-09-12T03:00:59.802612+0000, chain.objs.size()=1 2024-09-12T01:11:24.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SarRzMDO_ar50vjg3FphhoDn0w-8ank_0 2024-09-12T01:11:24.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17293788532831402019', time=2024-09-12T03:00:59.813241+0000, chain.objs.size()=1 2024-09-12T01:11:24.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZlID1qYYO6QhYeNVfRzY99XL-9bhfyH_0 2024-09-12T01:11:24.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8164836820934571365', time=2024-09-12T03:00:59.824407+0000, chain.objs.size()=1 2024-09-12T01:11:24.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DqMbuc8nvNfgZ4QwzEfr_ZPprgEmJH3_0 2024-09-12T01:11:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13441948558139620159', time=2024-09-12T03:00:59.829109+0000, chain.objs.size()=1 2024-09-12T01:11:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.NgnNqQaZGMPMC6chN_MiP3DsyJZtnMW_0 2024-09-12T01:11:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12104918701650752605', time=2024-09-12T03:00:59.946919+0000, chain.objs.size()=1 2024-09-12T01:11:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.OspTgrJ-tO4zduHZN6Ofa-25Q5Md7LR_0 2024-09-12T01:11:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1325942053949301954', time=2024-09-12T03:01:00.321211+0000, chain.objs.size()=1 2024-09-12T01:11:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VrV152DTnpReF35vJyrR2x2Lm3ZEgCQ_0 2024-09-12T01:11:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.145+0000 7ff630961640 0 -- 172.21.15.83:0/2086660974 >> [v2:172.21.15.83:6808/1437963911,v1:172.21.15.83:6809/1437963911] conn(0x55f3f8dcaae0 msgr2=0x7ff4fc08f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:11:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.146+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11337049632729691664', time=2024-09-12T03:01:00.377444+0000, chain.objs.size()=1 2024-09-12T01:11:24.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.146+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FDLR9JCCMem0isqi3L27-eiunabVDNB_0 2024-09-12T01:11:24.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.146+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4285551178414139800', time=2024-09-12T03:01:00.384839+0000, chain.objs.size()=1 2024-09-12T01:11:24.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.146+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RaPmK_wKT6T5lbmU078fb-MobAqBtm8_0 2024-09-12T01:11:24.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.146+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16521047081737227278', time=2024-09-12T03:01:00.436844+0000, chain.objs.size()=1 2024-09-12T01:11:24.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.146+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Zy69ba1GSGbKSZUh_G7N9ZrrmmVHUz3_0 2024-09-12T01:11:24.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.149+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.996559679998240688', time=2024-09-12T03:01:00.469330+0000, chain.objs.size()=1 2024-09-12T01:11:24.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.149+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tHOoIXyIC2Lo2tlCL50w-zryYNfmdyz_0 2024-09-12T01:11:24.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.150+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6040672930954641910', time=2024-09-12T03:01:00.501920+0000, chain.objs.size()=1 2024-09-12T01:11:24.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.150+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1NwY5UbVT32lojZdVTi4LDHz7hEB9wG_0 2024-09-12T01:11:24.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.150+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4027652935516535696', time=2024-09-12T03:01:00.680276+0000, chain.objs.size()=1 2024-09-12T01:11:24.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.150+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.HUH-8Msywz0p5vNFSQ-oV39N-t-Sm7E_0 2024-09-12T01:11:24.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.150+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4033125419511253528', time=2024-09-12T03:01:00.691087+0000, chain.objs.size()=1 2024-09-12T01:11:24.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.150+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oVcFVi06oTYjLD9XjFPdXRCgKxn3aWm_0 2024-09-12T01:11:24.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.152+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3314852695312715068', time=2024-09-12T03:01:00.756150+0000, chain.objs.size()=1 2024-09-12T01:11:24.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.152+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ijKuophCIzbheGJfaYkdlNtVa-nK2xG_0 2024-09-12T01:11:24.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12004468186830277459', time=2024-09-12T03:01:00.846199+0000, chain.objs.size()=1 2024-09-12T01:11:24.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.adwvX3XUy3yZKfZohA85YiX2ZCmjSb3_0 2024-09-12T01:11:24.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8711927531595490392', time=2024-09-12T03:01:00.868458+0000, chain.objs.size()=1 2024-09-12T01:11:24.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.aVBBdVIMcLN5hrQxFcVwtfD0CJUzKen_0 2024-09-12T01:11:24.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2245737595069985938', time=2024-09-12T03:01:00.880529+0000, chain.objs.size()=1 2024-09-12T01:11:24.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7o5GfzDrd9F357PHOW09vUgH4Da2EhE_0 2024-09-12T01:11:24.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5194782576390770841', time=2024-09-12T03:01:00.903480+0000, chain.objs.size()=1 2024-09-12T01:11:24.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.eMSaxFd4ZqCznBzj8U5EwrvuxDByWQB_0 2024-09-12T01:11:24.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15813479585020052921', time=2024-09-12T03:01:00.941077+0000, chain.objs.size()=1 2024-09-12T01:11:24.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5CtcaAVckUZZkfBxD86VBj_2E2mTKWm_0 2024-09-12T01:11:24.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5742509417488410687', time=2024-09-12T03:01:00.944855+0000, chain.objs.size()=1 2024-09-12T01:11:24.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ioU9kNRkzzr6bwePZlt53rHoshozylg_0 2024-09-12T01:11:24.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18328609740920476910', time=2024-09-12T03:01:00.988907+0000, chain.objs.size()=1 2024-09-12T01:11:24.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7dFQc0N8gEBhQ1_P4IJjh4wRnCxK35J_0 2024-09-12T01:11:24.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17191072173102811695', time=2024-09-12T03:01:08.892260+0000, chain.objs.size()=1 2024-09-12T01:11:24.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.153+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.280__shadow_.RoJr910Tt16iZl97yGphAboBbnmKFkm_0 2024-09-12T01:11:24.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.156+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1657712124131665265', time=2024-09-12T03:01:09.866202+0000, chain.objs.size()=1 2024-09-12T01:11:24.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.156+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.282__shadow_.cpkNBWy4ej3s8jEuHT75E_0IO5xYkXw_0 2024-09-12T01:11:24.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.156+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3535446387861403059', time=2024-09-12T03:01:10.324898+0000, chain.objs.size()=1 2024-09-12T01:11:24.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.156+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.283__shadow_.uWrtP-Sqx-o4nc9_wQsluMf_FDW5g7u_0 2024-09-12T01:11:24.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.156+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13230371167718411796', time=2024-09-12T03:01:11.921937+0000, chain.objs.size()=1 2024-09-12T01:11:24.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.156+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.286__shadow_.3EXpRMY7Jdi26R9kped9n7MZ__VcDC1_0 2024-09-12T01:11:24.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2314781474113537980', time=2024-09-12T03:01:12.932513+0000, chain.objs.size()=1 2024-09-12T01:11:24.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.288__shadow_.ZGk4pGoFZFs5Xq05w2_bf2FUTNegnnW_0 2024-09-12T01:11:24.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12399906149994330535', time=2024-09-12T03:01:14.316899+0000, chain.objs.size()=1 2024-09-12T01:11:24.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.291__shadow_.43KgL0QFpbIbq5vKLkviIfZUQ7-50Qf_0 2024-09-12T01:11:24.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9053860892487349667', time=2024-09-12T03:01:15.850844+0000, chain.objs.size()=1 2024-09-12T01:11:24.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.KGQM-cmlQ5eC3rs6xasC-RoeVsbQrBT_0 2024-09-12T01:11:24.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.386281004051902854', time=2024-09-12T03:01:21.514242+0000, chain.objs.size()=1 2024-09-12T01:11:24.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.304__shadow_.mQ13T-cHUZTwSHrBvzsucmdwkI8Ijhs_0 2024-09-12T01:11:24.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8009195885921190240', time=2024-09-12T03:01:40.143987+0000, chain.objs.size()=1 2024-09-12T01:11:24.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.gPjE8iiiwy-L2l02X5HkSHkdNX_ps0J_0 2024-09-12T01:11:24.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16454642933873175879', time=2024-09-12T03:01:40.192513+0000, chain.objs.size()=1 2024-09-12T01:11:24.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.tb33G_WnY7463jQAwzainNTM7RWtRua_0 2024-09-12T01:11:24.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1998222757383326198', time=2024-09-12T03:01:40.381723+0000, chain.objs.size()=1 2024-09-12T01:11:24.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.158+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.H5ILfRgVnARYjRXemrBcGEcWtg8sm88_0 2024-09-12T01:11:24.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.159+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13430618150326361890', time=2024-09-12T03:01:40.387630+0000, chain.objs.size()=1 2024-09-12T01:11:24.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.159+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.xd0Qi70BZuABXvvEywMWIjmfBjZfUPh_0 2024-09-12T01:11:24.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.161+0000 7ff630961640 0 -- 172.21.15.83:0/2086660974 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff618001e90 msgr2=0x7ff4fc08c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:11:24.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.161+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16457184285909424139', time=2024-09-12T03:01:40.438589+0000, chain.objs.size()=1 2024-09-12T01:11:24.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.162+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WvVauPAde9QN2btMqN6l3Z1fT7C4R1P_0 2024-09-12T01:11:24.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.162+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7862636781864094779', time=2024-09-12T03:01:40.494990+0000, chain.objs.size()=1 2024-09-12T01:11:24.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.162+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wbZP4Q8FU4hYG81f1FUVRWog-5f59Vl_0 2024-09-12T01:11:24.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.162+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14385717224496243929', time=2024-09-12T03:01:40.670005+0000, chain.objs.size()=1 2024-09-12T01:11:24.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.162+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jJwxRv3om9gskSTS-41KBR5Ldcm4YY3_0 2024-09-12T01:11:24.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1025204456244917845', time=2024-09-12T03:01:40.764761+0000, chain.objs.size()=1 2024-09-12T01:11:24.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.HobduJs7iukR9AT8fjd6gPgHTlD6UW9_0 2024-09-12T01:11:24.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3745685211185166150', time=2024-09-12T03:01:40.796056+0000, chain.objs.size()=1 2024-09-12T01:11:24.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.CIl2g1uLrapZzZZzvsY1tALqW7BWE0w_0 2024-09-12T01:11:24.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17035135389837006672', time=2024-09-12T03:01:40.954009+0000, chain.objs.size()=1 2024-09-12T01:11:24.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vdEyjnDTASmf6nZf4KJ9wsk2kBnSlw8_0 2024-09-12T01:11:24.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.646207266919937845', time=2024-09-12T03:01:41.024555+0000, chain.objs.size()=1 2024-09-12T01:11:24.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6vUjeR70rLmguati_YzLGHNseGDpEJw_0 2024-09-12T01:11:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4224117340891342648', time=2024-09-12T03:01:41.181160+0000, chain.objs.size()=1 2024-09-12T01:11:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.164+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._j5KjT7Owe0RA7eEr5tH8ICAI8ewD-V_0 2024-09-12T01:11:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.165+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12011729315362398015', time=2024-09-12T03:01:41.271511+0000, chain.objs.size()=1 2024-09-12T01:11:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.165+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.BaCm8Yd_4tkEzWnB3iByRcNN3bh4t8v_0 2024-09-12T01:11:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.165+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2031228780630229589', time=2024-09-12T03:01:41.297300+0000, chain.objs.size()=1 2024-09-12T01:11:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.165+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rsOUF4DAkRDdhmUpjCNFGwbDarHrr2e_0 2024-09-12T01:11:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.165+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13328323806649326473', time=2024-09-12T03:01:41.439324+0000, chain.objs.size()=1 2024-09-12T01:11:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.165+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.CNMbaytzstjNf3x4MXvdIeYEM3AA-lU_0 2024-09-12T01:11:24.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.165+0000 7ff630961640 0 -- 172.21.15.83:0/2086660974 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x55f3f8dcaae0 msgr2=0x7ff4fc08f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:11:24.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.168+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11552753105966520043', time=2024-09-12T03:01:41.446605+0000, chain.objs.size()=1 2024-09-12T01:11:24.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.168+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.S-xGzyCoQcne86vZx8hxxITtXUfIAns_0 2024-09-12T01:11:24.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.168+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18165071903423312802', time=2024-09-12T03:01:41.503742+0000, chain.objs.size()=1 2024-09-12T01:11:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.169+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.AOcjr1aHecjDrjkODe-SR13YPFKycU3_0 2024-09-12T01:11:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.169+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9463305914471966438', time=2024-09-12T03:01:41.556392+0000, chain.objs.size()=1 2024-09-12T01:11:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.169+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0PvRu9LfqiwEhhjgVf69xxyhIXaRJeO_0 2024-09-12T01:11:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.169+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18408111270708134885', time=2024-09-12T03:01:41.726197+0000, chain.objs.size()=1 2024-09-12T01:11:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.169+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ygJoudBfNO2kMt3xvybheKXXu28l0BO_0 2024-09-12T01:11:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.169+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10139579834868583588', time=2024-09-12T03:01:41.766483+0000, chain.objs.size()=1 2024-09-12T01:11:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.169+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MzxvC09nsc8OvDKoMyz8AEhUel74rkW_0 2024-09-12T01:11:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.169+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10475797412849386043', time=2024-09-12T03:01:41.804419+0000, chain.objs.size()=1 2024-09-12T01:11:24.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.169+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zabeFVSR8n8sVUnXJykGFy9Ewbrjr8z_0 2024-09-12T01:11:24.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4186892885866822076', time=2024-09-12T03:01:41.841059+0000, chain.objs.size()=1 2024-09-12T01:11:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GIdODc8eiJV2O0v_jW1_k2Ptw2Ifm7j_0 2024-09-12T01:11:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6583729431016820714', time=2024-09-12T03:01:41.981909+0000, chain.objs.size()=1 2024-09-12T01:11:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.SaC8C5vgnmrH7rrpCOMe9Z4qCVdM6Xg_0 2024-09-12T01:11:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17412941809488235025', time=2024-09-12T03:01:41.989939+0000, chain.objs.size()=1 2024-09-12T01:11:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3QgjLrvV59TpkCJAe4ttO-z9TCeVeb7_0 2024-09-12T01:11:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4028207149548476830', time=2024-09-12T03:01:42.050660+0000, chain.objs.size()=1 2024-09-12T01:11:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ldn5JZPlAEHQLvrCXC8VUw9DT_M0Wdi_0 2024-09-12T01:11:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6822815647255018318', time=2024-09-12T03:01:42.053950+0000, chain.objs.size()=1 2024-09-12T01:11:24.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.171+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qGlpVp9nxENfkumNgECHGemp5O8kPGD_0 2024-09-12T01:11:24.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.173+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15363469303833511750', time=2024-09-12T03:01:50.219651+0000, chain.objs.size()=1 2024-09-12T01:11:24.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.173+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.RkhbY5jrcTT_T-33CE09qKBHcdxJAWy_0 2024-09-12T01:11:24.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.173+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14918107420522802867', time=2024-09-12T03:01:50.278599+0000, chain.objs.size()=1 2024-09-12T01:11:24.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.173+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.t8Lx6WJ7CkxzIeEOcalC7cL2ioG3VBA_0 2024-09-12T01:11:24.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.173+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8693558106926964451', time=2024-09-12T03:01:50.353571+0000, chain.objs.size()=1 2024-09-12T01:11:24.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.173+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.UpwjI8JNj2fYGyu0vU_4dxoqfmP64R1_0 2024-09-12T01:11:24.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.173+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17184221687459830152', time=2024-09-12T03:01:50.588970+0000, chain.objs.size()=1 2024-09-12T01:11:24.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.173+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vhePPcUg2L1M9A_CuSyBABD8RdyR67i_0 2024-09-12T01:11:24.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.173+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8429794204914171398', time=2024-09-12T03:01:50.592877+0000, chain.objs.size()=1 2024-09-12T01:11:24.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.174+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kt2zEvdNCq9in3rZCsx8tWcXyUbDTKH_0 2024-09-12T01:11:24.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.174+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16891525553379739980', time=2024-09-12T03:01:50.597680+0000, chain.objs.size()=1 2024-09-12T01:11:24.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.174+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qarMQ-F6IlPNCwEzCTOWHWDceUDN_Eg_0 2024-09-12T01:11:24.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.174+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3217668232326392080', time=2024-09-12T03:01:50.819350+0000, chain.objs.size()=1 2024-09-12T01:11:24.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.174+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AfnOX0LBEZJnZc4s9cv210N2a9lg2xP_0 2024-09-12T01:11:24.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.175+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14853438949097480947', time=2024-09-12T03:01:50.833208+0000, chain.objs.size()=1 2024-09-12T01:11:24.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.175+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.sd6Juw5OIM7mEQsNS_cupps-37lWuaO_0 2024-09-12T01:11:24.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.175+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15821863179826517006', time=2024-09-12T03:01:50.851178+0000, chain.objs.size()=1 2024-09-12T01:11:24.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.175+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TFLB1Em2WUVvKGxNugbyCSpIHsehUB0_0 2024-09-12T01:11:24.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.175+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4531673621904499823', time=2024-09-12T03:01:50.960182+0000, chain.objs.size()=1 2024-09-12T01:11:24.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.175+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0bv1kfLcBCFEfhxQiwr4rgGPraHenCv_0 2024-09-12T01:11:24.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.175+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10643104186656815837', time=2024-09-12T03:01:51.186371+0000, chain.objs.size()=1 2024-09-12T01:11:24.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.175+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.S4OEUtPvphQeUvPymYkhsYGA1HY4qdr_0 2024-09-12T01:11:24.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.802242294036466712', time=2024-09-12T03:01:51.202979+0000, chain.objs.size()=1 2024-09-12T01:11:24.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IFbt-S6MkQfn_rWpSLMEhk4qbMgC0DL_0 2024-09-12T01:11:24.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13053504269506253307', time=2024-09-12T03:01:51.233036+0000, chain.objs.size()=1 2024-09-12T01:11:24.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.YHzyxCjnTZSlDEykxLXgEKa7PXDV_w6_0 2024-09-12T01:11:24.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6469842081023616929', time=2024-09-12T03:01:51.262283+0000, chain.objs.size()=1 2024-09-12T01:11:24.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.y8tSujN_0cUGn3Sekclt79dac1jKLK__0 2024-09-12T01:11:24.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7975805554583186169', time=2024-09-12T03:01:51.268485+0000, chain.objs.size()=1 2024-09-12T01:11:24.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Cmw8HC95McqSBrxagRu_DpNqb1Rp5_I_0 2024-09-12T01:11:24.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1778947952237932187', time=2024-09-12T03:01:51.486796+0000, chain.objs.size()=1 2024-09-12T01:11:24.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.scdl4EDt1V-Yr_cLqGC9wots6iqzU2h_0 2024-09-12T01:11:24.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11336739248046701409', time=2024-09-12T03:01:51.538870+0000, chain.objs.size()=1 2024-09-12T01:11:24.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jybsVwtMRkPOKSLmffuUZzyfZ8JIz0C_0 2024-09-12T01:11:24.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14924419003812073166', time=2024-09-12T03:01:51.659635+0000, chain.objs.size()=1 2024-09-12T01:11:24.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.178+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6RvVNu1nKipELnOJSiZ6C0bCOzDjwSR_0 2024-09-12T01:11:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.181+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3752460021059684426', time=2024-09-12T03:01:51.686131+0000, chain.objs.size()=1 2024-09-12T01:11:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.181+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.nhSFr_u9lZZRGbCk9pl9ImKCqpTh6D7_0 2024-09-12T01:11:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.181+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6475851431541616561', time=2024-09-12T03:01:51.692260+0000, chain.objs.size()=1 2024-09-12T01:11:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.181+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.85tG5Z851l2pKfY0b8UzCbykZLzaI96_0 2024-09-12T01:11:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.181+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7043539991583766376', time=2024-09-12T03:01:51.953590+0000, chain.objs.size()=1 2024-09-12T01:11:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.181+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ScMacG_qcGhH8ijpciD2Y0iM_BSmCAj_0 2024-09-12T01:11:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.181+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.61038673816923363', time=2024-09-12T03:01:51.961020+0000, chain.objs.size()=1 2024-09-12T01:11:24.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.181+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.w8xSTwftFnl0d8NgXSY7KWcRqPxXepq_0 2024-09-12T01:11:24.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.182+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2586085175054735134', time=2024-09-12T03:01:51.993864+0000, chain.objs.size()=1 2024-09-12T01:11:24.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.182+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8w-DLVwcGdbuSQzkvmiSXjhsBjd6LKj_0 2024-09-12T01:11:24.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.186+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47594 2024-09-12T01:11:24.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T01:11:24.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3483925154730204563', time=2024-09-12T03:01:52.042813+0000, chain.objs.size()=1 2024-09-12T01:11:24.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.p_yxetxEiyNZbRH3fmV1ZPYwCVpG39w_0 2024-09-12T01:11:24.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12898993106563756817', time=2024-09-12T03:01:52.075092+0000, chain.objs.size()=1 2024-09-12T01:11:24.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.BUavxkKMLqdtMOof-em-NcjGa1Lc_CC_0 2024-09-12T01:11:24.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11911691049761417532', time=2024-09-12T03:01:52.081965+0000, chain.objs.size()=1 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kgua0VVWoR7DnFhCjqyGYvcSwSPfd3z_0 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15988771454859869502', time=2024-09-12T03:01:52.098869+0000, chain.objs.size()=1 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OrG1q4JVyc0Jmh5UUkDoBLESNA9M6oG_0 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16393772914004362483', time=2024-09-12T03:01:52.168327+0000, chain.objs.size()=1 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uDrWjYj-bjrkVtvn5AXMclI2SQcNh3P_0 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1288297507033649169', time=2024-09-12T03:01:52.230694+0000, chain.objs.size()=1 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zGVxviC9es4lNxEY68NW5VH_J9KD0OO_0 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2044079571519302728', time=2024-09-12T03:01:52.242703+0000, chain.objs.size()=1 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.exYShvCqolZblZ2ijheLG5WX6WS2Vft_0 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16480784529904173657', time=2024-09-12T03:01:52.305286+0000, chain.objs.size()=1 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xJk9pz9d2I6iZepTDLNdnp5rWOG62q3_0 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4851510792283996645', time=2024-09-12T03:01:52.315303+0000, chain.objs.size()=1 2024-09-12T01:11:24.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LX5TBkYPwMAA0xgM5ksEaP3XOpXtWcy_0 2024-09-12T01:11:24.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8397858105048027985', time=2024-09-12T03:02:10.560410+0000, chain.objs.size()=1 2024-09-12T01:11:24.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.368__shadow_.Y_aK8T4no5_KFe2n6JcTxEOmLZv4KOp_0 2024-09-12T01:11:24.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7431518210341285479', time=2024-09-12T03:02:43.291473+0000, chain.objs.size()=1 2024-09-12T01:11:24.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.430__shadow_.lcikKtIFiFOGGBhZJgBHeb8SODKjX9l_0 2024-09-12T01:11:24.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.553896949204566958', time=2024-09-12T03:02:57.726256+0000, chain.objs.size()=1 2024-09-12T01:11:24.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.188+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.457__shadow_.rtWjF-1WwjrPaQTZGd6r2qpjvdHhnJX_0 2024-09-12T01:11:24.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13298508266843117817', time=2024-09-12T03:03:00.601576+0000, chain.objs.size()=1 2024-09-12T01:11:24.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.461__shadow_.5N5GWb4GAZlUMEvwdXrhXGni73G0koM_0 2024-09-12T01:11:24.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9472164680261198086', time=2024-09-12T03:03:02.715225+0000, chain.objs.size()=1 2024-09-12T01:11:24.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.464__shadow_.Lzd6ev1LRnaWTADVP2SpfxsayrY3a3l_0 2024-09-12T01:11:24.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.191+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8961014550068874556', time=2024-09-12T03:03:31.540719+0000, chain.objs.size()=3 2024-09-12T01:11:24.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.191+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.522__multipart_mymultipart.2~yhSjA_lV6dNpdzbhV0BKPt_i5zwt2bV.1 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.522__multipart_mymultipart.2~yhSjA_lV6dNpdzbhV0BKPt_i5zwt2bV.2 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.522__multipart_mymultipart.2~yhSjA_lV6dNpdzbhV0BKPt_i5zwt2bV.3 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~0oy_SLn4ibCqzpG6YIrW3r0mcoDOTVa', time=2024-09-12T03:03:32.751055+0000, chain.objs.size()=1 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~0oy_SLn4ibCqzpG6YIrW3r0mcoDOTVa.1 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7365089664724587547', time=2024-09-12T03:04:44.426780+0000, chain.objs.size()=1 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:1lrG7HqU7Oxz40qWKoHmy8nylzU5jF6_.oxW0cdWDjE4LOkWZ6zlEZUL6lSIsdpl_0 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10460078523435139788', time=2024-09-12T03:04:50.221155+0000, chain.objs.size()=1 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow_.Wgrv8iS5P9HxpYrcJrPduq0r0vymTo0_0 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5958318165492446032', time=2024-09-12T03:05:06.042071+0000, chain.objs.size()=1 2024-09-12T01:11:24.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:RVm7HicUyvTv2XmoS5Gbh99CfE20WLl_.WYU6T_FFZpD1WbTGtovocU8cnlfBBnT_0 2024-09-12T01:11:24.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1018578006439211880', time=2024-09-12T03:05:17.503046+0000, chain.objs.size()=1 2024-09-12T01:11:24.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.587__shadow:IkoZrv5f4k2Dd8mgdVFv-kdUVZWt-x._.K5R5EwcZDnSg_AakT5JlPA9-pcol_3o_0 2024-09-12T01:11:24.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q', time=2024-09-12T03:07:42.008600+0000, chain.objs.size()=12 2024-09-12T01:11:24.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.193+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__multipart_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.1 2024-09-12T01:11:24.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.196+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__shadow_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.1_1 2024-09-12T01:11:24.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.197+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__multipart_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.2 2024-09-12T01:11:24.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.197+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__shadow_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.2_1 2024-09-12T01:11:24.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.197+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__multipart_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.3 2024-09-12T01:11:24.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.198+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__shadow_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.3_1 2024-09-12T01:11:24.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.198+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__multipart_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.4 2024-09-12T01:11:24.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.198+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__shadow_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.4_1 2024-09-12T01:11:24.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.198+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__multipart_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.5 2024-09-12T01:11:24.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.199+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__shadow_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.5_1 2024-09-12T01:11:24.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.199+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__multipart_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.6 2024-09-12T01:11:24.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.199+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.625__shadow_multipart_enc.2~P9yh1c_osYOLhfxTmbBAOOcloMdU42Q.6_1 2024-09-12T01:11:24.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.201+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8639907663603989708', time=2024-09-12T03:07:48.981842+0000, chain.objs.size()=1 2024-09-12T01:11:24.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.201+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.639__shadow_.6dAaBoDF2N6Siooe_oZIlHW3wk_aRpj_0 2024-09-12T01:11:24.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.201+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6083712864451249374', time=2024-09-12T03:07:54.375471+0000, chain.objs.size()=2 2024-09-12T01:11:24.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.201+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.650__shadow_.enb3iXUt5nQ3vohcsj6-Kn1PJpYXlug_0 2024-09-12T01:11:24.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.201+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.650__shadow_.enb3iXUt5nQ3vohcsj6-Kn1PJpYXlug_1 2024-09-12T01:11:24.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.201+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13532414263160765430', time=2024-09-12T03:08:15.600498+0000, chain.objs.size()=1 2024-09-12T01:11:24.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.201+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.697__shadow:OyCfO57F79GewQJ2KO-C28hr7ROTRBU_.bi2GmaXE3b5e9ID-6kJh78ARenEkMfy_0 2024-09-12T01:11:24.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.203+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11194498894103384571', time=2024-09-12T03:08:19.121704+0000, chain.objs.size()=1 2024-09-12T01:11:24.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.203+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.705__shadow:r8RBs.3UIRT8Qdr44reaI6KrRbdfdoT_.-94NVaHtQfNDrv_D-wxv9iwmQwhXBJu_0 2024-09-12T01:11:24.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.203+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17376867622278922520', time=2024-09-12T03:08:22.448761+0000, chain.objs.size()=1 2024-09-12T01:11:24.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.203+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.712__multipart_file1.2~Sjjzt6bXWRJ-h7ZB9zb_TSif7fBnGtr.1 2024-09-12T01:11:24.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.203+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7416073296887349317', time=2024-09-12T03:08:57.317451+0000, chain.objs.size()=3 2024-09-12T01:11:24.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.203+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.744__multipart_mymultipart3.2~TgIWL1NOR5FDXYBiW-fhTSYumf0G8da.1 2024-09-12T01:11:24.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.203+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.744__multipart_mymultipart3.2~TgIWL1NOR5FDXYBiW-fhTSYumf0G8da.2 2024-09-12T01:11:24.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.205+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.744__multipart_mymultipart3.2~TgIWL1NOR5FDXYBiW-fhTSYumf0G8da.3 2024-09-12T01:11:24.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.209+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.212+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:11:24.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.213+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.213+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43471' 2024-09-12T01:11:24.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='__XWXSu2B9-78FwzhMIlK8-WfqAPUsaM', time=2024-09-12T02:58:55.670561+0000, chain.objs.size()=3 2024-09-12T01:11:24.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.b0gc1O8qcYQJIoUBzEJH2E-Y381e5uA_0 2024-09-12T01:11:24.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.b0gc1O8qcYQJIoUBzEJH2E-Y381e5uA_1 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.b0gc1O8qcYQJIoUBzEJH2E-Y381e5uA_2 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_zx70dTpU1iwvRpeBHIkc5V3dR97r9-C', time=2024-09-12T02:58:56.229355+0000, chain.objs.size()=1 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.164__shadow_.gdNYhx4tivLW6TWal1U7oalkVQzf_9K_0 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11022647803177094393', time=2024-09-12T03:00:38.433435+0000, chain.objs.size()=1 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.238__shadow_.l32XcgZQcNXli-lGspVEeeexNwiwPQS_0 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2592389227059916762', time=2024-09-12T03:00:40.583645+0000, chain.objs.size()=1 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.242__shadow_.aJuVS7_B4wYYSGcmOWUSmIEINXN__PB_0 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4282613571741787627', time=2024-09-12T03:00:45.502425+0000, chain.objs.size()=1 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.251__shadow_.gfnz8FdFv8ksWAsB65z4tXpCHPmxAP4_0 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.102093187309602907', time=2024-09-12T03:00:48.848080+0000, chain.objs.size()=1 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.258__shadow_.HTy5QA8sSSsMEBogn6LuhLsyYIkfCWa_0 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16270976127948721709', time=2024-09-12T03:00:58.863009+0000, chain.objs.size()=1 2024-09-12T01:11:24.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2D0ssNeXkRQmizxOaGAl_vPaZ1Ys8aT_0 2024-09-12T01:11:24.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15184681941063627232', time=2024-09-12T03:00:58.874302+0000, chain.objs.size()=1 2024-09-12T01:11:24.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WWN5bhBXWx85wgFsFSBGfoMGnKujoia_0 2024-09-12T01:11:24.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9796531115928863408', time=2024-09-12T03:00:58.875097+0000, chain.objs.size()=1 2024-09-12T01:11:24.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.iDhV-JKLllQvYd_REi-DImL3eVwbMNn_0 2024-09-12T01:11:24.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1611831633803194410', time=2024-09-12T03:00:58.975260+0000, chain.objs.size()=1 2024-09-12T01:11:24.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.214+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2LNZrJYA7u08Gs7jEMxB2cBTJ3OTGL8_0 2024-09-12T01:11:24.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14615391586203489317', time=2024-09-12T03:00:59.013563+0000, chain.objs.size()=1 2024-09-12T01:11:24.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sKub0tkWnzu9aCAdi0rQ4lqEjoG5uNG_0 2024-09-12T01:11:24.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4728021866832303553', time=2024-09-12T03:00:59.129978+0000, chain.objs.size()=1 2024-09-12T01:11:24.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.J8RMcwB2sgL7m2RQxUCu_P4pAfNTHs1_0 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9429516697809803529', time=2024-09-12T03:00:59.241818+0000, chain.objs.size()=1 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qlJ6XAmYfowy7eiVocvZNyekq8avMgT_0 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3818275500394526759', time=2024-09-12T03:00:59.416142+0000, chain.objs.size()=1 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bWJwjhT2Fc_GQsaLIF3QIFCNP2H1ZrU_0 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1675403473384605585', time=2024-09-12T03:00:59.417727+0000, chain.objs.size()=1 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.nJN5DlLinJCVZL4ZstMZ3jVi5Locbea_0 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4726025707178610180', time=2024-09-12T03:00:59.429657+0000, chain.objs.size()=1 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Fj9CqCoPb6W7pXiYfwghzpU5BNSMmDz_0 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15043220564992197479', time=2024-09-12T03:00:59.529490+0000, chain.objs.size()=1 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oQXhn5oGzk8rrJFw5bbE1I578c2xO5t_0 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13143047781997818182', time=2024-09-12T03:00:59.531447+0000, chain.objs.size()=1 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TpH-Q-RED2zT59qxLu7C5X-cnmEHEOk_0 2024-09-12T01:11:24.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17108773779527507067', time=2024-09-12T03:00:59.577838+0000, chain.objs.size()=1 2024-09-12T01:11:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.2ttfRIacAsHaPc5x_kj_U0oKL2aMsUm_0 2024-09-12T01:11:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3996898059684630345', time=2024-09-12T03:00:59.728798+0000, chain.objs.size()=1 2024-09-12T01:11:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.QssoZSxFl2IPu-8Fsp-LhYAfjQV0fTL_0 2024-09-12T01:11:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6563849813162146194', time=2024-09-12T03:00:59.815083+0000, chain.objs.size()=1 2024-09-12T01:11:24.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.218+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.AQyKYP6MTuR5_g_fh-tdh760Pt4BPyF_0 2024-09-12T01:11:24.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7910005352566566478', time=2024-09-12T03:00:59.956524+0000, chain.objs.size()=1 2024-09-12T01:11:24.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.k_YmTMIikJhIsWiZPLN4VO8jvbjSPRd_0 2024-09-12T01:11:24.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15807823582079106262', time=2024-09-12T03:01:00.004659+0000, chain.objs.size()=1 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WFj6gW5kPdC2stJIOVwBbut0FXGtBQA_0 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8972708546888862961', time=2024-09-12T03:01:00.024279+0000, chain.objs.size()=1 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cF6IY5TKR6GNXKOdU92Q59RLL5LD5Tr_0 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4868962551353880308', time=2024-09-12T03:01:00.095532+0000, chain.objs.size()=1 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tViMtY3f0yXRJ67vENz4K96ofvUR7BZ_0 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8737483884360484833', time=2024-09-12T03:01:00.341962+0000, chain.objs.size()=1 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sAzu8t2KAyEXKy3K2YwU3umcKLk0b5b_0 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18111273336256592384', time=2024-09-12T03:01:00.659517+0000, chain.objs.size()=1 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-Fy0D0IHZEq-5XHUnb5RyEdxlYcLcfv_0 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15044046085641385627', time=2024-09-12T03:01:00.663736+0000, chain.objs.size()=1 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oWHn22o0cR-QyO5QedYksoVThHwKyS-_0 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9742954022631378139', time=2024-09-12T03:01:00.762469+0000, chain.objs.size()=1 2024-09-12T01:11:24.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VerOF2xNZHqPtgbgTwB5HhT3ol6MPze_0 2024-09-12T01:11:24.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1547018203949794537', time=2024-09-12T03:01:00.769213+0000, chain.objs.size()=1 2024-09-12T01:11:24.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.223+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VU9k_8WL76BMgVnqZmOsF_xbRiq_Zge_0 2024-09-12T01:11:24.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.225+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3342990633534944724', time=2024-09-12T03:01:00.904231+0000, chain.objs.size()=1 2024-09-12T01:11:24.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.225+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4ej_9trfL0Fu-Oi7-oCkJSoiiuWLN_Q_0 2024-09-12T01:11:24.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.225+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3686087989064907642', time=2024-09-12T03:01:00.907842+0000, chain.objs.size()=1 2024-09-12T01:11:24.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.225+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uodn0Q7rpfaX0jMBlK-onagBNS1sbo7_0 2024-09-12T01:11:24.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.227+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3583379869295572285', time=2024-09-12T03:01:00.954006+0000, chain.objs.size()=1 2024-09-12T01:11:24.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.227+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.NgOvghuRRbk0i9TtZ1joQgD-CDXwmpH_0 2024-09-12T01:11:24.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2234067310949999559', time=2024-09-12T03:01:06.547408+0000, chain.objs.size()=1 2024-09-12T01:11:24.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.275__shadow_.Prq35v7WwaElAQvZEIxj-vvZ1JdiBtW_0 2024-09-12T01:11:24.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.229+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1597825449015331893', time=2024-09-12T03:01:09.867410+0000, chain.objs.size()=1 2024-09-12T01:11:24.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.229+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.282__shadow_.rGwAbS4xrwOwwAjOlNSbKeVtLK1er9i_0 2024-09-12T01:11:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11543391616763708842', time=2024-09-12T03:01:11.330759+0000, chain.objs.size()=1 2024-09-12T01:11:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.285__shadow_.-NxvWK3K8NwyclKN8s5EwjwxTAfCY6c_0 2024-09-12T01:11:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11395433298048874936', time=2024-09-12T03:01:12.933634+0000, chain.objs.size()=1 2024-09-12T01:11:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.288__shadow_.vR4Li-0vOzXzB4CkzmphIlcWZ7K_psy_0 2024-09-12T01:11:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9870122015794362967', time=2024-09-12T03:01:40.110328+0000, chain.objs.size()=1 2024-09-12T01:11:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.gzyWOKWNtbuWoeRid2e90RVVG7Z0R7g_0 2024-09-12T01:11:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10146436312037829001', time=2024-09-12T03:01:40.118926+0000, chain.objs.size()=1 2024-09-12T01:11:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8YQEEiqPZG8gcGEIsNoYlkW5jPTO3cN_0 2024-09-12T01:11:24.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11175196268817956156', time=2024-09-12T03:01:40.168841+0000, chain.objs.size()=1 2024-09-12T01:11:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.230+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yfPCjektMzkkKGshnVqXNs33ihZNij2_0 2024-09-12T01:11:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.232+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15877445950499720150', time=2024-09-12T03:01:40.178358+0000, chain.objs.size()=1 2024-09-12T01:11:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.232+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.DYzv_6rTSseADKTm640LH70dUN-TPbu_0 2024-09-12T01:11:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.232+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.996790212024386591', time=2024-09-12T03:01:40.183309+0000, chain.objs.size()=1 2024-09-12T01:11:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.232+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eO7l9X1JNbRACm7RjKOhY5wLoUhUctz_0 2024-09-12T01:11:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.232+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11016485587134332056', time=2024-09-12T03:01:40.461606+0000, chain.objs.size()=1 2024-09-12T01:11:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.232+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.glp_hEVF8cweSGbyL3rZRuPMax0EO1O_0 2024-09-12T01:11:24.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.232+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4801022603508278758', time=2024-09-12T03:01:40.496444+0000, chain.objs.size()=1 2024-09-12T01:11:24.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.232+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ak9TizJKe7pyk3iIg-jlWrRcFlXpTgq_0 2024-09-12T01:11:24.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.233+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18377148016464756779', time=2024-09-12T03:01:40.785134+0000, chain.objs.size()=1 2024-09-12T01:11:24.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.233+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-XFzjJoV0msimPxkIsL85LI4dTUR4jE_0 2024-09-12T01:11:24.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12170194492646717896', time=2024-09-12T03:01:40.787840+0000, chain.objs.size()=1 2024-09-12T01:11:24.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3VNPxdN_9p8m7y3ghMbjybPo-Ql353c_0 2024-09-12T01:11:24.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2125450854788989590', time=2024-09-12T03:01:40.923354+0000, chain.objs.size()=1 2024-09-12T01:11:24.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._tO3o9IEjRKl67TFtXEabFR1tT7K2UI_0 2024-09-12T01:11:24.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.234+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2330643526645483480', time=2024-09-12T03:01:40.977655+0000, chain.objs.size()=1 2024-09-12T01:11:24.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.234+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QaT5XrqzhfDN-rDV1GrqjI0xFqyCcns_0 2024-09-12T01:11:24.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.235+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10350214214890803367', time=2024-09-12T03:01:41.072095+0000, chain.objs.size()=1 2024-09-12T01:11:24.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.235+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rqgefBO8WfIAo9vVbpgUon5kmA1ovGS_0 2024-09-12T01:11:24.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.237+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12613595821861244146', time=2024-09-12T03:01:41.094500+0000, chain.objs.size()=1 2024-09-12T01:11:24.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.237+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.X729NiLhgKYYXfpogjJ6CXgarqbj0KS_0 2024-09-12T01:11:24.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.237+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3563286725470839169', time=2024-09-12T03:01:41.183061+0000, chain.objs.size()=1 2024-09-12T01:11:24.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.237+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Z6P55_5hj6yTQJYKWp9kAinx7HwlzyN_0 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4987008690594603299', time=2024-09-12T03:01:41.225197+0000, chain.objs.size()=1 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bIWQfWLmLn_43KSZ6CglOrtq6i6Jvqo_0 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15667009707459295963', time=2024-09-12T03:01:41.324914+0000, chain.objs.size()=1 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6WUO78sV_erYqOCXfvI2f9DWM--TrmT_0 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15046398537095253036', time=2024-09-12T03:01:41.328455+0000, chain.objs.size()=1 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zD6vob3mtnKtpiXUqz2iYHL8Uq_vv7D_0 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11090782752653846961', time=2024-09-12T03:01:41.337262+0000, chain.objs.size()=1 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.b3AjxOs8J05SukmwQJveMswbtRKEEen_0 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3790728771194558874', time=2024-09-12T03:01:41.349199+0000, chain.objs.size()=1 2024-09-12T01:11:24.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.gkM7q2-NDKBLivOAxZVBNFsjHucHfTs_0 2024-09-12T01:11:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8118499430557187071', time=2024-09-12T03:01:41.520084+0000, chain.objs.size()=1 2024-09-12T01:11:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zk9iUfvyosHTGzngdR2TV1NFt1RUV8E_0 2024-09-12T01:11:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18366706070391463635', time=2024-09-12T03:01:41.797005+0000, chain.objs.size()=1 2024-09-12T01:11:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PFXzvtTxpJLwmtDoKuzuvorsXt2sXr5_0 2024-09-12T01:11:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2851820390140980350', time=2024-09-12T03:01:41.819441+0000, chain.objs.size()=1 2024-09-12T01:11:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dTDsm9CDx0LUdJiiLEfRg5dvVzRyTIN_0 2024-09-12T01:11:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.58878226083557778', time=2024-09-12T03:01:41.862803+0000, chain.objs.size()=1 2024-09-12T01:11:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.243+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dDlT-NIdfzpZRxnlzlE3IOZcEZ41dfv_0 2024-09-12T01:11:24.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.244+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6451236480697771407', time=2024-09-12T03:01:41.885958+0000, chain.objs.size()=1 2024-09-12T01:11:24.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.244+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FOa5pEqKuxkQPjUmrce1u3jit1TBmf7_0 2024-09-12T01:11:24.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.244+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12590881402475903469', time=2024-09-12T03:01:41.897345+0000, chain.objs.size()=1 2024-09-12T01:11:24.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.244+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.a-f6T0zF6FyTohhYRseXVvdusV3u48i_0 2024-09-12T01:11:24.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6459635286249944091', time=2024-09-12T03:01:42.044097+0000, chain.objs.size()=1 2024-09-12T01:11:24.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8VYlYuZ6hFabCVhQwNdQEaB4ROa5Ql6_0 2024-09-12T01:11:24.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12349482392674704007', time=2024-09-12T03:01:42.072753+0000, chain.objs.size()=1 2024-09-12T01:11:24.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.l2gOCp57Qg8hwrXx8ranymi3bPwm4jg_0 2024-09-12T01:11:24.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9596620973062000882', time=2024-09-12T03:01:50.294611+0000, chain.objs.size()=1 2024-09-12T01:11:24.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.75f--NkYoNvJ5iuMc0tLd-PKjNENwz6_0 2024-09-12T01:11:24.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10826425605788396305', time=2024-09-12T03:01:50.330167+0000, chain.objs.size()=1 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KGfXutTbdze7aA3euUuilN9yNLU0Nyu_0 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10218065998524490050', time=2024-09-12T03:01:50.394777+0000, chain.objs.size()=1 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Z-8OPJ4JPZItF3ZfX5arKH2xNw7XGJj_0 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4589618243641053157', time=2024-09-12T03:01:50.604827+0000, chain.objs.size()=1 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ABmEG5DoIJt8lt8bN5VaF1OtN7Do1Od_0 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15700518018177186948', time=2024-09-12T03:01:50.609677+0000, chain.objs.size()=1 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4USjYNFpqyn-ukB9DJqCXgHyOiE7R7r_0 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14754186378749770921', time=2024-09-12T03:01:50.639745+0000, chain.objs.size()=1 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.c-xOLk6mILp7rLh7665isHA0EJfC3Xs_0 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10803800316261856940', time=2024-09-12T03:01:50.673022+0000, chain.objs.size()=1 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ANyD4Ydg2TGbSL2jse5oyNpQqqdOP2c_0 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14831621557831412412', time=2024-09-12T03:01:50.708961+0000, chain.objs.size()=1 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jCREl2zqdTXddioh5IlTMY1TL58hdeu_0 2024-09-12T01:11:24.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12981646157691390748', time=2024-09-12T03:01:50.844461+0000, chain.objs.size()=1 2024-09-12T01:11:24.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.248+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TostTnz0QQRRmeDAhLN3VBC0eJN8hch_0 2024-09-12T01:11:24.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6267861262384825577', time=2024-09-12T03:01:50.867585+0000, chain.objs.size()=1 2024-09-12T01:11:24.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OsZzyDCwfyBI6E2r3titp-8769PXmx4_0 2024-09-12T01:11:24.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.252+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3982599947980171108', time=2024-09-12T03:01:50.914451+0000, chain.objs.size()=1 2024-09-12T01:11:24.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.252+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pkwCVsbKbMLG5iqKpY0duCWjI8yCgwR_0 2024-09-12T01:11:24.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.253+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8898320892142759995', time=2024-09-12T03:01:51.119131+0000, chain.objs.size()=1 2024-09-12T01:11:24.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.253+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mbhr3Pt-ntK2a2y6aF0xy8BEvFN6U8q_0 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5489853437946944197', time=2024-09-12T03:01:51.255516+0000, chain.objs.size()=1 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hHbvxuc94a4ugudMF9VeWzPuO7i3BYS_0 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17798225913764781713', time=2024-09-12T03:01:51.389474+0000, chain.objs.size()=1 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.QOI3JVHf4iO4fqZfbwxBDS7wQiyikYU_0 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13850029193628845239', time=2024-09-12T03:01:51.405077+0000, chain.objs.size()=1 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.t_9Ei1EqznA3I9EwaS9_aRXrD0miZxm_0 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17405054557871487824', time=2024-09-12T03:01:51.410380+0000, chain.objs.size()=1 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tCZkvtEirE1n8zl1u6WRjI_z8V1eH-C_0 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4789984934366771637', time=2024-09-12T03:01:51.454730+0000, chain.objs.size()=1 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.HYN2EnCTwWiJJCEOR0bRz3oZCNDqYLX_0 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5802339664882841031', time=2024-09-12T03:01:51.511870+0000, chain.objs.size()=1 2024-09-12T01:11:24.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.255+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4By-VEufn2-pO-IZen4_RM3xcGx71_v_0 2024-09-12T01:11:24.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1736686992318194096', time=2024-09-12T03:01:51.542961+0000, chain.objs.size()=1 2024-09-12T01:11:24.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xL8KCd5Qr3JKZANIOreGvOdrmt7ypfj_0 2024-09-12T01:11:24.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11538411140155310093', time=2024-09-12T03:01:51.763655+0000, chain.objs.size()=1 2024-09-12T01:11:24.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kmfA0jNqhSe39bh8p9JgjMIEAvzLMQO_0 2024-09-12T01:11:24.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10021146688128690496', time=2024-09-12T03:01:51.900860+0000, chain.objs.size()=1 2024-09-12T01:11:24.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ymfqnE42x1D-KaFuOMmOTVUAwOVsnVG_0 2024-09-12T01:11:24.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4220485934805104794', time=2024-09-12T03:01:52.090239+0000, chain.objs.size()=1 2024-09-12T01:11:24.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TJPj59Q7uaqr18l-HwpAkVZYbjGnRAP_0 2024-09-12T01:11:24.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2137845033394209992', time=2024-09-12T03:01:52.178133+0000, chain.objs.size()=1 2024-09-12T01:11:24.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gFdmo9cD2PSclbX47lZPO7TkhulDuf5_0 2024-09-12T01:11:24.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5127649667805442115', time=2024-09-12T03:01:52.192534+0000, chain.objs.size()=1 2024-09-12T01:11:24.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mf7zKyOIvGDpYVLEiKDS0HNk6vWD3cS_0 2024-09-12T01:11:24.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9800675151848270504', time=2024-09-12T03:01:52.233000+0000, chain.objs.size()=1 2024-09-12T01:11:24.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.258+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CowFVPNjSN7lZoMvL5Hz2LnEUrbx84b_0 2024-09-12T01:11:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.261+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13818942243359357526', time=2024-09-12T03:01:52.238492+0000, chain.objs.size()=1 2024-09-12T01:11:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.261+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.VhYNjGK7zrqbEQvMkCaloPvN3g3D6PM_0 2024-09-12T01:11:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.261+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8327753633513184250', time=2024-09-12T03:01:52.299443+0000, chain.objs.size()=1 2024-09-12T01:11:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.261+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.dAuq_3BNAq5mcW6Ek3Lc_UR_ifjjEFx_0 2024-09-12T01:11:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.261+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5158129403731791847', time=2024-09-12T03:01:52.311222+0000, chain.objs.size()=1 2024-09-12T01:11:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.261+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TNgHAYnKpbGHp_P7lCyi5hAQSE2NnC1_0 2024-09-12T01:11:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.261+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12718878811853898187', time=2024-09-12T03:01:52.319721+0000, chain.objs.size()=1 2024-09-12T01:11:24.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.261+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.FZGdyPntcLHSkirMIdA6fOcSQGB_7_l_0 2024-09-12T01:11:24.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4645490039957757825', time=2024-09-12T03:03:13.740867+0000, chain.objs.size()=1 2024-09-12T01:11:24.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.491__shadow_.GnMFsFomiWyZJwA55L5g1i3RmM47tGK_0 2024-09-12T01:11:24.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4645490039957757825', time=2024-09-12T03:03:13.890319+0000, chain.objs.size()=1 2024-09-12T01:11:24.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.491__shadow_.GnMFsFomiWyZJwA55L5g1i3RmM47tGK_0 2024-09-12T01:11:24.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15397898666758242588', time=2024-09-12T03:03:25.314711+0000, chain.objs.size()=1 2024-09-12T01:11:24.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.517__multipart_mymultipartcopy.2~fxRN-I6b4RyaarZMnhScbV8hBYf7Ik0.1 2024-09-12T01:11:24.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11915291896916209196', time=2024-09-12T03:03:43.691587+0000, chain.objs.size()=2 2024-09-12T01:11:24.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~Q3M4iVeQ9v_3g77GqMhGKnTwWS3-oMX.1 2024-09-12T01:11:24.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~Q3M4iVeQ9v_3g77GqMhGKnTwWS3-oMX.2 2024-09-12T01:11:24.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1666195910571780871', time=2024-09-12T03:03:46.894799+0000, chain.objs.size()=1 2024-09-12T01:11:24.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.525__shadow_.Nkw-_y-W6YSKrc0sSHIGGLYYmcs3V7J_0 2024-09-12T01:11:24.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~HWCvjvjh1AiqkMm-T7iKpEm8qgVLuHZ', time=2024-09-12T03:03:50.801697+0000, chain.objs.size()=1 2024-09-12T01:11:24.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.532__multipart_mymultipart2.2~HWCvjvjh1AiqkMm-T7iKpEm8qgVLuHZ.1 2024-09-12T01:11:24.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17497261784827595640', time=2024-09-12T03:04:43.189231+0000, chain.objs.size()=1 2024-09-12T01:11:24.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.264+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:ScXiIYAIuse-m918Q1iKNprFA0rNCZQ_._Qva6kX6ACvf_k8BSu6Jcut_0kRIKsY_0 2024-09-12T01:11:24.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.269+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/43471 2024-09-12T01:11:24.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.271+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:11:24.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.271+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8241086792368634479', time=2024-09-12T03:04:44.929712+0000, chain.objs.size()=1 2024-09-12T01:11:24.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.271+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:KsOfwHQwK2haQFIIhzxAhZ68V6qwQYK_.pA-T6o8Ptc_-qwxd4_en0X-QoKnnxlb_0 2024-09-12T01:11:24.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.271+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12954076095899001018', time=2024-09-12T03:05:18.101788+0000, chain.objs.size()=1 2024-09-12T01:11:24.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.271+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.588__shadow:4xPJ1CaIvPQvu6NzQ491XsMrVLjw2bW_.LwxY4jkorTqJhlyfqCCTdE2zEV9hIRY_0 2024-09-12T01:11:24.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.271+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11227051219224566752', time=2024-09-12T03:07:47.554619+0000, chain.objs.size()=1 2024-09-12T01:11:24.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.271+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.636__shadow_.gnab9kprhqSoXSdiEwCEAxecmeBbLd8_0 2024-09-12T01:11:24.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.273+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.275+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:11:24.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.277+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.277+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50312' 2024-09-12T01:11:24.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17334525718772109953', time=2024-09-12T02:58:47.756699+0000, chain.objs.size()=1 2024-09-12T01:11:24.277 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.149__shadow_.T3Y6XviLXl4gsW4jza9f9pubyG1HJAF_0 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14321323429116396586', time=2024-09-12T02:58:56.946855+0000, chain.objs.size()=4 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.165__multipart_foo.2~ICVi5eoLT1DIl5lc2NfK65m7hdFxyXw.1 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.165__shadow_foo.2~ICVi5eoLT1DIl5lc2NfK65m7hdFxyXw.1_1 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.165__multipart_foo.2~ICVi5eoLT1DIl5lc2NfK65m7hdFxyXw.2 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.165__shadow_foo.2~ICVi5eoLT1DIl5lc2NfK65m7hdFxyXw.2_1 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14868289561128519824', time=2024-09-12T03:00:45.060098+0000, chain.objs.size()=1 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.250__shadow_.PhYtUuUTZeKBvAOGhApEeAlrhHRsfA0_0 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12442586271937521496', time=2024-09-12T03:00:48.402290+0000, chain.objs.size()=1 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.257__shadow_.83WXBZ1l5zhIQIsyjIW3U48Yp3QkNFU_0 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14534343615569536576', time=2024-09-12T03:00:50.206151+0000, chain.objs.size()=1 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.261__shadow_.GyREgiVVpgzR2bOzgbwAw8D30e2J4xl_0 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9422832563994412725', time=2024-09-12T03:00:58.893253+0000, chain.objs.size()=1 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JMlYI-nilPFL5_NpiDW1zZiVy86FLDr_0 2024-09-12T01:11:24.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10793784487965983933', time=2024-09-12T03:00:58.896041+0000, chain.objs.size()=1 2024-09-12T01:11:24.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SPQGM_NllJssQQZMJt1sYhR9iLe3jNr_0 2024-09-12T01:11:24.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11662309742120921542', time=2024-09-12T03:00:58.900712+0000, chain.objs.size()=1 2024-09-12T01:11:24.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7xO7dsGM6j-7OkhbkIC4znggut8oyS-_0 2024-09-12T01:11:24.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2521203736009489204', time=2024-09-12T03:00:58.907524+0000, chain.objs.size()=1 2024-09-12T01:11:24.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.278+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.iBolRwufgjNHnz4SERvKNFxq6BgVU3T_0 2024-09-12T01:11:24.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.282+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7538269704093794010', time=2024-09-12T03:00:58.946507+0000, chain.objs.size()=1 2024-09-12T01:11:24.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.282+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DXtsYjG3VR9xjS9lb5Jm0lZEzoOCr84_0 2024-09-12T01:11:24.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.282+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17524584967820408037', time=2024-09-12T03:00:58.974581+0000, chain.objs.size()=1 2024-09-12T01:11:24.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.282+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SiL_dgaHe2CLg6hw4-Z08f5rtKKLEfe_0 2024-09-12T01:11:24.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.282+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3192372165206319857', time=2024-09-12T03:00:59.002054+0000, chain.objs.size()=1 2024-09-12T01:11:24.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.282+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CNkmNu4xdTuQn2dihh9ViDsUrdeqAAn_0 2024-09-12T01:11:24.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10895200306387633450', time=2024-09-12T03:00:59.020750+0000, chain.objs.size()=1 2024-09-12T01:11:24.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oaEaNGOAaHBKG1eL5wW1g139nIRZ823_0 2024-09-12T01:11:24.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12914014107723254879', time=2024-09-12T03:00:59.174140+0000, chain.objs.size()=1 2024-09-12T01:11:24.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JPaPybXPFV8I0OEkC4I8Prnb5AzcTA__0 2024-09-12T01:11:24.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17422475090137301220', time=2024-09-12T03:00:59.237677+0000, chain.objs.size()=1 2024-09-12T01:11:24.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.aXBeT2Z7rbongOn9gNCoDza0_9yY001_0 2024-09-12T01:11:24.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10526734497939829038', time=2024-09-12T03:00:59.241655+0000, chain.objs.size()=1 2024-09-12T01:11:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fPAGnf7i3GbLomxB8eOtrM3A4f-W3zD_0 2024-09-12T01:11:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12862365794105249655', time=2024-09-12T03:00:59.445221+0000, chain.objs.size()=1 2024-09-12T01:11:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BGUYVXEqAKSzou-vTBGX4vHsLSwUuSj_0 2024-09-12T01:11:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10286081830446098808', time=2024-09-12T03:00:59.504477+0000, chain.objs.size()=1 2024-09-12T01:11:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.XLOUff3fjVN20fMMh8BmpdS1pAtuonH_0 2024-09-12T01:11:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.216225618644521670', time=2024-09-12T03:00:59.537461+0000, chain.objs.size()=1 2024-09-12T01:11:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.URKU5zo_InU7Wq3485RFSxkls8cfxAh_0 2024-09-12T01:11:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18139003706810314917', time=2024-09-12T03:00:59.542352+0000, chain.objs.size()=1 2024-09-12T01:11:24.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.283+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RoboS_KOI16W68mSMNSl3RFjAU6uLJA_0 2024-09-12T01:11:24.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.286+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9447828348273642411', time=2024-09-12T03:00:59.568555+0000, chain.objs.size()=1 2024-09-12T01:11:24.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.286+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.aGD-eNf9_F_3V5QfP_SAgezOIMNS5T0_0 2024-09-12T01:11:24.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.287+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14842065816762693437', time=2024-09-12T03:00:59.705759+0000, chain.objs.size()=1 2024-09-12T01:11:24.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.287+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lXAISCMk1zFG1IJJ1SWGx6ylGCKstYc_0 2024-09-12T01:11:24.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.287+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11655161101810029579', time=2024-09-12T03:00:59.738684+0000, chain.objs.size()=1 2024-09-12T01:11:24.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.287+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3QDxwbyvyjP5f2jLkvL9CNJZRIuriPP_0 2024-09-12T01:11:24.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.287+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11139474748428069829', time=2024-09-12T03:00:59.747987+0000, chain.objs.size()=1 2024-09-12T01:11:24.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.287+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.72lXTNhXVGBRBTID42XQsZAPu9rM6tj_0 2024-09-12T01:11:24.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.288+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7098118848745133856', time=2024-09-12T03:00:59.933952+0000, chain.objs.size()=1 2024-09-12T01:11:24.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.288+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._iVL4ghHNXIOv_GYgVjD3byvBdTkj8e_0 2024-09-12T01:11:24.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8453971765750735424', time=2024-09-12T03:00:59.968692+0000, chain.objs.size()=1 2024-09-12T01:11:24.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fBPojvVg9RY6dtGjt1RaGDc8j2kRLgg_0 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10098531431014692829', time=2024-09-12T03:00:59.993156+0000, chain.objs.size()=1 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bVm0mtSX36Gm_b8Likyu09vbXRNHuFz_0 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15086682729290388344', time=2024-09-12T03:01:00.026474+0000, chain.objs.size()=1 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9-3GLJMFRrwr-nbuNxr57Rp0hWsnzOQ_0 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9533456196486473569', time=2024-09-12T03:01:00.078503+0000, chain.objs.size()=1 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5pKQma10RX48wjKKgeGypb-GzEt2iJg_0 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3114405823362599734', time=2024-09-12T03:01:00.091783+0000, chain.objs.size()=1 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jS0wi9dcOqmz7cK4IRsH10nv5XuDMJI_0 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18204132166390184884', time=2024-09-12T03:01:00.412138+0000, chain.objs.size()=1 2024-09-12T01:11:24.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.289+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.XeyrVYO8TJ4HKgUtw5ydoFmfgynkHUH_0 2024-09-12T01:11:24.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.291+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11080975047216875996', time=2024-09-12T03:01:00.454174+0000, chain.objs.size()=1 2024-09-12T01:11:24.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.291+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.AJe9ltDRL0hQLcKoOG76B2JqAiHvOfk_0 2024-09-12T01:11:24.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.291+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17838203984065325971', time=2024-09-12T03:01:00.455075+0000, chain.objs.size()=1 2024-09-12T01:11:24.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.291+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LG9IgjTwCuUqubyMUt41bR4ZlGfhDZH_0 2024-09-12T01:11:24.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.291+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11503083138485950557', time=2024-09-12T03:01:00.511116+0000, chain.objs.size()=1 2024-09-12T01:11:24.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.291+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ndvCSMoRt1bv01Obrg97tEPOLTMD_tK_0 2024-09-12T01:11:24.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.293+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7599852006912925670', time=2024-09-12T03:01:00.861530+0000, chain.objs.size()=1 2024-09-12T01:11:24.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.293+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.GJEZLcJlR3H0MxenbMf54YeGDPjg2fd_0 2024-09-12T01:11:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9575761173722996801', time=2024-09-12T03:01:00.888317+0000, chain.objs.size()=1 2024-09-12T01:11:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.psMAg7RWbKr_wXG0Z9eMbj0Ba5VErqv_0 2024-09-12T01:11:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1413940091969759107', time=2024-09-12T03:01:00.898822+0000, chain.objs.size()=1 2024-09-12T01:11:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.XZ2JT31R_FGYQGk0NQPHJgmb89jNvzg_0 2024-09-12T01:11:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16864353311751284400', time=2024-09-12T03:01:00.966424+0000, chain.objs.size()=1 2024-09-12T01:11:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MsxveQP1w-5YmKtxfAgznZmdiGSJ70a_0 2024-09-12T01:11:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17223988531763300977', time=2024-09-12T03:01:04.655056+0000, chain.objs.size()=1 2024-09-12T01:11:24.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.271__shadow_.LJnJXz-NN-rRboSJDdhN2m7AroiqyP0_0 2024-09-12T01:11:24.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16530872570625449536', time=2024-09-12T03:01:06.993613+0000, chain.objs.size()=1 2024-09-12T01:11:24.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.276__shadow_.515xHCitT2XBDJD4CvXECK0dbOg4Vaz_0 2024-09-12T01:11:24.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9725587502149474952', time=2024-09-12T03:01:06.994554+0000, chain.objs.size()=1 2024-09-12T01:11:24.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.276__shadow_.g3UCsc2-UNKT-n1g-_J9UhlCbFx7e7n_0 2024-09-12T01:11:24.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6961976399648513364', time=2024-09-12T03:01:10.326015+0000, chain.objs.size()=1 2024-09-12T01:11:24.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.294+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.283__shadow_.buvewEJYf8csxbFHpPOCmc0kXfMCGyb_0 2024-09-12T01:11:24.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.296+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15989518638987516310', time=2024-09-12T03:01:15.873310+0000, chain.objs.size()=1 2024-09-12T01:11:24.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.296+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.UjGRHNRzx5wiUTj4V4fDIk9NxAaI5Gw_0 2024-09-12T01:11:24.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.296+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10548923116871705418', time=2024-09-12T03:01:20.061816+0000, chain.objs.size()=1 2024-09-12T01:11:24.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.296+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.301__shadow_.nnDgo3AL00ZUmo_oHlUbGolJMIQUB4__0 2024-09-12T01:11:24.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.297+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9817508767945244482', time=2024-09-12T03:01:21.995683+0000, chain.objs.size()=1 2024-09-12T01:11:24.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.297+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.305__shadow_.vB7y1bsinHZXkvQuFuI6lZqGWWBNyLr_0 2024-09-12T01:11:24.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.297+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.521858237471761493', time=2024-09-12T03:01:40.130454+0000, chain.objs.size()=1 2024-09-12T01:11:24.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.297+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Gc6B_LiGfPew6i1l880cRsBvFwI4iLB_0 2024-09-12T01:11:24.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.298+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4627368844866610960', time=2024-09-12T03:01:40.158359+0000, chain.objs.size()=1 2024-09-12T01:11:24.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.298+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.VhUF-MPbUJl5WjOGawB4xaiTIjT8KpX_0 2024-09-12T01:11:24.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14240547314859790021', time=2024-09-12T03:01:40.283203+0000, chain.objs.size()=1 2024-09-12T01:11:24.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NrIomMMLgqN1uhp6rmvgspXws3i0UXF_0 2024-09-12T01:11:24.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7309831976227491796', time=2024-09-12T03:01:40.409703+0000, chain.objs.size()=1 2024-09-12T01:11:24.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EJ9nA5w7hz9a5ke0AGO3Eoe_r9tSyBy_0 2024-09-12T01:11:24.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8758391708252119353', time=2024-09-12T03:01:40.423789+0000, chain.objs.size()=1 2024-09-12T01:11:24.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Py-Kgv3Eglchpbu4PDEZMF79xdNb7S0_0 2024-09-12T01:11:24.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.75312555273771401', time=2024-09-12T03:01:40.511059+0000, chain.objs.size()=1 2024-09-12T01:11:24.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.c8iOa8A9fdlhrPfsbBse8gF6GrH8QO-_0 2024-09-12T01:11:24.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5288318854869799880', time=2024-09-12T03:01:40.687795+0000, chain.objs.size()=1 2024-09-12T01:11:24.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.N5pghcWC-U6nt55qDiWb42k9ofWmguv_0 2024-09-12T01:11:24.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14650170330271953243', time=2024-09-12T03:01:40.725161+0000, chain.objs.size()=1 2024-09-12T01:11:24.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.299+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hSo2KUL0tAhchjSQtSre2p3yoAdI6eZ_0 2024-09-12T01:11:24.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.301+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10690518402481399245', time=2024-09-12T03:01:40.749961+0000, chain.objs.size()=1 2024-09-12T01:11:24.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.301+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kt_YuPZkPDCcJ49SQ0SbV2Vb8Y_4a1N_0 2024-09-12T01:11:24.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.301+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2656923576344429761', time=2024-09-12T03:01:40.817492+0000, chain.objs.size()=1 2024-09-12T01:11:24.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.301+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WoqFdlWfmbEBS3W0yOwgABDlE8FLYSP_0 2024-09-12T01:11:24.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.301+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10482139621642616575', time=2024-09-12T03:01:40.946338+0000, chain.objs.size()=1 2024-09-12T01:11:24.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.301+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._zvWkkZObFEexJVTsceBTvqC_Qm3hM9_0 2024-09-12T01:11:24.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.402349137169853205', time=2024-09-12T03:01:41.009390+0000, chain.objs.size()=1 2024-09-12T01:11:24.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KWR6IrgOVADNS_h33wI3Mjm_brTT-Rh_0 2024-09-12T01:11:24.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17769547039505911822', time=2024-09-12T03:01:41.046323+0000, chain.objs.size()=1 2024-09-12T01:11:24.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.xK43GXlR8ORHoWTCZT8nUzagDq4_mKr_0 2024-09-12T01:11:24.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.304+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11161471838237044498', time=2024-09-12T03:01:41.074101+0000, chain.objs.size()=1 2024-09-12T01:11:24.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.304+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uaPp6uTs6YoWfwrtLq0T6MgLzUU8OI4_0 2024-09-12T01:11:24.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17925843484000118444', time=2024-09-12T03:01:41.248925+0000, chain.objs.size()=1 2024-09-12T01:11:24.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EQs8FXq3ORbnC7e6u0vFozUpvbj0I2__0 2024-09-12T01:11:24.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12745299945871362522', time=2024-09-12T03:01:41.319329+0000, chain.objs.size()=1 2024-09-12T01:11:24.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bJCpG30PDSyt7mTXa2oMY53smWXuhd6_0 2024-09-12T01:11:24.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16318887511603229565', time=2024-09-12T03:01:41.350471+0000, chain.objs.size()=1 2024-09-12T01:11:24.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jN9ICpNP0jjC_eP2fFcg96Q_OO1aI5W_0 2024-09-12T01:11:24.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11991923711110836140', time=2024-09-12T03:01:41.502964+0000, chain.objs.size()=1 2024-09-12T01:11:24.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bhDNXEG0TVLcfrS_LwelZY3-CgkfLLO_0 2024-09-12T01:11:24.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.164700526455009133', time=2024-09-12T03:01:41.579720+0000, chain.objs.size()=1 2024-09-12T01:11:24.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.305+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1C1_tqJ8hB70mGVGR13Jkf1JFTBoeOX_0 2024-09-12T01:11:24.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.307+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13801357571191419981', time=2024-09-12T03:01:41.592674+0000, chain.objs.size()=1 2024-09-12T01:11:24.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.307+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zp-kTMrjeJWDDD_Hx4ldkZgIsv_SL3t_0 2024-09-12T01:11:24.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.307+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10965662233667896747', time=2024-09-12T03:01:41.868194+0000, chain.objs.size()=1 2024-09-12T01:11:24.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.307+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NxAMgBlujiH7ap9ycJLon_snwb0dVmR_0 2024-09-12T01:11:24.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.307+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2751310638667992846', time=2024-09-12T03:01:41.881710+0000, chain.objs.size()=1 2024-09-12T01:11:24.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.307+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EPUN33eTP-LQ0B3w9qdHCu5ELGpRMwI_0 2024-09-12T01:11:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9358479487370654715', time=2024-09-12T03:01:42.000793+0000, chain.objs.size()=1 2024-09-12T01:11:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GywG4nTSxVsoAvLI12bv4FvfyIeqEDr_0 2024-09-12T01:11:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14846985360193238764', time=2024-09-12T03:01:42.016028+0000, chain.objs.size()=1 2024-09-12T01:11:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KngJNpWO6muq8tupyZb0rUQ8dmJWCYX_0 2024-09-12T01:11:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15217684841844871961', time=2024-09-12T03:01:42.111756+0000, chain.objs.size()=1 2024-09-12T01:11:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.TzXxv7IE0TOABmHcTbMTFsjSIxKKGux_0 2024-09-12T01:11:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8059137284574033014', time=2024-09-12T03:01:50.220817+0000, chain.objs.size()=1 2024-09-12T01:11:24.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.j6PGuj0KAmpJTcY5DtWAEq6D54i0bj6_0 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1927408174021155794', time=2024-09-12T03:01:50.237878+0000, chain.objs.size()=1 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Rx5sLp9KDyoWO0qKjkjESSa3WELmSqd_0 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13953512528849257219', time=2024-09-12T03:01:50.270751+0000, chain.objs.size()=1 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Rla_PJljcw_iLEK9GfQSCZSwUWsHxZ9_0 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1453687739766663759', time=2024-09-12T03:01:50.303229+0000, chain.objs.size()=1 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.310+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.RT-vChhB7Ig_tctxR4b9oTNz7vXUXZk_0 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1572107801786296722', time=2024-09-12T03:01:50.407441+0000, chain.objs.size()=1 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hHPIVOPGus14WDY8y1J1C6nPD1UpR_m_0 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.311+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7377509987000322771', time=2024-09-12T03:01:50.554652+0000, chain.objs.size()=1 2024-09-12T01:11:24.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.311+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.eOmEFTY2Yw43lFE3O6xQC-Zm_EWjfkp_0 2024-09-12T01:11:24.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.314+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10987245059901968645', time=2024-09-12T03:01:50.578342+0000, chain.objs.size()=1 2024-09-12T01:11:24.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.314+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.bjfYRDlxmhv0hzGS7Cpf5_cGKMJQ0-l_0 2024-09-12T01:11:24.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.314+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17729808325310891650', time=2024-09-12T03:01:50.660734+0000, chain.objs.size()=1 2024-09-12T01:11:24.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.314+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oeVpCdtMug6KbTcdWVjSiF7JfjCoWlb_0 2024-09-12T01:11:24.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.316+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12359689902566044500', time=2024-09-12T03:01:50.694716+0000, chain.objs.size()=1 2024-09-12T01:11:24.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.316+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.G9cSvxhGIcUisx4vUIAYEPMJIso8j0j_0 2024-09-12T01:11:24.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.317+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18135786839179037818', time=2024-09-12T03:01:50.879501+0000, chain.objs.size()=1 2024-09-12T01:11:24.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.317+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rkoF342n-wmpoP780-AQPmgiwwUJ5ua_0 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10193862659092471406', time=2024-09-12T03:01:50.889872+0000, chain.objs.size()=1 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4y0JRhPwLWmK_7Sl0HaukkQqIeqMmJi_0 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14198938909460254099', time=2024-09-12T03:01:50.955967+0000, chain.objs.size()=1 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MGQ0qiuMiyNbUzspxV1NZTCnC7i91G7_0 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9262009237937523626', time=2024-09-12T03:01:51.134743+0000, chain.objs.size()=1 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.awYuNY3A5ML_XdiBpt61JR0xfMkFQhs_0 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15841844310027621642', time=2024-09-12T03:01:51.369076+0000, chain.objs.size()=1 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GWAezy39N-O4GC_Z5GnmmR-26x5puoE_0 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14266628795910590164', time=2024-09-12T03:01:51.387252+0000, chain.objs.size()=1 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4T3aTRP8u94Qm_vUA-IC0SUNM_qg8gI_0 2024-09-12T01:11:24.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.429860739704911369', time=2024-09-12T03:01:51.394640+0000, chain.objs.size()=1 2024-09-12T01:11:24.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.R5oJMcsiEyAp20xXhoGNMxx2sAPo6Ar_0 2024-09-12T01:11:24.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8608638270286016928', time=2024-09-12T03:01:51.424965+0000, chain.objs.size()=1 2024-09-12T01:11:24.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6agKrq-WQi59-hDojLiXTkWvTJJ6tjL_0 2024-09-12T01:11:24.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1070600356653634279', time=2024-09-12T03:01:51.647245+0000, chain.objs.size()=1 2024-09-12T01:11:24.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ky3H6hiEuQ6VEYc3dzT-h9Jk15rc5nz_0 2024-09-12T01:11:24.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15766919977738276740', time=2024-09-12T03:01:51.648044+0000, chain.objs.size()=1 2024-09-12T01:11:24.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.319+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OYR3eQch1_wVMb4D8X9eGzbn1mQMxP3_0 2024-09-12T01:11:24.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8708273069944372324', time=2024-09-12T03:01:51.730491+0000, chain.objs.size()=1 2024-09-12T01:11:24.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.5JObngwHbK_rvrm6bTTxdg9ccSvAk2E_0 2024-09-12T01:11:24.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11880391939332176138', time=2024-09-12T03:01:51.775820+0000, chain.objs.size()=1 2024-09-12T01:11:24.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MjlOkfNgSjiYYB4QOHyfGJSlqyD2617_0 2024-09-12T01:11:24.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4298613564670364288', time=2024-09-12T03:01:52.017683+0000, chain.objs.size()=1 2024-09-12T01:11:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.SW8OyXNu96bRwF2FgUly73hBFPZRLRz_0 2024-09-12T01:11:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5330392076004935805', time=2024-09-12T03:01:52.042755+0000, chain.objs.size()=1 2024-09-12T01:11:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.sIzCDfs_vrXrHbubdwESIKezfymFxmx_0 2024-09-12T01:11:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6246150395731244460', time=2024-09-12T03:01:52.066164+0000, chain.objs.size()=1 2024-09-12T01:11:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zxVvCDExgHJlVWbrH3hbcCTZ53WzWhe_0 2024-09-12T01:11:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16424597358113442769', time=2024-09-12T03:01:52.082711+0000, chain.objs.size()=1 2024-09-12T01:11:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.323+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.5bCNKCjQgNE--7MnhSlXW3RHGVrlJel_0 2024-09-12T01:11:24.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2678212549353998598', time=2024-09-12T03:01:52.183126+0000, chain.objs.size()=1 2024-09-12T01:11:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.u0B7pZmBfB9Und92BZDqTFcd56egAMR_0 2024-09-12T01:11:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17600732821312913289', time=2024-09-12T03:01:52.263166+0000, chain.objs.size()=1 2024-09-12T01:11:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6gSxm6O-mC8FmMFeRcdOBVyoDGXg98Q_0 2024-09-12T01:11:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14718741563793270450', time=2024-09-12T03:01:52.270625+0000, chain.objs.size()=1 2024-09-12T01:11:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vgTijvr-E4GwNwjPAVyo9i3bqwo4nlo_0 2024-09-12T01:11:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5355900515887323363', time=2024-09-12T03:01:52.284499+0000, chain.objs.size()=1 2024-09-12T01:11:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ZDJqbA-ds8i1KTcgKdUXmZM9tAXEdJx_0 2024-09-12T01:11:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.260228394706784367', time=2024-09-12T03:01:52.289283+0000, chain.objs.size()=1 2024-09-12T01:11:24.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.324+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ZspKyPgRi9urowZ0Kcmyrz4_NQT6_2N_0 2024-09-12T01:11:24.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.331+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/50312 2024-09-12T01:11:24.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:11:24.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7630009613476307690', time=2024-09-12T03:01:52.307834+0000, chain.objs.size()=1 2024-09-12T01:11:24.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.W-z5d9LWBrO2fGabx2EwZxaHXblN0et_0 2024-09-12T01:11:24.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3563365001862351019', time=2024-09-12T03:01:52.323856+0000, chain.objs.size()=1 2024-09-12T01:11:24.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.k6uzADQu1_P89XrjhpIDnsNUESqzvMK_0 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9569353451133429792', time=2024-09-12T03:03:10.905514+0000, chain.objs.size()=1 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.486__shadow_._ry42tDJf1-V1fTKAWn1F-bSAP4W2uV_0 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4652427243816531961', time=2024-09-12T03:03:15.055993+0000, chain.objs.size()=1 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.494__shadow_.wmjJ7ZvedrSebNQG8dqqJVpFmjH1qH7_0 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12678791777380368709', time=2024-09-12T03:03:17.667636+0000, chain.objs.size()=1 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.501__shadow_.E-cNUwHPrh8bns0nCXUiCLY4OqPkLXX_0 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18314606966363333757', time=2024-09-12T03:03:26.231554+0000, chain.objs.size()=1 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.519__multipart_mymultipart.2~POFpa6heJ3beLRPJiW3Hc7ECH36QQAB.1 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14889383951269525978', time=2024-09-12T03:03:27.208496+0000, chain.objs.size()=1 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.519__multipart_mymultipart.2~8UwAK2z1JBu10lq1s68qdkEcABLrbed.1 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4011594599295668737', time=2024-09-12T03:04:06.804644+0000, chain.objs.size()=4 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.536__multipart_mymultipart.2~LSGBREqlJRa7Mic__7bh3d74fVsii5v.1 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.536__multipart_mymultipart.2~LSGBREqlJRa7Mic__7bh3d74fVsii5v.2 2024-09-12T01:11:24.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.536__multipart_mymultipart.l0wUp6w6GAvoNOmDf1RFwM5Egmwyaj0p.3 2024-09-12T01:11:24.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.536__multipart_mymultipart.2~LSGBREqlJRa7Mic__7bh3d74fVsii5v.4 2024-09-12T01:11:24.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11026667391445233333', time=2024-09-12T03:04:26.286012+0000, chain.objs.size()=1 2024-09-12T01:11:24.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.334+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.551__shadow_.eqpZjo9O5StTdgPnb_W1XOp6GYq4sgx_0 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.338+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18277418866373982022', time=2024-09-12T03:04:30.484842+0000, chain.objs.size()=1 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.338+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.558__shadow_.tHYfp6NE0w7V4bjl1TJwj6CajhjTPR2_0 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2469235090486378623', time=2024-09-12T03:04:43.421473+0000, chain.objs.size()=1 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:BKQ9pi11BqnExhvktLvqGpDwTqvYDiG_.Xd2QBtEA1J5QQLEBUUYu1SJGTO4-qmU_0 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17757274963481464900', time=2024-09-12T03:04:57.771140+0000, chain.objs.size()=1 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:2C6xLUbUlkCywW9LLQ5jX6z7TV1BHf8_.lRoTPUWu1pxLzfWpORM_6e5wgxJg3ON_0 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7380995979388386636', time=2024-09-12T03:05:02.100789+0000, chain.objs.size()=1 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:R8.cyhr7CjzCJ2KJzGvMDE1MB2eMz6J_.kMdZyxYHX0VguC_ceF3Y2Ky5Pq2yZ35_0 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13464533586327649874', time=2024-09-12T03:05:03.971207+0000, chain.objs.size()=1 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:oaJX3M-8e6QcMPKYEX66mie5N9ngyMX_.NhQVkiyXzexmY4D2n6amLu2sHoXHvE0_0 2024-09-12T01:11:24.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17580113651547185117', time=2024-09-12T03:05:06.234607+0000, chain.objs.size()=1 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:1yqxAhou2su5jtei0ZSi5izXOKDOkf0_.vnSj7n3xT6nsk_EzjqZxi-_GJBS2mc7_0 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12729039821917913065', time=2024-09-12T03:05:18.110499+0000, chain.objs.size()=1 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.588__shadow:1NSkuLp6k2sLvtMCLcmm0KLsZHRXpdY_.LoMw5z2pAm_f16t5sYoqneQY8RU44Y6_0 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13712136110752823316', time=2024-09-12T03:07:49.697688+0000, chain.objs.size()=1 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.641__shadow_.FniiSczGTC8GKd2YLJajJBiDxUdht2__0 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7934722359074456357', time=2024-09-12T03:08:04.445527+0000, chain.objs.size()=1 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.669__shadow_.6pbs0MUdNz4x4VfrV1sfqByiHkTgE4v_0 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9077990321396260604', time=2024-09-12T03:08:20.087531+0000, chain.objs.size()=1 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.707__shadow_.bb7lNg6yIDqJ2ieFgpW1SbMDDzeAePO_0 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3182915981971016815', time=2024-09-12T03:08:55.875172+0000, chain.objs.size()=1 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.742__shadow_.DK1PqSXW7Uuv_b35wCE1md3671x9py1_0 2024-09-12T01:11:24.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.339+0000 7ff630961640 0 -- 172.21.15.83:0/2086660974 >> [v2:172.21.15.83:6820/2252380026,v1:172.21.15.83:6822/2252380026] conn(0x7ff4fc08a350 msgr2=0x7ff4fc0953d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:11:24.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.345+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.347+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:11:24.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.348+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.349+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50306' 2024-09-12T01:11:24.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9449778218555071369', time=2024-09-12T02:58:53.032884+0000, chain.objs.size()=5 2024-09-12T01:11:24.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__multipart_mymultipart-LUKEWARM.2~OMp3iolyPUMd6BmboYUKmAVXItWdRzW.1 2024-09-12T01:11:24.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__shadow_mymultipart-LUKEWARM.2~OMp3iolyPUMd6BmboYUKmAVXItWdRzW.1_1 2024-09-12T01:11:24.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__multipart_mymultipart-LUKEWARM.2~OMp3iolyPUMd6BmboYUKmAVXItWdRzW.2 2024-09-12T01:11:24.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__shadow_mymultipart-LUKEWARM.2~OMp3iolyPUMd6BmboYUKmAVXItWdRzW.2_1 2024-09-12T01:11:24.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__multipart_mymultipart-LUKEWARM.2~OMp3iolyPUMd6BmboYUKmAVXItWdRzW.3 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_ngwfoKLRauevBiDgSLx6RCon-90NzUP', time=2024-09-12T02:58:55.521030+0000, chain.objs.size()=3 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.PFdI3eLOP6JBsXKPUIAO_2kz1eV6T0w_0 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.PFdI3eLOP6JBsXKPUIAO_2kz1eV6T0w_1 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.PFdI3eLOP6JBsXKPUIAO_2kz1eV6T0w_2 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4853344467758398326', time=2024-09-12T03:00:36.631214+0000, chain.objs.size()=1 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.235__shadow_.VUQv0E-sWljNxkOesUgoZGBWJgZa3az_0 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18114457115200889659', time=2024-09-12T03:00:37.116038+0000, chain.objs.size()=1 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.236__shadow_.hiRnBLYCRiIwMU2-Yt_9g-dESm8UhvS_0 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12702453976763187277', time=2024-09-12T03:00:49.295792+0000, chain.objs.size()=1 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.259__shadow_.bWyjMYjQ8b2IWWRzmKNGyVJpS3pvD7y_0 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3966126764064261356', time=2024-09-12T03:00:58.993788+0000, chain.objs.size()=1 2024-09-12T01:11:24.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.350+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.s_ui2rCgN6dadSLf0wlI6qomxhZkJ3p_0 2024-09-12T01:11:24.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.353+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5768182016600426471', time=2024-09-12T03:00:59.029746+0000, chain.objs.size()=1 2024-09-12T01:11:24.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.353+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.CiNeGCpyiifBhvg9HzyTgQq2XxS5BzL_0 2024-09-12T01:11:24.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.353+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5831333970450748921', time=2024-09-12T03:00:59.229081+0000, chain.objs.size()=1 2024-09-12T01:11:24.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.353+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.0KSr7fkygk-UGvSijBjZ_vvHTKhNg_w_0 2024-09-12T01:11:24.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.354+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10308482845762812312', time=2024-09-12T03:00:59.418440+0000, chain.objs.size()=1 2024-09-12T01:11:24.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.354+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7SaOXzo1BKhMvWQt0T_Rox06h7iEg_l_0 2024-09-12T01:11:24.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.354+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18185007130802234563', time=2024-09-12T03:00:59.426667+0000, chain.objs.size()=1 2024-09-12T01:11:24.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.354+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.swGFQ3O0QmmbXaYGIimiYtdZiVZl7SF_0 2024-09-12T01:11:24.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4077609600750098847', time=2024-09-12T03:00:59.442867+0000, chain.objs.size()=1 2024-09-12T01:11:24.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vM89r3Ak6CxvkrKE1z1EvCVd19n05i7_0 2024-09-12T01:11:24.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14743791465083898930', time=2024-09-12T03:00:59.504761+0000, chain.objs.size()=1 2024-09-12T01:11:24.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.HAQ8r3ST-ZEoPAFAwK0Gnx7XNKsdfs3_0 2024-09-12T01:11:24.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16334453234842649695', time=2024-09-12T03:00:59.535946+0000, chain.objs.size()=1 2024-09-12T01:11:24.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.f5mTchm-DMgLWssr0jYQBNKf2cf7RgJ_0 2024-09-12T01:11:24.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5734025650375799158', time=2024-09-12T03:00:59.579906+0000, chain.objs.size()=1 2024-09-12T01:11:24.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dVVKfIwwxJMqSJrbCT3v5fG_SMqRpA6_0 2024-09-12T01:11:24.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16331134489789882276', time=2024-09-12T03:00:59.698327+0000, chain.objs.size()=1 2024-09-12T01:11:24.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.iRXQcHI34wYLR5HkoG45cL3VLuJERw-_0 2024-09-12T01:11:24.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4313423314062783481', time=2024-09-12T03:00:59.721984+0000, chain.objs.size()=1 2024-09-12T01:11:24.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.GVGKrWQBqjsiulbVfeCuXKgrvZw3C2V_0 2024-09-12T01:11:24.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.221012796589628630', time=2024-09-12T03:00:59.743868+0000, chain.objs.size()=1 2024-09-12T01:11:24.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.355+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RXkC6Tm-K26__sDjuDN4-eymZ47h85o_0 2024-09-12T01:11:24.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.357+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4753400790962370681', time=2024-09-12T03:00:59.773861+0000, chain.objs.size()=1 2024-09-12T01:11:24.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.357+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dSDUuMspesAy-S6ZhmzhTRnA3z2HOxd_0 2024-09-12T01:11:24.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.357+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10306081873683693015', time=2024-09-12T03:00:59.775373+0000, chain.objs.size()=1 2024-09-12T01:11:24.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.357+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Na0xj2Fxxs47qbP0vP80pres50WgGVE_0 2024-09-12T01:11:24.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2407084333559818792', time=2024-09-12T03:00:59.776948+0000, chain.objs.size()=1 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.6zkYXCmMTubQ9frXHhTtb7iryTzLKa2_0 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14512817457577435248', time=2024-09-12T03:00:59.935678+0000, chain.objs.size()=1 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.97pi9GDRlWO9NU2FKYVtK0k_AxOAjEa_0 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10087953685602736971', time=2024-09-12T03:00:59.966825+0000, chain.objs.size()=1 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.U-4YdHSI1W5znq0dOVf_xAyyNTvYF8E_0 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10164239537474368809', time=2024-09-12T03:00:59.978167+0000, chain.objs.size()=1 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.g2Pd_1EK6IkFk0LUJ9WJQBZ-dKlHZXE_0 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2399810266337452105', time=2024-09-12T03:01:00.026223+0000, chain.objs.size()=1 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.359+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.e_6qOLHS-jtUSgsG8doPKbIzuEX3WlE_0 2024-09-12T01:11:24.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.360+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12804845703143264885', time=2024-09-12T03:01:00.089326+0000, chain.objs.size()=1 2024-09-12T01:11:24.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.360+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Rw7TMN9VGaGKLXnDo6aEhrkGeHS-Gs5_0 2024-09-12T01:11:24.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.360+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1559641623933388589', time=2024-09-12T03:01:00.094223+0000, chain.objs.size()=1 2024-09-12T01:11:24.359 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.360+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.f8_ssodpQ7Dpr30yTczaPlsw2hhcLYO_0 2024-09-12T01:11:24.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.361+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18184050997027977696', time=2024-09-12T03:01:00.320498+0000, chain.objs.size()=1 2024-09-12T01:11:24.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.361+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.djCXebtzz7pyz1U-mnYdnNSeHQFqeXM_0 2024-09-12T01:11:24.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.361+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10914937871382342926', time=2024-09-12T03:01:00.335755+0000, chain.objs.size()=1 2024-09-12T01:11:24.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.361+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SsUU9sZ12U4eu9qupUUGVNQL54QdmmC_0 2024-09-12T01:11:24.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.361+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5945108140727578247', time=2024-09-12T03:01:00.435673+0000, chain.objs.size()=1 2024-09-12T01:11:24.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.361+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.I2gKlaW4yzEjFstVEStqF0pnM5dYddk_0 2024-09-12T01:11:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.361+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6008045975897717073', time=2024-09-12T03:01:00.446075+0000, chain.objs.size()=1 2024-09-12T01:11:24.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.361+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BDG4JFdlOBYJFggPxlZ_zaNOlcU19-n_0 2024-09-12T01:11:24.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.364+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7407978364796776586', time=2024-09-12T03:01:00.497072+0000, chain.objs.size()=1 2024-09-12T01:11:24.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.364+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.nWaeod5t7sHvs92FHuJ4daBQxGTpJfB_0 2024-09-12T01:11:24.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.365+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18445089149730608385', time=2024-09-12T03:01:00.514638+0000, chain.objs.size()=1 2024-09-12T01:11:24.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.365+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VGvrZMnm2NXGGo08oohl_GeggZ4bqLw_0 2024-09-12T01:11:24.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.365+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11687318626152897722', time=2024-09-12T03:01:00.626880+0000, chain.objs.size()=1 2024-09-12T01:11:24.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.365+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MSFuT1twzNb7KJlu8FLuzZ47urX327u_0 2024-09-12T01:11:24.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.365+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5056037242927422280', time=2024-09-12T03:01:00.632637+0000, chain.objs.size()=1 2024-09-12T01:11:24.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.365+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.arPFZaDCYtZECFu9EufOmvzuSdxwRdV_0 2024-09-12T01:11:24.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.365+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16554414031090299085', time=2024-09-12T03:01:00.691519+0000, chain.objs.size()=1 2024-09-12T01:11:24.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.365+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3T9FZVlt5fMydTDkOldRbMNHSScE-1U_0 2024-09-12T01:11:24.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.366+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14205145351127328712', time=2024-09-12T03:01:00.735743+0000, chain.objs.size()=1 2024-09-12T01:11:24.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.366+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BYz0IgVhqIEfGiQNfaak4blo-grArSs_0 2024-09-12T01:11:24.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.366+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10199508306786233699', time=2024-09-12T03:01:00.911404+0000, chain.objs.size()=1 2024-09-12T01:11:24.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.366+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8Jp-VYTDs4Exg62OxTHrDVE6iNfIZDK_0 2024-09-12T01:11:24.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.366+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12491771793380866912', time=2024-09-12T03:01:00.965731+0000, chain.objs.size()=1 2024-09-12T01:11:24.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.366+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3oSmm2ujjQE0_sk_3KbKIsTkpTsMxSE_0 2024-09-12T01:11:24.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.367+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15307919533799769857', time=2024-09-12T03:01:00.978500+0000, chain.objs.size()=1 2024-09-12T01:11:24.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.367+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3xpGdwjNQo4JN20GqEDNL_cTExJmAt5_0 2024-09-12T01:11:24.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.368+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12776015823095041393', time=2024-09-12T03:01:03.300671+0000, chain.objs.size()=1 2024-09-12T01:11:24.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.368+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.268__shadow_.mILpOYF_EatWmQ5fx9l-qOnB6JsH4dk_0 2024-09-12T01:11:24.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.368+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14989177350285055', time=2024-09-12T03:01:20.064671+0000, chain.objs.size()=1 2024-09-12T01:11:24.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.368+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.301__shadow_.OI1-QR18_wixR2Iav0ZXYtWOdkJ21cf_0 2024-09-12T01:11:24.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.369+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14392355728222009389', time=2024-09-12T03:01:22.437777+0000, chain.objs.size()=1 2024-09-12T01:11:24.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.369+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.306__shadow_.Syl4iz3Anr7mEJLQqxzwoAkbJJC9xKg_0 2024-09-12T01:11:24.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.369+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6925663874248925107', time=2024-09-12T03:01:27.768715+0000, chain.objs.size()=1 2024-09-12T01:11:24.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.369+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.316__shadow_.RK8xe6AmMf13VX3LQ4zf1C-IzGsa389_0 2024-09-12T01:11:24.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.370+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3204532188952130145', time=2024-09-12T03:01:40.145814+0000, chain.objs.size()=1 2024-09-12T01:11:24.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.370+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.A7kkrI4vhu5_GvVM3S2jfwn4lgJNa_L_0 2024-09-12T01:11:24.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.370+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2115896436292964516', time=2024-09-12T03:01:40.179361+0000, chain.objs.size()=1 2024-09-12T01:11:24.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.370+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.DytwnrJN8Yr43dfG23emX7DdZfqmIzR_0 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10019026690713857619', time=2024-09-12T03:01:40.237106+0000, chain.objs.size()=1 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.IcMn1l0ZVFEw84PzmVcVS2TD8OR5dFl_0 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2095881805084793080', time=2024-09-12T03:01:40.451468+0000, chain.objs.size()=1 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.CrM41PBzEZzp-A4WeuPYJ-0pRZDDVZs_0 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3145891392666190112', time=2024-09-12T03:01:40.534685+0000, chain.objs.size()=1 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pk6_ZDH6f0qSUUdWorfshP1L7KPHBcL_0 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18153702185614262368', time=2024-09-12T03:01:40.536345+0000, chain.objs.size()=1 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LFzSgM8eopyM6Jf7GVt2yKiLKZmxVe2_0 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14048585290215014075', time=2024-09-12T03:01:40.672456+0000, chain.objs.size()=1 2024-09-12T01:11:24.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.372+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.w89nNjVhPzDB8m4MxpnEJYttI_zChvu_0 2024-09-12T01:11:24.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.373+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4355390279022971807', time=2024-09-12T03:01:40.678230+0000, chain.objs.size()=1 2024-09-12T01:11:24.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.373+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3pPACIDGpjDHPA8vOZTs8V2XsP43rsj_0 2024-09-12T01:11:24.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.373+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1275491573134038294', time=2024-09-12T03:01:40.679009+0000, chain.objs.size()=1 2024-09-12T01:11:24.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.373+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3ktmkW8HxvbeZdbSHoNvfZQJ0T7HXcD_0 2024-09-12T01:11:24.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.373+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12519805481193588877', time=2024-09-12T03:01:40.743634+0000, chain.objs.size()=1 2024-09-12T01:11:24.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.373+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ygSdqEvd-8g_QcDRx-PfrsmO1MMeL4P_0 2024-09-12T01:11:24.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.373+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12751943270735628161', time=2024-09-12T03:01:40.778085+0000, chain.objs.size()=1 2024-09-12T01:11:24.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.373+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.TBb1C2VhJVqRfoPvb4NLCVU3O1b5-q5_0 2024-09-12T01:11:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3634262560347024437', time=2024-09-12T03:01:40.988172+0000, chain.objs.size()=1 2024-09-12T01:11:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LxjBCSBcd7lBvF8-c4sBG1bLUIx-Nb3_0 2024-09-12T01:11:24.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10319830652624740787', time=2024-09-12T03:01:41.284224+0000, chain.objs.size()=1 2024-09-12T01:11:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.p8GDmV96ffDf_pUxhzZKgWqtecYknmL_0 2024-09-12T01:11:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2178903040870109761', time=2024-09-12T03:01:41.485783+0000, chain.objs.size()=1 2024-09-12T01:11:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2Z8wZ1xlqGahSGz0ROETIANU1E5H1wQ_0 2024-09-12T01:11:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13584704348699181504', time=2024-09-12T03:01:41.559458+0000, chain.objs.size()=1 2024-09-12T01:11:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2jVDBRvYnMkacZsbmTEQ-rcEEs_SVO4_0 2024-09-12T01:11:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1181616672488545697', time=2024-09-12T03:01:41.605222+0000, chain.objs.size()=1 2024-09-12T01:11:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rsNqN-UFuZFfX8-TXI9t40r5W8_0uri_0 2024-09-12T01:11:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10341274630069523517', time=2024-09-12T03:01:41.611521+0000, chain.objs.size()=1 2024-09-12T01:11:24.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.377+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0Wpn72BbzfVkoG87GxdbRb_uKswY-8w_0 2024-09-12T01:11:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17135860975843022941', time=2024-09-12T03:01:41.701435+0000, chain.objs.size()=1 2024-09-12T01:11:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.XHLvpfxai-4t8bu7sdkbUXBpRKRJqpZ_0 2024-09-12T01:11:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1285995208305344316', time=2024-09-12T03:01:41.728164+0000, chain.objs.size()=1 2024-09-12T01:11:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Gbud9Uc6TmQdTLtZSbcIeeKzt_14p-M_0 2024-09-12T01:11:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15891182149383114248', time=2024-09-12T03:01:41.785327+0000, chain.objs.size()=1 2024-09-12T01:11:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.OfrtcFYEBSIFw6LZP6mLxvcb5rY4Ewl_0 2024-09-12T01:11:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18131953527247692551', time=2024-09-12T03:01:41.805952+0000, chain.objs.size()=1 2024-09-12T01:11:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FuL3f7NnMWkZxRzs6coWWwEf6p7N_z8_0 2024-09-12T01:11:24.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9718979473602654821', time=2024-09-12T03:01:41.842604+0000, chain.objs.size()=1 2024-09-12T01:11:24.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.378+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QsQ3dZ5xO-Rtz80LXK7D_Nc8zFSOhtE_0 2024-09-12T01:11:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11172519813233208760', time=2024-09-12T03:01:42.031166+0000, chain.objs.size()=1 2024-09-12T01:11:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.OYqdf3uDbNoxJlfAdDgpzg9IEdWhfbN_0 2024-09-12T01:11:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13704360217772066430', time=2024-09-12T03:01:42.035305+0000, chain.objs.size()=1 2024-09-12T01:11:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.S0hoP1L4t-qAo-czN3OysLQVlwVsS28_0 2024-09-12T01:11:24.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14302298016074444129', time=2024-09-12T03:01:42.044682+0000, chain.objs.size()=1 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.DZK3KrrxykbZC_JOHFrlcHROwI4MjN5_0 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16961053745315471200', time=2024-09-12T03:01:50.248931+0000, chain.objs.size()=1 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MM_ZIgtdK3I4tXkxo64pablvcha8r5Y_0 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17908781028107372333', time=2024-09-12T03:01:50.328140+0000, chain.objs.size()=1 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.381+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-J3OGvodLdm9W8P9yunaIopBwvgJEOC_0 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.382+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17552396352828719995', time=2024-09-12T03:01:50.347189+0000, chain.objs.size()=1 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.382+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.BT3cDeb0OjxBVcLrbC1l51OK7Wef4LY_0 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.382+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6743314418117423763', time=2024-09-12T03:01:50.372686+0000, chain.objs.size()=1 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.382+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9vhIePm4JtMDMYWmCPrP_4PwZrBwQY8_0 2024-09-12T01:11:24.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.382+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16359873418898920312', time=2024-09-12T03:01:50.634079+0000, chain.objs.size()=1 2024-09-12T01:11:24.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.382+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LHMzkvqevubW-QLr6y4IjldP-lWnwT1_0 2024-09-12T01:11:24.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.384+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3864536471968291048', time=2024-09-12T03:01:50.665408+0000, chain.objs.size()=1 2024-09-12T01:11:24.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.384+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.o3ykbVUAa2W3xGJhG-Y2dsQgLlsc3yH_0 2024-09-12T01:11:24.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.384+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4781583785891604730', time=2024-09-12T03:01:50.693581+0000, chain.objs.size()=1 2024-09-12T01:11:24.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.384+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.VQU2HSKi9SuI2HrFbJm3d2yShramTvv_0 2024-09-12T01:11:24.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.384+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12917291790419860485', time=2024-09-12T03:01:50.704218+0000, chain.objs.size()=1 2024-09-12T01:11:24.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.384+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.o32g1B9dgon91v7bgbwNrx0BJKArrvx_0 2024-09-12T01:11:24.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.385+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16357520851480011635', time=2024-09-12T03:01:50.893016+0000, chain.objs.size()=1 2024-09-12T01:11:24.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.385+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JIse7_lFmq1N_g4_qlUiVMVYhtFsZS9_0 2024-09-12T01:11:24.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.386+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15052041012930846248', time=2024-09-12T03:01:50.961588+0000, chain.objs.size()=1 2024-09-12T01:11:24.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.386+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.loLZBqF0SWOYdjyt8wetRm2HxnFsGdX_0 2024-09-12T01:11:24.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.386+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16254711751944375312', time=2024-09-12T03:01:50.976293+0000, chain.objs.size()=1 2024-09-12T01:11:24.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.386+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qDQO34EERo58Jr1haC2VMrCnDdcSi1__0 2024-09-12T01:11:24.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1339907824926139464', time=2024-09-12T03:01:51.092736+0000, chain.objs.size()=1 2024-09-12T01:11:24.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._hWcxO1RJCsNPmAYfoZT4x1SXOxZbsD_0 2024-09-12T01:11:24.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.552980267161148960', time=2024-09-12T03:01:51.128135+0000, chain.objs.size()=1 2024-09-12T01:11:24.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.e_j_OEcqcyfHfQEN6JC_doFVosKLUJy_0 2024-09-12T01:11:24.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16193030526664376660', time=2024-09-12T03:01:51.131907+0000, chain.objs.size()=1 2024-09-12T01:11:24.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pWjN4ngp2y-C6rN4aMS9LZ3r8v6RrQU_0 2024-09-12T01:11:24.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14483231251492119721', time=2024-09-12T03:01:51.222097+0000, chain.objs.size()=1 2024-09-12T01:11:24.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6cRqnHBRyEei7h0gj7gXkhGEZ0paLPO_0 2024-09-12T01:11:24.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6460583993967634484', time=2024-09-12T03:01:51.230163+0000, chain.objs.size()=1 2024-09-12T01:11:24.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.388+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8Qx8oZ0xvpzwVNIPD-f7ldYr0clUmtI_0 2024-09-12T01:11:24.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1533559565204949783', time=2024-09-12T03:01:51.453546+0000, chain.objs.size()=1 2024-09-12T01:11:24.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uERLznIMPBApdUCR_FPYhi6TfnW-Edy_0 2024-09-12T01:11:24.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11057809805208920676', time=2024-09-12T03:01:51.459134+0000, chain.objs.size()=1 2024-09-12T01:11:24.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3jwEpoJW1L5ix_tGglLER--Xp__5yeB_0 2024-09-12T01:11:24.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3087857282438243009', time=2024-09-12T03:01:51.468199+0000, chain.objs.size()=1 2024-09-12T01:11:24.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.jY1WA3HxS_ZPDKllmXUYk1Zw6ECgFJ4_0 2024-09-12T01:11:24.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9469613638702922696', time=2024-09-12T03:01:51.499132+0000, chain.objs.size()=1 2024-09-12T01:11:24.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1dyTEAxNY-P_dtEktd36BDdLWD01JcZ_0 2024-09-12T01:11:24.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8549176768046887567', time=2024-09-12T03:01:51.502630+0000, chain.objs.size()=1 2024-09-12T01:11:24.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.djw822xxxQFeYa3tgE8K1tqngy70IxB_0 2024-09-12T01:11:24.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4025891695232413705', time=2024-09-12T03:01:51.634658+0000, chain.objs.size()=1 2024-09-12T01:11:24.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.391+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.N-UOrIk-ICz9BS5eYJmpTy6uvj36ODT_0 2024-09-12T01:11:24.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16076796637286035769', time=2024-09-12T03:01:51.917075+0000, chain.objs.size()=1 2024-09-12T01:11:24.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.z3hEXq4-ik2d07-7VwmkIDPQpWpwiha_0 2024-09-12T01:11:24.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4290624693332164321', time=2024-09-12T03:01:51.984046+0000, chain.objs.size()=1 2024-09-12T01:11:24.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pTvdecKyt0dFTGnExDi8zWmXF_MOqJC_0 2024-09-12T01:11:24.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11505780981027709380', time=2024-09-12T03:01:52.008469+0000, chain.objs.size()=1 2024-09-12T01:11:24.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8zMT5bNRBSeVS2QA6IsSNcAXavYP-Yg_0 2024-09-12T01:11:24.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.52768245841831019', time=2024-09-12T03:01:52.018759+0000, chain.objs.size()=1 2024-09-12T01:11:24.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MgXQxW8EbttgLTaepLfv6o4aW-bQUq3_0 2024-09-12T01:11:24.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9337606603311390505', time=2024-09-12T03:01:52.055059+0000, chain.objs.size()=1 2024-09-12T01:11:24.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.H4U9YcCe-epsSFo_pJDKXcgyia6CSmR_0 2024-09-12T01:11:24.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16258580291473151591', time=2024-09-12T03:01:52.086914+0000, chain.objs.size()=1 2024-09-12T01:11:24.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.vEn4woqYWx7TAK63_IQ2ugXA-Emy6d6_0 2024-09-12T01:11:24.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.518956964359590433', time=2024-09-12T03:01:52.210242+0000, chain.objs.size()=1 2024-09-12T01:11:24.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.394+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IWTV-85PY85EXRW6u6opT3ZhSy5OIwm_0 2024-09-12T01:11:24.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.395+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15424364973447752584', time=2024-09-12T03:01:52.278931+0000, chain.objs.size()=1 2024-09-12T01:11:24.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.395+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7vMLTJcdpWRejDUkim3zROdIYBwcY2a_0 2024-09-12T01:11:24.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.398+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8402079773108811031', time=2024-09-12T03:01:52.303783+0000, chain.objs.size()=1 2024-09-12T01:11:24.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.398+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.swd2CzRKELv4WKgp-IuqVW9GnlJMBGW_0 2024-09-12T01:11:24.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.398+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14966197100402421048', time=2024-09-12T03:01:55.448814+0000, chain.objs.size()=1 2024-09-12T01:11:24.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.398+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.332__shadow_.LQWTnEU6aRMeehVJUIsTE6JGR3sZ_C5_0 2024-09-12T01:11:24.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.401+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/50306 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.522150963258526729', time=2024-09-12T03:02:00.394094+0000, chain.objs.size()=1 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.343__shadow_.5w6UoJE65nIUroD87q_lFo3cXaKBLHL_0 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17004061114115209372', time=2024-09-12T03:02:15.734157+0000, chain.objs.size()=1 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.377__shadow_.d9V9ekFl6Keq3KKZ1aAk1zaTX_BpnwU_0 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3347181564421743981', time=2024-09-12T03:02:46.654969+0000, chain.objs.size()=1 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.437__shadow_.x4clGnL_LXeD1ezr1xnnMqqkHZzSOQR_0 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16907124260078617737', time=2024-09-12T03:02:58.411469+0000, chain.objs.size()=1 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.458__shadow_.uTa_Ye2fNmVwIds7XaFDQK5n05AVdag_0 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13763329014687229483', time=2024-09-12T03:03:23.980675+0000, chain.objs.size()=1 2024-09-12T01:11:24.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.514__multipart_mymultipart.2~K6llY4unEyszGY670eX-XLC66jZGHgk.1 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15665754023141834226', time=2024-09-12T03:03:31.943671+0000, chain.objs.size()=3 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.522__multipart_mymultipart.2~fb2Qfqj9M54UYRlz1cndyK46CM_B-ha.1 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.522__multipart_mymultipart.2~fb2Qfqj9M54UYRlz1cndyK46CM_B-ha.2 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.522__multipart_mymultipart.2~fb2Qfqj9M54UYRlz1cndyK46CM_B-ha.3 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~U5ZmD4eyUESItbKutlfdDr19tv4-4tc', time=2024-09-12T03:03:35.116987+0000, chain.objs.size()=1 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~U5ZmD4eyUESItbKutlfdDr19tv4-4tc.2 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13337915909483300791', time=2024-09-12T03:03:45.940505+0000, chain.objs.size()=2 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~mb7KQc4yUx89meWXtrvQ3dlIAhWmc-g.1 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.403+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~mb7KQc4yUx89meWXtrvQ3dlIAhWmc-g.2 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.404+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15814135519705951306', time=2024-09-12T03:04:29.909980+0000, chain.objs.size()=1 2024-09-12T01:11:24.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.404+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.557__shadow_.AnEYJcPC3ZIYoCjALibYUyKZKpdohRY_0 2024-09-12T01:11:24.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.406+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4298926586483910827', time=2024-09-12T03:04:30.634989+0000, chain.objs.size()=1 2024-09-12T01:11:24.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.406+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.558__shadow_.5SCUNzoCPUXCZg20G_8EI0d-6UeznCY_0 2024-09-12T01:11:24.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1954623509541201725', time=2024-09-12T03:04:53.065282+0000, chain.objs.size()=1 2024-09-12T01:11:24.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.576__shadow:0MozmXduAUkIpRz9fUBqXOBhE1F-tdI_.T398PBDkao5ATZmduTSaUQCq98wGbKz_0 2024-09-12T01:11:24.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14816111869321312411', time=2024-09-12T03:04:54.140006+0000, chain.objs.size()=1 2024-09-12T01:11:24.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:GuXK0prkW7xn7ETk7EFjJKDABeotqFc_.ZvIHGFRXQk5_Pd-i0DdJtvH8oLOwF2k_0 2024-09-12T01:11:24.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4561342478839749961', time=2024-09-12T03:04:58.225662+0000, chain.objs.size()=1 2024-09-12T01:11:24.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:Dqx1K94FTk0ex0ICk6HmB8WZE542KnB_.CXBCEErjVlnOeBE-92VYYq24zGmXdGS_0 2024-09-12T01:11:24.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12543622268396533456', time=2024-09-12T03:05:08.889981+0000, chain.objs.size()=1 2024-09-12T01:11:24.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:ypKISKdKs2vK.hZINKrMcUcboorWa0O_.8oY0FXac1kNGtDsEoRg32OuEoePmT38_0 2024-09-12T01:11:24.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16661195551194141462', time=2024-09-12T03:05:12.911060+0000, chain.objs.size()=1 2024-09-12T01:11:24.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:dhWkZYBSv4x0.ZHJ0LqLFwykumE01MP_.ViQzqPukJoJZ5ovkgvWi0NTd1ENpOrR_0 2024-09-12T01:11:24.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11020949336478714045', time=2024-09-12T03:05:27.037312+0000, chain.objs.size()=1 2024-09-12T01:11:24.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.609__shadow_.FRQINP8I4aFnNPaUI30EJwhHLbQ2Jkz_0 2024-09-12T01:11:24.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14080535441176621467', time=2024-09-12T03:05:35.504544+0000, chain.objs.size()=12 2024-09-12T01:11:24.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.407+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__multipart_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.1 2024-09-12T01:11:24.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.409+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__shadow_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.1_1 2024-09-12T01:11:24.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.409+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__multipart_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.2 2024-09-12T01:11:24.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.409+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__shadow_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.2_1 2024-09-12T01:11:24.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.412+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__multipart_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.3 2024-09-12T01:11:24.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.412+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__shadow_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.3_1 2024-09-12T01:11:24.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.412+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__multipart_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.4 2024-09-12T01:11:24.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.413+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__shadow_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.4_1 2024-09-12T01:11:24.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.413+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__multipart_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.5 2024-09-12T01:11:24.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.413+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__shadow_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.5_1 2024-09-12T01:11:24.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.415+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__multipart_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.6 2024-09-12T01:11:24.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.415+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.616__shadow_multipart_enc.2~fa0_yVkIEqtqjpWc--ObWEDTvI6JSUi.6_1 2024-09-12T01:11:24.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.415+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13799059797246569599', time=2024-09-12T03:08:01.780755+0000, chain.objs.size()=1 2024-09-12T01:11:24.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.415+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.664__shadow_.cH09DpkAVsQ6a43g2Wy6NKUtykjUpev_0 2024-09-12T01:11:24.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.415+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17458212942268132612', time=2024-09-12T03:08:03.693806+0000, chain.objs.size()=1 2024-09-12T01:11:24.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.415+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.667__shadow_.i7tuc-eGEzWTuZTC6W0c7Mw3JzYtzkb_0 2024-09-12T01:11:24.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.415+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3248220141447966236', time=2024-09-12T03:08:12.977395+0000, chain.objs.size()=1 2024-09-12T01:11:24.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.415+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.691__shadow:uk-dgLm3E1BE418wQYBP9.8afjm2Zf7_.vYAHtKkTGu-cNN00Idqkv0RfT47vqFT_0 2024-09-12T01:11:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.416+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9331312356793277275', time=2024-09-12T03:08:14.716260+0000, chain.objs.size()=1 2024-09-12T01:11:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.416+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.695__shadow:SSWc-6.ZRJ21XewvRmU1S3-gm..2ShY_.bEzVSEI-plXlbVwNcXf17MQLzIy0Szm_0 2024-09-12T01:11:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.416+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14202127060715456876', time=2024-09-12T03:08:44.495626+0000, chain.objs.size()=1 2024-09-12T01:11:24.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.416+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.719__shadow_.BBRUKGcjv2KNXstRiliPOGPHWAjI7HD_0 2024-09-12T01:11:24.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.420+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17227877324368849499', time=2024-09-12T03:08:55.411961+0000, chain.objs.size()=1 2024-09-12T01:11:24.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.420+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.741__shadow_.bmPe2D8Up2uUdsr1h1gMchyLpNcMBy9_0 2024-09-12T01:11:24.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.422+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.425+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:11:24.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.426+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.427+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48397' 2024-09-12T01:11:24.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='_4xTotT9QJWfT8RFTSsytsC7LGTPPfN3', time=2024-09-12T02:58:54.983986+0000, chain.objs.size()=3 2024-09-12T01:11:24.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.jSzEXbWqjqqsEjlHN3RDuPOJ18NhJSn_0 2024-09-12T01:11:24.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.jSzEXbWqjqqsEjlHN3RDuPOJ18NhJSn_1 2024-09-12T01:11:24.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_.jSzEXbWqjqqsEjlHN3RDuPOJ18NhJSn_2 2024-09-12T01:11:24.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1759875861126133322', time=2024-09-12T03:00:45.059620+0000, chain.objs.size()=1 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.250__shadow_.Yok6e5kk7TAJnkG3q-VK-6FIS7r7Gg5_0 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18262042198336941747', time=2024-09-12T03:00:45.978748+0000, chain.objs.size()=1 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.252__shadow_.HVhPJ5SoJdbKJ3otesi0VHDuSeL_7Qc_0 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13180177598824858691', time=2024-09-12T03:00:58.866552+0000, chain.objs.size()=1 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.B7trj8uqvkKszChKgUCnwboQTOCDeZf_0 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13411853115271851130', time=2024-09-12T03:00:58.932472+0000, chain.objs.size()=1 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DjNx-WhXys4m6IqgSqa-lVkGQXsMCZC_0 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2260790948323808445', time=2024-09-12T03:00:58.969235+0000, chain.objs.size()=1 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.u3HZ0sso6aokuQLSzNlTQhN8VnSUgyo_0 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9870646697400057639', time=2024-09-12T03:00:58.989773+0000, chain.objs.size()=1 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.DhUCU51MRp7kl-ZpQ8QXzb3F2peWfAq_0 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15053503293234387944', time=2024-09-12T03:00:59.016250+0000, chain.objs.size()=1 2024-09-12T01:11:24.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bTeq14ty4YGGF3vXfIQCBg4Mi4L49oM_0 2024-09-12T01:11:24.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4007038247584252935', time=2024-09-12T03:00:59.126454+0000, chain.objs.size()=1 2024-09-12T01:11:24.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8456MmqY4TnWWuioSJDDzYCn4FGdhqg_0 2024-09-12T01:11:24.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8064221335129279953', time=2024-09-12T03:00:59.157154+0000, chain.objs.size()=1 2024-09-12T01:11:24.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.428+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xXLdHzehZnZNgxeX3N8sSOYPbNecPeo_0 2024-09-12T01:11:24.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.431+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4616037004670533734', time=2024-09-12T03:00:59.264274+0000, chain.objs.size()=1 2024-09-12T01:11:24.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.431+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Mym5LRIKJ55_CZD2k53PkGwYg8K4nKL_0 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18114040528030479936', time=2024-09-12T03:00:59.306222+0000, chain.objs.size()=1 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VCsJT2xbt6NR0jKdE-b8EU9kMQB2QAU_0 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12704977609773181028', time=2024-09-12T03:00:59.399114+0000, chain.objs.size()=1 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tMkoXOjfUWTp3uW8LFENSpTS3a0-CjV_0 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10187966529093371646', time=2024-09-12T03:00:59.452983+0000, chain.objs.size()=1 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JMB8WpAgGrqLun0T8n25xZamMahWCp7_0 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12152333389925452479', time=2024-09-12T03:00:59.475656+0000, chain.objs.size()=1 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TxHjq_QpYy324dfZPnSlW9jK0QQsmh4_0 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6799706489368893546', time=2024-09-12T03:00:59.577869+0000, chain.objs.size()=1 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._dxHeo-5V3elIqhqSAn8QYDUWhEkozh_0 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16632113217435147843', time=2024-09-12T03:00:59.696936+0000, chain.objs.size()=1 2024-09-12T01:11:24.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.v_M0GcxYwqXJtq1oHwByfOXSl4WPcsV_0 2024-09-12T01:11:24.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13367277441923706199', time=2024-09-12T03:00:59.720261+0000, chain.objs.size()=1 2024-09-12T01:11:24.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.AVnFU4XXTVo0Mh0tsqA5Nn70oG3FYbM_0 2024-09-12T01:11:24.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2423976827676712671', time=2024-09-12T03:00:59.794951+0000, chain.objs.size()=1 2024-09-12T01:11:24.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7Kj5AO2qWJvVAlrLrbJ31bLpJfD6eFa_0 2024-09-12T01:11:24.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12789312258983136992', time=2024-09-12T03:00:59.817814+0000, chain.objs.size()=1 2024-09-12T01:11:24.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.D9vFeFK3gXAHDkXY97KwbCKWXQTRM6I_0 2024-09-12T01:11:24.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18318249917412006939', time=2024-09-12T03:01:00.068181+0000, chain.objs.size()=1 2024-09-12T01:11:24.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.432+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SuHSeGMNYCn-vC9WTcgLHODin7ldk9J_0 2024-09-12T01:11:24.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.435+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13526956702146695495', time=2024-09-12T03:01:00.246658+0000, chain.objs.size()=1 2024-09-12T01:11:24.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.435+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.PLMtAiCm7tzKvfdJSlAhczOao3Ou97k_0 2024-09-12T01:11:24.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.436+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13506978625691235025', time=2024-09-12T03:01:00.327565+0000, chain.objs.size()=1 2024-09-12T01:11:24.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.436+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.h0c0v7JQMLgSnvh_TxJ34GyFd-K27G6_0 2024-09-12T01:11:24.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.436+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6430394733247575244', time=2024-09-12T03:01:00.348017+0000, chain.objs.size()=1 2024-09-12T01:11:24.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5Q3saM5Iu6pfDW6o78LJnNvPt18Yngr_0 2024-09-12T01:11:24.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14837776375735114164', time=2024-09-12T03:01:00.365155+0000, chain.objs.size()=1 2024-09-12T01:11:24.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.o4v8Adr03iFpcCHQeb7KRw3Jy_yvJ-f_0 2024-09-12T01:11:24.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9842669467374245044', time=2024-09-12T03:01:00.427215+0000, chain.objs.size()=1 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.rlzApATnimBWRV6wWo2edGnqbH_uBie_0 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4408058359001156741', time=2024-09-12T03:01:00.449886+0000, chain.objs.size()=1 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lTseW6Ob7zD7sAznkzpdWcknpfGoARe_0 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18160180756391257494', time=2024-09-12T03:01:00.511902+0000, chain.objs.size()=1 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sjF-qSQA-Np4bIxl2Rkg5nAe2rVqggq_0 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11150250250714241098', time=2024-09-12T03:01:00.614587+0000, chain.objs.size()=1 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VCu_4rqG-63I3SKYr2cDIlyqtcH20kj_0 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15513730973551838867', time=2024-09-12T03:01:00.652598+0000, chain.objs.size()=1 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.OiVsyZcXBjr5CWrozB27XH1jKRgYuxq_0 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6159382907682947132', time=2024-09-12T03:01:00.712716+0000, chain.objs.size()=1 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Gze6IIGtrhnxiSnNQsqrG0QiinQ9yAl_0 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10353749909029351464', time=2024-09-12T03:01:00.852025+0000, chain.objs.size()=1 2024-09-12T01:11:24.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.437+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.y1sNpEGoxkasQ_w33nYS5t9Z_iV1ixt_0 2024-09-12T01:11:24.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.439+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4420712733056297141', time=2024-09-12T03:01:00.951422+0000, chain.objs.size()=1 2024-09-12T01:11:24.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.439+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tfS5tpJyNOwuYxArW4vAUxrMsx5siKF_0 2024-09-12T01:11:24.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.440+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16358357590671583061', time=2024-09-12T03:01:00.974513+0000, chain.objs.size()=1 2024-09-12T01:11:24.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.440+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.R-LkAIhEaeLerR-YyFD8z-kGa6D8_SK_0 2024-09-12T01:11:24.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7553500017827461882', time=2024-09-12T03:01:00.977254+0000, chain.objs.size()=1 2024-09-12T01:11:24.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.joQxKsJxrsbEQYSy8rCDyUb_yBbwc-A_0 2024-09-12T01:11:24.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11510519069259961213', time=2024-09-12T03:01:06.099262+0000, chain.objs.size()=1 2024-09-12T01:11:24.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.274__shadow_.XeZKEIoXUK8xfr9Bb9hQquFktmajuUY_0 2024-09-12T01:11:24.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1590792243296290039', time=2024-09-12T03:01:06.992534+0000, chain.objs.size()=1 2024-09-12T01:11:24.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.276__shadow_.qUt-mBFiD2vBqDjuX4URIv6aUyDnjpr_0 2024-09-12T01:11:24.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.330763996285088735', time=2024-09-12T03:01:07.919014+0000, chain.objs.size()=1 2024-09-12T01:11:24.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.278__shadow_.9UR9aKtF4yazeEJyrkPAiofLjvsg6C__0 2024-09-12T01:11:24.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15017246441784043712', time=2024-09-12T03:01:08.892270+0000, chain.objs.size()=1 2024-09-12T01:11:24.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.280__shadow_.zdGLPF_nrDIBlqAhtunzEC4eS0T0eTx_0 2024-09-12T01:11:24.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15389347300626371525', time=2024-09-12T03:01:15.852191+0000, chain.objs.size()=1 2024-09-12T01:11:24.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.CVfxD4lYWwhVyEsD4UV3sogx6e-5DcA_0 2024-09-12T01:11:24.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10695773069800170193', time=2024-09-12T03:01:16.653741+0000, chain.objs.size()=1 2024-09-12T01:11:24.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.442+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.QzjADVa9hzBgdQ5BpKwoT7ZsT69eeLo_0 2024-09-12T01:11:24.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.443+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15430089629830664394', time=2024-09-12T03:01:19.578206+0000, chain.objs.size()=1 2024-09-12T01:11:24.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.443+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.300__shadow_.4ZJa80s2I-n1-BxJKVEeieYY0QcuKii_0 2024-09-12T01:11:24.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.443+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4045715409355295729', time=2024-09-12T03:01:40.161776+0000, chain.objs.size()=1 2024-09-12T01:11:24.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.443+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rKW2b2HdzXgwbgUodeHeFstolS12spS_0 2024-09-12T01:11:24.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.444+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11521087571829950553', time=2024-09-12T03:01:40.210036+0000, chain.objs.size()=1 2024-09-12T01:11:24.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.444+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QOke1jYuFZQA_h5kRv3TztD7zuGSFjV_0 2024-09-12T01:11:24.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.446+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4045574797468117842', time=2024-09-12T03:01:40.245946+0000, chain.objs.size()=1 2024-09-12T01:11:24.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.446+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7q1SsBRDlIsrF_z5wc_4AmjaYUnPEmj_0 2024-09-12T01:11:24.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.446+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17442635328318687415', time=2024-09-12T03:01:40.256296+0000, chain.objs.size()=1 2024-09-12T01:11:24.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.446+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0mzT-7S4hHW7ATraaxjocNhETdfcn6j_0 2024-09-12T01:11:24.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.447+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9198560536032070664', time=2024-09-12T03:01:40.268069+0000, chain.objs.size()=1 2024-09-12T01:11:24.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.447+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aXDO6yenVyKNfRgzoEHW6gtBkYoijLh_0 2024-09-12T01:11:24.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.447+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6594246080040888722', time=2024-09-12T03:01:40.287026+0000, chain.objs.size()=1 2024-09-12T01:11:24.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.447+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zYJrgS5KMwjQqo0MuItHBr9b6x48KOG_0 2024-09-12T01:11:24.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.447+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14128495540878905628', time=2024-09-12T03:01:40.288612+0000, chain.objs.size()=1 2024-09-12T01:11:24.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.447+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.VkQoski1bBcLm7baaRf3XQUpvZyWPGk_0 2024-09-12T01:11:24.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.447+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11632854872868327395', time=2024-09-12T03:01:40.375537+0000, chain.objs.size()=1 2024-09-12T01:11:24.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.447+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.hn9jncllTvi2d7QShZ-yjlwScMpCJi3_0 2024-09-12T01:11:24.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11144133862331162587', time=2024-09-12T03:01:40.405368+0000, chain.objs.size()=1 2024-09-12T01:11:24.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ze_T_hhWkSsN9bnVNFoHC-Q6mGSYoQE_0 2024-09-12T01:11:24.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9833146239174816148', time=2024-09-12T03:01:40.406115+0000, chain.objs.size()=1 2024-09-12T01:11:24.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NQ1TAPx3oOojmoIrhZZJt41_XSjwyHj_0 2024-09-12T01:11:24.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14601085058444754773', time=2024-09-12T03:01:40.512899+0000, chain.objs.size()=1 2024-09-12T01:11:24.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MdEE09s7pjzc2VBSvSYaswZVv7-y4BP_0 2024-09-12T01:11:24.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14249527249067098094', time=2024-09-12T03:01:40.521522+0000, chain.objs.size()=1 2024-09-12T01:11:24.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.SYpWrFfbvLo10tg-GsJnvfYdXh2a9T2_0 2024-09-12T01:11:24.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8722946195357971657', time=2024-09-12T03:01:40.533284+0000, chain.objs.size()=1 2024-09-12T01:11:24.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.YwYV5-jGFDNgxrXkfHvbk1m6-iBcA8M_0 2024-09-12T01:11:24.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15907881770041806032', time=2024-09-12T03:01:40.648336+0000, chain.objs.size()=1 2024-09-12T01:11:24.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.449+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vVSr-SQFYGm5NnKersueZDGdoLQSZc2_0 2024-09-12T01:11:24.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.450+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6363499887972481092', time=2024-09-12T03:01:40.965568+0000, chain.objs.size()=1 2024-09-12T01:11:24.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.450+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._RtUX9P7oPZ57Q5cOCI9gp7PgnjwTP6_0 2024-09-12T01:11:24.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.452+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17165872440705560599', time=2024-09-12T03:01:40.979599+0000, chain.objs.size()=1 2024-09-12T01:11:24.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.452+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2WI5HqFgRA0xDlisCLrzkjF7RzIfYX7_0 2024-09-12T01:11:24.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2066509200132052004', time=2024-09-12T03:01:40.986218+0000, chain.objs.size()=1 2024-09-12T01:11:24.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Bl3tQ6Gegirjct7V_SYUWwQW_L_tV1B_0 2024-09-12T01:11:24.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8612016084486244565', time=2024-09-12T03:01:41.036567+0000, chain.objs.size()=1 2024-09-12T01:11:24.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0ewmppkgjCuCB__TrJoUCy3BrQkAGRb_0 2024-09-12T01:11:24.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16274434866408536551', time=2024-09-12T03:01:41.317275+0000, chain.objs.size()=1 2024-09-12T01:11:24.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JZWMcGP0T4Ga4R8XUOkwQHul50JYn1O_0 2024-09-12T01:11:24.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8686591819469538530', time=2024-09-12T03:01:41.616210+0000, chain.objs.size()=1 2024-09-12T01:11:24.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bFGdPvlIdMLp2vqDQCY-5onXTQfyLZ0_0 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8119932949387161738', time=2024-09-12T03:01:41.624722+0000, chain.objs.size()=1 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.vFdoWlmIEd_u9TTImbAqfz1sNWMIPpF_0 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7306116716691048845', time=2024-09-12T03:01:41.627061+0000, chain.objs.size()=1 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5zqfNX2a9UkBQghLq38q4PbzMAhXeTa_0 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4284986480284987120', time=2024-09-12T03:01:41.743549+0000, chain.objs.size()=1 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ivyKj-EU1lNEoZV8XH0TYrGM-qJP3MN_0 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10526414153149720963', time=2024-09-12T03:01:41.807419+0000, chain.objs.size()=1 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.22255WF7EJeccqylC6WzjNR1vkpGqPz_0 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.589411235800738785', time=2024-09-12T03:01:41.894492+0000, chain.objs.size()=1 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0hOH8z0wwxYAe0cKKTl0FwYZBmh4dnD_0 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7107910183786151602', time=2024-09-12T03:01:42.085199+0000, chain.objs.size()=1 2024-09-12T01:11:24.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.454+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.AUPNcroDMj5tycqiZ4XG2Ei_r5Wn7Di_0 2024-09-12T01:11:24.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.455+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4089206610007111607', time=2024-09-12T03:01:42.107902+0000, chain.objs.size()=1 2024-09-12T01:11:24.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.455+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KpkEvjh7Yh7WfH2WicaxieOtCUTS6KF_0 2024-09-12T01:11:24.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.458+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14363588110654419726', time=2024-09-12T03:01:50.277817+0000, chain.objs.size()=1 2024-09-12T01:11:24.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.458+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.EhxNiGHJN0G-WSDNw90bRhgxw3rhf-n_0 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11678974996329863967', time=2024-09-12T03:01:50.282541+0000, chain.objs.size()=1 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.b2obzQLIeifiaV3Oh5D9iXWWoFhse25_0 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16602140132700706201', time=2024-09-12T03:01:50.344580+0000, chain.objs.size()=1 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0QyzpG8osuRyWgdBjN1xmJAcRg9IoIx_0 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4478097400492198472', time=2024-09-12T03:01:50.405830+0000, chain.objs.size()=1 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.30jes_p04HOGg8-8DEOS9hWCQU0gq-O_0 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4154837384975491863', time=2024-09-12T03:01:50.540204+0000, chain.objs.size()=1 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.s1Qer4_NHIdTqtjpgfM0QRzKcjiXvEG_0 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5738622875463336909', time=2024-09-12T03:01:50.551221+0000, chain.objs.size()=1 2024-09-12T01:11:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._sxoyBZnaAJZC37gmH7NnR33wCiSi5Z_0 2024-09-12T01:11:24.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4252737034332711959', time=2024-09-12T03:01:50.669116+0000, chain.objs.size()=1 2024-09-12T01:11:24.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Y25Yr44DFJOqK3gDIMyFpmnyuVrBNwF_0 2024-09-12T01:11:24.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13072876647753912421', time=2024-09-12T03:01:50.900842+0000, chain.objs.size()=1 2024-09-12T01:11:24.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.460+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.uqLGr0cpk7Paf1yhbrFJXYhYcRnI_CM_0 2024-09-12T01:11:24.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.462+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14379861220543108474', time=2024-09-12T03:01:50.921246+0000, chain.objs.size()=1 2024-09-12T01:11:24.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.462+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LC_UX0-npJvkmnk62IVPqwq4mU7Sd3u_0 2024-09-12T01:11:24.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.463+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7264230995967998415', time=2024-09-12T03:01:50.957985+0000, chain.objs.size()=1 2024-09-12T01:11:24.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.463+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oJJlJC-AoTAKryuCjEXh0lQbnuM1Ho1_0 2024-09-12T01:11:24.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.463+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12609313407455130283', time=2024-09-12T03:01:50.966114+0000, chain.objs.size()=1 2024-09-12T01:11:24.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.463+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Mk5QPX0r3QDOPxu5mvFag5JviWDP-6R_0 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.465+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8533847984974965092', time=2024-09-12T03:01:51.277586+0000, chain.objs.size()=1 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.465+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xp7HpLeDFQz5P3-4z1wqrguIifpCg6X_0 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.465+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10575111141862497056', time=2024-09-12T03:01:51.364291+0000, chain.objs.size()=1 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.465+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Ztf4n3EKfh5Y-TeRIz32BBRzUJoKoQS_0 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.465+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15369166775008189033', time=2024-09-12T03:01:51.366698+0000, chain.objs.size()=1 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.465+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xszo2xUijE5ZDdHafm7RtR62GznKlUT_0 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12381141961055015063', time=2024-09-12T03:01:51.384606+0000, chain.objs.size()=1 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MTOCcYhAtVgjxuOvDGwRTgOYOyX4Vyr_0 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2969192789769549133', time=2024-09-12T03:01:51.418737+0000, chain.objs.size()=1 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ShnFIKvVY6klS4weN4U13MXIU12UGMs_0 2024-09-12T01:11:24.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12510580332499554546', time=2024-09-12T03:01:51.513093+0000, chain.objs.size()=1 2024-09-12T01:11:24.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.M5A2W2WkZq6Ik72ZKO-gFbk6n_UM4dS_0 2024-09-12T01:11:24.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2856652195293001103', time=2024-09-12T03:01:51.531949+0000, chain.objs.size()=1 2024-09-12T01:11:24.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xPZxPwnFfT0zFWD8bKqY0JBfZGIdrOq_0 2024-09-12T01:11:24.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7446477024182665567', time=2024-09-12T03:01:51.639778+0000, chain.objs.size()=1 2024-09-12T01:11:24.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.466+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rUNmkxE1FiOGzRIJI3qCb5k61Dkjp6j_0 2024-09-12T01:11:24.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.468+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11459856121192362286', time=2024-09-12T03:01:51.652804+0000, chain.objs.size()=1 2024-09-12T01:11:24.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.468+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.PhmfLzqXFNJ4XJleXFrXzny59KEIQ0k_0 2024-09-12T01:11:24.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.469+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14008284609511400633', time=2024-09-12T03:01:51.741948+0000, chain.objs.size()=1 2024-09-12T01:11:24.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.469+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JTDJj-LVkDK_ILryPEF62CMeN2FZH3I_0 2024-09-12T01:11:24.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.469+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14422978801213595059', time=2024-09-12T03:01:51.748997+0000, chain.objs.size()=1 2024-09-12T01:11:24.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.s5iEH5uCMfqGw3_s-Xfot7YaHqBiJ8Q_0 2024-09-12T01:11:24.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14468922636362944861', time=2024-09-12T03:01:51.965718+0000, chain.objs.size()=1 2024-09-12T01:11:24.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OJ3rebCIY4iboKaPU0goZJNgX1jU37v_0 2024-09-12T01:11:24.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3890547502119213267', time=2024-09-12T03:01:52.216959+0000, chain.objs.size()=1 2024-09-12T01:11:24.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4jzwmCT3rMJThMP-apmxAFt-L5QJ59Z_0 2024-09-12T01:11:24.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10660641158544691346', time=2024-09-12T03:01:52.228747+0000, chain.objs.size()=1 2024-09-12T01:11:24.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KFauM0R6oGOJpvyxph0Z8PFlVdNj2N9_0 2024-09-12T01:11:24.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3913288494675159366', time=2024-09-12T03:01:52.283828+0000, chain.objs.size()=1 2024-09-12T01:11:24.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.CEWCadBjZbQvm2zJ8my6usSoY6P8AEU_0 2024-09-12T01:11:24.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11319722317016058445', time=2024-09-12T03:02:33.539452+0000, chain.objs.size()=1 2024-09-12T01:11:24.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.411__shadow_.jx82QJFWHmooQZ5veWQ8MpSvCQmYcnf_0 2024-09-12T01:11:24.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14870748887237448490', time=2024-09-12T03:02:45.160310+0000, chain.objs.size()=1 2024-09-12T01:11:24.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.470+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.434__shadow_.GuQlP9Kn64KPMVs_FZyDuPWvlO9excB_0 2024-09-12T01:11:24.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.472+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13802209759501233483', time=2024-09-12T03:02:50.773551+0000, chain.objs.size()=1 2024-09-12T01:11:24.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.472+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.445__shadow_.qDSbWfqhbKSrqIyHgaJ9RS8c2urCMWZ_0 2024-09-12T01:11:24.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.472+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2718635865218481058', time=2024-09-12T03:02:58.411606+0000, chain.objs.size()=1 2024-09-12T01:11:24.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.472+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.458__shadow_.E_XueaodyxDY-Q07UGb2TZ30ls3l0Dh_0 2024-09-12T01:11:24.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.472+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10375654104411230712', time=2024-09-12T03:03:24.456395+0000, chain.objs.size()=1 2024-09-12T01:11:24.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.472+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.515__shadow_.W4rX80Cc0R9yFeDOOoXV0K858MeCruU_0 2024-09-12T01:11:24.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.477+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48397 2024-09-12T01:11:24.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:11:24.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7', time=2024-09-12T03:03:41.539693+0000, chain.objs.size()=2 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.1 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.1_1 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7', time=2024-09-12T03:03:41.540902+0000, chain.objs.size()=2 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.2 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.2_1 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7', time=2024-09-12T03:03:41.542266+0000, chain.objs.size()=2 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.3 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.3_1 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7', time=2024-09-12T03:03:41.543359+0000, chain.objs.size()=2 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.4 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.4_1 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7', time=2024-09-12T03:03:41.544444+0000, chain.objs.size()=2 2024-09-12T01:11:24.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.5 2024-09-12T01:11:24.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.5_1 2024-09-12T01:11:24.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7', time=2024-09-12T03:03:41.545564+0000, chain.objs.size()=2 2024-09-12T01:11:24.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.6 2024-09-12T01:11:24.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.480+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.2~evzfbAeVcwKq2lsG4bjYoIjRiaPUSc7.6_1 2024-09-12T01:11:24.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.483+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13363943275670185787', time=2024-09-12T03:04:45.938945+0000, chain.objs.size()=1 2024-09-12T01:11:24.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.483+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:8e0SRFGMPtBBDmho1-7DonBF2HDc6Zy_.444xFWfforUddXT7NfkA0sAzjnByY5t_0 2024-09-12T01:11:24.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.483+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11539821002120294512', time=2024-09-12T03:04:51.974138+0000, chain.objs.size()=1 2024-09-12T01:11:24.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.483+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow:FMDXEv-1H-.9VPAKe9qFfMd2uyhtkVj_.6pyk9J-R4PJ5BSQiLQZt_Bxvf3v9pFB_0 2024-09-12T01:11:24.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.484+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12739271882034415448', time=2024-09-12T03:04:59.006586+0000, chain.objs.size()=1 2024-09-12T01:11:24.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.484+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:AMEDY7NSk9IhWElZVlap1htBtlt4F-z_.eS2pRupFP3X98pKpdr6j9EQxCXgby4b_0 2024-09-12T01:11:24.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.484+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16161219372669589693', time=2024-09-12T03:04:59.613191+0000, chain.objs.size()=1 2024-09-12T01:11:24.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.484+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:PrL7rXOOYnCqPE-n2BtoNAY-J0Jsmss_.miFqTiwcyMX3YoZrdt1B9aI0IKzXB-V_0 2024-09-12T01:11:24.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3566478566131820200', time=2024-09-12T03:05:00.390217+0000, chain.objs.size()=1 2024-09-12T01:11:24.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:IWlwucNRivhIjmh8V8S2faASz-6tzdn_.D4FknXA2SZbCimrOWZGItdkZeIYNl8x_0 2024-09-12T01:11:24.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1021807817055702404', time=2024-09-12T03:05:07.528874+0000, chain.objs.size()=1 2024-09-12T01:11:24.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:eJdmmo-68foxW8-W4Taz2-c2Hl-N3BT_.P30hCk0kdn48S7VurUTgva3iJWGI5jd_0 2024-09-12T01:11:24.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1798456524964320561', time=2024-09-12T03:05:17.981732+0000, chain.objs.size()=1 2024-09-12T01:11:24.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.588__shadow:nk.5uXQVhzIIoW5XAtj3oLzldA9zT6b_.LBSV349H8G7Jmq7NvulEn15uyf38eWz_0 2024-09-12T01:11:24.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6047729026881012291', time=2024-09-12T03:07:47.101193+0000, chain.objs.size()=1 2024-09-12T01:11:24.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.635__shadow_.xurbBNDbp7WfIIKkbr_nhW3gP9bp5ew_0 2024-09-12T01:11:24.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17320050066762683041', time=2024-09-12T03:07:53.801609+0000, chain.objs.size()=1 2024-09-12T01:11:24.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.649__shadow_.BsuVZpxB3YuOZKfvtinKQtXljU-fYcK_0 2024-09-12T01:11:24.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9550618360825252470', time=2024-09-12T03:07:57.692970+0000, chain.objs.size()=1 2024-09-12T01:11:24.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.656__shadow_.XX8U7DkmhWf1_SO25iY3qid1MM_7cDw_0 2024-09-12T01:11:24.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15848876437701436090', time=2024-09-12T03:08:21.878657+0000, chain.objs.size()=1 2024-09-12T01:11:24.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.486+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.711__shadow:yhaCaVo5us00YXotMeKqN6YHqkn3L7P_.dVm1YRese1P0dbOe7huFRe2DxI9oZYw_0 2024-09-12T01:11:24.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.489+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12436680151766297574', time=2024-09-12T03:08:45.043553+0000, chain.objs.size()=1 2024-09-12T01:11:24.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.489+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.720__shadow_.rphlDs8pOXdXacDLqTYB_JpTIky6mmk_0 2024-09-12T01:11:24.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.492+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.494+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:11:24.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.496+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.496+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50255' 2024-09-12T01:11:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.737609215566127491', time=2024-09-12T02:58:53.027736+0000, chain.objs.size()=5 2024-09-12T01:11:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__multipart_mymultipart-FROZEN.2~_5KYf-S_3Ie2Vg2eBJP8PNPkATGwK0A.1 2024-09-12T01:11:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__shadow_mymultipart-FROZEN.2~_5KYf-S_3Ie2Vg2eBJP8PNPkATGwK0A.1_1 2024-09-12T01:11:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__multipart_mymultipart-FROZEN.2~_5KYf-S_3Ie2Vg2eBJP8PNPkATGwK0A.2 2024-09-12T01:11:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__shadow_mymultipart-FROZEN.2~_5KYf-S_3Ie2Vg2eBJP8PNPkATGwK0A.2_1 2024-09-12T01:11:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ad4424e4-de7c-4376-b125-e717016a3484.4511.160__multipart_mymultipart-FROZEN.2~_5KYf-S_3Ie2Vg2eBJP8PNPkATGwK0A.3 2024-09-12T01:11:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14293853848870202726', time=2024-09-12T02:59:25.245392+0000, chain.objs.size()=1 2024-09-12T01:11:24.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.200__shadow_.yiXhrkNQbZZpkcUpwEjen8CPRAkCzxm_0 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~1mUIz1BELLb2P8TuOINIiJUTj_gkwHn', time=2024-09-12T02:59:26.320239+0000, chain.objs.size()=1 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.202__multipart_mymultipart.2~1mUIz1BELLb2P8TuOINIiJUTj_gkwHn.1 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9764602128584220331', time=2024-09-12T03:00:35.269667+0000, chain.objs.size()=1 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.232__shadow_.5dstWdIYslP9-_SXak4flZWthm_evs0_0 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1621608359398613591', time=2024-09-12T03:00:40.583449+0000, chain.objs.size()=1 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.242__shadow_.YOCCwGsUIjDMVIIw2bnelI2hlUqo3oI_0 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6306998476735446814', time=2024-09-12T03:00:44.107159+0000, chain.objs.size()=1 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.248__shadow_.iwEU4Jsws4OqgzSS7tFFnT1zGB9mkB0_0 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10638798383823268351', time=2024-09-12T03:00:58.938540+0000, chain.objs.size()=1 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TtWV5FT0p5DG8ZHUdYKKsKAcc5dDeAW_0 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8011089848175808990', time=2024-09-12T03:00:58.959232+0000, chain.objs.size()=1 2024-09-12T01:11:24.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.497+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.E6q1hxC3DZtUg7TenviljhOaWdbINqZ_0 2024-09-12T01:11:24.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.500+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16213981556117625087', time=2024-09-12T03:00:58.982997+0000, chain.objs.size()=1 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.500+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.y5s3At2YDhwaUDYdMZiGh0kpmyJ1Oju_0 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12988691288480448111', time=2024-09-12T03:00:59.140284+0000, chain.objs.size()=1 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RsKgrZ46v5m2Mdr6CtFKD73dD0udP-R_0 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8886366510892828534', time=2024-09-12T03:00:59.158204+0000, chain.objs.size()=1 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.IHGy7XXRE0WQsi6CmQQo2kqdmLZBbUt_0 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2970548558345606129', time=2024-09-12T03:00:59.278815+0000, chain.objs.size()=1 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.EOnS1A9CsFMCsDk1IFuFM4oeAtiCVaR_0 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8534074017987645154', time=2024-09-12T03:00:59.290802+0000, chain.objs.size()=1 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vxUJxC7OugYIgqLjzLGXNdpmRQuzLaD_0 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13353570796941546287', time=2024-09-12T03:00:59.310921+0000, chain.objs.size()=1 2024-09-12T01:11:24.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.501+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3z5ppyHh3vK4wzhQe3IRblhboWdR63Z_0 2024-09-12T01:11:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4041504087951695237', time=2024-09-12T03:00:59.406604+0000, chain.objs.size()=1 2024-09-12T01:11:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BOo7ApUPFHWo3uL6IGjWN1qxQwhIsDr_0 2024-09-12T01:11:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8400787963538745734', time=2024-09-12T03:00:59.455381+0000, chain.objs.size()=1 2024-09-12T01:11:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8CSPenunA46Q2s-p8Vq2kNrWL1qFU1p_0 2024-09-12T01:11:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17208972459117359356', time=2024-09-12T03:00:59.480055+0000, chain.objs.size()=1 2024-09-12T01:11:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JR7mslEgahQydgRUVedKnJW6fRlIRws_0 2024-09-12T01:11:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1542318710595667214', time=2024-09-12T03:00:59.666117+0000, chain.objs.size()=1 2024-09-12T01:11:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8ieezR6RT6ngc2qeWqoWEf_gOF9zyF-_0 2024-09-12T01:11:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15310681309577514943', time=2024-09-12T03:00:59.673184+0000, chain.objs.size()=1 2024-09-12T01:11:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.502+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.cdlbb-RnR9fB3Tvu2ScWReN937jBL7i_0 2024-09-12T01:11:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.504+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15091280920753129945', time=2024-09-12T03:00:59.707882+0000, chain.objs.size()=1 2024-09-12T01:11:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.504+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.b6e4olofnzb8hlWlZAckO0Qu__N_RtG_0 2024-09-12T01:11:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.504+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13194580287358877669', time=2024-09-12T03:00:59.710982+0000, chain.objs.size()=1 2024-09-12T01:11:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.504+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jpR0rnqU55Oy81iBSuMkmKcEewWEXt5_0 2024-09-12T01:11:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.504+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4855073053150648805', time=2024-09-12T03:00:59.784095+0000, chain.objs.size()=1 2024-09-12T01:11:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.504+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.HGYoMeuapBANJzUm8QI7b732JguhHpA_0 2024-09-12T01:11:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.504+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2981328173095161699', time=2024-09-12T03:00:59.968265+0000, chain.objs.size()=1 2024-09-12T01:11:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.504+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.HquV5kkbkX5q9gFgdWBYzO8noAoW4MP_0 2024-09-12T01:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.505+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1479974268455734054', time=2024-09-12T03:01:00.039899+0000, chain.objs.size()=1 2024-09-12T01:11:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.505+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.o56jFeIYO22iYiTw4SnWJWqpT6xA71C_0 2024-09-12T01:11:24.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.505+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5745567627786203340', time=2024-09-12T03:01:00.049066+0000, chain.objs.size()=1 2024-09-12T01:11:24.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.505+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.D2PwEqA4vYJhFB2h-8uccdBTWcexPt9_0 2024-09-12T01:11:24.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.507+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4390381035073674964', time=2024-09-12T03:01:00.375830+0000, chain.objs.size()=1 2024-09-12T01:11:24.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.507+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.0irg2q3Ub9a5jVpbUDjAW130dysQ2Hj_0 2024-09-12T01:11:24.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.507+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6637886456811689051', time=2024-09-12T03:01:00.380317+0000, chain.objs.size()=1 2024-09-12T01:11:24.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.507+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JCbePqqxYAhz9smwa0j7kxVybFk17XJ_0 2024-09-12T01:11:24.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.507+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7541732894322047921', time=2024-09-12T03:01:00.391004+0000, chain.objs.size()=1 2024-09-12T01:11:24.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.507+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.NVXSTW7sVn9PsvSSvIXjoi5dYJzrDQS_0 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16009603068255411152', time=2024-09-12T03:01:00.413165+0000, chain.objs.size()=1 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JkZeY9rhly4vU9HXtyK-72MYcnMFJgG_0 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1672597207839975698', time=2024-09-12T03:01:00.430915+0000, chain.objs.size()=1 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jQydSvUlIEwd6e5RvcdtLo-peNGXmBa_0 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.845138130252677876', time=2024-09-12T03:01:00.594720+0000, chain.objs.size()=1 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.YtrLgbF-5sGqLvXL_rAgv6XfRNIAQ8n_0 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1493546883639621330', time=2024-09-12T03:01:00.620523+0000, chain.objs.size()=1 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ynSeVU5Es7SJayfV55-Qha5_PY3MVda_0 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4439234726894506467', time=2024-09-12T03:01:00.640436+0000, chain.objs.size()=1 2024-09-12T01:11:24.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.8pR27bNr1Vy2H78ZGgHDINdIqvPU6TC_0 2024-09-12T01:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13604892609613995702', time=2024-09-12T03:01:00.717749+0000, chain.objs.size()=1 2024-09-12T01:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4NY-aek9kI-6w8mWIZU-O4417FoE8vw_0 2024-09-12T01:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2521365487891109617', time=2024-09-12T03:01:00.756060+0000, chain.objs.size()=1 2024-09-12T01:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1JD-qOk_OeAdX6SRyjDNbVgUbFPQpk3_0 2024-09-12T01:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11587896673854457774', time=2024-09-12T03:01:00.885605+0000, chain.objs.size()=1 2024-09-12T01:11:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.509+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.JrjjXiw7T7dvT_AO_fMHbDNNyBBa9HX_0 2024-09-12T01:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.511+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16654596430479200375', time=2024-09-12T03:01:00.890625+0000, chain.objs.size()=1 2024-09-12T01:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.511+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.7-7O04bDCpcnukUA0V0opFEtuA0ERlS_0 2024-09-12T01:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.512+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4093480327036390820', time=2024-09-12T03:01:01.906567+0000, chain.objs.size()=1 2024-09-12T01:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.512+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.265__shadow_.B_wXd0KLGowBV4vbJvgw7couJRQ15PZ_0 2024-09-12T01:11:24.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.512+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10228367240368085828', time=2024-09-12T03:01:02.832074+0000, chain.objs.size()=1 2024-09-12T01:11:24.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.512+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.267__shadow_.L680Y6kg9It9Y2xgO9HJqVeDmchcusK_0 2024-09-12T01:11:24.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.512+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4088788175986329110', time=2024-09-12T03:01:06.098232+0000, chain.objs.size()=1 2024-09-12T01:11:24.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.512+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.274__shadow_.E4_KW-bvdRsp2byEUCV561ZayFVpNeT_0 2024-09-12T01:11:24.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.512+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3174142686699814567', time=2024-09-12T03:01:08.399520+0000, chain.objs.size()=1 2024-09-12T01:11:24.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.512+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.279__shadow_.NQOKIlySKa6IhbRhAS_hQpbSUm169eb_0 2024-09-12T01:11:24.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.514+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1492954577244628076', time=2024-09-12T03:01:10.814308+0000, chain.objs.size()=1 2024-09-12T01:11:24.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.514+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.284__shadow_.3zGJVGuE0-NmIIIgl7dAa7-9g50WHPb_0 2024-09-12T01:11:24.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.514+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9344871696129347299', time=2024-09-12T03:01:11.923079+0000, chain.objs.size()=1 2024-09-12T01:11:24.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.514+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.286__shadow_.RoF8gMdeNsYmVQ_L5MmyLJj3X3yEOE1_0 2024-09-12T01:11:24.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.990497492379095444', time=2024-09-12T03:01:16.644406+0000, chain.objs.size()=1 2024-09-12T01:11:24.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.M5kCOHvlSu0Ex-3U5fIUen7TLbrcsK__0 2024-09-12T01:11:24.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5860100196438045040', time=2024-09-12T03:01:16.658682+0000, chain.objs.size()=1 2024-09-12T01:11:24.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.UY-XEgDg7V-QoNkZo5hmhl69GDq98AS_0 2024-09-12T01:11:24.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4393574196447451396', time=2024-09-12T03:01:18.063802+0000, chain.objs.size()=1 2024-09-12T01:11:24.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.297__shadow_.sVJzF8FBPlHjzHF-f4MYGbRF7gOko81_0 2024-09-12T01:11:24.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3855838878235557503', time=2024-09-12T03:01:29.454580+0000, chain.objs.size()=1 2024-09-12T01:11:24.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.320__shadow:zJLPTBJqn4LxMzuLLQwKyJkdf2P2Soz_.89C7xph8ar-_NVAVsVqMedGzQ3gzF0j_0 2024-09-12T01:11:24.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7190500549375562463', time=2024-09-12T03:01:40.123705+0000, chain.objs.size()=1 2024-09-12T01:11:24.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.515+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.atos0jUKA3gsIS3sB36zTuF_6guEoZD_0 2024-09-12T01:11:24.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.516+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13365700732058509592', time=2024-09-12T03:01:40.143871+0000, chain.objs.size()=1 2024-09-12T01:11:24.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.516+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.R8GwpUA8nRSbXSdUPKV8PKbPU5vS9j1_0 2024-09-12T01:11:24.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.516+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11258159605843559504', time=2024-09-12T03:01:40.215570+0000, chain.objs.size()=1 2024-09-12T01:11:24.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.516+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eRTYDhtcsdSlgze7cP7FrbJ1hv5tdrm_0 2024-09-12T01:11:24.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.516+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6492929574925188643', time=2024-09-12T03:01:40.379264+0000, chain.objs.size()=1 2024-09-12T01:11:24.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.516+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.81fPlZUhQDdattWQkp48PPpFhgTmJA8_0 2024-09-12T01:11:24.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.518+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17101439298822413390', time=2024-09-12T03:01:40.386669+0000, chain.objs.size()=1 2024-09-12T01:11:24.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.518+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7FeNYHe1oaxLrad-gNsiaXR_q1KP_Jf_0 2024-09-12T01:11:24.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.519+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6895882587074941801', time=2024-09-12T03:01:40.409139+0000, chain.objs.size()=1 2024-09-12T01:11:24.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.519+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qLhyk2kwFtw-PcSUb7jhs4zeARJKjuu_0 2024-09-12T01:11:24.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.520+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8216299901900986268', time=2024-09-12T03:01:40.444733+0000, chain.objs.size()=1 2024-09-12T01:11:24.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.520+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.W_uXqPnogeke0LH6dAjTfDrEe04nF1L_0 2024-09-12T01:11:24.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.520+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18139546601367368288', time=2024-09-12T03:01:40.543874+0000, chain.objs.size()=1 2024-09-12T01:11:24.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.520+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.9sUpriZJnKpXiWdSFpbr4UPd_K5K01i_0 2024-09-12T01:11:24.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.214553546874192339', time=2024-09-12T03:01:40.558309+0000, chain.objs.size()=1 2024-09-12T01:11:24.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2DYHl7g8jXRLNiFh7Pzg1NSXeBsraAC_0 2024-09-12T01:11:24.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14476747041378918211', time=2024-09-12T03:01:40.712294+0000, chain.objs.size()=1 2024-09-12T01:11:24.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pVQPh7mG6jrg8l-roIbf9bFRqNkkJor_0 2024-09-12T01:11:24.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14014680009743351522', time=2024-09-12T03:01:40.720086+0000, chain.objs.size()=1 2024-09-12T01:11:24.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yrBgpxZnCL7UBh_y3yU4mNvBiMiUMxW_0 2024-09-12T01:11:24.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17038516695872970887', time=2024-09-12T03:01:40.723144+0000, chain.objs.size()=1 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nO-3UxYvwF3y-IMio_lNtn5O2inYBYI_0 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13778174208574625441', time=2024-09-12T03:01:40.755021+0000, chain.objs.size()=1 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3I3_LVtpQi2VaSU5nudfKVO4l5ZZXU7_0 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13386118524264241789', time=2024-09-12T03:01:41.043897+0000, chain.objs.size()=1 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.47HZJGh6Juizt5BYdRPP5ezYFj1YYna_0 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13760873223364046455', time=2024-09-12T03:01:41.073816+0000, chain.objs.size()=1 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mhMsmsBdEWUTDKXRUf430gShWNDPooK_0 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3337980184262723454', time=2024-09-12T03:01:41.200591+0000, chain.objs.size()=1 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KTZv__Xt8QsWvJF2ti4iers1SlTcdgO_0 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3061672577483168515', time=2024-09-12T03:01:41.222412+0000, chain.objs.size()=1 2024-09-12T01:11:24.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.522+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Q_UYGOjAQKAjAXp3QyTh6OSWBRBLQFo_0 2024-09-12T01:11:24.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.523+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16096279115734419740', time=2024-09-12T03:01:41.228318+0000, chain.objs.size()=1 2024-09-12T01:11:24.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.523+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.9L1FCG5LZLAkrt5HZp6cnOMo7oVWA7D_0 2024-09-12T01:11:24.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.525+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2492951185688082938', time=2024-09-12T03:01:41.246225+0000, chain.objs.size()=1 2024-09-12T01:11:24.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.525+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kbdv-hqVXvzAO5n81jJsXHvR3vuGFNx_0 2024-09-12T01:11:24.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5503080150937832245', time=2024-09-12T03:01:41.260890+0000, chain.objs.size()=1 2024-09-12T01:11:24.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ipv4PXyMtts3uzLxRI99MyYHuR68jtF_0 2024-09-12T01:11:24.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13333448213033086188', time=2024-09-12T03:01:41.325546+0000, chain.objs.size()=1 2024-09-12T01:11:24.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.x0KitE-LNb6485FqDqTQZe7bLfuBI9c_0 2024-09-12T01:11:24.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15727705565041371059', time=2024-09-12T03:01:41.344782+0000, chain.objs.size()=1 2024-09-12T01:11:24.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pDpfIQr8djEF5NqFdYhe1CkV5Uk8XY__0 2024-09-12T01:11:24.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.497310106104511434', time=2024-09-12T03:01:41.441031+0000, chain.objs.size()=1 2024-09-12T01:11:24.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3XGMENc8CZb1n9NsutXx9lKpbh6v5tz_0 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17248537384690720050', time=2024-09-12T03:01:41.463652+0000, chain.objs.size()=1 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.t6VyKQw78zSNLy3gpYRfL5MVpjRNIAi_0 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10476118644557164401', time=2024-09-12T03:01:41.548616+0000, chain.objs.size()=1 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Svagbm2RDin4Cx7tKH6P0mGAWDM_w_Z_0 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6704547909590033904', time=2024-09-12T03:01:41.617128+0000, chain.objs.size()=1 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yKB4NHm7Wy6MW75rPsAFztEfc57qwlk_0 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15697638351067073521', time=2024-09-12T03:01:41.618171+0000, chain.objs.size()=1 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pNBWqjsa1dJpcfnf-olXUSpzHqKGKxM_0 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8245403388539441937', time=2024-09-12T03:01:41.832588+0000, chain.objs.size()=1 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aJjEVRbPd9NdUkdePJ8e6cx-ECanjdi_0 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.62443261520795214', time=2024-09-12T03:01:41.840838+0000, chain.objs.size()=1 2024-09-12T01:11:24.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.528+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.sHhYa3nup-G-Kw71rUJb6ncOKGOj7nP_0 2024-09-12T01:11:24.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.531+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1204371267312361098', time=2024-09-12T03:01:41.857022+0000, chain.objs.size()=1 2024-09-12T01:11:24.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.531+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.2cfk71auo9jtVgC2L1Y1_tM-fSwydv5_0 2024-09-12T01:11:24.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.532+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16815106552185004430', time=2024-09-12T03:01:42.000464+0000, chain.objs.size()=1 2024-09-12T01:11:24.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.532+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.eFthwYiyR6_hxWxFSi8fqfuMTYiq0ns_0 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17898505365141655432', time=2024-09-12T03:01:42.038758+0000, chain.objs.size()=1 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QECDnCksfG5N5QQvOZElqDTW_3xoJye_0 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.554982031791024663', time=2024-09-12T03:01:42.068910+0000, chain.objs.size()=1 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wSkIpbzoEQ7G03M7VjV7YYfWgnbBz9d_0 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4013501433668002769', time=2024-09-12T03:01:42.077076+0000, chain.objs.size()=1 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EHeiHTCg8iDZzq-zsS2FSEB5VW5wAHC_0 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17991225808198556159', time=2024-09-12T03:01:50.227615+0000, chain.objs.size()=1 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LU8zE7sDPFTws2dJhjzhPtz0aAmshHJ_0 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2235778106448497386', time=2024-09-12T03:01:50.236490+0000, chain.objs.size()=1 2024-09-12T01:11:24.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.eTFB-ByTtqvR9MyBK3tGSXqiPtfJoRd_0 2024-09-12T01:11:24.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11506761914137180685', time=2024-09-12T03:01:50.314532+0000, chain.objs.size()=1 2024-09-12T01:11:24.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.UmMgFuNKiZ3TgqwpOO07K77hEP-4f85_0 2024-09-12T01:11:24.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5884145559294222839', time=2024-09-12T03:01:50.362300+0000, chain.objs.size()=1 2024-09-12T01:11:24.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ZGz1pmBy1S-557A-pGXluteO61-aIIV_0 2024-09-12T01:11:24.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7948263571359202608', time=2024-09-12T03:01:50.604821+0000, chain.objs.size()=1 2024-09-12T01:11:24.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Eeb-T0Bh2RJTZndo3kM0HtJZDqL_h7y_0 2024-09-12T01:11:24.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15255416751226470045', time=2024-09-12T03:01:50.629108+0000, chain.objs.size()=1 2024-09-12T01:11:24.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.533+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.89i_bbVnJQ4JLyEruJPIS_GeoNgiVVK_0 2024-09-12T01:11:24.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.535+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14909458450495326148', time=2024-09-12T03:01:50.642830+0000, chain.objs.size()=1 2024-09-12T01:11:24.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.535+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3tqvF92TXCBhAPwYpS_dH1l7Bh7suKr_0 2024-09-12T01:11:24.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.537+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15528986395860803215', time=2024-09-12T03:01:50.724125+0000, chain.objs.size()=1 2024-09-12T01:11:24.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.537+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.bOenNE-ZMyTbMv6m1VMoN-neFYqFEqR_0 2024-09-12T01:11:24.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.538+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2406805645983514817', time=2024-09-12T03:01:50.907565+0000, chain.objs.size()=1 2024-09-12T01:11:24.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.538+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.b7VJkPZzTxb83Y0zHyyaK2rUZUTrxvZ_0 2024-09-12T01:11:24.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.539+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14305228484455290530', time=2024-09-12T03:01:50.987169+0000, chain.objs.size()=1 2024-09-12T01:11:24.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.539+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LW8OD2lVMpP7OTND1MnB0vSylo_ZTq2_0 2024-09-12T01:11:24.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.539+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14428996535573363203', time=2024-09-12T03:01:50.997067+0000, chain.objs.size()=1 2024-09-12T01:11:24.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.539+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.04GwsTI1H8lHRy9qUIK4-n0OQH9xrNl_0 2024-09-12T01:11:24.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.539+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1213443733019188035', time=2024-09-12T03:01:51.183757+0000, chain.objs.size()=1 2024-09-12T01:11:24.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.539+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.oq-5kf605kx6ujGAcKKdaJ6mtkY79Jm_0 2024-09-12T01:11:24.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.539+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2897959619914047263', time=2024-09-12T03:01:51.195405+0000, chain.objs.size()=1 2024-09-12T01:11:24.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.539+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Nim__vHHjaelM1MS_JsEYQW7Kp0TK3r_0 2024-09-12T01:11:24.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14264229249771788465', time=2024-09-12T03:01:51.264986+0000, chain.objs.size()=1 2024-09-12T01:11:24.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7dGOH4O1XsxV7c43Xc8cQC9Nw4iaZgj_0 2024-09-12T01:11:24.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5032771046923154624', time=2024-09-12T03:01:51.380323+0000, chain.objs.size()=1 2024-09-12T01:11:24.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lHyvtUSZrIruOZMrQ7JWanGIshA2p9J_0 2024-09-12T01:11:24.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7533323774325182672', time=2024-09-12T03:01:51.402117+0000, chain.objs.size()=1 2024-09-12T01:11:24.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ES0DwMV2TzCPonSgWFaayA1UkT1AOAT_0 2024-09-12T01:11:24.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13988326124702572882', time=2024-09-12T03:01:51.481823+0000, chain.objs.size()=1 2024-09-12T01:11:24.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GyHcIxYn7IrYpdXbGAq1KH-XM8_pq3P_0 2024-09-12T01:11:24.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9280535075801560628', time=2024-09-12T03:01:51.508924+0000, chain.objs.size()=1 2024-09-12T01:11:24.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.540+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.RHw9mW4kPBEEzyGGG-90SqPZJY7-fkT_0 2024-09-12T01:11:24.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.544+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1745255401013660167', time=2024-09-12T03:01:51.751551+0000, chain.objs.size()=1 2024-09-12T01:11:24.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.544+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pI7rj7tMtHWlvlS5xpTvDiRJ2we-hd-_0 2024-09-12T01:11:24.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.547+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/50255 2024-09-12T01:11:24.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T01:11:24.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13863577249997535201', time=2024-09-12T03:01:51.775949+0000, chain.objs.size()=1 2024-09-12T01:11:24.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rSt15H9T-7-aj3RqWHxKgcT0UbQ62_M_0 2024-09-12T01:11:24.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18142345099402859674', time=2024-09-12T03:01:51.778594+0000, chain.objs.size()=1 2024-09-12T01:11:24.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.gsqCG4UOk3-sl1lJHRxqU1Ne4tSaeFG_0 2024-09-12T01:11:24.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18322116442585358304', time=2024-09-12T03:01:51.818325+0000, chain.objs.size()=1 2024-09-12T01:11:24.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Sr6IIPH5vQXGvv1BDjU9Ooosc0cjg1f_0 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17311893576571641871', time=2024-09-12T03:01:52.034187+0000, chain.objs.size()=1 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.dxWUI9njLPWYDWXEWDVEbXX6w06Zy3j_0 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11182835539967376829', time=2024-09-12T03:01:52.062122+0000, chain.objs.size()=1 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8xPpixik8EbbLby0N3QYSGfL0cFD4CV_0 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14863498848397667226', time=2024-09-12T03:01:52.194889+0000, chain.objs.size()=1 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.BG4_2t9MAWWivV3l0PlaNKjt2yragMb_0 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5091608455465602231', time=2024-09-12T03:01:52.247555+0000, chain.objs.size()=1 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.nspj7ZD3Yz8GEuyMuj1Maok8XF4m7gq_0 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7680366553466822770', time=2024-09-12T03:01:52.254136+0000, chain.objs.size()=1 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.dm65BsDvNaqguSvBUQpeQY2yn-R7Z5v_0 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9446756232294919920', time=2024-09-12T03:02:44.692814+0000, chain.objs.size()=1 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.433__shadow_.LYtb0P0fZ_atcaL-TgHb7IZOIJH4OMO_0 2024-09-12T01:11:24.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7147191776739728482', time=2024-09-12T03:03:03.313167+0000, chain.objs.size()=1 2024-09-12T01:11:24.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.549+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.465__shadow_.SGum9lVoKACq9ugkvYfEhl8zXCZPy2D_0 2024-09-12T01:11:24.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.550+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8915438753547193506', time=2024-09-12T03:03:10.088240+0000, chain.objs.size()=1 2024-09-12T01:11:24.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.550+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.A6pjMUO-8pJ0bV7Xfr4FpCyYnjOUmS7_0 2024-09-12T01:11:24.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.550+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17281233439869721068', time=2024-09-12T03:03:10.617300+0000, chain.objs.size()=1 2024-09-12T01:11:24.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.550+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.485__shadow_.meVPPKXMop7mtuZVJ1h4D51J1IN0gzP_0 2024-09-12T01:11:24.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13083518133126813772', time=2024-09-12T03:03:17.567564+0000, chain.objs.size()=1 2024-09-12T01:11:24.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.500__shadow_.Ek_eSOK7z2xBXEyPrMd5jIvFSii-WA7_0 2024-09-12T01:11:24.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.553+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~_X7KoABo2yI_HQvr_1FTl_iDQl7WK1T', time=2024-09-12T03:03:51.869205+0000, chain.objs.size()=1 2024-09-12T01:11:24.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.553+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.534__multipart_mymultipart.2~_X7KoABo2yI_HQvr_1FTl_iDQl7WK1T.1 2024-09-12T01:11:24.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5413227808553621893', time=2024-09-12T03:04:08.877369+0000, chain.objs.size()=1 2024-09-12T01:11:24.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.537__multipart_mymultipart.2~mI0CA2zEkD_4En8zAvaQ46V34dJo8zv.1 2024-09-12T01:11:24.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8368012218912917986', time=2024-09-12T03:04:26.910262+0000, chain.objs.size()=1 2024-09-12T01:11:24.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.552__shadow_.4FkFlmXHG6fTQ9wtIszJg34ajeAp1GH_0 2024-09-12T01:11:24.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2946231351997084872', time=2024-09-12T03:04:27.569727+0000, chain.objs.size()=1 2024-09-12T01:11:24.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.553__shadow_.WzEbLXKrPOGVlnUhCoyPc8CJnoJQWpY_0 2024-09-12T01:11:24.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11203480174793476675', time=2024-09-12T03:04:31.084095+0000, chain.objs.size()=1 2024-09-12T01:11:24.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.559__shadow_.rvAnpaHjlW9k2AZWbs_tbNkZzPxwOtK_0 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17645644428156954622', time=2024-09-12T03:04:41.747707+0000, chain.objs.size()=1 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:gcaGwZUzsJ7TyGLD3rFqwzbpJn9h8B0_.hPNHxlHUIpzZWmkgLTNa1OxXL9G-a3o_0 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14846474517080463224', time=2024-09-12T03:04:50.369723+0000, chain.objs.size()=1 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow:mn.kq53675HPoJPDqFBo7YU8Okx4nBx_.A-gXoXSbK7fL87JqGfKQZZeF_YQljZE_0 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7669325536372126228', time=2024-09-12T03:04:56.195545+0000, chain.objs.size()=1 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:po0G7Q9uO2v8hJFPCacJu5R6SGT0dM0_.zdp1q0y63aEXb0VTSba8xVa9CDS8we1_0 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7761015359601557783', time=2024-09-12T03:05:02.939656+0000, chain.objs.size()=1 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:dsPT.cG1uMnpHgOmmllu2K-XB.jcY6k_.G__APgyoKZMAhyKuXBVhR4oxIqkJ1AI_0 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13854679599417601082', time=2024-09-12T03:05:06.382567+0000, chain.objs.size()=1 2024-09-12T01:11:24.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.555+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:W4UsEw2EC7uXI.Nbd3brkz9Uusev7qs_.62FcrX2sAD_DPXRaRxJVCpe-CWcO3zp_0 2024-09-12T01:11:24.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3752726626798439823', time=2024-09-12T03:05:06.581660+0000, chain.objs.size()=1 2024-09-12T01:11:24.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:QqEh8Xxv.ptbmmWAFqtv0hLC5Xbz5Uo_.j7V2oNwKGFtIud2_zCGwoWqnSKXIqYQ_0 2024-09-12T01:11:24.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.557+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15384976666901648422', time=2024-09-12T03:07:55.024753+0000, chain.objs.size()=1 2024-09-12T01:11:24.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.557+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.651__shadow_.O8JS1cmN9j6lxWPJEAKJBobFvVAdQiw_0 2024-09-12T01:11:24.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.559+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15818536156159503272', time=2024-09-12T03:08:05.674943+0000, chain.objs.size()=1 2024-09-12T01:11:24.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.559+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.673__shadow_.GO52ZjkJnJECZ8iBVO_khxbLex2ULdQ_0 2024-09-12T01:11:24.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.560+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12766237854096843119', time=2024-09-12T03:09:09.314088+0000, chain.objs.size()=1 2024-09-12T01:11:24.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.560+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.746__shadow_.rb0u4mairmLPoDyKI301VBqvuDlSG9L_0 2024-09-12T01:11:24.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.563+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.566+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:11:24.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.568+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.568+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/68710' 2024-09-12T01:11:24.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15033697981042887677', time=2024-09-12T02:59:14.155712+0000, chain.objs.size()=1 2024-09-12T01:11:24.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.189__shadow_.k8IrnebvXVC9WoaX6P-Jw0rJgpBAtV8_0 2024-09-12T01:11:24.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16406015990182692093', time=2024-09-12T03:00:37.115862+0000, chain.objs.size()=1 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.236__shadow_.IN-TrR5ZqnxX3I9hAj1abWeX1Wt5-nn_0 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15499765451685053905', time=2024-09-12T03:00:48.401203+0000, chain.objs.size()=1 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.257__shadow_.6YvAnjboZDwIII29h10e1BkK68XeoZi_0 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15440369755302322629', time=2024-09-12T03:00:50.206354+0000, chain.objs.size()=1 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.261__shadow_.nEicyRKGraSNeEiEe-Rh_tUeNZr9kS9_0 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9359794279490584824', time=2024-09-12T03:00:58.894696+0000, chain.objs.size()=1 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Ng3m1SllgBVDeZ_q9wowCDjfq6T2078_0 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4334743644873950218', time=2024-09-12T03:00:59.014098+0000, chain.objs.size()=1 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.BkG54d9fe9dLfjbI0NvYAnPysqrOFIm_0 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5802723552063836117', time=2024-09-12T03:00:59.019068+0000, chain.objs.size()=1 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.83Gq9pQ6lFMYVZ4kLO6rzxpdPBV-oVS_0 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17392921854626440602', time=2024-09-12T03:00:59.159823+0000, chain.objs.size()=1 2024-09-12T01:11:24.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4dlc9dCGZqdumgDjtJLEWVf_V2Q9434_0 2024-09-12T01:11:24.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8840114271055922949', time=2024-09-12T03:00:59.231231+0000, chain.objs.size()=1 2024-09-12T01:11:24.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5FufhV6DfZNjCEFMqof8swfXXJOR3o__0 2024-09-12T01:11:24.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1667262273396789775', time=2024-09-12T03:00:59.260850+0000, chain.objs.size()=1 2024-09-12T01:11:24.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.VSjLuCyKWGhjjenAGiO2rRs468GeyUB_0 2024-09-12T01:11:24.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15746191352021959611', time=2024-09-12T03:00:59.267893+0000, chain.objs.size()=1 2024-09-12T01:11:24.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.n_rY5xHJEJtAvtRncVSJX2jyfOXhmWL_0 2024-09-12T01:11:24.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2464556122941597880', time=2024-09-12T03:00:59.268623+0000, chain.objs.size()=1 2024-09-12T01:11:24.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.569+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.P01DQ98Xp6fSqVeT2AxczJMtl71BLTj_0 2024-09-12T01:11:24.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4349427348874781029', time=2024-09-12T03:00:59.287263+0000, chain.objs.size()=1 2024-09-12T01:11:24.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.NmzQejH5RKalNDs85cLCmPrIxn3DrQ3_0 2024-09-12T01:11:24.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10937113802881559788', time=2024-09-12T03:00:59.443496+0000, chain.objs.size()=1 2024-09-12T01:11:24.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.EoTkDCq12Q72R9gnqZ3JUNgBJEf_GIF_0 2024-09-12T01:11:24.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5358598315479073126', time=2024-09-12T03:00:59.463818+0000, chain.objs.size()=1 2024-09-12T01:11:24.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.HkTYD_xFElt1f3Qtokzuz4SZsF9QpGY_0 2024-09-12T01:11:24.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6818843456469360735', time=2024-09-12T03:00:59.529856+0000, chain.objs.size()=1 2024-09-12T01:11:24.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.V9mDMbWZTzb4fVNJktugHh6PbjQuI0h_0 2024-09-12T01:11:24.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15488373958221410051', time=2024-09-12T03:00:59.554201+0000, chain.objs.size()=1 2024-09-12T01:11:24.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.NluYNCGG1zrgqOzIMNmojctl_SXPYay_0 2024-09-12T01:11:24.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4169006897910307295', time=2024-09-12T03:00:59.568537+0000, chain.objs.size()=1 2024-09-12T01:11:24.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.573+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4NwsVUsLE5VW4la8LHtMQ9En0_tpKGe_0 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6004461690266418945', time=2024-09-12T03:00:59.678519+0000, chain.objs.size()=1 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.nAdQq9AHa__tIKPHL_ycDGQIVoQozhl_0 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.574+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8851027211223602571', time=2024-09-12T03:00:59.696964+0000, chain.objs.size()=1 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.574+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bxhaVWMXD_AZZR84XoSqv68tytIKbyW_0 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.575+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13420830959961218434', time=2024-09-12T03:00:59.731657+0000, chain.objs.size()=1 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.575+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WG5IyNs4OpqiH_IEXu25RsdOHWyZxMa_0 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.575+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16620064906662902615', time=2024-09-12T03:00:59.732398+0000, chain.objs.size()=1 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.575+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.c0EkhomMG2FypJ9rn_6N0k-bfsEDuGd_0 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.575+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9075142716467893661', time=2024-09-12T03:00:59.800296+0000, chain.objs.size()=1 2024-09-12T01:11:24.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.575+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.NBKyu5SGVJlfgrXYe_0e_kiAyA1m6Ab_0 2024-09-12T01:11:24.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.576+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7599235502482828012', time=2024-09-12T03:01:00.075959+0000, chain.objs.size()=1 2024-09-12T01:11:24.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.576+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bMp4rRsOW59eTVvmYXd8a3t_d2mebjM_0 2024-09-12T01:11:24.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12646961349569016067', time=2024-09-12T03:01:00.082358+0000, chain.objs.size()=1 2024-09-12T01:11:24.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FuGrHuCi8sY8IOWnu7uljFWU_AF4qIw_0 2024-09-12T01:11:24.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5344890111411584336', time=2024-09-12T03:01:00.101462+0000, chain.objs.size()=1 2024-09-12T01:11:24.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lQI8rGPZB5rHsSR4q2YjhGFIUvZkOnc_0 2024-09-12T01:11:24.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10687846658512662537', time=2024-09-12T03:01:00.329681+0000, chain.objs.size()=1 2024-09-12T01:11:24.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5fCw2AqEe2qUnfkObao8f7oVAQCXpK6_0 2024-09-12T01:11:24.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.578+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15325261506203994801', time=2024-09-12T03:01:00.367775+0000, chain.objs.size()=1 2024-09-12T01:11:24.577 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.578+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RjAT0_kviD6D9QveldoN3C79ypS_EXm_0 2024-09-12T01:11:24.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12243159099775055023', time=2024-09-12T03:01:00.627708+0000, chain.objs.size()=1 2024-09-12T01:11:24.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.anQ7aKSFCNCzk6OWBiG6wDQRn9Gz0Gi_0 2024-09-12T01:11:24.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16577439526653775883', time=2024-09-12T03:01:00.656089+0000, chain.objs.size()=1 2024-09-12T01:11:24.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.0zhELqxI9xq9ROF_enyrR09UYEPcIpj_0 2024-09-12T01:11:24.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7971177010349041866', time=2024-09-12T03:01:00.676558+0000, chain.objs.size()=1 2024-09-12T01:11:24.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tLSxvnh4oLLKnl7snsJr_BVy5k-sa9X_0 2024-09-12T01:11:24.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1611963881176091056', time=2024-09-12T03:01:00.702263+0000, chain.objs.size()=1 2024-09-12T01:11:24.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wD2kWmiAArO37V2q-OI7o1ZvbaV46gR_0 2024-09-12T01:11:24.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3763544086948478612', time=2024-09-12T03:01:00.742083+0000, chain.objs.size()=1 2024-09-12T01:11:24.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZBDs8esucHPNRA4erkNkSFOn_zfERlm_0 2024-09-12T01:11:24.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.279158471613609536', time=2024-09-12T03:01:00.750469+0000, chain.objs.size()=1 2024-09-12T01:11:24.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.579+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.YEc1MHzUjdc88tiRRMUkyMrzGMTaduP_0 2024-09-12T01:11:24.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.580+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9053368709005993438', time=2024-09-12T03:01:00.771050+0000, chain.objs.size()=1 2024-09-12T01:11:24.579 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.580+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.RGIJ4N2L5CBjA4Ephr85Sc2ejbd5KQd_0 2024-09-12T01:11:24.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16763539938074233138', time=2024-09-12T03:01:00.932353+0000, chain.objs.size()=1 2024-09-12T01:11:24.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.zK6W6JwTYmXASIRgp_iS7U0wcaYYfSm_0 2024-09-12T01:11:24.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5768722435089457533', time=2024-09-12T03:01:16.657684+0000, chain.objs.size()=1 2024-09-12T01:11:24.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.eMeyyuu-VSdEZAnTaxmbIIo5LnTgTP3_0 2024-09-12T01:11:24.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9188969206298259426', time=2024-09-12T03:01:29.973879+0000, chain.objs.size()=1 2024-09-12T01:11:24.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.322__shadow_.8H4zra_DtdniInddtzU4EEmMAjDw7bQ_0 2024-09-12T01:11:24.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7453574238300209539', time=2024-09-12T03:01:40.240009+0000, chain.objs.size()=1 2024-09-12T01:11:24.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PueZOlzjZb8fHLb-lAg1dTEhxAEx_VI_0 2024-09-12T01:11:24.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11571442422302541670', time=2024-09-12T03:01:40.269837+0000, chain.objs.size()=1 2024-09-12T01:11:24.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.582+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.oNnpAVaVaG68m36YrHIlqkUQ5UutjA4_0 2024-09-12T01:11:24.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.584+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1094269638492946841', time=2024-09-12T03:01:40.402482+0000, chain.objs.size()=1 2024-09-12T01:11:24.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.584+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.y-VktbrIXeYGzEQ9_AtAbz8flpxrJl4_0 2024-09-12T01:11:24.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.584+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4475652050316217930', time=2024-09-12T03:01:40.446596+0000, chain.objs.size()=1 2024-09-12T01:11:24.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.584+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3vbLn7Khb5mTOA4G1ef_GhG_ICbleP__0 2024-09-12T01:11:24.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.584+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7058886077066855478', time=2024-09-12T03:01:40.456746+0000, chain.objs.size()=1 2024-09-12T01:11:24.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.584+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6nZ9S3wfYPnUROHnG5TXLg0vhMpGPHP_0 2024-09-12T01:11:24.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.586+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5453920068784853067', time=2024-09-12T03:01:40.528098+0000, chain.objs.size()=1 2024-09-12T01:11:24.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.586+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.rgaGKnZIRQHD9lNhXCil3n3iZ6vBBLi_0 2024-09-12T01:11:24.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.586+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1729364851150686551', time=2024-09-12T03:01:40.644118+0000, chain.objs.size()=1 2024-09-12T01:11:24.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.586+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.IoD8t6sGJckf89JrsVui34zJ6J8alts_0 2024-09-12T01:11:24.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.586+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18229835414628682690', time=2024-09-12T03:01:40.717266+0000, chain.objs.size()=1 2024-09-12T01:11:24.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.586+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.80tF3HB3tpDMq0XV63KVbz1IXrAxDVU_0 2024-09-12T01:11:24.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.587+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2396199257210516845', time=2024-09-12T03:01:40.746257+0000, chain.objs.size()=1 2024-09-12T01:11:24.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.587+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NkmFLaCRzm91it85wxHGy27LyEVzmHB_0 2024-09-12T01:11:24.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.587+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8802552063602639090', time=2024-09-12T03:01:40.802489+0000, chain.objs.size()=1 2024-09-12T01:11:24.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.587+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uA4vQhcKzHIYmePCRy8obr3GyeijZZ0_0 2024-09-12T01:11:24.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.588+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9080623872069440707', time=2024-09-12T03:01:40.823850+0000, chain.objs.size()=1 2024-09-12T01:11:24.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.588+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6oqtgcr48YfrLtbT3rJ4XTvsyp2KhpT_0 2024-09-12T01:11:24.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.588+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1016164535907456123', time=2024-09-12T03:01:40.918435+0000, chain.objs.size()=1 2024-09-12T01:11:24.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.588+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.KI5sg0UmXavMe7P0JsW-SIRI5z9tHsV_0 2024-09-12T01:11:24.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.589+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11589447252934142277', time=2024-09-12T03:01:41.005122+0000, chain.objs.size()=1 2024-09-12T01:11:24.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.589+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3n7ZOBSz6cqvDHgJRdpE8t79KNLZgK3_0 2024-09-12T01:11:24.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.589+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7829396842130331557', time=2024-09-12T03:01:41.020491+0000, chain.objs.size()=1 2024-09-12T01:11:24.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.589+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.e_YpW-G7juWb61JxSxJUm4ZrGxPQaR__0 2024-09-12T01:11:24.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.589+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8496486858726597888', time=2024-09-12T03:01:41.033148+0000, chain.objs.size()=1 2024-09-12T01:11:24.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.589+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8MdYi7s8qVye12kUzShG3HUZ_jF6hZS_0 2024-09-12T01:11:24.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7590195775420407060', time=2024-09-12T03:01:41.066585+0000, chain.objs.size()=1 2024-09-12T01:11:24.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.9D-dX8UvBT38CoEg9-yWZGZmK7rjG5C_0 2024-09-12T01:11:24.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8628959618255665', time=2024-09-12T03:01:41.190374+0000, chain.objs.size()=1 2024-09-12T01:11:24.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.b1uq3QbpZGyU8GYYVGCDR6L9cLN105f_0 2024-09-12T01:11:24.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.659877958449496825', time=2024-09-12T03:01:41.194503+0000, chain.objs.size()=1 2024-09-12T01:11:24.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.i1Z7KZJrjJIov6_qm32v86pBodfjDNE_0 2024-09-12T01:11:24.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12071831590934244387', time=2024-09-12T03:01:41.196465+0000, chain.objs.size()=1 2024-09-12T01:11:24.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WDebLSq8C7-rw9ucqkZ7xXQdTfUq7w9_0 2024-09-12T01:11:24.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16446458322163702674', time=2024-09-12T03:01:41.199617+0000, chain.objs.size()=1 2024-09-12T01:11:24.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PvwW59edKGY36Lv-8p7aSQGANklMoO4_0 2024-09-12T01:11:24.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16049612376097544748', time=2024-09-12T03:01:41.223826+0000, chain.objs.size()=1 2024-09-12T01:11:24.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.591+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.pwWJk519xFIJMQ-AHX5J-hQqIwKnBKK_0 2024-09-12T01:11:24.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.592+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15542173717250881884', time=2024-09-12T03:01:41.239673+0000, chain.objs.size()=1 2024-09-12T01:11:24.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.592+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.p1ivAXfxTT3WvAJiP_IwKlYJNlHaZT6_0 2024-09-12T01:11:24.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.592+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1354429568737789115', time=2024-09-12T03:01:41.281766+0000, chain.objs.size()=1 2024-09-12T01:11:24.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.592+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.uQyG9AkyRkTXfb9VOqzlYSWQHZjcFY8_0 2024-09-12T01:11:24.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.592+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15058624313009950084', time=2024-09-12T03:01:41.334908+0000, chain.objs.size()=1 2024-09-12T01:11:24.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.592+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.9gryqo2Eez5ctMj87kM8pr2S5ZqEN4P_0 2024-09-12T01:11:24.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14116210289939162745', time=2024-09-12T03:01:41.345711+0000, chain.objs.size()=1 2024-09-12T01:11:24.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yZbTDK7f-oHPqmofwVL-JYKYkvqaRgV_0 2024-09-12T01:11:24.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.594+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5267152821966181193', time=2024-09-12T03:01:41.480546+0000, chain.objs.size()=1 2024-09-12T01:11:24.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.594+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EjC-tgunvIAnpbOh7QDcfaS5nsNLu1y_0 2024-09-12T01:11:24.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.595+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12951290407703711777', time=2024-09-12T03:01:41.570242+0000, chain.objs.size()=1 2024-09-12T01:11:24.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.595+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.K434pwu12lNS_fRWvpSB7Bms8dgrqYj_0 2024-09-12T01:11:24.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.595+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10303727957634516660', time=2024-09-12T03:01:41.722230+0000, chain.objs.size()=1 2024-09-12T01:11:24.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.595+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.byE3bqC-PWQbB0Fvd9XR7jSL15QvrpQ_0 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12864241111760935459', time=2024-09-12T03:01:41.727196+0000, chain.objs.size()=1 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.s7ekIMfbY4E4eB3-lIo8ZbmHLAzwybf_0 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1669280794972700237', time=2024-09-12T03:01:41.779457+0000, chain.objs.size()=1 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.g4yx9Utk8JSHnrOaPA46WjpbqVpVfkj_0 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5723536240247493808', time=2024-09-12T03:01:41.986331+0000, chain.objs.size()=1 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._lLSt8UN32aL2nLGeexBuOQ58jgS1r-_0 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11584718106893759930', time=2024-09-12T03:01:42.024139+0000, chain.objs.size()=1 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FvnKJtoxU36fOWav8ZZYDzN0dEBjolm_0 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7378133754276952475', time=2024-09-12T03:01:50.228047+0000, chain.objs.size()=1 2024-09-12T01:11:24.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.WFRg1d2NjnhmBv51NsHil5uqT4dP9Xj_0 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8929676279968872707', time=2024-09-12T03:01:50.365326+0000, chain.objs.size()=1 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.noAzxXYIDJQHCPsS0Y2Q_BXfcwzvToC_0 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3938674711716764882', time=2024-09-12T03:01:50.391050+0000, chain.objs.size()=1 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7MjxECgOX7HkgkNTaDtWAkl3mPIosHc_0 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16356664741834370955', time=2024-09-12T03:01:50.541214+0000, chain.objs.size()=1 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.598+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.aFSu5ZwSWHGt5_Jm7kAbxBGZ7nhqfzs_0 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.600+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12220667975339333639', time=2024-09-12T03:01:50.582379+0000, chain.objs.size()=1 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.600+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GegZ33_DFbey6C5lbxbzl15Zln3Z5-I_0 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.600+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.361334245060531511', time=2024-09-12T03:01:50.614834+0000, chain.objs.size()=1 2024-09-12T01:11:24.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.600+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6aKYJxZQ0XDO0boZy0ZoQivPO3UewNS_0 2024-09-12T01:11:24.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.601+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5095922034398273224', time=2024-09-12T03:01:50.621808+0000, chain.objs.size()=1 2024-09-12T01:11:24.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.601+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LkxnL4qadGbq9Ix3s3iVtTjtbDHR8Ab_0 2024-09-12T01:11:24.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.605+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8069893188771070205', time=2024-09-12T03:01:50.634626+0000, chain.objs.size()=1 2024-09-12T01:11:24.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.605+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.g9e_FEJ8QhBzCygqz811R2pf9zJRSyd_0 2024-09-12T01:11:24.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.605+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4665731863828853943', time=2024-09-12T03:01:50.818644+0000, chain.objs.size()=1 2024-09-12T01:11:24.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.605+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rToKTiL8fXLELqyqzsP4Y0VwZxwU-AX_0 2024-09-12T01:11:24.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16815748841653024453', time=2024-09-12T03:01:50.825008+0000, chain.objs.size()=1 2024-09-12T01:11:24.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.X2jLKHftB3MlBkBdh3P8IR6bznZOWFf_0 2024-09-12T01:11:24.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15874486918215348396', time=2024-09-12T03:01:50.847708+0000, chain.objs.size()=1 2024-09-12T01:11:24.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.9qQ1dUarPWQG--giEv0opngNmNHZeUk_0 2024-09-12T01:11:24.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.829849400211687498', time=2024-09-12T03:01:50.857590+0000, chain.objs.size()=1 2024-09-12T01:11:24.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TufB2KJDOAx2ewc3Nj8CoAl8qJvhlzo_0 2024-09-12T01:11:24.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4279363546703516208', time=2024-09-12T03:01:50.945704+0000, chain.objs.size()=1 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.nnMObU3dDvO01rdzFeoSDKUQv67RiAf_0 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15794298733747811871', time=2024-09-12T03:01:51.168266+0000, chain.objs.size()=1 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.BdSwUpeQl3Hvrl9gGxW5rkZRSbMq7ni_0 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15538121828428412565', time=2024-09-12T03:01:51.366993+0000, chain.objs.size()=1 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rqfHjKLzGplBJadL0ULCXHvGrGzI8ra_0 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6902663661208281478', time=2024-09-12T03:01:51.456436+0000, chain.objs.size()=1 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4gzLZDyw3PiTwqm2rkaFadGAXh_UxuR_0 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6065315487916827185', time=2024-09-12T03:01:51.509995+0000, chain.objs.size()=1 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.XX5VjZEzGORjHoxhFy_e7xOvbDf_rwB_0 2024-09-12T01:11:24.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5518183068502109992', time=2024-09-12T03:01:51.538586+0000, chain.objs.size()=1 2024-09-12T01:11:24.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.606+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ocOGygBVMHQKuyUjjIvb1noqgu1lpSl_0 2024-09-12T01:11:24.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5817327225165268171', time=2024-09-12T03:01:51.646323+0000, chain.objs.size()=1 2024-09-12T01:11:24.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.q5F587GnhjXEcyn5yhFl03QAYrCl7-A_0 2024-09-12T01:11:24.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12555163623031806268', time=2024-09-12T03:01:51.779296+0000, chain.objs.size()=1 2024-09-12T01:11:24.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DXSriO1mvrzhStgxG7-9Bn1oSn7HgA5_0 2024-09-12T01:11:24.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18256807526394905488', time=2024-09-12T03:01:51.793341+0000, chain.objs.size()=1 2024-09-12T01:11:24.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.cl56Vm5QCct6kTXsBkdc3KJgoMPxRLK_0 2024-09-12T01:11:24.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.609+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17310158488548019708', time=2024-09-12T03:01:51.904730+0000, chain.objs.size()=1 2024-09-12T01:11:24.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.609+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.-e8eNaLWc3ba2h71trS13E0l69FsNCO_0 2024-09-12T01:11:24.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.610+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16347614393234709465', time=2024-09-12T03:01:51.950777+0000, chain.objs.size()=1 2024-09-12T01:11:24.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.610+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GBf7ZHdMHKCRskz4AUpCrGWpqbCbTHN_0 2024-09-12T01:11:24.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18431596430153591327', time=2024-09-12T03:01:51.953974+0000, chain.objs.size()=1 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.sT5CCj_CeM-vgR9FvvRoy--VlWt-SKA_0 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.605784608190577197', time=2024-09-12T03:01:52.025086+0000, chain.objs.size()=1 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MRGV3XDfk5u3eAYTiDNdfXYjMY9BJVP_0 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1993805333918733131', time=2024-09-12T03:01:52.033287+0000, chain.objs.size()=1 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4zj7yem_ToSexWd12e2ECQTLpENWQ87_0 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17580030438052131820', time=2024-09-12T03:01:52.069135+0000, chain.objs.size()=1 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.iuFJZJZAwKnlFUdGFixhgT_KLx5sz4d_0 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3227783193538193279', time=2024-09-12T03:01:52.076685+0000, chain.objs.size()=1 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.SSstzQSWLBaLn6RW4pLMi5DwHjLjbPo_0 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16560637880396062522', time=2024-09-12T03:01:52.082916+0000, chain.objs.size()=1 2024-09-12T01:11:24.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.611+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.eHY9VlO0XYQMKXkK7e25HFe5OZKNfbv_0 2024-09-12T01:11:24.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.613+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5558261083473736870', time=2024-09-12T03:01:52.175013+0000, chain.objs.size()=1 2024-09-12T01:11:24.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.613+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qNRaHKPQ-PlLnwSLwb9j3rLuf2-SSZE_0 2024-09-12T01:11:24.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.616+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/68710 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12506777016854536783', time=2024-09-12T03:01:52.175723+0000, chain.objs.size()=1 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.pMk6SRCdmvDhRj8i9mpTAd5l6ScyGoW_0 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14832423889770709066', time=2024-09-12T03:02:16.291790+0000, chain.objs.size()=1 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.378__shadow_.1fuNUetxagmhUoGdZdFcmphkRbP5FyY_0 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14562764186326402368', time=2024-09-12T03:02:54.362495+0000, chain.objs.size()=1 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.451__shadow_.qrwIoEGqv-uWMSall-MK9i-1Meih02O_0 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5403741248924411166', time=2024-09-12T03:03:10.085705+0000, chain.objs.size()=1 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.mmsDo50yLpSZfJtBDqNbytsrUrRu2om_0 2024-09-12T01:11:24.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6359945710297534024', time=2024-09-12T03:03:11.732590+0000, chain.objs.size()=1 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.487__shadow_.yyhwpghiqqs7bJeF8HLCmWKok2uvJ3G_0 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6658706130104728827', time=2024-09-12T03:03:15.741694+0000, chain.objs.size()=1 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.496__shadow_.40cYCyNdyMdMu9bz8xDjoxOJVo72FM-_0 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3114373658100814700', time=2024-09-12T03:03:19.459494+0000, chain.objs.size()=1 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.504__shadow:Sxqts83E9ch0mXuzA3cUygir9GtCc0q_.GJXGml4UggGV5JB-2HNawTbAzqH1P1u_0 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8956508190020520947', time=2024-09-12T03:03:27.464788+0000, chain.objs.size()=1 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.518__shadow_.mAYD9ZAeOcaJqhtNehltlCFHcWbeonL_0 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17380702113188016484', time=2024-09-12T03:03:37.357669+0000, chain.objs.size()=6 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~U5ZmD4eyUESItbKutlfdDr19tv4-4tc.1 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.PeqYWJlY2rsBOwCWkC2JEvUiqYGN1ph0.2 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~U5ZmD4eyUESItbKutlfdDr19tv4-4tc.3 2024-09-12T01:11:24.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.619+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~U5ZmD4eyUESItbKutlfdDr19tv4-4tc.4 2024-09-12T01:11:24.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.623+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~U5ZmD4eyUESItbKutlfdDr19tv4-4tc.5 2024-09-12T01:11:24.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.623+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~U5ZmD4eyUESItbKutlfdDr19tv4-4tc.6 2024-09-12T01:11:24.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.623+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4580386328173074617', time=2024-09-12T03:03:41.551170+0000, chain.objs.size()=6 2024-09-12T01:11:24.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.623+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~MvWzRhnaSGay4sHPUq690PrGuH4udAb.1 2024-09-12T01:11:24.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.623+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.wXBzMydM0Z7lVgHFFAZs-pnfT1tqZ8YD.2 2024-09-12T01:11:24.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.623+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.EVXDvpBOMHEPHi34csRHH61d6K5Qc3jY.3 2024-09-12T01:11:24.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.623+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~MvWzRhnaSGay4sHPUq690PrGuH4udAb.4 2024-09-12T01:11:24.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.623+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~MvWzRhnaSGay4sHPUq690PrGuH4udAb.5 2024-09-12T01:11:24.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.623+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.2~MvWzRhnaSGay4sHPUq690PrGuH4udAb.6 2024-09-12T01:11:24.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.625+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12579312639292349018', time=2024-09-12T03:04:45.771645+0000, chain.objs.size()=1 2024-09-12T01:11:24.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.625+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:fDZxFBxCMk2limt13IkaE0j0YKMA9E._.MwvKTlOUw6Iab4iJaTwWYcDP5YoiBOV_0 2024-09-12T01:11:24.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.625+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17280333738112384941', time=2024-09-12T03:04:54.587796+0000, chain.objs.size()=1 2024-09-12T01:11:24.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.625+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:pHK.rbY15s3zDNBEfWFI1nSHON0AVBD_.Z49zB4XgI-FDxu_YQtI6O382DqSdz26_0 2024-09-12T01:11:24.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.625+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17256509196285304579', time=2024-09-12T03:05:02.706367+0000, chain.objs.size()=1 2024-09-12T01:11:24.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.625+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:hXsUUuOOnZaqYVvVmWeymWXa42STaI6_.sa0mQ0OjdYT2ilNWILsiejBqJRxzIV3_0 2024-09-12T01:11:24.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.628+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9575326889001353905', time=2024-09-12T03:05:08.614874+0000, chain.objs.size()=1 2024-09-12T01:11:24.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.628+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:ohqiUS9JaTSJVTzvpuT1OiIhN6ar6Om_.nqFf4anay_V-BMUvtZ8BfCeIponcdAF_0 2024-09-12T01:11:24.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.628+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15086253725272359375', time=2024-09-12T03:05:12.878470+0000, chain.objs.size()=1 2024-09-12T01:11:24.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.628+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:pbIQQ6KYXi8X2zha3BQm2o8GLVUPOL._.Auem8rcCGT7gQLZeMMqkZAZw3k-UqDu_0 2024-09-12T01:11:24.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7720509798764709523', time=2024-09-12T03:05:12.916360+0000, chain.objs.size()=1 2024-09-12T01:11:24.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.580__shadow:tDylobnfzg3zk8j6EtKFl1XsVsevZCS_.4dwF7z0lU4lVaGgljUKkYoARbGmbbR-_0 2024-09-12T01:11:24.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3446611831841937945', time=2024-09-12T03:05:24.271617+0000, chain.objs.size()=1 2024-09-12T01:11:24.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.603__shadow_.Zw8kkXTyFPJGDcoUQew-BZifuOQVq6y_0 2024-09-12T01:11:24.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.948285310784646795', time=2024-09-12T03:07:38.170278+0000, chain.objs.size()=1 2024-09-12T01:11:24.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.620__shadow_.dGjT2ra9TGJLGSwE2iwYfQHQoIuhU3__0 2024-09-12T01:11:24.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6598503804634277638', time=2024-09-12T03:07:44.657400+0000, chain.objs.size()=1 2024-09-12T01:11:24.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.630__shadow_.cDPcKEUNW6VHf5RC2yly4zVah2b-ain_0 2024-09-12T01:11:24.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3311947569584731326', time=2024-09-12T03:07:51.455723+0000, chain.objs.size()=1 2024-09-12T01:11:24.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.645__shadow_.WR5uvZwR6csoLXgb1-uikkEEhzKBhoX_0 2024-09-12T01:11:24.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9289601876402192551', time=2024-09-12T03:08:08.762228+0000, chain.objs.size()=1 2024-09-12T01:11:24.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.629+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.680__shadow_.3pfltNg7ZAILOsDDoHLzN39eLy9xf0m_0 2024-09-12T01:11:24.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.634+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.637+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:11:24.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.639+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.639+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45020' 2024-09-12T01:11:24.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5980248105109755844', time=2024-09-12T02:58:54.398063+0000, chain.objs.size()=3 2024-09-12T01:11:24.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__multipart_foo-STANDARD.2~Grlml8W4vzaA9xspi_617TXM4I6JSqB.1 2024-09-12T01:11:24.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__multipart_foo-STANDARD.2~Grlml8W4vzaA9xspi_617TXM4I6JSqB.2 2024-09-12T01:11:24.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__multipart_foo-STANDARD.2~Grlml8W4vzaA9xspi_617TXM4I6JSqB.3 2024-09-12T01:11:24.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9192635483496853094', time=2024-09-12T02:58:54.882768+0000, chain.objs.size()=5 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__multipart_foo-LUKEWARM.2~BPy17S-LrdPbqd9WgKL0CNAva4JXXsj.1 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_foo-LUKEWARM.2~BPy17S-LrdPbqd9WgKL0CNAva4JXXsj.1_1 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__multipart_foo-LUKEWARM.2~BPy17S-LrdPbqd9WgKL0CNAva4JXXsj.2 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__shadow_foo-LUKEWARM.2~BPy17S-LrdPbqd9WgKL0CNAva4JXXsj.2_1 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ad4424e4-de7c-4376-b125-e717016a3484.4511.162__multipart_foo-LUKEWARM.2~BPy17S-LrdPbqd9WgKL0CNAva4JXXsj.3 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3330802745970739955', time=2024-09-12T02:59:09.913372+0000, chain.objs.size()=1 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.179__shadow_.3B54UDOLOnOl5Fi0gyhnkkqy5I11XLS_0 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4302495569026980877', time=2024-09-12T03:00:41.062607+0000, chain.objs.size()=1 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.243__shadow_.-F86E19Uzvy8kj3woh_DkbA4zhP1bbn_0 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4021511056303080075', time=2024-09-12T03:00:50.205184+0000, chain.objs.size()=1 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.261__shadow_.j3h4rr7CHgKSWZHvmJ95ow7WqJPEall_0 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6235283283223248664', time=2024-09-12T03:00:58.874191+0000, chain.objs.size()=1 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.640+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FrD7vzBeW7w0gvIgsH4RKEtcNX8MrTa_0 2024-09-12T01:11:24.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.643+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16112350757868110293', time=2024-09-12T03:00:58.878387+0000, chain.objs.size()=1 2024-09-12T01:11:24.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.643+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wWpJmICPmuCwJX_iyysXYQjk4Gc04Ac_0 2024-09-12T01:11:24.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.643+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5997259532096737769', time=2024-09-12T03:00:58.923490+0000, chain.objs.size()=1 2024-09-12T01:11:24.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.643+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.g9HNG---6TwGam-gY8JWFCAmOOeK3an_0 2024-09-12T01:11:24.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.643+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15200356390103499105', time=2024-09-12T03:00:58.953751+0000, chain.objs.size()=1 2024-09-12T01:11:24.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.643+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xg56OelkZDQqGpGmpbBatMsz4Q4EVdc_0 2024-09-12T01:11:24.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.514725385584199986', time=2024-09-12T03:00:59.039077+0000, chain.objs.size()=1 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qGDN-AQRQLRwQ6SkBLbmzsJKONlNNvU_0 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.842839608977669850', time=2024-09-12T03:00:59.230925+0000, chain.objs.size()=1 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.tsSFnYITo30lPR0Oy-HYOW0pRDNOz1Z_0 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14310749978705346728', time=2024-09-12T03:00:59.263190+0000, chain.objs.size()=1 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Kx8kf-aR13UF7TpScCNiMLg8bnzKyfQ_0 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3993170190025527378', time=2024-09-12T03:00:59.271918+0000, chain.objs.size()=1 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dsKBE1axNEd6PXjiSKmeNIcyYV5CZiO_0 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5943955590119388641', time=2024-09-12T03:00:59.424323+0000, chain.objs.size()=1 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.woXLeU7-NM0Uw_AuSwVtMriTXke9Sez_0 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.802594430423280999', time=2024-09-12T03:00:59.432987+0000, chain.objs.size()=1 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.TVqElE1RT2AqSSom8P6kS8OaIGqQSqV_0 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7731554492380198407', time=2024-09-12T03:00:59.478155+0000, chain.objs.size()=1 2024-09-12T01:11:24.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.L8p51MCdYzznSqPd5Tgzin3zHhDNT51_0 2024-09-12T01:11:24.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12647363638681392910', time=2024-09-12T03:00:59.756613+0000, chain.objs.size()=1 2024-09-12T01:11:24.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.644+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vrsDLFBHZ_meV94x1IwuHI81BYlFF8u_0 2024-09-12T01:11:24.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.647+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1898215630538897409', time=2024-09-12T03:00:59.757716+0000, chain.objs.size()=1 2024-09-12T01:11:24.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.647+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.o-dxTOBJIGrej9DXcLlpdD8stLP8KC5_0 2024-09-12T01:11:24.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.647+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11066548852142898480', time=2024-09-12T03:00:59.790765+0000, chain.objs.size()=1 2024-09-12T01:11:24.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.647+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wMuQmS0sJR8rTEFkOfTJ76ESBH-xr9S_0 2024-09-12T01:11:24.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.648+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16570561855802559813', time=2024-09-12T03:00:59.995928+0000, chain.objs.size()=1 2024-09-12T01:11:24.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.648+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ClsPdh1M38_BAB6ItDfc5x932e4h9oD_0 2024-09-12T01:11:24.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2527349734128813679', time=2024-09-12T03:01:00.003146+0000, chain.objs.size()=1 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.m32td5Lmhso_bhHWpFEUSopJU0hPZLD_0 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10741174306747512332', time=2024-09-12T03:01:00.017819+0000, chain.objs.size()=1 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.QjWC6KYy03y3BavsIn_kwZUfg1dz-uL_0 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9980600234588216210', time=2024-09-12T03:01:00.361715+0000, chain.objs.size()=1 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mUcLzZXJvh_BCmbkjWh55hIk6lLqPys_0 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11432822215100604413', time=2024-09-12T03:01:00.394118+0000, chain.objs.size()=1 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.4u7Pu1J_zkLG7uw3hmXJuGsqVRcy01d_0 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3073546957898707561', time=2024-09-12T03:01:00.417340+0000, chain.objs.size()=1 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wsPE-Yo7JvbC5OTSgCWqL-_8rx13Ja6_0 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16719127320140483591', time=2024-09-12T03:01:00.454334+0000, chain.objs.size()=1 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.99LrrjS-9hJnv0tKO9cxQJIw9tTKMC3_0 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1004494962610119687', time=2024-09-12T03:01:00.476896+0000, chain.objs.size()=1 2024-09-12T01:11:24.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.k8ifvBCrOMN98gYUfvNxWP1k5rkbQn__0 2024-09-12T01:11:24.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5274631550276736492', time=2024-09-12T03:01:00.589215+0000, chain.objs.size()=1 2024-09-12T01:11:24.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.650+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vUIpm0povbJWR0P6NZHKfoGHqUfQerU_0 2024-09-12T01:11:24.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.652+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17371224878005789489', time=2024-09-12T03:01:00.604219+0000, chain.objs.size()=1 2024-09-12T01:11:24.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.652+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lNozWTQUkwzj45AswKcZk5am7QptxHt_0 2024-09-12T01:11:24.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.652+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4900117096347626648', time=2024-09-12T03:01:00.654207+0000, chain.objs.size()=1 2024-09-12T01:11:24.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.652+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.xmOoFQ0WDfdj7Yfy5cTRSQTDyR8DKpZ_0 2024-09-12T01:11:24.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11834178337323404123', time=2024-09-12T03:01:00.683964+0000, chain.objs.size()=1 2024-09-12T01:11:24.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.HiVYS36pGITNbSHR5UD4vPKBwssy-r0_0 2024-09-12T01:11:24.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14390947264279803067', time=2024-09-12T03:01:00.699917+0000, chain.objs.size()=1 2024-09-12T01:11:24.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.IUinuD9LS_jSCCDQBnBJXmIIwqsjuUk_0 2024-09-12T01:11:24.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11274807330006304090', time=2024-09-12T03:01:00.715134+0000, chain.objs.size()=1 2024-09-12T01:11:24.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.M_RjWEErpoqNzjH6BxEKKgxx5Y4zLxY_0 2024-09-12T01:11:24.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17817044569758103430', time=2024-09-12T03:01:00.728195+0000, chain.objs.size()=1 2024-09-12T01:11:24.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5J6qUSuBqlhBj5fepqpsTtvKSVNt_sK_0 2024-09-12T01:11:24.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10258976685321813566', time=2024-09-12T03:01:00.884477+0000, chain.objs.size()=1 2024-09-12T01:11:24.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.twMjqQOU8Z-AgzlwEwDacnMr0sSqk4T_0 2024-09-12T01:11:24.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10246193366749473234', time=2024-09-12T03:01:00.886312+0000, chain.objs.size()=1 2024-09-12T01:11:24.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.653+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5KG0Pvs2lP3r4vRgV7wu-8PeVKq7Gl8_0 2024-09-12T01:11:24.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.655+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2553494186335413947', time=2024-09-12T03:01:00.902374+0000, chain.objs.size()=1 2024-09-12T01:11:24.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.655+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Bp8eTE_UR-sP_WccZOayVUwnlbSd11X_0 2024-09-12T01:11:24.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.655+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13487573470144161772', time=2024-09-12T03:01:00.951600+0000, chain.objs.size()=1 2024-09-12T01:11:24.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.655+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ccM7iUt6XS7JLJXuzImbrrwt8t0pw33_0 2024-09-12T01:11:24.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.655+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8300622999706022351', time=2024-09-12T03:01:00.969469+0000, chain.objs.size()=1 2024-09-12T01:11:24.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.655+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ZkFUSpq7VfSLc4ByJtNtZzuvkJpVboC_0 2024-09-12T01:11:24.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.660+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10774764441527663523', time=2024-09-12T03:01:04.207099+0000, chain.objs.size()=1 2024-09-12T01:11:24.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.660+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.270__shadow_.8Mvj7d0P4ZuBw1VybvbcmZ1OLsJvLVV_0 2024-09-12T01:11:24.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.660+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12559309877319181313', time=2024-09-12T03:01:05.163148+0000, chain.objs.size()=1 2024-09-12T01:11:24.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.660+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.272__shadow_.Exu7euMJYB4RC-4W3-dyK6OKuBjppXs_0 2024-09-12T01:11:24.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.660+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12822404766368300405', time=2024-09-12T03:01:13.390654+0000, chain.objs.size()=1 2024-09-12T01:11:24.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.660+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.289__shadow_.z2BMt-It-9c-koh36HSkrbj2Z_cwwmm_0 2024-09-12T01:11:24.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.661+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2369778647183163042', time=2024-09-12T03:01:14.315448+0000, chain.objs.size()=1 2024-09-12T01:11:24.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.661+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.291__shadow_.2Ctk2lyh-2A3UtsfsswUb-MDHq4nmtO_0 2024-09-12T01:11:24.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.661+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8473474862350985454', time=2024-09-12T03:01:15.858292+0000, chain.objs.size()=1 2024-09-12T01:11:24.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.661+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.JITyGfvtKYexSb3Vhq17ku05LqQQP-U_0 2024-09-12T01:11:24.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.661+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10239785193184827901', time=2024-09-12T03:01:16.639248+0000, chain.objs.size()=1 2024-09-12T01:11:24.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.661+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.WAvYHI_GatYUZmFdkGfmrgX1nr1EE68_0 2024-09-12T01:11:24.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12934312125238721454', time=2024-09-12T03:01:16.652707+0000, chain.objs.size()=1 2024-09-12T01:11:24.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.Fk78CCT1K0cSBWkfUIzV2n-drMaueiI_0 2024-09-12T01:11:24.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15415473539881613094', time=2024-09-12T03:01:16.667569+0000, chain.objs.size()=1 2024-09-12T01:11:24.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.rjedTE-AilEBRf33XrTT5_ssJ4Tfuho_0 2024-09-12T01:11:24.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.319361984364209281', time=2024-09-12T03:01:21.060793+0000, chain.objs.size()=1 2024-09-12T01:11:24.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.303__shadow_.cL0GknQ2cpwM_JDSuEszadtoxvrUYnR_0 2024-09-12T01:11:24.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13684697493168160810', time=2024-09-12T03:01:30.585490+0000, chain.objs.size()=1 2024-09-12T01:11:24.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.323__shadow_.iLY_ANBOpeRdOlxU2GWXsfmugaIrBpR_0 2024-09-12T01:11:24.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12630864822200076150', time=2024-09-12T03:01:40.148779+0000, chain.objs.size()=1 2024-09-12T01:11:24.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.664+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.y4o2zJtkI7Pa_Qx-nuhMFSxIKcK4jPc_0 2024-09-12T01:11:24.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.665+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1269092245123758868', time=2024-09-12T03:01:40.200809+0000, chain.objs.size()=1 2024-09-12T01:11:24.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.665+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.EpwliSKLWWc7sC1-LmS83DKsl1lSZD-_0 2024-09-12T01:11:24.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9425808507844851854', time=2024-09-12T03:01:40.243341+0000, chain.objs.size()=1 2024-09-12T01:11:24.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ptdnU_UM0ULjnHpDIc0A3UpwZck_qz2_0 2024-09-12T01:11:24.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17885209047366084748', time=2024-09-12T03:01:40.283059+0000, chain.objs.size()=1 2024-09-12T01:11:24.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fyj2ZZJXzv01MhG-7o9-DH96ho5XXQ4_0 2024-09-12T01:11:24.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3810306686710574618', time=2024-09-12T03:01:40.381728+0000, chain.objs.size()=1 2024-09-12T01:11:24.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FLm7-dmM00zFGJf6ety9v4GEVLv8ukK_0 2024-09-12T01:11:24.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8111209991526577810', time=2024-09-12T03:01:40.387409+0000, chain.objs.size()=1 2024-09-12T01:11:24.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.L7pG7jdk67bI56pZKUTSgO1uAFQEqTw_0 2024-09-12T01:11:24.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.485366782334412470', time=2024-09-12T03:01:40.552260+0000, chain.objs.size()=1 2024-09-12T01:11:24.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.666+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.MpF9FmUekxpk5gIZ_zyAiYhCeTXvHxa_0 2024-09-12T01:11:24.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.669+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13445732406693031477', time=2024-09-12T03:01:40.671846+0000, chain.objs.size()=1 2024-09-12T01:11:24.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.669+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nLhD-hRAbTpcBtjDKFZFTxL-aKqb0vC_0 2024-09-12T01:11:24.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2103134959947731647', time=2024-09-12T03:01:40.675102+0000, chain.objs.size()=1 2024-09-12T01:11:24.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1mLl2Nc4iT1msQvW4sg-0FInsrwcn73_0 2024-09-12T01:11:24.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17154469447376990930', time=2024-09-12T03:01:40.715819+0000, chain.objs.size()=1 2024-09-12T01:11:24.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.bcgdyX9IBJnLLe-umm8eRGd-cPKqsKP_0 2024-09-12T01:11:24.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5000961982446308426', time=2024-09-12T03:01:40.729690+0000, chain.objs.size()=1 2024-09-12T01:11:24.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.oGQac_bZ48jvGVgt4nDy7z9Aqc3wwEl_0 2024-09-12T01:11:24.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9927846591749482397', time=2024-09-12T03:01:40.731356+0000, chain.objs.size()=1 2024-09-12T01:11:24.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8vOCOd1DOlIjzNt3k3Zs0CI7R5N-iD0_0 2024-09-12T01:11:24.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.377794780198773093', time=2024-09-12T03:01:40.768879+0000, chain.objs.size()=1 2024-09-12T01:11:24.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.670+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.jNT0m5Sv4czRDWIFYkHA6CVDQQigCtL_0 2024-09-12T01:11:24.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.671+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8975371561268275030', time=2024-09-12T03:01:40.910737+0000, chain.objs.size()=1 2024-09-12T01:11:24.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.671+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.XhUvcq7ObY7CrPMCmdZNfyk7WXjq77G_0 2024-09-12T01:11:24.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.671+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3179592112982168538', time=2024-09-12T03:01:40.913027+0000, chain.objs.size()=1 2024-09-12T01:11:24.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.671+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yXGVT54fRLFeoyM8mdXfvKKI_iUduLf_0 2024-09-12T01:11:24.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.671+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10820312928286083772', time=2024-09-12T03:01:40.961644+0000, chain.objs.size()=1 2024-09-12T01:11:24.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.671+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lNcZNwUf67Autlb4FO_7QudB1hqzicr_0 2024-09-12T01:11:24.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.672+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17089906416076427663', time=2024-09-12T03:01:40.984819+0000, chain.objs.size()=1 2024-09-12T01:11:24.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.672+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qWDHdNoEscprb2CtCq17BLtBNYWyXnP_0 2024-09-12T01:11:24.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.672+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16953687556766172172', time=2024-09-12T03:01:41.031921+0000, chain.objs.size()=1 2024-09-12T01:11:24.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.672+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5_AglzJJFCBzBiM7IP76QJ-nupWx1me_0 2024-09-12T01:11:24.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.674+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10068194527490972580', time=2024-09-12T03:01:41.045732+0000, chain.objs.size()=1 2024-09-12T01:11:24.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.674+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wSzuAiM-DW_ZhQqDfQV3ejtFRnc_66v_0 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12785268659512433059', time=2024-09-12T03:01:41.053096+0000, chain.objs.size()=1 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.LRr6wPuZrkuZMqc7pdCUq5DalsI8-uB_0 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11063344089971674942', time=2024-09-12T03:01:41.058737+0000, chain.objs.size()=1 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Qoa_Ir6WqAZjOQiZt-g4J3AbaZEhVKw_0 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3254447761764525141', time=2024-09-12T03:01:41.062611+0000, chain.objs.size()=1 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nO25M1ynvnedGvgUZRVxwSXYR2ULlbi_0 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10600815294198685575', time=2024-09-12T03:01:41.222422+0000, chain.objs.size()=1 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.UY_cGMR8RyNEoagSgWa4lLg-rX-TiYu_0 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3681032171698116294', time=2024-09-12T03:01:41.261551+0000, chain.objs.size()=1 2024-09-12T01:11:24.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.S1RUJXd3mXu2-_4lxERgPKtJZVgxjbn_0 2024-09-12T01:11:24.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17803257730666510333', time=2024-09-12T03:01:41.266062+0000, chain.objs.size()=1 2024-09-12T01:11:24.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.676+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.5G1l6DiEdgkEaIoX3FFIvntp05A3Tk0_0 2024-09-12T01:11:24.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17546211654603732007', time=2024-09-12T03:01:41.276510+0000, chain.objs.size()=1 2024-09-12T01:11:24.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QH9NtV1iH1lcDymPEdex92SphLh_KVY_0 2024-09-12T01:11:24.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17685574832537427286', time=2024-09-12T03:01:41.439018+0000, chain.objs.size()=1 2024-09-12T01:11:24.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fu3sFZCdH7yg8iPSpldwtC_vURMoUX1_0 2024-09-12T01:11:24.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16646134456201185890', time=2024-09-12T03:01:41.491134+0000, chain.objs.size()=1 2024-09-12T01:11:24.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3rXMycvWyqV5FUO3X6iKzDzzVlQdOy5_0 2024-09-12T01:11:24.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11829466150094115923', time=2024-09-12T03:01:41.603055+0000, chain.objs.size()=1 2024-09-12T01:11:24.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.7kBZzyLahGPztjx9pkTw05D2O-Ehp7Q_0 2024-09-12T01:11:24.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12468132258717829306', time=2024-09-12T03:01:41.621833+0000, chain.objs.size()=1 2024-09-12T01:11:24.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kPU2PAuVzcXPyEh6-HR-JuaEdAhNVdA_0 2024-09-12T01:11:24.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.537891692752396800', time=2024-09-12T03:01:41.702586+0000, chain.objs.size()=1 2024-09-12T01:11:24.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.679+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.mfWraYts8m64f2c7Ff7zXZvCdacd4v8_0 2024-09-12T01:11:24.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1582028049132007605', time=2024-09-12T03:01:41.710631+0000, chain.objs.size()=1 2024-09-12T01:11:24.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.iMhsjCeZn8_0KZXwgNgg4k_iE99R3XW_0 2024-09-12T01:11:24.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.592816005426652478', time=2024-09-12T03:01:41.755627+0000, chain.objs.size()=1 2024-09-12T01:11:24.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3ASQfc8JEm-FXbG83-E3NuF5cQPyvH8_0 2024-09-12T01:11:24.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2437419098173087853', time=2024-09-12T03:01:41.839119+0000, chain.objs.size()=1 2024-09-12T01:11:24.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dKtDCo7sVThzNhwFtgW9l4BwgBYacly_0 2024-09-12T01:11:24.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17660950449871592556', time=2024-09-12T03:01:42.016680+0000, chain.objs.size()=1 2024-09-12T01:11:24.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kZYLmNaZ7hg6LSreKaayGFxC_eG8S0i_0 2024-09-12T01:11:24.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7092127693998472493', time=2024-09-12T03:01:42.020692+0000, chain.objs.size()=1 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Wi4HUyeObiBDaIZ9N1k19XlXD1mod1G_0 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4961234828246209947', time=2024-09-12T03:01:42.054303+0000, chain.objs.size()=1 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.1tUt4L_NtBRVa0w_7szOusjW42NHnAc_0 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1437816337017745897', time=2024-09-12T03:01:42.058484+0000, chain.objs.size()=1 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yEV2osIahjUPZlI2UHQOoqXCPbRZvT7_0 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16918116591190561122', time=2024-09-12T03:01:42.099623+0000, chain.objs.size()=1 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zi_PZOJpoKNx-Jd32P-FzzoVygq9Zri_0 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9768266702814954770', time=2024-09-12T03:01:50.262219+0000, chain.objs.size()=1 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TrOdwl-B1q6k_9uzegG3os9fyLlYOVo_0 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14004868277743031182', time=2024-09-12T03:01:50.309757+0000, chain.objs.size()=1 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.0nGTL-1ejDUIKXKPXdq2L6Zd0S2Al7O_0 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1253449319243036582', time=2024-09-12T03:01:50.310611+0000, chain.objs.size()=1 2024-09-12T01:11:24.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.683+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tIjcUWpF1cTCdGogQGDawQy0D_bxiG7_0 2024-09-12T01:11:24.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.687+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16256570310506542710', time=2024-09-12T03:01:50.324363+0000, chain.objs.size()=1 2024-09-12T01:11:24.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.687+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kHX3-O1_Xc3YIRed7HWcsd4YZStz8TU_0 2024-09-12T01:11:24.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.131713347524580817', time=2024-09-12T03:01:50.335571+0000, chain.objs.size()=1 2024-09-12T01:11:24.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.V-3hqjroVBXPXdHWPZfoVQVRoihAjJn_0 2024-09-12T01:11:24.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8511518618863365480', time=2024-09-12T03:01:50.340024+0000, chain.objs.size()=1 2024-09-12T01:11:24.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.49Emo9EZkxV4NMDZRHrf9_K3hjzKq22_0 2024-09-12T01:11:24.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2719965075656452609', time=2024-09-12T03:01:50.405750+0000, chain.objs.size()=1 2024-09-12T01:11:24.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.BSj6hkXqWnwGS6ScDj-b2n3iBBCjHkI_0 2024-09-12T01:11:24.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11195449180233907919', time=2024-09-12T03:01:50.564484+0000, chain.objs.size()=1 2024-09-12T01:11:24.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GfYK6_rlCyWpTYjhE6hG8gnno44-K_y_0 2024-09-12T01:11:24.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4511134075013067532', time=2024-09-12T03:01:50.572963+0000, chain.objs.size()=1 2024-09-12T01:11:24.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.PEgimQYijAzQ4BIehyrRqjshgZWDU0c_0 2024-09-12T01:11:24.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17915434856396353595', time=2024-09-12T03:01:50.573736+0000, chain.objs.size()=1 2024-09-12T01:11:24.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.688+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TKhZxiG2ZB1ZVOoGSuA9CCp9-P1WVgC_0 2024-09-12T01:11:24.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.690+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13626258181817222596', time=2024-09-12T03:01:50.651921+0000, chain.objs.size()=1 2024-09-12T01:11:24.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.690+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.V0Zvy-4IaL2KnddBkKIpFhYMeVhiO1q_0 2024-09-12T01:11:24.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.690+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5542615627837480950', time=2024-09-12T03:01:50.689211+0000, chain.objs.size()=1 2024-09-12T01:11:24.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.690+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.BSInovuwXwZezzcwuwb_E79wnhpDBJ4_0 2024-09-12T01:11:24.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.694+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/45020 2024-09-12T01:11:24.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T01:11:24.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2266404901058368105', time=2024-09-12T03:01:50.705941+0000, chain.objs.size()=1 2024-09-12T01:11:24.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.2oBZOU2dUNxJfCn7ZNz-F90aAPmAuRe_0 2024-09-12T01:11:24.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15939288858941324719', time=2024-09-12T03:01:50.999792+0000, chain.objs.size()=1 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ErmyorMmW8wm9QAupXwTwqR3oiFx096_0 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.396404312597964864', time=2024-09-12T03:01:51.088764+0000, chain.objs.size()=1 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.S8ndtbBryxcfXRxLduPoGsnA8dDvNAB_0 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13070791029673831621', time=2024-09-12T03:01:51.100614+0000, chain.objs.size()=1 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Gy5fg8g1LEg7hLEL8OO3uJ5fzorAo9W_0 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9164592314469631134', time=2024-09-12T03:01:51.211878+0000, chain.objs.size()=1 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.sC1mH0QSZpSRbKGnIiZ-YzaY1B5Gsmi_0 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14437194384475645506', time=2024-09-12T03:01:51.235822+0000, chain.objs.size()=1 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.2TSe4JVf692L6uChSkYqNbfXjmKQY8F_0 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8192895213592504642', time=2024-09-12T03:01:51.245942+0000, chain.objs.size()=1 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.U-RIWFanNtIchZuORSH1OUf7zfhoeHE_0 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.165830760238491163', time=2024-09-12T03:01:51.251642+0000, chain.objs.size()=1 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.z9LMJJqq4sNTrP9Ur7WYSRnrAHcscfb_0 2024-09-12T01:11:24.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1185165120632284161', time=2024-09-12T03:01:51.399589+0000, chain.objs.size()=1 2024-09-12T01:11:24.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ke8DMr4YDBNC_YIGYSUturziywu-R5l_0 2024-09-12T01:11:24.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.696+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12935460050130935298', time=2024-09-12T03:01:51.522940+0000, chain.objs.size()=1 2024-09-12T01:11:24.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.697+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tAA9dLLsNfJThT5AHEHrFcOocEsjzKz_0 2024-09-12T01:11:24.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.697+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9344273821265696222', time=2024-09-12T03:01:51.541550+0000, chain.objs.size()=1 2024-09-12T01:11:24.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.697+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Kl424w2dutEvohBJzFpRVD3waLL3L6R_0 2024-09-12T01:11:24.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.697+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1757041306558036066', time=2024-09-12T03:01:51.651533+0000, chain.objs.size()=1 2024-09-12T01:11:24.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.697+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IE4hnm0p5_FaJxx7k1vkV8hNe_X40z8_0 2024-09-12T01:11:24.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.700+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15239849559096723257', time=2024-09-12T03:01:51.916288+0000, chain.objs.size()=1 2024-09-12T01:11:24.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.700+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.f2sIxggfe9VWn4KaaDTgBA3QWszbfhW_0 2024-09-12T01:11:24.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.700+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16863251223108739388', time=2024-09-12T03:01:51.918609+0000, chain.objs.size()=1 2024-09-12T01:11:24.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.700+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.x1S5r8koISn4obbPD-nzHprBYcgSkdp_0 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3502368090486753953', time=2024-09-12T03:01:51.921253+0000, chain.objs.size()=1 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TZBW-I9q9yLK1qVS-h0WmkmOkdS8NAL_0 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11202871409955028435', time=2024-09-12T03:01:51.934333+0000, chain.objs.size()=1 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rCOH1mrTAr29iJnq7UBiOjqGaHocWvU_0 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2011285448584615012', time=2024-09-12T03:01:52.022844+0000, chain.objs.size()=1 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.4GT-LJliQD1LeeGCw8KXmuWTpPWrpoS_0 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4139621551837378570', time=2024-09-12T03:01:52.199357+0000, chain.objs.size()=1 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.b5wpyKt1RbayqMUzAVvQHstaIJrGMO7_0 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7794434609180661952', time=2024-09-12T03:01:52.219449+0000, chain.objs.size()=1 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.AB5zaqI7_DjLnMCDFu5j0J6wARuRBKn_0 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18168809037399370011', time=2024-09-12T03:01:52.291052+0000, chain.objs.size()=1 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.mDng7ji_-ULfne0J-ktpQSfsbs6iY7v_0 2024-09-12T01:11:24.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5146549020423286213', time=2024-09-12T03:02:01.315494+0000, chain.objs.size()=1 2024-09-12T01:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.345__shadow_.PByE3Ib9pZ-gHcrtqOc6fH_OO2-kCid_0 2024-09-12T01:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12776883720370668590', time=2024-09-12T03:02:43.722909+0000, chain.objs.size()=1 2024-09-12T01:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.431__shadow_.NoNb1uf5se1c-gYVXzV9hbjHoz7wpKO_0 2024-09-12T01:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17934237019586196272', time=2024-09-12T03:02:45.495230+0000, chain.objs.size()=1 2024-09-12T01:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.702+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.435__shadow_.O-nH6hhSVVP5Yor_rBj2RF5PhYtQ5lh_0 2024-09-12T01:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.703+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8092476447418726648', time=2024-09-12T03:03:10.084858+0000, chain.objs.size()=1 2024-09-12T01:11:24.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.703+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.jiszICc3oSZoWfCVEuxpQIsQmpAv1do_0 2024-09-12T01:11:24.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.704+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10988566702548343824', time=2024-09-12T03:03:10.614259+0000, chain.objs.size()=1 2024-09-12T01:11:24.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.704+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.485__shadow_.OmbM87P3HKlNqNnvtpde3W-kHPJlR5t_0 2024-09-12T01:11:24.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.705+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11377930572350740224', time=2024-09-12T03:03:43.856867+0000, chain.objs.size()=2 2024-09-12T01:11:24.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.705+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~duZcY-v7qy4afqtopdF7Dl1vQYIiDmv.1 2024-09-12T01:11:24.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~duZcY-v7qy4afqtopdF7Dl1vQYIiDmv.2 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13040584988385232639', time=2024-09-12T03:03:44.052956+0000, chain.objs.size()=3 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~FNa-o9jNJLDvfn5tQYDxUmxMO8VBiFN.1 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~FNa-o9jNJLDvfn5tQYDxUmxMO8VBiFN.2 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.524__multipart_mymultipart.2~FNa-o9jNJLDvfn5tQYDxUmxMO8VBiFN.3 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3989754236217254461', time=2024-09-12T03:03:45.571475+0000, chain.objs.size()=2 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~hxKDlBGY7o9u-kr75PNP1AYX7X6tUb8.1 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.526__multipart_mymultipart.2~hxKDlBGY7o9u-kr75PNP1AYX7X6tUb8.2 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2401951768821821324', time=2024-09-12T03:04:47.392946+0000, chain.objs.size()=1 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.571__shadow:Gau-POyCA2aJS7S35JA2970wDv6YNZU_.lsu4fU_0fyok8BtXR28e25tW3E6JGqZ_0 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14127114721710047581', time=2024-09-12T03:04:55.960118+0000, chain.objs.size()=1 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:qLo7COyGrNXkcf2d79haJnxasdQ4TcR_.vfVx1V3Met_r5feWwz7VZvVqmSvWtrv_0 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12528401523924884152', time=2024-09-12T03:07:37.757397+0000, chain.objs.size()=1 2024-09-12T01:11:24.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.707+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.619__shadow_.jOrBuV25yHcj8FpUJ4wDuRzGtqxKIEQ_0 2024-09-12T01:11:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.710+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12981203611535521967', time=2024-09-12T03:08:02.934351+0000, chain.objs.size()=1 2024-09-12T01:11:24.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.710+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.666__shadow_.6I0YNMLbh-Zr_3Nhtrt9lCKsj2BH4Ig_0 2024-09-12T01:11:24.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.714+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.717+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:11:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.718+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/59535' 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.976294130542139826', time=2024-09-12T02:59:11.611386+0000, chain.objs.size()=1 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.183__shadow_.P0K-4Up11r36JjuFa705mzTjH6Reros_0 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3453111246258346695', time=2024-09-12T03:00:34.738258+0000, chain.objs.size()=1 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.231__shadow_.ah8KsaCy7z8-T82HjkO_SxakcAEJF8z_0 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6441529525244552937', time=2024-09-12T03:00:38.435465+0000, chain.objs.size()=1 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.238__shadow_.pCmYyMa1-Dlo--jQ9mTblAiTeKI097D_0 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17003819878946805717', time=2024-09-12T03:00:58.879765+0000, chain.objs.size()=1 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dZrUEP5eBKNzDABN9CHFYl1xxQqJfax_0 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2877341236133484889', time=2024-09-12T03:00:58.971060+0000, chain.objs.size()=1 2024-09-12T01:11:24.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.SVk9yaoqPDbX22nw95njLi_dg1dxxgt_0 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15518297491530399171', time=2024-09-12T03:00:59.015233+0000, chain.objs.size()=1 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.fzNQz9swa9F5vBHkMXMhMe2F4x_ugZv_0 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8868356872007730466', time=2024-09-12T03:00:59.035309+0000, chain.objs.size()=1 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.FGVOyOnXX0u_9od5vVoAeWiKTcFdod8_0 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18103591351323161541', time=2024-09-12T03:00:59.191418+0000, chain.objs.size()=1 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bWdq30rZQqjkciDssn7WAS6a2db_ZAO_0 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5303252291698326867', time=2024-09-12T03:00:59.303416+0000, chain.objs.size()=1 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.kmbSRkDWHiuDZb3StJ_ODn-zGw9_Xz7_0 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2253823438938624767', time=2024-09-12T03:00:59.306676+0000, chain.objs.size()=1 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.IHh808pY7Zmud52KzMyvkkXA-iyuiI9_0 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9701693778595301195', time=2024-09-12T03:00:59.691802+0000, chain.objs.size()=1 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.HhSATFfrBeFh1-cKx-cHK0ECjGvcZed_0 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.719+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1598725225935183875', time=2024-09-12T03:00:59.716449+0000, chain.objs.size()=1 2024-09-12T01:11:24.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.720+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.emJtRGnMPDHsYBxT9-VVWW7_pqGeduq_0 2024-09-12T01:11:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.723+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12439418644344131234', time=2024-09-12T03:00:59.734025+0000, chain.objs.size()=1 2024-09-12T01:11:24.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.723+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KvZA54YllU7JyvpOq23xe3AeEBZrpnn_0 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16605539814898046737', time=2024-09-12T03:00:59.798774+0000, chain.objs.size()=1 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Fh7jDSrU9dJjtVExaVHUEp9M2iW7A0e_0 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12344323576891185873', time=2024-09-12T03:00:59.841815+0000, chain.objs.size()=1 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-cLgAU49OqM7B1QLMLmzDdTBvrpJR3M_0 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7659631450889139393', time=2024-09-12T03:00:59.941078+0000, chain.objs.size()=1 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.sJiiHhKZBwwXuCxQYQnn9e50iuI7nt3_0 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17738062110157473244', time=2024-09-12T03:01:00.001649+0000, chain.objs.size()=1 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.wlMvtBToi5RZmaHSE5D0CShj53qF20Y_0 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16683177986460024859', time=2024-09-12T03:01:00.003366+0000, chain.objs.size()=1 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.vN4cjmS3PX_u1j-Ka3Ie7zsraaagNh__0 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3877035414235610602', time=2024-09-12T03:01:00.009218+0000, chain.objs.size()=1 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.bOdFGy-a6PJcKJ9uI2OCt5L2lYN8Dth_0 2024-09-12T01:11:24.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.725464926556119528', time=2024-09-12T03:01:00.033705+0000, chain.objs.size()=1 2024-09-12T01:11:24.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.uWXAxBd_j6OK4qljAsyyFl_jCm7flZ0_0 2024-09-12T01:11:24.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4408750590739728538', time=2024-09-12T03:01:00.048007+0000, chain.objs.size()=1 2024-09-12T01:11:24.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ORhNnxJK6ljX6mv8fsx25Dr5x6NZ3tS_0 2024-09-12T01:11:24.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10078993647987142749', time=2024-09-12T03:01:00.071111+0000, chain.objs.size()=1 2024-09-12T01:11:24.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.-7q9w38QN7cOdMKcHbKIQoe-l9gBjO9_0 2024-09-12T01:11:24.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6508523774020615553', time=2024-09-12T03:01:00.398337+0000, chain.objs.size()=1 2024-09-12T01:11:24.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.726+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.p6P-Ush3MXCtLl_I9uXn_3wtQc2HkaT_0 2024-09-12T01:11:24.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.729+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9536395196886602933', time=2024-09-12T03:01:00.466746+0000, chain.objs.size()=1 2024-09-12T01:11:24.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.729+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.WQ3vWHO1i-FTKRGA4OeR9c2IQSW5Bzj_0 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12955548151624604770', time=2024-09-12T03:01:00.654894+0000, chain.objs.size()=1 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.IHQ2D9OWTDjsUDwOcZfN5lKWWiZvywc_0 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1420582313018791904', time=2024-09-12T03:01:00.661231+0000, chain.objs.size()=1 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.0JiLheMj-N38xgA7cyo8MVycU9owgmD_0 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11816395770841222175', time=2024-09-12T03:01:00.732743+0000, chain.objs.size()=1 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.QApuTt5YMdvTpLQZU23zIj5UzrZDluP_0 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6283490298232617859', time=2024-09-12T03:01:00.936564+0000, chain.objs.size()=1 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LlWR28aBKDoXVBPWePbIPY5UHdyQZXo_0 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2240894738880617241', time=2024-09-12T03:01:00.963191+0000, chain.objs.size()=1 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.mQcP6Y5a43xmUFSmdQS_e1DF6zllctW_0 2024-09-12T01:11:24.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.285769818048629552', time=2024-09-12T03:01:00.981336+0000, chain.objs.size()=1 2024-09-12T01:11:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.dxIqiGsa90Te1ghOaUZ0PFokf2td57y_0 2024-09-12T01:11:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8336741702452208287', time=2024-09-12T03:01:13.391715+0000, chain.objs.size()=1 2024-09-12T01:11:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.289__shadow_.FhyA9hzk1bMeA9-L9uHE2FZNv-tDlpf_0 2024-09-12T01:11:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13158726014933488241', time=2024-09-12T03:01:15.851084+0000, chain.objs.size()=1 2024-09-12T01:11:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.H_r79h3FvFUbo5VRMNqxeLdCeuc4pdS_0 2024-09-12T01:11:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15275348437377144809', time=2024-09-12T03:01:16.641721+0000, chain.objs.size()=1 2024-09-12T01:11:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.294__shadow_.2XF2Pz1ZJBFvndIcCak_IuuYxJnQ-_y_0 2024-09-12T01:11:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12793964210972218995', time=2024-09-12T03:01:18.537322+0000, chain.objs.size()=1 2024-09-12T01:11:24.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.731+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.298__shadow_.a9j2NWBE4Pa6e-uTezJc6St02rkddOM_0 2024-09-12T01:11:24.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.733+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10693600866649324886', time=2024-09-12T03:01:23.050306+0000, chain.objs.size()=1 2024-09-12T01:11:24.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.733+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.307__shadow_.9vkEdg6DGZHSo2GXwUWDU0HNlHJKhRd_0 2024-09-12T01:11:24.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4750249776432484827', time=2024-09-12T03:01:40.105902+0000, chain.objs.size()=1 2024-09-12T01:11:24.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.JwrezGaELpnomvSkDHTMPr95YaRYeC__0 2024-09-12T01:11:24.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2939989336984989508', time=2024-09-12T03:01:40.116069+0000, chain.objs.size()=1 2024-09-12T01:11:24.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.djHzNHl0ySk3s4a2WzEDczSxChoLlS-_0 2024-09-12T01:11:24.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.336536849020684030', time=2024-09-12T03:01:40.291396+0000, chain.objs.size()=1 2024-09-12T01:11:24.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.d1zShibiLAEI_2LR3NpslZon8ist5QZ_0 2024-09-12T01:11:24.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11526186854605927427', time=2024-09-12T03:01:40.387212+0000, chain.objs.size()=1 2024-09-12T01:11:24.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.yO_3-6PgxgCjNsTyOYD2ZDL_qS7uG9a_0 2024-09-12T01:11:24.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3609165171378878768', time=2024-09-12T03:01:40.431224+0000, chain.objs.size()=1 2024-09-12T01:11:24.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.736+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.GmBYIg0m-CYP_Enhp_n1_BCh1YR3HT__0 2024-09-12T01:11:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.737+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16946348740257647082', time=2024-09-12T03:01:40.432931+0000, chain.objs.size()=1 2024-09-12T01:11:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.737+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.FjzdlrELzOsazob-w6mEi6cvd_CbJW5_0 2024-09-12T01:11:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15153447350137995770', time=2024-09-12T03:01:40.540005+0000, chain.objs.size()=1 2024-09-12T01:11:24.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.iXMkmVv006nhlG0_UIo-O2BfOrZSvvw_0 2024-09-12T01:11:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15884965369648842087', time=2024-09-12T03:01:40.541618+0000, chain.objs.size()=1 2024-09-12T01:11:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.-Kgd68VIPSWa7TLhBS0CM80uI4-3D-Z_0 2024-09-12T01:11:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7467483746912662096', time=2024-09-12T03:01:40.546054+0000, chain.objs.size()=1 2024-09-12T01:11:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.h0pcz0hzDjs4CLTE4YpC5JZlSlqJLKg_0 2024-09-12T01:11:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4111816763950458228', time=2024-09-12T03:01:40.756302+0000, chain.objs.size()=1 2024-09-12T01:11:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.q2XoAf55nna7UWY2fYfGZ1W9O8nATAf_0 2024-09-12T01:11:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3181256855333434974', time=2024-09-12T03:01:40.772737+0000, chain.objs.size()=1 2024-09-12T01:11:24.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.738+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.SAjBLs-BIF8Wjjfjc6ctaQ_K3L-6dVs_0 2024-09-12T01:11:24.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.740+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3200654934866515592', time=2024-09-12T03:01:40.915276+0000, chain.objs.size()=1 2024-09-12T01:11:24.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.740+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zXBPUzrB6jkw0sFADb4XqV0DxUGNggN_0 2024-09-12T01:11:24.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.740+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.958959990072050167', time=2024-09-12T03:01:40.972383+0000, chain.objs.size()=1 2024-09-12T01:11:24.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.740+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.y4U8p_N0MU4WwgQ9jBcZBxfE3Y1xBE6_0 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8554130246279591200', time=2024-09-12T03:01:41.444312+0000, chain.objs.size()=1 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0LanMgdDs0sPe67JdPBA-4mGq_rEAgt_0 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18157695741881910042', time=2024-09-12T03:01:41.709158+0000, chain.objs.size()=1 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.69C-yX1FC198fVeMFQylJr0Dmjbx-xY_0 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.666928737164745578', time=2024-09-12T03:01:41.753915+0000, chain.objs.size()=1 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.J1AMBL76Jzz8WcZhfY5Zy3fPcF-Ul_K_0 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7865232635314339726', time=2024-09-12T03:01:41.756967+0000, chain.objs.size()=1 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ljSSKg4BxSx1-3eKNgn060P9fA6Ua08_0 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14875842869982307360', time=2024-09-12T03:01:41.827397+0000, chain.objs.size()=1 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.thALzk5EixaKBqFvMIZdA-puRRFwi3g_0 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16770457760741418949', time=2024-09-12T03:01:41.834909+0000, chain.objs.size()=1 2024-09-12T01:11:24.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.741+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.fiWXE4g9O-478QILh-hPbcEuOhewSyS_0 2024-09-12T01:11:24.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.742+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11480540922866951850', time=2024-09-12T03:01:41.839524+0000, chain.objs.size()=1 2024-09-12T01:11:24.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.742+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.izjnXwfmR9-9htI5YqXL3BasQq8_p0n_0 2024-09-12T01:11:24.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.742+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13775840502652212269', time=2024-09-12T03:01:41.987659+0000, chain.objs.size()=1 2024-09-12T01:11:24.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.742+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.0zj3bsV7yk5wfGIdc4bhcfvioWqwZ2Z_0 2024-09-12T01:11:24.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.743+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12285878866724108817', time=2024-09-12T03:01:42.004902+0000, chain.objs.size()=1 2024-09-12T01:11:24.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.743+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8V8amZXR42cSS-W-NTXs42kWmAepHEL_0 2024-09-12T01:11:24.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14305412089301537477', time=2024-09-12T03:01:42.061042+0000, chain.objs.size()=1 2024-09-12T01:11:24.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.a_7Oo2tCJq9W7uaKWYSptqZGdfTq71a_0 2024-09-12T01:11:24.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1293601541092816875', time=2024-09-12T03:01:42.100600+0000, chain.objs.size()=1 2024-09-12T01:11:24.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.coFzGXp39djCeVXZ7Xl6IN4cDZAPCsc_0 2024-09-12T01:11:24.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10331245719200874028', time=2024-09-12T03:01:50.214498+0000, chain.objs.size()=1 2024-09-12T01:11:24.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rvb-mkNdK8Hu_mqqBxKPSzSqnNGL1ce_0 2024-09-12T01:11:24.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3624775362910195975', time=2024-09-12T03:01:50.262297+0000, chain.objs.size()=1 2024-09-12T01:11:24.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ngsgEkXHalWKLDYege_ZMSE1guQb8W7_0 2024-09-12T01:11:24.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17626831767984897681', time=2024-09-12T03:01:50.646334+0000, chain.objs.size()=1 2024-09-12T01:11:24.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.745+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.OAF2trV-qY23LbZG67eYQ20zH9u2BR__0 2024-09-12T01:11:24.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.747+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15877921583195085108', time=2024-09-12T03:01:50.723550+0000, chain.objs.size()=1 2024-09-12T01:11:24.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.747+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.17bQns2WmFPr1MTWFMYQSA7NLTpUSft_0 2024-09-12T01:11:24.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.747+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1266624397733032698', time=2024-09-12T03:01:50.834519+0000, chain.objs.size()=1 2024-09-12T01:11:24.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.747+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fkSjPelmAhXW3y-6kL9LdKifL7OHuU5_0 2024-09-12T01:11:24.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.747+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8957622160783072408', time=2024-09-12T03:01:50.885235+0000, chain.objs.size()=1 2024-09-12T01:11:24.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.747+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.njqsnolkODUDRL_VD3k455DeQ6iuPCa_0 2024-09-12T01:11:24.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.747+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6023746890733188524', time=2024-09-12T03:01:50.933565+0000, chain.objs.size()=1 2024-09-12T01:11:24.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.747+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Q9G4R3WJ1YyTVl4I-g9R2TMQJIXAFhd_0 2024-09-12T01:11:24.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.749+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13987345417080649142', time=2024-09-12T03:01:50.950109+0000, chain.objs.size()=1 2024-09-12T01:11:24.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.749+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.qXRDYvmGCC6MZuv7_I4EeJSuxs8BtOV_0 2024-09-12T01:11:24.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.749+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13508062598019958529', time=2024-09-12T03:01:50.955274+0000, chain.objs.size()=1 2024-09-12T01:11:24.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.749+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.58NxNgWa9Msgf-4hn5q6KLvt18rkzdO_0 2024-09-12T01:11:24.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.749+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3329993320837447042', time=2024-09-12T03:01:50.978975+0000, chain.objs.size()=1 2024-09-12T01:11:24.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.749+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.wxsdlAaS69MKH42A3Ss5JvejDEjakyT_0 2024-09-12T01:11:24.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.751+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12825449082338162148', time=2024-09-12T03:01:50.983660+0000, chain.objs.size()=1 2024-09-12T01:11:24.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.751+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.MreerlFhk2dL970nMbWvPjGK53VsmYR_0 2024-09-12T01:11:24.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.751+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10249780843566444520', time=2024-09-12T03:01:51.141090+0000, chain.objs.size()=1 2024-09-12T01:11:24.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.751+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.YzTUnLAZvu31g8JQ9IGL0aeDGvVRrr4_0 2024-09-12T01:11:24.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.751+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17192321524441437535', time=2024-09-12T03:01:51.143127+0000, chain.objs.size()=1 2024-09-12T01:11:24.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.751+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.nXJldVcuBy1D07Q7qdZRfg91CgXssL0_0 2024-09-12T01:11:24.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.751+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1286755380515747674', time=2024-09-12T03:01:51.158241+0000, chain.objs.size()=1 2024-09-12T01:11:24.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.751+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zeImBEX7ZG5nLDyNLCdaCVZhQoz7vPO_0 2024-09-12T01:11:24.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.752+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15817435358164730513', time=2024-09-12T03:01:51.192208+0000, chain.objs.size()=1 2024-09-12T01:11:24.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.752+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.KOMVri5tY2sgAUn97gEhU6BrusOPW5N_0 2024-09-12T01:11:24.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4694164883645845776', time=2024-09-12T03:01:51.371506+0000, chain.objs.size()=1 2024-09-12T01:11:24.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.TbAoDxXoiei-DOftP_Qu3yLW-AWcJmE_0 2024-09-12T01:11:24.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1938728602399808972', time=2024-09-12T03:01:51.513469+0000, chain.objs.size()=1 2024-09-12T01:11:24.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ozWxEurj-IGxZ3XHQqzdI9ZhpjzhDAH_0 2024-09-12T01:11:24.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10297770864392540330', time=2024-09-12T03:01:51.527633+0000, chain.objs.size()=1 2024-09-12T01:11:24.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.d2VMHTR0aJEHHypZWes9j57Dt0SrzM__0 2024-09-12T01:11:24.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13898862245822822959', time=2024-09-12T03:01:51.640794+0000, chain.objs.size()=1 2024-09-12T01:11:24.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ehdd6zyvNtbc5SqxHt4gFHAD14z-lRz_0 2024-09-12T01:11:24.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.369208837162108277', time=2024-09-12T03:01:51.718555+0000, chain.objs.size()=1 2024-09-12T01:11:24.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.754+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rfZzAsYhSW696Io1n9Opiq7BNEhxTY-_0 2024-09-12T01:11:24.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.755+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1150883222268659927', time=2024-09-12T03:01:51.794284+0000, chain.objs.size()=1 2024-09-12T01:11:24.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.755+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.lVxwLLAWKP8Qc-jCn7KRLX5JiACjtIK_0 2024-09-12T01:11:24.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.755+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2109908273014434182', time=2024-09-12T03:01:51.929826+0000, chain.objs.size()=1 2024-09-12T01:11:24.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.755+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.m00sL6JBMgi_1fhq9uenLSp33E6QUhu_0 2024-09-12T01:11:24.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.756+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4729611438077713177', time=2024-09-12T03:01:51.999611+0000, chain.objs.size()=1 2024-09-12T01:11:24.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.eqGq_1p8tnSxs8AIjMXwNQVi_ufVnsA_0 2024-09-12T01:11:24.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13891700108471583891', time=2024-09-12T03:01:52.000461+0000, chain.objs.size()=1 2024-09-12T01:11:24.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.93IWenFVtqR4TzmDue6E0DJRFWtGeVw_0 2024-09-12T01:11:24.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2617783860155797585', time=2024-09-12T03:01:52.169091+0000, chain.objs.size()=1 2024-09-12T01:11:24.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ZH14zE0pBnzMRjcG5ws8bEvZ2yd2QIm_0 2024-09-12T01:11:24.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.757+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4678986837925720277', time=2024-09-12T03:01:52.188968+0000, chain.objs.size()=1 2024-09-12T01:11:24.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.757+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.rr3vh_Rxnmj9bDcZ_HMLNkk9-u3Qtdg_0 2024-09-12T01:11:24.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.759+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11121294909394535634', time=2024-09-12T03:01:52.194539+0000, chain.objs.size()=1 2024-09-12T01:11:24.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.759+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.LsIBbYFXDoDeW56LZVeOG0GN6S5sg-o_0 2024-09-12T01:11:24.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.759+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3423607360307912823', time=2024-09-12T03:01:52.247044+0000, chain.objs.size()=1 2024-09-12T01:11:24.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.759+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hF4YacWXEfdEU4euvroJ68QVPBeL-2T_0 2024-09-12T01:11:24.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.759+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5738709024591509457', time=2024-09-12T03:01:52.253161+0000, chain.objs.size()=1 2024-09-12T01:11:24.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.759+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.xSqJF5kXoEm2WrFgaZr1EFOulLqBjLc_0 2024-09-12T01:11:24.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.760+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.497561838255129353', time=2024-09-12T03:01:52.275996+0000, chain.objs.size()=1 2024-09-12T01:11:24.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.760+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hTnuuZw1GfBcKkrQb3G0_4SvBP6weaU_0 2024-09-12T01:11:24.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.760+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5519976396738017515', time=2024-09-12T03:01:52.279302+0000, chain.objs.size()=1 2024-09-12T01:11:24.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.760+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.2flyDyxHv2njLKvdz6D3JCguYWsiig-_0 2024-09-12T01:11:24.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.760+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14301314583274445532', time=2024-09-12T03:01:55.820741+0000, chain.objs.size()=1 2024-09-12T01:11:24.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.760+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.333__shadow_._Qq8Fm4ydyEGjDOQGttYOmVrWyj6pVo_0 2024-09-12T01:11:24.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.760+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15698349062047026577', time=2024-09-12T03:02:47.103098+0000, chain.objs.size()=1 2024-09-12T01:11:24.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.760+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.438__shadow_.rItHisSXtw9kSaAbowFYghXnNPJg3mO_0 2024-09-12T01:11:24.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15167487158340450908', time=2024-09-12T03:03:03.695881+0000, chain.objs.size()=1 2024-09-12T01:11:24.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.466__shadow_.UhTAs9qcX1_TPMUIIXuVbKtmwNwW_Hn_0 2024-09-12T01:11:24.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9018896230714650913', time=2024-09-12T03:04:45.439779+0000, chain.objs.size()=1 2024-09-12T01:11:24.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:U9vK1L397F3e7Ob291cO4C.O2Q9hDdm_.nmvHS8PvsBQALk7EbtzhXuTFVV5LTaQ_0 2024-09-12T01:11:24.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.608141925880487910', time=2024-09-12T03:04:47.906697+0000, chain.objs.size()=1 2024-09-12T01:11:24.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.572__shadow_.Sclj-Di8o_Md4t2cz_lAL-n_72F27v1_0 2024-09-12T01:11:24.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.762+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16815493634846690386', time=2024-09-12T03:05:03.131284+0000, chain.objs.size()=1 2024-09-12T01:11:24.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.762+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.578__shadow:CeINp1X32wg9o6go1F6P7dzY4ulRwl8_.PBGgWhFh_Sa_B5boqYwNdkrDnqstz-4_0 2024-09-12T01:11:24.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.763+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10635445179978232094', time=2024-09-12T03:05:14.217813+0000, chain.objs.size()=1 2024-09-12T01:11:24.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.763+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:KODN.8dZDpGzIgch7yFt-tCcoP7nMV6_.tgb73D62C7eSPLCpdH7jpLDdHwIXAd7_0 2024-09-12T01:11:24.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.766+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2015143190481113607', time=2024-09-12T03:05:14.218952+0000, chain.objs.size()=1 2024-09-12T01:11:24.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.766+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.581__shadow:KODN.8dZDpGzIgch7yFt-tCcoP7nMV6_.tgb73D62C7eSPLCpdH7jpLDdHwIXAd7_0 2024-09-12T01:11:24.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.766+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10977420393506419886', time=2024-09-12T03:05:26.151993+0000, chain.objs.size()=1 2024-09-12T01:11:24.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.766+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.607__shadow_.wp-g5QK2AKwKY9jwI6dOljQI9oT8c_Z_0 2024-09-12T01:11:24.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.766+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16207612037561133754', time=2024-09-12T03:07:47.982798+0000, chain.objs.size()=1 2024-09-12T01:11:24.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.766+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.637__shadow_.C_OSTsqNisnvQJ8v9iAPRfJrRwHaXki_0 2024-09-12T01:11:24.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.770+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/59535 2024-09-12T01:11:24.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:11:24.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3573164727187638636', time=2024-09-12T03:07:49.796939+0000, chain.objs.size()=1 2024-09-12T01:11:24.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.642__shadow_.CJrUFP0QOAwHiS5XVBI4TWVoN_bXvEL_0 2024-09-12T01:11:24.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7655043189468492464', time=2024-09-12T03:07:50.876806+0000, chain.objs.size()=1 2024-09-12T01:11:24.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.644__shadow_.8dX0sszWVyIsz-ITZkElMkES-H2wvEc_0 2024-09-12T01:11:24.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15828472773901167374', time=2024-09-12T03:08:03.693210+0000, chain.objs.size()=1 2024-09-12T01:11:24.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.667__shadow_.qyYLL0jVRMXVkMfe3_sgdDKwin1zokM_0 2024-09-12T01:11:24.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3744181638742914170', time=2024-09-12T03:08:14.355124+0000, chain.objs.size()=1 2024-09-12T01:11:24.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.694__shadow:ShjIyfPichRdOTpZV5eqWlANHGUWNL8_.WT3j82yQ9zg0HwUcnEUQs6EjDe_jt45_0 2024-09-12T01:11:24.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9666709662615998714', time=2024-09-12T03:08:56.596918+0000, chain.objs.size()=1 2024-09-12T01:11:24.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.772+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.743__multipart_mymultipart3.2~qOgseEAioxupCo6hdroNQYgtks4yyEF.1 2024-09-12T01:11:24.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.775+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.777+0000 7ff634d2c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:11:24.777 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.779+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:24.778 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.779+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:24.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/62476' 2024-09-12T01:11:24.779 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4958810383987156166', time=2024-09-12T02:59:09.051495+0000, chain.objs.size()=1 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.177__shadow_.RPkp0A5-_EaTKxe-PU8uRO8L8qix7bH_0 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1781078764465046372', time=2024-09-12T03:00:37.117401+0000, chain.objs.size()=1 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.236__shadow_.tk2aWIm9mXuNS32TxblLffiPF1vF_0a_0 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4008386875721320512', time=2024-09-12T03:00:39.226873+0000, chain.objs.size()=1 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.239__shadow_.0qpGnbHXN7nJCTL-k3zDg3TRURcerlj_0 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3084378016021597940', time=2024-09-12T03:00:45.978411+0000, chain.objs.size()=1 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.252__shadow_.PEYL71QgXQgpyRHkIeoDta_MjgXjIRj_0 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1345650294825325715', time=2024-09-12T03:00:49.745005+0000, chain.objs.size()=1 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.260__shadow_.Fy2-vCuY_v074RBV89LBuZlWwJWKHgi_0 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10964407631690680128', time=2024-09-12T03:00:49.745957+0000, chain.objs.size()=1 2024-09-12T01:11:24.780 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.260__shadow_.-trK6cF9_lqqt69ikNoR7G0E3_uw-m0_0 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1800962441095577062', time=2024-09-12T03:00:58.867723+0000, chain.objs.size()=1 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.AP5gD2QLrX-0U9csyc6aTw41d0y0uSC_0 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16056135634211483157', time=2024-09-12T03:00:58.893284+0000, chain.objs.size()=1 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.ufHtLtHBnfTTqO1qdYs0caI2TfypOQU_0 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13656686684825248301', time=2024-09-12T03:00:58.933572+0000, chain.objs.size()=1 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9NX0W5FxeSruTnoSQQs4TjI-Rnt3Nz3_0 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12486896116942075016', time=2024-09-12T03:00:59.174971+0000, chain.objs.size()=1 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LhRXiv5r4JixIgzhxm6co1HcstQ5Gen_0 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5914681546847438453', time=2024-09-12T03:00:59.178449+0000, chain.objs.size()=1 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.an3ph5FmLaLuykY5DbOwLXHKa6fDF7U_0 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18321686152214574794', time=2024-09-12T03:00:59.440094+0000, chain.objs.size()=1 2024-09-12T01:11:24.781 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.780+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.9Irx75KHbvrBdean8JKWkxD00FKaALp_0 2024-09-12T01:11:24.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.783+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13859046243086482511', time=2024-09-12T03:00:59.456989+0000, chain.objs.size()=1 2024-09-12T01:11:24.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.783+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.lB5lvEJUbyzqX2yjK2OiM9MuL3nVxDG_0 2024-09-12T01:11:24.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.783+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4207223307016623968', time=2024-09-12T03:00:59.519766+0000, chain.objs.size()=1 2024-09-12T01:11:24.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.783+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Qpg9u-cCBq3DMKIkhjx1IYvlkfGdiK9_0 2024-09-12T01:11:24.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.783+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15530424851794319329', time=2024-09-12T03:00:59.524413+0000, chain.objs.size()=1 2024-09-12T01:11:24.782 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.783+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.MdWQLSKqppBh5sQcxwDR4UwUH528Nyq_0 2024-09-12T01:11:24.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13981840525156578281', time=2024-09-12T03:00:59.540395+0000, chain.objs.size()=1 2024-09-12T01:11:24.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.qR3-FP_VVgrdM6wBCQWxWFaPvDPqtkx_0 2024-09-12T01:11:24.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3545974693517929951', time=2024-09-12T03:00:59.556852+0000, chain.objs.size()=1 2024-09-12T01:11:24.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_._gqiz_e4OZ-QK6MaLyDWnnGBof0j36B_0 2024-09-12T01:11:24.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4386074540744981612', time=2024-09-12T03:00:59.561459+0000, chain.objs.size()=1 2024-09-12T01:11:24.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.3pHBxgZyN2RhrSGS1icaa5hqXTJEoz0_0 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8463522675231020296', time=2024-09-12T03:00:59.821570+0000, chain.objs.size()=1 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Z7PN7NIHPdituCFgzezRXIp3Ulb6LaK_0 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2630397848317402061', time=2024-09-12T03:00:59.826532+0000, chain.objs.size()=1 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.EDWaRiwX_ZSGeuFvLEMmZHkDyE8bt7k_0 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2281727522951507729', time=2024-09-12T03:00:59.831830+0000, chain.objs.size()=1 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.hf-Fmg8WG3slTapUgSRjc8y26MAwBfE_0 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5511275031994488502', time=2024-09-12T03:00:59.926981+0000, chain.objs.size()=1 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.1YlWck45mai9s7UCxusmBLncTcUwYfy_0 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14557631421870862771', time=2024-09-12T03:00:59.954697+0000, chain.objs.size()=1 2024-09-12T01:11:24.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.785+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.V5C-ZxlgdmGCs0V5r1CNmQ357Lj7fNr_0 2024-09-12T01:11:24.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.787+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4195309616605292757', time=2024-09-12T03:00:59.970652+0000, chain.objs.size()=1 2024-09-12T01:11:24.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.787+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.oe2jHSaIByWDeRV7J9bCFp6BkzUoAUv_0 2024-09-12T01:11:24.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.788+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3512675927304240894', time=2024-09-12T03:01:00.492460+0000, chain.objs.size()=1 2024-09-12T01:11:24.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.788+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.zCmjQR3FobDCsMlLSyswp7UxVzyZKPi_0 2024-09-12T01:11:24.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.788+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17258058169034633432', time=2024-09-12T03:01:00.636231+0000, chain.objs.size()=1 2024-09-12T01:11:24.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.788+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.aQhyT8GowLwGGHEm4HuJvQNESpkyq6j_0 2024-09-12T01:11:24.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.789+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16169124596717628051', time=2024-09-12T03:01:00.678940+0000, chain.objs.size()=1 2024-09-12T01:11:24.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.789+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.jbqzWvNREOEOmgRVaIZtadn0T8nQMkW_0 2024-09-12T01:11:24.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.789+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3595658381378893654', time=2024-09-12T03:01:00.719052+0000, chain.objs.size()=1 2024-09-12T01:11:24.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.789+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.KOi4B_PZxpJeO_ICdve6peBYRdkdzyH_0 2024-09-12T01:11:24.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10660528730453458631', time=2024-09-12T03:01:00.748439+0000, chain.objs.size()=1 2024-09-12T01:11:24.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.g8MfUA6CQzZx-goXENECRN-41d9IW_3_0 2024-09-12T01:11:24.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11138987409707735568', time=2024-09-12T03:01:00.847664+0000, chain.objs.size()=1 2024-09-12T01:11:24.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.R5H7IyHuhkROCXhs8gbgmxTGDBoUi4c_0 2024-09-12T01:11:24.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14396328369982745296', time=2024-09-12T03:01:00.872075+0000, chain.objs.size()=1 2024-09-12T01:11:24.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.Hex7uCyZ2BVyez7ir7bQc-I1hT-jUpF_0 2024-09-12T01:11:24.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7092162895825898069', time=2024-09-12T03:01:00.927217+0000, chain.objs.size()=1 2024-09-12T01:11:24.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.5hZ26v79NvPsnQvXsSNmh2tHrHGc49L_0 2024-09-12T01:11:24.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11477886416884334567', time=2024-09-12T03:01:00.958470+0000, chain.objs.size()=1 2024-09-12T01:11:24.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.I-KqUiLR8hC4psF8cz1W0IbauQyVhQA_0 2024-09-12T01:11:24.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.671976400472316885', time=2024-09-12T03:01:00.984263+0000, chain.objs.size()=1 2024-09-12T01:11:24.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.c3jKBLsDiswyG4mUelAKAKYU1Q386h1_0 2024-09-12T01:11:24.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10182001668342256815', time=2024-09-12T03:01:00.993797+0000, chain.objs.size()=1 2024-09-12T01:11:24.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.790+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.263__shadow_.LWVW8NJO-gpoL3WPoJv-v50bTBEA8M__0 2024-09-12T01:11:24.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.793+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15064621027635284264', time=2024-09-12T03:01:10.326416+0000, chain.objs.size()=1 2024-09-12T01:11:24.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.793+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.283__shadow_.oGkTCFdyfLHshfJI_MhDXGJvInkMaUi_0 2024-09-12T01:11:24.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.795+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12451716498964032774', time=2024-09-12T03:01:15.846950+0000, chain.objs.size()=1 2024-09-12T01:11:24.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.795+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.293__shadow_.uQnwxpKD26d0hE5ZuRJaJvYHE_zkL_E_0 2024-09-12T01:11:24.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.795+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16439979081366549406', time=2024-09-12T03:01:20.549684+0000, chain.objs.size()=1 2024-09-12T01:11:24.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.795+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.302__shadow_.Iv9w2qr95LBrn0ZFTrgaxqs4obUiKO3_0 2024-09-12T01:11:24.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.795+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2871235312520113847', time=2024-09-12T03:01:40.144139+0000, chain.objs.size()=1 2024-09-12T01:11:24.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.795+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Ny52sb8U_OGktNA5KBxidk1MvE3ZyEA_0 2024-09-12T01:11:24.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.795+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14108421615035726409', time=2024-09-12T03:01:40.150277+0000, chain.objs.size()=1 2024-09-12T01:11:24.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.795+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ormsabYC7Tprm45StQymy8ISfB81v5y_0 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5686467427465804864', time=2024-09-12T03:01:40.190698+0000, chain.objs.size()=1 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.SWBkN4WosliJ8BV0xJ58ud-WSNoU-Q7_0 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13455549750112018700', time=2024-09-12T03:01:40.201677+0000, chain.objs.size()=1 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.B7qSzl2Rwh9SalLucsUw0dH1BI39q5I_0 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6501873598629904844', time=2024-09-12T03:01:40.206129+0000, chain.objs.size()=1 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.6fKwTzwo66Ivb1dqDNrBPezqSfRfNUk_0 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2401913575526264719', time=2024-09-12T03:01:40.210143+0000, chain.objs.size()=1 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._VKVy3VJvxkqOUaJzgp4M5VNS9YTb0y_0 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4283564860755022526', time=2024-09-12T03:01:40.225556+0000, chain.objs.size()=1 2024-09-12T01:11:24.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ANGKVGkF63l8ItLOCDhvkCbVayGNM09_0 2024-09-12T01:11:24.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.263215428249562788', time=2024-09-12T03:01:40.270355+0000, chain.objs.size()=1 2024-09-12T01:11:24.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ioK468vw08Hwa-OFpv7npSZOz-zkO6P_0 2024-09-12T01:11:24.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13395028228764235403', time=2024-09-12T03:01:40.386080+0000, chain.objs.size()=1 2024-09-12T01:11:24.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.796+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4nwjXB0f9MepRwQLcXTePkjOOF6u351_0 2024-09-12T01:11:24.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15988261288209719851', time=2024-09-12T03:01:40.484320+0000, chain.objs.size()=1 2024-09-12T01:11:24.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aqVgeRx1Mjzy5EiGw8eZtC7fhtfNori_0 2024-09-12T01:11:24.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3648884004014721872', time=2024-09-12T03:01:40.533615+0000, chain.objs.size()=1 2024-09-12T01:11:24.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.kgVgTrRs4wOv6-OaKI6C5WNBugdzZyp_0 2024-09-12T01:11:24.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7037645251017459707', time=2024-09-12T03:01:40.650677+0000, chain.objs.size()=1 2024-09-12T01:11:24.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.L2hdvaH2EeQNoN_KWPW4C56F-y6Idj-_0 2024-09-12T01:11:24.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14026888861206978477', time=2024-09-12T03:01:40.659445+0000, chain.objs.size()=1 2024-09-12T01:11:24.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.dEhc3fr2Jj_KI9ptVtPnoNdsYUqj9Nq_0 2024-09-12T01:11:24.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16264532647329128603', time=2024-09-12T03:01:40.677024+0000, chain.objs.size()=1 2024-09-12T01:11:24.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.qS9UPtz40Sbc4rBF3uJcfolmDhy2jSV_0 2024-09-12T01:11:24.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16477478227469030920', time=2024-09-12T03:01:40.806589+0000, chain.objs.size()=1 2024-09-12T01:11:24.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.800+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.O1x124mxpOdzFGKtnQsS9OEDVllldJb_0 2024-09-12T01:11:24.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3881644502115650725', time=2024-09-12T03:01:40.811400+0000, chain.objs.size()=1 2024-09-12T01:11:24.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.DY90KFA7__xHlp3bPS5xWIKNw_doTYQ_0 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1903609988467135101', time=2024-09-12T03:01:40.942389+0000, chain.objs.size()=1 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.HfLew4u75HXF7EMimcDoM94vRgWadmQ_0 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.3931152309689496922', time=2024-09-12T03:01:40.952227+0000, chain.objs.size()=1 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.NwvdR0zI-VQOmGBD5zObuV5b-VuxoaW_0 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15204013619882701090', time=2024-09-12T03:01:41.053126+0000, chain.objs.size()=1 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Xw7EpNYqHWb4pGpKO8su7V-M_OM-RLc_0 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16383980163760546210', time=2024-09-12T03:01:41.232782+0000, chain.objs.size()=1 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.QlCsUkzEysXJVPiQJM37aN1JMenrCvk_0 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1932968722714450250', time=2024-09-12T03:01:41.234538+0000, chain.objs.size()=1 2024-09-12T01:11:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.804+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.4Yf5HmN3__V3sndBv8ZHW356iF5kTzR_0 2024-09-12T01:11:24.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.805+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5800075501467597358', time=2024-09-12T03:01:41.291388+0000, chain.objs.size()=1 2024-09-12T01:11:24.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.805+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.HwinGD2vJWdiLwofWw5YYKMidsxq9-Q_0 2024-09-12T01:11:24.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.805+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6615057942874780937', time=2024-09-12T03:01:41.328958+0000, chain.objs.size()=1 2024-09-12T01:11:24.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.805+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.M8guYeXgSJJPzfmHfiPO0HgLYuFAJEI_0 2024-09-12T01:11:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.807+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.769061773492737547', time=2024-09-12T03:01:41.349203+0000, chain.objs.size()=1 2024-09-12T01:11:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.807+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.aTDOJfNM_tBbrdQRbHyBdF_S1kDOKpX_0 2024-09-12T01:11:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.807+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15858867848917158487', time=2024-09-12T03:01:41.468795+0000, chain.objs.size()=1 2024-09-12T01:11:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.807+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.WEc1Qkri9QZth7So1yKs5KBr321nlFt_0 2024-09-12T01:11:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.807+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7750925601455072992', time=2024-09-12T03:01:41.478342+0000, chain.objs.size()=1 2024-09-12T01:11:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.807+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.PmqdEvEbOJu1orYwuL8K8dg7mv8vO7L_0 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6909423481529621008', time=2024-09-12T03:01:41.505976+0000, chain.objs.size()=1 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.nQ2C2DiCDZ_WNQX-5h1v0rP2TZ4JjTN_0 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10902291367916379577', time=2024-09-12T03:01:41.523134+0000, chain.objs.size()=1 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.8Ce6zs3utCRlJWUnVpewhadxh9xEnsk_0 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10330750177028809307', time=2024-09-12T03:01:41.565862+0000, chain.objs.size()=1 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.zQaL9SaNlnkUEJkcGo23FGKZ8j4lfQ7_0 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13630251725199867552', time=2024-09-12T03:01:41.575616+0000, chain.objs.size()=1 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.Lc4_bzJWB_UUmw0aNadmeaTJ_Q8lOi6_0 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15569703086057187717', time=2024-09-12T03:01:41.580189+0000, chain.objs.size()=1 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.ZpYxUfBkmSWoZm6Y0dOJKjia-30bdmc_0 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1473802294170930091', time=2024-09-12T03:01:41.583688+0000, chain.objs.size()=1 2024-09-12T01:11:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.809+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.UA_tTHCehbHXXo0o2xyOOND93NkQ_hu_0 2024-09-12T01:11:24.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.810+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4324712910777432938', time=2024-09-12T03:01:41.597654+0000, chain.objs.size()=1 2024-09-12T01:11:24.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.810+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.VquTaUmSosVIFvQ7xSa0iV_RkROrZpk_0 2024-09-12T01:11:24.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.810+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7495065830412604526', time=2024-09-12T03:01:41.601124+0000, chain.objs.size()=1 2024-09-12T01:11:24.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.810+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.P-wiAigxIr8Ym-z4g5HG31b3FjwU9Ai_0 2024-09-12T01:11:24.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.810+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5838406411003067085', time=2024-09-12T03:01:41.712452+0000, chain.objs.size()=1 2024-09-12T01:11:24.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.810+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.DNKhVnvzyC2J2yyK09mxAV5na-G7o39_0 2024-09-12T01:11:24.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12523077554619011247', time=2024-09-12T03:01:41.714737+0000, chain.objs.size()=1 2024-09-12T01:11:24.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.D6geBwCexsQkwZRUA5Y5RO8nOPBQo0z_0 2024-09-12T01:11:24.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.812+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9973890446732430674', time=2024-09-12T03:01:41.785413+0000, chain.objs.size()=1 2024-09-12T01:11:24.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.812+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_._yuUrkVjm4mIqGNAEuX4zDHYLfxKVvH_0 2024-09-12T01:11:24.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.813+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7779691591217319281', time=2024-09-12T03:01:42.026791+0000, chain.objs.size()=1 2024-09-12T01:11:24.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.813+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lfQxAqmLBWMqt0HcDzwViKP41IygjS5_0 2024-09-12T01:11:24.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11333262723988134821', time=2024-09-12T03:01:42.042921+0000, chain.objs.size()=1 2024-09-12T01:11:24.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.wM4QsW59VX-vvP9EEymlUGji5VV1ELA_0 2024-09-12T01:11:24.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16153361812394105670', time=2024-09-12T03:01:42.051982+0000, chain.objs.size()=1 2024-09-12T01:11:24.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.3ateRpWlw-3mrz8UOtrUSp_pdGU3RL4_0 2024-09-12T01:11:24.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6706363619075645787', time=2024-09-12T03:01:42.061413+0000, chain.objs.size()=1 2024-09-12T01:11:24.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lb79v-CRKrRQ76jdgAYfeh0dhaPn7UQ_0 2024-09-12T01:11:24.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4230564822304296499', time=2024-09-12T03:01:42.076874+0000, chain.objs.size()=1 2024-09-12T01:11:24.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.u1fgXexbGhJd9qB8X6iOw2Xom_MUMdB_0 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5556915659407345169', time=2024-09-12T03:01:42.089963+0000, chain.objs.size()=1 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.324__shadow_.lxwheIZAYC8xPDxVh2MvA8NfgdtJliT_0 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5299845971577069302', time=2024-09-12T03:01:50.223459+0000, chain.objs.size()=1 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.cBUTv-1IZjk-hT7_qZtE07pgBQxmpii_0 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8848710874284836457', time=2024-09-12T03:01:50.339944+0000, chain.objs.size()=1 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.y1ojN8PW2hzbmGfidckfy0qXOPGR47w_0 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6798313047192372765', time=2024-09-12T03:01:50.370300+0000, chain.objs.size()=1 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_._t2pJXXtGV7JTg5sOCRQfkIDaG1rgbl_0 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7731302828949594984', time=2024-09-12T03:01:50.413298+0000, chain.objs.size()=1 2024-09-12T01:11:24.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.815+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IAw24xYTToc85ww3Oi4wBsAkBZqV6H3_0 2024-09-12T01:11:24.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.817+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15102352833936843798', time=2024-09-12T03:01:50.540979+0000, chain.objs.size()=1 2024-09-12T01:11:24.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.817+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.DJuo39XBuSdlPIS_RM2Dn12kllD10Aw_0 2024-09-12T01:11:24.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13534613932842404607', time=2024-09-12T03:01:50.563222+0000, chain.objs.size()=1 2024-09-12T01:11:24.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.aqpfoagPZdot8RIybR9nksdikVuHdy5_0 2024-09-12T01:11:24.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4554983620475507320', time=2024-09-12T03:01:50.592657+0000, chain.objs.size()=1 2024-09-12T01:11:24.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1_9W2e9kvlmaO1oB9G_tGQ9koaqd5tV_0 2024-09-12T01:11:24.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17202517704120371194', time=2024-09-12T03:01:50.615064+0000, chain.objs.size()=1 2024-09-12T01:11:24.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ligshC_rfXaDrI8mnkzr4dSaS3Eu9-V_0 2024-09-12T01:11:24.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10161273976788636741', time=2024-09-12T03:01:50.630316+0000, chain.objs.size()=1 2024-09-12T01:11:24.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.PaJeWqSLUhFD3JCCdC-N9IpEzmJEAWC_0 2024-09-12T01:11:24.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8570136834182059024', time=2024-09-12T03:01:50.677266+0000, chain.objs.size()=1 2024-09-12T01:11:24.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.h5nS0Z62WWszo_Yqu4Q1jBu-5m8hzhZ_0 2024-09-12T01:11:24.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.8973022197920042229', time=2024-09-12T03:01:50.815822+0000, chain.objs.size()=1 2024-09-12T01:11:24.821 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.821+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.UH0TW1cDBZeAkDUOB3ogLwXKGGrY5uZ_0 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15534584240194464922', time=2024-09-12T03:01:50.823348+0000, chain.objs.size()=1 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.B9afRf5cOpsF8Cgi5pcp9MSIHxiJrxU_0 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.16275344242655413443', time=2024-09-12T03:01:50.824357+0000, chain.objs.size()=1 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.GlBHMhT5zABTrGQBolzCYz_wdZL19WM_0 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14625309089043638072', time=2024-09-12T03:01:50.865020+0000, chain.objs.size()=1 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.R3Pff78j1u314TP00qb5-rdenTA5UNH_0 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.822+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5501986832687137285', time=2024-09-12T03:01:50.872714+0000, chain.objs.size()=1 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.822+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.7T3uczsNEOIeXrNF_F1c9EK_q8DIfmm_0 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.823+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2737435621060315922', time=2024-09-12T03:01:50.874745+0000, chain.objs.size()=1 2024-09-12T01:11:24.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.823+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.tTWycRFYLOiO3a1xw-Vw8AsQ5uHqgmV_0 2024-09-12T01:11:24.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.825+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4255102349314309644', time=2024-09-12T03:01:50.950127+0000, chain.objs.size()=1 2024-09-12T01:11:24.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.825+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.JOkfSpijKPf7p4cPTsAL7-J3fXg3DZc_0 2024-09-12T01:11:24.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.825+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7109990598472617977', time=2024-09-12T03:01:50.973559+0000, chain.objs.size()=1 2024-09-12T01:11:24.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.825+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6rM8ygesyOfr_Fm8J5F3_QgqIgLylZh_0 2024-09-12T01:11:24.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.825+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9992444494162401478', time=2024-09-12T03:01:51.099376+0000, chain.objs.size()=1 2024-09-12T01:11:24.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.825+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.XOO83-UY5mGHyk1SKe1ueUqIYL3VjM7_0 2024-09-12T01:11:24.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.829+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 0/62476 2024-09-12T01:11:24.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T01:11:24.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9591824296722373497', time=2024-09-12T03:01:51.175833+0000, chain.objs.size()=1 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.HbHCuHQOz7QTvFYOqM1QBXXoU6GlDvu_0 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1872010023961913866', time=2024-09-12T03:01:51.190302+0000, chain.objs.size()=1 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.IiIO451N7mGrBmcnQzfMQi1wjUEowUe_0 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7999294049096846120', time=2024-09-12T03:01:51.239393+0000, chain.objs.size()=1 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.fFRPyrk48ht8Yvb2zy-JfUhC3HELZkk_0 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18364340437579798906', time=2024-09-12T03:01:51.363627+0000, chain.objs.size()=1 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.U94zlRIHyDaXnNupodkBqFKVP9RsYy9_0 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.12340258380008409313', time=2024-09-12T03:01:51.407236+0000, chain.objs.size()=1 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.hUoVKtKkozE1P5wGokeNzX3RE5tzUkA_0 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.13332874027246932154', time=2024-09-12T03:01:51.411549+0000, chain.objs.size()=1 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.SCCgXfJtOB-P8z_HGl8SR5DrRZcEtUt_0 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1424711344352533889', time=2024-09-12T03:01:51.438354+0000, chain.objs.size()=1 2024-09-12T01:11:24.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8dhdRoo_twBcwVhrbPNLqf176VZmOvQ_0 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.5412050364120164305', time=2024-09-12T03:01:51.517437+0000, chain.objs.size()=1 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.57PTn125FC16RjA4_ftu-2sSOZLbrx7_0 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10132655874645086297', time=2024-09-12T03:01:51.651104+0000, chain.objs.size()=1 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.1PXeM_EPsWvUVpqxZ9R4wgzSD_LjrDU_0 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.189681832286167887', time=2024-09-12T03:01:51.661705+0000, chain.objs.size()=1 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.ptmiWKo3TGfJ0VfewDWF5SpZZ_HPHbf_0 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9275652112893731703', time=2024-09-12T03:01:51.703608+0000, chain.objs.size()=1 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.kE2g56Kumg0KUgoIP54Pureusl_FeZN_0 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6614314918455494784', time=2024-09-12T03:01:51.901738+0000, chain.objs.size()=1 2024-09-12T01:11:24.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.832+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.3TuauY96YrXMPDg-MC9QNpEOJsnkNlz_0 2024-09-12T01:11:24.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.835+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10156665829513795032', time=2024-09-12T03:01:51.939013+0000, chain.objs.size()=1 2024-09-12T01:11:24.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.835+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.blBR5zcvVPGCakPWMAncU9Rg9gCTLHl_0 2024-09-12T01:11:24.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10854968955588661466', time=2024-09-12T03:01:51.995669+0000, chain.objs.size()=1 2024-09-12T01:11:24.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.zRXhCc9YNU97AQ7qSmbu66KKpOY8dck_0 2024-09-12T01:11:24.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1594887256075356051', time=2024-09-12T03:01:51.996612+0000, chain.objs.size()=1 2024-09-12T01:11:24.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.T2qTVPxamWK5Dy6sQ8U3VPXFYl6xAlS_0 2024-09-12T01:11:24.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.7683715202463398214', time=2024-09-12T03:01:52.036503+0000, chain.objs.size()=1 2024-09-12T01:11:24.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.6MSirM2rUr2jdqMQS0UTyaAzow5NETQ_0 2024-09-12T01:11:24.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1275573158823748217', time=2024-09-12T03:01:52.258985+0000, chain.objs.size()=1 2024-09-12T01:11:24.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.Jd6ndmtu-J8cnKY9jndE-eGoWTJVN6N_0 2024-09-12T01:11:24.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.10828459374617523067', time=2024-09-12T03:01:52.270722+0000, chain.objs.size()=1 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.836+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.g9F5aayTtVKoK0D4DAmlqefitKq4XlS_0 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17148994775079311491', time=2024-09-12T03:01:52.320726+0000, chain.objs.size()=1 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.325__shadow_.8uQ39Yzy3p5SYb43rLznQY-B1jr7Rzf_0 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.2917197296195775146', time=2024-09-12T03:01:53.205587+0000, chain.objs.size()=1 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.327__shadow_.fRNfVaJi1me8sygmFJa1gxokNXZMfWz_0 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14270745296579188894', time=2024-09-12T03:01:58.191055+0000, chain.objs.size()=1 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.338__shadow_.nWNpk5pqZ4xL0fuN_StIwRSjYYf1mvM_0 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6883133065864747589', time=2024-09-12T03:02:18.322849+0000, chain.objs.size()=1 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.382__shadow_.cqtRVU_2FWG1po1qW8pCL21Okogo2ow_0 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4763568874892877741', time=2024-09-12T03:02:22.583808+0000, chain.objs.size()=1 2024-09-12T01:11:24.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.837+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.391__shadow_.VlGyUyjVPtDbWclBxNSltFoEQCA5Moi_0 2024-09-12T01:11:24.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.841+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1638282096234345366', time=2024-09-12T03:03:10.089215+0000, chain.objs.size()=1 2024-09-12T01:11:24.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.484__shadow_.0XfPqevERNoYt5S-MJfyWiwHRo-5A77_0 2024-09-12T01:11:24.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.841+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17678306542091295975', time=2024-09-12T03:03:31.850153+0000, chain.objs.size()=1 2024-09-12T01:11:24.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.521__shadow:6w2QblaPtrXPTn1zilHt6qzdPeBC5UZ_.E5xpn69GjgsZIHAYEUDm9DLn9U_f6nE_0 2024-09-12T01:11:24.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.841+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.1378119939031550137', time=2024-09-12T03:03:43.006459+0000, chain.objs.size()=12 2024-09-12T01:11:24.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.qV7g_326CUfz1jtDg9QJo-s4jrK5f_Q8.1 2024-09-12T01:11:24.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.841+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.qV7g_326CUfz1jtDg9QJo-s4jrK5f_Q8.1_1 2024-09-12T01:11:24.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.842+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.8pVLPQDut9u6sXBsnDFk7fIxRi11Y1RM.2 2024-09-12T01:11:24.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.842+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.8pVLPQDut9u6sXBsnDFk7fIxRi11Y1RM.2_1 2024-09-12T01:11:24.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.843+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.0IIiblY4_jG6gDdjs5-O5z7fEfFX8QHJ.3 2024-09-12T01:11:24.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.843+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.0IIiblY4_jG6gDdjs5-O5z7fEfFX8QHJ.3_1 2024-09-12T01:11:24.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.843+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.g1gSIRIWxiNIDwH-XRnNOPUnWzp9cXKU.4 2024-09-12T01:11:24.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.843+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.g1gSIRIWxiNIDwH-XRnNOPUnWzp9cXKU.4_1 2024-09-12T01:11:24.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.843+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.NjwD0YBKFHrI3i9S5qMaav6aKTv0NLYK.5 2024-09-12T01:11:24.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.NjwD0YBKFHrI3i9S5qMaav6aKTv0NLYK.5_1 2024-09-12T01:11:24.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__multipart_mymultipart.FmYJ2Zt5r6GhT1j3yQyjjkIsi_86divM.6 2024-09-12T01:11:24.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.523__shadow_mymultipart.FmYJ2Zt5r6GhT1j3yQyjjkIsi_86divM.6_1 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.9988784949377727965', time=2024-09-12T03:04:26.736679+0000, chain.objs.size()=1 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.552__shadow_.h6aVuuNE9qdmm6aJ4dGi8KZI9H9CRw4_0 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.17962194917812930961', time=2024-09-12T03:04:41.603635+0000, chain.objs.size()=1 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:wsvgbuBfuUnndQ4dl00ML6i8F9vFvBJ_.GNucsLS8o7TQ04w-ZTe6ouGwas8LAda_0 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.6090244630961982569', time=2024-09-12T03:04:46.214291+0000, chain.objs.size()=1 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.570__shadow:Ibd32jXlGdSfTGrdTPgvIllMxVxVFGc_.iieZQK2p3tN1l5yXaRUz05FTA1T8iHU_0 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.14451236842693659646', time=2024-09-12T03:04:47.405127+0000, chain.objs.size()=1 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.571__shadow:Pf.xnRf6XwfDAhKA9zZkxT1BnmtsXMI_.qiwZ6MK4v3qdRiSc03XrE7a0WXN3PTa_0 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15974003558103778826', time=2024-09-12T03:04:52.166719+0000, chain.objs.size()=1 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.575__shadow:MlNYWhW-0ckOAWfGOtZCw-9C-w5bV80_.wzPE1O5eA311t61k4A2Ihf1hyI6fyoh_0 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18446490887701395911', time=2024-09-12T03:04:53.040029+0000, chain.objs.size()=1 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.847+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.576__shadow_.Uki_i59WPHKrvw3PdKw1KQmjFpoV2al_0 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.848+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.15123078403760033114', time=2024-09-12T03:04:55.679986+0000, chain.objs.size()=1 2024-09-12T01:11:24.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.848+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.577__shadow:ks6XAXK2LrQeaNsx2k8zorduHm5SgRL_.nqsqrVR4qpbEfgs43XllH2wR2yOEYgM_0 2024-09-12T01:11:24.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.848+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4870277107248760587', time=2024-09-12T03:05:21.880757+0000, chain.objs.size()=1 2024-09-12T01:11:24.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.848+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.597__shadow_.OA2iuj5LnSbQelIywJ3Kf97UA6BBI7F_0 2024-09-12T01:11:24.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.852+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.4883349653329628218', time=2024-09-12T03:05:24.763678+0000, chain.objs.size()=1 2024-09-12T01:11:24.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.852+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.604__shadow_.oCXwldW-w8COcW-HhstVai9Omk9gIQS_0 2024-09-12T01:11:24.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.853+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.11560816858497998861', time=2024-09-12T03:05:34.527320+0000, chain.objs.size()=12 2024-09-12T01:11:24.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__multipart_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.1 2024-09-12T01:11:24.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.853+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__shadow_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.1_1 2024-09-12T01:11:24.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.854+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__multipart_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.2 2024-09-12T01:11:24.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.854+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__shadow_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.2_1 2024-09-12T01:11:24.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.854+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__multipart_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.3 2024-09-12T01:11:24.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.854+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__shadow_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.3_1 2024-09-12T01:11:24.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.854+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__multipart_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.4 2024-09-12T01:11:24.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.854+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__shadow_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.4_1 2024-09-12T01:11:24.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.854+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__multipart_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.5 2024-09-12T01:11:24.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.854+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__shadow_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.5_1 2024-09-12T01:11:24.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.856+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__multipart_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.6 2024-09-12T01:11:24.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.858+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.615__shadow_multipart_enc.2~bu0wBIQGxPJNgfYuvy-Lz4eg51QvclT.6_1 2024-09-12T01:11:24.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.859+0000 7ff634d2c800 20 garbage collection: RGWGC::process iterating over entry tag='ad4424e4-de7c-4376-b125-e717016a3484.4511.18196406726785087586', time=2024-09-12T03:07:52.041572+0000, chain.objs.size()=1 2024-09-12T01:11:24.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.859+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ad4424e4-de7c-4376-b125-e717016a3484.4511.646__shadow_.KCG8xTDPNjSxRpinRuqsimyGSyo7wpz_0 2024-09-12T01:11:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.863+0000 7ff634d2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:24.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.866+0000 7ff4e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:11:24.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.868+0000 7ff634d2c800 20 remove_watcher() i=0 2024-09-12T01:11:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.868+0000 7ff634d2c800 2 removed watcher, disabling cache 2024-09-12T01:11:24.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.869+0000 7ff634d2c800 20 remove_watcher() i=1 2024-09-12T01:11:24.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.870+0000 7ff634d2c800 20 remove_watcher() i=2 2024-09-12T01:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.871+0000 7ff634d2c800 20 remove_watcher() i=3 2024-09-12T01:11:24.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.872+0000 7ff634d2c800 20 remove_watcher() i=4 2024-09-12T01:11:24.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.873+0000 7ff634d2c800 20 remove_watcher() i=5 2024-09-12T01:11:24.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.874+0000 7ff634d2c800 20 remove_watcher() i=6 2024-09-12T01:11:24.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-12T01:11:24.875+0000 7ff634d2c800 20 remove_watcher() i=7 2024-09-12T01:11:24.884 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:11:24.896 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T01:11:24.954 DEBUG:teuthology.orchestra.run.smithi083:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:11:25.024 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T01:11:25.093 DEBUG:teuthology.orchestra.run.smithi083:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:11:25.163 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T01:11:25.241 DEBUG:teuthology.orchestra.run.smithi083:> sudo update-ca-trust 2024-09-12T01:11:26.253 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:11:26.263 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:11:26.264 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:26.588 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:11:26.600 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T01:11:26.602 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":1504,"stamp":"2024-09-12T01:11:26.232250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600103598,"num_objects":4033,"num_object_clones":0,"num_object_copies":15336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4033,"num_whiteouts":0,"num_read":175960,"num_read_kb":2397312,"num_write":139547,"num_write_kb":2482850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14391,"ondisk_log_size":14391,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2543336,"kb_used_data":1070720,"kb_used_omap":12,"kb_used_meta":1472179,"kb_avail":752431384,"statfs":{"total":773094113280,"available":770489737216,"internally_reserved":0,"allocated":1096417280,"data_stored":1080184608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1507511858},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-117297587,"num_objects":-863,"num_object_clones":0,"num_object_copies":-3424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-863,"num_whiteouts":0,"num_read":991,"num_read_kb":1058,"num_write":927,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005837"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509864+0000","last_change":"2024-09-12T00:56:52.991247+0000","last_active":"2024-09-12T01:06:53.509864+0000","last_peered":"2024-09-12T01:06:53.509864+0000","last_clean":"2024-09-12T01:06:53.509864+0000","last_became_active":"2024-09-12T00:56:52.990975+0000","last_became_peered":"2024-09-12T00:56:52.990975+0000","last_unstale":"2024-09-12T01:06:53.509864+0000","last_undegraded":"2024-09-12T01:06:53.509864+0000","last_fullsized":"2024-09-12T01:06:53.509864+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:25.467438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.408743+0000","last_change":"2024-09-12T00:46:19.285045+0000","last_active":"2024-09-12T01:08:48.408743+0000","last_peered":"2024-09-12T01:08:48.408743+0000","last_clean":"2024-09-12T01:08:48.408743+0000","last_became_active":"2024-09-12T00:46:19.284774+0000","last_became_peered":"2024-09-12T00:46:19.284774+0000","last_unstale":"2024-09-12T01:08:48.408743+0000","last_undegraded":"2024-09-12T01:08:48.408743+0000","last_fullsized":"2024-09-12T01:08:48.408743+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:05.942678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.410391+0000","last_change":"2024-09-12T00:46:16.275794+0000","last_active":"2024-09-12T01:11:18.410391+0000","last_peered":"2024-09-12T01:11:18.410391+0000","last_clean":"2024-09-12T01:11:18.410391+0000","last_became_active":"2024-09-12T00:46:16.275529+0000","last_became_peered":"2024-09-12T00:46:16.275529+0000","last_unstale":"2024-09-12T01:11:18.410391+0000","last_undegraded":"2024-09-12T01:11:18.410391+0000","last_fullsized":"2024-09-12T01:11:18.410391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:10.602032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'24","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.244847+0000","last_change":"2024-09-12T00:44:37.816651+0000","last_active":"2024-09-12T01:08:22.244847+0000","last_peered":"2024-09-12T01:08:22.244847+0000","last_clean":"2024-09-12T01:08:22.244847+0000","last_became_active":"2024-09-12T00:44:37.816192+0000","last_became_peered":"2024-09-12T00:44:37.816192+0000","last_unstale":"2024-09-12T01:08:22.244847+0000","last_undegraded":"2024-09-12T01:08:22.244847+0000","last_fullsized":"2024-09-12T01:08:22.244847+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:52.133009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:52.373304+0000","last_change":"2024-09-12T00:56:52.996167+0000","last_active":"2024-09-12T01:06:52.373304+0000","last_peered":"2024-09-12T01:06:52.373304+0000","last_clean":"2024-09-12T01:06:52.373304+0000","last_became_active":"2024-09-12T00:56:52.995871+0000","last_became_peered":"2024-09-12T00:56:52.995871+0000","last_unstale":"2024-09-12T01:06:52.373304+0000","last_undegraded":"2024-09-12T01:06:52.373304+0000","last_fullsized":"2024-09-12T01:06:52.373304+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:23.434095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:51.498180+0000","last_change":"2024-09-12T00:46:19.285212+0000","last_active":"2024-09-12T01:08:51.498180+0000","last_peered":"2024-09-12T01:08:51.498180+0000","last_clean":"2024-09-12T01:08:51.498180+0000","last_became_active":"2024-09-12T00:46:19.284875+0000","last_became_peered":"2024-09-12T00:46:19.284875+0000","last_unstale":"2024-09-12T01:08:51.498180+0000","last_undegraded":"2024-09-12T01:08:51.498180+0000","last_fullsized":"2024-09-12T01:08:51.498180+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:33.439048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.478299+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:08:47.478299+0000","last_peered":"2024-09-12T01:08:47.478299+0000","last_clean":"2024-09-12T01:08:47.478299+0000","last_became_active":"2024-09-12T00:46:16.275381+0000","last_became_peered":"2024-09-12T00:46:16.275381+0000","last_unstale":"2024-09-12T01:08:47.478299+0000","last_undegraded":"2024-09-12T01:08:47.478299+0000","last_fullsized":"2024-09-12T01:08:47.478299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.675654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'45","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.444239+0000","last_change":"2024-09-12T00:44:37.819913+0000","last_active":"2024-09-12T01:08:56.444239+0000","last_peered":"2024-09-12T01:08:56.444239+0000","last_clean":"2024-09-12T01:08:56.444239+0000","last_became_active":"2024-09-12T00:44:37.819561+0000","last_became_peered":"2024-09-12T00:44:37.819561+0000","last_unstale":"2024-09-12T01:08:56.444239+0000","last_undegraded":"2024-09-12T01:08:56.444239+0000","last_fullsized":"2024-09-12T01:08:56.444239+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:18.208589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":164,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409863+0000","last_change":"2024-09-12T00:56:52.990647+0000","last_active":"2024-09-12T01:08:58.409863+0000","last_peered":"2024-09-12T01:08:58.409863+0000","last_clean":"2024-09-12T01:08:58.409863+0000","last_became_active":"2024-09-12T00:56:52.990364+0000","last_became_peered":"2024-09-12T00:56:52.990364+0000","last_unstale":"2024-09-12T01:08:58.409863+0000","last_undegraded":"2024-09-12T01:08:58.409863+0000","last_fullsized":"2024-09-12T01:08:58.409863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:34.228970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.483121+0000","last_change":"2024-09-12T00:46:19.285614+0000","last_active":"2024-09-12T01:09:17.483121+0000","last_peered":"2024-09-12T01:09:17.483121+0000","last_clean":"2024-09-12T01:09:17.483121+0000","last_became_active":"2024-09-12T00:46:19.285357+0000","last_became_peered":"2024-09-12T00:46:19.285357+0000","last_unstale":"2024-09-12T01:09:17.483121+0000","last_undegraded":"2024-09-12T01:09:17.483121+0000","last_fullsized":"2024-09-12T01:09:17.483121+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:02.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":2,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.384512+0000","last_change":"2024-09-12T00:46:16.278495+0000","last_active":"2024-09-12T01:08:18.384512+0000","last_peered":"2024-09-12T01:08:18.384512+0000","last_clean":"2024-09-12T01:08:18.384512+0000","last_became_active":"2024-09-12T00:46:16.278221+0000","last_became_peered":"2024-09-12T00:46:16.278221+0000","last_unstale":"2024-09-12T01:08:18.384512+0000","last_undegraded":"2024-09-12T01:08:18.384512+0000","last_fullsized":"2024-09-12T01:08:18.384512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:42.560119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5130,"num_write":12,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'37","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375379+0000","last_change":"2024-09-12T00:44:37.818554+0000","last_active":"2024-09-12T01:07:07.375379+0000","last_peered":"2024-09-12T01:07:07.375379+0000","last_clean":"2024-09-12T01:07:07.375379+0000","last_became_active":"2024-09-12T00:44:37.818239+0000","last_became_peered":"2024-09-12T00:44:37.818239+0000","last_unstale":"2024-09-12T01:07:07.375379+0000","last_undegraded":"2024-09-12T01:07:07.375379+0000","last_fullsized":"2024-09-12T01:07:07.375379+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:53.443510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":144,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:37.459106+0000","last_change":"2024-09-12T00:56:52.995412+0000","last_active":"2024-09-12T01:06:37.459106+0000","last_peered":"2024-09-12T01:06:37.459106+0000","last_clean":"2024-09-12T01:06:37.459106+0000","last_became_active":"2024-09-12T00:56:52.995062+0000","last_became_peered":"2024-09-12T00:56:52.995062+0000","last_unstale":"2024-09-12T01:06:37.459106+0000","last_undegraded":"2024-09-12T01:06:37.459106+0000","last_fullsized":"2024-09-12T01:06:37.459106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.136639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475349+0000","last_change":"2024-09-12T00:46:19.285095+0000","last_active":"2024-09-12T01:08:27.475349+0000","last_peered":"2024-09-12T01:08:27.475349+0000","last_clean":"2024-09-12T01:08:27.475349+0000","last_became_active":"2024-09-12T00:46:19.284822+0000","last_became_peered":"2024-09-12T00:46:19.284822+0000","last_unstale":"2024-09-12T01:08:27.475349+0000","last_undegraded":"2024-09-12T01:08:27.475349+0000","last_fullsized":"2024-09-12T01:08:27.475349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:42.407553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411818+0000","last_change":"2024-09-12T00:46:16.261917+0000","last_active":"2024-09-12T01:09:13.411818+0000","last_peered":"2024-09-12T01:09:13.411818+0000","last_clean":"2024-09-12T01:09:13.411818+0000","last_became_active":"2024-09-12T00:46:16.261617+0000","last_became_peered":"2024-09-12T00:46:16.261617+0000","last_unstale":"2024-09-12T01:09:13.411818+0000","last_undegraded":"2024-09-12T01:09:13.411818+0000","last_fullsized":"2024-09-12T01:09:13.411818+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:45.217925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.392519+0000","last_change":"2024-09-12T00:44:37.815822+0000","last_active":"2024-09-12T01:08:00.392519+0000","last_peered":"2024-09-12T01:08:00.392519+0000","last_clean":"2024-09-12T01:08:00.392519+0000","last_became_active":"2024-09-12T00:44:37.815325+0000","last_became_peered":"2024-09-12T00:44:37.815325+0000","last_unstale":"2024-09-12T01:08:00.392519+0000","last_undegraded":"2024-09-12T01:08:00.392519+0000","last_fullsized":"2024-09-12T01:08:00.392519+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:41.073259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":218,"num_write":105,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389388+0000","last_change":"2024-09-12T00:56:52.991644+0000","last_active":"2024-09-12T01:08:53.389388+0000","last_peered":"2024-09-12T01:08:53.389388+0000","last_clean":"2024-09-12T01:08:53.389388+0000","last_became_active":"2024-09-12T00:56:52.991358+0000","last_became_peered":"2024-09-12T00:56:52.991358+0000","last_unstale":"2024-09-12T01:08:53.389388+0000","last_undegraded":"2024-09-12T01:08:53.389388+0000","last_fullsized":"2024-09-12T01:08:53.389388+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:23.445118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520059+0000","last_change":"2024-09-12T00:46:19.274308+0000","last_active":"2024-09-12T01:08:08.520059+0000","last_peered":"2024-09-12T01:08:08.520059+0000","last_clean":"2024-09-12T01:08:08.520059+0000","last_became_active":"2024-09-12T00:46:19.274024+0000","last_became_peered":"2024-09-12T00:46:19.274024+0000","last_unstale":"2024-09-12T01:08:08.520059+0000","last_undegraded":"2024-09-12T01:08:08.520059+0000","last_fullsized":"2024-09-12T01:08:08.520059+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.097376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.471438+0000","last_change":"2024-09-12T00:46:16.272503+0000","last_active":"2024-09-12T01:08:02.471438+0000","last_peered":"2024-09-12T01:08:02.471438+0000","last_clean":"2024-09-12T01:08:02.471438+0000","last_became_active":"2024-09-12T00:46:16.272230+0000","last_became_peered":"2024-09-12T00:46:16.272230+0000","last_unstale":"2024-09-12T01:08:02.471438+0000","last_undegraded":"2024-09-12T01:08:02.471438+0000","last_fullsized":"2024-09-12T01:08:02.471438+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:22.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'26","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375307+0000","last_change":"2024-09-12T00:44:37.821557+0000","last_active":"2024-09-12T01:07:07.375307+0000","last_peered":"2024-09-12T01:07:07.375307+0000","last_clean":"2024-09-12T01:07:07.375307+0000","last_became_active":"2024-09-12T00:44:37.821297+0000","last_became_peered":"2024-09-12T00:44:37.821297+0000","last_unstale":"2024-09-12T01:07:07.375307+0000","last_undegraded":"2024-09-12T01:07:07.375307+0000","last_fullsized":"2024-09-12T01:07:07.375307+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.631261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.506633+0000","last_change":"2024-09-12T00:56:52.990792+0000","last_active":"2024-09-12T01:07:17.506633+0000","last_peered":"2024-09-12T01:07:17.506633+0000","last_clean":"2024-09-12T01:07:17.506633+0000","last_became_active":"2024-09-12T00:56:52.990528+0000","last_became_peered":"2024-09-12T00:56:52.990528+0000","last_unstale":"2024-09-12T01:07:17.506633+0000","last_undegraded":"2024-09-12T01:07:17.506633+0000","last_fullsized":"2024-09-12T01:07:17.506633+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:30.175859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'7","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.222506+0000","last_change":"2024-09-12T00:46:19.281162+0000","last_active":"2024-09-12T01:11:23.222506+0000","last_peered":"2024-09-12T01:11:23.222506+0000","last_clean":"2024-09-12T01:11:23.222506+0000","last_became_active":"2024-09-12T00:46:19.280794+0000","last_became_peered":"2024-09-12T00:46:19.280794+0000","last_unstale":"2024-09-12T01:11:23.222506+0000","last_undegraded":"2024-09-12T01:11:23.222506+0000","last_fullsized":"2024-09-12T01:11:23.222506+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:50.182755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":12296,"num_write":7,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.599017+0000","last_change":"2024-09-12T00:46:16.267841+0000","last_active":"2024-09-12T01:08:08.599017+0000","last_peered":"2024-09-12T01:08:08.599017+0000","last_clean":"2024-09-12T01:08:08.599017+0000","last_became_active":"2024-09-12T00:46:16.267528+0000","last_became_peered":"2024-09-12T00:46:16.267528+0000","last_unstale":"2024-09-12T01:08:08.599017+0000","last_undegraded":"2024-09-12T01:08:08.599017+0000","last_fullsized":"2024-09-12T01:08:08.599017+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8204,"num_write":4,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'128","reported_seq":430,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.484992+0000","last_change":"2024-09-12T00:44:37.819828+0000","last_active":"2024-09-12T01:07:11.484992+0000","last_peered":"2024-09-12T01:07:11.484992+0000","last_clean":"2024-09-12T01:07:11.484992+0000","last_became_active":"2024-09-12T00:44:37.819556+0000","last_became_peered":"2024-09-12T00:44:37.819556+0000","last_unstale":"2024-09-12T01:07:11.484992+0000","last_undegraded":"2024-09-12T01:07:11.484992+0000","last_fullsized":"2024-09-12T01:07:11.484992+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:37.132092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":767,"num_read_kb":571,"num_write":157,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.482640+0000","last_change":"2024-09-12T00:56:52.992341+0000","last_active":"2024-09-12T01:06:56.482640+0000","last_peered":"2024-09-12T01:06:56.482640+0000","last_clean":"2024-09-12T01:06:56.482640+0000","last_became_active":"2024-09-12T00:56:52.992081+0000","last_became_peered":"2024-09-12T00:56:52.992081+0000","last_unstale":"2024-09-12T01:06:56.482640+0000","last_undegraded":"2024-09-12T01:06:56.482640+0000","last_fullsized":"2024-09-12T01:06:56.482640+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:38.856681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'6","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:51.498160+0000","last_change":"2024-09-12T00:46:19.280066+0000","last_active":"2024-09-12T01:08:51.498160+0000","last_peered":"2024-09-12T01:08:51.498160+0000","last_clean":"2024-09-12T01:08:51.498160+0000","last_became_active":"2024-09-12T00:46:19.279811+0000","last_became_peered":"2024-09-12T00:46:19.279811+0000","last_unstale":"2024-09-12T01:08:51.498160+0000","last_undegraded":"2024-09-12T01:08:51.498160+0000","last_fullsized":"2024-09-12T01:08:51.498160+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.923506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":13308,"num_write":11,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'4","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.524972+0000","last_change":"2024-09-12T00:46:16.274833+0000","last_active":"2024-09-12T01:08:48.524972+0000","last_peered":"2024-09-12T01:08:48.524972+0000","last_clean":"2024-09-12T01:08:48.524972+0000","last_became_active":"2024-09-12T00:46:16.274541+0000","last_became_peered":"2024-09-12T00:46:16.274541+0000","last_unstale":"2024-09-12T01:08:48.524972+0000","last_undegraded":"2024-09-12T01:08:48.524972+0000","last_fullsized":"2024-09-12T01:08:48.524972+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:58.251023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'13","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388468+0000","last_change":"2024-09-12T00:44:37.817411+0000","last_active":"2024-09-12T01:08:48.388468+0000","last_peered":"2024-09-12T01:08:48.388468+0000","last_clean":"2024-09-12T01:08:48.388468+0000","last_became_active":"2024-09-12T00:44:37.817108+0000","last_became_peered":"2024-09-12T00:44:37.817108+0000","last_unstale":"2024-09-12T01:08:48.388468+0000","last_undegraded":"2024-09-12T01:08:48.388468+0000","last_fullsized":"2024-09-12T01:08:48.388468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:45.282350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509925+0000","last_change":"2024-09-12T00:56:52.989648+0000","last_active":"2024-09-12T01:06:53.509925+0000","last_peered":"2024-09-12T01:06:53.509925+0000","last_clean":"2024-09-12T01:06:53.509925+0000","last_became_active":"2024-09-12T00:56:52.989394+0000","last_became_peered":"2024-09-12T00:56:52.989394+0000","last_unstale":"2024-09-12T01:06:53.509925+0000","last_undegraded":"2024-09-12T01:06:53.509925+0000","last_fullsized":"2024-09-12T01:06:53.509925+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:17.324226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389271+0000","last_change":"2024-09-12T00:46:19.282381+0000","last_active":"2024-09-12T01:08:53.389271+0000","last_peered":"2024-09-12T01:08:53.389271+0000","last_clean":"2024-09-12T01:08:53.389271+0000","last_became_active":"2024-09-12T00:46:19.280878+0000","last_became_peered":"2024-09-12T00:46:19.280878+0000","last_unstale":"2024-09-12T01:08:53.389271+0000","last_undegraded":"2024-09-12T01:08:53.389271+0000","last_fullsized":"2024-09-12T01:08:53.389271+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:37.733061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10236,"num_write":10,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'1","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389440+0000","last_change":"2024-09-12T00:46:16.278285+0000","last_active":"2024-09-12T01:08:47.389440+0000","last_peered":"2024-09-12T01:08:47.389440+0000","last_clean":"2024-09-12T01:08:47.389440+0000","last_became_active":"2024-09-12T00:46:16.277776+0000","last_became_peered":"2024-09-12T00:46:16.277776+0000","last_unstale":"2024-09-12T01:08:47.389440+0000","last_undegraded":"2024-09-12T01:08:47.389440+0000","last_fullsized":"2024-09-12T01:08:47.389440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:47.993297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'18","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389367+0000","last_change":"2024-09-12T00:44:37.816393+0000","last_active":"2024-09-12T01:08:47.389367+0000","last_peered":"2024-09-12T01:08:47.389367+0000","last_clean":"2024-09-12T01:08:47.389367+0000","last_became_active":"2024-09-12T00:44:37.815820+0000","last_became_peered":"2024-09-12T00:44:37.815820+0000","last_unstale":"2024-09-12T01:08:47.389367+0000","last_undegraded":"2024-09-12T01:08:47.389367+0000","last_fullsized":"2024-09-12T01:08:47.389367+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:49.470552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.475979+0000","last_change":"2024-09-12T00:56:52.996102+0000","last_active":"2024-09-12T01:08:32.475979+0000","last_peered":"2024-09-12T01:08:32.475979+0000","last_clean":"2024-09-12T01:08:32.475979+0000","last_became_active":"2024-09-12T00:56:52.995696+0000","last_became_peered":"2024-09-12T00:56:52.995696+0000","last_unstale":"2024-09-12T01:08:32.475979+0000","last_undegraded":"2024-09-12T01:08:32.475979+0000","last_fullsized":"2024-09-12T01:08:32.475979+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:57.634150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383372+0000","last_change":"2024-09-12T00:46:19.282715+0000","last_active":"2024-09-12T01:08:08.383372+0000","last_peered":"2024-09-12T01:08:08.383372+0000","last_clean":"2024-09-12T01:08:08.383372+0000","last_became_active":"2024-09-12T00:46:19.282466+0000","last_became_peered":"2024-09-12T00:46:19.282466+0000","last_unstale":"2024-09-12T01:08:08.383372+0000","last_undegraded":"2024-09-12T01:08:08.383372+0000","last_fullsized":"2024-09-12T01:08:08.383372+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.083481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.612173+0000","last_change":"2024-09-12T00:46:16.268948+0000","last_active":"2024-09-12T01:09:43.612173+0000","last_peered":"2024-09-12T01:09:43.612173+0000","last_clean":"2024-09-12T01:09:43.612173+0000","last_became_active":"2024-09-12T00:46:16.268479+0000","last_became_peered":"2024-09-12T00:46:16.268479+0000","last_unstale":"2024-09-12T01:09:43.612173+0000","last_undegraded":"2024-09-12T01:09:43.612173+0000","last_fullsized":"2024-09-12T01:09:43.612173+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:29.450733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519282+0000","last_change":"2024-09-12T00:44:37.811999+0000","last_active":"2024-09-12T01:08:47.519282+0000","last_peered":"2024-09-12T01:08:47.519282+0000","last_clean":"2024-09-12T01:08:47.519282+0000","last_became_active":"2024-09-12T00:44:37.811697+0000","last_became_peered":"2024-09-12T00:44:37.811697+0000","last_unstale":"2024-09-12T01:08:47.519282+0000","last_undegraded":"2024-09-12T01:08:47.519282+0000","last_fullsized":"2024-09-12T01:08:47.519282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:46.654992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":57,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.387544+0000","last_change":"2024-09-12T00:56:52.985166+0000","last_active":"2024-09-12T01:08:32.387544+0000","last_peered":"2024-09-12T01:08:32.387544+0000","last_clean":"2024-09-12T01:08:32.387544+0000","last_became_active":"2024-09-12T00:56:52.984878+0000","last_became_peered":"2024-09-12T00:56:52.984878+0000","last_unstale":"2024-09-12T01:08:32.387544+0000","last_undegraded":"2024-09-12T01:08:32.387544+0000","last_fullsized":"2024-09-12T01:08:32.387544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.409540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.466660+0000","last_change":"2024-09-12T00:46:19.276813+0000","last_active":"2024-09-12T01:07:27.466660+0000","last_peered":"2024-09-12T01:07:27.466660+0000","last_clean":"2024-09-12T01:07:27.466660+0000","last_became_active":"2024-09-12T00:46:19.276197+0000","last_became_peered":"2024-09-12T00:46:19.276197+0000","last_unstale":"2024-09-12T01:07:27.466660+0000","last_undegraded":"2024-09-12T01:07:27.466660+0000","last_fullsized":"2024-09-12T01:07:27.466660+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:53.182491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'7","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519377+0000","last_change":"2024-09-12T00:46:16.264295+0000","last_active":"2024-09-12T01:08:03.519377+0000","last_peered":"2024-09-12T01:08:03.519377+0000","last_clean":"2024-09-12T01:08:03.519377+0000","last_became_active":"2024-09-12T00:46:16.263870+0000","last_became_peered":"2024-09-12T00:46:16.263870+0000","last_unstale":"2024-09-12T01:08:03.519377+0000","last_undegraded":"2024-09-12T01:08:03.519377+0000","last_fullsized":"2024-09-12T01:08:03.519377+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:24.692637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":17,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'37","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519258+0000","last_change":"2024-09-12T00:44:37.820673+0000","last_active":"2024-09-12T01:08:47.519258+0000","last_peered":"2024-09-12T01:08:47.519258+0000","last_clean":"2024-09-12T01:08:47.519258+0000","last_became_active":"2024-09-12T00:44:37.820232+0000","last_became_peered":"2024-09-12T00:44:37.820232+0000","last_unstale":"2024-09-12T01:08:47.519258+0000","last_undegraded":"2024-09-12T01:08:47.519258+0000","last_fullsized":"2024-09-12T01:08:47.519258+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.688623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496180+0000","last_change":"2024-09-12T00:56:52.987731+0000","last_active":"2024-09-12T01:08:36.496180+0000","last_peered":"2024-09-12T01:08:36.496180+0000","last_clean":"2024-09-12T01:08:36.496180+0000","last_became_active":"2024-09-12T00:56:52.987492+0000","last_became_peered":"2024-09-12T00:56:52.987492+0000","last_unstale":"2024-09-12T01:08:36.496180+0000","last_undegraded":"2024-09-12T01:08:36.496180+0000","last_fullsized":"2024-09-12T01:08:36.496180+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.155360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'9","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383413+0000","last_change":"2024-09-12T00:46:19.287908+0000","last_active":"2024-09-12T01:08:08.383413+0000","last_peered":"2024-09-12T01:08:08.383413+0000","last_clean":"2024-09-12T01:08:08.383413+0000","last_became_active":"2024-09-12T00:46:19.286860+0000","last_became_peered":"2024-09-12T00:46:19.286860+0000","last_unstale":"2024-09-12T01:08:08.383413+0000","last_undegraded":"2024-09-12T01:08:08.383413+0000","last_fullsized":"2024-09-12T01:08:08.383413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:54.927557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13316,"num_write":14,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.382795+0000","last_change":"2024-09-12T00:46:16.279497+0000","last_active":"2024-09-12T01:08:03.382795+0000","last_peered":"2024-09-12T01:08:03.382795+0000","last_clean":"2024-09-12T01:08:03.382795+0000","last_became_active":"2024-09-12T00:46:16.279114+0000","last_became_peered":"2024-09-12T00:46:16.279114+0000","last_unstale":"2024-09-12T01:08:03.382795+0000","last_undegraded":"2024-09-12T01:08:03.382795+0000","last_fullsized":"2024-09-12T01:08:03.382795+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:42.826584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":2,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'25","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388537+0000","last_change":"2024-09-12T00:44:37.819571+0000","last_active":"2024-09-12T01:08:48.388537+0000","last_peered":"2024-09-12T01:08:48.388537+0000","last_clean":"2024-09-12T01:08:48.388537+0000","last_became_active":"2024-09-12T00:44:37.819153+0000","last_became_peered":"2024-09-12T00:44:37.819153+0000","last_unstale":"2024-09-12T01:08:48.388537+0000","last_undegraded":"2024-09-12T01:08:48.388537+0000","last_fullsized":"2024-09-12T01:08:48.388537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:27.117588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":89,"num_write":41,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.523138+0000","last_change":"2024-09-12T00:56:52.990539+0000","last_active":"2024-09-12T01:08:33.523138+0000","last_peered":"2024-09-12T01:08:33.523138+0000","last_clean":"2024-09-12T01:08:33.523138+0000","last_became_active":"2024-09-12T00:56:52.990265+0000","last_became_peered":"2024-09-12T00:56:52.990265+0000","last_unstale":"2024-09-12T01:08:33.523138+0000","last_undegraded":"2024-09-12T01:08:33.523138+0000","last_fullsized":"2024-09-12T01:08:33.523138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:41.315107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519397+0000","last_change":"2024-09-12T00:46:19.277307+0000","last_active":"2024-09-12T01:08:03.519397+0000","last_peered":"2024-09-12T01:08:03.519397+0000","last_clean":"2024-09-12T01:08:03.519397+0000","last_became_active":"2024-09-12T00:46:19.277011+0000","last_became_peered":"2024-09-12T00:46:19.277011+0000","last_unstale":"2024-09-12T01:08:03.519397+0000","last_undegraded":"2024-09-12T01:08:03.519397+0000","last_fullsized":"2024-09-12T01:08:03.519397+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:43.590749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.471543+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:08:02.471543+0000","last_peered":"2024-09-12T01:08:02.471543+0000","last_clean":"2024-09-12T01:08:02.471543+0000","last_became_active":"2024-09-12T00:46:16.275403+0000","last_became_peered":"2024-09-12T00:46:16.275403+0000","last_unstale":"2024-09-12T01:08:02.471543+0000","last_undegraded":"2024-09-12T01:08:02.471543+0000","last_fullsized":"2024-09-12T01:08:02.471543+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.331770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202496,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5128,"num_write":2,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"264'68","reported_seq":266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.598342+0000","last_change":"2024-09-12T00:44:37.821656+0000","last_active":"2024-09-12T01:08:03.598342+0000","last_peered":"2024-09-12T01:08:03.598342+0000","last_clean":"2024-09-12T01:08:03.598342+0000","last_became_active":"2024-09-12T00:44:37.821192+0000","last_became_peered":"2024-09-12T00:44:37.821192+0000","last_unstale":"2024-09-12T01:08:03.598342+0000","last_undegraded":"2024-09-12T01:08:03.598342+0000","last_fullsized":"2024-09-12T01:08:03.598342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:14.342220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":323,"num_write":87,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479794+0000","last_change":"2024-09-12T00:56:52.995841+0000","last_active":"2024-09-12T01:08:57.479794+0000","last_peered":"2024-09-12T01:08:57.479794+0000","last_clean":"2024-09-12T01:08:57.479794+0000","last_became_active":"2024-09-12T00:56:52.995495+0000","last_became_peered":"2024-09-12T00:56:52.995495+0000","last_unstale":"2024-09-12T01:08:57.479794+0000","last_undegraded":"2024-09-12T01:08:57.479794+0000","last_fullsized":"2024-09-12T01:08:57.479794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:07.859390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:22.465900+0000","last_change":"2024-09-12T00:46:19.280925+0000","last_active":"2024-09-12T01:07:22.465900+0000","last_peered":"2024-09-12T01:07:22.465900+0000","last_clean":"2024-09-12T01:07:22.465900+0000","last_became_active":"2024-09-12T00:46:19.280653+0000","last_became_peered":"2024-09-12T00:46:19.280653+0000","last_unstale":"2024-09-12T01:07:22.465900+0000","last_undegraded":"2024-09-12T01:07:22.465900+0000","last_fullsized":"2024-09-12T01:07:22.465900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:20.246986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10256,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"261'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396139+0000","last_change":"2024-09-12T00:46:16.270257+0000","last_active":"2024-09-12T01:07:18.396139+0000","last_peered":"2024-09-12T01:07:18.396139+0000","last_clean":"2024-09-12T01:07:18.396139+0000","last_became_active":"2024-09-12T00:46:16.270004+0000","last_became_peered":"2024-09-12T00:46:16.270004+0000","last_unstale":"2024-09-12T01:07:18.396139+0000","last_undegraded":"2024-09-12T01:07:18.396139+0000","last_fullsized":"2024-09-12T01:07:18.396139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:08.342727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'15","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.597733+0000","last_change":"2024-09-12T00:44:37.820954+0000","last_active":"2024-09-12T01:07:58.597733+0000","last_peered":"2024-09-12T01:07:58.597733+0000","last_clean":"2024-09-12T01:07:58.597733+0000","last_became_active":"2024-09-12T00:44:37.820639+0000","last_became_peered":"2024-09-12T00:44:37.820639+0000","last_unstale":"2024-09-12T01:07:58.597733+0000","last_undegraded":"2024-09-12T01:07:58.597733+0000","last_fullsized":"2024-09-12T01:07:58.597733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:51.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391071+0000","last_change":"2024-09-12T00:56:52.991542+0000","last_active":"2024-09-12T01:08:57.391071+0000","last_peered":"2024-09-12T01:08:57.391071+0000","last_clean":"2024-09-12T01:08:57.391071+0000","last_became_active":"2024-09-12T00:56:52.991261+0000","last_became_peered":"2024-09-12T00:56:52.991261+0000","last_unstale":"2024-09-12T01:08:57.391071+0000","last_undegraded":"2024-09-12T01:08:57.391071+0000","last_fullsized":"2024-09-12T01:08:57.391071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:08.574079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:22.465859+0000","last_change":"2024-09-12T00:46:19.282895+0000","last_active":"2024-09-12T01:07:22.465859+0000","last_peered":"2024-09-12T01:07:22.465859+0000","last_clean":"2024-09-12T01:07:22.465859+0000","last_became_active":"2024-09-12T00:46:19.281676+0000","last_became_peered":"2024-09-12T00:46:19.281676+0000","last_unstale":"2024-09-12T01:07:22.465859+0000","last_undegraded":"2024-09-12T01:07:22.465859+0000","last_fullsized":"2024-09-12T01:07:22.465859+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.550417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465156+0000","last_change":"2024-09-12T00:46:16.276429+0000","last_active":"2024-09-12T01:07:17.465156+0000","last_peered":"2024-09-12T01:07:17.465156+0000","last_clean":"2024-09-12T01:07:17.465156+0000","last_became_active":"2024-09-12T00:46:16.276180+0000","last_became_peered":"2024-09-12T00:46:16.276180+0000","last_unstale":"2024-09-12T01:07:17.465156+0000","last_undegraded":"2024-09-12T01:07:17.465156+0000","last_fullsized":"2024-09-12T01:07:17.465156+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:48.188004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382200+0000","last_change":"2024-09-12T00:44:37.820502+0000","last_active":"2024-09-12T01:07:58.382200+0000","last_peered":"2024-09-12T01:07:58.382200+0000","last_clean":"2024-09-12T01:07:58.382200+0000","last_became_active":"2024-09-12T00:44:37.820217+0000","last_became_peered":"2024-09-12T00:44:37.820217+0000","last_unstale":"2024-09-12T01:07:58.382200+0000","last_undegraded":"2024-09-12T01:07:58.382200+0000","last_fullsized":"2024-09-12T01:07:58.382200+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.838632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":127,"num_write":61,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.517081+0000","last_change":"2024-09-12T00:56:52.989385+0000","last_active":"2024-09-12T01:08:32.517081+0000","last_peered":"2024-09-12T01:08:32.517081+0000","last_clean":"2024-09-12T01:08:32.517081+0000","last_became_active":"2024-09-12T00:56:52.988302+0000","last_became_peered":"2024-09-12T00:56:52.988302+0000","last_unstale":"2024-09-12T01:08:32.517081+0000","last_undegraded":"2024-09-12T01:08:32.517081+0000","last_fullsized":"2024-09-12T01:08:32.517081+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:40.813037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'7","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.377182+0000","last_change":"2024-09-12T00:46:19.285378+0000","last_active":"2024-09-12T01:07:23.377182+0000","last_peered":"2024-09-12T01:07:23.377182+0000","last_clean":"2024-09-12T01:07:23.377182+0000","last_became_active":"2024-09-12T00:46:19.280889+0000","last_became_peered":"2024-09-12T00:46:19.280889+0000","last_unstale":"2024-09-12T01:07:23.377182+0000","last_undegraded":"2024-09-12T01:07:23.377182+0000","last_fullsized":"2024-09-12T01:07:23.377182+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:56.282208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7182,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396190+0000","last_change":"2024-09-12T00:46:16.263413+0000","last_active":"2024-09-12T01:07:18.396190+0000","last_peered":"2024-09-12T01:07:18.396190+0000","last_clean":"2024-09-12T01:07:18.396190+0000","last_became_active":"2024-09-12T00:46:16.263065+0000","last_became_peered":"2024-09-12T00:46:16.263065+0000","last_unstale":"2024-09-12T01:07:18.396190+0000","last_undegraded":"2024-09-12T01:07:18.396190+0000","last_fullsized":"2024-09-12T01:07:18.396190+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:23.322080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.491664+0000","last_change":"2024-09-12T00:44:37.814881+0000","last_active":"2024-09-12T01:08:01.491664+0000","last_peered":"2024-09-12T01:08:01.491664+0000","last_clean":"2024-09-12T01:08:01.491664+0000","last_became_active":"2024-09-12T00:44:37.814584+0000","last_became_peered":"2024-09-12T00:44:37.814584+0000","last_unstale":"2024-09-12T01:08:01.491664+0000","last_undegraded":"2024-09-12T01:08:01.491664+0000","last_fullsized":"2024-09-12T01:08:01.491664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:18.206072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391027+0000","last_change":"2024-09-12T00:56:52.991853+0000","last_active":"2024-09-12T01:08:57.391027+0000","last_peered":"2024-09-12T01:08:57.391027+0000","last_clean":"2024-09-12T01:08:57.391027+0000","last_became_active":"2024-09-12T00:56:52.990830+0000","last_became_peered":"2024-09-12T00:56:52.990830+0000","last_unstale":"2024-09-12T01:08:57.391027+0000","last_undegraded":"2024-09-12T01:08:57.391027+0000","last_fullsized":"2024-09-12T01:08:57.391027+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:49.621390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'10","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.611466+0000","last_change":"2024-09-12T00:46:19.285059+0000","last_active":"2024-09-12T01:09:38.611466+0000","last_peered":"2024-09-12T01:09:38.611466+0000","last_clean":"2024-09-12T01:09:38.611466+0000","last_became_active":"2024-09-12T00:46:19.284748+0000","last_became_peered":"2024-09-12T00:46:19.284748+0000","last_unstale":"2024-09-12T01:09:38.611466+0000","last_undegraded":"2024-09-12T01:09:38.611466+0000","last_fullsized":"2024-09-12T01:09:38.611466+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:39.933756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8194,"num_write":15,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"261'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396223+0000","last_change":"2024-09-12T00:46:16.274496+0000","last_active":"2024-09-12T01:07:18.396223+0000","last_peered":"2024-09-12T01:07:18.396223+0000","last_clean":"2024-09-12T01:07:18.396223+0000","last_became_active":"2024-09-12T00:46:16.274209+0000","last_became_peered":"2024-09-12T00:46:16.274209+0000","last_unstale":"2024-09-12T01:07:18.396223+0000","last_undegraded":"2024-09-12T01:07:18.396223+0000","last_fullsized":"2024-09-12T01:07:18.396223+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:33.536444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":10,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382153+0000","last_change":"2024-09-12T00:44:37.819591+0000","last_active":"2024-09-12T01:07:58.382153+0000","last_peered":"2024-09-12T01:07:58.382153+0000","last_clean":"2024-09-12T01:07:58.382153+0000","last_became_active":"2024-09-12T00:44:37.819298+0000","last_became_peered":"2024-09-12T00:44:37.819298+0000","last_unstale":"2024-09-12T01:07:58.382153+0000","last_undegraded":"2024-09-12T01:07:58.382153+0000","last_fullsized":"2024-09-12T01:07:58.382153+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:00.112592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.469348+0000","last_change":"2024-09-12T00:56:52.996314+0000","last_active":"2024-09-12T01:07:47.469348+0000","last_peered":"2024-09-12T01:07:47.469348+0000","last_clean":"2024-09-12T01:07:47.469348+0000","last_became_active":"2024-09-12T00:56:52.996048+0000","last_became_peered":"2024-09-12T00:56:52.996048+0000","last_unstale":"2024-09-12T01:07:47.469348+0000","last_undegraded":"2024-09-12T01:07:47.469348+0000","last_fullsized":"2024-09-12T01:07:47.469348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.954796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.408810+0000","last_change":"2024-09-12T00:46:19.286025+0000","last_active":"2024-09-12T01:11:08.408810+0000","last_peered":"2024-09-12T01:11:08.408810+0000","last_clean":"2024-09-12T01:11:08.408810+0000","last_became_active":"2024-09-12T00:46:19.285304+0000","last_became_peered":"2024-09-12T00:46:19.285304+0000","last_unstale":"2024-09-12T01:11:08.408810+0000","last_undegraded":"2024-09-12T01:11:08.408810+0000","last_fullsized":"2024-09-12T01:11:08.408810+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:59.248323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2428,"num_write":3,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.497525+0000","last_change":"2024-09-12T00:46:16.272142+0000","last_active":"2024-09-12T01:08:46.497525+0000","last_peered":"2024-09-12T01:08:46.497525+0000","last_clean":"2024-09-12T01:08:46.497525+0000","last_became_active":"2024-09-12T00:46:16.271839+0000","last_became_peered":"2024-09-12T00:46:16.271839+0000","last_unstale":"2024-09-12T01:08:46.497525+0000","last_undegraded":"2024-09-12T01:08:46.497525+0000","last_fullsized":"2024-09-12T01:08:46.497525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:04.288299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"264'41","reported_seq":151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.650570+0000","last_change":"2024-09-12T00:44:37.822164+0000","last_active":"2024-09-12T01:08:56.650570+0000","last_peered":"2024-09-12T01:08:56.650570+0000","last_clean":"2024-09-12T01:08:56.650570+0000","last_became_active":"2024-09-12T00:44:37.821837+0000","last_became_peered":"2024-09-12T00:44:37.821837+0000","last_unstale":"2024-09-12T01:08:56.650570+0000","last_undegraded":"2024-09-12T01:08:56.650570+0000","last_fullsized":"2024-09-12T01:08:56.650570+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:59.825047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":140,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403198+0000","last_change":"2024-09-12T00:56:52.996477+0000","last_active":"2024-09-12T01:08:08.403198+0000","last_peered":"2024-09-12T01:08:08.403198+0000","last_clean":"2024-09-12T01:08:08.403198+0000","last_became_active":"2024-09-12T00:56:52.996287+0000","last_became_peered":"2024-09-12T00:56:52.996287+0000","last_unstale":"2024-09-12T01:08:08.403198+0000","last_undegraded":"2024-09-12T01:08:08.403198+0000","last_fullsized":"2024-09-12T01:08:08.403198+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:34.040673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389308+0000","last_change":"2024-09-12T00:46:19.284780+0000","last_active":"2024-09-12T01:08:53.389308+0000","last_peered":"2024-09-12T01:08:53.389308+0000","last_clean":"2024-09-12T01:08:53.389308+0000","last_became_active":"2024-09-12T00:46:19.284490+0000","last_became_peered":"2024-09-12T00:46:19.284490+0000","last_unstale":"2024-09-12T01:08:53.389308+0000","last_undegraded":"2024-09-12T01:08:53.389308+0000","last_fullsized":"2024-09-12T01:08:53.389308+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.303903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"264'9","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389475+0000","last_change":"2024-09-12T00:46:16.275634+0000","last_active":"2024-09-12T01:08:47.389475+0000","last_peered":"2024-09-12T01:08:47.389475+0000","last_clean":"2024-09-12T01:08:47.389475+0000","last_became_active":"2024-09-12T00:46:16.275312+0000","last_became_peered":"2024-09-12T00:46:16.275312+0000","last_unstale":"2024-09-12T01:08:47.389475+0000","last_undegraded":"2024-09-12T01:08:47.389475+0000","last_fullsized":"2024-09-12T01:08:47.389475+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.528193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20478,"num_write":19,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'42","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590315+0000","last_change":"2024-09-12T00:44:37.819546+0000","last_active":"2024-09-12T01:07:08.590315+0000","last_peered":"2024-09-12T01:07:08.590315+0000","last_clean":"2024-09-12T01:07:08.590315+0000","last_became_active":"2024-09-12T00:44:37.819289+0000","last_became_peered":"2024-09-12T00:44:37.819289+0000","last_unstale":"2024-09-12T01:07:08.590315+0000","last_undegraded":"2024-09-12T01:07:08.590315+0000","last_fullsized":"2024-09-12T01:07:08.590315+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:38.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":167,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.595680+0000","last_change":"2024-09-12T00:56:52.987494+0000","last_active":"2024-09-12T01:07:43.595680+0000","last_peered":"2024-09-12T01:07:43.595680+0000","last_clean":"2024-09-12T01:07:43.595680+0000","last_became_active":"2024-09-12T00:56:52.987226+0000","last_became_peered":"2024-09-12T00:56:52.987226+0000","last_unstale":"2024-09-12T01:07:43.595680+0000","last_undegraded":"2024-09-12T01:07:43.595680+0000","last_fullsized":"2024-09-12T01:07:43.595680+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:25.549274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389413+0000","last_change":"2024-09-12T00:46:19.287340+0000","last_active":"2024-09-12T01:08:53.389413+0000","last_peered":"2024-09-12T01:08:53.389413+0000","last_clean":"2024-09-12T01:08:53.389413+0000","last_became_active":"2024-09-12T00:46:19.287067+0000","last_became_peered":"2024-09-12T00:46:19.287067+0000","last_unstale":"2024-09-12T01:08:53.389413+0000","last_undegraded":"2024-09-12T01:08:53.389413+0000","last_fullsized":"2024-09-12T01:08:53.389413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.086451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641131,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2174,"num_write":2,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:03.408116+0000","last_change":"2024-09-12T00:46:16.278474+0000","last_active":"2024-09-12T01:11:03.408116+0000","last_peered":"2024-09-12T01:11:03.408116+0000","last_clean":"2024-09-12T01:11:03.408116+0000","last_became_active":"2024-09-12T00:46:16.278205+0000","last_became_peered":"2024-09-12T00:46:16.278205+0000","last_unstale":"2024-09-12T01:11:03.408116+0000","last_undegraded":"2024-09-12T01:11:03.408116+0000","last_fullsized":"2024-09-12T01:11:03.408116+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:45.398336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'62","reported_seq":211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.997717+0000","last_change":"2024-09-12T00:44:37.811854+0000","last_active":"2024-09-12T01:08:52.997717+0000","last_peered":"2024-09-12T01:08:52.997717+0000","last_clean":"2024-09-12T01:08:52.997717+0000","last_became_active":"2024-09-12T00:44:37.811544+0000","last_became_peered":"2024-09-12T00:44:37.811544+0000","last_unstale":"2024-09-12T01:08:52.997717+0000","last_undegraded":"2024-09-12T01:08:52.997717+0000","last_fullsized":"2024-09-12T01:08:52.997717+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:05.666736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":232,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.399787+0000","last_change":"2024-09-12T00:56:52.989633+0000","last_active":"2024-09-12T01:07:43.399787+0000","last_peered":"2024-09-12T01:07:43.399787+0000","last_clean":"2024-09-12T01:07:43.399787+0000","last_became_active":"2024-09-12T00:56:52.988985+0000","last_became_peered":"2024-09-12T00:56:52.988985+0000","last_unstale":"2024-09-12T01:07:43.399787+0000","last_undegraded":"2024-09-12T01:07:43.399787+0000","last_fullsized":"2024-09-12T01:07:43.399787+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:47.578076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'10","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479160+0000","last_change":"2024-09-12T00:46:19.279808+0000","last_active":"2024-09-12T01:08:52.479160+0000","last_peered":"2024-09-12T01:08:52.479160+0000","last_clean":"2024-09-12T01:08:52.479160+0000","last_became_active":"2024-09-12T00:46:19.279527+0000","last_became_peered":"2024-09-12T00:46:19.279527+0000","last_unstale":"2024-09-12T01:08:52.479160+0000","last_undegraded":"2024-09-12T01:08:52.479160+0000","last_fullsized":"2024-09-12T01:08:52.479160+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:07.362005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8190,"num_write":20,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388598+0000","last_change":"2024-09-12T00:46:16.273882+0000","last_active":"2024-09-12T01:08:48.388598+0000","last_peered":"2024-09-12T01:08:48.388598+0000","last_clean":"2024-09-12T01:08:48.388598+0000","last_became_active":"2024-09-12T00:46:16.273598+0000","last_became_peered":"2024-09-12T00:46:16.273598+0000","last_unstale":"2024-09-12T01:08:48.388598+0000","last_undegraded":"2024-09-12T01:08:48.388598+0000","last_fullsized":"2024-09-12T01:08:48.388598+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:16.097567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'41","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.165530+0000","last_change":"2024-09-12T00:44:37.813325+0000","last_active":"2024-09-12T01:08:57.165530+0000","last_peered":"2024-09-12T01:08:57.165530+0000","last_clean":"2024-09-12T01:08:57.165530+0000","last_became_active":"2024-09-12T00:44:37.813081+0000","last_became_peered":"2024-09-12T00:44:37.813081+0000","last_unstale":"2024-09-12T01:08:57.165530+0000","last_undegraded":"2024-09-12T01:08:57.165530+0000","last_fullsized":"2024-09-12T01:08:57.165530+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:39.795060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":146,"num_write":78,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.472330+0000","last_change":"2024-09-12T00:56:52.995736+0000","last_active":"2024-09-12T01:08:07.472330+0000","last_peered":"2024-09-12T01:08:07.472330+0000","last_clean":"2024-09-12T01:08:07.472330+0000","last_became_active":"2024-09-12T00:56:52.995412+0000","last_became_peered":"2024-09-12T00:56:52.995412+0000","last_unstale":"2024-09-12T01:08:07.472330+0000","last_undegraded":"2024-09-12T01:08:07.472330+0000","last_fullsized":"2024-09-12T01:08:07.472330+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:15.173930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.597690+0000","last_change":"2024-09-12T00:46:19.283005+0000","last_active":"2024-09-12T01:07:58.597690+0000","last_peered":"2024-09-12T01:07:58.597690+0000","last_clean":"2024-09-12T01:07:58.597690+0000","last_became_active":"2024-09-12T00:46:19.282672+0000","last_became_peered":"2024-09-12T00:46:19.282672+0000","last_unstale":"2024-09-12T01:07:58.597690+0000","last_undegraded":"2024-09-12T01:07:58.597690+0000","last_fullsized":"2024-09-12T01:07:58.597690+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:25.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'8","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.400080+0000","last_change":"2024-09-12T00:46:16.266194+0000","last_active":"2024-09-12T01:10:08.400080+0000","last_peered":"2024-09-12T01:10:08.400080+0000","last_clean":"2024-09-12T01:10:08.400080+0000","last_became_active":"2024-09-12T00:46:16.265927+0000","last_became_peered":"2024-09-12T00:46:16.265927+0000","last_unstale":"2024-09-12T01:10:08.400080+0000","last_undegraded":"2024-09-12T01:10:08.400080+0000","last_fullsized":"2024-09-12T01:10:08.400080+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:30.967366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'26","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375318+0000","last_change":"2024-09-12T00:44:37.820836+0000","last_active":"2024-09-12T01:07:07.375318+0000","last_peered":"2024-09-12T01:07:07.375318+0000","last_clean":"2024-09-12T01:07:07.375318+0000","last_became_active":"2024-09-12T00:44:37.820584+0000","last_became_peered":"2024-09-12T00:44:37.820584+0000","last_unstale":"2024-09-12T01:07:07.375318+0000","last_undegraded":"2024-09-12T01:07:07.375318+0000","last_fullsized":"2024-09-12T01:07:07.375318+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:59.394929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.493580+0000","last_change":"2024-09-12T00:56:52.994371+0000","last_active":"2024-09-12T01:08:16.493580+0000","last_peered":"2024-09-12T01:08:16.493580+0000","last_clean":"2024-09-12T01:08:16.493580+0000","last_became_active":"2024-09-12T00:56:52.994132+0000","last_became_peered":"2024-09-12T00:56:52.994132+0000","last_unstale":"2024-09-12T01:08:16.493580+0000","last_undegraded":"2024-09-12T01:08:16.493580+0000","last_fullsized":"2024-09-12T01:08:16.493580+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:57.349446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.491642+0000","last_change":"2024-09-12T00:46:19.281067+0000","last_active":"2024-09-12T01:08:01.491642+0000","last_peered":"2024-09-12T01:08:01.491642+0000","last_clean":"2024-09-12T01:08:01.491642+0000","last_became_active":"2024-09-12T00:46:19.280726+0000","last_became_peered":"2024-09-12T00:46:19.280726+0000","last_unstale":"2024-09-12T01:08:01.491642+0000","last_undegraded":"2024-09-12T01:08:01.491642+0000","last_fullsized":"2024-09-12T01:08:01.491642+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:00.902460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202496,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5128,"num_write":8,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.470726+0000","last_change":"2024-09-12T00:46:16.276183+0000","last_active":"2024-09-12T01:07:57.470726+0000","last_peered":"2024-09-12T01:07:57.470726+0000","last_clean":"2024-09-12T01:07:57.470726+0000","last_became_active":"2024-09-12T00:46:16.275908+0000","last_became_peered":"2024-09-12T00:46:16.275908+0000","last_unstale":"2024-09-12T01:07:57.470726+0000","last_undegraded":"2024-09-12T01:07:57.470726+0000","last_fullsized":"2024-09-12T01:07:57.470726+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:52.232454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496227+0000","last_change":"2024-09-12T00:44:37.812084+0000","last_active":"2024-09-12T01:08:36.496227+0000","last_peered":"2024-09-12T01:08:36.496227+0000","last_clean":"2024-09-12T01:08:36.496227+0000","last_became_active":"2024-09-12T00:44:37.811613+0000","last_became_peered":"2024-09-12T00:44:37.811613+0000","last_unstale":"2024-09-12T01:08:36.496227+0000","last_undegraded":"2024-09-12T01:08:36.496227+0000","last_fullsized":"2024-09-12T01:08:36.496227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:51.317906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520108+0000","last_change":"2024-09-12T00:56:52.989823+0000","last_active":"2024-09-12T01:08:08.520108+0000","last_peered":"2024-09-12T01:08:08.520108+0000","last_clean":"2024-09-12T01:08:08.520108+0000","last_became_active":"2024-09-12T00:56:52.989552+0000","last_became_peered":"2024-09-12T00:56:52.989552+0000","last_unstale":"2024-09-12T01:08:08.520108+0000","last_undegraded":"2024-09-12T01:08:08.520108+0000","last_fullsized":"2024-09-12T01:08:08.520108+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:32.733496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390164+0000","last_change":"2024-09-12T00:46:19.282416+0000","last_active":"2024-09-12T01:08:52.390164+0000","last_peered":"2024-09-12T01:08:52.390164+0000","last_clean":"2024-09-12T01:08:52.390164+0000","last_became_active":"2024-09-12T00:46:19.282137+0000","last_became_peered":"2024-09-12T00:46:19.282137+0000","last_unstale":"2024-09-12T01:08:52.390164+0000","last_undegraded":"2024-09-12T01:08:52.390164+0000","last_fullsized":"2024-09-12T01:08:52.390164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:16.519283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557118+0000","last_change":"2024-09-12T00:46:16.274482+0000","last_active":"2024-09-12T01:11:22.557118+0000","last_peered":"2024-09-12T01:11:22.557118+0000","last_clean":"2024-09-12T01:11:22.557118+0000","last_became_active":"2024-09-12T00:46:16.274198+0000","last_became_peered":"2024-09-12T00:46:16.274198+0000","last_unstale":"2024-09-12T01:11:22.557118+0000","last_undegraded":"2024-09-12T01:11:22.557118+0000","last_fullsized":"2024-09-12T01:11:22.557118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:47.458869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2619,"num_write":4,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475262+0000","last_change":"2024-09-12T00:44:37.814764+0000","last_active":"2024-09-12T01:08:27.475262+0000","last_peered":"2024-09-12T01:08:27.475262+0000","last_clean":"2024-09-12T01:08:27.475262+0000","last_became_active":"2024-09-12T00:44:37.814480+0000","last_became_peered":"2024-09-12T00:44:37.814480+0000","last_unstale":"2024-09-12T01:08:27.475262+0000","last_undegraded":"2024-09-12T01:08:27.475262+0000","last_fullsized":"2024-09-12T01:08:27.475262+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:18.473305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383351+0000","last_change":"2024-09-12T00:56:52.997107+0000","last_active":"2024-09-12T01:08:08.383351+0000","last_peered":"2024-09-12T01:08:08.383351+0000","last_clean":"2024-09-12T01:08:08.383351+0000","last_became_active":"2024-09-12T00:56:52.996816+0000","last_became_peered":"2024-09-12T00:56:52.996816+0000","last_unstale":"2024-09-12T01:08:08.383351+0000","last_undegraded":"2024-09-12T01:08:08.383351+0000","last_fullsized":"2024-09-12T01:08:08.383351+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:21.071571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519342+0000","last_change":"2024-09-12T00:46:19.276670+0000","last_active":"2024-09-12T01:08:03.519342+0000","last_peered":"2024-09-12T01:08:03.519342+0000","last_clean":"2024-09-12T01:08:03.519342+0000","last_became_active":"2024-09-12T00:46:19.276366+0000","last_became_peered":"2024-09-12T00:46:19.276366+0000","last_unstale":"2024-09-12T01:08:03.519342+0000","last_undegraded":"2024-09-12T01:08:03.519342+0000","last_fullsized":"2024-09-12T01:08:03.519342+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:52.413983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.604649+0000","last_change":"2024-09-12T00:46:16.274311+0000","last_active":"2024-09-12T01:08:48.604649+0000","last_peered":"2024-09-12T01:08:48.604649+0000","last_clean":"2024-09-12T01:08:48.604649+0000","last_became_active":"2024-09-12T00:46:16.273821+0000","last_became_peered":"2024-09-12T00:46:16.273821+0000","last_unstale":"2024-09-12T01:08:48.604649+0000","last_undegraded":"2024-09-12T01:08:48.604649+0000","last_fullsized":"2024-09-12T01:08:48.604649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:14.476953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.522282+0000","last_change":"2024-09-12T00:44:37.817651+0000","last_active":"2024-09-12T01:08:28.522282+0000","last_peered":"2024-09-12T01:08:28.522282+0000","last_clean":"2024-09-12T01:08:28.522282+0000","last_became_active":"2024-09-12T00:44:37.817357+0000","last_became_peered":"2024-09-12T00:44:37.817357+0000","last_unstale":"2024-09-12T01:08:28.522282+0000","last_undegraded":"2024-09-12T01:08:28.522282+0000","last_fullsized":"2024-09-12T01:08:28.522282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:32.676919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.513328+0000","last_change":"2024-09-12T00:56:52.991150+0000","last_active":"2024-09-12T01:07:18.513328+0000","last_peered":"2024-09-12T01:07:18.513328+0000","last_clean":"2024-09-12T01:07:18.513328+0000","last_became_active":"2024-09-12T00:56:52.990450+0000","last_became_peered":"2024-09-12T00:56:52.990450+0000","last_unstale":"2024-09-12T01:07:18.513328+0000","last_undegraded":"2024-09-12T01:07:18.513328+0000","last_fullsized":"2024-09-12T01:07:18.513328+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:08.753872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"264'7","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465243+0000","last_change":"2024-09-12T00:46:19.281700+0000","last_active":"2024-09-12T01:07:17.465243+0000","last_peered":"2024-09-12T01:07:17.465243+0000","last_clean":"2024-09-12T01:07:17.465243+0000","last_became_active":"2024-09-12T00:46:19.281413+0000","last_became_peered":"2024-09-12T00:46:19.281413+0000","last_unstale":"2024-09-12T01:07:17.465243+0000","last_undegraded":"2024-09-12T01:07:17.465243+0000","last_fullsized":"2024-09-12T01:07:17.465243+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:32.000629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":16941,"num_write":7,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"264'8","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.055888+0000","last_change":"2024-09-12T00:46:16.272138+0000","last_active":"2024-09-12T01:11:23.055888+0000","last_peered":"2024-09-12T01:11:23.055888+0000","last_clean":"2024-09-12T01:11:23.055888+0000","last_became_active":"2024-09-12T00:46:16.271730+0000","last_became_peered":"2024-09-12T00:46:16.271730+0000","last_unstale":"2024-09-12T01:11:23.055888+0000","last_undegraded":"2024-09-12T01:11:23.055888+0000","last_fullsized":"2024-09-12T01:11:23.055888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:24.991885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11841,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516358+0000","last_change":"2024-09-12T00:44:37.815831+0000","last_active":"2024-09-12T01:08:27.516358+0000","last_peered":"2024-09-12T01:08:27.516358+0000","last_clean":"2024-09-12T01:08:27.516358+0000","last_became_active":"2024-09-12T00:44:37.815542+0000","last_became_peered":"2024-09-12T00:44:37.815542+0000","last_unstale":"2024-09-12T01:08:27.516358+0000","last_undegraded":"2024-09-12T01:08:27.516358+0000","last_fullsized":"2024-09-12T01:08:27.516358+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.238225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":55,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.513375+0000","last_change":"2024-09-12T00:56:52.988965+0000","last_active":"2024-09-12T01:07:18.513375+0000","last_peered":"2024-09-12T01:07:18.513375+0000","last_clean":"2024-09-12T01:07:18.513375+0000","last_became_active":"2024-09-12T00:56:52.988702+0000","last_became_peered":"2024-09-12T00:56:52.988702+0000","last_unstale":"2024-09-12T01:07:18.513375+0000","last_undegraded":"2024-09-12T01:07:18.513375+0000","last_fullsized":"2024-09-12T01:07:18.513375+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:28.810429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.483052+0000","last_change":"2024-09-12T00:46:19.277090+0000","last_active":"2024-09-12T01:09:17.483052+0000","last_peered":"2024-09-12T01:09:17.483052+0000","last_clean":"2024-09-12T01:09:17.483052+0000","last_became_active":"2024-09-12T00:46:19.276538+0000","last_became_peered":"2024-09-12T00:46:19.276538+0000","last_unstale":"2024-09-12T01:09:17.483052+0000","last_undegraded":"2024-09-12T01:09:17.483052+0000","last_fullsized":"2024-09-12T01:09:17.483052+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.608027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.523552+0000","last_change":"2024-09-12T00:46:16.273158+0000","last_active":"2024-09-12T01:09:17.523552+0000","last_peered":"2024-09-12T01:09:17.523552+0000","last_clean":"2024-09-12T01:09:17.523552+0000","last_became_active":"2024-09-12T00:46:16.272892+0000","last_became_peered":"2024-09-12T00:46:16.272892+0000","last_unstale":"2024-09-12T01:09:17.523552+0000","last_undegraded":"2024-09-12T01:09:17.523552+0000","last_fullsized":"2024-09-12T01:09:17.523552+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.867186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"264'6","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.601661+0000","last_change":"2024-09-12T00:44:37.820513+0000","last_active":"2024-09-12T01:08:28.601661+0000","last_peered":"2024-09-12T01:08:28.601661+0000","last_clean":"2024-09-12T01:08:28.601661+0000","last_became_active":"2024-09-12T00:44:37.819232+0000","last_became_peered":"2024-09-12T00:44:37.819232+0000","last_unstale":"2024-09-12T01:08:28.601661+0000","last_undegraded":"2024-09-12T01:08:28.601661+0000","last_fullsized":"2024-09-12T01:08:28.601661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:53.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479701+0000","last_change":"2024-09-12T00:56:52.994822+0000","last_active":"2024-09-12T01:08:57.479701+0000","last_peered":"2024-09-12T01:08:57.479701+0000","last_clean":"2024-09-12T01:08:57.479701+0000","last_became_active":"2024-09-12T00:56:52.994128+0000","last_became_peered":"2024-09-12T00:56:52.994128+0000","last_unstale":"2024-09-12T01:08:57.479701+0000","last_undegraded":"2024-09-12T01:08:57.479701+0000","last_fullsized":"2024-09-12T01:08:57.479701+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:23.628943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.518602+0000","last_change":"2024-09-12T00:46:19.282799+0000","last_active":"2024-09-12T01:07:58.518602+0000","last_peered":"2024-09-12T01:07:58.518602+0000","last_clean":"2024-09-12T01:07:58.518602+0000","last_became_active":"2024-09-12T00:46:19.281782+0000","last_became_peered":"2024-09-12T00:46:19.281782+0000","last_unstale":"2024-09-12T01:07:58.518602+0000","last_undegraded":"2024-09-12T01:07:58.518602+0000","last_fullsized":"2024-09-12T01:07:58.518602+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:46.964297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.490914+0000","last_change":"2024-09-12T00:46:16.274107+0000","last_active":"2024-09-12T01:07:56.490914+0000","last_peered":"2024-09-12T01:07:56.490914+0000","last_clean":"2024-09-12T01:07:56.490914+0000","last_became_active":"2024-09-12T00:46:16.273356+0000","last_became_peered":"2024-09-12T00:46:16.273356+0000","last_unstale":"2024-09-12T01:07:56.490914+0000","last_undegraded":"2024-09-12T01:07:56.490914+0000","last_fullsized":"2024-09-12T01:07:56.490914+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:14.769067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'16","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.488931+0000","last_change":"2024-09-12T00:44:37.818413+0000","last_active":"2024-09-12T01:07:41.488931+0000","last_peered":"2024-09-12T01:07:41.488931+0000","last_clean":"2024-09-12T01:07:41.488931+0000","last_became_active":"2024-09-12T00:44:37.818054+0000","last_became_peered":"2024-09-12T00:44:37.818054+0000","last_unstale":"2024-09-12T01:07:41.488931+0000","last_undegraded":"2024-09-12T01:07:41.488931+0000","last_fullsized":"2024-09-12T01:07:41.488931+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:10.843685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.591776+0000","last_change":"2024-09-12T00:56:52.991268+0000","last_active":"2024-09-12T01:07:18.591776+0000","last_peered":"2024-09-12T01:07:18.591776+0000","last_clean":"2024-09-12T01:07:18.591776+0000","last_became_active":"2024-09-12T00:56:52.990601+0000","last_became_peered":"2024-09-12T00:56:52.990601+0000","last_unstale":"2024-09-12T01:07:18.591776+0000","last_undegraded":"2024-09-12T01:07:18.591776+0000","last_fullsized":"2024-09-12T01:07:18.591776+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:14.400256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615507+0000","last_change":"2024-09-12T00:46:19.282146+0000","last_active":"2024-09-12T01:10:08.615507+0000","last_peered":"2024-09-12T01:10:08.615507+0000","last_clean":"2024-09-12T01:10:08.615507+0000","last_became_active":"2024-09-12T00:46:19.281732+0000","last_became_peered":"2024-09-12T00:46:19.281732+0000","last_unstale":"2024-09-12T01:10:08.615507+0000","last_undegraded":"2024-09-12T01:10:08.615507+0000","last_fullsized":"2024-09-12T01:10:08.615507+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:55.852331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615530+0000","last_change":"2024-09-12T00:46:16.277570+0000","last_active":"2024-09-12T01:10:08.615530+0000","last_peered":"2024-09-12T01:10:08.615530+0000","last_clean":"2024-09-12T01:10:08.615530+0000","last_became_active":"2024-09-12T00:46:16.277261+0000","last_became_peered":"2024-09-12T00:46:16.277261+0000","last_unstale":"2024-09-12T01:10:08.615530+0000","last_undegraded":"2024-09-12T01:10:08.615530+0000","last_fullsized":"2024-09-12T01:10:08.615530+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:00.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12284,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'33","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.645110+0000","last_change":"2024-09-12T00:44:37.818362+0000","last_active":"2024-09-12T01:08:56.645110+0000","last_peered":"2024-09-12T01:08:56.645110+0000","last_clean":"2024-09-12T01:08:56.645110+0000","last_became_active":"2024-09-12T00:44:37.818055+0000","last_became_peered":"2024-09-12T00:44:37.818055+0000","last_unstale":"2024-09-12T01:08:56.645110+0000","last_undegraded":"2024-09-12T01:08:56.645110+0000","last_fullsized":"2024-09-12T01:08:56.645110+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.754260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":106,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380147+0000","last_change":"2024-09-12T00:56:52.989699+0000","last_active":"2024-09-12T01:07:43.380147+0000","last_peered":"2024-09-12T01:07:43.380147+0000","last_clean":"2024-09-12T01:07:43.380147+0000","last_became_active":"2024-09-12T00:56:52.989396+0000","last_became_peered":"2024-09-12T00:56:52.989396+0000","last_unstale":"2024-09-12T01:07:43.380147+0000","last_undegraded":"2024-09-12T01:07:43.380147+0000","last_fullsized":"2024-09-12T01:07:43.380147+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.478574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.523445+0000","last_change":"2024-09-12T00:46:19.281553+0000","last_active":"2024-09-12T01:09:17.523445+0000","last_peered":"2024-09-12T01:09:17.523445+0000","last_clean":"2024-09-12T01:09:17.523445+0000","last_became_active":"2024-09-12T00:46:19.281231+0000","last_became_peered":"2024-09-12T00:46:19.281231+0000","last_unstale":"2024-09-12T01:09:17.523445+0000","last_undegraded":"2024-09-12T01:09:17.523445+0000","last_fullsized":"2024-09-12T01:09:17.523445+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:58.529910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.494009+0000","last_change":"2024-09-12T00:46:16.277008+0000","last_active":"2024-09-12T01:08:21.494009+0000","last_peered":"2024-09-12T01:08:21.494009+0000","last_clean":"2024-09-12T01:08:21.494009+0000","last_became_active":"2024-09-12T00:46:16.276730+0000","last_became_peered":"2024-09-12T00:46:16.276730+0000","last_unstale":"2024-09-12T01:08:21.494009+0000","last_undegraded":"2024-09-12T01:08:21.494009+0000","last_fullsized":"2024-09-12T01:08:21.494009+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:54.164828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":10,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'54","reported_seq":199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.488274+0000","last_change":"2024-09-12T00:44:37.817537+0000","last_active":"2024-09-12T01:07:36.488274+0000","last_peered":"2024-09-12T01:07:36.488274+0000","last_clean":"2024-09-12T01:07:36.488274+0000","last_became_active":"2024-09-12T00:44:37.817249+0000","last_became_peered":"2024-09-12T00:44:37.817249+0000","last_unstale":"2024-09-12T01:07:36.488274+0000","last_undegraded":"2024-09-12T01:07:36.488274+0000","last_fullsized":"2024-09-12T01:07:36.488274+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.627057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":217,"num_write":83,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510158+0000","last_change":"2024-09-12T00:56:52.993381+0000","last_active":"2024-09-12T01:07:42.510158+0000","last_peered":"2024-09-12T01:07:42.510158+0000","last_clean":"2024-09-12T01:07:42.510158+0000","last_became_active":"2024-09-12T00:56:52.992289+0000","last_became_peered":"2024-09-12T00:56:52.992289+0000","last_unstale":"2024-09-12T01:07:42.510158+0000","last_undegraded":"2024-09-12T01:07:42.510158+0000","last_fullsized":"2024-09-12T01:07:42.510158+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:39.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.600810+0000","last_change":"2024-09-12T00:46:19.281027+0000","last_active":"2024-09-12T01:08:23.600810+0000","last_peered":"2024-09-12T01:08:23.600810+0000","last_clean":"2024-09-12T01:08:23.600810+0000","last_became_active":"2024-09-12T00:46:19.280725+0000","last_became_peered":"2024-09-12T00:46:19.280725+0000","last_unstale":"2024-09-12T01:08:23.600810+0000","last_undegraded":"2024-09-12T01:08:23.600810+0000","last_fullsized":"2024-09-12T01:08:23.600810+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:05.148455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.608121+0000","last_change":"2024-09-12T00:46:16.272821+0000","last_active":"2024-09-12T01:09:13.608121+0000","last_peered":"2024-09-12T01:09:13.608121+0000","last_clean":"2024-09-12T01:09:13.608121+0000","last_became_active":"2024-09-12T00:46:16.272417+0000","last_became_peered":"2024-09-12T00:46:16.272417+0000","last_unstale":"2024-09-12T01:09:13.608121+0000","last_undegraded":"2024-09-12T01:09:13.608121+0000","last_fullsized":"2024-09-12T01:09:13.608121+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:30.234992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2052,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'44","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594575+0000","last_change":"2024-09-12T00:44:37.818360+0000","last_active":"2024-09-12T01:07:33.594575+0000","last_peered":"2024-09-12T01:07:33.594575+0000","last_clean":"2024-09-12T01:07:33.594575+0000","last_became_active":"2024-09-12T00:44:37.815722+0000","last_became_peered":"2024-09-12T00:44:37.815722+0000","last_unstale":"2024-09-12T01:07:33.594575+0000","last_undegraded":"2024-09-12T01:07:33.594575+0000","last_fullsized":"2024-09-12T01:07:33.594575+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:01.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":150,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465217+0000","last_change":"2024-09-12T00:56:52.993069+0000","last_active":"2024-09-12T01:07:17.465217+0000","last_peered":"2024-09-12T01:07:17.465217+0000","last_clean":"2024-09-12T01:07:17.465217+0000","last_became_active":"2024-09-12T00:56:52.989218+0000","last_became_peered":"2024-09-12T00:56:52.989218+0000","last_unstale":"2024-09-12T01:07:17.465217+0000","last_undegraded":"2024-09-12T01:07:17.465217+0000","last_fullsized":"2024-09-12T01:07:17.465217+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:51.764331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.501310+0000","last_change":"2024-09-12T00:46:19.282564+0000","last_active":"2024-09-12T01:09:16.501310+0000","last_peered":"2024-09-12T01:09:16.501310+0000","last_clean":"2024-09-12T01:09:16.501310+0000","last_became_active":"2024-09-12T00:46:19.282270+0000","last_became_peered":"2024-09-12T00:46:19.282270+0000","last_unstale":"2024-09-12T01:09:16.501310+0000","last_undegraded":"2024-09-12T01:09:16.501310+0000","last_fullsized":"2024-09-12T01:09:16.501310+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:43.456680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.392925+0000","last_change":"2024-09-12T00:46:16.276646+0000","last_active":"2024-09-12T01:09:12.392925+0000","last_peered":"2024-09-12T01:09:12.392925+0000","last_clean":"2024-09-12T01:09:12.392925+0000","last_became_active":"2024-09-12T00:46:16.276368+0000","last_became_peered":"2024-09-12T00:46:16.276368+0000","last_unstale":"2024-09-12T01:09:12.392925+0000","last_undegraded":"2024-09-12T01:09:12.392925+0000","last_fullsized":"2024-09-12T01:09:12.392925+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:03.285958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594535+0000","last_change":"2024-09-12T00:44:37.821471+0000","last_active":"2024-09-12T01:07:33.594535+0000","last_peered":"2024-09-12T01:07:33.594535+0000","last_clean":"2024-09-12T01:07:33.594535+0000","last_became_active":"2024-09-12T00:44:37.821172+0000","last_became_peered":"2024-09-12T00:44:37.821172+0000","last_unstale":"2024-09-12T01:07:33.594535+0000","last_undegraded":"2024-09-12T01:07:33.594535+0000","last_fullsized":"2024-09-12T01:07:33.594535+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:46.622590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":156,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.592791+0000","last_change":"2024-09-12T00:56:52.993348+0000","last_active":"2024-09-12T01:07:23.592791+0000","last_peered":"2024-09-12T01:07:23.592791+0000","last_clean":"2024-09-12T01:07:23.592791+0000","last_became_active":"2024-09-12T00:56:52.993079+0000","last_became_peered":"2024-09-12T00:56:52.993079+0000","last_unstale":"2024-09-12T01:07:23.592791+0000","last_undegraded":"2024-09-12T01:07:23.592791+0000","last_fullsized":"2024-09-12T01:07:23.592791+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:13.494808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.501272+0000","last_change":"2024-09-12T00:46:19.279921+0000","last_active":"2024-09-12T01:09:16.501272+0000","last_peered":"2024-09-12T01:09:16.501272+0000","last_clean":"2024-09-12T01:09:16.501272+0000","last_became_active":"2024-09-12T00:46:19.279630+0000","last_became_peered":"2024-09-12T00:46:19.279630+0000","last_unstale":"2024-09-12T01:09:16.501272+0000","last_undegraded":"2024-09-12T01:09:16.501272+0000","last_fullsized":"2024-09-12T01:09:16.501272+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.231021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411787+0000","last_change":"2024-09-12T00:46:16.267218+0000","last_active":"2024-09-12T01:09:13.411787+0000","last_peered":"2024-09-12T01:09:13.411787+0000","last_clean":"2024-09-12T01:09:13.411787+0000","last_became_active":"2024-09-12T00:46:16.266854+0000","last_became_peered":"2024-09-12T00:46:16.266854+0000","last_unstale":"2024-09-12T01:09:13.411787+0000","last_undegraded":"2024-09-12T01:09:13.411787+0000","last_fullsized":"2024-09-12T01:09:13.411787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:46.629498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'16","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.497466+0000","last_change":"2024-09-12T00:44:37.822549+0000","last_active":"2024-09-12T01:08:46.497466+0000","last_peered":"2024-09-12T01:08:46.497466+0000","last_clean":"2024-09-12T01:08:46.497466+0000","last_became_active":"2024-09-12T00:44:37.822277+0000","last_became_peered":"2024-09-12T00:44:37.822277+0000","last_unstale":"2024-09-12T01:08:46.497466+0000","last_undegraded":"2024-09-12T01:08:46.497466+0000","last_fullsized":"2024-09-12T01:08:46.497466+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.547476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'371","reported_seq":1142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.529637+0000","last_change":"2024-09-12T00:30:11.108085+0000","last_active":"2024-09-12T01:11:23.529637+0000","last_peered":"2024-09-12T01:11:23.529637+0000","last_clean":"2024-09-12T01:11:23.529637+0000","last_became_active":"2024-09-12T00:30:11.107706+0000","last_became_peered":"2024-09-12T00:30:11.107706+0000","last_unstale":"2024-09-12T01:11:23.529637+0000","last_undegraded":"2024-09-12T01:11:23.529637+0000","last_fullsized":"2024-09-12T01:11:23.529637+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.042423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1492023,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":736,"num_read_kb":12989,"num_write":1270,"num_write_kb":41879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'141","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.303738+0000","last_change":"2024-09-12T00:30:13.128059+0000","last_active":"2024-09-12T01:10:50.303738+0000","last_peered":"2024-09-12T01:10:50.303738+0000","last_clean":"2024-09-12T01:10:50.303738+0000","last_became_active":"2024-09-12T00:30:13.126147+0000","last_became_peered":"2024-09-12T00:30:13.126147+0000","last_unstale":"2024-09-12T01:10:50.303738+0000","last_undegraded":"2024-09-12T01:10:50.303738+0000","last_fullsized":"2024-09-12T01:10:50.303738+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:08.534438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":527,"num_write":201,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'275","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.951043+0000","last_change":"2024-09-12T00:30:11.101673+0000","last_active":"2024-09-12T01:09:23.951043+0000","last_peered":"2024-09-12T01:09:23.951043+0000","last_clean":"2024-09-12T01:09:23.951043+0000","last_became_active":"2024-09-12T00:30:11.101252+0000","last_became_peered":"2024-09-12T00:30:11.101252+0000","last_unstale":"2024-09-12T01:09:23.951043+0000","last_undegraded":"2024-09-12T01:09:23.951043+0000","last_fullsized":"2024-09-12T01:09:23.951043+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:24.037331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2397728,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":419,"num_read_kb":19965,"num_write":1005,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'209","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:30.236873+0000","last_change":"2024-09-12T00:30:13.124111+0000","last_active":"2024-09-12T01:09:30.236873+0000","last_peered":"2024-09-12T01:09:30.236873+0000","last_clean":"2024-09-12T01:09:30.236873+0000","last_became_active":"2024-09-12T00:30:13.123880+0000","last_became_peered":"2024-09-12T00:30:13.123880+0000","last_unstale":"2024-09-12T01:09:30.236873+0000","last_undegraded":"2024-09-12T01:09:30.236873+0000","last_fullsized":"2024-09-12T01:09:30.236873+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:41.642173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":720,"num_write":314,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'244","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:30.793618+0000","last_change":"2024-09-12T00:30:11.096844+0000","last_active":"2024-09-12T01:09:30.793618+0000","last_peered":"2024-09-12T01:09:30.793618+0000","last_clean":"2024-09-12T01:09:30.793618+0000","last_became_active":"2024-09-12T00:30:11.096381+0000","last_became_peered":"2024-09-12T00:30:11.096381+0000","last_unstale":"2024-09-12T01:09:30.793618+0000","last_undegraded":"2024-09-12T01:09:30.793618+0000","last_fullsized":"2024-09-12T01:09:30.793618+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:57.955383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13784106,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":389,"num_read_kb":52758,"num_write":935,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'151","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.489637+0000","last_change":"2024-09-12T00:30:13.121126+0000","last_active":"2024-09-12T01:08:45.489637+0000","last_peered":"2024-09-12T01:08:45.489637+0000","last_clean":"2024-09-12T01:08:45.489637+0000","last_became_active":"2024-09-12T00:30:13.120834+0000","last_became_peered":"2024-09-12T00:30:13.120834+0000","last_unstale":"2024-09-12T01:08:45.489637+0000","last_undegraded":"2024-09-12T01:08:45.489637+0000","last_fullsized":"2024-09-12T01:08:45.489637+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:48.681924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":556,"num_write":237,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'249","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.036676+0000","last_change":"2024-09-12T00:30:11.102160+0000","last_active":"2024-09-12T01:09:33.036676+0000","last_peered":"2024-09-12T01:09:33.036676+0000","last_clean":"2024-09-12T01:09:33.036676+0000","last_became_active":"2024-09-12T00:30:11.101773+0000","last_became_peered":"2024-09-12T00:30:11.101773+0000","last_unstale":"2024-09-12T01:09:33.036676+0000","last_undegraded":"2024-09-12T01:09:33.036676+0000","last_fullsized":"2024-09-12T01:09:33.036676+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:43.867988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3779590,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":382,"num_read_kb":6781,"num_write":869,"num_write_kb":20709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4368","reported_seq":4967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.603185+0000","last_change":"2024-09-12T00:30:13.114180+0000","last_active":"2024-09-12T01:07:47.603185+0000","last_peered":"2024-09-12T01:07:47.603185+0000","last_clean":"2024-09-12T01:07:47.603185+0000","last_became_active":"2024-09-12T00:30:13.113812+0000","last_became_peered":"2024-09-12T00:30:13.113812+0000","last_unstale":"2024-09-12T01:07:47.603185+0000","last_undegraded":"2024-09-12T01:07:47.603185+0000","last_fullsized":"2024-09-12T01:07:47.603185+0000","mapping_epoch":28,"log_start":"264'4300","ondisk_log_start":"264'4300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:35.040266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17553,"num_read_kb":14742,"num_write":6586,"num_write_kb":3311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'294","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.514337+0000","last_change":"2024-09-12T00:30:11.098446+0000","last_active":"2024-09-12T01:11:23.514337+0000","last_peered":"2024-09-12T01:11:23.514337+0000","last_clean":"2024-09-12T01:11:23.514337+0000","last_became_active":"2024-09-12T00:30:11.097339+0000","last_became_peered":"2024-09-12T00:30:11.097339+0000","last_unstale":"2024-09-12T01:11:23.514337+0000","last_undegraded":"2024-09-12T01:11:23.514337+0000","last_fullsized":"2024-09-12T01:11:23.514337+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:40.707199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055238,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":412,"num_read_kb":4533,"num_write":1107,"num_write_kb":19662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"264'201","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.028978+0000","last_change":"2024-09-12T00:30:13.125647+0000","last_active":"2024-09-12T01:08:21.028978+0000","last_peered":"2024-09-12T01:08:21.028978+0000","last_clean":"2024-09-12T01:08:21.028978+0000","last_became_active":"2024-09-12T00:30:13.125363+0000","last_became_peered":"2024-09-12T00:30:13.125363+0000","last_unstale":"2024-09-12T01:08:21.028978+0000","last_undegraded":"2024-09-12T01:08:21.028978+0000","last_fullsized":"2024-09-12T01:08:21.028978+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:56.486136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":845,"num_read_kb":691,"num_write":311,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'280","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:29.550648+0000","last_change":"2024-09-12T00:30:11.104965+0000","last_active":"2024-09-12T01:09:29.550648+0000","last_peered":"2024-09-12T01:09:29.550648+0000","last_clean":"2024-09-12T01:09:29.550648+0000","last_became_active":"2024-09-12T00:30:11.104535+0000","last_became_peered":"2024-09-12T00:30:11.104535+0000","last_unstale":"2024-09-12T01:09:29.550648+0000","last_undegraded":"2024-09-12T01:09:29.550648+0000","last_fullsized":"2024-09-12T01:09:29.550648+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:02.250566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214355,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":410,"num_read_kb":66788,"num_write":917,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'115","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.522736+0000","last_change":"2024-09-12T00:30:13.125175+0000","last_active":"2024-09-12T01:08:53.522736+0000","last_peered":"2024-09-12T01:08:53.522736+0000","last_clean":"2024-09-12T01:08:53.522736+0000","last_became_active":"2024-09-12T00:30:13.124774+0000","last_became_peered":"2024-09-12T00:30:13.124774+0000","last_unstale":"2024-09-12T01:08:53.522736+0000","last_undegraded":"2024-09-12T01:08:53.522736+0000","last_fullsized":"2024-09-12T01:08:53.522736+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:17.846970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":451,"num_write":180,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'277","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.405774+0000","last_change":"2024-09-12T00:30:11.102635+0000","last_active":"2024-09-12T01:11:23.405774+0000","last_peered":"2024-09-12T01:11:23.405774+0000","last_clean":"2024-09-12T01:11:23.405774+0000","last_became_active":"2024-09-12T00:30:11.102281+0000","last_became_peered":"2024-09-12T00:30:11.102281+0000","last_unstale":"2024-09-12T01:11:23.405774+0000","last_undegraded":"2024-09-12T01:11:23.405774+0000","last_fullsized":"2024-09-12T01:11:23.405774+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:36.443637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706718,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":422,"num_read_kb":13880,"num_write":922,"num_write_kb":40348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'544","reported_seq":1240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.564544+0000","last_change":"2024-09-12T00:30:13.126388+0000","last_active":"2024-09-12T01:09:22.564544+0000","last_peered":"2024-09-12T01:09:22.564544+0000","last_clean":"2024-09-12T01:09:22.564544+0000","last_became_active":"2024-09-12T00:30:13.126123+0000","last_became_peered":"2024-09-12T00:30:13.126123+0000","last_unstale":"2024-09-12T01:09:22.564544+0000","last_undegraded":"2024-09-12T01:09:22.564544+0000","last_fullsized":"2024-09-12T01:09:22.564544+0000","mapping_epoch":28,"log_start":"264'500","ondisk_log_start":"264'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:46.451607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2509,"num_read_kb":2200,"num_write":899,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'251","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.535584+0000","last_change":"2024-09-12T00:30:11.104564+0000","last_active":"2024-09-12T01:09:13.535584+0000","last_peered":"2024-09-12T01:09:13.535584+0000","last_clean":"2024-09-12T01:09:13.535584+0000","last_became_active":"2024-09-12T00:30:11.104084+0000","last_became_peered":"2024-09-12T00:30:11.104084+0000","last_unstale":"2024-09-12T01:09:13.535584+0000","last_undegraded":"2024-09-12T01:09:13.535584+0000","last_fullsized":"2024-09-12T01:09:13.535584+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:20.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5497379,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":435,"num_read_kb":14633,"num_write":922,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'231","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.849014+0000","last_change":"2024-09-12T00:30:13.129106+0000","last_active":"2024-09-12T01:09:15.849014+0000","last_peered":"2024-09-12T01:09:15.849014+0000","last_clean":"2024-09-12T01:09:15.849014+0000","last_became_active":"2024-09-12T00:30:13.127581+0000","last_became_peered":"2024-09-12T00:30:13.127581+0000","last_unstale":"2024-09-12T01:09:15.849014+0000","last_undegraded":"2024-09-12T01:09:15.849014+0000","last_fullsized":"2024-09-12T01:09:15.849014+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:37.451443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1008,"num_read_kb":834,"num_write":338,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'462","reported_seq":1238,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.335798+0000","last_change":"2024-09-12T00:30:13.121457+0000","last_active":"2024-09-12T01:08:46.335798+0000","last_peered":"2024-09-12T01:08:46.335798+0000","last_clean":"2024-09-12T01:08:46.335798+0000","last_became_active":"2024-09-12T00:30:13.121154+0000","last_became_peered":"2024-09-12T00:30:13.121154+0000","last_unstale":"2024-09-12T01:08:46.335798+0000","last_undegraded":"2024-09-12T01:08:46.335798+0000","last_fullsized":"2024-09-12T01:08:46.335798+0000","mapping_epoch":28,"log_start":"264'400","ondisk_log_start":"264'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:30.709632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2284,"num_read_kb":1967,"num_write":806,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'250","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.376952+0000","last_change":"2024-09-12T00:30:11.103793+0000","last_active":"2024-09-12T01:11:23.376952+0000","last_peered":"2024-09-12T01:11:23.376952+0000","last_clean":"2024-09-12T01:11:23.376952+0000","last_became_active":"2024-09-12T00:30:11.103437+0000","last_became_peered":"2024-09-12T00:30:11.103437+0000","last_unstale":"2024-09-12T01:11:23.376952+0000","last_undegraded":"2024-09-12T01:11:23.376952+0000","last_fullsized":"2024-09-12T01:11:23.376952+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:00.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15228190,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":393,"num_read_kb":35388,"num_write":851,"num_write_kb":32368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'227","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.699341+0000","last_change":"2024-09-12T00:30:13.129323+0000","last_active":"2024-09-12T01:08:47.699341+0000","last_peered":"2024-09-12T01:08:47.699341+0000","last_clean":"2024-09-12T01:08:47.699341+0000","last_became_active":"2024-09-12T00:30:13.128977+0000","last_became_peered":"2024-09-12T00:30:13.128977+0000","last_unstale":"2024-09-12T01:08:47.699341+0000","last_undegraded":"2024-09-12T01:08:47.699341+0000","last_fullsized":"2024-09-12T01:08:47.699341+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:56.133929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1058,"num_read_kb":878,"num_write":388,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'275","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.538922+0000","last_change":"2024-09-12T00:30:11.115651+0000","last_active":"2024-09-12T01:11:23.538922+0000","last_peered":"2024-09-12T01:11:23.538922+0000","last_clean":"2024-09-12T01:11:23.538922+0000","last_became_active":"2024-09-12T00:30:11.114961+0000","last_became_peered":"2024-09-12T00:30:11.114961+0000","last_unstale":"2024-09-12T01:11:23.538922+0000","last_undegraded":"2024-09-12T01:11:23.538922+0000","last_fullsized":"2024-09-12T01:11:23.538922+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:14.975869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246923,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":398,"num_read_kb":13562,"num_write":911,"num_write_kb":25787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'212","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.269904+0000","last_change":"2024-09-12T00:30:13.127448+0000","last_active":"2024-09-12T01:09:09.269904+0000","last_peered":"2024-09-12T01:09:09.269904+0000","last_clean":"2024-09-12T01:09:09.269904+0000","last_became_active":"2024-09-12T00:30:13.127190+0000","last_became_peered":"2024-09-12T00:30:13.127190+0000","last_unstale":"2024-09-12T01:09:09.269904+0000","last_undegraded":"2024-09-12T01:09:09.269904+0000","last_fullsized":"2024-09-12T01:09:09.269904+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:54.603682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":739,"num_write":341,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'331","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.401578+0000","last_change":"2024-09-12T00:30:11.106208+0000","last_active":"2024-09-12T01:11:23.401578+0000","last_peered":"2024-09-12T01:11:23.401578+0000","last_clean":"2024-09-12T01:11:23.401578+0000","last_became_active":"2024-09-12T00:30:11.105844+0000","last_became_peered":"2024-09-12T00:30:11.105844+0000","last_unstale":"2024-09-12T01:11:23.401578+0000","last_undegraded":"2024-09-12T01:11:23.401578+0000","last_fullsized":"2024-09-12T01:11:23.401578+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:53.358144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6628298,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":482,"num_read_kb":46849,"num_write":1141,"num_write_kb":40470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'183","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390220+0000","last_change":"2024-09-12T00:30:13.125263+0000","last_active":"2024-09-12T01:08:52.390220+0000","last_peered":"2024-09-12T01:08:52.390220+0000","last_clean":"2024-09-12T01:08:52.390220+0000","last_became_active":"2024-09-12T00:30:13.124627+0000","last_became_peered":"2024-09-12T00:30:13.124627+0000","last_unstale":"2024-09-12T01:08:52.390220+0000","last_undegraded":"2024-09-12T01:08:52.390220+0000","last_fullsized":"2024-09-12T01:08:52.390220+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:42.412103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":804,"num_read_kb":662,"num_write":262,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'277","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.446898+0000","last_change":"2024-09-12T00:30:11.114785+0000","last_active":"2024-09-12T01:11:23.446898+0000","last_peered":"2024-09-12T01:11:23.446898+0000","last_clean":"2024-09-12T01:11:23.446898+0000","last_became_active":"2024-09-12T00:30:11.114309+0000","last_became_peered":"2024-09-12T00:30:11.114309+0000","last_unstale":"2024-09-12T01:11:23.446898+0000","last_undegraded":"2024-09-12T01:11:23.446898+0000","last_fullsized":"2024-09-12T01:11:23.446898+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.364638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10105484,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":480,"num_read_kb":64152,"num_write":932,"num_write_kb":27626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'205","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479130+0000","last_change":"2024-09-12T00:30:13.129990+0000","last_active":"2024-09-12T01:08:52.479130+0000","last_peered":"2024-09-12T01:08:52.479130+0000","last_clean":"2024-09-12T01:08:52.479130+0000","last_became_active":"2024-09-12T00:30:13.129718+0000","last_became_peered":"2024-09-12T00:30:13.129718+0000","last_unstale":"2024-09-12T01:08:52.479130+0000","last_undegraded":"2024-09-12T01:08:52.479130+0000","last_fullsized":"2024-09-12T01:08:52.479130+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:07.835287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":749,"num_write":336,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'328","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.471884+0000","last_change":"2024-09-12T00:30:11.109350+0000","last_active":"2024-09-12T01:09:23.471884+0000","last_peered":"2024-09-12T01:09:23.471884+0000","last_clean":"2024-09-12T01:09:23.471884+0000","last_became_active":"2024-09-12T00:30:11.108958+0000","last_became_peered":"2024-09-12T00:30:11.108958+0000","last_unstale":"2024-09-12T01:09:23.471884+0000","last_undegraded":"2024-09-12T01:09:23.471884+0000","last_fullsized":"2024-09-12T01:09:23.471884+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:47.014408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14088217,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":517,"num_read_kb":32014,"num_write":1318,"num_write_kb":50601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'152","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.409340+0000","last_change":"2024-09-12T00:30:13.126434+0000","last_active":"2024-09-12T01:08:53.409340+0000","last_peered":"2024-09-12T01:08:53.409340+0000","last_clean":"2024-09-12T01:08:53.409340+0000","last_became_active":"2024-09-12T00:30:13.126143+0000","last_became_peered":"2024-09-12T00:30:13.126143+0000","last_unstale":"2024-09-12T01:08:53.409340+0000","last_undegraded":"2024-09-12T01:08:53.409340+0000","last_fullsized":"2024-09-12T01:08:53.409340+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:20.649913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":565,"num_write":225,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'269","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.055631+0000","last_change":"2024-09-12T00:30:11.096841+0000","last_active":"2024-09-12T01:09:28.055631+0000","last_peered":"2024-09-12T01:09:28.055631+0000","last_clean":"2024-09-12T01:09:28.055631+0000","last_became_active":"2024-09-12T00:30:11.096162+0000","last_became_peered":"2024-09-12T00:30:11.096162+0000","last_unstale":"2024-09-12T01:09:28.055631+0000","last_undegraded":"2024-09-12T01:09:28.055631+0000","last_fullsized":"2024-09-12T01:09:28.055631+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:02.238568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3298821,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":397,"num_read_kb":7247,"num_write":905,"num_write_kb":14577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'148","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.870030+0000","last_change":"2024-09-12T00:30:21.192901+0000","last_active":"2024-09-12T01:09:46.870030+0000","last_peered":"2024-09-12T01:09:46.870030+0000","last_clean":"2024-09-12T01:09:46.870030+0000","last_became_active":"2024-09-12T00:30:21.192654+0000","last_became_peered":"2024-09-12T00:30:21.192654+0000","last_unstale":"2024-09-12T01:09:46.870030+0000","last_undegraded":"2024-09-12T01:09:46.870030+0000","last_fullsized":"2024-09-12T01:09:46.870030+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:51.831265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":350,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'101","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.979565+0000","last_change":"2024-09-12T00:30:13.130308+0000","last_active":"2024-09-12T01:08:53.979565+0000","last_peered":"2024-09-12T01:08:53.979565+0000","last_clean":"2024-09-12T01:08:53.979565+0000","last_became_active":"2024-09-12T00:30:13.130030+0000","last_became_peered":"2024-09-12T00:30:13.130030+0000","last_unstale":"2024-09-12T01:08:53.979565+0000","last_undegraded":"2024-09-12T01:08:53.979565+0000","last_fullsized":"2024-09-12T01:08:53.979565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:14.502318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":143,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'402","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.623591+0000","last_change":"2024-09-12T00:30:46.767993+0000","last_active":"2024-09-12T01:11:23.623591+0000","last_peered":"2024-09-12T01:11:23.623591+0000","last_clean":"2024-09-12T01:11:23.623591+0000","last_became_active":"2024-09-12T00:30:46.767516+0000","last_became_peered":"2024-09-12T00:30:46.767516+0000","last_unstale":"2024-09-12T01:11:23.623591+0000","last_undegraded":"2024-09-12T01:11:23.623591+0000","last_fullsized":"2024-09-12T01:11:23.623591+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:13.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9870247,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":590,"num_read_kb":38821,"num_write":1336,"num_write_kb":62705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,4],"acting":[3,5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605940+0000","last_change":"2024-09-12T00:30:15.127353+0000","last_active":"2024-09-12T01:08:58.605940+0000","last_peered":"2024-09-12T01:08:58.605940+0000","last_clean":"2024-09-12T01:08:58.605940+0000","last_became_active":"2024-09-12T00:30:15.127067+0000","last_became_peered":"2024-09-12T00:30:15.127067+0000","last_unstale":"2024-09-12T01:08:58.605940+0000","last_undegraded":"2024-09-12T01:08:58.605940+0000","last_fullsized":"2024-09-12T01:08:58.605940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:01.202011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'320","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.534951+0000","last_change":"2024-09-12T00:30:17.145857+0000","last_active":"2024-09-12T01:11:22.534951+0000","last_peered":"2024-09-12T01:11:22.534951+0000","last_clean":"2024-09-12T01:11:22.534951+0000","last_became_active":"2024-09-12T00:30:17.145455+0000","last_became_peered":"2024-09-12T00:30:17.145455+0000","last_unstale":"2024-09-12T01:11:22.534951+0000","last_undegraded":"2024-09-12T01:11:22.534951+0000","last_fullsized":"2024-09-12T01:11:22.534951+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:25.114718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":944,"num_write":404,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409967+0000","last_change":"2024-09-12T00:30:19.168447+0000","last_active":"2024-09-12T01:08:58.409967+0000","last_peered":"2024-09-12T01:08:58.409967+0000","last_clean":"2024-09-12T01:08:58.409967+0000","last_became_active":"2024-09-12T00:30:19.168192+0000","last_became_peered":"2024-09-12T00:30:19.168192+0000","last_unstale":"2024-09-12T01:08:58.409967+0000","last_undegraded":"2024-09-12T01:08:58.409967+0000","last_fullsized":"2024-09-12T01:08:58.409967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:11.131718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'146","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.132064+0000","last_change":"2024-09-12T00:30:21.189447+0000","last_active":"2024-09-12T01:09:43.132064+0000","last_peered":"2024-09-12T01:09:43.132064+0000","last_clean":"2024-09-12T01:09:43.132064+0000","last_became_active":"2024-09-12T00:30:21.189141+0000","last_became_peered":"2024-09-12T00:30:21.189141+0000","last_unstale":"2024-09-12T01:09:43.132064+0000","last_undegraded":"2024-09-12T01:09:43.132064+0000","last_fullsized":"2024-09-12T01:09:43.132064+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:53.347172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":204,"num_write":274,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'90","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.605253+0000","last_change":"2024-09-12T00:30:13.127898+0000","last_active":"2024-09-12T01:08:53.605253+0000","last_peered":"2024-09-12T01:08:53.605253+0000","last_clean":"2024-09-12T01:08:53.605253+0000","last_became_active":"2024-09-12T00:30:13.127577+0000","last_became_peered":"2024-09-12T00:30:13.127577+0000","last_unstale":"2024-09-12T01:08:53.605253+0000","last_undegraded":"2024-09-12T01:08:53.605253+0000","last_fullsized":"2024-09-12T01:08:53.605253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:40.499246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":367,"num_write":144,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'247","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:44.196296+0000","last_change":"2024-09-12T00:30:11.092270+0000","last_active":"2024-09-12T01:10:44.196296+0000","last_peered":"2024-09-12T01:10:44.196296+0000","last_clean":"2024-09-12T01:10:44.196296+0000","last_became_active":"2024-09-12T00:30:11.091860+0000","last_became_peered":"2024-09-12T00:30:11.091860+0000","last_unstale":"2024-09-12T01:10:44.196296+0000","last_undegraded":"2024-09-12T01:10:44.196296+0000","last_fullsized":"2024-09-12T01:10:44.196296+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:18.340874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3749324,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":390,"num_read_kb":88624,"num_write":917,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510119+0000","last_change":"2024-09-12T00:30:15.130476+0000","last_active":"2024-09-12T01:07:42.510119+0000","last_peered":"2024-09-12T01:07:42.510119+0000","last_clean":"2024-09-12T01:07:42.510119+0000","last_became_active":"2024-09-12T00:30:15.130254+0000","last_became_peered":"2024-09-12T00:30:15.130254+0000","last_unstale":"2024-09-12T01:07:42.510119+0000","last_undegraded":"2024-09-12T01:07:42.510119+0000","last_fullsized":"2024-09-12T01:07:42.510119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.906448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'108","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.183586+0000","last_change":"2024-09-12T00:30:17.148717+0000","last_active":"2024-09-12T01:10:26.183586+0000","last_peered":"2024-09-12T01:10:26.183586+0000","last_clean":"2024-09-12T01:10:26.183586+0000","last_became_active":"2024-09-12T00:30:17.148422+0000","last_became_peered":"2024-09-12T00:30:17.148422+0000","last_unstale":"2024-09-12T01:10:26.183586+0000","last_undegraded":"2024-09-12T01:10:26.183586+0000","last_fullsized":"2024-09-12T01:10:26.183586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:54.544557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":99,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409940+0000","last_change":"2024-09-12T00:30:19.163744+0000","last_active":"2024-09-12T01:08:58.409940+0000","last_peered":"2024-09-12T01:08:58.409940+0000","last_clean":"2024-09-12T01:08:58.409940+0000","last_became_active":"2024-09-12T00:30:19.163363+0000","last_became_peered":"2024-09-12T00:30:19.163363+0000","last_unstale":"2024-09-12T01:08:58.409940+0000","last_undegraded":"2024-09-12T01:08:58.409940+0000","last_fullsized":"2024-09-12T01:08:58.409940+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:34.458854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'134","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.285173+0000","last_change":"2024-09-12T00:30:21.180741+0000","last_active":"2024-09-12T01:09:46.285173+0000","last_peered":"2024-09-12T01:09:46.285173+0000","last_clean":"2024-09-12T01:09:46.285173+0000","last_became_active":"2024-09-12T00:30:21.180419+0000","last_became_peered":"2024-09-12T00:30:21.180419+0000","last_unstale":"2024-09-12T01:09:46.285173+0000","last_undegraded":"2024-09-12T01:09:46.285173+0000","last_fullsized":"2024-09-12T01:09:46.285173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.115939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":136,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'120","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.531565+0000","last_change":"2024-09-12T00:30:13.126841+0000","last_active":"2024-09-12T01:09:21.531565+0000","last_peered":"2024-09-12T01:09:21.531565+0000","last_clean":"2024-09-12T01:09:21.531565+0000","last_became_active":"2024-09-12T00:30:13.126531+0000","last_became_peered":"2024-09-12T00:30:13.126531+0000","last_unstale":"2024-09-12T01:09:21.531565+0000","last_undegraded":"2024-09-12T01:09:21.531565+0000","last_fullsized":"2024-09-12T01:09:21.531565+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:10.702442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":438,"num_write":171,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'315","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.537259+0000","last_change":"2024-09-12T00:30:11.112561+0000","last_active":"2024-09-12T01:11:23.537259+0000","last_peered":"2024-09-12T01:11:23.537259+0000","last_clean":"2024-09-12T01:11:23.537259+0000","last_became_active":"2024-09-12T00:30:11.110001+0000","last_became_peered":"2024-09-12T00:30:11.110001+0000","last_unstale":"2024-09-12T01:11:23.537259+0000","last_undegraded":"2024-09-12T01:11:23.537259+0000","last_fullsized":"2024-09-12T01:11:23.537259+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:28.054807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4638876,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":403,"num_read_kb":4100,"num_write":997,"num_write_kb":26242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.520792+0000","last_change":"2024-09-12T00:30:15.126005+0000","last_active":"2024-09-12T01:08:57.520792+0000","last_peered":"2024-09-12T01:08:57.520792+0000","last_clean":"2024-09-12T01:08:57.520792+0000","last_became_active":"2024-09-12T00:30:15.125728+0000","last_became_peered":"2024-09-12T00:30:15.125728+0000","last_unstale":"2024-09-12T01:08:57.520792+0000","last_undegraded":"2024-09-12T01:08:57.520792+0000","last_fullsized":"2024-09-12T01:08:57.520792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:00.586425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'145","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.201330+0000","last_change":"2024-09-12T00:30:17.145113+0000","last_active":"2024-09-12T01:10:26.201330+0000","last_peered":"2024-09-12T01:10:26.201330+0000","last_clean":"2024-09-12T01:10:26.201330+0000","last_became_active":"2024-09-12T00:30:17.144701+0000","last_became_peered":"2024-09-12T00:30:17.144701+0000","last_unstale":"2024-09-12T01:10:26.201330+0000","last_undegraded":"2024-09-12T01:10:26.201330+0000","last_fullsized":"2024-09-12T01:10:26.201330+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:20.054774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":141,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'771","reported_seq":2310,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.506340+0000","last_change":"2024-09-12T00:30:19.170912+0000","last_active":"2024-09-12T01:11:22.506340+0000","last_peered":"2024-09-12T01:11:22.506340+0000","last_clean":"2024-09-12T01:11:22.506340+0000","last_became_active":"2024-09-12T00:30:19.170568+0000","last_became_peered":"2024-09-12T00:30:19.170568+0000","last_unstale":"2024-09-12T01:11:22.506340+0000","last_undegraded":"2024-09-12T01:11:22.506340+0000","last_fullsized":"2024-09-12T01:11:22.506340+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:09.164786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'212","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.922971+0000","last_change":"2024-09-12T00:30:21.188577+0000","last_active":"2024-09-12T01:09:46.922971+0000","last_peered":"2024-09-12T01:09:46.922971+0000","last_clean":"2024-09-12T01:09:46.922971+0000","last_became_active":"2024-09-12T00:30:21.188312+0000","last_became_peered":"2024-09-12T00:30:21.188312+0000","last_unstale":"2024-09-12T01:09:46.922971+0000","last_undegraded":"2024-09-12T01:09:46.922971+0000","last_fullsized":"2024-09-12T01:09:46.922971+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:02.003043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":596,"num_write":468,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'84","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.925453+0000","last_change":"2024-09-12T00:30:13.128485+0000","last_active":"2024-09-12T01:09:10.925453+0000","last_peered":"2024-09-12T01:09:10.925453+0000","last_clean":"2024-09-12T01:09:10.925453+0000","last_became_active":"2024-09-12T00:30:13.125323+0000","last_became_peered":"2024-09-12T00:30:13.125323+0000","last_unstale":"2024-09-12T01:09:10.925453+0000","last_undegraded":"2024-09-12T01:09:10.925453+0000","last_fullsized":"2024-09-12T01:09:10.925453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:35.611738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":383,"num_read_kb":333,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'376","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.390231+0000","last_change":"2024-09-12T00:30:11.102149+0000","last_active":"2024-09-12T01:11:23.390231+0000","last_peered":"2024-09-12T01:11:23.390231+0000","last_clean":"2024-09-12T01:11:23.390231+0000","last_became_active":"2024-09-12T00:30:11.101745+0000","last_became_peered":"2024-09-12T00:30:11.101745+0000","last_unstale":"2024-09-12T01:11:23.390231+0000","last_undegraded":"2024-09-12T01:11:23.390231+0000","last_fullsized":"2024-09-12T01:11:23.390231+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:28.329293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270498,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":729,"num_read_kb":23420,"num_write":1224,"num_write_kb":19418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605977+0000","last_change":"2024-09-12T00:30:15.124922+0000","last_active":"2024-09-12T01:08:58.605977+0000","last_peered":"2024-09-12T01:08:58.605977+0000","last_clean":"2024-09-12T01:08:58.605977+0000","last_became_active":"2024-09-12T00:30:15.124597+0000","last_became_peered":"2024-09-12T00:30:15.124597+0000","last_unstale":"2024-09-12T01:08:58.605977+0000","last_undegraded":"2024-09-12T01:08:58.605977+0000","last_fullsized":"2024-09-12T01:08:58.605977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:33.763481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'257","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.466288+0000","last_change":"2024-09-12T00:30:17.146147+0000","last_active":"2024-09-12T01:10:51.466288+0000","last_peered":"2024-09-12T01:10:51.466288+0000","last_clean":"2024-09-12T01:10:51.466288+0000","last_became_active":"2024-09-12T00:30:17.145866+0000","last_became_peered":"2024-09-12T00:30:17.145866+0000","last_unstale":"2024-09-12T01:10:51.466288+0000","last_undegraded":"2024-09-12T01:10:51.466288+0000","last_fullsized":"2024-09-12T01:10:51.466288+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:44.866654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56379,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":424,"num_read_kb":883,"num_write":348,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'797","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.507144+0000","last_change":"2024-09-12T00:30:19.172788+0000","last_active":"2024-09-12T01:10:51.507144+0000","last_peered":"2024-09-12T01:10:51.507144+0000","last_clean":"2024-09-12T01:10:51.507144+0000","last_became_active":"2024-09-12T00:30:19.172403+0000","last_became_peered":"2024-09-12T00:30:19.172403+0000","last_unstale":"2024-09-12T01:10:51.507144+0000","last_undegraded":"2024-09-12T01:10:51.507144+0000","last_fullsized":"2024-09-12T01:10:51.507144+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:18.079531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'131","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:26.492883+0000","last_change":"2024-09-12T00:30:13.120892+0000","last_active":"2024-09-12T01:09:26.492883+0000","last_peered":"2024-09-12T01:09:26.492883+0000","last_clean":"2024-09-12T01:09:26.492883+0000","last_became_active":"2024-09-12T00:30:13.120524+0000","last_became_peered":"2024-09-12T00:30:13.120524+0000","last_unstale":"2024-09-12T01:09:26.492883+0000","last_undegraded":"2024-09-12T01:09:26.492883+0000","last_fullsized":"2024-09-12T01:09:26.492883+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:04.978011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":538,"num_write":190,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'341","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.476327+0000","last_change":"2024-09-12T00:30:11.106118+0000","last_active":"2024-09-12T01:11:23.476327+0000","last_peered":"2024-09-12T01:11:23.476327+0000","last_clean":"2024-09-12T01:11:23.476327+0000","last_became_active":"2024-09-12T00:30:11.105769+0000","last_became_peered":"2024-09-12T00:30:11.105769+0000","last_unstale":"2024-09-12T01:11:23.476327+0000","last_undegraded":"2024-09-12T01:11:23.476327+0000","last_fullsized":"2024-09-12T01:11:23.476327+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:02.413308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14227300,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":437,"num_read_kb":22715,"num_write":1071,"num_write_kb":62157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.394488+0000","last_change":"2024-09-12T00:30:15.133021+0000","last_active":"2024-09-12T01:07:08.394488+0000","last_peered":"2024-09-12T01:07:08.394488+0000","last_clean":"2024-09-12T01:07:08.394488+0000","last_became_active":"2024-09-12T00:30:15.132719+0000","last_became_peered":"2024-09-12T00:30:15.132719+0000","last_unstale":"2024-09-12T01:07:08.394488+0000","last_undegraded":"2024-09-12T01:07:08.394488+0000","last_fullsized":"2024-09-12T01:07:08.394488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:07.213409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'355","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.476977+0000","last_change":"2024-09-12T00:30:17.146741+0000","last_active":"2024-09-12T01:10:51.476977+0000","last_peered":"2024-09-12T01:10:51.476977+0000","last_clean":"2024-09-12T01:10:51.476977+0000","last_became_active":"2024-09-12T00:30:17.146465+0000","last_became_peered":"2024-09-12T00:30:17.146465+0000","last_unstale":"2024-09-12T01:10:51.476977+0000","last_undegraded":"2024-09-12T01:10:51.476977+0000","last_fullsized":"2024-09-12T01:10:51.476977+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:45.163258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59352,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":587,"num_read_kb":1107,"num_write":468,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:37.388200+0000","last_change":"2024-09-12T00:30:19.164620+0000","last_active":"2024-09-12T01:08:37.388200+0000","last_peered":"2024-09-12T01:08:37.388200+0000","last_clean":"2024-09-12T01:08:37.388200+0000","last_became_active":"2024-09-12T00:30:19.164249+0000","last_became_peered":"2024-09-12T00:30:19.164249+0000","last_unstale":"2024-09-12T01:08:37.388200+0000","last_undegraded":"2024-09-12T01:08:37.388200+0000","last_fullsized":"2024-09-12T01:08:37.388200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.473748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'544","reported_seq":1352,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490700+0000","last_change":"2024-09-12T00:30:21.189555+0000","last_active":"2024-09-12T01:10:51.490700+0000","last_peered":"2024-09-12T01:10:51.490700+0000","last_clean":"2024-09-12T01:10:51.490700+0000","last_became_active":"2024-09-12T00:30:21.189156+0000","last_became_peered":"2024-09-12T00:30:21.189156+0000","last_unstale":"2024-09-12T01:10:51.490700+0000","last_undegraded":"2024-09-12T01:10:51.490700+0000","last_fullsized":"2024-09-12T01:10:51.490700+0000","mapping_epoch":36,"log_start":"264'500","ondisk_log_start":"264'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:44.394203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1309,"num_read_kb":1298,"num_write":1161,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'143","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411766+0000","last_change":"2024-09-12T00:30:13.124257+0000","last_active":"2024-09-12T01:09:13.411766+0000","last_peered":"2024-09-12T01:09:13.411766+0000","last_clean":"2024-09-12T01:09:13.411766+0000","last_became_active":"2024-09-12T00:30:13.124006+0000","last_became_peered":"2024-09-12T00:30:13.124006+0000","last_unstale":"2024-09-12T01:09:13.411766+0000","last_undegraded":"2024-09-12T01:09:13.411766+0000","last_fullsized":"2024-09-12T01:09:13.411766+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:34.013529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":534,"num_write":203,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'349","reported_seq":1155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.750723+0000","last_change":"2024-09-12T00:30:11.104817+0000","last_active":"2024-09-12T01:09:43.750723+0000","last_peered":"2024-09-12T01:09:43.750723+0000","last_clean":"2024-09-12T01:09:43.750723+0000","last_became_active":"2024-09-12T00:30:11.104314+0000","last_became_peered":"2024-09-12T00:30:11.104314+0000","last_unstale":"2024-09-12T01:09:43.750723+0000","last_undegraded":"2024-09-12T01:09:43.750723+0000","last_fullsized":"2024-09-12T01:09:43.750723+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:39.988458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15014466,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":742,"num_read_kb":45639,"num_write":1475,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375246+0000","last_change":"2024-09-12T00:30:15.125725+0000","last_active":"2024-09-12T01:07:07.375246+0000","last_peered":"2024-09-12T01:07:07.375246+0000","last_clean":"2024-09-12T01:07:07.375246+0000","last_became_active":"2024-09-12T00:30:15.125380+0000","last_became_peered":"2024-09-12T00:30:15.125380+0000","last_unstale":"2024-09-12T01:07:07.375246+0000","last_undegraded":"2024-09-12T01:07:07.375246+0000","last_fullsized":"2024-09-12T01:07:07.375246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:13.819176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'249","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.454948+0000","last_change":"2024-09-12T00:30:17.146917+0000","last_active":"2024-09-12T01:10:51.454948+0000","last_peered":"2024-09-12T01:10:51.454948+0000","last_clean":"2024-09-12T01:10:51.454948+0000","last_became_active":"2024-09-12T00:30:17.145155+0000","last_became_peered":"2024-09-12T00:30:17.145155+0000","last_unstale":"2024-09-12T01:10:51.454948+0000","last_undegraded":"2024-09-12T01:10:51.454948+0000","last_fullsized":"2024-09-12T01:10:51.454948+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.615595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56946,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":408,"num_read_kb":855,"num_write":332,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.506558+0000","last_change":"2024-09-12T00:30:19.171499+0000","last_active":"2024-09-12T01:07:17.506558+0000","last_peered":"2024-09-12T01:07:17.506558+0000","last_clean":"2024-09-12T01:07:17.506558+0000","last_became_active":"2024-09-12T00:30:19.171189+0000","last_became_peered":"2024-09-12T00:30:19.171189+0000","last_unstale":"2024-09-12T01:07:17.506558+0000","last_undegraded":"2024-09-12T01:07:17.506558+0000","last_fullsized":"2024-09-12T01:07:17.506558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:46.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2414","reported_seq":4278,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.417930+0000","last_change":"2024-09-12T00:30:21.184001+0000","last_active":"2024-09-12T01:10:08.417930+0000","last_peered":"2024-09-12T01:10:08.417930+0000","last_clean":"2024-09-12T01:10:08.417930+0000","last_became_active":"2024-09-12T00:30:21.183561+0000","last_became_peered":"2024-09-12T00:30:21.183561+0000","last_unstale":"2024-09-12T01:10:08.417930+0000","last_undegraded":"2024-09-12T01:10:08.417930+0000","last_fullsized":"2024-09-12T01:10:08.417930+0000","mapping_epoch":36,"log_start":"264'2400","ondisk_log_start":"264'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":2400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:10.831146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6196,"num_read_kb":6147,"num_write":4885,"num_write_kb":1795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'180","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.091778+0000","last_change":"2024-09-12T00:30:13.122346+0000","last_active":"2024-09-12T01:08:05.091778+0000","last_peered":"2024-09-12T01:08:05.091778+0000","last_clean":"2024-09-12T01:08:05.091778+0000","last_became_active":"2024-09-12T00:30:13.122098+0000","last_became_peered":"2024-09-12T00:30:13.122098+0000","last_unstale":"2024-09-12T01:08:05.091778+0000","last_undegraded":"2024-09-12T01:08:05.091778+0000","last_fullsized":"2024-09-12T01:08:05.091778+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:08.371631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":634,"num_write":261,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'279","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.561759+0000","last_change":"2024-09-12T00:30:11.113453+0000","last_active":"2024-09-12T01:11:23.561759+0000","last_peered":"2024-09-12T01:11:23.561759+0000","last_clean":"2024-09-12T01:11:23.561759+0000","last_became_active":"2024-09-12T00:30:11.112302+0000","last_became_peered":"2024-09-12T00:30:11.112302+0000","last_unstale":"2024-09-12T01:11:23.561759+0000","last_undegraded":"2024-09-12T01:11:23.561759+0000","last_fullsized":"2024-09-12T01:11:23.561759+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:35.544849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324989,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":431,"num_read_kb":10142,"num_write":947,"num_write_kb":18823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476007+0000","last_change":"2024-09-12T00:30:15.129726+0000","last_active":"2024-09-12T01:08:32.476007+0000","last_peered":"2024-09-12T01:08:32.476007+0000","last_clean":"2024-09-12T01:08:32.476007+0000","last_became_active":"2024-09-12T00:30:15.129311+0000","last_became_peered":"2024-09-12T00:30:15.129311+0000","last_unstale":"2024-09-12T01:08:32.476007+0000","last_undegraded":"2024-09-12T01:08:32.476007+0000","last_fullsized":"2024-09-12T01:08:32.476007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.755744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'301","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.479762+0000","last_change":"2024-09-12T00:30:17.147414+0000","last_active":"2024-09-12T01:10:51.479762+0000","last_peered":"2024-09-12T01:10:51.479762+0000","last_clean":"2024-09-12T01:10:51.479762+0000","last_became_active":"2024-09-12T00:30:17.147148+0000","last_became_peered":"2024-09-12T00:30:17.147148+0000","last_unstale":"2024-09-12T01:10:51.479762+0000","last_undegraded":"2024-09-12T01:10:51.479762+0000","last_fullsized":"2024-09-12T01:10:51.479762+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:05.230391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61211,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1004,"num_write":408,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'797","reported_seq":2324,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.508156+0000","last_change":"2024-09-12T00:30:19.168748+0000","last_active":"2024-09-12T01:10:51.508156+0000","last_peered":"2024-09-12T01:10:51.508156+0000","last_clean":"2024-09-12T01:10:51.508156+0000","last_became_active":"2024-09-12T00:30:19.168419+0000","last_became_peered":"2024-09-12T00:30:19.168419+0000","last_unstale":"2024-09-12T01:10:51.508156+0000","last_undegraded":"2024-09-12T01:10:51.508156+0000","last_fullsized":"2024-09-12T01:10:51.508156+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.358636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'162","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.270455+0000","last_change":"2024-09-12T00:30:21.179851+0000","last_active":"2024-09-12T01:10:50.270455+0000","last_peered":"2024-09-12T01:10:50.270455+0000","last_clean":"2024-09-12T01:10:50.270455+0000","last_became_active":"2024-09-12T00:30:21.179533+0000","last_became_peered":"2024-09-12T00:30:21.179533+0000","last_unstale":"2024-09-12T01:10:50.270455+0000","last_undegraded":"2024-09-12T01:10:50.270455+0000","last_fullsized":"2024-09-12T01:10:50.270455+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:31.165476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":87,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'98","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.459055+0000","last_change":"2024-09-12T00:30:13.131803+0000","last_active":"2024-09-12T01:08:55.459055+0000","last_peered":"2024-09-12T01:08:55.459055+0000","last_clean":"2024-09-12T01:08:55.459055+0000","last_became_active":"2024-09-12T00:30:13.131423+0000","last_became_peered":"2024-09-12T00:30:13.131423+0000","last_unstale":"2024-09-12T01:08:55.459055+0000","last_undegraded":"2024-09-12T01:08:55.459055+0000","last_fullsized":"2024-09-12T01:08:55.459055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:28.163588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":366,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'341","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.472171+0000","last_change":"2024-09-12T00:30:11.103652+0000","last_active":"2024-09-12T01:11:23.472171+0000","last_peered":"2024-09-12T01:11:23.472171+0000","last_clean":"2024-09-12T01:11:23.472171+0000","last_became_active":"2024-09-12T00:30:11.103285+0000","last_became_peered":"2024-09-12T00:30:11.103285+0000","last_unstale":"2024-09-12T01:11:23.472171+0000","last_undegraded":"2024-09-12T01:11:23.472171+0000","last_fullsized":"2024-09-12T01:11:23.472171+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:22.473520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284123,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":536,"num_read_kb":3264,"num_write":1054,"num_write_kb":35970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.376081+0000","last_change":"2024-09-12T00:30:15.132989+0000","last_active":"2024-09-12T01:07:12.376081+0000","last_peered":"2024-09-12T01:07:12.376081+0000","last_clean":"2024-09-12T01:07:12.376081+0000","last_became_active":"2024-09-12T00:30:15.132695+0000","last_became_peered":"2024-09-12T00:30:15.132695+0000","last_unstale":"2024-09-12T01:07:12.376081+0000","last_undegraded":"2024-09-12T01:07:12.376081+0000","last_fullsized":"2024-09-12T01:07:12.376081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:47.371729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'449","reported_seq":1072,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.482261+0000","last_change":"2024-09-12T00:30:17.147365+0000","last_active":"2024-09-12T01:10:51.482261+0000","last_peered":"2024-09-12T01:10:51.482261+0000","last_clean":"2024-09-12T01:10:51.482261+0000","last_became_active":"2024-09-12T00:30:17.147015+0000","last_became_peered":"2024-09-12T00:30:17.147015+0000","last_unstale":"2024-09-12T01:10:51.482261+0000","last_undegraded":"2024-09-12T01:10:51.482261+0000","last_fullsized":"2024-09-12T01:10:51.482261+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.499988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116137,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":761,"num_read_kb":1645,"num_write":620,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.464310+0000","last_change":"2024-09-12T00:30:19.167774+0000","last_active":"2024-09-12T01:07:12.464310+0000","last_peered":"2024-09-12T01:07:12.464310+0000","last_clean":"2024-09-12T01:07:12.464310+0000","last_became_active":"2024-09-12T00:30:19.167503+0000","last_became_peered":"2024-09-12T00:30:19.167503+0000","last_unstale":"2024-09-12T01:07:12.464310+0000","last_undegraded":"2024-09-12T01:07:12.464310+0000","last_fullsized":"2024-09-12T01:07:12.464310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:36.705384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'96","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.090386+0000","last_change":"2024-09-12T00:30:21.192974+0000","last_active":"2024-09-12T01:09:27.090386+0000","last_peered":"2024-09-12T01:09:27.090386+0000","last_clean":"2024-09-12T01:09:27.090386+0000","last_became_active":"2024-09-12T00:30:21.192700+0000","last_became_peered":"2024-09-12T00:30:21.192700+0000","last_unstale":"2024-09-12T01:09:27.090386+0000","last_undegraded":"2024-09-12T01:09:27.090386+0000","last_fullsized":"2024-09-12T01:09:27.090386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:29.992638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":205,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'119","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.885840+0000","last_change":"2024-09-12T00:30:13.128514+0000","last_active":"2024-09-12T01:09:23.885840+0000","last_peered":"2024-09-12T01:09:23.885840+0000","last_clean":"2024-09-12T01:09:23.885840+0000","last_became_active":"2024-09-12T00:30:13.128253+0000","last_became_peered":"2024-09-12T00:30:13.128253+0000","last_unstale":"2024-09-12T01:09:23.885840+0000","last_undegraded":"2024-09-12T01:09:23.885840+0000","last_fullsized":"2024-09-12T01:09:23.885840+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:27.745822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":431,"num_write":189,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'277","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.249150+0000","last_change":"2024-09-12T00:30:11.100672+0000","last_active":"2024-09-12T01:11:23.249150+0000","last_peered":"2024-09-12T01:11:23.249150+0000","last_clean":"2024-09-12T01:11:23.249150+0000","last_became_active":"2024-09-12T00:30:11.100056+0000","last_became_peered":"2024-09-12T00:30:11.100056+0000","last_unstale":"2024-09-12T01:11:23.249150+0000","last_undegraded":"2024-09-12T01:11:23.249150+0000","last_fullsized":"2024-09-12T01:11:23.249150+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:16.381329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380833,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":444,"num_read_kb":62849,"num_write":1050,"num_write_kb":31335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.386352+0000","last_change":"2024-09-12T00:30:15.133052+0000","last_active":"2024-09-12T01:08:33.386352+0000","last_peered":"2024-09-12T01:08:33.386352+0000","last_clean":"2024-09-12T01:08:33.386352+0000","last_became_active":"2024-09-12T00:30:15.132801+0000","last_became_peered":"2024-09-12T00:30:15.132801+0000","last_unstale":"2024-09-12T01:08:33.386352+0000","last_undegraded":"2024-09-12T01:08:33.386352+0000","last_fullsized":"2024-09-12T01:08:33.386352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:47.232632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'293","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.966157+0000","last_change":"2024-09-12T00:30:17.149925+0000","last_active":"2024-09-12T01:11:22.966157+0000","last_peered":"2024-09-12T01:11:22.966157+0000","last_clean":"2024-09-12T01:11:22.966157+0000","last_became_active":"2024-09-12T00:30:17.149603+0000","last_became_peered":"2024-09-12T00:30:17.149603+0000","last_unstale":"2024-09-12T01:11:22.966157+0000","last_undegraded":"2024-09-12T01:11:22.966157+0000","last_fullsized":"2024-09-12T01:11:22.966157+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.420246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57292,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":510,"num_read_kb":1117,"num_write":456,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.387057+0000","last_change":"2024-09-12T00:30:19.168486+0000","last_active":"2024-09-12T01:08:38.387057+0000","last_peered":"2024-09-12T01:08:38.387057+0000","last_clean":"2024-09-12T01:08:38.387057+0000","last_became_active":"2024-09-12T00:30:19.168223+0000","last_became_peered":"2024-09-12T00:30:19.168223+0000","last_unstale":"2024-09-12T01:08:38.387057+0000","last_undegraded":"2024-09-12T01:08:38.387057+0000","last_fullsized":"2024-09-12T01:08:38.387057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'123","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:27.493758+0000","last_change":"2024-09-12T00:30:21.192816+0000","last_active":"2024-09-12T01:10:27.493758+0000","last_peered":"2024-09-12T01:10:27.493758+0000","last_clean":"2024-09-12T01:10:27.493758+0000","last_became_active":"2024-09-12T00:30:21.192509+0000","last_became_peered":"2024-09-12T00:30:21.192509+0000","last_unstale":"2024-09-12T01:10:27.493758+0000","last_undegraded":"2024-09-12T01:10:27.493758+0000","last_fullsized":"2024-09-12T01:10:27.493758+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:26.935855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'134","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.147039+0000","last_change":"2024-09-12T00:30:13.123694+0000","last_active":"2024-09-12T01:09:32.147039+0000","last_peered":"2024-09-12T01:09:32.147039+0000","last_clean":"2024-09-12T01:09:32.147039+0000","last_became_active":"2024-09-12T00:30:13.123412+0000","last_became_peered":"2024-09-12T00:30:13.123412+0000","last_unstale":"2024-09-12T01:09:32.147039+0000","last_undegraded":"2024-09-12T01:09:32.147039+0000","last_fullsized":"2024-09-12T01:09:32.147039+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:23.159421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":514,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'258","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.603553+0000","last_change":"2024-09-12T00:30:11.098282+0000","last_active":"2024-09-12T01:11:23.603553+0000","last_peered":"2024-09-12T01:11:23.603553+0000","last_clean":"2024-09-12T01:11:23.603553+0000","last_became_active":"2024-09-12T00:30:11.097902+0000","last_became_peered":"2024-09-12T00:30:11.097902+0000","last_unstale":"2024-09-12T01:11:23.603553+0000","last_undegraded":"2024-09-12T01:11:23.603553+0000","last_fullsized":"2024-09-12T01:11:23.603553+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.859119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2387060,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":404,"num_read_kb":17154,"num_write":960,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476034+0000","last_change":"2024-09-12T00:30:15.125920+0000","last_active":"2024-09-12T01:08:32.476034+0000","last_peered":"2024-09-12T01:08:32.476034+0000","last_clean":"2024-09-12T01:08:32.476034+0000","last_became_active":"2024-09-12T00:30:15.125629+0000","last_became_peered":"2024-09-12T00:30:15.125629+0000","last_unstale":"2024-09-12T01:08:32.476034+0000","last_undegraded":"2024-09-12T01:08:32.476034+0000","last_fullsized":"2024-09-12T01:08:32.476034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:47.978464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'278","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.489267+0000","last_change":"2024-09-12T00:30:17.149967+0000","last_active":"2024-09-12T01:10:51.489267+0000","last_peered":"2024-09-12T01:10:51.489267+0000","last_clean":"2024-09-12T01:10:51.489267+0000","last_became_active":"2024-09-12T00:30:17.149661+0000","last_became_peered":"2024-09-12T00:30:17.149661+0000","last_unstale":"2024-09-12T01:10:51.489267+0000","last_undegraded":"2024-09-12T01:10:51.489267+0000","last_fullsized":"2024-09-12T01:10:51.489267+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:40.653446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61294,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":921,"num_write":366,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'761","reported_seq":2256,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.506608+0000","last_change":"2024-09-12T00:30:19.167751+0000","last_active":"2024-09-12T01:11:22.506608+0000","last_peered":"2024-09-12T01:11:22.506608+0000","last_clean":"2024-09-12T01:11:22.506608+0000","last_became_active":"2024-09-12T00:30:19.167476+0000","last_became_peered":"2024-09-12T00:30:19.167476+0000","last_unstale":"2024-09-12T01:11:22.506608+0000","last_undegraded":"2024-09-12T01:11:22.506608+0000","last_fullsized":"2024-09-12T01:11:22.506608+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:15.217938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'158","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.465466+0000","last_change":"2024-09-12T00:30:21.187022+0000","last_active":"2024-09-12T01:08:14.465466+0000","last_peered":"2024-09-12T01:08:14.465466+0000","last_clean":"2024-09-12T01:08:14.465466+0000","last_became_active":"2024-09-12T00:30:21.185553+0000","last_became_peered":"2024-09-12T00:30:21.185553+0000","last_unstale":"2024-09-12T01:08:14.465466+0000","last_undegraded":"2024-09-12T01:08:14.465466+0000","last_fullsized":"2024-09-12T01:08:14.465466+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:17.382517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":222,"num_write":391,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'167","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:31.495475+0000","last_change":"2024-09-12T00:30:13.121937+0000","last_active":"2024-09-12T01:08:31.495475+0000","last_peered":"2024-09-12T01:08:31.495475+0000","last_clean":"2024-09-12T01:08:31.495475+0000","last_became_active":"2024-09-12T00:30:13.121664+0000","last_became_peered":"2024-09-12T00:30:13.121664+0000","last_unstale":"2024-09-12T01:08:31.495475+0000","last_undegraded":"2024-09-12T01:08:31.495475+0000","last_fullsized":"2024-09-12T01:08:31.495475+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:50.278462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":568,"num_write":259,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'492","reported_seq":1306,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.628816+0000","last_change":"2024-09-12T00:30:11.112653+0000","last_active":"2024-09-12T01:11:23.628816+0000","last_peered":"2024-09-12T01:11:23.628816+0000","last_clean":"2024-09-12T01:11:23.628816+0000","last_became_active":"2024-09-12T00:30:11.110370+0000","last_became_peered":"2024-09-12T00:30:11.110370+0000","last_unstale":"2024-09-12T01:11:23.628816+0000","last_undegraded":"2024-09-12T01:11:23.628816+0000","last_fullsized":"2024-09-12T01:11:23.628816+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:29.346634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181242,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":1197,"num_read_kb":75458,"num_write":1566,"num_write_kb":22075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.488233+0000","last_change":"2024-09-12T00:30:15.133096+0000","last_active":"2024-09-12T01:11:22.488233+0000","last_peered":"2024-09-12T01:11:22.488233+0000","last_clean":"2024-09-12T01:11:22.488233+0000","last_became_active":"2024-09-12T00:30:15.132802+0000","last_became_peered":"2024-09-12T00:30:15.132802+0000","last_unstale":"2024-09-12T01:11:22.488233+0000","last_undegraded":"2024-09-12T01:11:22.488233+0000","last_fullsized":"2024-09-12T01:11:22.488233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:41.563778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'74","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.169269+0000","last_change":"2024-09-12T00:30:17.148149+0000","last_active":"2024-09-12T01:10:26.169269+0000","last_peered":"2024-09-12T01:10:26.169269+0000","last_clean":"2024-09-12T01:10:26.169269+0000","last_became_active":"2024-09-12T00:30:17.147864+0000","last_became_peered":"2024-09-12T00:30:17.147864+0000","last_unstale":"2024-09-12T01:10:26.169269+0000","last_undegraded":"2024-09-12T01:10:26.169269+0000","last_fullsized":"2024-09-12T01:10:26.169269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.850618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'782","reported_seq":2333,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.507478+0000","last_change":"2024-09-12T00:30:19.169220+0000","last_active":"2024-09-12T01:11:22.507478+0000","last_peered":"2024-09-12T01:11:22.507478+0000","last_clean":"2024-09-12T01:11:22.507478+0000","last_became_active":"2024-09-12T00:30:19.168960+0000","last_became_peered":"2024-09-12T00:30:19.168960+0000","last_unstale":"2024-09-12T01:11:22.507478+0000","last_undegraded":"2024-09-12T01:11:22.507478+0000","last_fullsized":"2024-09-12T01:11:22.507478+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:05.977565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.244027+0000","last_change":"2024-09-12T00:30:21.186976+0000","last_active":"2024-09-12T01:08:47.244027+0000","last_peered":"2024-09-12T01:08:47.244027+0000","last_clean":"2024-09-12T01:08:47.244027+0000","last_became_active":"2024-09-12T00:30:21.185618+0000","last_became_peered":"2024-09-12T00:30:21.185618+0000","last_unstale":"2024-09-12T01:08:47.244027+0000","last_undegraded":"2024-09-12T01:08:47.244027+0000","last_fullsized":"2024-09-12T01:08:47.244027+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:37.276257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":151,"num_write":299,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:49.019799+0000","last_change":"2024-09-12T00:30:13.130144+0000","last_active":"2024-09-12T01:08:49.019799+0000","last_peered":"2024-09-12T01:08:49.019799+0000","last_clean":"2024-09-12T01:08:49.019799+0000","last_became_active":"2024-09-12T00:30:13.129892+0000","last_became_peered":"2024-09-12T00:30:13.129892+0000","last_unstale":"2024-09-12T01:08:49.019799+0000","last_undegraded":"2024-09-12T01:08:49.019799+0000","last_fullsized":"2024-09-12T01:08:49.019799+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:52.379617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":984,"num_read_kb":836,"num_write":303,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'260","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:42.940671+0000","last_change":"2024-09-12T00:30:11.103543+0000","last_active":"2024-09-12T01:10:42.940671+0000","last_peered":"2024-09-12T01:10:42.940671+0000","last_clean":"2024-09-12T01:10:42.940671+0000","last_became_active":"2024-09-12T00:30:11.103195+0000","last_became_peered":"2024-09-12T00:30:11.103195+0000","last_unstale":"2024-09-12T01:10:42.940671+0000","last_undegraded":"2024-09-12T01:10:42.940671+0000","last_fullsized":"2024-09-12T01:10:42.940671+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:34.854760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6563396,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":379,"num_read_kb":8246,"num_write":884,"num_write_kb":41947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.602445+0000","last_change":"2024-09-12T00:30:15.128205+0000","last_active":"2024-09-12T01:08:33.602445+0000","last_peered":"2024-09-12T01:08:33.602445+0000","last_clean":"2024-09-12T01:08:33.602445+0000","last_became_active":"2024-09-12T00:30:15.127047+0000","last_became_peered":"2024-09-12T00:30:15.127047+0000","last_unstale":"2024-09-12T01:08:33.602445+0000","last_undegraded":"2024-09-12T01:08:33.602445+0000","last_fullsized":"2024-09-12T01:08:33.602445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:24.381773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'306","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.473780+0000","last_change":"2024-09-12T00:30:17.149883+0000","last_active":"2024-09-12T01:10:51.473780+0000","last_peered":"2024-09-12T01:10:51.473780+0000","last_clean":"2024-09-12T01:10:51.473780+0000","last_became_active":"2024-09-12T00:30:17.149579+0000","last_became_peered":"2024-09-12T00:30:17.149579+0000","last_unstale":"2024-09-12T01:10:51.473780+0000","last_undegraded":"2024-09-12T01:10:51.473780+0000","last_fullsized":"2024-09-12T01:10:51.473780+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:00.182066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49466,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":910,"num_write":384,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496293+0000","last_change":"2024-09-12T00:30:19.169963+0000","last_active":"2024-09-12T01:08:36.496293+0000","last_peered":"2024-09-12T01:08:36.496293+0000","last_clean":"2024-09-12T01:08:36.496293+0000","last_became_active":"2024-09-12T00:30:19.169468+0000","last_became_peered":"2024-09-12T00:30:19.169468+0000","last_unstale":"2024-09-12T01:08:36.496293+0000","last_undegraded":"2024-09-12T01:08:36.496293+0000","last_fullsized":"2024-09-12T01:08:36.496293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.885333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'111","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.875182+0000","last_change":"2024-09-12T00:30:21.184306+0000","last_active":"2024-09-12T01:09:46.875182+0000","last_peered":"2024-09-12T01:09:46.875182+0000","last_clean":"2024-09-12T01:09:46.875182+0000","last_became_active":"2024-09-12T00:30:21.184033+0000","last_became_peered":"2024-09-12T00:30:21.184033+0000","last_unstale":"2024-09-12T01:09:46.875182+0000","last_undegraded":"2024-09-12T01:09:46.875182+0000","last_fullsized":"2024-09-12T01:09:46.875182+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.799929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":266,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'245","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.688573+0000","last_change":"2024-09-12T00:30:13.121232+0000","last_active":"2024-09-12T01:08:19.688573+0000","last_peered":"2024-09-12T01:08:19.688573+0000","last_clean":"2024-09-12T01:08:19.688573+0000","last_became_active":"2024-09-12T00:30:13.120962+0000","last_became_peered":"2024-09-12T00:30:13.120962+0000","last_unstale":"2024-09-12T01:08:19.688573+0000","last_undegraded":"2024-09-12T01:08:19.688573+0000","last_fullsized":"2024-09-12T01:08:19.688573+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:29.222097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":839,"num_write":403,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403142+0000","last_change":"2024-09-12T00:29:54.471707+0000","last_active":"2024-09-12T01:08:08.403142+0000","last_peered":"2024-09-12T01:08:08.403142+0000","last_clean":"2024-09-12T01:08:08.403142+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T01:08:08.403142+0000","last_undegraded":"2024-09-12T01:08:08.403142+0000","last_fullsized":"2024-09-12T01:08:08.403142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_clean_scrub_stamp":"2024-09-12T00:29:53.438265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.897736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594622+0000","last_change":"2024-09-12T00:30:01.530800+0000","last_active":"2024-09-12T01:07:33.594622+0000","last_peered":"2024-09-12T01:07:33.594622+0000","last_clean":"2024-09-12T01:07:33.594622+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T01:07:33.594622+0000","last_undegraded":"2024-09-12T01:07:33.594622+0000","last_fullsized":"2024-09-12T01:07:33.594622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:58.930249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'255","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.751009+0000","last_change":"2024-09-12T00:30:11.102970+0000","last_active":"2024-09-12T01:09:43.751009+0000","last_peered":"2024-09-12T01:09:43.751009+0000","last_clean":"2024-09-12T01:09:43.751009+0000","last_became_active":"2024-09-12T00:30:11.102144+0000","last_became_peered":"2024-09-12T00:30:11.102144+0000","last_unstale":"2024-09-12T01:09:43.751009+0000","last_undegraded":"2024-09-12T01:09:43.751009+0000","last_fullsized":"2024-09-12T01:09:43.751009+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:38.319543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14238165,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":368,"num_read_kb":17991,"num_write":923,"num_write_kb":40410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"38'3","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.477731+0000","last_change":"2024-09-12T00:30:15.132691+0000","last_active":"2024-09-12T01:11:22.477731+0000","last_peered":"2024-09-12T01:11:22.477731+0000","last_clean":"2024-09-12T01:11:22.477731+0000","last_became_active":"2024-09-12T00:30:15.132332+0000","last_became_peered":"2024-09-12T00:30:15.132332+0000","last_unstale":"2024-09-12T01:11:22.477731+0000","last_undegraded":"2024-09-12T01:11:22.477731+0000","last_fullsized":"2024-09-12T01:11:22.477731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:09.196418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'701","reported_seq":1384,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.593925+0000","last_change":"2024-09-12T00:30:17.150136+0000","last_active":"2024-09-12T01:11:23.593925+0000","last_peered":"2024-09-12T01:11:23.593925+0000","last_clean":"2024-09-12T01:11:23.593925+0000","last_became_active":"2024-09-12T00:30:17.149842+0000","last_became_peered":"2024-09-12T00:30:17.149842+0000","last_unstale":"2024-09-12T01:11:23.593925+0000","last_undegraded":"2024-09-12T01:11:23.593925+0000","last_fullsized":"2024-09-12T01:11:23.593925+0000","mapping_epoch":32,"log_start":"264'600","ondisk_log_start":"264'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.362386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185190,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1370,"num_read_kb":2889,"num_write":1303,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.464436+0000","last_change":"2024-09-12T00:30:19.168459+0000","last_active":"2024-09-12T01:07:12.464436+0000","last_peered":"2024-09-12T01:07:12.464436+0000","last_clean":"2024-09-12T01:07:12.464436+0000","last_became_active":"2024-09-12T00:30:19.168219+0000","last_became_peered":"2024-09-12T00:30:19.168219+0000","last_unstale":"2024-09-12T01:07:12.464436+0000","last_undegraded":"2024-09-12T01:07:12.464436+0000","last_fullsized":"2024-09-12T01:07:12.464436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:10.717786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'214","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:45.780203+0000","last_change":"2024-09-12T00:30:21.192045+0000","last_active":"2024-09-12T01:09:45.780203+0000","last_peered":"2024-09-12T01:09:45.780203+0000","last_clean":"2024-09-12T01:09:45.780203+0000","last_became_active":"2024-09-12T00:30:21.191389+0000","last_became_peered":"2024-09-12T00:30:21.191389+0000","last_unstale":"2024-09-12T01:09:45.780203+0000","last_undegraded":"2024-09-12T01:09:45.780203+0000","last_fullsized":"2024-09-12T01:09:45.780203+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:50.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":544,"num_write":463,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'83","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.482265+0000","last_change":"2024-09-12T00:30:13.124765+0000","last_active":"2024-09-12T01:09:12.482265+0000","last_peered":"2024-09-12T01:09:12.482265+0000","last_clean":"2024-09-12T01:09:12.482265+0000","last_became_active":"2024-09-12T00:30:13.124407+0000","last_became_peered":"2024-09-12T00:30:13.124407+0000","last_unstale":"2024-09-12T01:09:12.482265+0000","last_undegraded":"2024-09-12T01:09:12.482265+0000","last_fullsized":"2024-09-12T01:09:12.482265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:33.269760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":258,"num_write":150,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.598985+0000","last_change":"2024-09-12T00:30:01.530206+0000","last_active":"2024-09-12T01:08:08.598985+0000","last_peered":"2024-09-12T01:08:08.598985+0000","last_clean":"2024-09-12T01:08:08.598985+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T01:08:08.598985+0000","last_undegraded":"2024-09-12T01:08:08.598985+0000","last_fullsized":"2024-09-12T01:08:08.598985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:48.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'316","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.470506+0000","last_change":"2024-09-12T00:30:11.099484+0000","last_active":"2024-09-12T01:09:23.470506+0000","last_peered":"2024-09-12T01:09:23.470506+0000","last_clean":"2024-09-12T01:09:23.470506+0000","last_became_active":"2024-09-12T00:30:11.099065+0000","last_became_peered":"2024-09-12T00:30:11.099065+0000","last_unstale":"2024-09-12T01:09:23.470506+0000","last_undegraded":"2024-09-12T01:09:23.470506+0000","last_fullsized":"2024-09-12T01:09:23.470506+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:19.401122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2020207,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":452,"num_read_kb":8968,"num_write":1100,"num_write_kb":21800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590364+0000","last_change":"2024-09-12T00:30:15.130834+0000","last_active":"2024-09-12T01:07:08.590364+0000","last_peered":"2024-09-12T01:07:08.590364+0000","last_clean":"2024-09-12T01:07:08.590364+0000","last_became_active":"2024-09-12T00:30:15.130490+0000","last_became_peered":"2024-09-12T00:30:15.130490+0000","last_unstale":"2024-09-12T01:07:08.590364+0000","last_undegraded":"2024-09-12T01:07:08.590364+0000","last_fullsized":"2024-09-12T01:07:08.590364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:41.519057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'1348","reported_seq":2766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.768645+0000","last_change":"2024-09-12T00:30:17.146700+0000","last_active":"2024-09-12T01:11:22.768645+0000","last_peered":"2024-09-12T01:11:22.768645+0000","last_clean":"2024-09-12T01:11:22.768645+0000","last_became_active":"2024-09-12T00:30:17.146374+0000","last_became_peered":"2024-09-12T00:30:17.146374+0000","last_unstale":"2024-09-12T01:11:22.768645+0000","last_undegraded":"2024-09-12T01:11:22.768645+0000","last_fullsized":"2024-09-12T01:11:22.768645+0000","mapping_epoch":32,"log_start":"264'1300","ondisk_log_start":"264'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:46.392573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186701,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2147,"num_read_kb":3978,"num_write":1250,"num_write_kb":1090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.597073+0000","last_change":"2024-09-12T00:30:19.169975+0000","last_active":"2024-09-12T01:07:53.597073+0000","last_peered":"2024-09-12T01:07:53.597073+0000","last_clean":"2024-09-12T01:07:53.597073+0000","last_became_active":"2024-09-12T00:30:19.169700+0000","last_became_peered":"2024-09-12T00:30:19.169700+0000","last_unstale":"2024-09-12T01:07:53.597073+0000","last_undegraded":"2024-09-12T01:07:53.597073+0000","last_fullsized":"2024-09-12T01:07:53.597073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:43.445292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'95","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.451982+0000","last_change":"2024-09-12T00:30:21.193756+0000","last_active":"2024-09-12T01:09:28.451982+0000","last_peered":"2024-09-12T01:09:28.451982+0000","last_clean":"2024-09-12T01:09:28.451982+0000","last_became_active":"2024-09-12T00:30:21.193491+0000","last_became_peered":"2024-09-12T00:30:21.193491+0000","last_unstale":"2024-09-12T01:09:28.451982+0000","last_undegraded":"2024-09-12T01:09:28.451982+0000","last_fullsized":"2024-09-12T01:09:28.451982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:22.498346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":108,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'101","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.393014+0000","last_change":"2024-09-12T00:30:13.124361+0000","last_active":"2024-09-12T01:09:12.393014+0000","last_peered":"2024-09-12T01:09:12.393014+0000","last_clean":"2024-09-12T01:09:12.393014+0000","last_became_active":"2024-09-12T00:30:13.124085+0000","last_became_peered":"2024-09-12T00:30:13.124085+0000","last_unstale":"2024-09-12T01:09:12.393014+0000","last_undegraded":"2024-09-12T01:09:12.393014+0000","last_fullsized":"2024-09-12T01:09:12.393014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:04.474974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":146,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.378595+0000","last_change":"2024-09-12T00:30:01.610469+0000","last_active":"2024-09-12T01:07:33.378595+0000","last_peered":"2024-09-12T01:07:33.378595+0000","last_clean":"2024-09-12T01:07:33.378595+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T01:07:33.378595+0000","last_undegraded":"2024-09-12T01:07:33.378595+0000","last_fullsized":"2024-09-12T01:07:33.378595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:35.665518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'292","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.649534+0000","last_change":"2024-09-12T00:30:46.767164+0000","last_active":"2024-09-12T01:09:33.649534+0000","last_peered":"2024-09-12T01:09:33.649534+0000","last_clean":"2024-09-12T01:09:33.649534+0000","last_became_active":"2024-09-12T00:30:46.766731+0000","last_became_peered":"2024-09-12T00:30:46.766731+0000","last_unstale":"2024-09-12T01:09:33.649534+0000","last_undegraded":"2024-09-12T01:09:33.649534+0000","last_fullsized":"2024-09-12T01:09:33.649534+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:46.403345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13020287,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":466,"num_read_kb":16356,"num_write":1122,"num_write_kb":34470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,4],"acting":[5,7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.374902+0000","last_change":"2024-09-12T00:30:15.133051+0000","last_active":"2024-09-12T01:07:08.374902+0000","last_peered":"2024-09-12T01:07:08.374902+0000","last_clean":"2024-09-12T01:07:08.374902+0000","last_became_active":"2024-09-12T00:30:15.132744+0000","last_became_peered":"2024-09-12T00:30:15.132744+0000","last_unstale":"2024-09-12T01:07:08.374902+0000","last_undegraded":"2024-09-12T01:07:08.374902+0000","last_fullsized":"2024-09-12T01:07:08.374902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:50.803146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'217","reported_seq":1253,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.310283+0000","last_change":"2024-09-12T00:30:17.145576+0000","last_active":"2024-09-12T01:10:50.310283+0000","last_peered":"2024-09-12T01:10:50.310283+0000","last_clean":"2024-09-12T01:10:50.310283+0000","last_became_active":"2024-09-12T00:30:17.145284+0000","last_became_peered":"2024-09-12T00:30:17.145284+0000","last_unstale":"2024-09-12T01:10:50.310283+0000","last_undegraded":"2024-09-12T01:10:50.310283+0000","last_fullsized":"2024-09-12T01:10:50.310283+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:04.503798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":145,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511658+0000","last_change":"2024-09-12T00:30:19.169714+0000","last_active":"2024-09-12T01:07:52.511658+0000","last_peered":"2024-09-12T01:07:52.511658+0000","last_clean":"2024-09-12T01:07:52.511658+0000","last_became_active":"2024-09-12T00:30:19.169439+0000","last_became_peered":"2024-09-12T00:30:19.169439+0000","last_unstale":"2024-09-12T01:07:52.511658+0000","last_undegraded":"2024-09-12T01:07:52.511658+0000","last_fullsized":"2024-09-12T01:07:52.511658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:26.888194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'342","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.969662+0000","last_change":"2024-09-12T00:30:21.187938+0000","last_active":"2024-09-12T01:09:46.969662+0000","last_peered":"2024-09-12T01:09:46.969662+0000","last_clean":"2024-09-12T01:09:46.969662+0000","last_became_active":"2024-09-12T00:30:21.187616+0000","last_became_peered":"2024-09-12T00:30:21.187616+0000","last_unstale":"2024-09-12T01:09:46.969662+0000","last_undegraded":"2024-09-12T01:09:46.969662+0000","last_fullsized":"2024-09-12T01:09:46.969662+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:17.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":676,"num_read_kb":665,"num_write":755,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'375","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.067358+0000","last_change":"2024-09-12T00:30:13.123029+0000","last_active":"2024-09-12T01:09:09.067358+0000","last_peered":"2024-09-12T01:09:09.067358+0000","last_clean":"2024-09-12T01:09:09.067358+0000","last_became_active":"2024-09-12T00:30:13.122751+0000","last_became_peered":"2024-09-12T00:30:13.122751+0000","last_unstale":"2024-09-12T01:09:09.067358+0000","last_undegraded":"2024-09-12T01:09:09.067358+0000","last_fullsized":"2024-09-12T01:09:09.067358+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:58.496482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1941,"num_read_kb":1679,"num_write":648,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594595+0000","last_change":"2024-09-12T00:30:01.530685+0000","last_active":"2024-09-12T01:07:33.594595+0000","last_peered":"2024-09-12T01:07:33.594595+0000","last_clean":"2024-09-12T01:07:33.594595+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T01:07:33.594595+0000","last_undegraded":"2024-09-12T01:07:33.594595+0000","last_fullsized":"2024-09-12T01:07:33.594595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:49.919156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'359","reported_seq":1092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.439930+0000","last_change":"2024-09-12T00:30:11.100580+0000","last_active":"2024-09-12T01:11:23.439930+0000","last_peered":"2024-09-12T01:11:23.439930+0000","last_clean":"2024-09-12T01:11:23.439930+0000","last_became_active":"2024-09-12T00:30:11.100253+0000","last_became_peered":"2024-09-12T00:30:11.100253+0000","last_unstale":"2024-09-12T01:11:23.439930+0000","last_undegraded":"2024-09-12T01:11:23.439930+0000","last_fullsized":"2024-09-12T01:11:23.439930+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:01.683692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12863237,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":812,"num_read_kb":32409,"num_write":1218,"num_write_kb":44212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.380734+0000","last_change":"2024-09-12T00:30:15.128086+0000","last_active":"2024-09-12T01:07:48.380734+0000","last_peered":"2024-09-12T01:07:48.380734+0000","last_clean":"2024-09-12T01:07:48.380734+0000","last_became_active":"2024-09-12T00:30:15.127835+0000","last_became_peered":"2024-09-12T00:30:15.127835+0000","last_unstale":"2024-09-12T01:07:48.380734+0000","last_undegraded":"2024-09-12T01:07:48.380734+0000","last_fullsized":"2024-09-12T01:07:48.380734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:47.620246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'123","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.156498+0000","last_change":"2024-09-12T00:30:17.148863+0000","last_active":"2024-09-12T01:10:26.156498+0000","last_peered":"2024-09-12T01:10:26.156498+0000","last_clean":"2024-09-12T01:10:26.156498+0000","last_became_active":"2024-09-12T00:30:17.148548+0000","last_became_peered":"2024-09-12T00:30:17.148548+0000","last_unstale":"2024-09-12T01:10:26.156498+0000","last_undegraded":"2024-09-12T01:10:26.156498+0000","last_fullsized":"2024-09-12T01:10:26.156498+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590341+0000","last_change":"2024-09-12T00:30:19.165383+0000","last_active":"2024-09-12T01:07:08.590341+0000","last_peered":"2024-09-12T01:07:08.590341+0000","last_clean":"2024-09-12T01:07:08.590341+0000","last_became_active":"2024-09-12T00:30:19.165120+0000","last_became_peered":"2024-09-12T00:30:19.165120+0000","last_unstale":"2024-09-12T01:07:08.590341+0000","last_undegraded":"2024-09-12T01:07:08.590341+0000","last_fullsized":"2024-09-12T01:07:08.590341+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:24.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'134","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.882688+0000","last_change":"2024-09-12T00:30:21.181012+0000","last_active":"2024-09-12T01:09:23.882688+0000","last_peered":"2024-09-12T01:09:23.882688+0000","last_clean":"2024-09-12T01:09:23.882688+0000","last_became_active":"2024-09-12T00:30:21.180708+0000","last_became_peered":"2024-09-12T00:30:21.180708+0000","last_unstale":"2024-09-12T01:09:23.882688+0000","last_undegraded":"2024-09-12T01:09:23.882688+0000","last_fullsized":"2024-09-12T01:09:23.882688+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:50.395523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":239,"num_write":325,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'170","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.380239+0000","last_change":"2024-09-12T00:30:13.130893+0000","last_active":"2024-09-12T01:07:42.380239+0000","last_peered":"2024-09-12T01:07:42.380239+0000","last_clean":"2024-09-12T01:07:42.380239+0000","last_became_active":"2024-09-12T00:30:13.130610+0000","last_became_peered":"2024-09-12T00:30:13.130610+0000","last_unstale":"2024-09-12T01:07:42.380239+0000","last_undegraded":"2024-09-12T01:07:42.380239+0000","last_fullsized":"2024-09-12T01:07:42.380239+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:26.005542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":757,"num_read_kb":608,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'255","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:26.086446+0000","last_change":"2024-09-12T00:30:11.104365+0000","last_active":"2024-09-12T01:09:26.086446+0000","last_peered":"2024-09-12T01:09:26.086446+0000","last_clean":"2024-09-12T01:09:26.086446+0000","last_became_active":"2024-09-12T00:30:11.104002+0000","last_became_peered":"2024-09-12T00:30:11.104002+0000","last_unstale":"2024-09-12T01:09:26.086446+0000","last_undegraded":"2024-09-12T01:09:26.086446+0000","last_fullsized":"2024-09-12T01:09:26.086446+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:42.652998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8724393,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":344,"num_read_kb":13267,"num_write":870,"num_write_kb":33802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:32.467396+0000","last_change":"2024-09-12T00:30:01.575846+0000","last_active":"2024-09-12T01:07:32.467396+0000","last_peered":"2024-09-12T01:07:32.467396+0000","last_clean":"2024-09-12T01:07:32.467396+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T01:07:32.467396+0000","last_undegraded":"2024-09-12T01:07:32.467396+0000","last_fullsized":"2024-09-12T01:07:32.467396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:02.507794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510721+0000","last_change":"2024-09-12T00:30:15.127858+0000","last_active":"2024-09-12T01:07:47.510721+0000","last_peered":"2024-09-12T01:07:47.510721+0000","last_clean":"2024-09-12T01:07:47.510721+0000","last_became_active":"2024-09-12T00:30:15.127513+0000","last_became_peered":"2024-09-12T00:30:15.127513+0000","last_unstale":"2024-09-12T01:07:47.510721+0000","last_undegraded":"2024-09-12T01:07:47.510721+0000","last_fullsized":"2024-09-12T01:07:47.510721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:13.431995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'557","reported_seq":1215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.530330+0000","last_change":"2024-09-12T00:30:17.146701+0000","last_active":"2024-09-12T01:11:22.530330+0000","last_peered":"2024-09-12T01:11:22.530330+0000","last_clean":"2024-09-12T01:11:22.530330+0000","last_became_active":"2024-09-12T00:30:17.146141+0000","last_became_peered":"2024-09-12T00:30:17.146141+0000","last_unstale":"2024-09-12T01:11:22.530330+0000","last_undegraded":"2024-09-12T01:11:22.530330+0000","last_fullsized":"2024-09-12T01:11:22.530330+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:34.957314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1533,"num_read_kb":2449,"num_write":2006,"num_write_kb":1846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.490280+0000","last_change":"2024-09-12T00:30:19.168100+0000","last_active":"2024-09-12T01:07:51.490280+0000","last_peered":"2024-09-12T01:07:51.490280+0000","last_clean":"2024-09-12T01:07:51.490280+0000","last_became_active":"2024-09-12T00:30:19.167819+0000","last_became_peered":"2024-09-12T00:30:19.167819+0000","last_unstale":"2024-09-12T01:07:51.490280+0000","last_undegraded":"2024-09-12T01:07:51.490280+0000","last_fullsized":"2024-09-12T01:07:51.490280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:06.580191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'175","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.532966+0000","last_change":"2024-09-12T00:30:21.193170+0000","last_active":"2024-09-12T01:09:21.532966+0000","last_peered":"2024-09-12T01:09:21.532966+0000","last_clean":"2024-09-12T01:09:21.532966+0000","last_became_active":"2024-09-12T00:30:21.192893+0000","last_became_peered":"2024-09-12T00:30:21.192893+0000","last_unstale":"2024-09-12T01:09:21.532966+0000","last_undegraded":"2024-09-12T01:09:21.532966+0000","last_fullsized":"2024-09-12T01:09:21.532966+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.137808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":195,"num_read_kb":181,"num_write":424,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'295","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.821157+0000","last_change":"2024-09-12T00:30:13.125785+0000","last_active":"2024-09-12T01:07:43.821157+0000","last_peered":"2024-09-12T01:07:43.821157+0000","last_clean":"2024-09-12T01:07:43.821157+0000","last_became_active":"2024-09-12T00:30:13.125487+0000","last_became_peered":"2024-09-12T00:30:13.125487+0000","last_unstale":"2024-09-12T01:07:43.821157+0000","last_undegraded":"2024-09-12T01:07:43.821157+0000","last_fullsized":"2024-09-12T01:07:43.821157+0000","mapping_epoch":28,"log_start":"261'200","ondisk_log_start":"261'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:38.141488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1016,"num_write":432,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'241","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.516205+0000","last_change":"2024-09-12T00:30:11.108644+0000","last_active":"2024-09-12T01:08:19.516205+0000","last_peered":"2024-09-12T01:08:19.516205+0000","last_clean":"2024-09-12T01:08:19.516205+0000","last_became_active":"2024-09-12T00:30:11.108257+0000","last_became_peered":"2024-09-12T00:30:11.108257+0000","last_unstale":"2024-09-12T01:08:19.516205+0000","last_undegraded":"2024-09-12T01:08:19.516205+0000","last_fullsized":"2024-09-12T01:08:19.516205+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:15.455005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12965617,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":381,"num_read_kb":29050,"num_write":885,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.595234+0000","last_change":"2024-09-12T00:30:01.530154+0000","last_active":"2024-09-12T01:07:38.595234+0000","last_peered":"2024-09-12T01:07:38.595234+0000","last_clean":"2024-09-12T01:07:38.595234+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T01:07:38.595234+0000","last_undegraded":"2024-09-12T01:07:38.595234+0000","last_fullsized":"2024-09-12T01:07:38.595234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:56.892481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.517391+0000","last_change":"2024-09-12T00:30:15.125077+0000","last_active":"2024-09-12T01:07:48.517391+0000","last_peered":"2024-09-12T01:07:48.517391+0000","last_clean":"2024-09-12T01:07:48.517391+0000","last_became_active":"2024-09-12T00:30:15.124765+0000","last_became_peered":"2024-09-12T00:30:15.124765+0000","last_unstale":"2024-09-12T01:07:48.517391+0000","last_undegraded":"2024-09-12T01:07:48.517391+0000","last_fullsized":"2024-09-12T01:07:48.517391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:26.426998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'162","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.221326+0000","last_change":"2024-09-12T00:30:17.147603+0000","last_active":"2024-09-12T01:10:26.221326+0000","last_peered":"2024-09-12T01:10:26.221326+0000","last_clean":"2024-09-12T01:10:26.221326+0000","last_became_active":"2024-09-12T00:30:17.147297+0000","last_became_peered":"2024-09-12T00:30:17.147297+0000","last_unstale":"2024-09-12T01:10:26.221326+0000","last_undegraded":"2024-09-12T01:10:26.221326+0000","last_fullsized":"2024-09-12T01:10:26.221326+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:26.332646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":197,"num_write":138,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'781","reported_seq":4275,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.503994+0000","last_change":"2024-09-12T00:30:19.169985+0000","last_active":"2024-09-12T01:11:22.503994+0000","last_peered":"2024-09-12T01:11:22.503994+0000","last_clean":"2024-09-12T01:11:22.503994+0000","last_became_active":"2024-09-12T00:30:19.169689+0000","last_became_peered":"2024-09-12T00:30:19.169689+0000","last_unstale":"2024-09-12T01:11:22.503994+0000","last_undegraded":"2024-09-12T01:11:22.503994+0000","last_fullsized":"2024-09-12T01:11:22.503994+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:18.977023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'135","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.493856+0000","last_change":"2024-09-12T00:30:21.189863+0000","last_active":"2024-09-12T01:10:51.493856+0000","last_peered":"2024-09-12T01:10:51.493856+0000","last_clean":"2024-09-12T01:10:51.493856+0000","last_became_active":"2024-09-12T00:30:21.189546+0000","last_became_peered":"2024-09-12T00:30:21.189546+0000","last_unstale":"2024-09-12T01:10:51.493856+0000","last_undegraded":"2024-09-12T01:10:51.493856+0000","last_fullsized":"2024-09-12T01:10:51.493856+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.427001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":147,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'196","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.514948+0000","last_change":"2024-09-12T00:30:13.118911+0000","last_active":"2024-09-12T01:08:17.514948+0000","last_peered":"2024-09-12T01:08:17.514948+0000","last_clean":"2024-09-12T01:08:17.514948+0000","last_became_active":"2024-09-12T00:30:13.118656+0000","last_became_peered":"2024-09-12T00:30:13.118656+0000","last_unstale":"2024-09-12T01:08:17.514948+0000","last_undegraded":"2024-09-12T01:08:17.514948+0000","last_fullsized":"2024-09-12T01:08:17.514948+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:57.996691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":942,"num_read_kb":795,"num_write":340,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'312","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.522829+0000","last_change":"2024-09-12T00:30:11.090609+0000","last_active":"2024-09-12T01:09:12.522829+0000","last_peered":"2024-09-12T01:09:12.522829+0000","last_clean":"2024-09-12T01:09:12.522829+0000","last_became_active":"2024-09-12T00:30:11.090114+0000","last_became_peered":"2024-09-12T00:30:11.090114+0000","last_unstale":"2024-09-12T01:09:12.522829+0000","last_undegraded":"2024-09-12T01:09:12.522829+0000","last_fullsized":"2024-09-12T01:09:12.522829+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:10.941716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19194423,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":547,"num_read_kb":27250,"num_write":1213,"num_write_kb":43330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.521544+0000","last_change":"2024-09-12T00:30:01.610276+0000","last_active":"2024-09-12T01:09:02.521544+0000","last_peered":"2024-09-12T01:09:02.521544+0000","last_clean":"2024-09-12T01:09:02.521544+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T01:09:02.521544+0000","last_undegraded":"2024-09-12T01:09:02.521544+0000","last_fullsized":"2024-09-12T01:09:02.521544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:31.655155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596333+0000","last_change":"2024-09-12T00:30:15.127408+0000","last_active":"2024-09-12T01:07:48.596333+0000","last_peered":"2024-09-12T01:07:48.596333+0000","last_clean":"2024-09-12T01:07:48.596333+0000","last_became_active":"2024-09-12T00:30:15.126949+0000","last_became_peered":"2024-09-12T00:30:15.126949+0000","last_unstale":"2024-09-12T01:07:48.596333+0000","last_undegraded":"2024-09-12T01:07:48.596333+0000","last_fullsized":"2024-09-12T01:07:48.596333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:24.696309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.206045+0000","last_change":"2024-09-12T00:30:17.150111+0000","last_active":"2024-09-12T01:10:26.206045+0000","last_peered":"2024-09-12T01:10:26.206045+0000","last_clean":"2024-09-12T01:10:26.206045+0000","last_became_active":"2024-09-12T00:30:17.149791+0000","last_became_peered":"2024-09-12T00:30:17.149791+0000","last_unstale":"2024-09-12T01:10:26.206045+0000","last_undegraded":"2024-09-12T01:10:26.206045+0000","last_fullsized":"2024-09-12T01:10:26.206045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.663317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'797","reported_seq":4535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.506132+0000","last_change":"2024-09-12T00:30:19.167079+0000","last_active":"2024-09-12T01:10:51.506132+0000","last_peered":"2024-09-12T01:10:51.506132+0000","last_clean":"2024-09-12T01:10:51.506132+0000","last_became_active":"2024-09-12T00:30:19.166687+0000","last_became_peered":"2024-09-12T00:30:19.166687+0000","last_unstale":"2024-09-12T01:10:51.506132+0000","last_undegraded":"2024-09-12T01:10:51.506132+0000","last_fullsized":"2024-09-12T01:10:51.506132+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:58.724984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.877133+0000","last_change":"2024-09-12T00:30:21.192502+0000","last_active":"2024-09-12T01:09:46.877133+0000","last_peered":"2024-09-12T01:09:46.877133+0000","last_clean":"2024-09-12T01:09:46.877133+0000","last_became_active":"2024-09-12T00:30:21.192189+0000","last_became_peered":"2024-09-12T00:30:21.192189+0000","last_unstale":"2024-09-12T01:09:46.877133+0000","last_undegraded":"2024-09-12T01:09:46.877133+0000","last_fullsized":"2024-09-12T01:09:46.877133+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:51.071766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":326,"num_read_kb":325,"num_write":560,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'395","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489484+0000","last_change":"2024-09-12T00:30:13.121172+0000","last_active":"2024-09-12T01:07:46.489484+0000","last_peered":"2024-09-12T01:07:46.489484+0000","last_clean":"2024-09-12T01:07:46.489484+0000","last_became_active":"2024-09-12T00:30:13.120906+0000","last_became_peered":"2024-09-12T00:30:13.120906+0000","last_unstale":"2024-09-12T01:07:46.489484+0000","last_undegraded":"2024-09-12T01:07:46.489484+0000","last_fullsized":"2024-09-12T01:07:46.489484+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:54.969193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1876,"num_read_kb":1541,"num_write":715,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'272","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.720910+0000","last_change":"2024-09-12T00:30:11.102338+0000","last_active":"2024-09-12T01:09:31.720910+0000","last_peered":"2024-09-12T01:09:31.720910+0000","last_clean":"2024-09-12T01:09:31.720910+0000","last_became_active":"2024-09-12T00:30:11.101931+0000","last_became_peered":"2024-09-12T00:30:11.101931+0000","last_unstale":"2024-09-12T01:09:31.720910+0000","last_undegraded":"2024-09-12T01:09:31.720910+0000","last_fullsized":"2024-09-12T01:09:31.720910+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:00.380675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10543400,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":444,"num_read_kb":50202,"num_write":1005,"num_write_kb":37284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.606593+0000","last_change":"2024-09-12T00:30:01.530986+0000","last_active":"2024-09-12T01:09:03.606593+0000","last_peered":"2024-09-12T01:09:03.606593+0000","last_clean":"2024-09-12T01:09:03.606593+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T01:09:03.606593+0000","last_undegraded":"2024-09-12T01:09:03.606593+0000","last_fullsized":"2024-09-12T01:09:03.606593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:52.048191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.515540+0000","last_change":"2024-09-12T00:30:15.126298+0000","last_active":"2024-09-12T01:08:22.515540+0000","last_peered":"2024-09-12T01:08:22.515540+0000","last_clean":"2024-09-12T01:08:22.515540+0000","last_became_active":"2024-09-12T00:30:15.126041+0000","last_became_peered":"2024-09-12T00:30:15.126041+0000","last_unstale":"2024-09-12T01:08:22.515540+0000","last_undegraded":"2024-09-12T01:08:22.515540+0000","last_fullsized":"2024-09-12T01:08:22.515540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:47.264234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'761","reported_seq":1478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.300374+0000","last_change":"2024-09-12T00:30:17.149254+0000","last_active":"2024-09-12T01:11:23.300374+0000","last_peered":"2024-09-12T01:11:23.300374+0000","last_clean":"2024-09-12T01:11:23.300374+0000","last_became_active":"2024-09-12T00:30:17.148954+0000","last_became_peered":"2024-09-12T00:30:17.148954+0000","last_unstale":"2024-09-12T01:11:23.300374+0000","last_undegraded":"2024-09-12T01:11:23.300374+0000","last_fullsized":"2024-09-12T01:11:23.300374+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:23.398387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155985,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1373,"num_read_kb":3176,"num_write":1136,"num_write_kb":954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511612+0000","last_change":"2024-09-12T00:30:19.169337+0000","last_active":"2024-09-12T01:07:52.511612+0000","last_peered":"2024-09-12T01:07:52.511612+0000","last_clean":"2024-09-12T01:07:52.511612+0000","last_became_active":"2024-09-12T00:30:19.168965+0000","last_became_peered":"2024-09-12T00:30:19.168965+0000","last_unstale":"2024-09-12T01:07:52.511612+0000","last_undegraded":"2024-09-12T01:07:52.511612+0000","last_fullsized":"2024-09-12T01:07:52.511612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:32.282990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'132","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.271173+0000","last_change":"2024-09-12T00:30:21.186564+0000","last_active":"2024-09-12T01:09:46.271173+0000","last_peered":"2024-09-12T01:09:46.271173+0000","last_clean":"2024-09-12T01:09:46.271173+0000","last_became_active":"2024-09-12T00:30:21.186262+0000","last_became_peered":"2024-09-12T00:30:21.186262+0000","last_unstale":"2024-09-12T01:09:46.271173+0000","last_undegraded":"2024-09-12T01:09:46.271173+0000","last_fullsized":"2024-09-12T01:09:46.271173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:19.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":332,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'144","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.925813+0000","last_change":"2024-09-12T00:30:21.193317+0000","last_active":"2024-09-12T01:09:46.925813+0000","last_peered":"2024-09-12T01:09:46.925813+0000","last_clean":"2024-09-12T01:09:46.925813+0000","last_became_active":"2024-09-12T00:30:21.193010+0000","last_became_peered":"2024-09-12T00:30:21.193010+0000","last_unstale":"2024-09-12T01:09:46.925813+0000","last_undegraded":"2024-09-12T01:09:46.925813+0000","last_fullsized":"2024-09-12T01:09:46.925813+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:25.295748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'64","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.214217+0000","last_change":"2024-09-12T00:30:13.122292+0000","last_active":"2024-09-12T01:09:31.214217+0000","last_peered":"2024-09-12T01:09:31.214217+0000","last_clean":"2024-09-12T01:09:31.214217+0000","last_became_active":"2024-09-12T00:30:13.121613+0000","last_became_peered":"2024-09-12T00:30:13.121613+0000","last_unstale":"2024-09-12T01:09:31.214217+0000","last_undegraded":"2024-09-12T01:09:31.214217+0000","last_fullsized":"2024-09-12T01:09:31.214217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:01.317063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":107,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'334","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.566770+0000","last_change":"2024-09-12T00:30:11.110609+0000","last_active":"2024-09-12T01:11:23.566770+0000","last_peered":"2024-09-12T01:11:23.566770+0000","last_clean":"2024-09-12T01:11:23.566770+0000","last_became_active":"2024-09-12T00:30:11.109653+0000","last_became_peered":"2024-09-12T00:30:11.109653+0000","last_unstale":"2024-09-12T01:11:23.566770+0000","last_undegraded":"2024-09-12T01:11:23.566770+0000","last_fullsized":"2024-09-12T01:11:23.566770+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:12.419689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2133189,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":660,"num_read_kb":3250,"num_write":1191,"num_write_kb":30224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.379544+0000","last_change":"2024-09-12T00:30:15.133054+0000","last_active":"2024-09-12T01:07:37.379544+0000","last_peered":"2024-09-12T01:07:37.379544+0000","last_clean":"2024-09-12T01:07:37.379544+0000","last_became_active":"2024-09-12T00:30:15.132784+0000","last_became_peered":"2024-09-12T00:30:15.132784+0000","last_unstale":"2024-09-12T01:07:37.379544+0000","last_undegraded":"2024-09-12T01:07:37.379544+0000","last_fullsized":"2024-09-12T01:07:37.379544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:01.793710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'255","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.224691+0000","last_change":"2024-09-12T00:30:17.146875+0000","last_active":"2024-09-12T01:10:26.224691+0000","last_peered":"2024-09-12T01:10:26.224691+0000","last_clean":"2024-09-12T01:10:26.224691+0000","last_became_active":"2024-09-12T00:30:17.146483+0000","last_became_peered":"2024-09-12T00:30:17.146483+0000","last_unstale":"2024-09-12T01:10:26.224691+0000","last_undegraded":"2024-09-12T01:10:26.224691+0000","last_fullsized":"2024-09-12T01:10:26.224691+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:14.781544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52591,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":415,"num_read_kb":851,"num_write":332,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380029+0000","last_change":"2024-09-12T00:30:19.169288+0000","last_active":"2024-09-12T01:07:43.380029+0000","last_peered":"2024-09-12T01:07:43.380029+0000","last_clean":"2024-09-12T01:07:43.380029+0000","last_became_active":"2024-09-12T00:30:19.168980+0000","last_became_peered":"2024-09-12T00:30:19.168980+0000","last_unstale":"2024-09-12T01:07:43.380029+0000","last_undegraded":"2024-09-12T01:07:43.380029+0000","last_fullsized":"2024-09-12T01:07:43.380029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:55.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'108","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.943994+0000","last_change":"2024-09-12T00:30:21.188045+0000","last_active":"2024-09-12T01:08:50.943994+0000","last_peered":"2024-09-12T01:08:50.943994+0000","last_clean":"2024-09-12T01:08:50.943994+0000","last_became_active":"2024-09-12T00:30:21.187742+0000","last_became_peered":"2024-09-12T00:30:21.187742+0000","last_unstale":"2024-09-12T01:08:50.943994+0000","last_undegraded":"2024-09-12T01:08:50.943994+0000","last_fullsized":"2024-09-12T01:08:50.943994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'264","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.741230+0000","last_change":"2024-09-12T00:30:13.131517+0000","last_active":"2024-09-12T01:08:03.741230+0000","last_peered":"2024-09-12T01:08:03.741230+0000","last_clean":"2024-09-12T01:08:03.741230+0000","last_became_active":"2024-09-12T00:30:13.131204+0000","last_became_peered":"2024-09-12T00:30:13.131204+0000","last_unstale":"2024-09-12T01:08:03.741230+0000","last_undegraded":"2024-09-12T01:08:03.741230+0000","last_fullsized":"2024-09-12T01:08:03.741230+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:06.638417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":908,"num_write":395,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.445894+0000","last_change":"2024-09-12T00:30:11.104784+0000","last_active":"2024-09-12T01:11:23.445894+0000","last_peered":"2024-09-12T01:11:23.445894+0000","last_clean":"2024-09-12T01:11:23.445894+0000","last_became_active":"2024-09-12T00:30:11.104403+0000","last_became_peered":"2024-09-12T00:30:11.104403+0000","last_unstale":"2024-09-12T01:11:23.445894+0000","last_undegraded":"2024-09-12T01:11:23.445894+0000","last_fullsized":"2024-09-12T01:11:23.445894+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.674612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5276601,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":555,"num_read_kb":58051,"num_write":1182,"num_write_kb":38205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.509453+0000","last_change":"2024-09-12T00:30:15.128673+0000","last_active":"2024-09-12T01:07:37.509453+0000","last_peered":"2024-09-12T01:07:37.509453+0000","last_clean":"2024-09-12T01:07:37.509453+0000","last_became_active":"2024-09-12T00:30:15.128366+0000","last_became_peered":"2024-09-12T00:30:15.128366+0000","last_unstale":"2024-09-12T01:07:37.509453+0000","last_undegraded":"2024-09-12T01:07:37.509453+0000","last_fullsized":"2024-09-12T01:07:37.509453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:18.808966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'45","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.025516+0000","last_change":"2024-09-12T00:30:17.139289+0000","last_active":"2024-09-12T01:10:26.025516+0000","last_peered":"2024-09-12T01:10:26.025516+0000","last_clean":"2024-09-12T01:10:26.025516+0000","last_became_active":"2024-09-12T00:30:17.138399+0000","last_became_peered":"2024-09-12T00:30:17.138399+0000","last_unstale":"2024-09-12T01:10:26.025516+0000","last_undegraded":"2024-09-12T01:10:26.025516+0000","last_fullsized":"2024-09-12T01:10:26.025516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:34.631922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":31,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.488873+0000","last_change":"2024-09-12T00:30:19.167516+0000","last_active":"2024-09-12T01:07:41.488873+0000","last_peered":"2024-09-12T01:07:41.488873+0000","last_clean":"2024-09-12T01:07:41.488873+0000","last_became_active":"2024-09-12T00:30:19.167213+0000","last_became_peered":"2024-09-12T00:30:19.167213+0000","last_unstale":"2024-09-12T01:07:41.488873+0000","last_undegraded":"2024-09-12T01:07:41.488873+0000","last_fullsized":"2024-09-12T01:07:41.488873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:20.695360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'202","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.271103+0000","last_change":"2024-09-12T00:30:21.185959+0000","last_active":"2024-09-12T01:10:50.271103+0000","last_peered":"2024-09-12T01:10:50.271103+0000","last_clean":"2024-09-12T01:10:50.271103+0000","last_became_active":"2024-09-12T00:30:21.185636+0000","last_became_peered":"2024-09-12T00:30:21.185636+0000","last_unstale":"2024-09-12T01:10:50.271103+0000","last_undegraded":"2024-09-12T01:10:50.271103+0000","last_fullsized":"2024-09-12T01:10:50.271103+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:18.839590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":299,"num_write":483,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'101","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.233430+0000","last_change":"2024-09-12T00:30:13.124435+0000","last_active":"2024-09-12T01:08:23.233430+0000","last_peered":"2024-09-12T01:08:23.233430+0000","last_clean":"2024-09-12T01:08:23.233430+0000","last_became_active":"2024-09-12T00:30:13.124163+0000","last_became_peered":"2024-09-12T00:30:13.124163+0000","last_unstale":"2024-09-12T01:08:23.233430+0000","last_undegraded":"2024-09-12T01:08:23.233430+0000","last_fullsized":"2024-09-12T01:08:23.233430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:34.854665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":380,"num_write":155,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'283","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.749795+0000","last_change":"2024-09-12T00:30:11.111101+0000","last_active":"2024-09-12T01:09:43.749795+0000","last_peered":"2024-09-12T01:09:43.749795+0000","last_clean":"2024-09-12T01:09:43.749795+0000","last_became_active":"2024-09-12T00:30:11.110736+0000","last_became_peered":"2024-09-12T00:30:11.110736+0000","last_unstale":"2024-09-12T01:09:43.749795+0000","last_undegraded":"2024-09-12T01:09:43.749795+0000","last_fullsized":"2024-09-12T01:09:43.749795+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:36.799456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14685817,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":756,"num_read_kb":34556,"num_write":1099,"num_write_kb":41998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.488227+0000","last_change":"2024-09-12T00:30:15.121446+0000","last_active":"2024-09-12T01:07:36.488227+0000","last_peered":"2024-09-12T01:07:36.488227+0000","last_clean":"2024-09-12T01:07:36.488227+0000","last_became_active":"2024-09-12T00:30:15.121068+0000","last_became_peered":"2024-09-12T00:30:15.121068+0000","last_unstale":"2024-09-12T01:07:36.488227+0000","last_undegraded":"2024-09-12T01:07:36.488227+0000","last_fullsized":"2024-09-12T01:07:36.488227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:39.771010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'314","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.380796+0000","last_change":"2024-09-12T00:30:17.148244+0000","last_active":"2024-09-12T01:11:23.380796+0000","last_peered":"2024-09-12T01:11:23.380796+0000","last_clean":"2024-09-12T01:11:23.380796+0000","last_became_active":"2024-09-12T00:30:17.147946+0000","last_became_peered":"2024-09-12T00:30:17.147946+0000","last_unstale":"2024-09-12T01:11:23.380796+0000","last_undegraded":"2024-09-12T01:11:23.380796+0000","last_fullsized":"2024-09-12T01:11:23.380796+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:12.212273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":1151,"num_write":414,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.399089+0000","last_change":"2024-09-12T00:30:19.167688+0000","last_active":"2024-09-12T01:07:38.399089+0000","last_peered":"2024-09-12T01:07:38.399089+0000","last_clean":"2024-09-12T01:07:38.399089+0000","last_became_active":"2024-09-12T00:30:19.167407+0000","last_became_peered":"2024-09-12T00:30:19.167407+0000","last_unstale":"2024-09-12T01:07:38.399089+0000","last_undegraded":"2024-09-12T01:07:38.399089+0000","last_fullsized":"2024-09-12T01:07:38.399089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:37.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.270721+0000","last_change":"2024-09-12T00:30:21.189080+0000","last_active":"2024-09-12T01:09:23.270721+0000","last_peered":"2024-09-12T01:09:23.270721+0000","last_clean":"2024-09-12T01:09:23.270721+0000","last_became_active":"2024-09-12T00:30:21.188801+0000","last_became_peered":"2024-09-12T00:30:21.188801+0000","last_unstale":"2024-09-12T01:09:23.270721+0000","last_undegraded":"2024-09-12T01:09:23.270721+0000","last_fullsized":"2024-09-12T01:09:23.270721+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:52.941694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":174,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'271","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.925751+0000","last_change":"2024-09-12T00:30:13.122096+0000","last_active":"2024-09-12T01:07:50.925751+0000","last_peered":"2024-09-12T01:07:50.925751+0000","last_clean":"2024-09-12T01:07:50.925751+0000","last_became_active":"2024-09-12T00:30:13.121687+0000","last_became_peered":"2024-09-12T00:30:13.121687+0000","last_unstale":"2024-09-12T01:07:50.925751+0000","last_undegraded":"2024-09-12T01:07:50.925751+0000","last_fullsized":"2024-09-12T01:07:50.925751+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:11.931962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1180,"num_read_kb":936,"num_write":465,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'272","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.150176+0000","last_change":"2024-09-12T00:30:11.098286+0000","last_active":"2024-09-12T01:08:57.150176+0000","last_peered":"2024-09-12T01:08:57.150176+0000","last_clean":"2024-09-12T01:08:57.150176+0000","last_became_active":"2024-09-12T00:30:11.097863+0000","last_became_peered":"2024-09-12T00:30:11.097863+0000","last_unstale":"2024-09-12T01:08:57.150176+0000","last_undegraded":"2024-09-12T01:08:57.150176+0000","last_fullsized":"2024-09-12T01:08:57.150176+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:12.507001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9451713,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":456,"num_read_kb":74370,"num_write":1043,"num_write_kb":34671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.595145+0000","last_change":"2024-09-12T00:30:15.125794+0000","last_active":"2024-09-12T01:07:38.595145+0000","last_peered":"2024-09-12T01:07:38.595145+0000","last_clean":"2024-09-12T01:07:38.595145+0000","last_became_active":"2024-09-12T00:30:15.125505+0000","last_became_peered":"2024-09-12T00:30:15.125505+0000","last_unstale":"2024-09-12T01:07:38.595145+0000","last_undegraded":"2024-09-12T01:07:38.595145+0000","last_fullsized":"2024-09-12T01:07:38.595145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:58.671332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'278","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.131148+0000","last_change":"2024-09-12T00:30:17.146728+0000","last_active":"2024-09-12T01:11:23.131148+0000","last_peered":"2024-09-12T01:11:23.131148+0000","last_clean":"2024-09-12T01:11:23.131148+0000","last_became_active":"2024-09-12T00:30:17.146112+0000","last_became_peered":"2024-09-12T00:30:17.146112+0000","last_unstale":"2024-09-12T01:11:23.131148+0000","last_undegraded":"2024-09-12T01:11:23.131148+0000","last_fullsized":"2024-09-12T01:11:23.131148+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:53.604417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56907,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":1155,"num_write":390,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380111+0000","last_change":"2024-09-12T00:30:19.165113+0000","last_active":"2024-09-12T01:07:43.380111+0000","last_peered":"2024-09-12T01:07:43.380111+0000","last_clean":"2024-09-12T01:07:43.380111+0000","last_became_active":"2024-09-12T00:30:19.164820+0000","last_became_peered":"2024-09-12T00:30:19.164820+0000","last_unstale":"2024-09-12T01:07:43.380111+0000","last_undegraded":"2024-09-12T01:07:43.380111+0000","last_fullsized":"2024-09-12T01:07:43.380111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:05.633814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'177","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.659876+0000","last_change":"2024-09-12T00:30:13.124841+0000","last_active":"2024-09-12T01:08:12.659876+0000","last_peered":"2024-09-12T01:08:12.659876+0000","last_clean":"2024-09-12T01:08:12.659876+0000","last_became_active":"2024-09-12T00:30:13.124584+0000","last_became_peered":"2024-09-12T00:30:13.124584+0000","last_unstale":"2024-09-12T01:08:12.659876+0000","last_undegraded":"2024-09-12T01:08:12.659876+0000","last_fullsized":"2024-09-12T01:08:12.659876+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.463711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":813,"num_read_kb":670,"num_write":272,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'289","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:24.698763+0000","last_change":"2024-09-12T00:30:11.098303+0000","last_active":"2024-09-12T01:09:24.698763+0000","last_peered":"2024-09-12T01:09:24.698763+0000","last_clean":"2024-09-12T01:09:24.698763+0000","last_became_active":"2024-09-12T00:30:11.097890+0000","last_became_peered":"2024-09-12T00:30:11.097890+0000","last_unstale":"2024-09-12T01:09:24.698763+0000","last_undegraded":"2024-09-12T01:09:24.698763+0000","last_fullsized":"2024-09-12T01:09:24.698763+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:22.964167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8875917,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":488,"num_read_kb":38571,"num_write":1081,"num_write_kb":31383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'5","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.210840+0000","last_change":"2024-09-12T00:30:15.122461+0000","last_active":"2024-09-12T01:10:51.210840+0000","last_peered":"2024-09-12T01:10:51.210840+0000","last_clean":"2024-09-12T01:10:51.210840+0000","last_became_active":"2024-09-12T00:30:15.122172+0000","last_became_peered":"2024-09-12T00:30:15.122172+0000","last_unstale":"2024-09-12T01:10:51.210840+0000","last_undegraded":"2024-09-12T01:10:51.210840+0000","last_fullsized":"2024-09-12T01:10:51.210840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:40.318954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'502","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.460544+0000","last_change":"2024-09-12T00:30:17.146325+0000","last_active":"2024-09-12T01:10:51.460544+0000","last_peered":"2024-09-12T01:10:51.460544+0000","last_clean":"2024-09-12T01:10:51.460544+0000","last_became_active":"2024-09-12T00:30:17.145882+0000","last_became_peered":"2024-09-12T00:30:17.145882+0000","last_unstale":"2024-09-12T01:10:51.460544+0000","last_undegraded":"2024-09-12T01:10:51.460544+0000","last_fullsized":"2024-09-12T01:10:51.460544+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:43.412234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124876,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":923,"num_read_kb":2013,"num_write":816,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.490351+0000","last_change":"2024-09-12T00:30:19.171021+0000","last_active":"2024-09-12T01:07:51.490351+0000","last_peered":"2024-09-12T01:07:51.490351+0000","last_clean":"2024-09-12T01:07:51.490351+0000","last_became_active":"2024-09-12T00:30:19.170776+0000","last_became_peered":"2024-09-12T00:30:19.170776+0000","last_unstale":"2024-09-12T01:07:51.490351+0000","last_undegraded":"2024-09-12T01:07:51.490351+0000","last_fullsized":"2024-09-12T01:07:51.490351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:45.791234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'142","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.220138+0000","last_change":"2024-09-12T00:30:21.188712+0000","last_active":"2024-09-12T01:09:12.220138+0000","last_peered":"2024-09-12T01:09:12.220138+0000","last_clean":"2024-09-12T01:09:12.220138+0000","last_became_active":"2024-09-12T00:30:21.188376+0000","last_became_peered":"2024-09-12T00:30:21.188376+0000","last_unstale":"2024-09-12T01:09:12.220138+0000","last_undegraded":"2024-09-12T01:09:12.220138+0000","last_fullsized":"2024-09-12T01:09:12.220138+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:33.881129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":168,"num_write":312,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'188","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.553795+0000","last_change":"2024-09-12T00:30:13.119832+0000","last_active":"2024-09-12T01:08:48.553795+0000","last_peered":"2024-09-12T01:08:48.553795+0000","last_clean":"2024-09-12T01:08:48.553795+0000","last_became_active":"2024-09-12T00:30:13.118251+0000","last_became_peered":"2024-09-12T00:30:13.118251+0000","last_unstale":"2024-09-12T01:08:48.553795+0000","last_undegraded":"2024-09-12T01:08:48.553795+0000","last_fullsized":"2024-09-12T01:08:48.553795+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:08.129477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":709,"num_write":308,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'301","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:49.565897+0000","last_change":"2024-09-12T00:30:11.103265+0000","last_active":"2024-09-12T01:10:49.565897+0000","last_peered":"2024-09-12T01:10:49.565897+0000","last_clean":"2024-09-12T01:10:49.565897+0000","last_became_active":"2024-09-12T00:30:11.102929+0000","last_became_peered":"2024-09-12T00:30:11.102929+0000","last_unstale":"2024-09-12T01:10:49.565897+0000","last_undegraded":"2024-09-12T01:10:49.565897+0000","last_fullsized":"2024-09-12T01:10:49.565897+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:09.657923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4555234,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":415,"num_read_kb":62693,"num_write":1017,"num_write_kb":37872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489602+0000","last_change":"2024-09-12T00:30:15.127559+0000","last_active":"2024-09-12T01:07:46.489602+0000","last_peered":"2024-09-12T01:07:46.489602+0000","last_clean":"2024-09-12T01:07:46.489602+0000","last_became_active":"2024-09-12T00:30:15.127268+0000","last_became_peered":"2024-09-12T00:30:15.127268+0000","last_unstale":"2024-09-12T01:07:46.489602+0000","last_undegraded":"2024-09-12T01:07:46.489602+0000","last_fullsized":"2024-09-12T01:07:46.489602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:40.481520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'306","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.215461+0000","last_change":"2024-09-12T00:30:17.145767+0000","last_active":"2024-09-12T01:11:23.215461+0000","last_peered":"2024-09-12T01:11:23.215461+0000","last_clean":"2024-09-12T01:11:23.215461+0000","last_became_active":"2024-09-12T00:30:17.145504+0000","last_became_peered":"2024-09-12T00:30:17.145504+0000","last_unstale":"2024-09-12T01:11:23.215461+0000","last_undegraded":"2024-09-12T01:11:23.215461+0000","last_fullsized":"2024-09-12T01:11:23.215461+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.680720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1192,"num_write":444,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.470054+0000","last_change":"2024-09-12T00:30:19.169885+0000","last_active":"2024-09-12T01:07:52.470054+0000","last_peered":"2024-09-12T01:07:52.470054+0000","last_clean":"2024-09-12T01:07:52.470054+0000","last_became_active":"2024-09-12T00:30:19.169558+0000","last_became_peered":"2024-09-12T00:30:19.169558+0000","last_unstale":"2024-09-12T01:07:52.470054+0000","last_undegraded":"2024-09-12T01:07:52.470054+0000","last_fullsized":"2024-09-12T01:07:52.470054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:54.438982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'175","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.845489+0000","last_change":"2024-09-12T00:30:21.188671+0000","last_active":"2024-09-12T01:09:16.845489+0000","last_peered":"2024-09-12T01:09:16.845489+0000","last_clean":"2024-09-12T01:09:16.845489+0000","last_became_active":"2024-09-12T00:30:21.188350+0000","last_became_peered":"2024-09-12T00:30:21.188350+0000","last_unstale":"2024-09-12T01:09:16.845489+0000","last_undegraded":"2024-09-12T01:09:16.845489+0000","last_fullsized":"2024-09-12T01:09:16.845489+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.291083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2246,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":214,"num_write":509,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'191","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.825959+0000","last_change":"2024-09-12T00:30:13.127956+0000","last_active":"2024-09-12T01:09:09.825959+0000","last_peered":"2024-09-12T01:09:09.825959+0000","last_clean":"2024-09-12T01:09:09.825959+0000","last_became_active":"2024-09-12T00:30:13.127294+0000","last_became_peered":"2024-09-12T00:30:13.127294+0000","last_unstale":"2024-09-12T01:09:09.825959+0000","last_undegraded":"2024-09-12T01:09:09.825959+0000","last_fullsized":"2024-09-12T01:09:09.825959+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:36.940318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":881,"num_read_kb":750,"num_write":313,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'305","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.411781+0000","last_change":"2024-09-12T00:30:11.091385+0000","last_active":"2024-09-12T01:11:23.411781+0000","last_peered":"2024-09-12T01:11:23.411781+0000","last_clean":"2024-09-12T01:11:23.411781+0000","last_became_active":"2024-09-12T00:30:11.091027+0000","last_became_peered":"2024-09-12T00:30:11.091027+0000","last_unstale":"2024-09-12T01:11:23.411781+0000","last_undegraded":"2024-09-12T01:11:23.411781+0000","last_fullsized":"2024-09-12T01:11:23.411781+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:30.586849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6384977,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":466,"num_read_kb":8604,"num_write":1126,"num_write_kb":27793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489557+0000","last_change":"2024-09-12T00:30:15.126670+0000","last_active":"2024-09-12T01:07:46.489557+0000","last_peered":"2024-09-12T01:07:46.489557+0000","last_clean":"2024-09-12T01:07:46.489557+0000","last_became_active":"2024-09-12T00:30:15.126254+0000","last_became_peered":"2024-09-12T00:30:15.126254+0000","last_unstale":"2024-09-12T01:07:46.489557+0000","last_undegraded":"2024-09-12T01:07:46.489557+0000","last_fullsized":"2024-09-12T01:07:46.489557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:45.385397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'279","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.226884+0000","last_change":"2024-09-12T00:30:17.146500+0000","last_active":"2024-09-12T01:10:26.226884+0000","last_peered":"2024-09-12T01:10:26.226884+0000","last_clean":"2024-09-12T01:10:26.226884+0000","last_became_active":"2024-09-12T00:30:17.146106+0000","last_became_peered":"2024-09-12T00:30:17.146106+0000","last_unstale":"2024-09-12T01:10:26.226884+0000","last_undegraded":"2024-09-12T01:10:26.226884+0000","last_fullsized":"2024-09-12T01:10:26.226884+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:56.226270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":947,"num_write":382,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.385079+0000","last_change":"2024-09-12T00:30:19.167702+0000","last_active":"2024-09-12T01:08:23.385079+0000","last_peered":"2024-09-12T01:08:23.385079+0000","last_clean":"2024-09-12T01:08:23.385079+0000","last_became_active":"2024-09-12T00:30:19.167119+0000","last_became_peered":"2024-09-12T00:30:19.167119+0000","last_unstale":"2024-09-12T01:08:23.385079+0000","last_undegraded":"2024-09-12T01:08:23.385079+0000","last_fullsized":"2024-09-12T01:08:23.385079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:22.072993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'97","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490235+0000","last_change":"2024-09-12T00:30:21.191304+0000","last_active":"2024-09-12T01:10:51.490235+0000","last_peered":"2024-09-12T01:10:51.490235+0000","last_clean":"2024-09-12T01:10:51.490235+0000","last_became_active":"2024-09-12T00:30:21.190937+0000","last_became_peered":"2024-09-12T00:30:21.190937+0000","last_unstale":"2024-09-12T01:10:51.490235+0000","last_undegraded":"2024-09-12T01:10:51.490235+0000","last_fullsized":"2024-09-12T01:10:51.490235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:04.164418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":102,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'207","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:24.682793+0000","last_change":"2024-09-12T00:30:13.120652+0000","last_active":"2024-09-12T01:09:24.682793+0000","last_peered":"2024-09-12T01:09:24.682793+0000","last_clean":"2024-09-12T01:09:24.682793+0000","last_became_active":"2024-09-12T00:30:13.119843+0000","last_became_peered":"2024-09-12T00:30:13.119843+0000","last_unstale":"2024-09-12T01:09:24.682793+0000","last_undegraded":"2024-09-12T01:09:24.682793+0000","last_fullsized":"2024-09-12T01:09:24.682793+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.594925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":901,"num_read_kb":747,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'304","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.375447+0000","last_change":"2024-09-12T00:30:11.101174+0000","last_active":"2024-09-12T01:09:27.375447+0000","last_peered":"2024-09-12T01:09:27.375447+0000","last_clean":"2024-09-12T01:09:27.375447+0000","last_became_active":"2024-09-12T00:30:11.100750+0000","last_became_peered":"2024-09-12T00:30:11.100750+0000","last_unstale":"2024-09-12T01:09:27.375447+0000","last_undegraded":"2024-09-12T01:09:27.375447+0000","last_fullsized":"2024-09-12T01:09:27.375447+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:57.978779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7989139,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":511,"num_read_kb":31919,"num_write":1235,"num_write_kb":26213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510757+0000","last_change":"2024-09-12T00:30:15.127738+0000","last_active":"2024-09-12T01:07:47.510757+0000","last_peered":"2024-09-12T01:07:47.510757+0000","last_clean":"2024-09-12T01:07:47.510757+0000","last_became_active":"2024-09-12T00:30:15.127444+0000","last_became_peered":"2024-09-12T00:30:15.127444+0000","last_unstale":"2024-09-12T01:07:47.510757+0000","last_undegraded":"2024-09-12T01:07:47.510757+0000","last_fullsized":"2024-09-12T01:07:47.510757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:29.367406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'84","reported_seq":596,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.218785+0000","last_change":"2024-09-12T00:30:17.144599+0000","last_active":"2024-09-12T01:10:26.218785+0000","last_peered":"2024-09-12T01:10:26.218785+0000","last_clean":"2024-09-12T01:10:26.218785+0000","last_became_active":"2024-09-12T00:30:17.144283+0000","last_became_peered":"2024-09-12T00:30:17.144283+0000","last_unstale":"2024-09-12T01:10:26.218785+0000","last_undegraded":"2024-09-12T01:10:26.218785+0000","last_fullsized":"2024-09-12T01:10:26.218785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:42.626907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":66,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'767","reported_seq":2395,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.504014+0000","last_change":"2024-09-12T00:30:19.167155+0000","last_active":"2024-09-12T01:11:22.504014+0000","last_peered":"2024-09-12T01:11:22.504014+0000","last_clean":"2024-09-12T01:11:22.504014+0000","last_became_active":"2024-09-12T00:30:19.166851+0000","last_became_peered":"2024-09-12T00:30:19.166851+0000","last_unstale":"2024-09-12T01:11:22.504014+0000","last_undegraded":"2024-09-12T01:11:22.504014+0000","last_fullsized":"2024-09-12T01:11:22.504014+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:22.407452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'131","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.215109+0000","last_change":"2024-09-12T00:30:21.190459+0000","last_active":"2024-09-12T01:09:31.215109+0000","last_peered":"2024-09-12T01:09:31.215109+0000","last_clean":"2024-09-12T01:09:31.215109+0000","last_became_active":"2024-09-12T00:30:21.190151+0000","last_became_peered":"2024-09-12T00:30:21.190151+0000","last_unstale":"2024-09-12T01:09:31.215109+0000","last_undegraded":"2024-09-12T01:09:31.215109+0000","last_fullsized":"2024-09-12T01:09:31.215109+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:54.921241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'111","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489533+0000","last_change":"2024-09-12T00:30:13.124415+0000","last_active":"2024-09-12T01:07:46.489533+0000","last_peered":"2024-09-12T01:07:46.489533+0000","last_clean":"2024-09-12T01:07:46.489533+0000","last_became_active":"2024-09-12T00:30:13.124167+0000","last_became_peered":"2024-09-12T00:30:13.124167+0000","last_unstale":"2024-09-12T01:07:46.489533+0000","last_undegraded":"2024-09-12T01:07:46.489533+0000","last_fullsized":"2024-09-12T01:07:46.489533+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:40.559024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":425,"num_write":152,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'404","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.415150+0000","last_change":"2024-09-12T00:30:11.109569+0000","last_active":"2024-09-12T01:11:23.415150+0000","last_peered":"2024-09-12T01:11:23.415150+0000","last_clean":"2024-09-12T01:11:23.415150+0000","last_became_active":"2024-09-12T00:30:11.108422+0000","last_became_peered":"2024-09-12T00:30:11.108422+0000","last_unstale":"2024-09-12T01:11:23.415150+0000","last_undegraded":"2024-09-12T01:11:23.415150+0000","last_fullsized":"2024-09-12T01:11:23.415150+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:38.097953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345472,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":814,"num_read_kb":2763,"num_write":1276,"num_write_kb":29562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.400338+0000","last_change":"2024-09-12T00:30:15.125457+0000","last_active":"2024-09-12T01:07:48.400338+0000","last_peered":"2024-09-12T01:07:48.400338+0000","last_clean":"2024-09-12T01:07:48.400338+0000","last_became_active":"2024-09-12T00:30:15.124922+0000","last_became_peered":"2024-09-12T00:30:15.124922+0000","last_unstale":"2024-09-12T01:07:48.400338+0000","last_undegraded":"2024-09-12T01:07:48.400338+0000","last_fullsized":"2024-09-12T01:07:48.400338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:27.550117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'346","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.452379+0000","last_change":"2024-09-12T00:30:17.149283+0000","last_active":"2024-09-12T01:10:51.452379+0000","last_peered":"2024-09-12T01:10:51.452379+0000","last_clean":"2024-09-12T01:10:51.452379+0000","last_became_active":"2024-09-12T00:30:17.148793+0000","last_became_peered":"2024-09-12T00:30:17.148793+0000","last_unstale":"2024-09-12T01:10:51.452379+0000","last_undegraded":"2024-09-12T01:10:51.452379+0000","last_fullsized":"2024-09-12T01:10:51.452379+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:33.498700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81032,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1086,"num_write":448,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:37.500323+0000","last_change":"2024-09-12T00:30:19.170247+0000","last_active":"2024-09-12T01:06:37.500323+0000","last_peered":"2024-09-12T01:06:37.500323+0000","last_clean":"2024-09-12T01:06:37.500323+0000","last_became_active":"2024-09-12T00:30:19.169982+0000","last_became_peered":"2024-09-12T00:30:19.169982+0000","last_unstale":"2024-09-12T01:06:37.500323+0000","last_undegraded":"2024-09-12T01:06:37.500323+0000","last_fullsized":"2024-09-12T01:06:37.500323+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'144","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.849786+0000","last_change":"2024-09-12T00:30:21.187973+0000","last_active":"2024-09-12T01:09:32.849786+0000","last_peered":"2024-09-12T01:09:32.849786+0000","last_clean":"2024-09-12T01:09:32.849786+0000","last_became_active":"2024-09-12T00:30:21.187641+0000","last_became_peered":"2024-09-12T00:30:21.187641+0000","last_unstale":"2024-09-12T01:09:32.849786+0000","last_undegraded":"2024-09-12T01:09:32.849786+0000","last_fullsized":"2024-09-12T01:09:32.849786+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:39.449383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":136,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'194","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.088663+0000","last_change":"2024-09-12T00:30:13.123094+0000","last_active":"2024-09-12T01:09:27.088663+0000","last_peered":"2024-09-12T01:09:27.088663+0000","last_clean":"2024-09-12T01:09:27.088663+0000","last_became_active":"2024-09-12T00:30:13.122622+0000","last_became_peered":"2024-09-12T00:30:13.122622+0000","last_unstale":"2024-09-12T01:09:27.088663+0000","last_undegraded":"2024-09-12T01:09:27.088663+0000","last_fullsized":"2024-09-12T01:09:27.088663+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:35.254290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":295,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'302","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.405819+0000","last_change":"2024-09-12T00:30:11.110375+0000","last_active":"2024-09-12T01:11:23.405819+0000","last_peered":"2024-09-12T01:11:23.405819+0000","last_clean":"2024-09-12T01:11:23.405819+0000","last_became_active":"2024-09-12T00:30:11.109855+0000","last_became_peered":"2024-09-12T00:30:11.109855+0000","last_unstale":"2024-09-12T01:11:23.405819+0000","last_undegraded":"2024-09-12T01:11:23.405819+0000","last_fullsized":"2024-09-12T01:11:23.405819+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:19.550416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1639977,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":575,"num_read_kb":64470,"num_write":1004,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489543+0000","last_change":"2024-09-12T00:30:15.126170+0000","last_active":"2024-09-12T01:07:46.489543+0000","last_peered":"2024-09-12T01:07:46.489543+0000","last_clean":"2024-09-12T01:07:46.489543+0000","last_became_active":"2024-09-12T00:30:15.125870+0000","last_became_peered":"2024-09-12T00:30:15.125870+0000","last_unstale":"2024-09-12T01:07:46.489543+0000","last_undegraded":"2024-09-12T01:07:46.489543+0000","last_fullsized":"2024-09-12T01:07:46.489543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:51.538427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'273","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.516204+0000","last_change":"2024-09-12T00:30:17.149628+0000","last_active":"2024-09-12T01:11:22.516204+0000","last_peered":"2024-09-12T01:11:22.516204+0000","last_clean":"2024-09-12T01:11:22.516204+0000","last_became_active":"2024-09-12T00:30:17.149226+0000","last_became_peered":"2024-09-12T00:30:17.149226+0000","last_unstale":"2024-09-12T01:11:22.516204+0000","last_undegraded":"2024-09-12T01:11:22.516204+0000","last_fullsized":"2024-09-12T01:11:22.516204+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:10.554142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":439,"num_read_kb":908,"num_write":362,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:38.585722+0000","last_change":"2024-09-12T00:30:19.164875+0000","last_active":"2024-09-12T01:06:38.585722+0000","last_peered":"2024-09-12T01:06:38.585722+0000","last_clean":"2024-09-12T01:06:38.585722+0000","last_became_active":"2024-09-12T00:30:19.164556+0000","last_became_peered":"2024-09-12T00:30:19.164556+0000","last_unstale":"2024-09-12T01:06:38.585722+0000","last_undegraded":"2024-09-12T01:06:38.585722+0000","last_fullsized":"2024-09-12T01:06:38.585722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:05.138428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'135","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.064016+0000","last_change":"2024-09-12T00:30:21.193857+0000","last_active":"2024-09-12T01:09:09.064016+0000","last_peered":"2024-09-12T01:09:09.064016+0000","last_clean":"2024-09-12T01:09:09.064016+0000","last_became_active":"2024-09-12T00:30:21.193606+0000","last_became_peered":"2024-09-12T00:30:21.193606+0000","last_unstale":"2024-09-12T01:09:09.064016+0000","last_undegraded":"2024-09-12T01:09:09.064016+0000","last_fullsized":"2024-09-12T01:09:09.064016+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:56.806530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":946,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":239,"num_write":347,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'4096","reported_seq":4671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.218622+0000","last_change":"2024-09-12T00:30:13.121220+0000","last_active":"2024-09-12T01:09:12.218622+0000","last_peered":"2024-09-12T01:09:12.218622+0000","last_clean":"2024-09-12T01:09:12.218622+0000","last_became_active":"2024-09-12T00:30:13.120940+0000","last_became_peered":"2024-09-12T00:30:13.120940+0000","last_unstale":"2024-09-12T01:09:12.218622+0000","last_undegraded":"2024-09-12T01:09:12.218622+0000","last_fullsized":"2024-09-12T01:09:12.218622+0000","mapping_epoch":28,"log_start":"264'4000","ondisk_log_start":"264'4000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.657138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16459,"num_read_kb":13812,"num_write":6134,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'290","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.722385+0000","last_change":"2024-09-12T00:30:11.099270+0000","last_active":"2024-09-12T01:09:31.722385+0000","last_peered":"2024-09-12T01:09:31.722385+0000","last_clean":"2024-09-12T01:09:31.722385+0000","last_became_active":"2024-09-12T00:30:11.098879+0000","last_became_peered":"2024-09-12T00:30:11.098879+0000","last_unstale":"2024-09-12T01:09:31.722385+0000","last_undegraded":"2024-09-12T01:09:31.722385+0000","last_fullsized":"2024-09-12T01:09:31.722385+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:03.440870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18151009,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":534,"num_read_kb":44110,"num_write":978,"num_write_kb":43739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409893+0000","last_change":"2024-09-12T00:30:15.125790+0000","last_active":"2024-09-12T01:08:58.409893+0000","last_peered":"2024-09-12T01:08:58.409893+0000","last_clean":"2024-09-12T01:08:58.409893+0000","last_became_active":"2024-09-12T00:30:15.125452+0000","last_became_peered":"2024-09-12T00:30:15.125452+0000","last_unstale":"2024-09-12T01:08:58.409893+0000","last_undegraded":"2024-09-12T01:08:58.409893+0000","last_fullsized":"2024-09-12T01:08:58.409893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:30.616035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'229","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.097745+0000","last_change":"2024-09-12T00:30:17.146683+0000","last_active":"2024-09-12T01:10:26.097745+0000","last_peered":"2024-09-12T01:10:26.097745+0000","last_clean":"2024-09-12T01:10:26.097745+0000","last_became_active":"2024-09-12T00:30:17.145961+0000","last_became_peered":"2024-09-12T00:30:17.145961+0000","last_unstale":"2024-09-12T01:10:26.097745+0000","last_undegraded":"2024-09-12T01:10:26.097745+0000","last_fullsized":"2024-09-12T01:10:26.097745+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:39.502275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44597,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":767,"num_write":298,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596405+0000","last_change":"2024-09-12T00:30:19.168010+0000","last_active":"2024-09-12T01:07:48.596405+0000","last_peered":"2024-09-12T01:07:48.596405+0000","last_clean":"2024-09-12T01:07:48.596405+0000","last_became_active":"2024-09-12T00:30:19.167723+0000","last_became_peered":"2024-09-12T00:30:19.167723+0000","last_unstale":"2024-09-12T01:07:48.596405+0000","last_undegraded":"2024-09-12T01:07:48.596405+0000","last_fullsized":"2024-09-12T01:07:48.596405+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:31.864085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'170","reported_seq":1613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:44.737494+0000","last_change":"2024-09-12T00:30:21.188654+0000","last_active":"2024-09-12T01:09:44.737494+0000","last_peered":"2024-09-12T01:09:44.737494+0000","last_clean":"2024-09-12T01:09:44.737494+0000","last_became_active":"2024-09-12T00:30:21.188363+0000","last_became_peered":"2024-09-12T00:30:21.188363+0000","last_unstale":"2024-09-12T01:09:44.737494+0000","last_undegraded":"2024-09-12T01:09:44.737494+0000","last_fullsized":"2024-09-12T01:09:44.737494+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:40.099921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1158,"num_read_kb":1157,"num_write":386,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'184","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.498641+0000","last_change":"2024-09-12T00:30:13.126020+0000","last_active":"2024-09-12T01:08:56.498641+0000","last_peered":"2024-09-12T01:08:56.498641+0000","last_clean":"2024-09-12T01:08:56.498641+0000","last_became_active":"2024-09-12T00:30:13.125727+0000","last_became_peered":"2024-09-12T00:30:13.125727+0000","last_unstale":"2024-09-12T01:08:56.498641+0000","last_undegraded":"2024-09-12T01:08:56.498641+0000","last_fullsized":"2024-09-12T01:08:56.498641+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:09.160490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":704,"num_write":275,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'257","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.754496+0000","last_change":"2024-09-12T00:30:11.092275+0000","last_active":"2024-09-12T01:09:43.754496+0000","last_peered":"2024-09-12T01:09:43.754496+0000","last_clean":"2024-09-12T01:09:43.754496+0000","last_became_active":"2024-09-12T00:30:11.091808+0000","last_became_peered":"2024-09-12T00:30:11.091808+0000","last_unstale":"2024-09-12T01:09:43.754496+0000","last_undegraded":"2024-09-12T01:09:43.754496+0000","last_fullsized":"2024-09-12T01:09:43.754496+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:26.055957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13691604,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":368,"num_read_kb":10677,"num_write":922,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:37.500363+0000","last_change":"2024-09-12T00:30:15.127289+0000","last_active":"2024-09-12T01:06:37.500363+0000","last_peered":"2024-09-12T01:06:37.500363+0000","last_clean":"2024-09-12T01:06:37.500363+0000","last_became_active":"2024-09-12T00:30:15.126206+0000","last_became_peered":"2024-09-12T00:30:15.126206+0000","last_unstale":"2024-09-12T01:06:37.500363+0000","last_undegraded":"2024-09-12T01:06:37.500363+0000","last_fullsized":"2024-09-12T01:06:37.500363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:39.699331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'298","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.484314+0000","last_change":"2024-09-12T00:30:17.145025+0000","last_active":"2024-09-12T01:10:51.484314+0000","last_peered":"2024-09-12T01:10:51.484314+0000","last_clean":"2024-09-12T01:10:51.484314+0000","last_became_active":"2024-09-12T00:30:17.144724+0000","last_became_peered":"2024-09-12T00:30:17.144724+0000","last_unstale":"2024-09-12T01:10:51.484314+0000","last_undegraded":"2024-09-12T01:10:51.484314+0000","last_fullsized":"2024-09-12T01:10:51.484314+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:32.229866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":949,"num_write":392,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511636+0000","last_change":"2024-09-12T00:30:19.172540+0000","last_active":"2024-09-12T01:07:52.511636+0000","last_peered":"2024-09-12T01:07:52.511636+0000","last_clean":"2024-09-12T01:07:52.511636+0000","last_became_active":"2024-09-12T00:30:19.172265+0000","last_became_peered":"2024-09-12T00:30:19.172265+0000","last_unstale":"2024-09-12T01:07:52.511636+0000","last_undegraded":"2024-09-12T01:07:52.511636+0000","last_fullsized":"2024-09-12T01:07:52.511636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:34.189913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'129","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.303430+0000","last_change":"2024-09-12T00:30:21.192137+0000","last_active":"2024-09-12T01:10:50.303430+0000","last_peered":"2024-09-12T01:10:50.303430+0000","last_clean":"2024-09-12T01:10:50.303430+0000","last_became_active":"2024-09-12T00:30:21.191837+0000","last_became_peered":"2024-09-12T00:30:21.191837+0000","last_unstale":"2024-09-12T01:10:50.303430+0000","last_undegraded":"2024-09-12T01:10:50.303430+0000","last_fullsized":"2024-09-12T01:10:50.303430+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:51.812234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":99,"num_write":307,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'142","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.522841+0000","last_change":"2024-09-12T00:30:13.122097+0000","last_active":"2024-09-12T01:09:12.522841+0000","last_peered":"2024-09-12T01:09:12.522841+0000","last_clean":"2024-09-12T01:09:12.522841+0000","last_became_active":"2024-09-12T00:30:13.121828+0000","last_became_peered":"2024-09-12T00:30:13.121828+0000","last_unstale":"2024-09-12T01:09:12.522841+0000","last_undegraded":"2024-09-12T01:09:12.522841+0000","last_fullsized":"2024-09-12T01:09:12.522841+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.165397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":656,"num_read_kb":543,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'307","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.172050+0000","last_change":"2024-09-12T00:30:11.106219+0000","last_active":"2024-09-12T01:09:22.172050+0000","last_peered":"2024-09-12T01:09:22.172050+0000","last_clean":"2024-09-12T01:09:22.172050+0000","last_became_active":"2024-09-12T00:30:11.105480+0000","last_became_peered":"2024-09-12T00:30:11.105480+0000","last_unstale":"2024-09-12T01:09:22.172050+0000","last_undegraded":"2024-09-12T01:09:22.172050+0000","last_fullsized":"2024-09-12T01:09:22.172050+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:30.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6161693,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":716,"num_read_kb":27112,"num_write":1158,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'88","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:25.698914+0000","last_change":"2024-09-12T00:30:13.130762+0000","last_active":"2024-09-12T01:09:25.698914+0000","last_peered":"2024-09-12T01:09:25.698914+0000","last_clean":"2024-09-12T01:09:25.698914+0000","last_became_active":"2024-09-12T00:30:13.130421+0000","last_became_peered":"2024-09-12T00:30:13.130421+0000","last_unstale":"2024-09-12T01:09:25.698914+0000","last_undegraded":"2024-09-12T01:09:25.698914+0000","last_fullsized":"2024-09-12T01:09:25.698914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:30.693777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":312,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'307","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.399705+0000","last_change":"2024-09-12T00:30:11.092694+0000","last_active":"2024-09-12T01:11:23.399705+0000","last_peered":"2024-09-12T01:11:23.399705+0000","last_clean":"2024-09-12T01:11:23.399705+0000","last_became_active":"2024-09-12T00:30:11.092318+0000","last_became_peered":"2024-09-12T00:30:11.092318+0000","last_unstale":"2024-09-12T01:11:23.399705+0000","last_undegraded":"2024-09-12T01:11:23.399705+0000","last_fullsized":"2024-09-12T01:11:23.399705+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:49.888269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4851765,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":385,"num_read_kb":12148,"num_write":1029,"num_write_kb":57585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'403","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.766486+0000","last_change":"2024-09-12T00:30:13.127156+0000","last_active":"2024-09-12T01:09:27.766486+0000","last_peered":"2024-09-12T01:09:27.766486+0000","last_clean":"2024-09-12T01:09:27.766486+0000","last_became_active":"2024-09-12T00:30:13.126912+0000","last_became_peered":"2024-09-12T00:30:13.126912+0000","last_unstale":"2024-09-12T01:09:27.766486+0000","last_undegraded":"2024-09-12T01:09:27.766486+0000","last_fullsized":"2024-09-12T01:09:27.766486+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:42.227244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1731,"num_read_kb":1377,"num_write":679,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'387","reported_seq":1048,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.556410+0000","last_change":"2024-09-12T00:30:11.099450+0000","last_active":"2024-09-12T01:11:23.556410+0000","last_peered":"2024-09-12T01:11:23.556410+0000","last_clean":"2024-09-12T01:11:23.556410+0000","last_became_active":"2024-09-12T00:30:11.099069+0000","last_became_peered":"2024-09-12T00:30:11.099069+0000","last_unstale":"2024-09-12T01:11:23.556410+0000","last_undegraded":"2024-09-12T01:11:23.556410+0000","last_fullsized":"2024-09-12T01:11:23.556410+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:15.083942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20449928,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":648,"num_read_kb":70901,"num_write":1239,"num_write_kb":51705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'117","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.482213+0000","last_change":"2024-09-12T00:30:13.127130+0000","last_active":"2024-09-12T01:09:12.482213+0000","last_peered":"2024-09-12T01:09:12.482213+0000","last_clean":"2024-09-12T01:09:12.482213+0000","last_became_active":"2024-09-12T00:30:13.126860+0000","last_became_peered":"2024-09-12T00:30:13.126860+0000","last_unstale":"2024-09-12T01:09:12.482213+0000","last_undegraded":"2024-09-12T01:09:12.482213+0000","last_fullsized":"2024-09-12T01:09:12.482213+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:11.846692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":463,"num_write":200,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'271","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:44.896946+0000","last_change":"2024-09-12T00:30:11.105582+0000","last_active":"2024-09-12T01:08:44.896946+0000","last_peered":"2024-09-12T01:08:44.896946+0000","last_clean":"2024-09-12T01:08:44.896946+0000","last_became_active":"2024-09-12T00:30:11.105196+0000","last_became_peered":"2024-09-12T00:30:11.105196+0000","last_unstale":"2024-09-12T01:08:44.896946+0000","last_undegraded":"2024-09-12T01:08:44.896946+0000","last_fullsized":"2024-09-12T01:08:44.896946+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:05.512265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4571982,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":405,"num_read_kb":8471,"num_write":945,"num_write_kb":46203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'4191","reported_seq":4832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.275772+0000","last_change":"2024-09-12T00:30:13.125779+0000","last_active":"2024-09-12T01:09:46.275772+0000","last_peered":"2024-09-12T01:09:46.275772+0000","last_clean":"2024-09-12T01:09:46.275772+0000","last_became_active":"2024-09-12T00:30:13.125353+0000","last_became_peered":"2024-09-12T00:30:13.125353+0000","last_unstale":"2024-09-12T01:09:46.275772+0000","last_undegraded":"2024-09-12T01:09:46.275772+0000","last_fullsized":"2024-09-12T01:09:46.275772+0000","mapping_epoch":28,"log_start":"264'4100","ondisk_log_start":"264'4100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":3000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:27.342797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16885,"num_read_kb":14166,"num_write":6282,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'310","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.392972+0000","last_change":"2024-09-12T00:30:11.108515+0000","last_active":"2024-09-12T01:09:12.392972+0000","last_peered":"2024-09-12T01:09:12.392972+0000","last_clean":"2024-09-12T01:09:12.392972+0000","last_became_active":"2024-09-12T00:30:11.108127+0000","last_became_peered":"2024-09-12T00:30:11.108127+0000","last_unstale":"2024-09-12T01:09:12.392972+0000","last_undegraded":"2024-09-12T01:09:12.392972+0000","last_fullsized":"2024-09-12T01:09:12.392972+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:39.466509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7349140,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":396,"num_read_kb":2771,"num_write":1025,"num_write_kb":29841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'185","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.516867+0000","last_change":"2024-09-12T00:30:13.129689+0000","last_active":"2024-09-12T01:07:43.516867+0000","last_peered":"2024-09-12T01:07:43.516867+0000","last_clean":"2024-09-12T01:07:43.516867+0000","last_became_active":"2024-09-12T00:30:13.129432+0000","last_became_peered":"2024-09-12T00:30:13.129432+0000","last_unstale":"2024-09-12T01:07:43.516867+0000","last_undegraded":"2024-09-12T01:07:43.516867+0000","last_fullsized":"2024-09-12T01:07:43.516867+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:23.760718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":694,"num_write":316,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'306","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:46.120237+0000","last_change":"2024-09-12T00:30:11.108733+0000","last_active":"2024-09-12T01:10:46.120237+0000","last_peered":"2024-09-12T01:10:46.120237+0000","last_clean":"2024-09-12T01:10:46.120237+0000","last_became_active":"2024-09-12T00:30:11.108351+0000","last_became_peered":"2024-09-12T00:30:11.108351+0000","last_unstale":"2024-09-12T01:10:46.120237+0000","last_undegraded":"2024-09-12T01:10:46.120237+0000","last_fullsized":"2024-09-12T01:10:46.120237+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:25.752418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5893721,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":609,"num_read_kb":30774,"num_write":1189,"num_write_kb":36026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'163","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.830877+0000","last_change":"2024-09-12T00:30:13.124976+0000","last_active":"2024-09-12T01:08:14.830877+0000","last_peered":"2024-09-12T01:08:14.830877+0000","last_clean":"2024-09-12T01:08:14.830877+0000","last_became_active":"2024-09-12T00:30:13.124637+0000","last_became_peered":"2024-09-12T00:30:13.124637+0000","last_unstale":"2024-09-12T01:08:14.830877+0000","last_undegraded":"2024-09-12T01:08:14.830877+0000","last_fullsized":"2024-09-12T01:08:14.830877+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:27.099393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":588,"num_write":241,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'307","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.749414+0000","last_change":"2024-09-12T00:30:11.110962+0000","last_active":"2024-09-12T01:09:43.749414+0000","last_peered":"2024-09-12T01:09:43.749414+0000","last_clean":"2024-09-12T01:09:43.749414+0000","last_became_active":"2024-09-12T00:30:11.108084+0000","last_became_peered":"2024-09-12T00:30:11.108084+0000","last_unstale":"2024-09-12T01:09:43.749414+0000","last_undegraded":"2024-09-12T01:09:43.749414+0000","last_fullsized":"2024-09-12T01:09:43.749414+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:46.496743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5227247,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":551,"num_read_kb":11433,"num_write":1172,"num_write_kb":28830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'237","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.819696+0000","last_change":"2024-09-12T00:30:13.129156+0000","last_active":"2024-09-12T01:09:46.819696+0000","last_peered":"2024-09-12T01:09:46.819696+0000","last_clean":"2024-09-12T01:09:46.819696+0000","last_became_active":"2024-09-12T00:30:13.128799+0000","last_became_peered":"2024-09-12T00:30:13.128799+0000","last_unstale":"2024-09-12T01:09:46.819696+0000","last_undegraded":"2024-09-12T01:09:46.819696+0000","last_fullsized":"2024-09-12T01:09:46.819696+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:02.256587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":871,"num_write":360,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'278","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.795326+0000","last_change":"2024-09-12T00:30:11.103076+0000","last_active":"2024-09-12T01:09:28.795326+0000","last_peered":"2024-09-12T01:09:28.795326+0000","last_clean":"2024-09-12T01:09:28.795326+0000","last_became_active":"2024-09-12T00:30:11.102617+0000","last_became_peered":"2024-09-12T00:30:11.102617+0000","last_unstale":"2024-09-12T01:09:28.795326+0000","last_undegraded":"2024-09-12T01:09:28.795326+0000","last_fullsized":"2024-09-12T01:09:28.795326+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11054816,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":401,"num_read_kb":18669,"num_write":949,"num_write_kb":28835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'52","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.491391+0000","last_change":"2024-09-12T00:30:13.123470+0000","last_active":"2024-09-12T01:08:22.491391+0000","last_peered":"2024-09-12T01:08:22.491391+0000","last_clean":"2024-09-12T01:08:22.491391+0000","last_became_active":"2024-09-12T00:30:13.123035+0000","last_became_peered":"2024-09-12T00:30:13.123035+0000","last_unstale":"2024-09-12T01:08:22.491391+0000","last_undegraded":"2024-09-12T01:08:22.491391+0000","last_fullsized":"2024-09-12T01:08:22.491391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.860214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":222,"num_write":77,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'300","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.517801+0000","last_change":"2024-09-12T00:30:11.112796+0000","last_active":"2024-09-12T01:11:23.517801+0000","last_peered":"2024-09-12T01:11:23.517801+0000","last_clean":"2024-09-12T01:11:23.517801+0000","last_became_active":"2024-09-12T00:30:11.110299+0000","last_became_peered":"2024-09-12T00:30:11.110299+0000","last_unstale":"2024-09-12T01:11:23.517801+0000","last_undegraded":"2024-09-12T01:11:23.517801+0000","last_fullsized":"2024-09-12T01:11:23.517801+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:24.673935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4218838,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":407,"num_read_kb":30015,"num_write":1010,"num_write_kb":30187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'180","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.132211+0000","last_change":"2024-09-12T00:30:13.124078+0000","last_active":"2024-09-12T01:09:12.132211+0000","last_peered":"2024-09-12T01:09:12.132211+0000","last_clean":"2024-09-12T01:09:12.132211+0000","last_became_active":"2024-09-12T00:30:13.123217+0000","last_became_peered":"2024-09-12T00:30:13.123217+0000","last_unstale":"2024-09-12T01:09:12.132211+0000","last_undegraded":"2024-09-12T01:09:12.132211+0000","last_fullsized":"2024-09-12T01:09:12.132211+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:27.761815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":608,"num_write":257,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'267","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475274+0000","last_change":"2024-09-12T00:30:11.103101+0000","last_active":"2024-09-12T01:08:27.475274+0000","last_peered":"2024-09-12T01:08:27.475274+0000","last_clean":"2024-09-12T01:08:27.475274+0000","last_became_active":"2024-09-12T00:30:11.102436+0000","last_became_peered":"2024-09-12T00:30:11.102436+0000","last_unstale":"2024-09-12T01:08:27.475274+0000","last_undegraded":"2024-09-12T01:08:27.475274+0000","last_fullsized":"2024-09-12T01:08:27.475274+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:41.189010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7688011,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":458,"num_read_kb":79108,"num_write":1057,"num_write_kb":40469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'217","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.852926+0000","last_change":"2024-09-12T00:30:13.130944+0000","last_active":"2024-09-12T01:09:32.852926+0000","last_peered":"2024-09-12T01:09:32.852926+0000","last_clean":"2024-09-12T01:09:32.852926+0000","last_became_active":"2024-09-12T00:30:13.129733+0000","last_became_peered":"2024-09-12T00:30:13.129733+0000","last_unstale":"2024-09-12T01:09:32.852926+0000","last_undegraded":"2024-09-12T01:09:32.852926+0000","last_fullsized":"2024-09-12T01:09:32.852926+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.671267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":953,"num_read_kb":786,"num_write":335,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'345","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.387259+0000","last_change":"2024-09-12T00:30:11.106483+0000","last_active":"2024-09-12T01:11:23.387259+0000","last_peered":"2024-09-12T01:11:23.387259+0000","last_clean":"2024-09-12T01:11:23.387259+0000","last_became_active":"2024-09-12T00:30:11.105950+0000","last_became_peered":"2024-09-12T00:30:11.105950+0000","last_unstale":"2024-09-12T01:11:23.387259+0000","last_undegraded":"2024-09-12T01:11:23.387259+0000","last_fullsized":"2024-09-12T01:11:23.387259+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:12.198729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8540255,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":552,"num_read_kb":20760,"num_write":1305,"num_write_kb":32414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'172","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.452544+0000","last_change":"2024-09-12T00:30:13.128272+0000","last_active":"2024-09-12T01:09:33.452544+0000","last_peered":"2024-09-12T01:09:33.452544+0000","last_clean":"2024-09-12T01:09:33.452544+0000","last_became_active":"2024-09-12T00:30:13.128009+0000","last_became_peered":"2024-09-12T00:30:13.128009+0000","last_unstale":"2024-09-12T01:09:33.452544+0000","last_undegraded":"2024-09-12T01:09:33.452544+0000","last_fullsized":"2024-09-12T01:09:33.452544+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:55.279618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":738,"num_read_kb":604,"num_write":258,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'329","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:42.536640+0000","last_change":"2024-09-12T00:30:11.097300+0000","last_active":"2024-09-12T01:10:42.536640+0000","last_peered":"2024-09-12T01:10:42.536640+0000","last_clean":"2024-09-12T01:10:42.536640+0000","last_became_active":"2024-09-12T00:30:11.096908+0000","last_became_peered":"2024-09-12T00:30:11.096908+0000","last_unstale":"2024-09-12T01:10:42.536640+0000","last_undegraded":"2024-09-12T01:10:42.536640+0000","last_fullsized":"2024-09-12T01:10:42.536640+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:48.080479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8750206,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":529,"num_read_kb":27822,"num_write":1259,"num_write_kb":35997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'129","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.405828+0000","last_change":"2024-09-12T00:30:13.127092+0000","last_active":"2024-09-12T01:08:28.405828+0000","last_peered":"2024-09-12T01:08:28.405828+0000","last_clean":"2024-09-12T01:08:28.405828+0000","last_became_active":"2024-09-12T00:30:13.126817+0000","last_became_peered":"2024-09-12T00:30:13.126817+0000","last_unstale":"2024-09-12T01:08:28.405828+0000","last_undegraded":"2024-09-12T01:08:28.405828+0000","last_fullsized":"2024-09-12T01:08:28.405828+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.950480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":588,"num_read_kb":486,"num_write":195,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'304","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.446448+0000","last_change":"2024-09-12T00:30:11.105919+0000","last_active":"2024-09-12T01:11:23.446448+0000","last_peered":"2024-09-12T01:11:23.446448+0000","last_clean":"2024-09-12T01:11:23.446448+0000","last_became_active":"2024-09-12T00:30:11.105575+0000","last_became_peered":"2024-09-12T00:30:11.105575+0000","last_unstale":"2024-09-12T01:11:23.446448+0000","last_undegraded":"2024-09-12T01:11:23.446448+0000","last_fullsized":"2024-09-12T01:11:23.446448+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:20.050929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10282395,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":548,"num_read_kb":45130,"num_write":1123,"num_write_kb":46621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'202","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.432143+0000","last_change":"2024-09-12T00:30:13.129377+0000","last_active":"2024-09-12T01:09:03.432143+0000","last_peered":"2024-09-12T01:09:03.432143+0000","last_clean":"2024-09-12T01:09:03.432143+0000","last_became_active":"2024-09-12T00:30:13.129092+0000","last_became_peered":"2024-09-12T00:30:13.129092+0000","last_unstale":"2024-09-12T01:09:03.432143+0000","last_undegraded":"2024-09-12T01:09:03.432143+0000","last_fullsized":"2024-09-12T01:09:03.432143+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:03.194905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":854,"num_read_kb":707,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'314","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.579292+0000","last_change":"2024-09-12T00:30:11.109364+0000","last_active":"2024-09-12T01:11:23.579292+0000","last_peered":"2024-09-12T01:11:23.579292+0000","last_clean":"2024-09-12T01:11:23.579292+0000","last_became_active":"2024-09-12T00:30:11.108616+0000","last_became_peered":"2024-09-12T00:30:11.108616+0000","last_unstale":"2024-09-12T01:11:23.579292+0000","last_undegraded":"2024-09-12T01:11:23.579292+0000","last_fullsized":"2024-09-12T01:11:23.579292+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:22.828086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505504,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":922,"num_read_kb":21858,"num_write":1119,"num_write_kb":27958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'147","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516270+0000","last_change":"2024-09-12T00:30:13.127131+0000","last_active":"2024-09-12T01:08:27.516270+0000","last_peered":"2024-09-12T01:08:27.516270+0000","last_clean":"2024-09-12T01:08:27.516270+0000","last_became_active":"2024-09-12T00:30:13.125887+0000","last_became_peered":"2024-09-12T00:30:13.125887+0000","last_unstale":"2024-09-12T01:08:27.516270+0000","last_undegraded":"2024-09-12T01:08:27.516270+0000","last_fullsized":"2024-09-12T01:08:27.516270+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:40.857952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":559,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'294","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.378697+0000","last_change":"2024-09-12T00:30:46.396636+0000","last_active":"2024-09-12T01:11:23.378697+0000","last_peered":"2024-09-12T01:11:23.378697+0000","last_clean":"2024-09-12T01:11:23.378697+0000","last_became_active":"2024-09-12T00:30:46.396288+0000","last_became_peered":"2024-09-12T00:30:46.396288+0000","last_unstale":"2024-09-12T01:11:23.378697+0000","last_undegraded":"2024-09-12T01:11:23.378697+0000","last_fullsized":"2024-09-12T01:11:23.378697+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:48.101790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10096145,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":500,"num_read_kb":21012,"num_write":1019,"num_write_kb":30668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'249","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.546201+0000","last_change":"2024-09-12T00:30:13.127777+0000","last_active":"2024-09-12T01:09:43.546201+0000","last_peered":"2024-09-12T01:09:43.546201+0000","last_clean":"2024-09-12T01:09:43.546201+0000","last_became_active":"2024-09-12T00:30:13.127513+0000","last_became_peered":"2024-09-12T00:30:13.127513+0000","last_unstale":"2024-09-12T01:09:43.546201+0000","last_undegraded":"2024-09-12T01:09:43.546201+0000","last_fullsized":"2024-09-12T01:09:43.546201+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:22.047664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":791,"num_write":358,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'299","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.550256+0000","last_change":"2024-09-12T00:30:11.110035+0000","last_active":"2024-09-12T01:11:23.550256+0000","last_peered":"2024-09-12T01:11:23.550256+0000","last_clean":"2024-09-12T01:11:23.550256+0000","last_became_active":"2024-09-12T00:30:11.109661+0000","last_became_peered":"2024-09-12T00:30:11.109661+0000","last_unstale":"2024-09-12T01:11:23.550256+0000","last_undegraded":"2024-09-12T01:11:23.550256+0000","last_fullsized":"2024-09-12T01:11:23.550256+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:51.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8646628,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":422,"num_read_kb":8210,"num_write":1051,"num_write_kb":36173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'284","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.578179+0000","last_change":"2024-09-12T00:30:11.113547+0000","last_active":"2024-09-12T01:11:23.578179+0000","last_peered":"2024-09-12T01:11:23.578179+0000","last_clean":"2024-09-12T01:11:23.578179+0000","last_became_active":"2024-09-12T00:30:11.113173+0000","last_became_peered":"2024-09-12T00:30:11.113173+0000","last_unstale":"2024-09-12T01:11:23.578179+0000","last_undegraded":"2024-09-12T01:11:23.578179+0000","last_fullsized":"2024-09-12T01:11:23.578179+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:20.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8387571,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":453,"num_read_kb":50214,"num_write":1026,"num_write_kb":47204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'24","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.520781+0000","last_change":"2024-09-12T00:30:13.126552+0000","last_active":"2024-09-12T01:08:57.520781+0000","last_peered":"2024-09-12T01:08:57.520781+0000","last_clean":"2024-09-12T01:08:57.520781+0000","last_became_active":"2024-09-12T00:30:13.126264+0000","last_became_peered":"2024-09-12T00:30:13.126264+0000","last_unstale":"2024-09-12T01:08:57.520781+0000","last_undegraded":"2024-09-12T01:08:57.520781+0000","last_fullsized":"2024-09-12T01:08:57.520781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:09.574554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":113,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'304","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.038387+0000","last_change":"2024-09-12T00:30:11.102417+0000","last_active":"2024-09-12T01:09:33.038387+0000","last_peered":"2024-09-12T01:09:33.038387+0000","last_clean":"2024-09-12T01:09:33.038387+0000","last_became_active":"2024-09-12T00:30:11.102026+0000","last_became_peered":"2024-09-12T00:30:11.102026+0000","last_unstale":"2024-09-12T01:09:33.038387+0000","last_undegraded":"2024-09-12T01:09:33.038387+0000","last_fullsized":"2024-09-12T01:09:33.038387+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:54.893481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5791192,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":599,"num_read_kb":9482,"num_write":1140,"num_write_kb":28977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'250","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.409374+0000","last_change":"2024-09-12T00:30:13.120189+0000","last_active":"2024-09-12T01:08:53.409374+0000","last_peered":"2024-09-12T01:08:53.409374+0000","last_clean":"2024-09-12T01:08:53.409374+0000","last_became_active":"2024-09-12T00:30:13.119872+0000","last_became_peered":"2024-09-12T00:30:13.119872+0000","last_unstale":"2024-09-12T01:08:53.409374+0000","last_undegraded":"2024-09-12T01:08:53.409374+0000","last_fullsized":"2024-09-12T01:08:53.409374+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:30.740866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":987,"num_write":428,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5946,"num_read_kb":4236,"num_write":1962,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1033,"ondisk_log_size":1033,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15005,"num_read_kb":14670,"num_write":16786,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1559,"ondisk_log_size":1559,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":653,"ondisk_log_size":653,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1834349,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17337,"num_read_kb":33944,"num_write":14556,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":2188983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2120,"ondisk_log_size":2120,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2429,"num_read_kb":2894,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102018,"num_read_kb":85254,"num_write":36979,"num_write_kb":18604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4230,"ondisk_log_size":4230,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":484632839,"num_objects":3635,"num_object_clones":0,"num_object_copies":14540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3635,"num_whiteouts":0,"num_read":32867,"num_read_kb":1917388,"num_write":68791,"num_write_kb":2191736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":694988800,"data_stored":694988800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4493,"ondisk_log_size":4493,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59550535,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":139,"num_read_kb":170064,"num_write":163,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127492096,"data_stored":127481486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":53477376,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":141,"num_read_kb":168795,"num_write":167,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122466304,"data_stored":122460999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509946,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":360208,"kb_used_data":144384,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94011632,"statfs":{"total":96636764160,"available":96267911168,"internally_reserved":0,"allocated":147849216,"data_stored":145818234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":220985799},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509943,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398712,"kb_used_data":118920,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93973128,"statfs":{"total":96636764160,"available":96228483072,"internally_reserved":0,"allocated":121774080,"data_stored":119734403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509943,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":219716,"kb_used_data":89836,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94152124,"statfs":{"total":96636764160,"available":96411774976,"internally_reserved":0,"allocated":91992064,"data_stored":89952552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542648,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345276,"kb_used_data":137836,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94026564,"statfs":{"total":96636764160,"available":96283201536,"internally_reserved":0,"allocated":141144064,"data_stored":139135656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542647,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248136,"kb_used_data":148984,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94123704,"statfs":{"total":96636764160,"available":96382672896,"internally_reserved":0,"allocated":152559616,"data_stored":150532187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":101513671},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542645,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373592,"kb_used_data":148040,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93998248,"statfs":{"total":96636764160,"available":96254205952,"internally_reserved":0,"allocated":151592960,"data_stored":149551159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542648,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316856,"kb_used_data":127464,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":94054984,"statfs":{"total":96636764160,"available":96312303616,"internally_reserved":0,"allocated":130523136,"data_stored":128478045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575351,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280840,"kb_used_data":155256,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94091000,"statfs":{"total":96636764160,"available":96349184000,"internally_reserved":0,"allocated":158982144,"data_stored":156982372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":70447104,"data_stored":70447104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65097728,"data_stored":65097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":124665856,"data_stored":124665856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":79831040,"data_stored":79831040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":108998656,"data_stored":108998656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98582528,"data_stored":98582528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83771392,"data_stored":83771392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63594496,"data_stored":63594496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":281248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":291285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":127269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":208702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":361226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":391794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":348198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":179261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15749120,"data_stored":15749120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":10017451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23072768,"data_stored":23072768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24358912,"data_stored":24354972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14667776,"data_stored":14667776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":9102833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14221312,"data_stored":14219947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6287360,"data_stored":6287360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6881280,"data_stored":6879915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24694784,"data_stored":24693419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39837696,"data_stored":39837696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17031168,"data_stored":17027228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:26.618 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:26.951 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:11:26.962 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T01:11:26.964 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":1504,"stamp":"2024-09-12T01:11:26.232250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600103598,"num_objects":4033,"num_object_clones":0,"num_object_copies":15336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4033,"num_whiteouts":0,"num_read":175960,"num_read_kb":2397312,"num_write":139547,"num_write_kb":2482850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14391,"ondisk_log_size":14391,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2543336,"kb_used_data":1070720,"kb_used_omap":12,"kb_used_meta":1472179,"kb_avail":752431384,"statfs":{"total":773094113280,"available":770489737216,"internally_reserved":0,"allocated":1096417280,"data_stored":1080184608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1507511858},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-117297587,"num_objects":-863,"num_object_clones":0,"num_object_copies":-3424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-863,"num_whiteouts":0,"num_read":991,"num_read_kb":1058,"num_write":927,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005837"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509864+0000","last_change":"2024-09-12T00:56:52.991247+0000","last_active":"2024-09-12T01:06:53.509864+0000","last_peered":"2024-09-12T01:06:53.509864+0000","last_clean":"2024-09-12T01:06:53.509864+0000","last_became_active":"2024-09-12T00:56:52.990975+0000","last_became_peered":"2024-09-12T00:56:52.990975+0000","last_unstale":"2024-09-12T01:06:53.509864+0000","last_undegraded":"2024-09-12T01:06:53.509864+0000","last_fullsized":"2024-09-12T01:06:53.509864+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:25.467438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.408743+0000","last_change":"2024-09-12T00:46:19.285045+0000","last_active":"2024-09-12T01:08:48.408743+0000","last_peered":"2024-09-12T01:08:48.408743+0000","last_clean":"2024-09-12T01:08:48.408743+0000","last_became_active":"2024-09-12T00:46:19.284774+0000","last_became_peered":"2024-09-12T00:46:19.284774+0000","last_unstale":"2024-09-12T01:08:48.408743+0000","last_undegraded":"2024-09-12T01:08:48.408743+0000","last_fullsized":"2024-09-12T01:08:48.408743+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:05.942678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.410391+0000","last_change":"2024-09-12T00:46:16.275794+0000","last_active":"2024-09-12T01:11:18.410391+0000","last_peered":"2024-09-12T01:11:18.410391+0000","last_clean":"2024-09-12T01:11:18.410391+0000","last_became_active":"2024-09-12T00:46:16.275529+0000","last_became_peered":"2024-09-12T00:46:16.275529+0000","last_unstale":"2024-09-12T01:11:18.410391+0000","last_undegraded":"2024-09-12T01:11:18.410391+0000","last_fullsized":"2024-09-12T01:11:18.410391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:10.602032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'24","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.244847+0000","last_change":"2024-09-12T00:44:37.816651+0000","last_active":"2024-09-12T01:08:22.244847+0000","last_peered":"2024-09-12T01:08:22.244847+0000","last_clean":"2024-09-12T01:08:22.244847+0000","last_became_active":"2024-09-12T00:44:37.816192+0000","last_became_peered":"2024-09-12T00:44:37.816192+0000","last_unstale":"2024-09-12T01:08:22.244847+0000","last_undegraded":"2024-09-12T01:08:22.244847+0000","last_fullsized":"2024-09-12T01:08:22.244847+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:52.133009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:52.373304+0000","last_change":"2024-09-12T00:56:52.996167+0000","last_active":"2024-09-12T01:06:52.373304+0000","last_peered":"2024-09-12T01:06:52.373304+0000","last_clean":"2024-09-12T01:06:52.373304+0000","last_became_active":"2024-09-12T00:56:52.995871+0000","last_became_peered":"2024-09-12T00:56:52.995871+0000","last_unstale":"2024-09-12T01:06:52.373304+0000","last_undegraded":"2024-09-12T01:06:52.373304+0000","last_fullsized":"2024-09-12T01:06:52.373304+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:23.434095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:51.498180+0000","last_change":"2024-09-12T00:46:19.285212+0000","last_active":"2024-09-12T01:08:51.498180+0000","last_peered":"2024-09-12T01:08:51.498180+0000","last_clean":"2024-09-12T01:08:51.498180+0000","last_became_active":"2024-09-12T00:46:19.284875+0000","last_became_peered":"2024-09-12T00:46:19.284875+0000","last_unstale":"2024-09-12T01:08:51.498180+0000","last_undegraded":"2024-09-12T01:08:51.498180+0000","last_fullsized":"2024-09-12T01:08:51.498180+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:33.439048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.478299+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:08:47.478299+0000","last_peered":"2024-09-12T01:08:47.478299+0000","last_clean":"2024-09-12T01:08:47.478299+0000","last_became_active":"2024-09-12T00:46:16.275381+0000","last_became_peered":"2024-09-12T00:46:16.275381+0000","last_unstale":"2024-09-12T01:08:47.478299+0000","last_undegraded":"2024-09-12T01:08:47.478299+0000","last_fullsized":"2024-09-12T01:08:47.478299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.675654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'45","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.444239+0000","last_change":"2024-09-12T00:44:37.819913+0000","last_active":"2024-09-12T01:08:56.444239+0000","last_peered":"2024-09-12T01:08:56.444239+0000","last_clean":"2024-09-12T01:08:56.444239+0000","last_became_active":"2024-09-12T00:44:37.819561+0000","last_became_peered":"2024-09-12T00:44:37.819561+0000","last_unstale":"2024-09-12T01:08:56.444239+0000","last_undegraded":"2024-09-12T01:08:56.444239+0000","last_fullsized":"2024-09-12T01:08:56.444239+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:18.208589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":164,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409863+0000","last_change":"2024-09-12T00:56:52.990647+0000","last_active":"2024-09-12T01:08:58.409863+0000","last_peered":"2024-09-12T01:08:58.409863+0000","last_clean":"2024-09-12T01:08:58.409863+0000","last_became_active":"2024-09-12T00:56:52.990364+0000","last_became_peered":"2024-09-12T00:56:52.990364+0000","last_unstale":"2024-09-12T01:08:58.409863+0000","last_undegraded":"2024-09-12T01:08:58.409863+0000","last_fullsized":"2024-09-12T01:08:58.409863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:34.228970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.483121+0000","last_change":"2024-09-12T00:46:19.285614+0000","last_active":"2024-09-12T01:09:17.483121+0000","last_peered":"2024-09-12T01:09:17.483121+0000","last_clean":"2024-09-12T01:09:17.483121+0000","last_became_active":"2024-09-12T00:46:19.285357+0000","last_became_peered":"2024-09-12T00:46:19.285357+0000","last_unstale":"2024-09-12T01:09:17.483121+0000","last_undegraded":"2024-09-12T01:09:17.483121+0000","last_fullsized":"2024-09-12T01:09:17.483121+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:02.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":2,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.384512+0000","last_change":"2024-09-12T00:46:16.278495+0000","last_active":"2024-09-12T01:08:18.384512+0000","last_peered":"2024-09-12T01:08:18.384512+0000","last_clean":"2024-09-12T01:08:18.384512+0000","last_became_active":"2024-09-12T00:46:16.278221+0000","last_became_peered":"2024-09-12T00:46:16.278221+0000","last_unstale":"2024-09-12T01:08:18.384512+0000","last_undegraded":"2024-09-12T01:08:18.384512+0000","last_fullsized":"2024-09-12T01:08:18.384512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:42.560119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5130,"num_write":12,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'37","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375379+0000","last_change":"2024-09-12T00:44:37.818554+0000","last_active":"2024-09-12T01:07:07.375379+0000","last_peered":"2024-09-12T01:07:07.375379+0000","last_clean":"2024-09-12T01:07:07.375379+0000","last_became_active":"2024-09-12T00:44:37.818239+0000","last_became_peered":"2024-09-12T00:44:37.818239+0000","last_unstale":"2024-09-12T01:07:07.375379+0000","last_undegraded":"2024-09-12T01:07:07.375379+0000","last_fullsized":"2024-09-12T01:07:07.375379+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:53.443510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":144,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:37.459106+0000","last_change":"2024-09-12T00:56:52.995412+0000","last_active":"2024-09-12T01:06:37.459106+0000","last_peered":"2024-09-12T01:06:37.459106+0000","last_clean":"2024-09-12T01:06:37.459106+0000","last_became_active":"2024-09-12T00:56:52.995062+0000","last_became_peered":"2024-09-12T00:56:52.995062+0000","last_unstale":"2024-09-12T01:06:37.459106+0000","last_undegraded":"2024-09-12T01:06:37.459106+0000","last_fullsized":"2024-09-12T01:06:37.459106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.136639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475349+0000","last_change":"2024-09-12T00:46:19.285095+0000","last_active":"2024-09-12T01:08:27.475349+0000","last_peered":"2024-09-12T01:08:27.475349+0000","last_clean":"2024-09-12T01:08:27.475349+0000","last_became_active":"2024-09-12T00:46:19.284822+0000","last_became_peered":"2024-09-12T00:46:19.284822+0000","last_unstale":"2024-09-12T01:08:27.475349+0000","last_undegraded":"2024-09-12T01:08:27.475349+0000","last_fullsized":"2024-09-12T01:08:27.475349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:42.407553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411818+0000","last_change":"2024-09-12T00:46:16.261917+0000","last_active":"2024-09-12T01:09:13.411818+0000","last_peered":"2024-09-12T01:09:13.411818+0000","last_clean":"2024-09-12T01:09:13.411818+0000","last_became_active":"2024-09-12T00:46:16.261617+0000","last_became_peered":"2024-09-12T00:46:16.261617+0000","last_unstale":"2024-09-12T01:09:13.411818+0000","last_undegraded":"2024-09-12T01:09:13.411818+0000","last_fullsized":"2024-09-12T01:09:13.411818+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:45.217925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.392519+0000","last_change":"2024-09-12T00:44:37.815822+0000","last_active":"2024-09-12T01:08:00.392519+0000","last_peered":"2024-09-12T01:08:00.392519+0000","last_clean":"2024-09-12T01:08:00.392519+0000","last_became_active":"2024-09-12T00:44:37.815325+0000","last_became_peered":"2024-09-12T00:44:37.815325+0000","last_unstale":"2024-09-12T01:08:00.392519+0000","last_undegraded":"2024-09-12T01:08:00.392519+0000","last_fullsized":"2024-09-12T01:08:00.392519+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:41.073259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":218,"num_write":105,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389388+0000","last_change":"2024-09-12T00:56:52.991644+0000","last_active":"2024-09-12T01:08:53.389388+0000","last_peered":"2024-09-12T01:08:53.389388+0000","last_clean":"2024-09-12T01:08:53.389388+0000","last_became_active":"2024-09-12T00:56:52.991358+0000","last_became_peered":"2024-09-12T00:56:52.991358+0000","last_unstale":"2024-09-12T01:08:53.389388+0000","last_undegraded":"2024-09-12T01:08:53.389388+0000","last_fullsized":"2024-09-12T01:08:53.389388+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:23.445118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520059+0000","last_change":"2024-09-12T00:46:19.274308+0000","last_active":"2024-09-12T01:08:08.520059+0000","last_peered":"2024-09-12T01:08:08.520059+0000","last_clean":"2024-09-12T01:08:08.520059+0000","last_became_active":"2024-09-12T00:46:19.274024+0000","last_became_peered":"2024-09-12T00:46:19.274024+0000","last_unstale":"2024-09-12T01:08:08.520059+0000","last_undegraded":"2024-09-12T01:08:08.520059+0000","last_fullsized":"2024-09-12T01:08:08.520059+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.097376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.471438+0000","last_change":"2024-09-12T00:46:16.272503+0000","last_active":"2024-09-12T01:08:02.471438+0000","last_peered":"2024-09-12T01:08:02.471438+0000","last_clean":"2024-09-12T01:08:02.471438+0000","last_became_active":"2024-09-12T00:46:16.272230+0000","last_became_peered":"2024-09-12T00:46:16.272230+0000","last_unstale":"2024-09-12T01:08:02.471438+0000","last_undegraded":"2024-09-12T01:08:02.471438+0000","last_fullsized":"2024-09-12T01:08:02.471438+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:22.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'26","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375307+0000","last_change":"2024-09-12T00:44:37.821557+0000","last_active":"2024-09-12T01:07:07.375307+0000","last_peered":"2024-09-12T01:07:07.375307+0000","last_clean":"2024-09-12T01:07:07.375307+0000","last_became_active":"2024-09-12T00:44:37.821297+0000","last_became_peered":"2024-09-12T00:44:37.821297+0000","last_unstale":"2024-09-12T01:07:07.375307+0000","last_undegraded":"2024-09-12T01:07:07.375307+0000","last_fullsized":"2024-09-12T01:07:07.375307+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.631261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.506633+0000","last_change":"2024-09-12T00:56:52.990792+0000","last_active":"2024-09-12T01:07:17.506633+0000","last_peered":"2024-09-12T01:07:17.506633+0000","last_clean":"2024-09-12T01:07:17.506633+0000","last_became_active":"2024-09-12T00:56:52.990528+0000","last_became_peered":"2024-09-12T00:56:52.990528+0000","last_unstale":"2024-09-12T01:07:17.506633+0000","last_undegraded":"2024-09-12T01:07:17.506633+0000","last_fullsized":"2024-09-12T01:07:17.506633+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:30.175859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'7","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.222506+0000","last_change":"2024-09-12T00:46:19.281162+0000","last_active":"2024-09-12T01:11:23.222506+0000","last_peered":"2024-09-12T01:11:23.222506+0000","last_clean":"2024-09-12T01:11:23.222506+0000","last_became_active":"2024-09-12T00:46:19.280794+0000","last_became_peered":"2024-09-12T00:46:19.280794+0000","last_unstale":"2024-09-12T01:11:23.222506+0000","last_undegraded":"2024-09-12T01:11:23.222506+0000","last_fullsized":"2024-09-12T01:11:23.222506+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:50.182755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":12296,"num_write":7,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.599017+0000","last_change":"2024-09-12T00:46:16.267841+0000","last_active":"2024-09-12T01:08:08.599017+0000","last_peered":"2024-09-12T01:08:08.599017+0000","last_clean":"2024-09-12T01:08:08.599017+0000","last_became_active":"2024-09-12T00:46:16.267528+0000","last_became_peered":"2024-09-12T00:46:16.267528+0000","last_unstale":"2024-09-12T01:08:08.599017+0000","last_undegraded":"2024-09-12T01:08:08.599017+0000","last_fullsized":"2024-09-12T01:08:08.599017+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8204,"num_write":4,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'128","reported_seq":430,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.484992+0000","last_change":"2024-09-12T00:44:37.819828+0000","last_active":"2024-09-12T01:07:11.484992+0000","last_peered":"2024-09-12T01:07:11.484992+0000","last_clean":"2024-09-12T01:07:11.484992+0000","last_became_active":"2024-09-12T00:44:37.819556+0000","last_became_peered":"2024-09-12T00:44:37.819556+0000","last_unstale":"2024-09-12T01:07:11.484992+0000","last_undegraded":"2024-09-12T01:07:11.484992+0000","last_fullsized":"2024-09-12T01:07:11.484992+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:37.132092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":767,"num_read_kb":571,"num_write":157,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.482640+0000","last_change":"2024-09-12T00:56:52.992341+0000","last_active":"2024-09-12T01:06:56.482640+0000","last_peered":"2024-09-12T01:06:56.482640+0000","last_clean":"2024-09-12T01:06:56.482640+0000","last_became_active":"2024-09-12T00:56:52.992081+0000","last_became_peered":"2024-09-12T00:56:52.992081+0000","last_unstale":"2024-09-12T01:06:56.482640+0000","last_undegraded":"2024-09-12T01:06:56.482640+0000","last_fullsized":"2024-09-12T01:06:56.482640+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:38.856681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'6","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:51.498160+0000","last_change":"2024-09-12T00:46:19.280066+0000","last_active":"2024-09-12T01:08:51.498160+0000","last_peered":"2024-09-12T01:08:51.498160+0000","last_clean":"2024-09-12T01:08:51.498160+0000","last_became_active":"2024-09-12T00:46:19.279811+0000","last_became_peered":"2024-09-12T00:46:19.279811+0000","last_unstale":"2024-09-12T01:08:51.498160+0000","last_undegraded":"2024-09-12T01:08:51.498160+0000","last_fullsized":"2024-09-12T01:08:51.498160+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.923506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":13308,"num_write":11,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'4","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.524972+0000","last_change":"2024-09-12T00:46:16.274833+0000","last_active":"2024-09-12T01:08:48.524972+0000","last_peered":"2024-09-12T01:08:48.524972+0000","last_clean":"2024-09-12T01:08:48.524972+0000","last_became_active":"2024-09-12T00:46:16.274541+0000","last_became_peered":"2024-09-12T00:46:16.274541+0000","last_unstale":"2024-09-12T01:08:48.524972+0000","last_undegraded":"2024-09-12T01:08:48.524972+0000","last_fullsized":"2024-09-12T01:08:48.524972+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:58.251023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'13","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388468+0000","last_change":"2024-09-12T00:44:37.817411+0000","last_active":"2024-09-12T01:08:48.388468+0000","last_peered":"2024-09-12T01:08:48.388468+0000","last_clean":"2024-09-12T01:08:48.388468+0000","last_became_active":"2024-09-12T00:44:37.817108+0000","last_became_peered":"2024-09-12T00:44:37.817108+0000","last_unstale":"2024-09-12T01:08:48.388468+0000","last_undegraded":"2024-09-12T01:08:48.388468+0000","last_fullsized":"2024-09-12T01:08:48.388468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:45.282350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509925+0000","last_change":"2024-09-12T00:56:52.989648+0000","last_active":"2024-09-12T01:06:53.509925+0000","last_peered":"2024-09-12T01:06:53.509925+0000","last_clean":"2024-09-12T01:06:53.509925+0000","last_became_active":"2024-09-12T00:56:52.989394+0000","last_became_peered":"2024-09-12T00:56:52.989394+0000","last_unstale":"2024-09-12T01:06:53.509925+0000","last_undegraded":"2024-09-12T01:06:53.509925+0000","last_fullsized":"2024-09-12T01:06:53.509925+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:17.324226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389271+0000","last_change":"2024-09-12T00:46:19.282381+0000","last_active":"2024-09-12T01:08:53.389271+0000","last_peered":"2024-09-12T01:08:53.389271+0000","last_clean":"2024-09-12T01:08:53.389271+0000","last_became_active":"2024-09-12T00:46:19.280878+0000","last_became_peered":"2024-09-12T00:46:19.280878+0000","last_unstale":"2024-09-12T01:08:53.389271+0000","last_undegraded":"2024-09-12T01:08:53.389271+0000","last_fullsized":"2024-09-12T01:08:53.389271+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:37.733061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10236,"num_write":10,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'1","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389440+0000","last_change":"2024-09-12T00:46:16.278285+0000","last_active":"2024-09-12T01:08:47.389440+0000","last_peered":"2024-09-12T01:08:47.389440+0000","last_clean":"2024-09-12T01:08:47.389440+0000","last_became_active":"2024-09-12T00:46:16.277776+0000","last_became_peered":"2024-09-12T00:46:16.277776+0000","last_unstale":"2024-09-12T01:08:47.389440+0000","last_undegraded":"2024-09-12T01:08:47.389440+0000","last_fullsized":"2024-09-12T01:08:47.389440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:47.993297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'18","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389367+0000","last_change":"2024-09-12T00:44:37.816393+0000","last_active":"2024-09-12T01:08:47.389367+0000","last_peered":"2024-09-12T01:08:47.389367+0000","last_clean":"2024-09-12T01:08:47.389367+0000","last_became_active":"2024-09-12T00:44:37.815820+0000","last_became_peered":"2024-09-12T00:44:37.815820+0000","last_unstale":"2024-09-12T01:08:47.389367+0000","last_undegraded":"2024-09-12T01:08:47.389367+0000","last_fullsized":"2024-09-12T01:08:47.389367+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:49.470552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.475979+0000","last_change":"2024-09-12T00:56:52.996102+0000","last_active":"2024-09-12T01:08:32.475979+0000","last_peered":"2024-09-12T01:08:32.475979+0000","last_clean":"2024-09-12T01:08:32.475979+0000","last_became_active":"2024-09-12T00:56:52.995696+0000","last_became_peered":"2024-09-12T00:56:52.995696+0000","last_unstale":"2024-09-12T01:08:32.475979+0000","last_undegraded":"2024-09-12T01:08:32.475979+0000","last_fullsized":"2024-09-12T01:08:32.475979+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:57.634150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383372+0000","last_change":"2024-09-12T00:46:19.282715+0000","last_active":"2024-09-12T01:08:08.383372+0000","last_peered":"2024-09-12T01:08:08.383372+0000","last_clean":"2024-09-12T01:08:08.383372+0000","last_became_active":"2024-09-12T00:46:19.282466+0000","last_became_peered":"2024-09-12T00:46:19.282466+0000","last_unstale":"2024-09-12T01:08:08.383372+0000","last_undegraded":"2024-09-12T01:08:08.383372+0000","last_fullsized":"2024-09-12T01:08:08.383372+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.083481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.612173+0000","last_change":"2024-09-12T00:46:16.268948+0000","last_active":"2024-09-12T01:09:43.612173+0000","last_peered":"2024-09-12T01:09:43.612173+0000","last_clean":"2024-09-12T01:09:43.612173+0000","last_became_active":"2024-09-12T00:46:16.268479+0000","last_became_peered":"2024-09-12T00:46:16.268479+0000","last_unstale":"2024-09-12T01:09:43.612173+0000","last_undegraded":"2024-09-12T01:09:43.612173+0000","last_fullsized":"2024-09-12T01:09:43.612173+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:29.450733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519282+0000","last_change":"2024-09-12T00:44:37.811999+0000","last_active":"2024-09-12T01:08:47.519282+0000","last_peered":"2024-09-12T01:08:47.519282+0000","last_clean":"2024-09-12T01:08:47.519282+0000","last_became_active":"2024-09-12T00:44:37.811697+0000","last_became_peered":"2024-09-12T00:44:37.811697+0000","last_unstale":"2024-09-12T01:08:47.519282+0000","last_undegraded":"2024-09-12T01:08:47.519282+0000","last_fullsized":"2024-09-12T01:08:47.519282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:46.654992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":57,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.387544+0000","last_change":"2024-09-12T00:56:52.985166+0000","last_active":"2024-09-12T01:08:32.387544+0000","last_peered":"2024-09-12T01:08:32.387544+0000","last_clean":"2024-09-12T01:08:32.387544+0000","last_became_active":"2024-09-12T00:56:52.984878+0000","last_became_peered":"2024-09-12T00:56:52.984878+0000","last_unstale":"2024-09-12T01:08:32.387544+0000","last_undegraded":"2024-09-12T01:08:32.387544+0000","last_fullsized":"2024-09-12T01:08:32.387544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.409540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.466660+0000","last_change":"2024-09-12T00:46:19.276813+0000","last_active":"2024-09-12T01:07:27.466660+0000","last_peered":"2024-09-12T01:07:27.466660+0000","last_clean":"2024-09-12T01:07:27.466660+0000","last_became_active":"2024-09-12T00:46:19.276197+0000","last_became_peered":"2024-09-12T00:46:19.276197+0000","last_unstale":"2024-09-12T01:07:27.466660+0000","last_undegraded":"2024-09-12T01:07:27.466660+0000","last_fullsized":"2024-09-12T01:07:27.466660+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:53.182491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'7","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519377+0000","last_change":"2024-09-12T00:46:16.264295+0000","last_active":"2024-09-12T01:08:03.519377+0000","last_peered":"2024-09-12T01:08:03.519377+0000","last_clean":"2024-09-12T01:08:03.519377+0000","last_became_active":"2024-09-12T00:46:16.263870+0000","last_became_peered":"2024-09-12T00:46:16.263870+0000","last_unstale":"2024-09-12T01:08:03.519377+0000","last_undegraded":"2024-09-12T01:08:03.519377+0000","last_fullsized":"2024-09-12T01:08:03.519377+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:24.692637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":17,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'37","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519258+0000","last_change":"2024-09-12T00:44:37.820673+0000","last_active":"2024-09-12T01:08:47.519258+0000","last_peered":"2024-09-12T01:08:47.519258+0000","last_clean":"2024-09-12T01:08:47.519258+0000","last_became_active":"2024-09-12T00:44:37.820232+0000","last_became_peered":"2024-09-12T00:44:37.820232+0000","last_unstale":"2024-09-12T01:08:47.519258+0000","last_undegraded":"2024-09-12T01:08:47.519258+0000","last_fullsized":"2024-09-12T01:08:47.519258+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.688623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496180+0000","last_change":"2024-09-12T00:56:52.987731+0000","last_active":"2024-09-12T01:08:36.496180+0000","last_peered":"2024-09-12T01:08:36.496180+0000","last_clean":"2024-09-12T01:08:36.496180+0000","last_became_active":"2024-09-12T00:56:52.987492+0000","last_became_peered":"2024-09-12T00:56:52.987492+0000","last_unstale":"2024-09-12T01:08:36.496180+0000","last_undegraded":"2024-09-12T01:08:36.496180+0000","last_fullsized":"2024-09-12T01:08:36.496180+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.155360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'9","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383413+0000","last_change":"2024-09-12T00:46:19.287908+0000","last_active":"2024-09-12T01:08:08.383413+0000","last_peered":"2024-09-12T01:08:08.383413+0000","last_clean":"2024-09-12T01:08:08.383413+0000","last_became_active":"2024-09-12T00:46:19.286860+0000","last_became_peered":"2024-09-12T00:46:19.286860+0000","last_unstale":"2024-09-12T01:08:08.383413+0000","last_undegraded":"2024-09-12T01:08:08.383413+0000","last_fullsized":"2024-09-12T01:08:08.383413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:54.927557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13316,"num_write":14,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.382795+0000","last_change":"2024-09-12T00:46:16.279497+0000","last_active":"2024-09-12T01:08:03.382795+0000","last_peered":"2024-09-12T01:08:03.382795+0000","last_clean":"2024-09-12T01:08:03.382795+0000","last_became_active":"2024-09-12T00:46:16.279114+0000","last_became_peered":"2024-09-12T00:46:16.279114+0000","last_unstale":"2024-09-12T01:08:03.382795+0000","last_undegraded":"2024-09-12T01:08:03.382795+0000","last_fullsized":"2024-09-12T01:08:03.382795+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:42.826584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":2,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'25","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388537+0000","last_change":"2024-09-12T00:44:37.819571+0000","last_active":"2024-09-12T01:08:48.388537+0000","last_peered":"2024-09-12T01:08:48.388537+0000","last_clean":"2024-09-12T01:08:48.388537+0000","last_became_active":"2024-09-12T00:44:37.819153+0000","last_became_peered":"2024-09-12T00:44:37.819153+0000","last_unstale":"2024-09-12T01:08:48.388537+0000","last_undegraded":"2024-09-12T01:08:48.388537+0000","last_fullsized":"2024-09-12T01:08:48.388537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:27.117588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":89,"num_write":41,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.523138+0000","last_change":"2024-09-12T00:56:52.990539+0000","last_active":"2024-09-12T01:08:33.523138+0000","last_peered":"2024-09-12T01:08:33.523138+0000","last_clean":"2024-09-12T01:08:33.523138+0000","last_became_active":"2024-09-12T00:56:52.990265+0000","last_became_peered":"2024-09-12T00:56:52.990265+0000","last_unstale":"2024-09-12T01:08:33.523138+0000","last_undegraded":"2024-09-12T01:08:33.523138+0000","last_fullsized":"2024-09-12T01:08:33.523138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:41.315107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519397+0000","last_change":"2024-09-12T00:46:19.277307+0000","last_active":"2024-09-12T01:08:03.519397+0000","last_peered":"2024-09-12T01:08:03.519397+0000","last_clean":"2024-09-12T01:08:03.519397+0000","last_became_active":"2024-09-12T00:46:19.277011+0000","last_became_peered":"2024-09-12T00:46:19.277011+0000","last_unstale":"2024-09-12T01:08:03.519397+0000","last_undegraded":"2024-09-12T01:08:03.519397+0000","last_fullsized":"2024-09-12T01:08:03.519397+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:43.590749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.471543+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:08:02.471543+0000","last_peered":"2024-09-12T01:08:02.471543+0000","last_clean":"2024-09-12T01:08:02.471543+0000","last_became_active":"2024-09-12T00:46:16.275403+0000","last_became_peered":"2024-09-12T00:46:16.275403+0000","last_unstale":"2024-09-12T01:08:02.471543+0000","last_undegraded":"2024-09-12T01:08:02.471543+0000","last_fullsized":"2024-09-12T01:08:02.471543+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.331770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202496,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5128,"num_write":2,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"264'68","reported_seq":266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.598342+0000","last_change":"2024-09-12T00:44:37.821656+0000","last_active":"2024-09-12T01:08:03.598342+0000","last_peered":"2024-09-12T01:08:03.598342+0000","last_clean":"2024-09-12T01:08:03.598342+0000","last_became_active":"2024-09-12T00:44:37.821192+0000","last_became_peered":"2024-09-12T00:44:37.821192+0000","last_unstale":"2024-09-12T01:08:03.598342+0000","last_undegraded":"2024-09-12T01:08:03.598342+0000","last_fullsized":"2024-09-12T01:08:03.598342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:14.342220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":323,"num_write":87,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479794+0000","last_change":"2024-09-12T00:56:52.995841+0000","last_active":"2024-09-12T01:08:57.479794+0000","last_peered":"2024-09-12T01:08:57.479794+0000","last_clean":"2024-09-12T01:08:57.479794+0000","last_became_active":"2024-09-12T00:56:52.995495+0000","last_became_peered":"2024-09-12T00:56:52.995495+0000","last_unstale":"2024-09-12T01:08:57.479794+0000","last_undegraded":"2024-09-12T01:08:57.479794+0000","last_fullsized":"2024-09-12T01:08:57.479794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:07.859390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:22.465900+0000","last_change":"2024-09-12T00:46:19.280925+0000","last_active":"2024-09-12T01:07:22.465900+0000","last_peered":"2024-09-12T01:07:22.465900+0000","last_clean":"2024-09-12T01:07:22.465900+0000","last_became_active":"2024-09-12T00:46:19.280653+0000","last_became_peered":"2024-09-12T00:46:19.280653+0000","last_unstale":"2024-09-12T01:07:22.465900+0000","last_undegraded":"2024-09-12T01:07:22.465900+0000","last_fullsized":"2024-09-12T01:07:22.465900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:20.246986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10256,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"261'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396139+0000","last_change":"2024-09-12T00:46:16.270257+0000","last_active":"2024-09-12T01:07:18.396139+0000","last_peered":"2024-09-12T01:07:18.396139+0000","last_clean":"2024-09-12T01:07:18.396139+0000","last_became_active":"2024-09-12T00:46:16.270004+0000","last_became_peered":"2024-09-12T00:46:16.270004+0000","last_unstale":"2024-09-12T01:07:18.396139+0000","last_undegraded":"2024-09-12T01:07:18.396139+0000","last_fullsized":"2024-09-12T01:07:18.396139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:08.342727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'15","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.597733+0000","last_change":"2024-09-12T00:44:37.820954+0000","last_active":"2024-09-12T01:07:58.597733+0000","last_peered":"2024-09-12T01:07:58.597733+0000","last_clean":"2024-09-12T01:07:58.597733+0000","last_became_active":"2024-09-12T00:44:37.820639+0000","last_became_peered":"2024-09-12T00:44:37.820639+0000","last_unstale":"2024-09-12T01:07:58.597733+0000","last_undegraded":"2024-09-12T01:07:58.597733+0000","last_fullsized":"2024-09-12T01:07:58.597733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:51.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391071+0000","last_change":"2024-09-12T00:56:52.991542+0000","last_active":"2024-09-12T01:08:57.391071+0000","last_peered":"2024-09-12T01:08:57.391071+0000","last_clean":"2024-09-12T01:08:57.391071+0000","last_became_active":"2024-09-12T00:56:52.991261+0000","last_became_peered":"2024-09-12T00:56:52.991261+0000","last_unstale":"2024-09-12T01:08:57.391071+0000","last_undegraded":"2024-09-12T01:08:57.391071+0000","last_fullsized":"2024-09-12T01:08:57.391071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:08.574079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:22.465859+0000","last_change":"2024-09-12T00:46:19.282895+0000","last_active":"2024-09-12T01:07:22.465859+0000","last_peered":"2024-09-12T01:07:22.465859+0000","last_clean":"2024-09-12T01:07:22.465859+0000","last_became_active":"2024-09-12T00:46:19.281676+0000","last_became_peered":"2024-09-12T00:46:19.281676+0000","last_unstale":"2024-09-12T01:07:22.465859+0000","last_undegraded":"2024-09-12T01:07:22.465859+0000","last_fullsized":"2024-09-12T01:07:22.465859+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.550417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465156+0000","last_change":"2024-09-12T00:46:16.276429+0000","last_active":"2024-09-12T01:07:17.465156+0000","last_peered":"2024-09-12T01:07:17.465156+0000","last_clean":"2024-09-12T01:07:17.465156+0000","last_became_active":"2024-09-12T00:46:16.276180+0000","last_became_peered":"2024-09-12T00:46:16.276180+0000","last_unstale":"2024-09-12T01:07:17.465156+0000","last_undegraded":"2024-09-12T01:07:17.465156+0000","last_fullsized":"2024-09-12T01:07:17.465156+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:48.188004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382200+0000","last_change":"2024-09-12T00:44:37.820502+0000","last_active":"2024-09-12T01:07:58.382200+0000","last_peered":"2024-09-12T01:07:58.382200+0000","last_clean":"2024-09-12T01:07:58.382200+0000","last_became_active":"2024-09-12T00:44:37.820217+0000","last_became_peered":"2024-09-12T00:44:37.820217+0000","last_unstale":"2024-09-12T01:07:58.382200+0000","last_undegraded":"2024-09-12T01:07:58.382200+0000","last_fullsized":"2024-09-12T01:07:58.382200+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.838632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":127,"num_write":61,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.517081+0000","last_change":"2024-09-12T00:56:52.989385+0000","last_active":"2024-09-12T01:08:32.517081+0000","last_peered":"2024-09-12T01:08:32.517081+0000","last_clean":"2024-09-12T01:08:32.517081+0000","last_became_active":"2024-09-12T00:56:52.988302+0000","last_became_peered":"2024-09-12T00:56:52.988302+0000","last_unstale":"2024-09-12T01:08:32.517081+0000","last_undegraded":"2024-09-12T01:08:32.517081+0000","last_fullsized":"2024-09-12T01:08:32.517081+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:40.813037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'7","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.377182+0000","last_change":"2024-09-12T00:46:19.285378+0000","last_active":"2024-09-12T01:07:23.377182+0000","last_peered":"2024-09-12T01:07:23.377182+0000","last_clean":"2024-09-12T01:07:23.377182+0000","last_became_active":"2024-09-12T00:46:19.280889+0000","last_became_peered":"2024-09-12T00:46:19.280889+0000","last_unstale":"2024-09-12T01:07:23.377182+0000","last_undegraded":"2024-09-12T01:07:23.377182+0000","last_fullsized":"2024-09-12T01:07:23.377182+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:56.282208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7182,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396190+0000","last_change":"2024-09-12T00:46:16.263413+0000","last_active":"2024-09-12T01:07:18.396190+0000","last_peered":"2024-09-12T01:07:18.396190+0000","last_clean":"2024-09-12T01:07:18.396190+0000","last_became_active":"2024-09-12T00:46:16.263065+0000","last_became_peered":"2024-09-12T00:46:16.263065+0000","last_unstale":"2024-09-12T01:07:18.396190+0000","last_undegraded":"2024-09-12T01:07:18.396190+0000","last_fullsized":"2024-09-12T01:07:18.396190+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:23.322080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.491664+0000","last_change":"2024-09-12T00:44:37.814881+0000","last_active":"2024-09-12T01:08:01.491664+0000","last_peered":"2024-09-12T01:08:01.491664+0000","last_clean":"2024-09-12T01:08:01.491664+0000","last_became_active":"2024-09-12T00:44:37.814584+0000","last_became_peered":"2024-09-12T00:44:37.814584+0000","last_unstale":"2024-09-12T01:08:01.491664+0000","last_undegraded":"2024-09-12T01:08:01.491664+0000","last_fullsized":"2024-09-12T01:08:01.491664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:18.206072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391027+0000","last_change":"2024-09-12T00:56:52.991853+0000","last_active":"2024-09-12T01:08:57.391027+0000","last_peered":"2024-09-12T01:08:57.391027+0000","last_clean":"2024-09-12T01:08:57.391027+0000","last_became_active":"2024-09-12T00:56:52.990830+0000","last_became_peered":"2024-09-12T00:56:52.990830+0000","last_unstale":"2024-09-12T01:08:57.391027+0000","last_undegraded":"2024-09-12T01:08:57.391027+0000","last_fullsized":"2024-09-12T01:08:57.391027+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:49.621390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'10","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.611466+0000","last_change":"2024-09-12T00:46:19.285059+0000","last_active":"2024-09-12T01:09:38.611466+0000","last_peered":"2024-09-12T01:09:38.611466+0000","last_clean":"2024-09-12T01:09:38.611466+0000","last_became_active":"2024-09-12T00:46:19.284748+0000","last_became_peered":"2024-09-12T00:46:19.284748+0000","last_unstale":"2024-09-12T01:09:38.611466+0000","last_undegraded":"2024-09-12T01:09:38.611466+0000","last_fullsized":"2024-09-12T01:09:38.611466+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:39.933756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8194,"num_write":15,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"261'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396223+0000","last_change":"2024-09-12T00:46:16.274496+0000","last_active":"2024-09-12T01:07:18.396223+0000","last_peered":"2024-09-12T01:07:18.396223+0000","last_clean":"2024-09-12T01:07:18.396223+0000","last_became_active":"2024-09-12T00:46:16.274209+0000","last_became_peered":"2024-09-12T00:46:16.274209+0000","last_unstale":"2024-09-12T01:07:18.396223+0000","last_undegraded":"2024-09-12T01:07:18.396223+0000","last_fullsized":"2024-09-12T01:07:18.396223+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:33.536444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":10,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382153+0000","last_change":"2024-09-12T00:44:37.819591+0000","last_active":"2024-09-12T01:07:58.382153+0000","last_peered":"2024-09-12T01:07:58.382153+0000","last_clean":"2024-09-12T01:07:58.382153+0000","last_became_active":"2024-09-12T00:44:37.819298+0000","last_became_peered":"2024-09-12T00:44:37.819298+0000","last_unstale":"2024-09-12T01:07:58.382153+0000","last_undegraded":"2024-09-12T01:07:58.382153+0000","last_fullsized":"2024-09-12T01:07:58.382153+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:00.112592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.469348+0000","last_change":"2024-09-12T00:56:52.996314+0000","last_active":"2024-09-12T01:07:47.469348+0000","last_peered":"2024-09-12T01:07:47.469348+0000","last_clean":"2024-09-12T01:07:47.469348+0000","last_became_active":"2024-09-12T00:56:52.996048+0000","last_became_peered":"2024-09-12T00:56:52.996048+0000","last_unstale":"2024-09-12T01:07:47.469348+0000","last_undegraded":"2024-09-12T01:07:47.469348+0000","last_fullsized":"2024-09-12T01:07:47.469348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.954796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.408810+0000","last_change":"2024-09-12T00:46:19.286025+0000","last_active":"2024-09-12T01:11:08.408810+0000","last_peered":"2024-09-12T01:11:08.408810+0000","last_clean":"2024-09-12T01:11:08.408810+0000","last_became_active":"2024-09-12T00:46:19.285304+0000","last_became_peered":"2024-09-12T00:46:19.285304+0000","last_unstale":"2024-09-12T01:11:08.408810+0000","last_undegraded":"2024-09-12T01:11:08.408810+0000","last_fullsized":"2024-09-12T01:11:08.408810+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:59.248323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2428,"num_write":3,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.497525+0000","last_change":"2024-09-12T00:46:16.272142+0000","last_active":"2024-09-12T01:08:46.497525+0000","last_peered":"2024-09-12T01:08:46.497525+0000","last_clean":"2024-09-12T01:08:46.497525+0000","last_became_active":"2024-09-12T00:46:16.271839+0000","last_became_peered":"2024-09-12T00:46:16.271839+0000","last_unstale":"2024-09-12T01:08:46.497525+0000","last_undegraded":"2024-09-12T01:08:46.497525+0000","last_fullsized":"2024-09-12T01:08:46.497525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:04.288299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"264'41","reported_seq":151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.650570+0000","last_change":"2024-09-12T00:44:37.822164+0000","last_active":"2024-09-12T01:08:56.650570+0000","last_peered":"2024-09-12T01:08:56.650570+0000","last_clean":"2024-09-12T01:08:56.650570+0000","last_became_active":"2024-09-12T00:44:37.821837+0000","last_became_peered":"2024-09-12T00:44:37.821837+0000","last_unstale":"2024-09-12T01:08:56.650570+0000","last_undegraded":"2024-09-12T01:08:56.650570+0000","last_fullsized":"2024-09-12T01:08:56.650570+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:59.825047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":140,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403198+0000","last_change":"2024-09-12T00:56:52.996477+0000","last_active":"2024-09-12T01:08:08.403198+0000","last_peered":"2024-09-12T01:08:08.403198+0000","last_clean":"2024-09-12T01:08:08.403198+0000","last_became_active":"2024-09-12T00:56:52.996287+0000","last_became_peered":"2024-09-12T00:56:52.996287+0000","last_unstale":"2024-09-12T01:08:08.403198+0000","last_undegraded":"2024-09-12T01:08:08.403198+0000","last_fullsized":"2024-09-12T01:08:08.403198+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:34.040673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389308+0000","last_change":"2024-09-12T00:46:19.284780+0000","last_active":"2024-09-12T01:08:53.389308+0000","last_peered":"2024-09-12T01:08:53.389308+0000","last_clean":"2024-09-12T01:08:53.389308+0000","last_became_active":"2024-09-12T00:46:19.284490+0000","last_became_peered":"2024-09-12T00:46:19.284490+0000","last_unstale":"2024-09-12T01:08:53.389308+0000","last_undegraded":"2024-09-12T01:08:53.389308+0000","last_fullsized":"2024-09-12T01:08:53.389308+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.303903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"264'9","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389475+0000","last_change":"2024-09-12T00:46:16.275634+0000","last_active":"2024-09-12T01:08:47.389475+0000","last_peered":"2024-09-12T01:08:47.389475+0000","last_clean":"2024-09-12T01:08:47.389475+0000","last_became_active":"2024-09-12T00:46:16.275312+0000","last_became_peered":"2024-09-12T00:46:16.275312+0000","last_unstale":"2024-09-12T01:08:47.389475+0000","last_undegraded":"2024-09-12T01:08:47.389475+0000","last_fullsized":"2024-09-12T01:08:47.389475+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.528193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20478,"num_write":19,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'42","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590315+0000","last_change":"2024-09-12T00:44:37.819546+0000","last_active":"2024-09-12T01:07:08.590315+0000","last_peered":"2024-09-12T01:07:08.590315+0000","last_clean":"2024-09-12T01:07:08.590315+0000","last_became_active":"2024-09-12T00:44:37.819289+0000","last_became_peered":"2024-09-12T00:44:37.819289+0000","last_unstale":"2024-09-12T01:07:08.590315+0000","last_undegraded":"2024-09-12T01:07:08.590315+0000","last_fullsized":"2024-09-12T01:07:08.590315+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:38.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":167,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.595680+0000","last_change":"2024-09-12T00:56:52.987494+0000","last_active":"2024-09-12T01:07:43.595680+0000","last_peered":"2024-09-12T01:07:43.595680+0000","last_clean":"2024-09-12T01:07:43.595680+0000","last_became_active":"2024-09-12T00:56:52.987226+0000","last_became_peered":"2024-09-12T00:56:52.987226+0000","last_unstale":"2024-09-12T01:07:43.595680+0000","last_undegraded":"2024-09-12T01:07:43.595680+0000","last_fullsized":"2024-09-12T01:07:43.595680+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:25.549274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389413+0000","last_change":"2024-09-12T00:46:19.287340+0000","last_active":"2024-09-12T01:08:53.389413+0000","last_peered":"2024-09-12T01:08:53.389413+0000","last_clean":"2024-09-12T01:08:53.389413+0000","last_became_active":"2024-09-12T00:46:19.287067+0000","last_became_peered":"2024-09-12T00:46:19.287067+0000","last_unstale":"2024-09-12T01:08:53.389413+0000","last_undegraded":"2024-09-12T01:08:53.389413+0000","last_fullsized":"2024-09-12T01:08:53.389413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.086451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641131,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2174,"num_write":2,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:03.408116+0000","last_change":"2024-09-12T00:46:16.278474+0000","last_active":"2024-09-12T01:11:03.408116+0000","last_peered":"2024-09-12T01:11:03.408116+0000","last_clean":"2024-09-12T01:11:03.408116+0000","last_became_active":"2024-09-12T00:46:16.278205+0000","last_became_peered":"2024-09-12T00:46:16.278205+0000","last_unstale":"2024-09-12T01:11:03.408116+0000","last_undegraded":"2024-09-12T01:11:03.408116+0000","last_fullsized":"2024-09-12T01:11:03.408116+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:45.398336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'62","reported_seq":211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.997717+0000","last_change":"2024-09-12T00:44:37.811854+0000","last_active":"2024-09-12T01:08:52.997717+0000","last_peered":"2024-09-12T01:08:52.997717+0000","last_clean":"2024-09-12T01:08:52.997717+0000","last_became_active":"2024-09-12T00:44:37.811544+0000","last_became_peered":"2024-09-12T00:44:37.811544+0000","last_unstale":"2024-09-12T01:08:52.997717+0000","last_undegraded":"2024-09-12T01:08:52.997717+0000","last_fullsized":"2024-09-12T01:08:52.997717+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:05.666736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":232,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.399787+0000","last_change":"2024-09-12T00:56:52.989633+0000","last_active":"2024-09-12T01:07:43.399787+0000","last_peered":"2024-09-12T01:07:43.399787+0000","last_clean":"2024-09-12T01:07:43.399787+0000","last_became_active":"2024-09-12T00:56:52.988985+0000","last_became_peered":"2024-09-12T00:56:52.988985+0000","last_unstale":"2024-09-12T01:07:43.399787+0000","last_undegraded":"2024-09-12T01:07:43.399787+0000","last_fullsized":"2024-09-12T01:07:43.399787+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:47.578076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'10","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479160+0000","last_change":"2024-09-12T00:46:19.279808+0000","last_active":"2024-09-12T01:08:52.479160+0000","last_peered":"2024-09-12T01:08:52.479160+0000","last_clean":"2024-09-12T01:08:52.479160+0000","last_became_active":"2024-09-12T00:46:19.279527+0000","last_became_peered":"2024-09-12T00:46:19.279527+0000","last_unstale":"2024-09-12T01:08:52.479160+0000","last_undegraded":"2024-09-12T01:08:52.479160+0000","last_fullsized":"2024-09-12T01:08:52.479160+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:07.362005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8190,"num_write":20,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388598+0000","last_change":"2024-09-12T00:46:16.273882+0000","last_active":"2024-09-12T01:08:48.388598+0000","last_peered":"2024-09-12T01:08:48.388598+0000","last_clean":"2024-09-12T01:08:48.388598+0000","last_became_active":"2024-09-12T00:46:16.273598+0000","last_became_peered":"2024-09-12T00:46:16.273598+0000","last_unstale":"2024-09-12T01:08:48.388598+0000","last_undegraded":"2024-09-12T01:08:48.388598+0000","last_fullsized":"2024-09-12T01:08:48.388598+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:16.097567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'41","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.165530+0000","last_change":"2024-09-12T00:44:37.813325+0000","last_active":"2024-09-12T01:08:57.165530+0000","last_peered":"2024-09-12T01:08:57.165530+0000","last_clean":"2024-09-12T01:08:57.165530+0000","last_became_active":"2024-09-12T00:44:37.813081+0000","last_became_peered":"2024-09-12T00:44:37.813081+0000","last_unstale":"2024-09-12T01:08:57.165530+0000","last_undegraded":"2024-09-12T01:08:57.165530+0000","last_fullsized":"2024-09-12T01:08:57.165530+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:39.795060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":146,"num_write":78,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.472330+0000","last_change":"2024-09-12T00:56:52.995736+0000","last_active":"2024-09-12T01:08:07.472330+0000","last_peered":"2024-09-12T01:08:07.472330+0000","last_clean":"2024-09-12T01:08:07.472330+0000","last_became_active":"2024-09-12T00:56:52.995412+0000","last_became_peered":"2024-09-12T00:56:52.995412+0000","last_unstale":"2024-09-12T01:08:07.472330+0000","last_undegraded":"2024-09-12T01:08:07.472330+0000","last_fullsized":"2024-09-12T01:08:07.472330+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:15.173930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.597690+0000","last_change":"2024-09-12T00:46:19.283005+0000","last_active":"2024-09-12T01:07:58.597690+0000","last_peered":"2024-09-12T01:07:58.597690+0000","last_clean":"2024-09-12T01:07:58.597690+0000","last_became_active":"2024-09-12T00:46:19.282672+0000","last_became_peered":"2024-09-12T00:46:19.282672+0000","last_unstale":"2024-09-12T01:07:58.597690+0000","last_undegraded":"2024-09-12T01:07:58.597690+0000","last_fullsized":"2024-09-12T01:07:58.597690+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:25.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'8","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.400080+0000","last_change":"2024-09-12T00:46:16.266194+0000","last_active":"2024-09-12T01:10:08.400080+0000","last_peered":"2024-09-12T01:10:08.400080+0000","last_clean":"2024-09-12T01:10:08.400080+0000","last_became_active":"2024-09-12T00:46:16.265927+0000","last_became_peered":"2024-09-12T00:46:16.265927+0000","last_unstale":"2024-09-12T01:10:08.400080+0000","last_undegraded":"2024-09-12T01:10:08.400080+0000","last_fullsized":"2024-09-12T01:10:08.400080+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:30.967366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'26","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375318+0000","last_change":"2024-09-12T00:44:37.820836+0000","last_active":"2024-09-12T01:07:07.375318+0000","last_peered":"2024-09-12T01:07:07.375318+0000","last_clean":"2024-09-12T01:07:07.375318+0000","last_became_active":"2024-09-12T00:44:37.820584+0000","last_became_peered":"2024-09-12T00:44:37.820584+0000","last_unstale":"2024-09-12T01:07:07.375318+0000","last_undegraded":"2024-09-12T01:07:07.375318+0000","last_fullsized":"2024-09-12T01:07:07.375318+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:59.394929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.493580+0000","last_change":"2024-09-12T00:56:52.994371+0000","last_active":"2024-09-12T01:08:16.493580+0000","last_peered":"2024-09-12T01:08:16.493580+0000","last_clean":"2024-09-12T01:08:16.493580+0000","last_became_active":"2024-09-12T00:56:52.994132+0000","last_became_peered":"2024-09-12T00:56:52.994132+0000","last_unstale":"2024-09-12T01:08:16.493580+0000","last_undegraded":"2024-09-12T01:08:16.493580+0000","last_fullsized":"2024-09-12T01:08:16.493580+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:57.349446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.491642+0000","last_change":"2024-09-12T00:46:19.281067+0000","last_active":"2024-09-12T01:08:01.491642+0000","last_peered":"2024-09-12T01:08:01.491642+0000","last_clean":"2024-09-12T01:08:01.491642+0000","last_became_active":"2024-09-12T00:46:19.280726+0000","last_became_peered":"2024-09-12T00:46:19.280726+0000","last_unstale":"2024-09-12T01:08:01.491642+0000","last_undegraded":"2024-09-12T01:08:01.491642+0000","last_fullsized":"2024-09-12T01:08:01.491642+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:00.902460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202496,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5128,"num_write":8,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.470726+0000","last_change":"2024-09-12T00:46:16.276183+0000","last_active":"2024-09-12T01:07:57.470726+0000","last_peered":"2024-09-12T01:07:57.470726+0000","last_clean":"2024-09-12T01:07:57.470726+0000","last_became_active":"2024-09-12T00:46:16.275908+0000","last_became_peered":"2024-09-12T00:46:16.275908+0000","last_unstale":"2024-09-12T01:07:57.470726+0000","last_undegraded":"2024-09-12T01:07:57.470726+0000","last_fullsized":"2024-09-12T01:07:57.470726+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:52.232454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496227+0000","last_change":"2024-09-12T00:44:37.812084+0000","last_active":"2024-09-12T01:08:36.496227+0000","last_peered":"2024-09-12T01:08:36.496227+0000","last_clean":"2024-09-12T01:08:36.496227+0000","last_became_active":"2024-09-12T00:44:37.811613+0000","last_became_peered":"2024-09-12T00:44:37.811613+0000","last_unstale":"2024-09-12T01:08:36.496227+0000","last_undegraded":"2024-09-12T01:08:36.496227+0000","last_fullsized":"2024-09-12T01:08:36.496227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:51.317906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520108+0000","last_change":"2024-09-12T00:56:52.989823+0000","last_active":"2024-09-12T01:08:08.520108+0000","last_peered":"2024-09-12T01:08:08.520108+0000","last_clean":"2024-09-12T01:08:08.520108+0000","last_became_active":"2024-09-12T00:56:52.989552+0000","last_became_peered":"2024-09-12T00:56:52.989552+0000","last_unstale":"2024-09-12T01:08:08.520108+0000","last_undegraded":"2024-09-12T01:08:08.520108+0000","last_fullsized":"2024-09-12T01:08:08.520108+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:32.733496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390164+0000","last_change":"2024-09-12T00:46:19.282416+0000","last_active":"2024-09-12T01:08:52.390164+0000","last_peered":"2024-09-12T01:08:52.390164+0000","last_clean":"2024-09-12T01:08:52.390164+0000","last_became_active":"2024-09-12T00:46:19.282137+0000","last_became_peered":"2024-09-12T00:46:19.282137+0000","last_unstale":"2024-09-12T01:08:52.390164+0000","last_undegraded":"2024-09-12T01:08:52.390164+0000","last_fullsized":"2024-09-12T01:08:52.390164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:16.519283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557118+0000","last_change":"2024-09-12T00:46:16.274482+0000","last_active":"2024-09-12T01:11:22.557118+0000","last_peered":"2024-09-12T01:11:22.557118+0000","last_clean":"2024-09-12T01:11:22.557118+0000","last_became_active":"2024-09-12T00:46:16.274198+0000","last_became_peered":"2024-09-12T00:46:16.274198+0000","last_unstale":"2024-09-12T01:11:22.557118+0000","last_undegraded":"2024-09-12T01:11:22.557118+0000","last_fullsized":"2024-09-12T01:11:22.557118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:47.458869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2619,"num_write":4,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475262+0000","last_change":"2024-09-12T00:44:37.814764+0000","last_active":"2024-09-12T01:08:27.475262+0000","last_peered":"2024-09-12T01:08:27.475262+0000","last_clean":"2024-09-12T01:08:27.475262+0000","last_became_active":"2024-09-12T00:44:37.814480+0000","last_became_peered":"2024-09-12T00:44:37.814480+0000","last_unstale":"2024-09-12T01:08:27.475262+0000","last_undegraded":"2024-09-12T01:08:27.475262+0000","last_fullsized":"2024-09-12T01:08:27.475262+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:18.473305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383351+0000","last_change":"2024-09-12T00:56:52.997107+0000","last_active":"2024-09-12T01:08:08.383351+0000","last_peered":"2024-09-12T01:08:08.383351+0000","last_clean":"2024-09-12T01:08:08.383351+0000","last_became_active":"2024-09-12T00:56:52.996816+0000","last_became_peered":"2024-09-12T00:56:52.996816+0000","last_unstale":"2024-09-12T01:08:08.383351+0000","last_undegraded":"2024-09-12T01:08:08.383351+0000","last_fullsized":"2024-09-12T01:08:08.383351+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:21.071571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519342+0000","last_change":"2024-09-12T00:46:19.276670+0000","last_active":"2024-09-12T01:08:03.519342+0000","last_peered":"2024-09-12T01:08:03.519342+0000","last_clean":"2024-09-12T01:08:03.519342+0000","last_became_active":"2024-09-12T00:46:19.276366+0000","last_became_peered":"2024-09-12T00:46:19.276366+0000","last_unstale":"2024-09-12T01:08:03.519342+0000","last_undegraded":"2024-09-12T01:08:03.519342+0000","last_fullsized":"2024-09-12T01:08:03.519342+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:52.413983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.604649+0000","last_change":"2024-09-12T00:46:16.274311+0000","last_active":"2024-09-12T01:08:48.604649+0000","last_peered":"2024-09-12T01:08:48.604649+0000","last_clean":"2024-09-12T01:08:48.604649+0000","last_became_active":"2024-09-12T00:46:16.273821+0000","last_became_peered":"2024-09-12T00:46:16.273821+0000","last_unstale":"2024-09-12T01:08:48.604649+0000","last_undegraded":"2024-09-12T01:08:48.604649+0000","last_fullsized":"2024-09-12T01:08:48.604649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:14.476953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.522282+0000","last_change":"2024-09-12T00:44:37.817651+0000","last_active":"2024-09-12T01:08:28.522282+0000","last_peered":"2024-09-12T01:08:28.522282+0000","last_clean":"2024-09-12T01:08:28.522282+0000","last_became_active":"2024-09-12T00:44:37.817357+0000","last_became_peered":"2024-09-12T00:44:37.817357+0000","last_unstale":"2024-09-12T01:08:28.522282+0000","last_undegraded":"2024-09-12T01:08:28.522282+0000","last_fullsized":"2024-09-12T01:08:28.522282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:32.676919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.513328+0000","last_change":"2024-09-12T00:56:52.991150+0000","last_active":"2024-09-12T01:07:18.513328+0000","last_peered":"2024-09-12T01:07:18.513328+0000","last_clean":"2024-09-12T01:07:18.513328+0000","last_became_active":"2024-09-12T00:56:52.990450+0000","last_became_peered":"2024-09-12T00:56:52.990450+0000","last_unstale":"2024-09-12T01:07:18.513328+0000","last_undegraded":"2024-09-12T01:07:18.513328+0000","last_fullsized":"2024-09-12T01:07:18.513328+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:08.753872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"264'7","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465243+0000","last_change":"2024-09-12T00:46:19.281700+0000","last_active":"2024-09-12T01:07:17.465243+0000","last_peered":"2024-09-12T01:07:17.465243+0000","last_clean":"2024-09-12T01:07:17.465243+0000","last_became_active":"2024-09-12T00:46:19.281413+0000","last_became_peered":"2024-09-12T00:46:19.281413+0000","last_unstale":"2024-09-12T01:07:17.465243+0000","last_undegraded":"2024-09-12T01:07:17.465243+0000","last_fullsized":"2024-09-12T01:07:17.465243+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:32.000629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":16941,"num_write":7,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"264'8","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.055888+0000","last_change":"2024-09-12T00:46:16.272138+0000","last_active":"2024-09-12T01:11:23.055888+0000","last_peered":"2024-09-12T01:11:23.055888+0000","last_clean":"2024-09-12T01:11:23.055888+0000","last_became_active":"2024-09-12T00:46:16.271730+0000","last_became_peered":"2024-09-12T00:46:16.271730+0000","last_unstale":"2024-09-12T01:11:23.055888+0000","last_undegraded":"2024-09-12T01:11:23.055888+0000","last_fullsized":"2024-09-12T01:11:23.055888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:24.991885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11841,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516358+0000","last_change":"2024-09-12T00:44:37.815831+0000","last_active":"2024-09-12T01:08:27.516358+0000","last_peered":"2024-09-12T01:08:27.516358+0000","last_clean":"2024-09-12T01:08:27.516358+0000","last_became_active":"2024-09-12T00:44:37.815542+0000","last_became_peered":"2024-09-12T00:44:37.815542+0000","last_unstale":"2024-09-12T01:08:27.516358+0000","last_undegraded":"2024-09-12T01:08:27.516358+0000","last_fullsized":"2024-09-12T01:08:27.516358+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.238225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":55,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.513375+0000","last_change":"2024-09-12T00:56:52.988965+0000","last_active":"2024-09-12T01:07:18.513375+0000","last_peered":"2024-09-12T01:07:18.513375+0000","last_clean":"2024-09-12T01:07:18.513375+0000","last_became_active":"2024-09-12T00:56:52.988702+0000","last_became_peered":"2024-09-12T00:56:52.988702+0000","last_unstale":"2024-09-12T01:07:18.513375+0000","last_undegraded":"2024-09-12T01:07:18.513375+0000","last_fullsized":"2024-09-12T01:07:18.513375+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:28.810429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.483052+0000","last_change":"2024-09-12T00:46:19.277090+0000","last_active":"2024-09-12T01:09:17.483052+0000","last_peered":"2024-09-12T01:09:17.483052+0000","last_clean":"2024-09-12T01:09:17.483052+0000","last_became_active":"2024-09-12T00:46:19.276538+0000","last_became_peered":"2024-09-12T00:46:19.276538+0000","last_unstale":"2024-09-12T01:09:17.483052+0000","last_undegraded":"2024-09-12T01:09:17.483052+0000","last_fullsized":"2024-09-12T01:09:17.483052+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.608027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.523552+0000","last_change":"2024-09-12T00:46:16.273158+0000","last_active":"2024-09-12T01:09:17.523552+0000","last_peered":"2024-09-12T01:09:17.523552+0000","last_clean":"2024-09-12T01:09:17.523552+0000","last_became_active":"2024-09-12T00:46:16.272892+0000","last_became_peered":"2024-09-12T00:46:16.272892+0000","last_unstale":"2024-09-12T01:09:17.523552+0000","last_undegraded":"2024-09-12T01:09:17.523552+0000","last_fullsized":"2024-09-12T01:09:17.523552+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.867186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"264'6","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.601661+0000","last_change":"2024-09-12T00:44:37.820513+0000","last_active":"2024-09-12T01:08:28.601661+0000","last_peered":"2024-09-12T01:08:28.601661+0000","last_clean":"2024-09-12T01:08:28.601661+0000","last_became_active":"2024-09-12T00:44:37.819232+0000","last_became_peered":"2024-09-12T00:44:37.819232+0000","last_unstale":"2024-09-12T01:08:28.601661+0000","last_undegraded":"2024-09-12T01:08:28.601661+0000","last_fullsized":"2024-09-12T01:08:28.601661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:53.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479701+0000","last_change":"2024-09-12T00:56:52.994822+0000","last_active":"2024-09-12T01:08:57.479701+0000","last_peered":"2024-09-12T01:08:57.479701+0000","last_clean":"2024-09-12T01:08:57.479701+0000","last_became_active":"2024-09-12T00:56:52.994128+0000","last_became_peered":"2024-09-12T00:56:52.994128+0000","last_unstale":"2024-09-12T01:08:57.479701+0000","last_undegraded":"2024-09-12T01:08:57.479701+0000","last_fullsized":"2024-09-12T01:08:57.479701+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:23.628943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.518602+0000","last_change":"2024-09-12T00:46:19.282799+0000","last_active":"2024-09-12T01:07:58.518602+0000","last_peered":"2024-09-12T01:07:58.518602+0000","last_clean":"2024-09-12T01:07:58.518602+0000","last_became_active":"2024-09-12T00:46:19.281782+0000","last_became_peered":"2024-09-12T00:46:19.281782+0000","last_unstale":"2024-09-12T01:07:58.518602+0000","last_undegraded":"2024-09-12T01:07:58.518602+0000","last_fullsized":"2024-09-12T01:07:58.518602+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:46.964297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.490914+0000","last_change":"2024-09-12T00:46:16.274107+0000","last_active":"2024-09-12T01:07:56.490914+0000","last_peered":"2024-09-12T01:07:56.490914+0000","last_clean":"2024-09-12T01:07:56.490914+0000","last_became_active":"2024-09-12T00:46:16.273356+0000","last_became_peered":"2024-09-12T00:46:16.273356+0000","last_unstale":"2024-09-12T01:07:56.490914+0000","last_undegraded":"2024-09-12T01:07:56.490914+0000","last_fullsized":"2024-09-12T01:07:56.490914+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:14.769067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'16","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.488931+0000","last_change":"2024-09-12T00:44:37.818413+0000","last_active":"2024-09-12T01:07:41.488931+0000","last_peered":"2024-09-12T01:07:41.488931+0000","last_clean":"2024-09-12T01:07:41.488931+0000","last_became_active":"2024-09-12T00:44:37.818054+0000","last_became_peered":"2024-09-12T00:44:37.818054+0000","last_unstale":"2024-09-12T01:07:41.488931+0000","last_undegraded":"2024-09-12T01:07:41.488931+0000","last_fullsized":"2024-09-12T01:07:41.488931+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:10.843685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.591776+0000","last_change":"2024-09-12T00:56:52.991268+0000","last_active":"2024-09-12T01:07:18.591776+0000","last_peered":"2024-09-12T01:07:18.591776+0000","last_clean":"2024-09-12T01:07:18.591776+0000","last_became_active":"2024-09-12T00:56:52.990601+0000","last_became_peered":"2024-09-12T00:56:52.990601+0000","last_unstale":"2024-09-12T01:07:18.591776+0000","last_undegraded":"2024-09-12T01:07:18.591776+0000","last_fullsized":"2024-09-12T01:07:18.591776+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:14.400256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615507+0000","last_change":"2024-09-12T00:46:19.282146+0000","last_active":"2024-09-12T01:10:08.615507+0000","last_peered":"2024-09-12T01:10:08.615507+0000","last_clean":"2024-09-12T01:10:08.615507+0000","last_became_active":"2024-09-12T00:46:19.281732+0000","last_became_peered":"2024-09-12T00:46:19.281732+0000","last_unstale":"2024-09-12T01:10:08.615507+0000","last_undegraded":"2024-09-12T01:10:08.615507+0000","last_fullsized":"2024-09-12T01:10:08.615507+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:55.852331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615530+0000","last_change":"2024-09-12T00:46:16.277570+0000","last_active":"2024-09-12T01:10:08.615530+0000","last_peered":"2024-09-12T01:10:08.615530+0000","last_clean":"2024-09-12T01:10:08.615530+0000","last_became_active":"2024-09-12T00:46:16.277261+0000","last_became_peered":"2024-09-12T00:46:16.277261+0000","last_unstale":"2024-09-12T01:10:08.615530+0000","last_undegraded":"2024-09-12T01:10:08.615530+0000","last_fullsized":"2024-09-12T01:10:08.615530+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:00.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12284,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'33","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.645110+0000","last_change":"2024-09-12T00:44:37.818362+0000","last_active":"2024-09-12T01:08:56.645110+0000","last_peered":"2024-09-12T01:08:56.645110+0000","last_clean":"2024-09-12T01:08:56.645110+0000","last_became_active":"2024-09-12T00:44:37.818055+0000","last_became_peered":"2024-09-12T00:44:37.818055+0000","last_unstale":"2024-09-12T01:08:56.645110+0000","last_undegraded":"2024-09-12T01:08:56.645110+0000","last_fullsized":"2024-09-12T01:08:56.645110+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.754260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":106,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380147+0000","last_change":"2024-09-12T00:56:52.989699+0000","last_active":"2024-09-12T01:07:43.380147+0000","last_peered":"2024-09-12T01:07:43.380147+0000","last_clean":"2024-09-12T01:07:43.380147+0000","last_became_active":"2024-09-12T00:56:52.989396+0000","last_became_peered":"2024-09-12T00:56:52.989396+0000","last_unstale":"2024-09-12T01:07:43.380147+0000","last_undegraded":"2024-09-12T01:07:43.380147+0000","last_fullsized":"2024-09-12T01:07:43.380147+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.478574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.523445+0000","last_change":"2024-09-12T00:46:19.281553+0000","last_active":"2024-09-12T01:09:17.523445+0000","last_peered":"2024-09-12T01:09:17.523445+0000","last_clean":"2024-09-12T01:09:17.523445+0000","last_became_active":"2024-09-12T00:46:19.281231+0000","last_became_peered":"2024-09-12T00:46:19.281231+0000","last_unstale":"2024-09-12T01:09:17.523445+0000","last_undegraded":"2024-09-12T01:09:17.523445+0000","last_fullsized":"2024-09-12T01:09:17.523445+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:58.529910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.494009+0000","last_change":"2024-09-12T00:46:16.277008+0000","last_active":"2024-09-12T01:08:21.494009+0000","last_peered":"2024-09-12T01:08:21.494009+0000","last_clean":"2024-09-12T01:08:21.494009+0000","last_became_active":"2024-09-12T00:46:16.276730+0000","last_became_peered":"2024-09-12T00:46:16.276730+0000","last_unstale":"2024-09-12T01:08:21.494009+0000","last_undegraded":"2024-09-12T01:08:21.494009+0000","last_fullsized":"2024-09-12T01:08:21.494009+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:54.164828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":10,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'54","reported_seq":199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.488274+0000","last_change":"2024-09-12T00:44:37.817537+0000","last_active":"2024-09-12T01:07:36.488274+0000","last_peered":"2024-09-12T01:07:36.488274+0000","last_clean":"2024-09-12T01:07:36.488274+0000","last_became_active":"2024-09-12T00:44:37.817249+0000","last_became_peered":"2024-09-12T00:44:37.817249+0000","last_unstale":"2024-09-12T01:07:36.488274+0000","last_undegraded":"2024-09-12T01:07:36.488274+0000","last_fullsized":"2024-09-12T01:07:36.488274+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.627057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":217,"num_write":83,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510158+0000","last_change":"2024-09-12T00:56:52.993381+0000","last_active":"2024-09-12T01:07:42.510158+0000","last_peered":"2024-09-12T01:07:42.510158+0000","last_clean":"2024-09-12T01:07:42.510158+0000","last_became_active":"2024-09-12T00:56:52.992289+0000","last_became_peered":"2024-09-12T00:56:52.992289+0000","last_unstale":"2024-09-12T01:07:42.510158+0000","last_undegraded":"2024-09-12T01:07:42.510158+0000","last_fullsized":"2024-09-12T01:07:42.510158+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:39.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.600810+0000","last_change":"2024-09-12T00:46:19.281027+0000","last_active":"2024-09-12T01:08:23.600810+0000","last_peered":"2024-09-12T01:08:23.600810+0000","last_clean":"2024-09-12T01:08:23.600810+0000","last_became_active":"2024-09-12T00:46:19.280725+0000","last_became_peered":"2024-09-12T00:46:19.280725+0000","last_unstale":"2024-09-12T01:08:23.600810+0000","last_undegraded":"2024-09-12T01:08:23.600810+0000","last_fullsized":"2024-09-12T01:08:23.600810+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:05.148455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.608121+0000","last_change":"2024-09-12T00:46:16.272821+0000","last_active":"2024-09-12T01:09:13.608121+0000","last_peered":"2024-09-12T01:09:13.608121+0000","last_clean":"2024-09-12T01:09:13.608121+0000","last_became_active":"2024-09-12T00:46:16.272417+0000","last_became_peered":"2024-09-12T00:46:16.272417+0000","last_unstale":"2024-09-12T01:09:13.608121+0000","last_undegraded":"2024-09-12T01:09:13.608121+0000","last_fullsized":"2024-09-12T01:09:13.608121+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:30.234992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2052,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'44","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594575+0000","last_change":"2024-09-12T00:44:37.818360+0000","last_active":"2024-09-12T01:07:33.594575+0000","last_peered":"2024-09-12T01:07:33.594575+0000","last_clean":"2024-09-12T01:07:33.594575+0000","last_became_active":"2024-09-12T00:44:37.815722+0000","last_became_peered":"2024-09-12T00:44:37.815722+0000","last_unstale":"2024-09-12T01:07:33.594575+0000","last_undegraded":"2024-09-12T01:07:33.594575+0000","last_fullsized":"2024-09-12T01:07:33.594575+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:01.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":150,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465217+0000","last_change":"2024-09-12T00:56:52.993069+0000","last_active":"2024-09-12T01:07:17.465217+0000","last_peered":"2024-09-12T01:07:17.465217+0000","last_clean":"2024-09-12T01:07:17.465217+0000","last_became_active":"2024-09-12T00:56:52.989218+0000","last_became_peered":"2024-09-12T00:56:52.989218+0000","last_unstale":"2024-09-12T01:07:17.465217+0000","last_undegraded":"2024-09-12T01:07:17.465217+0000","last_fullsized":"2024-09-12T01:07:17.465217+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:51.764331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.501310+0000","last_change":"2024-09-12T00:46:19.282564+0000","last_active":"2024-09-12T01:09:16.501310+0000","last_peered":"2024-09-12T01:09:16.501310+0000","last_clean":"2024-09-12T01:09:16.501310+0000","last_became_active":"2024-09-12T00:46:19.282270+0000","last_became_peered":"2024-09-12T00:46:19.282270+0000","last_unstale":"2024-09-12T01:09:16.501310+0000","last_undegraded":"2024-09-12T01:09:16.501310+0000","last_fullsized":"2024-09-12T01:09:16.501310+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:43.456680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.392925+0000","last_change":"2024-09-12T00:46:16.276646+0000","last_active":"2024-09-12T01:09:12.392925+0000","last_peered":"2024-09-12T01:09:12.392925+0000","last_clean":"2024-09-12T01:09:12.392925+0000","last_became_active":"2024-09-12T00:46:16.276368+0000","last_became_peered":"2024-09-12T00:46:16.276368+0000","last_unstale":"2024-09-12T01:09:12.392925+0000","last_undegraded":"2024-09-12T01:09:12.392925+0000","last_fullsized":"2024-09-12T01:09:12.392925+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:03.285958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594535+0000","last_change":"2024-09-12T00:44:37.821471+0000","last_active":"2024-09-12T01:07:33.594535+0000","last_peered":"2024-09-12T01:07:33.594535+0000","last_clean":"2024-09-12T01:07:33.594535+0000","last_became_active":"2024-09-12T00:44:37.821172+0000","last_became_peered":"2024-09-12T00:44:37.821172+0000","last_unstale":"2024-09-12T01:07:33.594535+0000","last_undegraded":"2024-09-12T01:07:33.594535+0000","last_fullsized":"2024-09-12T01:07:33.594535+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:46.622590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":156,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.592791+0000","last_change":"2024-09-12T00:56:52.993348+0000","last_active":"2024-09-12T01:07:23.592791+0000","last_peered":"2024-09-12T01:07:23.592791+0000","last_clean":"2024-09-12T01:07:23.592791+0000","last_became_active":"2024-09-12T00:56:52.993079+0000","last_became_peered":"2024-09-12T00:56:52.993079+0000","last_unstale":"2024-09-12T01:07:23.592791+0000","last_undegraded":"2024-09-12T01:07:23.592791+0000","last_fullsized":"2024-09-12T01:07:23.592791+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:13.494808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.501272+0000","last_change":"2024-09-12T00:46:19.279921+0000","last_active":"2024-09-12T01:09:16.501272+0000","last_peered":"2024-09-12T01:09:16.501272+0000","last_clean":"2024-09-12T01:09:16.501272+0000","last_became_active":"2024-09-12T00:46:19.279630+0000","last_became_peered":"2024-09-12T00:46:19.279630+0000","last_unstale":"2024-09-12T01:09:16.501272+0000","last_undegraded":"2024-09-12T01:09:16.501272+0000","last_fullsized":"2024-09-12T01:09:16.501272+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.231021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411787+0000","last_change":"2024-09-12T00:46:16.267218+0000","last_active":"2024-09-12T01:09:13.411787+0000","last_peered":"2024-09-12T01:09:13.411787+0000","last_clean":"2024-09-12T01:09:13.411787+0000","last_became_active":"2024-09-12T00:46:16.266854+0000","last_became_peered":"2024-09-12T00:46:16.266854+0000","last_unstale":"2024-09-12T01:09:13.411787+0000","last_undegraded":"2024-09-12T01:09:13.411787+0000","last_fullsized":"2024-09-12T01:09:13.411787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:46.629498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'16","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.497466+0000","last_change":"2024-09-12T00:44:37.822549+0000","last_active":"2024-09-12T01:08:46.497466+0000","last_peered":"2024-09-12T01:08:46.497466+0000","last_clean":"2024-09-12T01:08:46.497466+0000","last_became_active":"2024-09-12T00:44:37.822277+0000","last_became_peered":"2024-09-12T00:44:37.822277+0000","last_unstale":"2024-09-12T01:08:46.497466+0000","last_undegraded":"2024-09-12T01:08:46.497466+0000","last_fullsized":"2024-09-12T01:08:46.497466+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.547476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'371","reported_seq":1142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.529637+0000","last_change":"2024-09-12T00:30:11.108085+0000","last_active":"2024-09-12T01:11:23.529637+0000","last_peered":"2024-09-12T01:11:23.529637+0000","last_clean":"2024-09-12T01:11:23.529637+0000","last_became_active":"2024-09-12T00:30:11.107706+0000","last_became_peered":"2024-09-12T00:30:11.107706+0000","last_unstale":"2024-09-12T01:11:23.529637+0000","last_undegraded":"2024-09-12T01:11:23.529637+0000","last_fullsized":"2024-09-12T01:11:23.529637+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.042423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1492023,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":736,"num_read_kb":12989,"num_write":1270,"num_write_kb":41879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'141","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.303738+0000","last_change":"2024-09-12T00:30:13.128059+0000","last_active":"2024-09-12T01:10:50.303738+0000","last_peered":"2024-09-12T01:10:50.303738+0000","last_clean":"2024-09-12T01:10:50.303738+0000","last_became_active":"2024-09-12T00:30:13.126147+0000","last_became_peered":"2024-09-12T00:30:13.126147+0000","last_unstale":"2024-09-12T01:10:50.303738+0000","last_undegraded":"2024-09-12T01:10:50.303738+0000","last_fullsized":"2024-09-12T01:10:50.303738+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:08.534438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":527,"num_write":201,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'275","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.951043+0000","last_change":"2024-09-12T00:30:11.101673+0000","last_active":"2024-09-12T01:09:23.951043+0000","last_peered":"2024-09-12T01:09:23.951043+0000","last_clean":"2024-09-12T01:09:23.951043+0000","last_became_active":"2024-09-12T00:30:11.101252+0000","last_became_peered":"2024-09-12T00:30:11.101252+0000","last_unstale":"2024-09-12T01:09:23.951043+0000","last_undegraded":"2024-09-12T01:09:23.951043+0000","last_fullsized":"2024-09-12T01:09:23.951043+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:24.037331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2397728,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":419,"num_read_kb":19965,"num_write":1005,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'209","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:30.236873+0000","last_change":"2024-09-12T00:30:13.124111+0000","last_active":"2024-09-12T01:09:30.236873+0000","last_peered":"2024-09-12T01:09:30.236873+0000","last_clean":"2024-09-12T01:09:30.236873+0000","last_became_active":"2024-09-12T00:30:13.123880+0000","last_became_peered":"2024-09-12T00:30:13.123880+0000","last_unstale":"2024-09-12T01:09:30.236873+0000","last_undegraded":"2024-09-12T01:09:30.236873+0000","last_fullsized":"2024-09-12T01:09:30.236873+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:41.642173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":720,"num_write":314,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'244","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:30.793618+0000","last_change":"2024-09-12T00:30:11.096844+0000","last_active":"2024-09-12T01:09:30.793618+0000","last_peered":"2024-09-12T01:09:30.793618+0000","last_clean":"2024-09-12T01:09:30.793618+0000","last_became_active":"2024-09-12T00:30:11.096381+0000","last_became_peered":"2024-09-12T00:30:11.096381+0000","last_unstale":"2024-09-12T01:09:30.793618+0000","last_undegraded":"2024-09-12T01:09:30.793618+0000","last_fullsized":"2024-09-12T01:09:30.793618+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:57.955383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13784106,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":389,"num_read_kb":52758,"num_write":935,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'151","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.489637+0000","last_change":"2024-09-12T00:30:13.121126+0000","last_active":"2024-09-12T01:08:45.489637+0000","last_peered":"2024-09-12T01:08:45.489637+0000","last_clean":"2024-09-12T01:08:45.489637+0000","last_became_active":"2024-09-12T00:30:13.120834+0000","last_became_peered":"2024-09-12T00:30:13.120834+0000","last_unstale":"2024-09-12T01:08:45.489637+0000","last_undegraded":"2024-09-12T01:08:45.489637+0000","last_fullsized":"2024-09-12T01:08:45.489637+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:48.681924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":556,"num_write":237,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'249","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.036676+0000","last_change":"2024-09-12T00:30:11.102160+0000","last_active":"2024-09-12T01:09:33.036676+0000","last_peered":"2024-09-12T01:09:33.036676+0000","last_clean":"2024-09-12T01:09:33.036676+0000","last_became_active":"2024-09-12T00:30:11.101773+0000","last_became_peered":"2024-09-12T00:30:11.101773+0000","last_unstale":"2024-09-12T01:09:33.036676+0000","last_undegraded":"2024-09-12T01:09:33.036676+0000","last_fullsized":"2024-09-12T01:09:33.036676+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:43.867988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3779590,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":382,"num_read_kb":6781,"num_write":869,"num_write_kb":20709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4368","reported_seq":4967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.603185+0000","last_change":"2024-09-12T00:30:13.114180+0000","last_active":"2024-09-12T01:07:47.603185+0000","last_peered":"2024-09-12T01:07:47.603185+0000","last_clean":"2024-09-12T01:07:47.603185+0000","last_became_active":"2024-09-12T00:30:13.113812+0000","last_became_peered":"2024-09-12T00:30:13.113812+0000","last_unstale":"2024-09-12T01:07:47.603185+0000","last_undegraded":"2024-09-12T01:07:47.603185+0000","last_fullsized":"2024-09-12T01:07:47.603185+0000","mapping_epoch":28,"log_start":"264'4300","ondisk_log_start":"264'4300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:35.040266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17553,"num_read_kb":14742,"num_write":6586,"num_write_kb":3311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'294","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.514337+0000","last_change":"2024-09-12T00:30:11.098446+0000","last_active":"2024-09-12T01:11:23.514337+0000","last_peered":"2024-09-12T01:11:23.514337+0000","last_clean":"2024-09-12T01:11:23.514337+0000","last_became_active":"2024-09-12T00:30:11.097339+0000","last_became_peered":"2024-09-12T00:30:11.097339+0000","last_unstale":"2024-09-12T01:11:23.514337+0000","last_undegraded":"2024-09-12T01:11:23.514337+0000","last_fullsized":"2024-09-12T01:11:23.514337+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:40.707199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055238,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":412,"num_read_kb":4533,"num_write":1107,"num_write_kb":19662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"264'201","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.028978+0000","last_change":"2024-09-12T00:30:13.125647+0000","last_active":"2024-09-12T01:08:21.028978+0000","last_peered":"2024-09-12T01:08:21.028978+0000","last_clean":"2024-09-12T01:08:21.028978+0000","last_became_active":"2024-09-12T00:30:13.125363+0000","last_became_peered":"2024-09-12T00:30:13.125363+0000","last_unstale":"2024-09-12T01:08:21.028978+0000","last_undegraded":"2024-09-12T01:08:21.028978+0000","last_fullsized":"2024-09-12T01:08:21.028978+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:56.486136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":845,"num_read_kb":691,"num_write":311,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'280","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:29.550648+0000","last_change":"2024-09-12T00:30:11.104965+0000","last_active":"2024-09-12T01:09:29.550648+0000","last_peered":"2024-09-12T01:09:29.550648+0000","last_clean":"2024-09-12T01:09:29.550648+0000","last_became_active":"2024-09-12T00:30:11.104535+0000","last_became_peered":"2024-09-12T00:30:11.104535+0000","last_unstale":"2024-09-12T01:09:29.550648+0000","last_undegraded":"2024-09-12T01:09:29.550648+0000","last_fullsized":"2024-09-12T01:09:29.550648+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:02.250566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214355,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":410,"num_read_kb":66788,"num_write":917,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'115","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.522736+0000","last_change":"2024-09-12T00:30:13.125175+0000","last_active":"2024-09-12T01:08:53.522736+0000","last_peered":"2024-09-12T01:08:53.522736+0000","last_clean":"2024-09-12T01:08:53.522736+0000","last_became_active":"2024-09-12T00:30:13.124774+0000","last_became_peered":"2024-09-12T00:30:13.124774+0000","last_unstale":"2024-09-12T01:08:53.522736+0000","last_undegraded":"2024-09-12T01:08:53.522736+0000","last_fullsized":"2024-09-12T01:08:53.522736+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:17.846970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":451,"num_write":180,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'277","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.405774+0000","last_change":"2024-09-12T00:30:11.102635+0000","last_active":"2024-09-12T01:11:23.405774+0000","last_peered":"2024-09-12T01:11:23.405774+0000","last_clean":"2024-09-12T01:11:23.405774+0000","last_became_active":"2024-09-12T00:30:11.102281+0000","last_became_peered":"2024-09-12T00:30:11.102281+0000","last_unstale":"2024-09-12T01:11:23.405774+0000","last_undegraded":"2024-09-12T01:11:23.405774+0000","last_fullsized":"2024-09-12T01:11:23.405774+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:36.443637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706718,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":422,"num_read_kb":13880,"num_write":922,"num_write_kb":40348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'544","reported_seq":1240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.564544+0000","last_change":"2024-09-12T00:30:13.126388+0000","last_active":"2024-09-12T01:09:22.564544+0000","last_peered":"2024-09-12T01:09:22.564544+0000","last_clean":"2024-09-12T01:09:22.564544+0000","last_became_active":"2024-09-12T00:30:13.126123+0000","last_became_peered":"2024-09-12T00:30:13.126123+0000","last_unstale":"2024-09-12T01:09:22.564544+0000","last_undegraded":"2024-09-12T01:09:22.564544+0000","last_fullsized":"2024-09-12T01:09:22.564544+0000","mapping_epoch":28,"log_start":"264'500","ondisk_log_start":"264'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:46.451607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2509,"num_read_kb":2200,"num_write":899,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'251","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.535584+0000","last_change":"2024-09-12T00:30:11.104564+0000","last_active":"2024-09-12T01:09:13.535584+0000","last_peered":"2024-09-12T01:09:13.535584+0000","last_clean":"2024-09-12T01:09:13.535584+0000","last_became_active":"2024-09-12T00:30:11.104084+0000","last_became_peered":"2024-09-12T00:30:11.104084+0000","last_unstale":"2024-09-12T01:09:13.535584+0000","last_undegraded":"2024-09-12T01:09:13.535584+0000","last_fullsized":"2024-09-12T01:09:13.535584+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:20.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5497379,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":435,"num_read_kb":14633,"num_write":922,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'231","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.849014+0000","last_change":"2024-09-12T00:30:13.129106+0000","last_active":"2024-09-12T01:09:15.849014+0000","last_peered":"2024-09-12T01:09:15.849014+0000","last_clean":"2024-09-12T01:09:15.849014+0000","last_became_active":"2024-09-12T00:30:13.127581+0000","last_became_peered":"2024-09-12T00:30:13.127581+0000","last_unstale":"2024-09-12T01:09:15.849014+0000","last_undegraded":"2024-09-12T01:09:15.849014+0000","last_fullsized":"2024-09-12T01:09:15.849014+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:37.451443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1008,"num_read_kb":834,"num_write":338,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'462","reported_seq":1238,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.335798+0000","last_change":"2024-09-12T00:30:13.121457+0000","last_active":"2024-09-12T01:08:46.335798+0000","last_peered":"2024-09-12T01:08:46.335798+0000","last_clean":"2024-09-12T01:08:46.335798+0000","last_became_active":"2024-09-12T00:30:13.121154+0000","last_became_peered":"2024-09-12T00:30:13.121154+0000","last_unstale":"2024-09-12T01:08:46.335798+0000","last_undegraded":"2024-09-12T01:08:46.335798+0000","last_fullsized":"2024-09-12T01:08:46.335798+0000","mapping_epoch":28,"log_start":"264'400","ondisk_log_start":"264'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:30.709632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2284,"num_read_kb":1967,"num_write":806,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'250","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.376952+0000","last_change":"2024-09-12T00:30:11.103793+0000","last_active":"2024-09-12T01:11:23.376952+0000","last_peered":"2024-09-12T01:11:23.376952+0000","last_clean":"2024-09-12T01:11:23.376952+0000","last_became_active":"2024-09-12T00:30:11.103437+0000","last_became_peered":"2024-09-12T00:30:11.103437+0000","last_unstale":"2024-09-12T01:11:23.376952+0000","last_undegraded":"2024-09-12T01:11:23.376952+0000","last_fullsized":"2024-09-12T01:11:23.376952+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:00.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15228190,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":393,"num_read_kb":35388,"num_write":851,"num_write_kb":32368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'227","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.699341+0000","last_change":"2024-09-12T00:30:13.129323+0000","last_active":"2024-09-12T01:08:47.699341+0000","last_peered":"2024-09-12T01:08:47.699341+0000","last_clean":"2024-09-12T01:08:47.699341+0000","last_became_active":"2024-09-12T00:30:13.128977+0000","last_became_peered":"2024-09-12T00:30:13.128977+0000","last_unstale":"2024-09-12T01:08:47.699341+0000","last_undegraded":"2024-09-12T01:08:47.699341+0000","last_fullsized":"2024-09-12T01:08:47.699341+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:56.133929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1058,"num_read_kb":878,"num_write":388,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'275","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.538922+0000","last_change":"2024-09-12T00:30:11.115651+0000","last_active":"2024-09-12T01:11:23.538922+0000","last_peered":"2024-09-12T01:11:23.538922+0000","last_clean":"2024-09-12T01:11:23.538922+0000","last_became_active":"2024-09-12T00:30:11.114961+0000","last_became_peered":"2024-09-12T00:30:11.114961+0000","last_unstale":"2024-09-12T01:11:23.538922+0000","last_undegraded":"2024-09-12T01:11:23.538922+0000","last_fullsized":"2024-09-12T01:11:23.538922+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:14.975869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246923,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":398,"num_read_kb":13562,"num_write":911,"num_write_kb":25787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'212","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.269904+0000","last_change":"2024-09-12T00:30:13.127448+0000","last_active":"2024-09-12T01:09:09.269904+0000","last_peered":"2024-09-12T01:09:09.269904+0000","last_clean":"2024-09-12T01:09:09.269904+0000","last_became_active":"2024-09-12T00:30:13.127190+0000","last_became_peered":"2024-09-12T00:30:13.127190+0000","last_unstale":"2024-09-12T01:09:09.269904+0000","last_undegraded":"2024-09-12T01:09:09.269904+0000","last_fullsized":"2024-09-12T01:09:09.269904+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:54.603682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":739,"num_write":341,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'331","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.401578+0000","last_change":"2024-09-12T00:30:11.106208+0000","last_active":"2024-09-12T01:11:23.401578+0000","last_peered":"2024-09-12T01:11:23.401578+0000","last_clean":"2024-09-12T01:11:23.401578+0000","last_became_active":"2024-09-12T00:30:11.105844+0000","last_became_peered":"2024-09-12T00:30:11.105844+0000","last_unstale":"2024-09-12T01:11:23.401578+0000","last_undegraded":"2024-09-12T01:11:23.401578+0000","last_fullsized":"2024-09-12T01:11:23.401578+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:53.358144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6628298,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":482,"num_read_kb":46849,"num_write":1141,"num_write_kb":40470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'183","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390220+0000","last_change":"2024-09-12T00:30:13.125263+0000","last_active":"2024-09-12T01:08:52.390220+0000","last_peered":"2024-09-12T01:08:52.390220+0000","last_clean":"2024-09-12T01:08:52.390220+0000","last_became_active":"2024-09-12T00:30:13.124627+0000","last_became_peered":"2024-09-12T00:30:13.124627+0000","last_unstale":"2024-09-12T01:08:52.390220+0000","last_undegraded":"2024-09-12T01:08:52.390220+0000","last_fullsized":"2024-09-12T01:08:52.390220+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:42.412103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":804,"num_read_kb":662,"num_write":262,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'277","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.446898+0000","last_change":"2024-09-12T00:30:11.114785+0000","last_active":"2024-09-12T01:11:23.446898+0000","last_peered":"2024-09-12T01:11:23.446898+0000","last_clean":"2024-09-12T01:11:23.446898+0000","last_became_active":"2024-09-12T00:30:11.114309+0000","last_became_peered":"2024-09-12T00:30:11.114309+0000","last_unstale":"2024-09-12T01:11:23.446898+0000","last_undegraded":"2024-09-12T01:11:23.446898+0000","last_fullsized":"2024-09-12T01:11:23.446898+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.364638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10105484,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":480,"num_read_kb":64152,"num_write":932,"num_write_kb":27626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'205","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479130+0000","last_change":"2024-09-12T00:30:13.129990+0000","last_active":"2024-09-12T01:08:52.479130+0000","last_peered":"2024-09-12T01:08:52.479130+0000","last_clean":"2024-09-12T01:08:52.479130+0000","last_became_active":"2024-09-12T00:30:13.129718+0000","last_became_peered":"2024-09-12T00:30:13.129718+0000","last_unstale":"2024-09-12T01:08:52.479130+0000","last_undegraded":"2024-09-12T01:08:52.479130+0000","last_fullsized":"2024-09-12T01:08:52.479130+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:07.835287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":749,"num_write":336,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'328","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.471884+0000","last_change":"2024-09-12T00:30:11.109350+0000","last_active":"2024-09-12T01:09:23.471884+0000","last_peered":"2024-09-12T01:09:23.471884+0000","last_clean":"2024-09-12T01:09:23.471884+0000","last_became_active":"2024-09-12T00:30:11.108958+0000","last_became_peered":"2024-09-12T00:30:11.108958+0000","last_unstale":"2024-09-12T01:09:23.471884+0000","last_undegraded":"2024-09-12T01:09:23.471884+0000","last_fullsized":"2024-09-12T01:09:23.471884+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:47.014408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14088217,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":517,"num_read_kb":32014,"num_write":1318,"num_write_kb":50601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'152","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.409340+0000","last_change":"2024-09-12T00:30:13.126434+0000","last_active":"2024-09-12T01:08:53.409340+0000","last_peered":"2024-09-12T01:08:53.409340+0000","last_clean":"2024-09-12T01:08:53.409340+0000","last_became_active":"2024-09-12T00:30:13.126143+0000","last_became_peered":"2024-09-12T00:30:13.126143+0000","last_unstale":"2024-09-12T01:08:53.409340+0000","last_undegraded":"2024-09-12T01:08:53.409340+0000","last_fullsized":"2024-09-12T01:08:53.409340+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:20.649913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":565,"num_write":225,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'269","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.055631+0000","last_change":"2024-09-12T00:30:11.096841+0000","last_active":"2024-09-12T01:09:28.055631+0000","last_peered":"2024-09-12T01:09:28.055631+0000","last_clean":"2024-09-12T01:09:28.055631+0000","last_became_active":"2024-09-12T00:30:11.096162+0000","last_became_peered":"2024-09-12T00:30:11.096162+0000","last_unstale":"2024-09-12T01:09:28.055631+0000","last_undegraded":"2024-09-12T01:09:28.055631+0000","last_fullsized":"2024-09-12T01:09:28.055631+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:02.238568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3298821,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":397,"num_read_kb":7247,"num_write":905,"num_write_kb":14577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'148","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.870030+0000","last_change":"2024-09-12T00:30:21.192901+0000","last_active":"2024-09-12T01:09:46.870030+0000","last_peered":"2024-09-12T01:09:46.870030+0000","last_clean":"2024-09-12T01:09:46.870030+0000","last_became_active":"2024-09-12T00:30:21.192654+0000","last_became_peered":"2024-09-12T00:30:21.192654+0000","last_unstale":"2024-09-12T01:09:46.870030+0000","last_undegraded":"2024-09-12T01:09:46.870030+0000","last_fullsized":"2024-09-12T01:09:46.870030+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:51.831265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":350,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'101","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.979565+0000","last_change":"2024-09-12T00:30:13.130308+0000","last_active":"2024-09-12T01:08:53.979565+0000","last_peered":"2024-09-12T01:08:53.979565+0000","last_clean":"2024-09-12T01:08:53.979565+0000","last_became_active":"2024-09-12T00:30:13.130030+0000","last_became_peered":"2024-09-12T00:30:13.130030+0000","last_unstale":"2024-09-12T01:08:53.979565+0000","last_undegraded":"2024-09-12T01:08:53.979565+0000","last_fullsized":"2024-09-12T01:08:53.979565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:14.502318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":143,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'402","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.623591+0000","last_change":"2024-09-12T00:30:46.767993+0000","last_active":"2024-09-12T01:11:23.623591+0000","last_peered":"2024-09-12T01:11:23.623591+0000","last_clean":"2024-09-12T01:11:23.623591+0000","last_became_active":"2024-09-12T00:30:46.767516+0000","last_became_peered":"2024-09-12T00:30:46.767516+0000","last_unstale":"2024-09-12T01:11:23.623591+0000","last_undegraded":"2024-09-12T01:11:23.623591+0000","last_fullsized":"2024-09-12T01:11:23.623591+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:13.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9870247,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":590,"num_read_kb":38821,"num_write":1336,"num_write_kb":62705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,4],"acting":[3,5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605940+0000","last_change":"2024-09-12T00:30:15.127353+0000","last_active":"2024-09-12T01:08:58.605940+0000","last_peered":"2024-09-12T01:08:58.605940+0000","last_clean":"2024-09-12T01:08:58.605940+0000","last_became_active":"2024-09-12T00:30:15.127067+0000","last_became_peered":"2024-09-12T00:30:15.127067+0000","last_unstale":"2024-09-12T01:08:58.605940+0000","last_undegraded":"2024-09-12T01:08:58.605940+0000","last_fullsized":"2024-09-12T01:08:58.605940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:01.202011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'320","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.534951+0000","last_change":"2024-09-12T00:30:17.145857+0000","last_active":"2024-09-12T01:11:22.534951+0000","last_peered":"2024-09-12T01:11:22.534951+0000","last_clean":"2024-09-12T01:11:22.534951+0000","last_became_active":"2024-09-12T00:30:17.145455+0000","last_became_peered":"2024-09-12T00:30:17.145455+0000","last_unstale":"2024-09-12T01:11:22.534951+0000","last_undegraded":"2024-09-12T01:11:22.534951+0000","last_fullsized":"2024-09-12T01:11:22.534951+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:25.114718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":944,"num_write":404,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409967+0000","last_change":"2024-09-12T00:30:19.168447+0000","last_active":"2024-09-12T01:08:58.409967+0000","last_peered":"2024-09-12T01:08:58.409967+0000","last_clean":"2024-09-12T01:08:58.409967+0000","last_became_active":"2024-09-12T00:30:19.168192+0000","last_became_peered":"2024-09-12T00:30:19.168192+0000","last_unstale":"2024-09-12T01:08:58.409967+0000","last_undegraded":"2024-09-12T01:08:58.409967+0000","last_fullsized":"2024-09-12T01:08:58.409967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:11.131718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'146","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.132064+0000","last_change":"2024-09-12T00:30:21.189447+0000","last_active":"2024-09-12T01:09:43.132064+0000","last_peered":"2024-09-12T01:09:43.132064+0000","last_clean":"2024-09-12T01:09:43.132064+0000","last_became_active":"2024-09-12T00:30:21.189141+0000","last_became_peered":"2024-09-12T00:30:21.189141+0000","last_unstale":"2024-09-12T01:09:43.132064+0000","last_undegraded":"2024-09-12T01:09:43.132064+0000","last_fullsized":"2024-09-12T01:09:43.132064+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:53.347172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":204,"num_write":274,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'90","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.605253+0000","last_change":"2024-09-12T00:30:13.127898+0000","last_active":"2024-09-12T01:08:53.605253+0000","last_peered":"2024-09-12T01:08:53.605253+0000","last_clean":"2024-09-12T01:08:53.605253+0000","last_became_active":"2024-09-12T00:30:13.127577+0000","last_became_peered":"2024-09-12T00:30:13.127577+0000","last_unstale":"2024-09-12T01:08:53.605253+0000","last_undegraded":"2024-09-12T01:08:53.605253+0000","last_fullsized":"2024-09-12T01:08:53.605253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:40.499246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":367,"num_write":144,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'247","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:44.196296+0000","last_change":"2024-09-12T00:30:11.092270+0000","last_active":"2024-09-12T01:10:44.196296+0000","last_peered":"2024-09-12T01:10:44.196296+0000","last_clean":"2024-09-12T01:10:44.196296+0000","last_became_active":"2024-09-12T00:30:11.091860+0000","last_became_peered":"2024-09-12T00:30:11.091860+0000","last_unstale":"2024-09-12T01:10:44.196296+0000","last_undegraded":"2024-09-12T01:10:44.196296+0000","last_fullsized":"2024-09-12T01:10:44.196296+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:18.340874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3749324,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":390,"num_read_kb":88624,"num_write":917,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510119+0000","last_change":"2024-09-12T00:30:15.130476+0000","last_active":"2024-09-12T01:07:42.510119+0000","last_peered":"2024-09-12T01:07:42.510119+0000","last_clean":"2024-09-12T01:07:42.510119+0000","last_became_active":"2024-09-12T00:30:15.130254+0000","last_became_peered":"2024-09-12T00:30:15.130254+0000","last_unstale":"2024-09-12T01:07:42.510119+0000","last_undegraded":"2024-09-12T01:07:42.510119+0000","last_fullsized":"2024-09-12T01:07:42.510119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.906448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'108","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.183586+0000","last_change":"2024-09-12T00:30:17.148717+0000","last_active":"2024-09-12T01:10:26.183586+0000","last_peered":"2024-09-12T01:10:26.183586+0000","last_clean":"2024-09-12T01:10:26.183586+0000","last_became_active":"2024-09-12T00:30:17.148422+0000","last_became_peered":"2024-09-12T00:30:17.148422+0000","last_unstale":"2024-09-12T01:10:26.183586+0000","last_undegraded":"2024-09-12T01:10:26.183586+0000","last_fullsized":"2024-09-12T01:10:26.183586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:54.544557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":99,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409940+0000","last_change":"2024-09-12T00:30:19.163744+0000","last_active":"2024-09-12T01:08:58.409940+0000","last_peered":"2024-09-12T01:08:58.409940+0000","last_clean":"2024-09-12T01:08:58.409940+0000","last_became_active":"2024-09-12T00:30:19.163363+0000","last_became_peered":"2024-09-12T00:30:19.163363+0000","last_unstale":"2024-09-12T01:08:58.409940+0000","last_undegraded":"2024-09-12T01:08:58.409940+0000","last_fullsized":"2024-09-12T01:08:58.409940+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:34.458854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'134","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.285173+0000","last_change":"2024-09-12T00:30:21.180741+0000","last_active":"2024-09-12T01:09:46.285173+0000","last_peered":"2024-09-12T01:09:46.285173+0000","last_clean":"2024-09-12T01:09:46.285173+0000","last_became_active":"2024-09-12T00:30:21.180419+0000","last_became_peered":"2024-09-12T00:30:21.180419+0000","last_unstale":"2024-09-12T01:09:46.285173+0000","last_undegraded":"2024-09-12T01:09:46.285173+0000","last_fullsized":"2024-09-12T01:09:46.285173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.115939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":136,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'120","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.531565+0000","last_change":"2024-09-12T00:30:13.126841+0000","last_active":"2024-09-12T01:09:21.531565+0000","last_peered":"2024-09-12T01:09:21.531565+0000","last_clean":"2024-09-12T01:09:21.531565+0000","last_became_active":"2024-09-12T00:30:13.126531+0000","last_became_peered":"2024-09-12T00:30:13.126531+0000","last_unstale":"2024-09-12T01:09:21.531565+0000","last_undegraded":"2024-09-12T01:09:21.531565+0000","last_fullsized":"2024-09-12T01:09:21.531565+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:10.702442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":438,"num_write":171,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'315","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.537259+0000","last_change":"2024-09-12T00:30:11.112561+0000","last_active":"2024-09-12T01:11:23.537259+0000","last_peered":"2024-09-12T01:11:23.537259+0000","last_clean":"2024-09-12T01:11:23.537259+0000","last_became_active":"2024-09-12T00:30:11.110001+0000","last_became_peered":"2024-09-12T00:30:11.110001+0000","last_unstale":"2024-09-12T01:11:23.537259+0000","last_undegraded":"2024-09-12T01:11:23.537259+0000","last_fullsized":"2024-09-12T01:11:23.537259+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:28.054807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4638876,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":403,"num_read_kb":4100,"num_write":997,"num_write_kb":26242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.520792+0000","last_change":"2024-09-12T00:30:15.126005+0000","last_active":"2024-09-12T01:08:57.520792+0000","last_peered":"2024-09-12T01:08:57.520792+0000","last_clean":"2024-09-12T01:08:57.520792+0000","last_became_active":"2024-09-12T00:30:15.125728+0000","last_became_peered":"2024-09-12T00:30:15.125728+0000","last_unstale":"2024-09-12T01:08:57.520792+0000","last_undegraded":"2024-09-12T01:08:57.520792+0000","last_fullsized":"2024-09-12T01:08:57.520792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:00.586425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'145","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.201330+0000","last_change":"2024-09-12T00:30:17.145113+0000","last_active":"2024-09-12T01:10:26.201330+0000","last_peered":"2024-09-12T01:10:26.201330+0000","last_clean":"2024-09-12T01:10:26.201330+0000","last_became_active":"2024-09-12T00:30:17.144701+0000","last_became_peered":"2024-09-12T00:30:17.144701+0000","last_unstale":"2024-09-12T01:10:26.201330+0000","last_undegraded":"2024-09-12T01:10:26.201330+0000","last_fullsized":"2024-09-12T01:10:26.201330+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:20.054774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":141,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'771","reported_seq":2310,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.506340+0000","last_change":"2024-09-12T00:30:19.170912+0000","last_active":"2024-09-12T01:11:22.506340+0000","last_peered":"2024-09-12T01:11:22.506340+0000","last_clean":"2024-09-12T01:11:22.506340+0000","last_became_active":"2024-09-12T00:30:19.170568+0000","last_became_peered":"2024-09-12T00:30:19.170568+0000","last_unstale":"2024-09-12T01:11:22.506340+0000","last_undegraded":"2024-09-12T01:11:22.506340+0000","last_fullsized":"2024-09-12T01:11:22.506340+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:09.164786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'212","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.922971+0000","last_change":"2024-09-12T00:30:21.188577+0000","last_active":"2024-09-12T01:09:46.922971+0000","last_peered":"2024-09-12T01:09:46.922971+0000","last_clean":"2024-09-12T01:09:46.922971+0000","last_became_active":"2024-09-12T00:30:21.188312+0000","last_became_peered":"2024-09-12T00:30:21.188312+0000","last_unstale":"2024-09-12T01:09:46.922971+0000","last_undegraded":"2024-09-12T01:09:46.922971+0000","last_fullsized":"2024-09-12T01:09:46.922971+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:02.003043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":596,"num_write":468,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'84","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.925453+0000","last_change":"2024-09-12T00:30:13.128485+0000","last_active":"2024-09-12T01:09:10.925453+0000","last_peered":"2024-09-12T01:09:10.925453+0000","last_clean":"2024-09-12T01:09:10.925453+0000","last_became_active":"2024-09-12T00:30:13.125323+0000","last_became_peered":"2024-09-12T00:30:13.125323+0000","last_unstale":"2024-09-12T01:09:10.925453+0000","last_undegraded":"2024-09-12T01:09:10.925453+0000","last_fullsized":"2024-09-12T01:09:10.925453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:35.611738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":383,"num_read_kb":333,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'376","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.390231+0000","last_change":"2024-09-12T00:30:11.102149+0000","last_active":"2024-09-12T01:11:23.390231+0000","last_peered":"2024-09-12T01:11:23.390231+0000","last_clean":"2024-09-12T01:11:23.390231+0000","last_became_active":"2024-09-12T00:30:11.101745+0000","last_became_peered":"2024-09-12T00:30:11.101745+0000","last_unstale":"2024-09-12T01:11:23.390231+0000","last_undegraded":"2024-09-12T01:11:23.390231+0000","last_fullsized":"2024-09-12T01:11:23.390231+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:28.329293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270498,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":729,"num_read_kb":23420,"num_write":1224,"num_write_kb":19418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605977+0000","last_change":"2024-09-12T00:30:15.124922+0000","last_active":"2024-09-12T01:08:58.605977+0000","last_peered":"2024-09-12T01:08:58.605977+0000","last_clean":"2024-09-12T01:08:58.605977+0000","last_became_active":"2024-09-12T00:30:15.124597+0000","last_became_peered":"2024-09-12T00:30:15.124597+0000","last_unstale":"2024-09-12T01:08:58.605977+0000","last_undegraded":"2024-09-12T01:08:58.605977+0000","last_fullsized":"2024-09-12T01:08:58.605977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:33.763481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'257","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.466288+0000","last_change":"2024-09-12T00:30:17.146147+0000","last_active":"2024-09-12T01:10:51.466288+0000","last_peered":"2024-09-12T01:10:51.466288+0000","last_clean":"2024-09-12T01:10:51.466288+0000","last_became_active":"2024-09-12T00:30:17.145866+0000","last_became_peered":"2024-09-12T00:30:17.145866+0000","last_unstale":"2024-09-12T01:10:51.466288+0000","last_undegraded":"2024-09-12T01:10:51.466288+0000","last_fullsized":"2024-09-12T01:10:51.466288+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:44.866654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56379,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":424,"num_read_kb":883,"num_write":348,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'797","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.507144+0000","last_change":"2024-09-12T00:30:19.172788+0000","last_active":"2024-09-12T01:10:51.507144+0000","last_peered":"2024-09-12T01:10:51.507144+0000","last_clean":"2024-09-12T01:10:51.507144+0000","last_became_active":"2024-09-12T00:30:19.172403+0000","last_became_peered":"2024-09-12T00:30:19.172403+0000","last_unstale":"2024-09-12T01:10:51.507144+0000","last_undegraded":"2024-09-12T01:10:51.507144+0000","last_fullsized":"2024-09-12T01:10:51.507144+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:18.079531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'131","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:26.492883+0000","last_change":"2024-09-12T00:30:13.120892+0000","last_active":"2024-09-12T01:09:26.492883+0000","last_peered":"2024-09-12T01:09:26.492883+0000","last_clean":"2024-09-12T01:09:26.492883+0000","last_became_active":"2024-09-12T00:30:13.120524+0000","last_became_peered":"2024-09-12T00:30:13.120524+0000","last_unstale":"2024-09-12T01:09:26.492883+0000","last_undegraded":"2024-09-12T01:09:26.492883+0000","last_fullsized":"2024-09-12T01:09:26.492883+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:04.978011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":538,"num_write":190,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'341","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.476327+0000","last_change":"2024-09-12T00:30:11.106118+0000","last_active":"2024-09-12T01:11:23.476327+0000","last_peered":"2024-09-12T01:11:23.476327+0000","last_clean":"2024-09-12T01:11:23.476327+0000","last_became_active":"2024-09-12T00:30:11.105769+0000","last_became_peered":"2024-09-12T00:30:11.105769+0000","last_unstale":"2024-09-12T01:11:23.476327+0000","last_undegraded":"2024-09-12T01:11:23.476327+0000","last_fullsized":"2024-09-12T01:11:23.476327+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:02.413308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14227300,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":437,"num_read_kb":22715,"num_write":1071,"num_write_kb":62157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.394488+0000","last_change":"2024-09-12T00:30:15.133021+0000","last_active":"2024-09-12T01:07:08.394488+0000","last_peered":"2024-09-12T01:07:08.394488+0000","last_clean":"2024-09-12T01:07:08.394488+0000","last_became_active":"2024-09-12T00:30:15.132719+0000","last_became_peered":"2024-09-12T00:30:15.132719+0000","last_unstale":"2024-09-12T01:07:08.394488+0000","last_undegraded":"2024-09-12T01:07:08.394488+0000","last_fullsized":"2024-09-12T01:07:08.394488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:07.213409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'355","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.476977+0000","last_change":"2024-09-12T00:30:17.146741+0000","last_active":"2024-09-12T01:10:51.476977+0000","last_peered":"2024-09-12T01:10:51.476977+0000","last_clean":"2024-09-12T01:10:51.476977+0000","last_became_active":"2024-09-12T00:30:17.146465+0000","last_became_peered":"2024-09-12T00:30:17.146465+0000","last_unstale":"2024-09-12T01:10:51.476977+0000","last_undegraded":"2024-09-12T01:10:51.476977+0000","last_fullsized":"2024-09-12T01:10:51.476977+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:45.163258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59352,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":587,"num_read_kb":1107,"num_write":468,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:37.388200+0000","last_change":"2024-09-12T00:30:19.164620+0000","last_active":"2024-09-12T01:08:37.388200+0000","last_peered":"2024-09-12T01:08:37.388200+0000","last_clean":"2024-09-12T01:08:37.388200+0000","last_became_active":"2024-09-12T00:30:19.164249+0000","last_became_peered":"2024-09-12T00:30:19.164249+0000","last_unstale":"2024-09-12T01:08:37.388200+0000","last_undegraded":"2024-09-12T01:08:37.388200+0000","last_fullsized":"2024-09-12T01:08:37.388200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.473748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'544","reported_seq":1352,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490700+0000","last_change":"2024-09-12T00:30:21.189555+0000","last_active":"2024-09-12T01:10:51.490700+0000","last_peered":"2024-09-12T01:10:51.490700+0000","last_clean":"2024-09-12T01:10:51.490700+0000","last_became_active":"2024-09-12T00:30:21.189156+0000","last_became_peered":"2024-09-12T00:30:21.189156+0000","last_unstale":"2024-09-12T01:10:51.490700+0000","last_undegraded":"2024-09-12T01:10:51.490700+0000","last_fullsized":"2024-09-12T01:10:51.490700+0000","mapping_epoch":36,"log_start":"264'500","ondisk_log_start":"264'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:44.394203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1309,"num_read_kb":1298,"num_write":1161,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'143","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411766+0000","last_change":"2024-09-12T00:30:13.124257+0000","last_active":"2024-09-12T01:09:13.411766+0000","last_peered":"2024-09-12T01:09:13.411766+0000","last_clean":"2024-09-12T01:09:13.411766+0000","last_became_active":"2024-09-12T00:30:13.124006+0000","last_became_peered":"2024-09-12T00:30:13.124006+0000","last_unstale":"2024-09-12T01:09:13.411766+0000","last_undegraded":"2024-09-12T01:09:13.411766+0000","last_fullsized":"2024-09-12T01:09:13.411766+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:34.013529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":534,"num_write":203,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'349","reported_seq":1155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.750723+0000","last_change":"2024-09-12T00:30:11.104817+0000","last_active":"2024-09-12T01:09:43.750723+0000","last_peered":"2024-09-12T01:09:43.750723+0000","last_clean":"2024-09-12T01:09:43.750723+0000","last_became_active":"2024-09-12T00:30:11.104314+0000","last_became_peered":"2024-09-12T00:30:11.104314+0000","last_unstale":"2024-09-12T01:09:43.750723+0000","last_undegraded":"2024-09-12T01:09:43.750723+0000","last_fullsized":"2024-09-12T01:09:43.750723+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:39.988458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15014466,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":742,"num_read_kb":45639,"num_write":1475,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375246+0000","last_change":"2024-09-12T00:30:15.125725+0000","last_active":"2024-09-12T01:07:07.375246+0000","last_peered":"2024-09-12T01:07:07.375246+0000","last_clean":"2024-09-12T01:07:07.375246+0000","last_became_active":"2024-09-12T00:30:15.125380+0000","last_became_peered":"2024-09-12T00:30:15.125380+0000","last_unstale":"2024-09-12T01:07:07.375246+0000","last_undegraded":"2024-09-12T01:07:07.375246+0000","last_fullsized":"2024-09-12T01:07:07.375246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:13.819176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'249","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.454948+0000","last_change":"2024-09-12T00:30:17.146917+0000","last_active":"2024-09-12T01:10:51.454948+0000","last_peered":"2024-09-12T01:10:51.454948+0000","last_clean":"2024-09-12T01:10:51.454948+0000","last_became_active":"2024-09-12T00:30:17.145155+0000","last_became_peered":"2024-09-12T00:30:17.145155+0000","last_unstale":"2024-09-12T01:10:51.454948+0000","last_undegraded":"2024-09-12T01:10:51.454948+0000","last_fullsized":"2024-09-12T01:10:51.454948+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.615595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56946,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":408,"num_read_kb":855,"num_write":332,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.506558+0000","last_change":"2024-09-12T00:30:19.171499+0000","last_active":"2024-09-12T01:07:17.506558+0000","last_peered":"2024-09-12T01:07:17.506558+0000","last_clean":"2024-09-12T01:07:17.506558+0000","last_became_active":"2024-09-12T00:30:19.171189+0000","last_became_peered":"2024-09-12T00:30:19.171189+0000","last_unstale":"2024-09-12T01:07:17.506558+0000","last_undegraded":"2024-09-12T01:07:17.506558+0000","last_fullsized":"2024-09-12T01:07:17.506558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:46.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2414","reported_seq":4278,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.417930+0000","last_change":"2024-09-12T00:30:21.184001+0000","last_active":"2024-09-12T01:10:08.417930+0000","last_peered":"2024-09-12T01:10:08.417930+0000","last_clean":"2024-09-12T01:10:08.417930+0000","last_became_active":"2024-09-12T00:30:21.183561+0000","last_became_peered":"2024-09-12T00:30:21.183561+0000","last_unstale":"2024-09-12T01:10:08.417930+0000","last_undegraded":"2024-09-12T01:10:08.417930+0000","last_fullsized":"2024-09-12T01:10:08.417930+0000","mapping_epoch":36,"log_start":"264'2400","ondisk_log_start":"264'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":2400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:10.831146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6196,"num_read_kb":6147,"num_write":4885,"num_write_kb":1795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'180","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.091778+0000","last_change":"2024-09-12T00:30:13.122346+0000","last_active":"2024-09-12T01:08:05.091778+0000","last_peered":"2024-09-12T01:08:05.091778+0000","last_clean":"2024-09-12T01:08:05.091778+0000","last_became_active":"2024-09-12T00:30:13.122098+0000","last_became_peered":"2024-09-12T00:30:13.122098+0000","last_unstale":"2024-09-12T01:08:05.091778+0000","last_undegraded":"2024-09-12T01:08:05.091778+0000","last_fullsized":"2024-09-12T01:08:05.091778+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:08.371631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":634,"num_write":261,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'279","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.561759+0000","last_change":"2024-09-12T00:30:11.113453+0000","last_active":"2024-09-12T01:11:23.561759+0000","last_peered":"2024-09-12T01:11:23.561759+0000","last_clean":"2024-09-12T01:11:23.561759+0000","last_became_active":"2024-09-12T00:30:11.112302+0000","last_became_peered":"2024-09-12T00:30:11.112302+0000","last_unstale":"2024-09-12T01:11:23.561759+0000","last_undegraded":"2024-09-12T01:11:23.561759+0000","last_fullsized":"2024-09-12T01:11:23.561759+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:35.544849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324989,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":431,"num_read_kb":10142,"num_write":947,"num_write_kb":18823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476007+0000","last_change":"2024-09-12T00:30:15.129726+0000","last_active":"2024-09-12T01:08:32.476007+0000","last_peered":"2024-09-12T01:08:32.476007+0000","last_clean":"2024-09-12T01:08:32.476007+0000","last_became_active":"2024-09-12T00:30:15.129311+0000","last_became_peered":"2024-09-12T00:30:15.129311+0000","last_unstale":"2024-09-12T01:08:32.476007+0000","last_undegraded":"2024-09-12T01:08:32.476007+0000","last_fullsized":"2024-09-12T01:08:32.476007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.755744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'301","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.479762+0000","last_change":"2024-09-12T00:30:17.147414+0000","last_active":"2024-09-12T01:10:51.479762+0000","last_peered":"2024-09-12T01:10:51.479762+0000","last_clean":"2024-09-12T01:10:51.479762+0000","last_became_active":"2024-09-12T00:30:17.147148+0000","last_became_peered":"2024-09-12T00:30:17.147148+0000","last_unstale":"2024-09-12T01:10:51.479762+0000","last_undegraded":"2024-09-12T01:10:51.479762+0000","last_fullsized":"2024-09-12T01:10:51.479762+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:05.230391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61211,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1004,"num_write":408,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'797","reported_seq":2324,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.508156+0000","last_change":"2024-09-12T00:30:19.168748+0000","last_active":"2024-09-12T01:10:51.508156+0000","last_peered":"2024-09-12T01:10:51.508156+0000","last_clean":"2024-09-12T01:10:51.508156+0000","last_became_active":"2024-09-12T00:30:19.168419+0000","last_became_peered":"2024-09-12T00:30:19.168419+0000","last_unstale":"2024-09-12T01:10:51.508156+0000","last_undegraded":"2024-09-12T01:10:51.508156+0000","last_fullsized":"2024-09-12T01:10:51.508156+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.358636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'162","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.270455+0000","last_change":"2024-09-12T00:30:21.179851+0000","last_active":"2024-09-12T01:10:50.270455+0000","last_peered":"2024-09-12T01:10:50.270455+0000","last_clean":"2024-09-12T01:10:50.270455+0000","last_became_active":"2024-09-12T00:30:21.179533+0000","last_became_peered":"2024-09-12T00:30:21.179533+0000","last_unstale":"2024-09-12T01:10:50.270455+0000","last_undegraded":"2024-09-12T01:10:50.270455+0000","last_fullsized":"2024-09-12T01:10:50.270455+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:31.165476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":87,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'98","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.459055+0000","last_change":"2024-09-12T00:30:13.131803+0000","last_active":"2024-09-12T01:08:55.459055+0000","last_peered":"2024-09-12T01:08:55.459055+0000","last_clean":"2024-09-12T01:08:55.459055+0000","last_became_active":"2024-09-12T00:30:13.131423+0000","last_became_peered":"2024-09-12T00:30:13.131423+0000","last_unstale":"2024-09-12T01:08:55.459055+0000","last_undegraded":"2024-09-12T01:08:55.459055+0000","last_fullsized":"2024-09-12T01:08:55.459055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:28.163588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":366,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'341","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.472171+0000","last_change":"2024-09-12T00:30:11.103652+0000","last_active":"2024-09-12T01:11:23.472171+0000","last_peered":"2024-09-12T01:11:23.472171+0000","last_clean":"2024-09-12T01:11:23.472171+0000","last_became_active":"2024-09-12T00:30:11.103285+0000","last_became_peered":"2024-09-12T00:30:11.103285+0000","last_unstale":"2024-09-12T01:11:23.472171+0000","last_undegraded":"2024-09-12T01:11:23.472171+0000","last_fullsized":"2024-09-12T01:11:23.472171+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:22.473520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284123,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":536,"num_read_kb":3264,"num_write":1054,"num_write_kb":35970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.376081+0000","last_change":"2024-09-12T00:30:15.132989+0000","last_active":"2024-09-12T01:07:12.376081+0000","last_peered":"2024-09-12T01:07:12.376081+0000","last_clean":"2024-09-12T01:07:12.376081+0000","last_became_active":"2024-09-12T00:30:15.132695+0000","last_became_peered":"2024-09-12T00:30:15.132695+0000","last_unstale":"2024-09-12T01:07:12.376081+0000","last_undegraded":"2024-09-12T01:07:12.376081+0000","last_fullsized":"2024-09-12T01:07:12.376081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:47.371729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'449","reported_seq":1072,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.482261+0000","last_change":"2024-09-12T00:30:17.147365+0000","last_active":"2024-09-12T01:10:51.482261+0000","last_peered":"2024-09-12T01:10:51.482261+0000","last_clean":"2024-09-12T01:10:51.482261+0000","last_became_active":"2024-09-12T00:30:17.147015+0000","last_became_peered":"2024-09-12T00:30:17.147015+0000","last_unstale":"2024-09-12T01:10:51.482261+0000","last_undegraded":"2024-09-12T01:10:51.482261+0000","last_fullsized":"2024-09-12T01:10:51.482261+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.499988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116137,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":761,"num_read_kb":1645,"num_write":620,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.464310+0000","last_change":"2024-09-12T00:30:19.167774+0000","last_active":"2024-09-12T01:07:12.464310+0000","last_peered":"2024-09-12T01:07:12.464310+0000","last_clean":"2024-09-12T01:07:12.464310+0000","last_became_active":"2024-09-12T00:30:19.167503+0000","last_became_peered":"2024-09-12T00:30:19.167503+0000","last_unstale":"2024-09-12T01:07:12.464310+0000","last_undegraded":"2024-09-12T01:07:12.464310+0000","last_fullsized":"2024-09-12T01:07:12.464310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:36.705384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'96","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.090386+0000","last_change":"2024-09-12T00:30:21.192974+0000","last_active":"2024-09-12T01:09:27.090386+0000","last_peered":"2024-09-12T01:09:27.090386+0000","last_clean":"2024-09-12T01:09:27.090386+0000","last_became_active":"2024-09-12T00:30:21.192700+0000","last_became_peered":"2024-09-12T00:30:21.192700+0000","last_unstale":"2024-09-12T01:09:27.090386+0000","last_undegraded":"2024-09-12T01:09:27.090386+0000","last_fullsized":"2024-09-12T01:09:27.090386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:29.992638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":205,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'119","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.885840+0000","last_change":"2024-09-12T00:30:13.128514+0000","last_active":"2024-09-12T01:09:23.885840+0000","last_peered":"2024-09-12T01:09:23.885840+0000","last_clean":"2024-09-12T01:09:23.885840+0000","last_became_active":"2024-09-12T00:30:13.128253+0000","last_became_peered":"2024-09-12T00:30:13.128253+0000","last_unstale":"2024-09-12T01:09:23.885840+0000","last_undegraded":"2024-09-12T01:09:23.885840+0000","last_fullsized":"2024-09-12T01:09:23.885840+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:27.745822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":431,"num_write":189,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'277","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.249150+0000","last_change":"2024-09-12T00:30:11.100672+0000","last_active":"2024-09-12T01:11:23.249150+0000","last_peered":"2024-09-12T01:11:23.249150+0000","last_clean":"2024-09-12T01:11:23.249150+0000","last_became_active":"2024-09-12T00:30:11.100056+0000","last_became_peered":"2024-09-12T00:30:11.100056+0000","last_unstale":"2024-09-12T01:11:23.249150+0000","last_undegraded":"2024-09-12T01:11:23.249150+0000","last_fullsized":"2024-09-12T01:11:23.249150+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:16.381329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380833,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":444,"num_read_kb":62849,"num_write":1050,"num_write_kb":31335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.386352+0000","last_change":"2024-09-12T00:30:15.133052+0000","last_active":"2024-09-12T01:08:33.386352+0000","last_peered":"2024-09-12T01:08:33.386352+0000","last_clean":"2024-09-12T01:08:33.386352+0000","last_became_active":"2024-09-12T00:30:15.132801+0000","last_became_peered":"2024-09-12T00:30:15.132801+0000","last_unstale":"2024-09-12T01:08:33.386352+0000","last_undegraded":"2024-09-12T01:08:33.386352+0000","last_fullsized":"2024-09-12T01:08:33.386352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:47.232632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'293","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.966157+0000","last_change":"2024-09-12T00:30:17.149925+0000","last_active":"2024-09-12T01:11:22.966157+0000","last_peered":"2024-09-12T01:11:22.966157+0000","last_clean":"2024-09-12T01:11:22.966157+0000","last_became_active":"2024-09-12T00:30:17.149603+0000","last_became_peered":"2024-09-12T00:30:17.149603+0000","last_unstale":"2024-09-12T01:11:22.966157+0000","last_undegraded":"2024-09-12T01:11:22.966157+0000","last_fullsized":"2024-09-12T01:11:22.966157+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.420246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57292,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":510,"num_read_kb":1117,"num_write":456,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.387057+0000","last_change":"2024-09-12T00:30:19.168486+0000","last_active":"2024-09-12T01:08:38.387057+0000","last_peered":"2024-09-12T01:08:38.387057+0000","last_clean":"2024-09-12T01:08:38.387057+0000","last_became_active":"2024-09-12T00:30:19.168223+0000","last_became_peered":"2024-09-12T00:30:19.168223+0000","last_unstale":"2024-09-12T01:08:38.387057+0000","last_undegraded":"2024-09-12T01:08:38.387057+0000","last_fullsized":"2024-09-12T01:08:38.387057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'123","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:27.493758+0000","last_change":"2024-09-12T00:30:21.192816+0000","last_active":"2024-09-12T01:10:27.493758+0000","last_peered":"2024-09-12T01:10:27.493758+0000","last_clean":"2024-09-12T01:10:27.493758+0000","last_became_active":"2024-09-12T00:30:21.192509+0000","last_became_peered":"2024-09-12T00:30:21.192509+0000","last_unstale":"2024-09-12T01:10:27.493758+0000","last_undegraded":"2024-09-12T01:10:27.493758+0000","last_fullsized":"2024-09-12T01:10:27.493758+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:26.935855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'134","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.147039+0000","last_change":"2024-09-12T00:30:13.123694+0000","last_active":"2024-09-12T01:09:32.147039+0000","last_peered":"2024-09-12T01:09:32.147039+0000","last_clean":"2024-09-12T01:09:32.147039+0000","last_became_active":"2024-09-12T00:30:13.123412+0000","last_became_peered":"2024-09-12T00:30:13.123412+0000","last_unstale":"2024-09-12T01:09:32.147039+0000","last_undegraded":"2024-09-12T01:09:32.147039+0000","last_fullsized":"2024-09-12T01:09:32.147039+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:23.159421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":514,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'258","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.603553+0000","last_change":"2024-09-12T00:30:11.098282+0000","last_active":"2024-09-12T01:11:23.603553+0000","last_peered":"2024-09-12T01:11:23.603553+0000","last_clean":"2024-09-12T01:11:23.603553+0000","last_became_active":"2024-09-12T00:30:11.097902+0000","last_became_peered":"2024-09-12T00:30:11.097902+0000","last_unstale":"2024-09-12T01:11:23.603553+0000","last_undegraded":"2024-09-12T01:11:23.603553+0000","last_fullsized":"2024-09-12T01:11:23.603553+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.859119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2387060,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":404,"num_read_kb":17154,"num_write":960,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476034+0000","last_change":"2024-09-12T00:30:15.125920+0000","last_active":"2024-09-12T01:08:32.476034+0000","last_peered":"2024-09-12T01:08:32.476034+0000","last_clean":"2024-09-12T01:08:32.476034+0000","last_became_active":"2024-09-12T00:30:15.125629+0000","last_became_peered":"2024-09-12T00:30:15.125629+0000","last_unstale":"2024-09-12T01:08:32.476034+0000","last_undegraded":"2024-09-12T01:08:32.476034+0000","last_fullsized":"2024-09-12T01:08:32.476034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:47.978464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'278","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.489267+0000","last_change":"2024-09-12T00:30:17.149967+0000","last_active":"2024-09-12T01:10:51.489267+0000","last_peered":"2024-09-12T01:10:51.489267+0000","last_clean":"2024-09-12T01:10:51.489267+0000","last_became_active":"2024-09-12T00:30:17.149661+0000","last_became_peered":"2024-09-12T00:30:17.149661+0000","last_unstale":"2024-09-12T01:10:51.489267+0000","last_undegraded":"2024-09-12T01:10:51.489267+0000","last_fullsized":"2024-09-12T01:10:51.489267+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:40.653446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61294,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":921,"num_write":366,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'761","reported_seq":2256,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.506608+0000","last_change":"2024-09-12T00:30:19.167751+0000","last_active":"2024-09-12T01:11:22.506608+0000","last_peered":"2024-09-12T01:11:22.506608+0000","last_clean":"2024-09-12T01:11:22.506608+0000","last_became_active":"2024-09-12T00:30:19.167476+0000","last_became_peered":"2024-09-12T00:30:19.167476+0000","last_unstale":"2024-09-12T01:11:22.506608+0000","last_undegraded":"2024-09-12T01:11:22.506608+0000","last_fullsized":"2024-09-12T01:11:22.506608+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:15.217938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'158","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.465466+0000","last_change":"2024-09-12T00:30:21.187022+0000","last_active":"2024-09-12T01:08:14.465466+0000","last_peered":"2024-09-12T01:08:14.465466+0000","last_clean":"2024-09-12T01:08:14.465466+0000","last_became_active":"2024-09-12T00:30:21.185553+0000","last_became_peered":"2024-09-12T00:30:21.185553+0000","last_unstale":"2024-09-12T01:08:14.465466+0000","last_undegraded":"2024-09-12T01:08:14.465466+0000","last_fullsized":"2024-09-12T01:08:14.465466+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:17.382517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":222,"num_write":391,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'167","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:31.495475+0000","last_change":"2024-09-12T00:30:13.121937+0000","last_active":"2024-09-12T01:08:31.495475+0000","last_peered":"2024-09-12T01:08:31.495475+0000","last_clean":"2024-09-12T01:08:31.495475+0000","last_became_active":"2024-09-12T00:30:13.121664+0000","last_became_peered":"2024-09-12T00:30:13.121664+0000","last_unstale":"2024-09-12T01:08:31.495475+0000","last_undegraded":"2024-09-12T01:08:31.495475+0000","last_fullsized":"2024-09-12T01:08:31.495475+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:50.278462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":568,"num_write":259,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'492","reported_seq":1306,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.628816+0000","last_change":"2024-09-12T00:30:11.112653+0000","last_active":"2024-09-12T01:11:23.628816+0000","last_peered":"2024-09-12T01:11:23.628816+0000","last_clean":"2024-09-12T01:11:23.628816+0000","last_became_active":"2024-09-12T00:30:11.110370+0000","last_became_peered":"2024-09-12T00:30:11.110370+0000","last_unstale":"2024-09-12T01:11:23.628816+0000","last_undegraded":"2024-09-12T01:11:23.628816+0000","last_fullsized":"2024-09-12T01:11:23.628816+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:29.346634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181242,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":1197,"num_read_kb":75458,"num_write":1566,"num_write_kb":22075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.488233+0000","last_change":"2024-09-12T00:30:15.133096+0000","last_active":"2024-09-12T01:11:22.488233+0000","last_peered":"2024-09-12T01:11:22.488233+0000","last_clean":"2024-09-12T01:11:22.488233+0000","last_became_active":"2024-09-12T00:30:15.132802+0000","last_became_peered":"2024-09-12T00:30:15.132802+0000","last_unstale":"2024-09-12T01:11:22.488233+0000","last_undegraded":"2024-09-12T01:11:22.488233+0000","last_fullsized":"2024-09-12T01:11:22.488233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:41.563778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'74","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.169269+0000","last_change":"2024-09-12T00:30:17.148149+0000","last_active":"2024-09-12T01:10:26.169269+0000","last_peered":"2024-09-12T01:10:26.169269+0000","last_clean":"2024-09-12T01:10:26.169269+0000","last_became_active":"2024-09-12T00:30:17.147864+0000","last_became_peered":"2024-09-12T00:30:17.147864+0000","last_unstale":"2024-09-12T01:10:26.169269+0000","last_undegraded":"2024-09-12T01:10:26.169269+0000","last_fullsized":"2024-09-12T01:10:26.169269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.850618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'782","reported_seq":2333,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.507478+0000","last_change":"2024-09-12T00:30:19.169220+0000","last_active":"2024-09-12T01:11:22.507478+0000","last_peered":"2024-09-12T01:11:22.507478+0000","last_clean":"2024-09-12T01:11:22.507478+0000","last_became_active":"2024-09-12T00:30:19.168960+0000","last_became_peered":"2024-09-12T00:30:19.168960+0000","last_unstale":"2024-09-12T01:11:22.507478+0000","last_undegraded":"2024-09-12T01:11:22.507478+0000","last_fullsized":"2024-09-12T01:11:22.507478+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:05.977565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.244027+0000","last_change":"2024-09-12T00:30:21.186976+0000","last_active":"2024-09-12T01:08:47.244027+0000","last_peered":"2024-09-12T01:08:47.244027+0000","last_clean":"2024-09-12T01:08:47.244027+0000","last_became_active":"2024-09-12T00:30:21.185618+0000","last_became_peered":"2024-09-12T00:30:21.185618+0000","last_unstale":"2024-09-12T01:08:47.244027+0000","last_undegraded":"2024-09-12T01:08:47.244027+0000","last_fullsized":"2024-09-12T01:08:47.244027+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:37.276257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":151,"num_write":299,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:49.019799+0000","last_change":"2024-09-12T00:30:13.130144+0000","last_active":"2024-09-12T01:08:49.019799+0000","last_peered":"2024-09-12T01:08:49.019799+0000","last_clean":"2024-09-12T01:08:49.019799+0000","last_became_active":"2024-09-12T00:30:13.129892+0000","last_became_peered":"2024-09-12T00:30:13.129892+0000","last_unstale":"2024-09-12T01:08:49.019799+0000","last_undegraded":"2024-09-12T01:08:49.019799+0000","last_fullsized":"2024-09-12T01:08:49.019799+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:52.379617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":984,"num_read_kb":836,"num_write":303,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'260","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:42.940671+0000","last_change":"2024-09-12T00:30:11.103543+0000","last_active":"2024-09-12T01:10:42.940671+0000","last_peered":"2024-09-12T01:10:42.940671+0000","last_clean":"2024-09-12T01:10:42.940671+0000","last_became_active":"2024-09-12T00:30:11.103195+0000","last_became_peered":"2024-09-12T00:30:11.103195+0000","last_unstale":"2024-09-12T01:10:42.940671+0000","last_undegraded":"2024-09-12T01:10:42.940671+0000","last_fullsized":"2024-09-12T01:10:42.940671+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:34.854760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6563396,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":379,"num_read_kb":8246,"num_write":884,"num_write_kb":41947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.602445+0000","last_change":"2024-09-12T00:30:15.128205+0000","last_active":"2024-09-12T01:08:33.602445+0000","last_peered":"2024-09-12T01:08:33.602445+0000","last_clean":"2024-09-12T01:08:33.602445+0000","last_became_active":"2024-09-12T00:30:15.127047+0000","last_became_peered":"2024-09-12T00:30:15.127047+0000","last_unstale":"2024-09-12T01:08:33.602445+0000","last_undegraded":"2024-09-12T01:08:33.602445+0000","last_fullsized":"2024-09-12T01:08:33.602445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:24.381773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'306","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.473780+0000","last_change":"2024-09-12T00:30:17.149883+0000","last_active":"2024-09-12T01:10:51.473780+0000","last_peered":"2024-09-12T01:10:51.473780+0000","last_clean":"2024-09-12T01:10:51.473780+0000","last_became_active":"2024-09-12T00:30:17.149579+0000","last_became_peered":"2024-09-12T00:30:17.149579+0000","last_unstale":"2024-09-12T01:10:51.473780+0000","last_undegraded":"2024-09-12T01:10:51.473780+0000","last_fullsized":"2024-09-12T01:10:51.473780+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:00.182066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49466,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":910,"num_write":384,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496293+0000","last_change":"2024-09-12T00:30:19.169963+0000","last_active":"2024-09-12T01:08:36.496293+0000","last_peered":"2024-09-12T01:08:36.496293+0000","last_clean":"2024-09-12T01:08:36.496293+0000","last_became_active":"2024-09-12T00:30:19.169468+0000","last_became_peered":"2024-09-12T00:30:19.169468+0000","last_unstale":"2024-09-12T01:08:36.496293+0000","last_undegraded":"2024-09-12T01:08:36.496293+0000","last_fullsized":"2024-09-12T01:08:36.496293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.885333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'111","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.875182+0000","last_change":"2024-09-12T00:30:21.184306+0000","last_active":"2024-09-12T01:09:46.875182+0000","last_peered":"2024-09-12T01:09:46.875182+0000","last_clean":"2024-09-12T01:09:46.875182+0000","last_became_active":"2024-09-12T00:30:21.184033+0000","last_became_peered":"2024-09-12T00:30:21.184033+0000","last_unstale":"2024-09-12T01:09:46.875182+0000","last_undegraded":"2024-09-12T01:09:46.875182+0000","last_fullsized":"2024-09-12T01:09:46.875182+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.799929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":266,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'245","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.688573+0000","last_change":"2024-09-12T00:30:13.121232+0000","last_active":"2024-09-12T01:08:19.688573+0000","last_peered":"2024-09-12T01:08:19.688573+0000","last_clean":"2024-09-12T01:08:19.688573+0000","last_became_active":"2024-09-12T00:30:13.120962+0000","last_became_peered":"2024-09-12T00:30:13.120962+0000","last_unstale":"2024-09-12T01:08:19.688573+0000","last_undegraded":"2024-09-12T01:08:19.688573+0000","last_fullsized":"2024-09-12T01:08:19.688573+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:29.222097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":839,"num_write":403,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403142+0000","last_change":"2024-09-12T00:29:54.471707+0000","last_active":"2024-09-12T01:08:08.403142+0000","last_peered":"2024-09-12T01:08:08.403142+0000","last_clean":"2024-09-12T01:08:08.403142+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T01:08:08.403142+0000","last_undegraded":"2024-09-12T01:08:08.403142+0000","last_fullsized":"2024-09-12T01:08:08.403142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_clean_scrub_stamp":"2024-09-12T00:29:53.438265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.897736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594622+0000","last_change":"2024-09-12T00:30:01.530800+0000","last_active":"2024-09-12T01:07:33.594622+0000","last_peered":"2024-09-12T01:07:33.594622+0000","last_clean":"2024-09-12T01:07:33.594622+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T01:07:33.594622+0000","last_undegraded":"2024-09-12T01:07:33.594622+0000","last_fullsized":"2024-09-12T01:07:33.594622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:58.930249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'255","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.751009+0000","last_change":"2024-09-12T00:30:11.102970+0000","last_active":"2024-09-12T01:09:43.751009+0000","last_peered":"2024-09-12T01:09:43.751009+0000","last_clean":"2024-09-12T01:09:43.751009+0000","last_became_active":"2024-09-12T00:30:11.102144+0000","last_became_peered":"2024-09-12T00:30:11.102144+0000","last_unstale":"2024-09-12T01:09:43.751009+0000","last_undegraded":"2024-09-12T01:09:43.751009+0000","last_fullsized":"2024-09-12T01:09:43.751009+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:38.319543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14238165,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":368,"num_read_kb":17991,"num_write":923,"num_write_kb":40410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"38'3","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.477731+0000","last_change":"2024-09-12T00:30:15.132691+0000","last_active":"2024-09-12T01:11:22.477731+0000","last_peered":"2024-09-12T01:11:22.477731+0000","last_clean":"2024-09-12T01:11:22.477731+0000","last_became_active":"2024-09-12T00:30:15.132332+0000","last_became_peered":"2024-09-12T00:30:15.132332+0000","last_unstale":"2024-09-12T01:11:22.477731+0000","last_undegraded":"2024-09-12T01:11:22.477731+0000","last_fullsized":"2024-09-12T01:11:22.477731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:09.196418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'701","reported_seq":1384,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.593925+0000","last_change":"2024-09-12T00:30:17.150136+0000","last_active":"2024-09-12T01:11:23.593925+0000","last_peered":"2024-09-12T01:11:23.593925+0000","last_clean":"2024-09-12T01:11:23.593925+0000","last_became_active":"2024-09-12T00:30:17.149842+0000","last_became_peered":"2024-09-12T00:30:17.149842+0000","last_unstale":"2024-09-12T01:11:23.593925+0000","last_undegraded":"2024-09-12T01:11:23.593925+0000","last_fullsized":"2024-09-12T01:11:23.593925+0000","mapping_epoch":32,"log_start":"264'600","ondisk_log_start":"264'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.362386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185190,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1370,"num_read_kb":2889,"num_write":1303,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.464436+0000","last_change":"2024-09-12T00:30:19.168459+0000","last_active":"2024-09-12T01:07:12.464436+0000","last_peered":"2024-09-12T01:07:12.464436+0000","last_clean":"2024-09-12T01:07:12.464436+0000","last_became_active":"2024-09-12T00:30:19.168219+0000","last_became_peered":"2024-09-12T00:30:19.168219+0000","last_unstale":"2024-09-12T01:07:12.464436+0000","last_undegraded":"2024-09-12T01:07:12.464436+0000","last_fullsized":"2024-09-12T01:07:12.464436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:10.717786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'214","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:45.780203+0000","last_change":"2024-09-12T00:30:21.192045+0000","last_active":"2024-09-12T01:09:45.780203+0000","last_peered":"2024-09-12T01:09:45.780203+0000","last_clean":"2024-09-12T01:09:45.780203+0000","last_became_active":"2024-09-12T00:30:21.191389+0000","last_became_peered":"2024-09-12T00:30:21.191389+0000","last_unstale":"2024-09-12T01:09:45.780203+0000","last_undegraded":"2024-09-12T01:09:45.780203+0000","last_fullsized":"2024-09-12T01:09:45.780203+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:50.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":544,"num_write":463,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'83","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.482265+0000","last_change":"2024-09-12T00:30:13.124765+0000","last_active":"2024-09-12T01:09:12.482265+0000","last_peered":"2024-09-12T01:09:12.482265+0000","last_clean":"2024-09-12T01:09:12.482265+0000","last_became_active":"2024-09-12T00:30:13.124407+0000","last_became_peered":"2024-09-12T00:30:13.124407+0000","last_unstale":"2024-09-12T01:09:12.482265+0000","last_undegraded":"2024-09-12T01:09:12.482265+0000","last_fullsized":"2024-09-12T01:09:12.482265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:33.269760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":258,"num_write":150,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.598985+0000","last_change":"2024-09-12T00:30:01.530206+0000","last_active":"2024-09-12T01:08:08.598985+0000","last_peered":"2024-09-12T01:08:08.598985+0000","last_clean":"2024-09-12T01:08:08.598985+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T01:08:08.598985+0000","last_undegraded":"2024-09-12T01:08:08.598985+0000","last_fullsized":"2024-09-12T01:08:08.598985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:48.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'316","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.470506+0000","last_change":"2024-09-12T00:30:11.099484+0000","last_active":"2024-09-12T01:09:23.470506+0000","last_peered":"2024-09-12T01:09:23.470506+0000","last_clean":"2024-09-12T01:09:23.470506+0000","last_became_active":"2024-09-12T00:30:11.099065+0000","last_became_peered":"2024-09-12T00:30:11.099065+0000","last_unstale":"2024-09-12T01:09:23.470506+0000","last_undegraded":"2024-09-12T01:09:23.470506+0000","last_fullsized":"2024-09-12T01:09:23.470506+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:19.401122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2020207,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":452,"num_read_kb":8968,"num_write":1100,"num_write_kb":21800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590364+0000","last_change":"2024-09-12T00:30:15.130834+0000","last_active":"2024-09-12T01:07:08.590364+0000","last_peered":"2024-09-12T01:07:08.590364+0000","last_clean":"2024-09-12T01:07:08.590364+0000","last_became_active":"2024-09-12T00:30:15.130490+0000","last_became_peered":"2024-09-12T00:30:15.130490+0000","last_unstale":"2024-09-12T01:07:08.590364+0000","last_undegraded":"2024-09-12T01:07:08.590364+0000","last_fullsized":"2024-09-12T01:07:08.590364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:41.519057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'1348","reported_seq":2766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.768645+0000","last_change":"2024-09-12T00:30:17.146700+0000","last_active":"2024-09-12T01:11:22.768645+0000","last_peered":"2024-09-12T01:11:22.768645+0000","last_clean":"2024-09-12T01:11:22.768645+0000","last_became_active":"2024-09-12T00:30:17.146374+0000","last_became_peered":"2024-09-12T00:30:17.146374+0000","last_unstale":"2024-09-12T01:11:22.768645+0000","last_undegraded":"2024-09-12T01:11:22.768645+0000","last_fullsized":"2024-09-12T01:11:22.768645+0000","mapping_epoch":32,"log_start":"264'1300","ondisk_log_start":"264'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:46.392573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186701,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2147,"num_read_kb":3978,"num_write":1250,"num_write_kb":1090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.597073+0000","last_change":"2024-09-12T00:30:19.169975+0000","last_active":"2024-09-12T01:07:53.597073+0000","last_peered":"2024-09-12T01:07:53.597073+0000","last_clean":"2024-09-12T01:07:53.597073+0000","last_became_active":"2024-09-12T00:30:19.169700+0000","last_became_peered":"2024-09-12T00:30:19.169700+0000","last_unstale":"2024-09-12T01:07:53.597073+0000","last_undegraded":"2024-09-12T01:07:53.597073+0000","last_fullsized":"2024-09-12T01:07:53.597073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:43.445292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'95","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.451982+0000","last_change":"2024-09-12T00:30:21.193756+0000","last_active":"2024-09-12T01:09:28.451982+0000","last_peered":"2024-09-12T01:09:28.451982+0000","last_clean":"2024-09-12T01:09:28.451982+0000","last_became_active":"2024-09-12T00:30:21.193491+0000","last_became_peered":"2024-09-12T00:30:21.193491+0000","last_unstale":"2024-09-12T01:09:28.451982+0000","last_undegraded":"2024-09-12T01:09:28.451982+0000","last_fullsized":"2024-09-12T01:09:28.451982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:22.498346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":108,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'101","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.393014+0000","last_change":"2024-09-12T00:30:13.124361+0000","last_active":"2024-09-12T01:09:12.393014+0000","last_peered":"2024-09-12T01:09:12.393014+0000","last_clean":"2024-09-12T01:09:12.393014+0000","last_became_active":"2024-09-12T00:30:13.124085+0000","last_became_peered":"2024-09-12T00:30:13.124085+0000","last_unstale":"2024-09-12T01:09:12.393014+0000","last_undegraded":"2024-09-12T01:09:12.393014+0000","last_fullsized":"2024-09-12T01:09:12.393014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:04.474974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":146,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.378595+0000","last_change":"2024-09-12T00:30:01.610469+0000","last_active":"2024-09-12T01:07:33.378595+0000","last_peered":"2024-09-12T01:07:33.378595+0000","last_clean":"2024-09-12T01:07:33.378595+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T01:07:33.378595+0000","last_undegraded":"2024-09-12T01:07:33.378595+0000","last_fullsized":"2024-09-12T01:07:33.378595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:35.665518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'292","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.649534+0000","last_change":"2024-09-12T00:30:46.767164+0000","last_active":"2024-09-12T01:09:33.649534+0000","last_peered":"2024-09-12T01:09:33.649534+0000","last_clean":"2024-09-12T01:09:33.649534+0000","last_became_active":"2024-09-12T00:30:46.766731+0000","last_became_peered":"2024-09-12T00:30:46.766731+0000","last_unstale":"2024-09-12T01:09:33.649534+0000","last_undegraded":"2024-09-12T01:09:33.649534+0000","last_fullsized":"2024-09-12T01:09:33.649534+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:46.403345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13020287,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":466,"num_read_kb":16356,"num_write":1122,"num_write_kb":34470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,4],"acting":[5,7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.374902+0000","last_change":"2024-09-12T00:30:15.133051+0000","last_active":"2024-09-12T01:07:08.374902+0000","last_peered":"2024-09-12T01:07:08.374902+0000","last_clean":"2024-09-12T01:07:08.374902+0000","last_became_active":"2024-09-12T00:30:15.132744+0000","last_became_peered":"2024-09-12T00:30:15.132744+0000","last_unstale":"2024-09-12T01:07:08.374902+0000","last_undegraded":"2024-09-12T01:07:08.374902+0000","last_fullsized":"2024-09-12T01:07:08.374902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:50.803146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'217","reported_seq":1253,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.310283+0000","last_change":"2024-09-12T00:30:17.145576+0000","last_active":"2024-09-12T01:10:50.310283+0000","last_peered":"2024-09-12T01:10:50.310283+0000","last_clean":"2024-09-12T01:10:50.310283+0000","last_became_active":"2024-09-12T00:30:17.145284+0000","last_became_peered":"2024-09-12T00:30:17.145284+0000","last_unstale":"2024-09-12T01:10:50.310283+0000","last_undegraded":"2024-09-12T01:10:50.310283+0000","last_fullsized":"2024-09-12T01:10:50.310283+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:04.503798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":145,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511658+0000","last_change":"2024-09-12T00:30:19.169714+0000","last_active":"2024-09-12T01:07:52.511658+0000","last_peered":"2024-09-12T01:07:52.511658+0000","last_clean":"2024-09-12T01:07:52.511658+0000","last_became_active":"2024-09-12T00:30:19.169439+0000","last_became_peered":"2024-09-12T00:30:19.169439+0000","last_unstale":"2024-09-12T01:07:52.511658+0000","last_undegraded":"2024-09-12T01:07:52.511658+0000","last_fullsized":"2024-09-12T01:07:52.511658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:26.888194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'342","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.969662+0000","last_change":"2024-09-12T00:30:21.187938+0000","last_active":"2024-09-12T01:09:46.969662+0000","last_peered":"2024-09-12T01:09:46.969662+0000","last_clean":"2024-09-12T01:09:46.969662+0000","last_became_active":"2024-09-12T00:30:21.187616+0000","last_became_peered":"2024-09-12T00:30:21.187616+0000","last_unstale":"2024-09-12T01:09:46.969662+0000","last_undegraded":"2024-09-12T01:09:46.969662+0000","last_fullsized":"2024-09-12T01:09:46.969662+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:17.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":676,"num_read_kb":665,"num_write":755,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'375","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.067358+0000","last_change":"2024-09-12T00:30:13.123029+0000","last_active":"2024-09-12T01:09:09.067358+0000","last_peered":"2024-09-12T01:09:09.067358+0000","last_clean":"2024-09-12T01:09:09.067358+0000","last_became_active":"2024-09-12T00:30:13.122751+0000","last_became_peered":"2024-09-12T00:30:13.122751+0000","last_unstale":"2024-09-12T01:09:09.067358+0000","last_undegraded":"2024-09-12T01:09:09.067358+0000","last_fullsized":"2024-09-12T01:09:09.067358+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:58.496482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1941,"num_read_kb":1679,"num_write":648,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594595+0000","last_change":"2024-09-12T00:30:01.530685+0000","last_active":"2024-09-12T01:07:33.594595+0000","last_peered":"2024-09-12T01:07:33.594595+0000","last_clean":"2024-09-12T01:07:33.594595+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T01:07:33.594595+0000","last_undegraded":"2024-09-12T01:07:33.594595+0000","last_fullsized":"2024-09-12T01:07:33.594595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:49.919156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'359","reported_seq":1092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.439930+0000","last_change":"2024-09-12T00:30:11.100580+0000","last_active":"2024-09-12T01:11:23.439930+0000","last_peered":"2024-09-12T01:11:23.439930+0000","last_clean":"2024-09-12T01:11:23.439930+0000","last_became_active":"2024-09-12T00:30:11.100253+0000","last_became_peered":"2024-09-12T00:30:11.100253+0000","last_unstale":"2024-09-12T01:11:23.439930+0000","last_undegraded":"2024-09-12T01:11:23.439930+0000","last_fullsized":"2024-09-12T01:11:23.439930+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:01.683692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12863237,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":812,"num_read_kb":32409,"num_write":1218,"num_write_kb":44212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.380734+0000","last_change":"2024-09-12T00:30:15.128086+0000","last_active":"2024-09-12T01:07:48.380734+0000","last_peered":"2024-09-12T01:07:48.380734+0000","last_clean":"2024-09-12T01:07:48.380734+0000","last_became_active":"2024-09-12T00:30:15.127835+0000","last_became_peered":"2024-09-12T00:30:15.127835+0000","last_unstale":"2024-09-12T01:07:48.380734+0000","last_undegraded":"2024-09-12T01:07:48.380734+0000","last_fullsized":"2024-09-12T01:07:48.380734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:47.620246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'123","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.156498+0000","last_change":"2024-09-12T00:30:17.148863+0000","last_active":"2024-09-12T01:10:26.156498+0000","last_peered":"2024-09-12T01:10:26.156498+0000","last_clean":"2024-09-12T01:10:26.156498+0000","last_became_active":"2024-09-12T00:30:17.148548+0000","last_became_peered":"2024-09-12T00:30:17.148548+0000","last_unstale":"2024-09-12T01:10:26.156498+0000","last_undegraded":"2024-09-12T01:10:26.156498+0000","last_fullsized":"2024-09-12T01:10:26.156498+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590341+0000","last_change":"2024-09-12T00:30:19.165383+0000","last_active":"2024-09-12T01:07:08.590341+0000","last_peered":"2024-09-12T01:07:08.590341+0000","last_clean":"2024-09-12T01:07:08.590341+0000","last_became_active":"2024-09-12T00:30:19.165120+0000","last_became_peered":"2024-09-12T00:30:19.165120+0000","last_unstale":"2024-09-12T01:07:08.590341+0000","last_undegraded":"2024-09-12T01:07:08.590341+0000","last_fullsized":"2024-09-12T01:07:08.590341+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:24.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'134","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.882688+0000","last_change":"2024-09-12T00:30:21.181012+0000","last_active":"2024-09-12T01:09:23.882688+0000","last_peered":"2024-09-12T01:09:23.882688+0000","last_clean":"2024-09-12T01:09:23.882688+0000","last_became_active":"2024-09-12T00:30:21.180708+0000","last_became_peered":"2024-09-12T00:30:21.180708+0000","last_unstale":"2024-09-12T01:09:23.882688+0000","last_undegraded":"2024-09-12T01:09:23.882688+0000","last_fullsized":"2024-09-12T01:09:23.882688+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:50.395523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":239,"num_write":325,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'170","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.380239+0000","last_change":"2024-09-12T00:30:13.130893+0000","last_active":"2024-09-12T01:07:42.380239+0000","last_peered":"2024-09-12T01:07:42.380239+0000","last_clean":"2024-09-12T01:07:42.380239+0000","last_became_active":"2024-09-12T00:30:13.130610+0000","last_became_peered":"2024-09-12T00:30:13.130610+0000","last_unstale":"2024-09-12T01:07:42.380239+0000","last_undegraded":"2024-09-12T01:07:42.380239+0000","last_fullsized":"2024-09-12T01:07:42.380239+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:26.005542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":757,"num_read_kb":608,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'255","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:26.086446+0000","last_change":"2024-09-12T00:30:11.104365+0000","last_active":"2024-09-12T01:09:26.086446+0000","last_peered":"2024-09-12T01:09:26.086446+0000","last_clean":"2024-09-12T01:09:26.086446+0000","last_became_active":"2024-09-12T00:30:11.104002+0000","last_became_peered":"2024-09-12T00:30:11.104002+0000","last_unstale":"2024-09-12T01:09:26.086446+0000","last_undegraded":"2024-09-12T01:09:26.086446+0000","last_fullsized":"2024-09-12T01:09:26.086446+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:42.652998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8724393,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":344,"num_read_kb":13267,"num_write":870,"num_write_kb":33802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:32.467396+0000","last_change":"2024-09-12T00:30:01.575846+0000","last_active":"2024-09-12T01:07:32.467396+0000","last_peered":"2024-09-12T01:07:32.467396+0000","last_clean":"2024-09-12T01:07:32.467396+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T01:07:32.467396+0000","last_undegraded":"2024-09-12T01:07:32.467396+0000","last_fullsized":"2024-09-12T01:07:32.467396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:02.507794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510721+0000","last_change":"2024-09-12T00:30:15.127858+0000","last_active":"2024-09-12T01:07:47.510721+0000","last_peered":"2024-09-12T01:07:47.510721+0000","last_clean":"2024-09-12T01:07:47.510721+0000","last_became_active":"2024-09-12T00:30:15.127513+0000","last_became_peered":"2024-09-12T00:30:15.127513+0000","last_unstale":"2024-09-12T01:07:47.510721+0000","last_undegraded":"2024-09-12T01:07:47.510721+0000","last_fullsized":"2024-09-12T01:07:47.510721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:13.431995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'557","reported_seq":1215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.530330+0000","last_change":"2024-09-12T00:30:17.146701+0000","last_active":"2024-09-12T01:11:22.530330+0000","last_peered":"2024-09-12T01:11:22.530330+0000","last_clean":"2024-09-12T01:11:22.530330+0000","last_became_active":"2024-09-12T00:30:17.146141+0000","last_became_peered":"2024-09-12T00:30:17.146141+0000","last_unstale":"2024-09-12T01:11:22.530330+0000","last_undegraded":"2024-09-12T01:11:22.530330+0000","last_fullsized":"2024-09-12T01:11:22.530330+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:34.957314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1533,"num_read_kb":2449,"num_write":2006,"num_write_kb":1846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.490280+0000","last_change":"2024-09-12T00:30:19.168100+0000","last_active":"2024-09-12T01:07:51.490280+0000","last_peered":"2024-09-12T01:07:51.490280+0000","last_clean":"2024-09-12T01:07:51.490280+0000","last_became_active":"2024-09-12T00:30:19.167819+0000","last_became_peered":"2024-09-12T00:30:19.167819+0000","last_unstale":"2024-09-12T01:07:51.490280+0000","last_undegraded":"2024-09-12T01:07:51.490280+0000","last_fullsized":"2024-09-12T01:07:51.490280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:06.580191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'175","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.532966+0000","last_change":"2024-09-12T00:30:21.193170+0000","last_active":"2024-09-12T01:09:21.532966+0000","last_peered":"2024-09-12T01:09:21.532966+0000","last_clean":"2024-09-12T01:09:21.532966+0000","last_became_active":"2024-09-12T00:30:21.192893+0000","last_became_peered":"2024-09-12T00:30:21.192893+0000","last_unstale":"2024-09-12T01:09:21.532966+0000","last_undegraded":"2024-09-12T01:09:21.532966+0000","last_fullsized":"2024-09-12T01:09:21.532966+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.137808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":195,"num_read_kb":181,"num_write":424,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'295","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.821157+0000","last_change":"2024-09-12T00:30:13.125785+0000","last_active":"2024-09-12T01:07:43.821157+0000","last_peered":"2024-09-12T01:07:43.821157+0000","last_clean":"2024-09-12T01:07:43.821157+0000","last_became_active":"2024-09-12T00:30:13.125487+0000","last_became_peered":"2024-09-12T00:30:13.125487+0000","last_unstale":"2024-09-12T01:07:43.821157+0000","last_undegraded":"2024-09-12T01:07:43.821157+0000","last_fullsized":"2024-09-12T01:07:43.821157+0000","mapping_epoch":28,"log_start":"261'200","ondisk_log_start":"261'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:38.141488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1016,"num_write":432,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'241","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.516205+0000","last_change":"2024-09-12T00:30:11.108644+0000","last_active":"2024-09-12T01:08:19.516205+0000","last_peered":"2024-09-12T01:08:19.516205+0000","last_clean":"2024-09-12T01:08:19.516205+0000","last_became_active":"2024-09-12T00:30:11.108257+0000","last_became_peered":"2024-09-12T00:30:11.108257+0000","last_unstale":"2024-09-12T01:08:19.516205+0000","last_undegraded":"2024-09-12T01:08:19.516205+0000","last_fullsized":"2024-09-12T01:08:19.516205+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:15.455005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12965617,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":381,"num_read_kb":29050,"num_write":885,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.595234+0000","last_change":"2024-09-12T00:30:01.530154+0000","last_active":"2024-09-12T01:07:38.595234+0000","last_peered":"2024-09-12T01:07:38.595234+0000","last_clean":"2024-09-12T01:07:38.595234+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T01:07:38.595234+0000","last_undegraded":"2024-09-12T01:07:38.595234+0000","last_fullsized":"2024-09-12T01:07:38.595234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:56.892481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.517391+0000","last_change":"2024-09-12T00:30:15.125077+0000","last_active":"2024-09-12T01:07:48.517391+0000","last_peered":"2024-09-12T01:07:48.517391+0000","last_clean":"2024-09-12T01:07:48.517391+0000","last_became_active":"2024-09-12T00:30:15.124765+0000","last_became_peered":"2024-09-12T00:30:15.124765+0000","last_unstale":"2024-09-12T01:07:48.517391+0000","last_undegraded":"2024-09-12T01:07:48.517391+0000","last_fullsized":"2024-09-12T01:07:48.517391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:26.426998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'162","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.221326+0000","last_change":"2024-09-12T00:30:17.147603+0000","last_active":"2024-09-12T01:10:26.221326+0000","last_peered":"2024-09-12T01:10:26.221326+0000","last_clean":"2024-09-12T01:10:26.221326+0000","last_became_active":"2024-09-12T00:30:17.147297+0000","last_became_peered":"2024-09-12T00:30:17.147297+0000","last_unstale":"2024-09-12T01:10:26.221326+0000","last_undegraded":"2024-09-12T01:10:26.221326+0000","last_fullsized":"2024-09-12T01:10:26.221326+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:26.332646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":197,"num_write":138,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'781","reported_seq":4275,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.503994+0000","last_change":"2024-09-12T00:30:19.169985+0000","last_active":"2024-09-12T01:11:22.503994+0000","last_peered":"2024-09-12T01:11:22.503994+0000","last_clean":"2024-09-12T01:11:22.503994+0000","last_became_active":"2024-09-12T00:30:19.169689+0000","last_became_peered":"2024-09-12T00:30:19.169689+0000","last_unstale":"2024-09-12T01:11:22.503994+0000","last_undegraded":"2024-09-12T01:11:22.503994+0000","last_fullsized":"2024-09-12T01:11:22.503994+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:18.977023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'135","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.493856+0000","last_change":"2024-09-12T00:30:21.189863+0000","last_active":"2024-09-12T01:10:51.493856+0000","last_peered":"2024-09-12T01:10:51.493856+0000","last_clean":"2024-09-12T01:10:51.493856+0000","last_became_active":"2024-09-12T00:30:21.189546+0000","last_became_peered":"2024-09-12T00:30:21.189546+0000","last_unstale":"2024-09-12T01:10:51.493856+0000","last_undegraded":"2024-09-12T01:10:51.493856+0000","last_fullsized":"2024-09-12T01:10:51.493856+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.427001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":147,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'196","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.514948+0000","last_change":"2024-09-12T00:30:13.118911+0000","last_active":"2024-09-12T01:08:17.514948+0000","last_peered":"2024-09-12T01:08:17.514948+0000","last_clean":"2024-09-12T01:08:17.514948+0000","last_became_active":"2024-09-12T00:30:13.118656+0000","last_became_peered":"2024-09-12T00:30:13.118656+0000","last_unstale":"2024-09-12T01:08:17.514948+0000","last_undegraded":"2024-09-12T01:08:17.514948+0000","last_fullsized":"2024-09-12T01:08:17.514948+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:57.996691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":942,"num_read_kb":795,"num_write":340,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'312","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.522829+0000","last_change":"2024-09-12T00:30:11.090609+0000","last_active":"2024-09-12T01:09:12.522829+0000","last_peered":"2024-09-12T01:09:12.522829+0000","last_clean":"2024-09-12T01:09:12.522829+0000","last_became_active":"2024-09-12T00:30:11.090114+0000","last_became_peered":"2024-09-12T00:30:11.090114+0000","last_unstale":"2024-09-12T01:09:12.522829+0000","last_undegraded":"2024-09-12T01:09:12.522829+0000","last_fullsized":"2024-09-12T01:09:12.522829+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:10.941716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19194423,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":547,"num_read_kb":27250,"num_write":1213,"num_write_kb":43330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.521544+0000","last_change":"2024-09-12T00:30:01.610276+0000","last_active":"2024-09-12T01:09:02.521544+0000","last_peered":"2024-09-12T01:09:02.521544+0000","last_clean":"2024-09-12T01:09:02.521544+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T01:09:02.521544+0000","last_undegraded":"2024-09-12T01:09:02.521544+0000","last_fullsized":"2024-09-12T01:09:02.521544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:31.655155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596333+0000","last_change":"2024-09-12T00:30:15.127408+0000","last_active":"2024-09-12T01:07:48.596333+0000","last_peered":"2024-09-12T01:07:48.596333+0000","last_clean":"2024-09-12T01:07:48.596333+0000","last_became_active":"2024-09-12T00:30:15.126949+0000","last_became_peered":"2024-09-12T00:30:15.126949+0000","last_unstale":"2024-09-12T01:07:48.596333+0000","last_undegraded":"2024-09-12T01:07:48.596333+0000","last_fullsized":"2024-09-12T01:07:48.596333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:24.696309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.206045+0000","last_change":"2024-09-12T00:30:17.150111+0000","last_active":"2024-09-12T01:10:26.206045+0000","last_peered":"2024-09-12T01:10:26.206045+0000","last_clean":"2024-09-12T01:10:26.206045+0000","last_became_active":"2024-09-12T00:30:17.149791+0000","last_became_peered":"2024-09-12T00:30:17.149791+0000","last_unstale":"2024-09-12T01:10:26.206045+0000","last_undegraded":"2024-09-12T01:10:26.206045+0000","last_fullsized":"2024-09-12T01:10:26.206045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.663317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'797","reported_seq":4535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.506132+0000","last_change":"2024-09-12T00:30:19.167079+0000","last_active":"2024-09-12T01:10:51.506132+0000","last_peered":"2024-09-12T01:10:51.506132+0000","last_clean":"2024-09-12T01:10:51.506132+0000","last_became_active":"2024-09-12T00:30:19.166687+0000","last_became_peered":"2024-09-12T00:30:19.166687+0000","last_unstale":"2024-09-12T01:10:51.506132+0000","last_undegraded":"2024-09-12T01:10:51.506132+0000","last_fullsized":"2024-09-12T01:10:51.506132+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:58.724984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.877133+0000","last_change":"2024-09-12T00:30:21.192502+0000","last_active":"2024-09-12T01:09:46.877133+0000","last_peered":"2024-09-12T01:09:46.877133+0000","last_clean":"2024-09-12T01:09:46.877133+0000","last_became_active":"2024-09-12T00:30:21.192189+0000","last_became_peered":"2024-09-12T00:30:21.192189+0000","last_unstale":"2024-09-12T01:09:46.877133+0000","last_undegraded":"2024-09-12T01:09:46.877133+0000","last_fullsized":"2024-09-12T01:09:46.877133+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:51.071766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":326,"num_read_kb":325,"num_write":560,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'395","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489484+0000","last_change":"2024-09-12T00:30:13.121172+0000","last_active":"2024-09-12T01:07:46.489484+0000","last_peered":"2024-09-12T01:07:46.489484+0000","last_clean":"2024-09-12T01:07:46.489484+0000","last_became_active":"2024-09-12T00:30:13.120906+0000","last_became_peered":"2024-09-12T00:30:13.120906+0000","last_unstale":"2024-09-12T01:07:46.489484+0000","last_undegraded":"2024-09-12T01:07:46.489484+0000","last_fullsized":"2024-09-12T01:07:46.489484+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:54.969193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1876,"num_read_kb":1541,"num_write":715,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'272","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.720910+0000","last_change":"2024-09-12T00:30:11.102338+0000","last_active":"2024-09-12T01:09:31.720910+0000","last_peered":"2024-09-12T01:09:31.720910+0000","last_clean":"2024-09-12T01:09:31.720910+0000","last_became_active":"2024-09-12T00:30:11.101931+0000","last_became_peered":"2024-09-12T00:30:11.101931+0000","last_unstale":"2024-09-12T01:09:31.720910+0000","last_undegraded":"2024-09-12T01:09:31.720910+0000","last_fullsized":"2024-09-12T01:09:31.720910+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:00.380675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10543400,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":444,"num_read_kb":50202,"num_write":1005,"num_write_kb":37284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.606593+0000","last_change":"2024-09-12T00:30:01.530986+0000","last_active":"2024-09-12T01:09:03.606593+0000","last_peered":"2024-09-12T01:09:03.606593+0000","last_clean":"2024-09-12T01:09:03.606593+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T01:09:03.606593+0000","last_undegraded":"2024-09-12T01:09:03.606593+0000","last_fullsized":"2024-09-12T01:09:03.606593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:52.048191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.515540+0000","last_change":"2024-09-12T00:30:15.126298+0000","last_active":"2024-09-12T01:08:22.515540+0000","last_peered":"2024-09-12T01:08:22.515540+0000","last_clean":"2024-09-12T01:08:22.515540+0000","last_became_active":"2024-09-12T00:30:15.126041+0000","last_became_peered":"2024-09-12T00:30:15.126041+0000","last_unstale":"2024-09-12T01:08:22.515540+0000","last_undegraded":"2024-09-12T01:08:22.515540+0000","last_fullsized":"2024-09-12T01:08:22.515540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:47.264234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'761","reported_seq":1478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.300374+0000","last_change":"2024-09-12T00:30:17.149254+0000","last_active":"2024-09-12T01:11:23.300374+0000","last_peered":"2024-09-12T01:11:23.300374+0000","last_clean":"2024-09-12T01:11:23.300374+0000","last_became_active":"2024-09-12T00:30:17.148954+0000","last_became_peered":"2024-09-12T00:30:17.148954+0000","last_unstale":"2024-09-12T01:11:23.300374+0000","last_undegraded":"2024-09-12T01:11:23.300374+0000","last_fullsized":"2024-09-12T01:11:23.300374+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:23.398387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155985,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1373,"num_read_kb":3176,"num_write":1136,"num_write_kb":954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511612+0000","last_change":"2024-09-12T00:30:19.169337+0000","last_active":"2024-09-12T01:07:52.511612+0000","last_peered":"2024-09-12T01:07:52.511612+0000","last_clean":"2024-09-12T01:07:52.511612+0000","last_became_active":"2024-09-12T00:30:19.168965+0000","last_became_peered":"2024-09-12T00:30:19.168965+0000","last_unstale":"2024-09-12T01:07:52.511612+0000","last_undegraded":"2024-09-12T01:07:52.511612+0000","last_fullsized":"2024-09-12T01:07:52.511612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:32.282990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'132","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.271173+0000","last_change":"2024-09-12T00:30:21.186564+0000","last_active":"2024-09-12T01:09:46.271173+0000","last_peered":"2024-09-12T01:09:46.271173+0000","last_clean":"2024-09-12T01:09:46.271173+0000","last_became_active":"2024-09-12T00:30:21.186262+0000","last_became_peered":"2024-09-12T00:30:21.186262+0000","last_unstale":"2024-09-12T01:09:46.271173+0000","last_undegraded":"2024-09-12T01:09:46.271173+0000","last_fullsized":"2024-09-12T01:09:46.271173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:19.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":332,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'144","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.925813+0000","last_change":"2024-09-12T00:30:21.193317+0000","last_active":"2024-09-12T01:09:46.925813+0000","last_peered":"2024-09-12T01:09:46.925813+0000","last_clean":"2024-09-12T01:09:46.925813+0000","last_became_active":"2024-09-12T00:30:21.193010+0000","last_became_peered":"2024-09-12T00:30:21.193010+0000","last_unstale":"2024-09-12T01:09:46.925813+0000","last_undegraded":"2024-09-12T01:09:46.925813+0000","last_fullsized":"2024-09-12T01:09:46.925813+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:25.295748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'64","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.214217+0000","last_change":"2024-09-12T00:30:13.122292+0000","last_active":"2024-09-12T01:09:31.214217+0000","last_peered":"2024-09-12T01:09:31.214217+0000","last_clean":"2024-09-12T01:09:31.214217+0000","last_became_active":"2024-09-12T00:30:13.121613+0000","last_became_peered":"2024-09-12T00:30:13.121613+0000","last_unstale":"2024-09-12T01:09:31.214217+0000","last_undegraded":"2024-09-12T01:09:31.214217+0000","last_fullsized":"2024-09-12T01:09:31.214217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:01.317063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":107,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'334","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.566770+0000","last_change":"2024-09-12T00:30:11.110609+0000","last_active":"2024-09-12T01:11:23.566770+0000","last_peered":"2024-09-12T01:11:23.566770+0000","last_clean":"2024-09-12T01:11:23.566770+0000","last_became_active":"2024-09-12T00:30:11.109653+0000","last_became_peered":"2024-09-12T00:30:11.109653+0000","last_unstale":"2024-09-12T01:11:23.566770+0000","last_undegraded":"2024-09-12T01:11:23.566770+0000","last_fullsized":"2024-09-12T01:11:23.566770+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:12.419689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2133189,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":660,"num_read_kb":3250,"num_write":1191,"num_write_kb":30224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.379544+0000","last_change":"2024-09-12T00:30:15.133054+0000","last_active":"2024-09-12T01:07:37.379544+0000","last_peered":"2024-09-12T01:07:37.379544+0000","last_clean":"2024-09-12T01:07:37.379544+0000","last_became_active":"2024-09-12T00:30:15.132784+0000","last_became_peered":"2024-09-12T00:30:15.132784+0000","last_unstale":"2024-09-12T01:07:37.379544+0000","last_undegraded":"2024-09-12T01:07:37.379544+0000","last_fullsized":"2024-09-12T01:07:37.379544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:01.793710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'255","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.224691+0000","last_change":"2024-09-12T00:30:17.146875+0000","last_active":"2024-09-12T01:10:26.224691+0000","last_peered":"2024-09-12T01:10:26.224691+0000","last_clean":"2024-09-12T01:10:26.224691+0000","last_became_active":"2024-09-12T00:30:17.146483+0000","last_became_peered":"2024-09-12T00:30:17.146483+0000","last_unstale":"2024-09-12T01:10:26.224691+0000","last_undegraded":"2024-09-12T01:10:26.224691+0000","last_fullsized":"2024-09-12T01:10:26.224691+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:14.781544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52591,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":415,"num_read_kb":851,"num_write":332,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380029+0000","last_change":"2024-09-12T00:30:19.169288+0000","last_active":"2024-09-12T01:07:43.380029+0000","last_peered":"2024-09-12T01:07:43.380029+0000","last_clean":"2024-09-12T01:07:43.380029+0000","last_became_active":"2024-09-12T00:30:19.168980+0000","last_became_peered":"2024-09-12T00:30:19.168980+0000","last_unstale":"2024-09-12T01:07:43.380029+0000","last_undegraded":"2024-09-12T01:07:43.380029+0000","last_fullsized":"2024-09-12T01:07:43.380029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:55.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'108","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.943994+0000","last_change":"2024-09-12T00:30:21.188045+0000","last_active":"2024-09-12T01:08:50.943994+0000","last_peered":"2024-09-12T01:08:50.943994+0000","last_clean":"2024-09-12T01:08:50.943994+0000","last_became_active":"2024-09-12T00:30:21.187742+0000","last_became_peered":"2024-09-12T00:30:21.187742+0000","last_unstale":"2024-09-12T01:08:50.943994+0000","last_undegraded":"2024-09-12T01:08:50.943994+0000","last_fullsized":"2024-09-12T01:08:50.943994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'264","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.741230+0000","last_change":"2024-09-12T00:30:13.131517+0000","last_active":"2024-09-12T01:08:03.741230+0000","last_peered":"2024-09-12T01:08:03.741230+0000","last_clean":"2024-09-12T01:08:03.741230+0000","last_became_active":"2024-09-12T00:30:13.131204+0000","last_became_peered":"2024-09-12T00:30:13.131204+0000","last_unstale":"2024-09-12T01:08:03.741230+0000","last_undegraded":"2024-09-12T01:08:03.741230+0000","last_fullsized":"2024-09-12T01:08:03.741230+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:06.638417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":908,"num_write":395,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.445894+0000","last_change":"2024-09-12T00:30:11.104784+0000","last_active":"2024-09-12T01:11:23.445894+0000","last_peered":"2024-09-12T01:11:23.445894+0000","last_clean":"2024-09-12T01:11:23.445894+0000","last_became_active":"2024-09-12T00:30:11.104403+0000","last_became_peered":"2024-09-12T00:30:11.104403+0000","last_unstale":"2024-09-12T01:11:23.445894+0000","last_undegraded":"2024-09-12T01:11:23.445894+0000","last_fullsized":"2024-09-12T01:11:23.445894+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.674612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5276601,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":555,"num_read_kb":58051,"num_write":1182,"num_write_kb":38205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.509453+0000","last_change":"2024-09-12T00:30:15.128673+0000","last_active":"2024-09-12T01:07:37.509453+0000","last_peered":"2024-09-12T01:07:37.509453+0000","last_clean":"2024-09-12T01:07:37.509453+0000","last_became_active":"2024-09-12T00:30:15.128366+0000","last_became_peered":"2024-09-12T00:30:15.128366+0000","last_unstale":"2024-09-12T01:07:37.509453+0000","last_undegraded":"2024-09-12T01:07:37.509453+0000","last_fullsized":"2024-09-12T01:07:37.509453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:18.808966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'45","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.025516+0000","last_change":"2024-09-12T00:30:17.139289+0000","last_active":"2024-09-12T01:10:26.025516+0000","last_peered":"2024-09-12T01:10:26.025516+0000","last_clean":"2024-09-12T01:10:26.025516+0000","last_became_active":"2024-09-12T00:30:17.138399+0000","last_became_peered":"2024-09-12T00:30:17.138399+0000","last_unstale":"2024-09-12T01:10:26.025516+0000","last_undegraded":"2024-09-12T01:10:26.025516+0000","last_fullsized":"2024-09-12T01:10:26.025516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:34.631922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":31,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.488873+0000","last_change":"2024-09-12T00:30:19.167516+0000","last_active":"2024-09-12T01:07:41.488873+0000","last_peered":"2024-09-12T01:07:41.488873+0000","last_clean":"2024-09-12T01:07:41.488873+0000","last_became_active":"2024-09-12T00:30:19.167213+0000","last_became_peered":"2024-09-12T00:30:19.167213+0000","last_unstale":"2024-09-12T01:07:41.488873+0000","last_undegraded":"2024-09-12T01:07:41.488873+0000","last_fullsized":"2024-09-12T01:07:41.488873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:20.695360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'202","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.271103+0000","last_change":"2024-09-12T00:30:21.185959+0000","last_active":"2024-09-12T01:10:50.271103+0000","last_peered":"2024-09-12T01:10:50.271103+0000","last_clean":"2024-09-12T01:10:50.271103+0000","last_became_active":"2024-09-12T00:30:21.185636+0000","last_became_peered":"2024-09-12T00:30:21.185636+0000","last_unstale":"2024-09-12T01:10:50.271103+0000","last_undegraded":"2024-09-12T01:10:50.271103+0000","last_fullsized":"2024-09-12T01:10:50.271103+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:18.839590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":299,"num_write":483,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'101","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.233430+0000","last_change":"2024-09-12T00:30:13.124435+0000","last_active":"2024-09-12T01:08:23.233430+0000","last_peered":"2024-09-12T01:08:23.233430+0000","last_clean":"2024-09-12T01:08:23.233430+0000","last_became_active":"2024-09-12T00:30:13.124163+0000","last_became_peered":"2024-09-12T00:30:13.124163+0000","last_unstale":"2024-09-12T01:08:23.233430+0000","last_undegraded":"2024-09-12T01:08:23.233430+0000","last_fullsized":"2024-09-12T01:08:23.233430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:34.854665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":380,"num_write":155,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'283","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.749795+0000","last_change":"2024-09-12T00:30:11.111101+0000","last_active":"2024-09-12T01:09:43.749795+0000","last_peered":"2024-09-12T01:09:43.749795+0000","last_clean":"2024-09-12T01:09:43.749795+0000","last_became_active":"2024-09-12T00:30:11.110736+0000","last_became_peered":"2024-09-12T00:30:11.110736+0000","last_unstale":"2024-09-12T01:09:43.749795+0000","last_undegraded":"2024-09-12T01:09:43.749795+0000","last_fullsized":"2024-09-12T01:09:43.749795+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:36.799456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14685817,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":756,"num_read_kb":34556,"num_write":1099,"num_write_kb":41998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.488227+0000","last_change":"2024-09-12T00:30:15.121446+0000","last_active":"2024-09-12T01:07:36.488227+0000","last_peered":"2024-09-12T01:07:36.488227+0000","last_clean":"2024-09-12T01:07:36.488227+0000","last_became_active":"2024-09-12T00:30:15.121068+0000","last_became_peered":"2024-09-12T00:30:15.121068+0000","last_unstale":"2024-09-12T01:07:36.488227+0000","last_undegraded":"2024-09-12T01:07:36.488227+0000","last_fullsized":"2024-09-12T01:07:36.488227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:39.771010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'314","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.380796+0000","last_change":"2024-09-12T00:30:17.148244+0000","last_active":"2024-09-12T01:11:23.380796+0000","last_peered":"2024-09-12T01:11:23.380796+0000","last_clean":"2024-09-12T01:11:23.380796+0000","last_became_active":"2024-09-12T00:30:17.147946+0000","last_became_peered":"2024-09-12T00:30:17.147946+0000","last_unstale":"2024-09-12T01:11:23.380796+0000","last_undegraded":"2024-09-12T01:11:23.380796+0000","last_fullsized":"2024-09-12T01:11:23.380796+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:12.212273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":1151,"num_write":414,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.399089+0000","last_change":"2024-09-12T00:30:19.167688+0000","last_active":"2024-09-12T01:07:38.399089+0000","last_peered":"2024-09-12T01:07:38.399089+0000","last_clean":"2024-09-12T01:07:38.399089+0000","last_became_active":"2024-09-12T00:30:19.167407+0000","last_became_peered":"2024-09-12T00:30:19.167407+0000","last_unstale":"2024-09-12T01:07:38.399089+0000","last_undegraded":"2024-09-12T01:07:38.399089+0000","last_fullsized":"2024-09-12T01:07:38.399089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:37.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.270721+0000","last_change":"2024-09-12T00:30:21.189080+0000","last_active":"2024-09-12T01:09:23.270721+0000","last_peered":"2024-09-12T01:09:23.270721+0000","last_clean":"2024-09-12T01:09:23.270721+0000","last_became_active":"2024-09-12T00:30:21.188801+0000","last_became_peered":"2024-09-12T00:30:21.188801+0000","last_unstale":"2024-09-12T01:09:23.270721+0000","last_undegraded":"2024-09-12T01:09:23.270721+0000","last_fullsized":"2024-09-12T01:09:23.270721+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:52.941694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":174,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'271","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.925751+0000","last_change":"2024-09-12T00:30:13.122096+0000","last_active":"2024-09-12T01:07:50.925751+0000","last_peered":"2024-09-12T01:07:50.925751+0000","last_clean":"2024-09-12T01:07:50.925751+0000","last_became_active":"2024-09-12T00:30:13.121687+0000","last_became_peered":"2024-09-12T00:30:13.121687+0000","last_unstale":"2024-09-12T01:07:50.925751+0000","last_undegraded":"2024-09-12T01:07:50.925751+0000","last_fullsized":"2024-09-12T01:07:50.925751+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:11.931962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1180,"num_read_kb":936,"num_write":465,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'272","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.150176+0000","last_change":"2024-09-12T00:30:11.098286+0000","last_active":"2024-09-12T01:08:57.150176+0000","last_peered":"2024-09-12T01:08:57.150176+0000","last_clean":"2024-09-12T01:08:57.150176+0000","last_became_active":"2024-09-12T00:30:11.097863+0000","last_became_peered":"2024-09-12T00:30:11.097863+0000","last_unstale":"2024-09-12T01:08:57.150176+0000","last_undegraded":"2024-09-12T01:08:57.150176+0000","last_fullsized":"2024-09-12T01:08:57.150176+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:12.507001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9451713,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":456,"num_read_kb":74370,"num_write":1043,"num_write_kb":34671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.595145+0000","last_change":"2024-09-12T00:30:15.125794+0000","last_active":"2024-09-12T01:07:38.595145+0000","last_peered":"2024-09-12T01:07:38.595145+0000","last_clean":"2024-09-12T01:07:38.595145+0000","last_became_active":"2024-09-12T00:30:15.125505+0000","last_became_peered":"2024-09-12T00:30:15.125505+0000","last_unstale":"2024-09-12T01:07:38.595145+0000","last_undegraded":"2024-09-12T01:07:38.595145+0000","last_fullsized":"2024-09-12T01:07:38.595145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:58.671332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'278","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.131148+0000","last_change":"2024-09-12T00:30:17.146728+0000","last_active":"2024-09-12T01:11:23.131148+0000","last_peered":"2024-09-12T01:11:23.131148+0000","last_clean":"2024-09-12T01:11:23.131148+0000","last_became_active":"2024-09-12T00:30:17.146112+0000","last_became_peered":"2024-09-12T00:30:17.146112+0000","last_unstale":"2024-09-12T01:11:23.131148+0000","last_undegraded":"2024-09-12T01:11:23.131148+0000","last_fullsized":"2024-09-12T01:11:23.131148+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:53.604417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56907,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":1155,"num_write":390,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380111+0000","last_change":"2024-09-12T00:30:19.165113+0000","last_active":"2024-09-12T01:07:43.380111+0000","last_peered":"2024-09-12T01:07:43.380111+0000","last_clean":"2024-09-12T01:07:43.380111+0000","last_became_active":"2024-09-12T00:30:19.164820+0000","last_became_peered":"2024-09-12T00:30:19.164820+0000","last_unstale":"2024-09-12T01:07:43.380111+0000","last_undegraded":"2024-09-12T01:07:43.380111+0000","last_fullsized":"2024-09-12T01:07:43.380111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:05.633814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'177","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.659876+0000","last_change":"2024-09-12T00:30:13.124841+0000","last_active":"2024-09-12T01:08:12.659876+0000","last_peered":"2024-09-12T01:08:12.659876+0000","last_clean":"2024-09-12T01:08:12.659876+0000","last_became_active":"2024-09-12T00:30:13.124584+0000","last_became_peered":"2024-09-12T00:30:13.124584+0000","last_unstale":"2024-09-12T01:08:12.659876+0000","last_undegraded":"2024-09-12T01:08:12.659876+0000","last_fullsized":"2024-09-12T01:08:12.659876+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.463711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":813,"num_read_kb":670,"num_write":272,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'289","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:24.698763+0000","last_change":"2024-09-12T00:30:11.098303+0000","last_active":"2024-09-12T01:09:24.698763+0000","last_peered":"2024-09-12T01:09:24.698763+0000","last_clean":"2024-09-12T01:09:24.698763+0000","last_became_active":"2024-09-12T00:30:11.097890+0000","last_became_peered":"2024-09-12T00:30:11.097890+0000","last_unstale":"2024-09-12T01:09:24.698763+0000","last_undegraded":"2024-09-12T01:09:24.698763+0000","last_fullsized":"2024-09-12T01:09:24.698763+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:22.964167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8875917,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":488,"num_read_kb":38571,"num_write":1081,"num_write_kb":31383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'5","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.210840+0000","last_change":"2024-09-12T00:30:15.122461+0000","last_active":"2024-09-12T01:10:51.210840+0000","last_peered":"2024-09-12T01:10:51.210840+0000","last_clean":"2024-09-12T01:10:51.210840+0000","last_became_active":"2024-09-12T00:30:15.122172+0000","last_became_peered":"2024-09-12T00:30:15.122172+0000","last_unstale":"2024-09-12T01:10:51.210840+0000","last_undegraded":"2024-09-12T01:10:51.210840+0000","last_fullsized":"2024-09-12T01:10:51.210840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:40.318954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'502","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.460544+0000","last_change":"2024-09-12T00:30:17.146325+0000","last_active":"2024-09-12T01:10:51.460544+0000","last_peered":"2024-09-12T01:10:51.460544+0000","last_clean":"2024-09-12T01:10:51.460544+0000","last_became_active":"2024-09-12T00:30:17.145882+0000","last_became_peered":"2024-09-12T00:30:17.145882+0000","last_unstale":"2024-09-12T01:10:51.460544+0000","last_undegraded":"2024-09-12T01:10:51.460544+0000","last_fullsized":"2024-09-12T01:10:51.460544+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:43.412234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124876,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":923,"num_read_kb":2013,"num_write":816,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.490351+0000","last_change":"2024-09-12T00:30:19.171021+0000","last_active":"2024-09-12T01:07:51.490351+0000","last_peered":"2024-09-12T01:07:51.490351+0000","last_clean":"2024-09-12T01:07:51.490351+0000","last_became_active":"2024-09-12T00:30:19.170776+0000","last_became_peered":"2024-09-12T00:30:19.170776+0000","last_unstale":"2024-09-12T01:07:51.490351+0000","last_undegraded":"2024-09-12T01:07:51.490351+0000","last_fullsized":"2024-09-12T01:07:51.490351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:45.791234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'142","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.220138+0000","last_change":"2024-09-12T00:30:21.188712+0000","last_active":"2024-09-12T01:09:12.220138+0000","last_peered":"2024-09-12T01:09:12.220138+0000","last_clean":"2024-09-12T01:09:12.220138+0000","last_became_active":"2024-09-12T00:30:21.188376+0000","last_became_peered":"2024-09-12T00:30:21.188376+0000","last_unstale":"2024-09-12T01:09:12.220138+0000","last_undegraded":"2024-09-12T01:09:12.220138+0000","last_fullsized":"2024-09-12T01:09:12.220138+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:33.881129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":168,"num_write":312,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'188","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.553795+0000","last_change":"2024-09-12T00:30:13.119832+0000","last_active":"2024-09-12T01:08:48.553795+0000","last_peered":"2024-09-12T01:08:48.553795+0000","last_clean":"2024-09-12T01:08:48.553795+0000","last_became_active":"2024-09-12T00:30:13.118251+0000","last_became_peered":"2024-09-12T00:30:13.118251+0000","last_unstale":"2024-09-12T01:08:48.553795+0000","last_undegraded":"2024-09-12T01:08:48.553795+0000","last_fullsized":"2024-09-12T01:08:48.553795+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:08.129477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":709,"num_write":308,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'301","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:49.565897+0000","last_change":"2024-09-12T00:30:11.103265+0000","last_active":"2024-09-12T01:10:49.565897+0000","last_peered":"2024-09-12T01:10:49.565897+0000","last_clean":"2024-09-12T01:10:49.565897+0000","last_became_active":"2024-09-12T00:30:11.102929+0000","last_became_peered":"2024-09-12T00:30:11.102929+0000","last_unstale":"2024-09-12T01:10:49.565897+0000","last_undegraded":"2024-09-12T01:10:49.565897+0000","last_fullsized":"2024-09-12T01:10:49.565897+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:09.657923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4555234,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":415,"num_read_kb":62693,"num_write":1017,"num_write_kb":37872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489602+0000","last_change":"2024-09-12T00:30:15.127559+0000","last_active":"2024-09-12T01:07:46.489602+0000","last_peered":"2024-09-12T01:07:46.489602+0000","last_clean":"2024-09-12T01:07:46.489602+0000","last_became_active":"2024-09-12T00:30:15.127268+0000","last_became_peered":"2024-09-12T00:30:15.127268+0000","last_unstale":"2024-09-12T01:07:46.489602+0000","last_undegraded":"2024-09-12T01:07:46.489602+0000","last_fullsized":"2024-09-12T01:07:46.489602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:40.481520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'306","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.215461+0000","last_change":"2024-09-12T00:30:17.145767+0000","last_active":"2024-09-12T01:11:23.215461+0000","last_peered":"2024-09-12T01:11:23.215461+0000","last_clean":"2024-09-12T01:11:23.215461+0000","last_became_active":"2024-09-12T00:30:17.145504+0000","last_became_peered":"2024-09-12T00:30:17.145504+0000","last_unstale":"2024-09-12T01:11:23.215461+0000","last_undegraded":"2024-09-12T01:11:23.215461+0000","last_fullsized":"2024-09-12T01:11:23.215461+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.680720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1192,"num_write":444,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.470054+0000","last_change":"2024-09-12T00:30:19.169885+0000","last_active":"2024-09-12T01:07:52.470054+0000","last_peered":"2024-09-12T01:07:52.470054+0000","last_clean":"2024-09-12T01:07:52.470054+0000","last_became_active":"2024-09-12T00:30:19.169558+0000","last_became_peered":"2024-09-12T00:30:19.169558+0000","last_unstale":"2024-09-12T01:07:52.470054+0000","last_undegraded":"2024-09-12T01:07:52.470054+0000","last_fullsized":"2024-09-12T01:07:52.470054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:54.438982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'175","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.845489+0000","last_change":"2024-09-12T00:30:21.188671+0000","last_active":"2024-09-12T01:09:16.845489+0000","last_peered":"2024-09-12T01:09:16.845489+0000","last_clean":"2024-09-12T01:09:16.845489+0000","last_became_active":"2024-09-12T00:30:21.188350+0000","last_became_peered":"2024-09-12T00:30:21.188350+0000","last_unstale":"2024-09-12T01:09:16.845489+0000","last_undegraded":"2024-09-12T01:09:16.845489+0000","last_fullsized":"2024-09-12T01:09:16.845489+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.291083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2246,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":214,"num_write":509,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'191","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.825959+0000","last_change":"2024-09-12T00:30:13.127956+0000","last_active":"2024-09-12T01:09:09.825959+0000","last_peered":"2024-09-12T01:09:09.825959+0000","last_clean":"2024-09-12T01:09:09.825959+0000","last_became_active":"2024-09-12T00:30:13.127294+0000","last_became_peered":"2024-09-12T00:30:13.127294+0000","last_unstale":"2024-09-12T01:09:09.825959+0000","last_undegraded":"2024-09-12T01:09:09.825959+0000","last_fullsized":"2024-09-12T01:09:09.825959+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:36.940318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":881,"num_read_kb":750,"num_write":313,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'305","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.411781+0000","last_change":"2024-09-12T00:30:11.091385+0000","last_active":"2024-09-12T01:11:23.411781+0000","last_peered":"2024-09-12T01:11:23.411781+0000","last_clean":"2024-09-12T01:11:23.411781+0000","last_became_active":"2024-09-12T00:30:11.091027+0000","last_became_peered":"2024-09-12T00:30:11.091027+0000","last_unstale":"2024-09-12T01:11:23.411781+0000","last_undegraded":"2024-09-12T01:11:23.411781+0000","last_fullsized":"2024-09-12T01:11:23.411781+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:30.586849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6384977,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":466,"num_read_kb":8604,"num_write":1126,"num_write_kb":27793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489557+0000","last_change":"2024-09-12T00:30:15.126670+0000","last_active":"2024-09-12T01:07:46.489557+0000","last_peered":"2024-09-12T01:07:46.489557+0000","last_clean":"2024-09-12T01:07:46.489557+0000","last_became_active":"2024-09-12T00:30:15.126254+0000","last_became_peered":"2024-09-12T00:30:15.126254+0000","last_unstale":"2024-09-12T01:07:46.489557+0000","last_undegraded":"2024-09-12T01:07:46.489557+0000","last_fullsized":"2024-09-12T01:07:46.489557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:45.385397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'279","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.226884+0000","last_change":"2024-09-12T00:30:17.146500+0000","last_active":"2024-09-12T01:10:26.226884+0000","last_peered":"2024-09-12T01:10:26.226884+0000","last_clean":"2024-09-12T01:10:26.226884+0000","last_became_active":"2024-09-12T00:30:17.146106+0000","last_became_peered":"2024-09-12T00:30:17.146106+0000","last_unstale":"2024-09-12T01:10:26.226884+0000","last_undegraded":"2024-09-12T01:10:26.226884+0000","last_fullsized":"2024-09-12T01:10:26.226884+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:56.226270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":947,"num_write":382,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.385079+0000","last_change":"2024-09-12T00:30:19.167702+0000","last_active":"2024-09-12T01:08:23.385079+0000","last_peered":"2024-09-12T01:08:23.385079+0000","last_clean":"2024-09-12T01:08:23.385079+0000","last_became_active":"2024-09-12T00:30:19.167119+0000","last_became_peered":"2024-09-12T00:30:19.167119+0000","last_unstale":"2024-09-12T01:08:23.385079+0000","last_undegraded":"2024-09-12T01:08:23.385079+0000","last_fullsized":"2024-09-12T01:08:23.385079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:22.072993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'97","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490235+0000","last_change":"2024-09-12T00:30:21.191304+0000","last_active":"2024-09-12T01:10:51.490235+0000","last_peered":"2024-09-12T01:10:51.490235+0000","last_clean":"2024-09-12T01:10:51.490235+0000","last_became_active":"2024-09-12T00:30:21.190937+0000","last_became_peered":"2024-09-12T00:30:21.190937+0000","last_unstale":"2024-09-12T01:10:51.490235+0000","last_undegraded":"2024-09-12T01:10:51.490235+0000","last_fullsized":"2024-09-12T01:10:51.490235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:04.164418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":102,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'207","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:24.682793+0000","last_change":"2024-09-12T00:30:13.120652+0000","last_active":"2024-09-12T01:09:24.682793+0000","last_peered":"2024-09-12T01:09:24.682793+0000","last_clean":"2024-09-12T01:09:24.682793+0000","last_became_active":"2024-09-12T00:30:13.119843+0000","last_became_peered":"2024-09-12T00:30:13.119843+0000","last_unstale":"2024-09-12T01:09:24.682793+0000","last_undegraded":"2024-09-12T01:09:24.682793+0000","last_fullsized":"2024-09-12T01:09:24.682793+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.594925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":901,"num_read_kb":747,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'304","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.375447+0000","last_change":"2024-09-12T00:30:11.101174+0000","last_active":"2024-09-12T01:09:27.375447+0000","last_peered":"2024-09-12T01:09:27.375447+0000","last_clean":"2024-09-12T01:09:27.375447+0000","last_became_active":"2024-09-12T00:30:11.100750+0000","last_became_peered":"2024-09-12T00:30:11.100750+0000","last_unstale":"2024-09-12T01:09:27.375447+0000","last_undegraded":"2024-09-12T01:09:27.375447+0000","last_fullsized":"2024-09-12T01:09:27.375447+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:57.978779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7989139,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":511,"num_read_kb":31919,"num_write":1235,"num_write_kb":26213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510757+0000","last_change":"2024-09-12T00:30:15.127738+0000","last_active":"2024-09-12T01:07:47.510757+0000","last_peered":"2024-09-12T01:07:47.510757+0000","last_clean":"2024-09-12T01:07:47.510757+0000","last_became_active":"2024-09-12T00:30:15.127444+0000","last_became_peered":"2024-09-12T00:30:15.127444+0000","last_unstale":"2024-09-12T01:07:47.510757+0000","last_undegraded":"2024-09-12T01:07:47.510757+0000","last_fullsized":"2024-09-12T01:07:47.510757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:29.367406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'84","reported_seq":596,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.218785+0000","last_change":"2024-09-12T00:30:17.144599+0000","last_active":"2024-09-12T01:10:26.218785+0000","last_peered":"2024-09-12T01:10:26.218785+0000","last_clean":"2024-09-12T01:10:26.218785+0000","last_became_active":"2024-09-12T00:30:17.144283+0000","last_became_peered":"2024-09-12T00:30:17.144283+0000","last_unstale":"2024-09-12T01:10:26.218785+0000","last_undegraded":"2024-09-12T01:10:26.218785+0000","last_fullsized":"2024-09-12T01:10:26.218785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:42.626907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":66,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'767","reported_seq":2395,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.504014+0000","last_change":"2024-09-12T00:30:19.167155+0000","last_active":"2024-09-12T01:11:22.504014+0000","last_peered":"2024-09-12T01:11:22.504014+0000","last_clean":"2024-09-12T01:11:22.504014+0000","last_became_active":"2024-09-12T00:30:19.166851+0000","last_became_peered":"2024-09-12T00:30:19.166851+0000","last_unstale":"2024-09-12T01:11:22.504014+0000","last_undegraded":"2024-09-12T01:11:22.504014+0000","last_fullsized":"2024-09-12T01:11:22.504014+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:22.407452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'131","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.215109+0000","last_change":"2024-09-12T00:30:21.190459+0000","last_active":"2024-09-12T01:09:31.215109+0000","last_peered":"2024-09-12T01:09:31.215109+0000","last_clean":"2024-09-12T01:09:31.215109+0000","last_became_active":"2024-09-12T00:30:21.190151+0000","last_became_peered":"2024-09-12T00:30:21.190151+0000","last_unstale":"2024-09-12T01:09:31.215109+0000","last_undegraded":"2024-09-12T01:09:31.215109+0000","last_fullsized":"2024-09-12T01:09:31.215109+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:54.921241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'111","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489533+0000","last_change":"2024-09-12T00:30:13.124415+0000","last_active":"2024-09-12T01:07:46.489533+0000","last_peered":"2024-09-12T01:07:46.489533+0000","last_clean":"2024-09-12T01:07:46.489533+0000","last_became_active":"2024-09-12T00:30:13.124167+0000","last_became_peered":"2024-09-12T00:30:13.124167+0000","last_unstale":"2024-09-12T01:07:46.489533+0000","last_undegraded":"2024-09-12T01:07:46.489533+0000","last_fullsized":"2024-09-12T01:07:46.489533+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:40.559024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":425,"num_write":152,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'404","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.415150+0000","last_change":"2024-09-12T00:30:11.109569+0000","last_active":"2024-09-12T01:11:23.415150+0000","last_peered":"2024-09-12T01:11:23.415150+0000","last_clean":"2024-09-12T01:11:23.415150+0000","last_became_active":"2024-09-12T00:30:11.108422+0000","last_became_peered":"2024-09-12T00:30:11.108422+0000","last_unstale":"2024-09-12T01:11:23.415150+0000","last_undegraded":"2024-09-12T01:11:23.415150+0000","last_fullsized":"2024-09-12T01:11:23.415150+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:38.097953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345472,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":814,"num_read_kb":2763,"num_write":1276,"num_write_kb":29562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.400338+0000","last_change":"2024-09-12T00:30:15.125457+0000","last_active":"2024-09-12T01:07:48.400338+0000","last_peered":"2024-09-12T01:07:48.400338+0000","last_clean":"2024-09-12T01:07:48.400338+0000","last_became_active":"2024-09-12T00:30:15.124922+0000","last_became_peered":"2024-09-12T00:30:15.124922+0000","last_unstale":"2024-09-12T01:07:48.400338+0000","last_undegraded":"2024-09-12T01:07:48.400338+0000","last_fullsized":"2024-09-12T01:07:48.400338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:27.550117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'346","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.452379+0000","last_change":"2024-09-12T00:30:17.149283+0000","last_active":"2024-09-12T01:10:51.452379+0000","last_peered":"2024-09-12T01:10:51.452379+0000","last_clean":"2024-09-12T01:10:51.452379+0000","last_became_active":"2024-09-12T00:30:17.148793+0000","last_became_peered":"2024-09-12T00:30:17.148793+0000","last_unstale":"2024-09-12T01:10:51.452379+0000","last_undegraded":"2024-09-12T01:10:51.452379+0000","last_fullsized":"2024-09-12T01:10:51.452379+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:33.498700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81032,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1086,"num_write":448,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:37.500323+0000","last_change":"2024-09-12T00:30:19.170247+0000","last_active":"2024-09-12T01:06:37.500323+0000","last_peered":"2024-09-12T01:06:37.500323+0000","last_clean":"2024-09-12T01:06:37.500323+0000","last_became_active":"2024-09-12T00:30:19.169982+0000","last_became_peered":"2024-09-12T00:30:19.169982+0000","last_unstale":"2024-09-12T01:06:37.500323+0000","last_undegraded":"2024-09-12T01:06:37.500323+0000","last_fullsized":"2024-09-12T01:06:37.500323+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'144","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.849786+0000","last_change":"2024-09-12T00:30:21.187973+0000","last_active":"2024-09-12T01:09:32.849786+0000","last_peered":"2024-09-12T01:09:32.849786+0000","last_clean":"2024-09-12T01:09:32.849786+0000","last_became_active":"2024-09-12T00:30:21.187641+0000","last_became_peered":"2024-09-12T00:30:21.187641+0000","last_unstale":"2024-09-12T01:09:32.849786+0000","last_undegraded":"2024-09-12T01:09:32.849786+0000","last_fullsized":"2024-09-12T01:09:32.849786+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:39.449383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":136,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'194","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.088663+0000","last_change":"2024-09-12T00:30:13.123094+0000","last_active":"2024-09-12T01:09:27.088663+0000","last_peered":"2024-09-12T01:09:27.088663+0000","last_clean":"2024-09-12T01:09:27.088663+0000","last_became_active":"2024-09-12T00:30:13.122622+0000","last_became_peered":"2024-09-12T00:30:13.122622+0000","last_unstale":"2024-09-12T01:09:27.088663+0000","last_undegraded":"2024-09-12T01:09:27.088663+0000","last_fullsized":"2024-09-12T01:09:27.088663+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:35.254290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":295,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'302","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.405819+0000","last_change":"2024-09-12T00:30:11.110375+0000","last_active":"2024-09-12T01:11:23.405819+0000","last_peered":"2024-09-12T01:11:23.405819+0000","last_clean":"2024-09-12T01:11:23.405819+0000","last_became_active":"2024-09-12T00:30:11.109855+0000","last_became_peered":"2024-09-12T00:30:11.109855+0000","last_unstale":"2024-09-12T01:11:23.405819+0000","last_undegraded":"2024-09-12T01:11:23.405819+0000","last_fullsized":"2024-09-12T01:11:23.405819+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:19.550416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1639977,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":575,"num_read_kb":64470,"num_write":1004,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489543+0000","last_change":"2024-09-12T00:30:15.126170+0000","last_active":"2024-09-12T01:07:46.489543+0000","last_peered":"2024-09-12T01:07:46.489543+0000","last_clean":"2024-09-12T01:07:46.489543+0000","last_became_active":"2024-09-12T00:30:15.125870+0000","last_became_peered":"2024-09-12T00:30:15.125870+0000","last_unstale":"2024-09-12T01:07:46.489543+0000","last_undegraded":"2024-09-12T01:07:46.489543+0000","last_fullsized":"2024-09-12T01:07:46.489543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:51.538427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'273","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.516204+0000","last_change":"2024-09-12T00:30:17.149628+0000","last_active":"2024-09-12T01:11:22.516204+0000","last_peered":"2024-09-12T01:11:22.516204+0000","last_clean":"2024-09-12T01:11:22.516204+0000","last_became_active":"2024-09-12T00:30:17.149226+0000","last_became_peered":"2024-09-12T00:30:17.149226+0000","last_unstale":"2024-09-12T01:11:22.516204+0000","last_undegraded":"2024-09-12T01:11:22.516204+0000","last_fullsized":"2024-09-12T01:11:22.516204+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:10.554142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":439,"num_read_kb":908,"num_write":362,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:38.585722+0000","last_change":"2024-09-12T00:30:19.164875+0000","last_active":"2024-09-12T01:06:38.585722+0000","last_peered":"2024-09-12T01:06:38.585722+0000","last_clean":"2024-09-12T01:06:38.585722+0000","last_became_active":"2024-09-12T00:30:19.164556+0000","last_became_peered":"2024-09-12T00:30:19.164556+0000","last_unstale":"2024-09-12T01:06:38.585722+0000","last_undegraded":"2024-09-12T01:06:38.585722+0000","last_fullsized":"2024-09-12T01:06:38.585722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:05.138428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'135","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.064016+0000","last_change":"2024-09-12T00:30:21.193857+0000","last_active":"2024-09-12T01:09:09.064016+0000","last_peered":"2024-09-12T01:09:09.064016+0000","last_clean":"2024-09-12T01:09:09.064016+0000","last_became_active":"2024-09-12T00:30:21.193606+0000","last_became_peered":"2024-09-12T00:30:21.193606+0000","last_unstale":"2024-09-12T01:09:09.064016+0000","last_undegraded":"2024-09-12T01:09:09.064016+0000","last_fullsized":"2024-09-12T01:09:09.064016+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:56.806530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":946,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":239,"num_write":347,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'4096","reported_seq":4671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.218622+0000","last_change":"2024-09-12T00:30:13.121220+0000","last_active":"2024-09-12T01:09:12.218622+0000","last_peered":"2024-09-12T01:09:12.218622+0000","last_clean":"2024-09-12T01:09:12.218622+0000","last_became_active":"2024-09-12T00:30:13.120940+0000","last_became_peered":"2024-09-12T00:30:13.120940+0000","last_unstale":"2024-09-12T01:09:12.218622+0000","last_undegraded":"2024-09-12T01:09:12.218622+0000","last_fullsized":"2024-09-12T01:09:12.218622+0000","mapping_epoch":28,"log_start":"264'4000","ondisk_log_start":"264'4000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.657138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16459,"num_read_kb":13812,"num_write":6134,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'290","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.722385+0000","last_change":"2024-09-12T00:30:11.099270+0000","last_active":"2024-09-12T01:09:31.722385+0000","last_peered":"2024-09-12T01:09:31.722385+0000","last_clean":"2024-09-12T01:09:31.722385+0000","last_became_active":"2024-09-12T00:30:11.098879+0000","last_became_peered":"2024-09-12T00:30:11.098879+0000","last_unstale":"2024-09-12T01:09:31.722385+0000","last_undegraded":"2024-09-12T01:09:31.722385+0000","last_fullsized":"2024-09-12T01:09:31.722385+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:03.440870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18151009,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":534,"num_read_kb":44110,"num_write":978,"num_write_kb":43739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409893+0000","last_change":"2024-09-12T00:30:15.125790+0000","last_active":"2024-09-12T01:08:58.409893+0000","last_peered":"2024-09-12T01:08:58.409893+0000","last_clean":"2024-09-12T01:08:58.409893+0000","last_became_active":"2024-09-12T00:30:15.125452+0000","last_became_peered":"2024-09-12T00:30:15.125452+0000","last_unstale":"2024-09-12T01:08:58.409893+0000","last_undegraded":"2024-09-12T01:08:58.409893+0000","last_fullsized":"2024-09-12T01:08:58.409893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:30.616035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'229","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.097745+0000","last_change":"2024-09-12T00:30:17.146683+0000","last_active":"2024-09-12T01:10:26.097745+0000","last_peered":"2024-09-12T01:10:26.097745+0000","last_clean":"2024-09-12T01:10:26.097745+0000","last_became_active":"2024-09-12T00:30:17.145961+0000","last_became_peered":"2024-09-12T00:30:17.145961+0000","last_unstale":"2024-09-12T01:10:26.097745+0000","last_undegraded":"2024-09-12T01:10:26.097745+0000","last_fullsized":"2024-09-12T01:10:26.097745+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:39.502275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44597,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":767,"num_write":298,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596405+0000","last_change":"2024-09-12T00:30:19.168010+0000","last_active":"2024-09-12T01:07:48.596405+0000","last_peered":"2024-09-12T01:07:48.596405+0000","last_clean":"2024-09-12T01:07:48.596405+0000","last_became_active":"2024-09-12T00:30:19.167723+0000","last_became_peered":"2024-09-12T00:30:19.167723+0000","last_unstale":"2024-09-12T01:07:48.596405+0000","last_undegraded":"2024-09-12T01:07:48.596405+0000","last_fullsized":"2024-09-12T01:07:48.596405+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:31.864085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'170","reported_seq":1613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:44.737494+0000","last_change":"2024-09-12T00:30:21.188654+0000","last_active":"2024-09-12T01:09:44.737494+0000","last_peered":"2024-09-12T01:09:44.737494+0000","last_clean":"2024-09-12T01:09:44.737494+0000","last_became_active":"2024-09-12T00:30:21.188363+0000","last_became_peered":"2024-09-12T00:30:21.188363+0000","last_unstale":"2024-09-12T01:09:44.737494+0000","last_undegraded":"2024-09-12T01:09:44.737494+0000","last_fullsized":"2024-09-12T01:09:44.737494+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:40.099921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1158,"num_read_kb":1157,"num_write":386,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'184","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.498641+0000","last_change":"2024-09-12T00:30:13.126020+0000","last_active":"2024-09-12T01:08:56.498641+0000","last_peered":"2024-09-12T01:08:56.498641+0000","last_clean":"2024-09-12T01:08:56.498641+0000","last_became_active":"2024-09-12T00:30:13.125727+0000","last_became_peered":"2024-09-12T00:30:13.125727+0000","last_unstale":"2024-09-12T01:08:56.498641+0000","last_undegraded":"2024-09-12T01:08:56.498641+0000","last_fullsized":"2024-09-12T01:08:56.498641+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:09.160490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":704,"num_write":275,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'257","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.754496+0000","last_change":"2024-09-12T00:30:11.092275+0000","last_active":"2024-09-12T01:09:43.754496+0000","last_peered":"2024-09-12T01:09:43.754496+0000","last_clean":"2024-09-12T01:09:43.754496+0000","last_became_active":"2024-09-12T00:30:11.091808+0000","last_became_peered":"2024-09-12T00:30:11.091808+0000","last_unstale":"2024-09-12T01:09:43.754496+0000","last_undegraded":"2024-09-12T01:09:43.754496+0000","last_fullsized":"2024-09-12T01:09:43.754496+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:26.055957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13691604,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":368,"num_read_kb":10677,"num_write":922,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:37.500363+0000","last_change":"2024-09-12T00:30:15.127289+0000","last_active":"2024-09-12T01:06:37.500363+0000","last_peered":"2024-09-12T01:06:37.500363+0000","last_clean":"2024-09-12T01:06:37.500363+0000","last_became_active":"2024-09-12T00:30:15.126206+0000","last_became_peered":"2024-09-12T00:30:15.126206+0000","last_unstale":"2024-09-12T01:06:37.500363+0000","last_undegraded":"2024-09-12T01:06:37.500363+0000","last_fullsized":"2024-09-12T01:06:37.500363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:39.699331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'298","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.484314+0000","last_change":"2024-09-12T00:30:17.145025+0000","last_active":"2024-09-12T01:10:51.484314+0000","last_peered":"2024-09-12T01:10:51.484314+0000","last_clean":"2024-09-12T01:10:51.484314+0000","last_became_active":"2024-09-12T00:30:17.144724+0000","last_became_peered":"2024-09-12T00:30:17.144724+0000","last_unstale":"2024-09-12T01:10:51.484314+0000","last_undegraded":"2024-09-12T01:10:51.484314+0000","last_fullsized":"2024-09-12T01:10:51.484314+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:32.229866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":949,"num_write":392,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511636+0000","last_change":"2024-09-12T00:30:19.172540+0000","last_active":"2024-09-12T01:07:52.511636+0000","last_peered":"2024-09-12T01:07:52.511636+0000","last_clean":"2024-09-12T01:07:52.511636+0000","last_became_active":"2024-09-12T00:30:19.172265+0000","last_became_peered":"2024-09-12T00:30:19.172265+0000","last_unstale":"2024-09-12T01:07:52.511636+0000","last_undegraded":"2024-09-12T01:07:52.511636+0000","last_fullsized":"2024-09-12T01:07:52.511636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:34.189913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'129","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.303430+0000","last_change":"2024-09-12T00:30:21.192137+0000","last_active":"2024-09-12T01:10:50.303430+0000","last_peered":"2024-09-12T01:10:50.303430+0000","last_clean":"2024-09-12T01:10:50.303430+0000","last_became_active":"2024-09-12T00:30:21.191837+0000","last_became_peered":"2024-09-12T00:30:21.191837+0000","last_unstale":"2024-09-12T01:10:50.303430+0000","last_undegraded":"2024-09-12T01:10:50.303430+0000","last_fullsized":"2024-09-12T01:10:50.303430+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:51.812234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":99,"num_write":307,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'142","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.522841+0000","last_change":"2024-09-12T00:30:13.122097+0000","last_active":"2024-09-12T01:09:12.522841+0000","last_peered":"2024-09-12T01:09:12.522841+0000","last_clean":"2024-09-12T01:09:12.522841+0000","last_became_active":"2024-09-12T00:30:13.121828+0000","last_became_peered":"2024-09-12T00:30:13.121828+0000","last_unstale":"2024-09-12T01:09:12.522841+0000","last_undegraded":"2024-09-12T01:09:12.522841+0000","last_fullsized":"2024-09-12T01:09:12.522841+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.165397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":656,"num_read_kb":543,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'307","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.172050+0000","last_change":"2024-09-12T00:30:11.106219+0000","last_active":"2024-09-12T01:09:22.172050+0000","last_peered":"2024-09-12T01:09:22.172050+0000","last_clean":"2024-09-12T01:09:22.172050+0000","last_became_active":"2024-09-12T00:30:11.105480+0000","last_became_peered":"2024-09-12T00:30:11.105480+0000","last_unstale":"2024-09-12T01:09:22.172050+0000","last_undegraded":"2024-09-12T01:09:22.172050+0000","last_fullsized":"2024-09-12T01:09:22.172050+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:30.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6161693,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":716,"num_read_kb":27112,"num_write":1158,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'88","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:25.698914+0000","last_change":"2024-09-12T00:30:13.130762+0000","last_active":"2024-09-12T01:09:25.698914+0000","last_peered":"2024-09-12T01:09:25.698914+0000","last_clean":"2024-09-12T01:09:25.698914+0000","last_became_active":"2024-09-12T00:30:13.130421+0000","last_became_peered":"2024-09-12T00:30:13.130421+0000","last_unstale":"2024-09-12T01:09:25.698914+0000","last_undegraded":"2024-09-12T01:09:25.698914+0000","last_fullsized":"2024-09-12T01:09:25.698914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:30.693777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":312,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'307","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.399705+0000","last_change":"2024-09-12T00:30:11.092694+0000","last_active":"2024-09-12T01:11:23.399705+0000","last_peered":"2024-09-12T01:11:23.399705+0000","last_clean":"2024-09-12T01:11:23.399705+0000","last_became_active":"2024-09-12T00:30:11.092318+0000","last_became_peered":"2024-09-12T00:30:11.092318+0000","last_unstale":"2024-09-12T01:11:23.399705+0000","last_undegraded":"2024-09-12T01:11:23.399705+0000","last_fullsized":"2024-09-12T01:11:23.399705+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:49.888269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4851765,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":385,"num_read_kb":12148,"num_write":1029,"num_write_kb":57585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'403","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.766486+0000","last_change":"2024-09-12T00:30:13.127156+0000","last_active":"2024-09-12T01:09:27.766486+0000","last_peered":"2024-09-12T01:09:27.766486+0000","last_clean":"2024-09-12T01:09:27.766486+0000","last_became_active":"2024-09-12T00:30:13.126912+0000","last_became_peered":"2024-09-12T00:30:13.126912+0000","last_unstale":"2024-09-12T01:09:27.766486+0000","last_undegraded":"2024-09-12T01:09:27.766486+0000","last_fullsized":"2024-09-12T01:09:27.766486+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:42.227244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1731,"num_read_kb":1377,"num_write":679,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'387","reported_seq":1048,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.556410+0000","last_change":"2024-09-12T00:30:11.099450+0000","last_active":"2024-09-12T01:11:23.556410+0000","last_peered":"2024-09-12T01:11:23.556410+0000","last_clean":"2024-09-12T01:11:23.556410+0000","last_became_active":"2024-09-12T00:30:11.099069+0000","last_became_peered":"2024-09-12T00:30:11.099069+0000","last_unstale":"2024-09-12T01:11:23.556410+0000","last_undegraded":"2024-09-12T01:11:23.556410+0000","last_fullsized":"2024-09-12T01:11:23.556410+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:15.083942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20449928,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":648,"num_read_kb":70901,"num_write":1239,"num_write_kb":51705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'117","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.482213+0000","last_change":"2024-09-12T00:30:13.127130+0000","last_active":"2024-09-12T01:09:12.482213+0000","last_peered":"2024-09-12T01:09:12.482213+0000","last_clean":"2024-09-12T01:09:12.482213+0000","last_became_active":"2024-09-12T00:30:13.126860+0000","last_became_peered":"2024-09-12T00:30:13.126860+0000","last_unstale":"2024-09-12T01:09:12.482213+0000","last_undegraded":"2024-09-12T01:09:12.482213+0000","last_fullsized":"2024-09-12T01:09:12.482213+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:11.846692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":463,"num_write":200,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'271","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:44.896946+0000","last_change":"2024-09-12T00:30:11.105582+0000","last_active":"2024-09-12T01:08:44.896946+0000","last_peered":"2024-09-12T01:08:44.896946+0000","last_clean":"2024-09-12T01:08:44.896946+0000","last_became_active":"2024-09-12T00:30:11.105196+0000","last_became_peered":"2024-09-12T00:30:11.105196+0000","last_unstale":"2024-09-12T01:08:44.896946+0000","last_undegraded":"2024-09-12T01:08:44.896946+0000","last_fullsized":"2024-09-12T01:08:44.896946+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:05.512265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4571982,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":405,"num_read_kb":8471,"num_write":945,"num_write_kb":46203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'4191","reported_seq":4832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.275772+0000","last_change":"2024-09-12T00:30:13.125779+0000","last_active":"2024-09-12T01:09:46.275772+0000","last_peered":"2024-09-12T01:09:46.275772+0000","last_clean":"2024-09-12T01:09:46.275772+0000","last_became_active":"2024-09-12T00:30:13.125353+0000","last_became_peered":"2024-09-12T00:30:13.125353+0000","last_unstale":"2024-09-12T01:09:46.275772+0000","last_undegraded":"2024-09-12T01:09:46.275772+0000","last_fullsized":"2024-09-12T01:09:46.275772+0000","mapping_epoch":28,"log_start":"264'4100","ondisk_log_start":"264'4100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":3000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:27.342797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16885,"num_read_kb":14166,"num_write":6282,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'310","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.392972+0000","last_change":"2024-09-12T00:30:11.108515+0000","last_active":"2024-09-12T01:09:12.392972+0000","last_peered":"2024-09-12T01:09:12.392972+0000","last_clean":"2024-09-12T01:09:12.392972+0000","last_became_active":"2024-09-12T00:30:11.108127+0000","last_became_peered":"2024-09-12T00:30:11.108127+0000","last_unstale":"2024-09-12T01:09:12.392972+0000","last_undegraded":"2024-09-12T01:09:12.392972+0000","last_fullsized":"2024-09-12T01:09:12.392972+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:39.466509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7349140,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":396,"num_read_kb":2771,"num_write":1025,"num_write_kb":29841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'185","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.516867+0000","last_change":"2024-09-12T00:30:13.129689+0000","last_active":"2024-09-12T01:07:43.516867+0000","last_peered":"2024-09-12T01:07:43.516867+0000","last_clean":"2024-09-12T01:07:43.516867+0000","last_became_active":"2024-09-12T00:30:13.129432+0000","last_became_peered":"2024-09-12T00:30:13.129432+0000","last_unstale":"2024-09-12T01:07:43.516867+0000","last_undegraded":"2024-09-12T01:07:43.516867+0000","last_fullsized":"2024-09-12T01:07:43.516867+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:23.760718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":694,"num_write":316,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'306","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:46.120237+0000","last_change":"2024-09-12T00:30:11.108733+0000","last_active":"2024-09-12T01:10:46.120237+0000","last_peered":"2024-09-12T01:10:46.120237+0000","last_clean":"2024-09-12T01:10:46.120237+0000","last_became_active":"2024-09-12T00:30:11.108351+0000","last_became_peered":"2024-09-12T00:30:11.108351+0000","last_unstale":"2024-09-12T01:10:46.120237+0000","last_undegraded":"2024-09-12T01:10:46.120237+0000","last_fullsized":"2024-09-12T01:10:46.120237+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:25.752418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5893721,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":609,"num_read_kb":30774,"num_write":1189,"num_write_kb":36026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'163","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.830877+0000","last_change":"2024-09-12T00:30:13.124976+0000","last_active":"2024-09-12T01:08:14.830877+0000","last_peered":"2024-09-12T01:08:14.830877+0000","last_clean":"2024-09-12T01:08:14.830877+0000","last_became_active":"2024-09-12T00:30:13.124637+0000","last_became_peered":"2024-09-12T00:30:13.124637+0000","last_unstale":"2024-09-12T01:08:14.830877+0000","last_undegraded":"2024-09-12T01:08:14.830877+0000","last_fullsized":"2024-09-12T01:08:14.830877+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:27.099393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":588,"num_write":241,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'307","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.749414+0000","last_change":"2024-09-12T00:30:11.110962+0000","last_active":"2024-09-12T01:09:43.749414+0000","last_peered":"2024-09-12T01:09:43.749414+0000","last_clean":"2024-09-12T01:09:43.749414+0000","last_became_active":"2024-09-12T00:30:11.108084+0000","last_became_peered":"2024-09-12T00:30:11.108084+0000","last_unstale":"2024-09-12T01:09:43.749414+0000","last_undegraded":"2024-09-12T01:09:43.749414+0000","last_fullsized":"2024-09-12T01:09:43.749414+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:46.496743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5227247,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":551,"num_read_kb":11433,"num_write":1172,"num_write_kb":28830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'237","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.819696+0000","last_change":"2024-09-12T00:30:13.129156+0000","last_active":"2024-09-12T01:09:46.819696+0000","last_peered":"2024-09-12T01:09:46.819696+0000","last_clean":"2024-09-12T01:09:46.819696+0000","last_became_active":"2024-09-12T00:30:13.128799+0000","last_became_peered":"2024-09-12T00:30:13.128799+0000","last_unstale":"2024-09-12T01:09:46.819696+0000","last_undegraded":"2024-09-12T01:09:46.819696+0000","last_fullsized":"2024-09-12T01:09:46.819696+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:02.256587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":871,"num_write":360,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'278","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.795326+0000","last_change":"2024-09-12T00:30:11.103076+0000","last_active":"2024-09-12T01:09:28.795326+0000","last_peered":"2024-09-12T01:09:28.795326+0000","last_clean":"2024-09-12T01:09:28.795326+0000","last_became_active":"2024-09-12T00:30:11.102617+0000","last_became_peered":"2024-09-12T00:30:11.102617+0000","last_unstale":"2024-09-12T01:09:28.795326+0000","last_undegraded":"2024-09-12T01:09:28.795326+0000","last_fullsized":"2024-09-12T01:09:28.795326+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11054816,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":401,"num_read_kb":18669,"num_write":949,"num_write_kb":28835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'52","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.491391+0000","last_change":"2024-09-12T00:30:13.123470+0000","last_active":"2024-09-12T01:08:22.491391+0000","last_peered":"2024-09-12T01:08:22.491391+0000","last_clean":"2024-09-12T01:08:22.491391+0000","last_became_active":"2024-09-12T00:30:13.123035+0000","last_became_peered":"2024-09-12T00:30:13.123035+0000","last_unstale":"2024-09-12T01:08:22.491391+0000","last_undegraded":"2024-09-12T01:08:22.491391+0000","last_fullsized":"2024-09-12T01:08:22.491391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.860214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":222,"num_write":77,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'300","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.517801+0000","last_change":"2024-09-12T00:30:11.112796+0000","last_active":"2024-09-12T01:11:23.517801+0000","last_peered":"2024-09-12T01:11:23.517801+0000","last_clean":"2024-09-12T01:11:23.517801+0000","last_became_active":"2024-09-12T00:30:11.110299+0000","last_became_peered":"2024-09-12T00:30:11.110299+0000","last_unstale":"2024-09-12T01:11:23.517801+0000","last_undegraded":"2024-09-12T01:11:23.517801+0000","last_fullsized":"2024-09-12T01:11:23.517801+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:24.673935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4218838,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":407,"num_read_kb":30015,"num_write":1010,"num_write_kb":30187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'180","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.132211+0000","last_change":"2024-09-12T00:30:13.124078+0000","last_active":"2024-09-12T01:09:12.132211+0000","last_peered":"2024-09-12T01:09:12.132211+0000","last_clean":"2024-09-12T01:09:12.132211+0000","last_became_active":"2024-09-12T00:30:13.123217+0000","last_became_peered":"2024-09-12T00:30:13.123217+0000","last_unstale":"2024-09-12T01:09:12.132211+0000","last_undegraded":"2024-09-12T01:09:12.132211+0000","last_fullsized":"2024-09-12T01:09:12.132211+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:27.761815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":608,"num_write":257,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'267","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475274+0000","last_change":"2024-09-12T00:30:11.103101+0000","last_active":"2024-09-12T01:08:27.475274+0000","last_peered":"2024-09-12T01:08:27.475274+0000","last_clean":"2024-09-12T01:08:27.475274+0000","last_became_active":"2024-09-12T00:30:11.102436+0000","last_became_peered":"2024-09-12T00:30:11.102436+0000","last_unstale":"2024-09-12T01:08:27.475274+0000","last_undegraded":"2024-09-12T01:08:27.475274+0000","last_fullsized":"2024-09-12T01:08:27.475274+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:41.189010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7688011,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":458,"num_read_kb":79108,"num_write":1057,"num_write_kb":40469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'217","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.852926+0000","last_change":"2024-09-12T00:30:13.130944+0000","last_active":"2024-09-12T01:09:32.852926+0000","last_peered":"2024-09-12T01:09:32.852926+0000","last_clean":"2024-09-12T01:09:32.852926+0000","last_became_active":"2024-09-12T00:30:13.129733+0000","last_became_peered":"2024-09-12T00:30:13.129733+0000","last_unstale":"2024-09-12T01:09:32.852926+0000","last_undegraded":"2024-09-12T01:09:32.852926+0000","last_fullsized":"2024-09-12T01:09:32.852926+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.671267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":953,"num_read_kb":786,"num_write":335,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'345","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.387259+0000","last_change":"2024-09-12T00:30:11.106483+0000","last_active":"2024-09-12T01:11:23.387259+0000","last_peered":"2024-09-12T01:11:23.387259+0000","last_clean":"2024-09-12T01:11:23.387259+0000","last_became_active":"2024-09-12T00:30:11.105950+0000","last_became_peered":"2024-09-12T00:30:11.105950+0000","last_unstale":"2024-09-12T01:11:23.387259+0000","last_undegraded":"2024-09-12T01:11:23.387259+0000","last_fullsized":"2024-09-12T01:11:23.387259+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:12.198729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8540255,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":552,"num_read_kb":20760,"num_write":1305,"num_write_kb":32414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'172","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.452544+0000","last_change":"2024-09-12T00:30:13.128272+0000","last_active":"2024-09-12T01:09:33.452544+0000","last_peered":"2024-09-12T01:09:33.452544+0000","last_clean":"2024-09-12T01:09:33.452544+0000","last_became_active":"2024-09-12T00:30:13.128009+0000","last_became_peered":"2024-09-12T00:30:13.128009+0000","last_unstale":"2024-09-12T01:09:33.452544+0000","last_undegraded":"2024-09-12T01:09:33.452544+0000","last_fullsized":"2024-09-12T01:09:33.452544+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:55.279618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":738,"num_read_kb":604,"num_write":258,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'329","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:42.536640+0000","last_change":"2024-09-12T00:30:11.097300+0000","last_active":"2024-09-12T01:10:42.536640+0000","last_peered":"2024-09-12T01:10:42.536640+0000","last_clean":"2024-09-12T01:10:42.536640+0000","last_became_active":"2024-09-12T00:30:11.096908+0000","last_became_peered":"2024-09-12T00:30:11.096908+0000","last_unstale":"2024-09-12T01:10:42.536640+0000","last_undegraded":"2024-09-12T01:10:42.536640+0000","last_fullsized":"2024-09-12T01:10:42.536640+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:48.080479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8750206,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":529,"num_read_kb":27822,"num_write":1259,"num_write_kb":35997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'129","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.405828+0000","last_change":"2024-09-12T00:30:13.127092+0000","last_active":"2024-09-12T01:08:28.405828+0000","last_peered":"2024-09-12T01:08:28.405828+0000","last_clean":"2024-09-12T01:08:28.405828+0000","last_became_active":"2024-09-12T00:30:13.126817+0000","last_became_peered":"2024-09-12T00:30:13.126817+0000","last_unstale":"2024-09-12T01:08:28.405828+0000","last_undegraded":"2024-09-12T01:08:28.405828+0000","last_fullsized":"2024-09-12T01:08:28.405828+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.950480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":588,"num_read_kb":486,"num_write":195,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'304","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.446448+0000","last_change":"2024-09-12T00:30:11.105919+0000","last_active":"2024-09-12T01:11:23.446448+0000","last_peered":"2024-09-12T01:11:23.446448+0000","last_clean":"2024-09-12T01:11:23.446448+0000","last_became_active":"2024-09-12T00:30:11.105575+0000","last_became_peered":"2024-09-12T00:30:11.105575+0000","last_unstale":"2024-09-12T01:11:23.446448+0000","last_undegraded":"2024-09-12T01:11:23.446448+0000","last_fullsized":"2024-09-12T01:11:23.446448+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:20.050929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10282395,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":548,"num_read_kb":45130,"num_write":1123,"num_write_kb":46621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'202","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.432143+0000","last_change":"2024-09-12T00:30:13.129377+0000","last_active":"2024-09-12T01:09:03.432143+0000","last_peered":"2024-09-12T01:09:03.432143+0000","last_clean":"2024-09-12T01:09:03.432143+0000","last_became_active":"2024-09-12T00:30:13.129092+0000","last_became_peered":"2024-09-12T00:30:13.129092+0000","last_unstale":"2024-09-12T01:09:03.432143+0000","last_undegraded":"2024-09-12T01:09:03.432143+0000","last_fullsized":"2024-09-12T01:09:03.432143+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:03.194905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":854,"num_read_kb":707,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'314","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.579292+0000","last_change":"2024-09-12T00:30:11.109364+0000","last_active":"2024-09-12T01:11:23.579292+0000","last_peered":"2024-09-12T01:11:23.579292+0000","last_clean":"2024-09-12T01:11:23.579292+0000","last_became_active":"2024-09-12T00:30:11.108616+0000","last_became_peered":"2024-09-12T00:30:11.108616+0000","last_unstale":"2024-09-12T01:11:23.579292+0000","last_undegraded":"2024-09-12T01:11:23.579292+0000","last_fullsized":"2024-09-12T01:11:23.579292+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:22.828086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505504,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":922,"num_read_kb":21858,"num_write":1119,"num_write_kb":27958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'147","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516270+0000","last_change":"2024-09-12T00:30:13.127131+0000","last_active":"2024-09-12T01:08:27.516270+0000","last_peered":"2024-09-12T01:08:27.516270+0000","last_clean":"2024-09-12T01:08:27.516270+0000","last_became_active":"2024-09-12T00:30:13.125887+0000","last_became_peered":"2024-09-12T00:30:13.125887+0000","last_unstale":"2024-09-12T01:08:27.516270+0000","last_undegraded":"2024-09-12T01:08:27.516270+0000","last_fullsized":"2024-09-12T01:08:27.516270+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:40.857952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":559,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'294","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.378697+0000","last_change":"2024-09-12T00:30:46.396636+0000","last_active":"2024-09-12T01:11:23.378697+0000","last_peered":"2024-09-12T01:11:23.378697+0000","last_clean":"2024-09-12T01:11:23.378697+0000","last_became_active":"2024-09-12T00:30:46.396288+0000","last_became_peered":"2024-09-12T00:30:46.396288+0000","last_unstale":"2024-09-12T01:11:23.378697+0000","last_undegraded":"2024-09-12T01:11:23.378697+0000","last_fullsized":"2024-09-12T01:11:23.378697+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:48.101790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10096145,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":500,"num_read_kb":21012,"num_write":1019,"num_write_kb":30668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'249","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.546201+0000","last_change":"2024-09-12T00:30:13.127777+0000","last_active":"2024-09-12T01:09:43.546201+0000","last_peered":"2024-09-12T01:09:43.546201+0000","last_clean":"2024-09-12T01:09:43.546201+0000","last_became_active":"2024-09-12T00:30:13.127513+0000","last_became_peered":"2024-09-12T00:30:13.127513+0000","last_unstale":"2024-09-12T01:09:43.546201+0000","last_undegraded":"2024-09-12T01:09:43.546201+0000","last_fullsized":"2024-09-12T01:09:43.546201+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:22.047664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":791,"num_write":358,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'299","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.550256+0000","last_change":"2024-09-12T00:30:11.110035+0000","last_active":"2024-09-12T01:11:23.550256+0000","last_peered":"2024-09-12T01:11:23.550256+0000","last_clean":"2024-09-12T01:11:23.550256+0000","last_became_active":"2024-09-12T00:30:11.109661+0000","last_became_peered":"2024-09-12T00:30:11.109661+0000","last_unstale":"2024-09-12T01:11:23.550256+0000","last_undegraded":"2024-09-12T01:11:23.550256+0000","last_fullsized":"2024-09-12T01:11:23.550256+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:51.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8646628,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":422,"num_read_kb":8210,"num_write":1051,"num_write_kb":36173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'284","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.578179+0000","last_change":"2024-09-12T00:30:11.113547+0000","last_active":"2024-09-12T01:11:23.578179+0000","last_peered":"2024-09-12T01:11:23.578179+0000","last_clean":"2024-09-12T01:11:23.578179+0000","last_became_active":"2024-09-12T00:30:11.113173+0000","last_became_peered":"2024-09-12T00:30:11.113173+0000","last_unstale":"2024-09-12T01:11:23.578179+0000","last_undegraded":"2024-09-12T01:11:23.578179+0000","last_fullsized":"2024-09-12T01:11:23.578179+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:20.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8387571,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":453,"num_read_kb":50214,"num_write":1026,"num_write_kb":47204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'24","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.520781+0000","last_change":"2024-09-12T00:30:13.126552+0000","last_active":"2024-09-12T01:08:57.520781+0000","last_peered":"2024-09-12T01:08:57.520781+0000","last_clean":"2024-09-12T01:08:57.520781+0000","last_became_active":"2024-09-12T00:30:13.126264+0000","last_became_peered":"2024-09-12T00:30:13.126264+0000","last_unstale":"2024-09-12T01:08:57.520781+0000","last_undegraded":"2024-09-12T01:08:57.520781+0000","last_fullsized":"2024-09-12T01:08:57.520781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:09.574554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":113,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'304","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.038387+0000","last_change":"2024-09-12T00:30:11.102417+0000","last_active":"2024-09-12T01:09:33.038387+0000","last_peered":"2024-09-12T01:09:33.038387+0000","last_clean":"2024-09-12T01:09:33.038387+0000","last_became_active":"2024-09-12T00:30:11.102026+0000","last_became_peered":"2024-09-12T00:30:11.102026+0000","last_unstale":"2024-09-12T01:09:33.038387+0000","last_undegraded":"2024-09-12T01:09:33.038387+0000","last_fullsized":"2024-09-12T01:09:33.038387+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:54.893481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5791192,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":599,"num_read_kb":9482,"num_write":1140,"num_write_kb":28977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'250","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.409374+0000","last_change":"2024-09-12T00:30:13.120189+0000","last_active":"2024-09-12T01:08:53.409374+0000","last_peered":"2024-09-12T01:08:53.409374+0000","last_clean":"2024-09-12T01:08:53.409374+0000","last_became_active":"2024-09-12T00:30:13.119872+0000","last_became_peered":"2024-09-12T00:30:13.119872+0000","last_unstale":"2024-09-12T01:08:53.409374+0000","last_undegraded":"2024-09-12T01:08:53.409374+0000","last_fullsized":"2024-09-12T01:08:53.409374+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:30.740866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":987,"num_write":428,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5946,"num_read_kb":4236,"num_write":1962,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1033,"ondisk_log_size":1033,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15005,"num_read_kb":14670,"num_write":16786,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1559,"ondisk_log_size":1559,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":653,"ondisk_log_size":653,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1834349,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17337,"num_read_kb":33944,"num_write":14556,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":2188983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2120,"ondisk_log_size":2120,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2429,"num_read_kb":2894,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102018,"num_read_kb":85254,"num_write":36979,"num_write_kb":18604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4230,"ondisk_log_size":4230,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":484632839,"num_objects":3635,"num_object_clones":0,"num_object_copies":14540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3635,"num_whiteouts":0,"num_read":32867,"num_read_kb":1917388,"num_write":68791,"num_write_kb":2191736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":694988800,"data_stored":694988800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4493,"ondisk_log_size":4493,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59550535,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":139,"num_read_kb":170064,"num_write":163,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127492096,"data_stored":127481486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":53477376,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":141,"num_read_kb":168795,"num_write":167,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122466304,"data_stored":122460999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509946,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":360208,"kb_used_data":144384,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94011632,"statfs":{"total":96636764160,"available":96267911168,"internally_reserved":0,"allocated":147849216,"data_stored":145818234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":220985799},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509943,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398712,"kb_used_data":118920,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93973128,"statfs":{"total":96636764160,"available":96228483072,"internally_reserved":0,"allocated":121774080,"data_stored":119734403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509943,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":219716,"kb_used_data":89836,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94152124,"statfs":{"total":96636764160,"available":96411774976,"internally_reserved":0,"allocated":91992064,"data_stored":89952552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542648,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345276,"kb_used_data":137836,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94026564,"statfs":{"total":96636764160,"available":96283201536,"internally_reserved":0,"allocated":141144064,"data_stored":139135656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542647,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248136,"kb_used_data":148984,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94123704,"statfs":{"total":96636764160,"available":96382672896,"internally_reserved":0,"allocated":152559616,"data_stored":150532187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":101513671},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542645,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373592,"kb_used_data":148040,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93998248,"statfs":{"total":96636764160,"available":96254205952,"internally_reserved":0,"allocated":151592960,"data_stored":149551159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542648,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316856,"kb_used_data":127464,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":94054984,"statfs":{"total":96636764160,"available":96312303616,"internally_reserved":0,"allocated":130523136,"data_stored":128478045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575351,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280840,"kb_used_data":155256,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94091000,"statfs":{"total":96636764160,"available":96349184000,"internally_reserved":0,"allocated":158982144,"data_stored":156982372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":70447104,"data_stored":70447104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65097728,"data_stored":65097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":124665856,"data_stored":124665856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":79831040,"data_stored":79831040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":108998656,"data_stored":108998656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98582528,"data_stored":98582528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83771392,"data_stored":83771392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63594496,"data_stored":63594496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":281248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":291285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":127269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":208702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":361226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":391794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":348198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":179261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15749120,"data_stored":15749120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":10017451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23072768,"data_stored":23072768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24358912,"data_stored":24354972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14667776,"data_stored":14667776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":9102833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14221312,"data_stored":14219947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6287360,"data_stored":6287360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6881280,"data_stored":6879915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24694784,"data_stored":24693419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39837696,"data_stored":39837696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17031168,"data_stored":17027228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:26.979 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:11:26.980 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:27.318 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:11:27.330 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T01:11:27.332 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":1504,"stamp":"2024-09-12T01:11:26.232250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600103598,"num_objects":4033,"num_object_clones":0,"num_object_copies":15336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4033,"num_whiteouts":0,"num_read":175960,"num_read_kb":2397312,"num_write":139547,"num_write_kb":2482850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14391,"ondisk_log_size":14391,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2543336,"kb_used_data":1070720,"kb_used_omap":12,"kb_used_meta":1472179,"kb_avail":752431384,"statfs":{"total":773094113280,"available":770489737216,"internally_reserved":0,"allocated":1096417280,"data_stored":1080184608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1507511858},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-117297587,"num_objects":-863,"num_object_clones":0,"num_object_copies":-3424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-863,"num_whiteouts":0,"num_read":991,"num_read_kb":1058,"num_write":927,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005837"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509864+0000","last_change":"2024-09-12T00:56:52.991247+0000","last_active":"2024-09-12T01:06:53.509864+0000","last_peered":"2024-09-12T01:06:53.509864+0000","last_clean":"2024-09-12T01:06:53.509864+0000","last_became_active":"2024-09-12T00:56:52.990975+0000","last_became_peered":"2024-09-12T00:56:52.990975+0000","last_unstale":"2024-09-12T01:06:53.509864+0000","last_undegraded":"2024-09-12T01:06:53.509864+0000","last_fullsized":"2024-09-12T01:06:53.509864+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:25.467438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.408743+0000","last_change":"2024-09-12T00:46:19.285045+0000","last_active":"2024-09-12T01:08:48.408743+0000","last_peered":"2024-09-12T01:08:48.408743+0000","last_clean":"2024-09-12T01:08:48.408743+0000","last_became_active":"2024-09-12T00:46:19.284774+0000","last_became_peered":"2024-09-12T00:46:19.284774+0000","last_unstale":"2024-09-12T01:08:48.408743+0000","last_undegraded":"2024-09-12T01:08:48.408743+0000","last_fullsized":"2024-09-12T01:08:48.408743+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:05.942678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.410391+0000","last_change":"2024-09-12T00:46:16.275794+0000","last_active":"2024-09-12T01:11:18.410391+0000","last_peered":"2024-09-12T01:11:18.410391+0000","last_clean":"2024-09-12T01:11:18.410391+0000","last_became_active":"2024-09-12T00:46:16.275529+0000","last_became_peered":"2024-09-12T00:46:16.275529+0000","last_unstale":"2024-09-12T01:11:18.410391+0000","last_undegraded":"2024-09-12T01:11:18.410391+0000","last_fullsized":"2024-09-12T01:11:18.410391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:10.602032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'24","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.244847+0000","last_change":"2024-09-12T00:44:37.816651+0000","last_active":"2024-09-12T01:08:22.244847+0000","last_peered":"2024-09-12T01:08:22.244847+0000","last_clean":"2024-09-12T01:08:22.244847+0000","last_became_active":"2024-09-12T00:44:37.816192+0000","last_became_peered":"2024-09-12T00:44:37.816192+0000","last_unstale":"2024-09-12T01:08:22.244847+0000","last_undegraded":"2024-09-12T01:08:22.244847+0000","last_fullsized":"2024-09-12T01:08:22.244847+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:52.133009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:52.373304+0000","last_change":"2024-09-12T00:56:52.996167+0000","last_active":"2024-09-12T01:06:52.373304+0000","last_peered":"2024-09-12T01:06:52.373304+0000","last_clean":"2024-09-12T01:06:52.373304+0000","last_became_active":"2024-09-12T00:56:52.995871+0000","last_became_peered":"2024-09-12T00:56:52.995871+0000","last_unstale":"2024-09-12T01:06:52.373304+0000","last_undegraded":"2024-09-12T01:06:52.373304+0000","last_fullsized":"2024-09-12T01:06:52.373304+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:23.434095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:51.498180+0000","last_change":"2024-09-12T00:46:19.285212+0000","last_active":"2024-09-12T01:08:51.498180+0000","last_peered":"2024-09-12T01:08:51.498180+0000","last_clean":"2024-09-12T01:08:51.498180+0000","last_became_active":"2024-09-12T00:46:19.284875+0000","last_became_peered":"2024-09-12T00:46:19.284875+0000","last_unstale":"2024-09-12T01:08:51.498180+0000","last_undegraded":"2024-09-12T01:08:51.498180+0000","last_fullsized":"2024-09-12T01:08:51.498180+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:33.439048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.478299+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:08:47.478299+0000","last_peered":"2024-09-12T01:08:47.478299+0000","last_clean":"2024-09-12T01:08:47.478299+0000","last_became_active":"2024-09-12T00:46:16.275381+0000","last_became_peered":"2024-09-12T00:46:16.275381+0000","last_unstale":"2024-09-12T01:08:47.478299+0000","last_undegraded":"2024-09-12T01:08:47.478299+0000","last_fullsized":"2024-09-12T01:08:47.478299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.675654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'45","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.444239+0000","last_change":"2024-09-12T00:44:37.819913+0000","last_active":"2024-09-12T01:08:56.444239+0000","last_peered":"2024-09-12T01:08:56.444239+0000","last_clean":"2024-09-12T01:08:56.444239+0000","last_became_active":"2024-09-12T00:44:37.819561+0000","last_became_peered":"2024-09-12T00:44:37.819561+0000","last_unstale":"2024-09-12T01:08:56.444239+0000","last_undegraded":"2024-09-12T01:08:56.444239+0000","last_fullsized":"2024-09-12T01:08:56.444239+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:18.208589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":164,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409863+0000","last_change":"2024-09-12T00:56:52.990647+0000","last_active":"2024-09-12T01:08:58.409863+0000","last_peered":"2024-09-12T01:08:58.409863+0000","last_clean":"2024-09-12T01:08:58.409863+0000","last_became_active":"2024-09-12T00:56:52.990364+0000","last_became_peered":"2024-09-12T00:56:52.990364+0000","last_unstale":"2024-09-12T01:08:58.409863+0000","last_undegraded":"2024-09-12T01:08:58.409863+0000","last_fullsized":"2024-09-12T01:08:58.409863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:34.228970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.483121+0000","last_change":"2024-09-12T00:46:19.285614+0000","last_active":"2024-09-12T01:09:17.483121+0000","last_peered":"2024-09-12T01:09:17.483121+0000","last_clean":"2024-09-12T01:09:17.483121+0000","last_became_active":"2024-09-12T00:46:19.285357+0000","last_became_peered":"2024-09-12T00:46:19.285357+0000","last_unstale":"2024-09-12T01:09:17.483121+0000","last_undegraded":"2024-09-12T01:09:17.483121+0000","last_fullsized":"2024-09-12T01:09:17.483121+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:02.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":2,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.384512+0000","last_change":"2024-09-12T00:46:16.278495+0000","last_active":"2024-09-12T01:08:18.384512+0000","last_peered":"2024-09-12T01:08:18.384512+0000","last_clean":"2024-09-12T01:08:18.384512+0000","last_became_active":"2024-09-12T00:46:16.278221+0000","last_became_peered":"2024-09-12T00:46:16.278221+0000","last_unstale":"2024-09-12T01:08:18.384512+0000","last_undegraded":"2024-09-12T01:08:18.384512+0000","last_fullsized":"2024-09-12T01:08:18.384512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:42.560119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5130,"num_write":12,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'37","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375379+0000","last_change":"2024-09-12T00:44:37.818554+0000","last_active":"2024-09-12T01:07:07.375379+0000","last_peered":"2024-09-12T01:07:07.375379+0000","last_clean":"2024-09-12T01:07:07.375379+0000","last_became_active":"2024-09-12T00:44:37.818239+0000","last_became_peered":"2024-09-12T00:44:37.818239+0000","last_unstale":"2024-09-12T01:07:07.375379+0000","last_undegraded":"2024-09-12T01:07:07.375379+0000","last_fullsized":"2024-09-12T01:07:07.375379+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:53.443510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":144,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:37.459106+0000","last_change":"2024-09-12T00:56:52.995412+0000","last_active":"2024-09-12T01:06:37.459106+0000","last_peered":"2024-09-12T01:06:37.459106+0000","last_clean":"2024-09-12T01:06:37.459106+0000","last_became_active":"2024-09-12T00:56:52.995062+0000","last_became_peered":"2024-09-12T00:56:52.995062+0000","last_unstale":"2024-09-12T01:06:37.459106+0000","last_undegraded":"2024-09-12T01:06:37.459106+0000","last_fullsized":"2024-09-12T01:06:37.459106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.136639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475349+0000","last_change":"2024-09-12T00:46:19.285095+0000","last_active":"2024-09-12T01:08:27.475349+0000","last_peered":"2024-09-12T01:08:27.475349+0000","last_clean":"2024-09-12T01:08:27.475349+0000","last_became_active":"2024-09-12T00:46:19.284822+0000","last_became_peered":"2024-09-12T00:46:19.284822+0000","last_unstale":"2024-09-12T01:08:27.475349+0000","last_undegraded":"2024-09-12T01:08:27.475349+0000","last_fullsized":"2024-09-12T01:08:27.475349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:42.407553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411818+0000","last_change":"2024-09-12T00:46:16.261917+0000","last_active":"2024-09-12T01:09:13.411818+0000","last_peered":"2024-09-12T01:09:13.411818+0000","last_clean":"2024-09-12T01:09:13.411818+0000","last_became_active":"2024-09-12T00:46:16.261617+0000","last_became_peered":"2024-09-12T00:46:16.261617+0000","last_unstale":"2024-09-12T01:09:13.411818+0000","last_undegraded":"2024-09-12T01:09:13.411818+0000","last_fullsized":"2024-09-12T01:09:13.411818+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:45.217925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.392519+0000","last_change":"2024-09-12T00:44:37.815822+0000","last_active":"2024-09-12T01:08:00.392519+0000","last_peered":"2024-09-12T01:08:00.392519+0000","last_clean":"2024-09-12T01:08:00.392519+0000","last_became_active":"2024-09-12T00:44:37.815325+0000","last_became_peered":"2024-09-12T00:44:37.815325+0000","last_unstale":"2024-09-12T01:08:00.392519+0000","last_undegraded":"2024-09-12T01:08:00.392519+0000","last_fullsized":"2024-09-12T01:08:00.392519+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:41.073259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":218,"num_write":105,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389388+0000","last_change":"2024-09-12T00:56:52.991644+0000","last_active":"2024-09-12T01:08:53.389388+0000","last_peered":"2024-09-12T01:08:53.389388+0000","last_clean":"2024-09-12T01:08:53.389388+0000","last_became_active":"2024-09-12T00:56:52.991358+0000","last_became_peered":"2024-09-12T00:56:52.991358+0000","last_unstale":"2024-09-12T01:08:53.389388+0000","last_undegraded":"2024-09-12T01:08:53.389388+0000","last_fullsized":"2024-09-12T01:08:53.389388+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:23.445118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520059+0000","last_change":"2024-09-12T00:46:19.274308+0000","last_active":"2024-09-12T01:08:08.520059+0000","last_peered":"2024-09-12T01:08:08.520059+0000","last_clean":"2024-09-12T01:08:08.520059+0000","last_became_active":"2024-09-12T00:46:19.274024+0000","last_became_peered":"2024-09-12T00:46:19.274024+0000","last_unstale":"2024-09-12T01:08:08.520059+0000","last_undegraded":"2024-09-12T01:08:08.520059+0000","last_fullsized":"2024-09-12T01:08:08.520059+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.097376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.471438+0000","last_change":"2024-09-12T00:46:16.272503+0000","last_active":"2024-09-12T01:08:02.471438+0000","last_peered":"2024-09-12T01:08:02.471438+0000","last_clean":"2024-09-12T01:08:02.471438+0000","last_became_active":"2024-09-12T00:46:16.272230+0000","last_became_peered":"2024-09-12T00:46:16.272230+0000","last_unstale":"2024-09-12T01:08:02.471438+0000","last_undegraded":"2024-09-12T01:08:02.471438+0000","last_fullsized":"2024-09-12T01:08:02.471438+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:22.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'26","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375307+0000","last_change":"2024-09-12T00:44:37.821557+0000","last_active":"2024-09-12T01:07:07.375307+0000","last_peered":"2024-09-12T01:07:07.375307+0000","last_clean":"2024-09-12T01:07:07.375307+0000","last_became_active":"2024-09-12T00:44:37.821297+0000","last_became_peered":"2024-09-12T00:44:37.821297+0000","last_unstale":"2024-09-12T01:07:07.375307+0000","last_undegraded":"2024-09-12T01:07:07.375307+0000","last_fullsized":"2024-09-12T01:07:07.375307+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.631261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.506633+0000","last_change":"2024-09-12T00:56:52.990792+0000","last_active":"2024-09-12T01:07:17.506633+0000","last_peered":"2024-09-12T01:07:17.506633+0000","last_clean":"2024-09-12T01:07:17.506633+0000","last_became_active":"2024-09-12T00:56:52.990528+0000","last_became_peered":"2024-09-12T00:56:52.990528+0000","last_unstale":"2024-09-12T01:07:17.506633+0000","last_undegraded":"2024-09-12T01:07:17.506633+0000","last_fullsized":"2024-09-12T01:07:17.506633+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:30.175859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'7","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.222506+0000","last_change":"2024-09-12T00:46:19.281162+0000","last_active":"2024-09-12T01:11:23.222506+0000","last_peered":"2024-09-12T01:11:23.222506+0000","last_clean":"2024-09-12T01:11:23.222506+0000","last_became_active":"2024-09-12T00:46:19.280794+0000","last_became_peered":"2024-09-12T00:46:19.280794+0000","last_unstale":"2024-09-12T01:11:23.222506+0000","last_undegraded":"2024-09-12T01:11:23.222506+0000","last_fullsized":"2024-09-12T01:11:23.222506+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:50.182755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":12296,"num_write":7,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.599017+0000","last_change":"2024-09-12T00:46:16.267841+0000","last_active":"2024-09-12T01:08:08.599017+0000","last_peered":"2024-09-12T01:08:08.599017+0000","last_clean":"2024-09-12T01:08:08.599017+0000","last_became_active":"2024-09-12T00:46:16.267528+0000","last_became_peered":"2024-09-12T00:46:16.267528+0000","last_unstale":"2024-09-12T01:08:08.599017+0000","last_undegraded":"2024-09-12T01:08:08.599017+0000","last_fullsized":"2024-09-12T01:08:08.599017+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8204,"num_write":4,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'128","reported_seq":430,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.484992+0000","last_change":"2024-09-12T00:44:37.819828+0000","last_active":"2024-09-12T01:07:11.484992+0000","last_peered":"2024-09-12T01:07:11.484992+0000","last_clean":"2024-09-12T01:07:11.484992+0000","last_became_active":"2024-09-12T00:44:37.819556+0000","last_became_peered":"2024-09-12T00:44:37.819556+0000","last_unstale":"2024-09-12T01:07:11.484992+0000","last_undegraded":"2024-09-12T01:07:11.484992+0000","last_fullsized":"2024-09-12T01:07:11.484992+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:37.132092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":767,"num_read_kb":571,"num_write":157,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.482640+0000","last_change":"2024-09-12T00:56:52.992341+0000","last_active":"2024-09-12T01:06:56.482640+0000","last_peered":"2024-09-12T01:06:56.482640+0000","last_clean":"2024-09-12T01:06:56.482640+0000","last_became_active":"2024-09-12T00:56:52.992081+0000","last_became_peered":"2024-09-12T00:56:52.992081+0000","last_unstale":"2024-09-12T01:06:56.482640+0000","last_undegraded":"2024-09-12T01:06:56.482640+0000","last_fullsized":"2024-09-12T01:06:56.482640+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:38.856681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'6","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:51.498160+0000","last_change":"2024-09-12T00:46:19.280066+0000","last_active":"2024-09-12T01:08:51.498160+0000","last_peered":"2024-09-12T01:08:51.498160+0000","last_clean":"2024-09-12T01:08:51.498160+0000","last_became_active":"2024-09-12T00:46:19.279811+0000","last_became_peered":"2024-09-12T00:46:19.279811+0000","last_unstale":"2024-09-12T01:08:51.498160+0000","last_undegraded":"2024-09-12T01:08:51.498160+0000","last_fullsized":"2024-09-12T01:08:51.498160+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.923506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":13308,"num_write":11,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'4","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.524972+0000","last_change":"2024-09-12T00:46:16.274833+0000","last_active":"2024-09-12T01:08:48.524972+0000","last_peered":"2024-09-12T01:08:48.524972+0000","last_clean":"2024-09-12T01:08:48.524972+0000","last_became_active":"2024-09-12T00:46:16.274541+0000","last_became_peered":"2024-09-12T00:46:16.274541+0000","last_unstale":"2024-09-12T01:08:48.524972+0000","last_undegraded":"2024-09-12T01:08:48.524972+0000","last_fullsized":"2024-09-12T01:08:48.524972+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:58.251023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'13","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388468+0000","last_change":"2024-09-12T00:44:37.817411+0000","last_active":"2024-09-12T01:08:48.388468+0000","last_peered":"2024-09-12T01:08:48.388468+0000","last_clean":"2024-09-12T01:08:48.388468+0000","last_became_active":"2024-09-12T00:44:37.817108+0000","last_became_peered":"2024-09-12T00:44:37.817108+0000","last_unstale":"2024-09-12T01:08:48.388468+0000","last_undegraded":"2024-09-12T01:08:48.388468+0000","last_fullsized":"2024-09-12T01:08:48.388468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:45.282350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509925+0000","last_change":"2024-09-12T00:56:52.989648+0000","last_active":"2024-09-12T01:06:53.509925+0000","last_peered":"2024-09-12T01:06:53.509925+0000","last_clean":"2024-09-12T01:06:53.509925+0000","last_became_active":"2024-09-12T00:56:52.989394+0000","last_became_peered":"2024-09-12T00:56:52.989394+0000","last_unstale":"2024-09-12T01:06:53.509925+0000","last_undegraded":"2024-09-12T01:06:53.509925+0000","last_fullsized":"2024-09-12T01:06:53.509925+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:17.324226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389271+0000","last_change":"2024-09-12T00:46:19.282381+0000","last_active":"2024-09-12T01:08:53.389271+0000","last_peered":"2024-09-12T01:08:53.389271+0000","last_clean":"2024-09-12T01:08:53.389271+0000","last_became_active":"2024-09-12T00:46:19.280878+0000","last_became_peered":"2024-09-12T00:46:19.280878+0000","last_unstale":"2024-09-12T01:08:53.389271+0000","last_undegraded":"2024-09-12T01:08:53.389271+0000","last_fullsized":"2024-09-12T01:08:53.389271+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:37.733061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10236,"num_write":10,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'1","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389440+0000","last_change":"2024-09-12T00:46:16.278285+0000","last_active":"2024-09-12T01:08:47.389440+0000","last_peered":"2024-09-12T01:08:47.389440+0000","last_clean":"2024-09-12T01:08:47.389440+0000","last_became_active":"2024-09-12T00:46:16.277776+0000","last_became_peered":"2024-09-12T00:46:16.277776+0000","last_unstale":"2024-09-12T01:08:47.389440+0000","last_undegraded":"2024-09-12T01:08:47.389440+0000","last_fullsized":"2024-09-12T01:08:47.389440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:47.993297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'18","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389367+0000","last_change":"2024-09-12T00:44:37.816393+0000","last_active":"2024-09-12T01:08:47.389367+0000","last_peered":"2024-09-12T01:08:47.389367+0000","last_clean":"2024-09-12T01:08:47.389367+0000","last_became_active":"2024-09-12T00:44:37.815820+0000","last_became_peered":"2024-09-12T00:44:37.815820+0000","last_unstale":"2024-09-12T01:08:47.389367+0000","last_undegraded":"2024-09-12T01:08:47.389367+0000","last_fullsized":"2024-09-12T01:08:47.389367+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:49.470552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.475979+0000","last_change":"2024-09-12T00:56:52.996102+0000","last_active":"2024-09-12T01:08:32.475979+0000","last_peered":"2024-09-12T01:08:32.475979+0000","last_clean":"2024-09-12T01:08:32.475979+0000","last_became_active":"2024-09-12T00:56:52.995696+0000","last_became_peered":"2024-09-12T00:56:52.995696+0000","last_unstale":"2024-09-12T01:08:32.475979+0000","last_undegraded":"2024-09-12T01:08:32.475979+0000","last_fullsized":"2024-09-12T01:08:32.475979+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:57.634150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383372+0000","last_change":"2024-09-12T00:46:19.282715+0000","last_active":"2024-09-12T01:08:08.383372+0000","last_peered":"2024-09-12T01:08:08.383372+0000","last_clean":"2024-09-12T01:08:08.383372+0000","last_became_active":"2024-09-12T00:46:19.282466+0000","last_became_peered":"2024-09-12T00:46:19.282466+0000","last_unstale":"2024-09-12T01:08:08.383372+0000","last_undegraded":"2024-09-12T01:08:08.383372+0000","last_fullsized":"2024-09-12T01:08:08.383372+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.083481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.612173+0000","last_change":"2024-09-12T00:46:16.268948+0000","last_active":"2024-09-12T01:09:43.612173+0000","last_peered":"2024-09-12T01:09:43.612173+0000","last_clean":"2024-09-12T01:09:43.612173+0000","last_became_active":"2024-09-12T00:46:16.268479+0000","last_became_peered":"2024-09-12T00:46:16.268479+0000","last_unstale":"2024-09-12T01:09:43.612173+0000","last_undegraded":"2024-09-12T01:09:43.612173+0000","last_fullsized":"2024-09-12T01:09:43.612173+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:29.450733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519282+0000","last_change":"2024-09-12T00:44:37.811999+0000","last_active":"2024-09-12T01:08:47.519282+0000","last_peered":"2024-09-12T01:08:47.519282+0000","last_clean":"2024-09-12T01:08:47.519282+0000","last_became_active":"2024-09-12T00:44:37.811697+0000","last_became_peered":"2024-09-12T00:44:37.811697+0000","last_unstale":"2024-09-12T01:08:47.519282+0000","last_undegraded":"2024-09-12T01:08:47.519282+0000","last_fullsized":"2024-09-12T01:08:47.519282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:46.654992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":57,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.387544+0000","last_change":"2024-09-12T00:56:52.985166+0000","last_active":"2024-09-12T01:08:32.387544+0000","last_peered":"2024-09-12T01:08:32.387544+0000","last_clean":"2024-09-12T01:08:32.387544+0000","last_became_active":"2024-09-12T00:56:52.984878+0000","last_became_peered":"2024-09-12T00:56:52.984878+0000","last_unstale":"2024-09-12T01:08:32.387544+0000","last_undegraded":"2024-09-12T01:08:32.387544+0000","last_fullsized":"2024-09-12T01:08:32.387544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.409540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.466660+0000","last_change":"2024-09-12T00:46:19.276813+0000","last_active":"2024-09-12T01:07:27.466660+0000","last_peered":"2024-09-12T01:07:27.466660+0000","last_clean":"2024-09-12T01:07:27.466660+0000","last_became_active":"2024-09-12T00:46:19.276197+0000","last_became_peered":"2024-09-12T00:46:19.276197+0000","last_unstale":"2024-09-12T01:07:27.466660+0000","last_undegraded":"2024-09-12T01:07:27.466660+0000","last_fullsized":"2024-09-12T01:07:27.466660+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:53.182491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'7","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519377+0000","last_change":"2024-09-12T00:46:16.264295+0000","last_active":"2024-09-12T01:08:03.519377+0000","last_peered":"2024-09-12T01:08:03.519377+0000","last_clean":"2024-09-12T01:08:03.519377+0000","last_became_active":"2024-09-12T00:46:16.263870+0000","last_became_peered":"2024-09-12T00:46:16.263870+0000","last_unstale":"2024-09-12T01:08:03.519377+0000","last_undegraded":"2024-09-12T01:08:03.519377+0000","last_fullsized":"2024-09-12T01:08:03.519377+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:24.692637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":17,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'37","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519258+0000","last_change":"2024-09-12T00:44:37.820673+0000","last_active":"2024-09-12T01:08:47.519258+0000","last_peered":"2024-09-12T01:08:47.519258+0000","last_clean":"2024-09-12T01:08:47.519258+0000","last_became_active":"2024-09-12T00:44:37.820232+0000","last_became_peered":"2024-09-12T00:44:37.820232+0000","last_unstale":"2024-09-12T01:08:47.519258+0000","last_undegraded":"2024-09-12T01:08:47.519258+0000","last_fullsized":"2024-09-12T01:08:47.519258+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.688623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496180+0000","last_change":"2024-09-12T00:56:52.987731+0000","last_active":"2024-09-12T01:08:36.496180+0000","last_peered":"2024-09-12T01:08:36.496180+0000","last_clean":"2024-09-12T01:08:36.496180+0000","last_became_active":"2024-09-12T00:56:52.987492+0000","last_became_peered":"2024-09-12T00:56:52.987492+0000","last_unstale":"2024-09-12T01:08:36.496180+0000","last_undegraded":"2024-09-12T01:08:36.496180+0000","last_fullsized":"2024-09-12T01:08:36.496180+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.155360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'9","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383413+0000","last_change":"2024-09-12T00:46:19.287908+0000","last_active":"2024-09-12T01:08:08.383413+0000","last_peered":"2024-09-12T01:08:08.383413+0000","last_clean":"2024-09-12T01:08:08.383413+0000","last_became_active":"2024-09-12T00:46:19.286860+0000","last_became_peered":"2024-09-12T00:46:19.286860+0000","last_unstale":"2024-09-12T01:08:08.383413+0000","last_undegraded":"2024-09-12T01:08:08.383413+0000","last_fullsized":"2024-09-12T01:08:08.383413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:54.927557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13316,"num_write":14,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.382795+0000","last_change":"2024-09-12T00:46:16.279497+0000","last_active":"2024-09-12T01:08:03.382795+0000","last_peered":"2024-09-12T01:08:03.382795+0000","last_clean":"2024-09-12T01:08:03.382795+0000","last_became_active":"2024-09-12T00:46:16.279114+0000","last_became_peered":"2024-09-12T00:46:16.279114+0000","last_unstale":"2024-09-12T01:08:03.382795+0000","last_undegraded":"2024-09-12T01:08:03.382795+0000","last_fullsized":"2024-09-12T01:08:03.382795+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:42.826584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":2,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'25","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388537+0000","last_change":"2024-09-12T00:44:37.819571+0000","last_active":"2024-09-12T01:08:48.388537+0000","last_peered":"2024-09-12T01:08:48.388537+0000","last_clean":"2024-09-12T01:08:48.388537+0000","last_became_active":"2024-09-12T00:44:37.819153+0000","last_became_peered":"2024-09-12T00:44:37.819153+0000","last_unstale":"2024-09-12T01:08:48.388537+0000","last_undegraded":"2024-09-12T01:08:48.388537+0000","last_fullsized":"2024-09-12T01:08:48.388537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:27.117588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":89,"num_write":41,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.523138+0000","last_change":"2024-09-12T00:56:52.990539+0000","last_active":"2024-09-12T01:08:33.523138+0000","last_peered":"2024-09-12T01:08:33.523138+0000","last_clean":"2024-09-12T01:08:33.523138+0000","last_became_active":"2024-09-12T00:56:52.990265+0000","last_became_peered":"2024-09-12T00:56:52.990265+0000","last_unstale":"2024-09-12T01:08:33.523138+0000","last_undegraded":"2024-09-12T01:08:33.523138+0000","last_fullsized":"2024-09-12T01:08:33.523138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:41.315107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519397+0000","last_change":"2024-09-12T00:46:19.277307+0000","last_active":"2024-09-12T01:08:03.519397+0000","last_peered":"2024-09-12T01:08:03.519397+0000","last_clean":"2024-09-12T01:08:03.519397+0000","last_became_active":"2024-09-12T00:46:19.277011+0000","last_became_peered":"2024-09-12T00:46:19.277011+0000","last_unstale":"2024-09-12T01:08:03.519397+0000","last_undegraded":"2024-09-12T01:08:03.519397+0000","last_fullsized":"2024-09-12T01:08:03.519397+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:43.590749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.471543+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:08:02.471543+0000","last_peered":"2024-09-12T01:08:02.471543+0000","last_clean":"2024-09-12T01:08:02.471543+0000","last_became_active":"2024-09-12T00:46:16.275403+0000","last_became_peered":"2024-09-12T00:46:16.275403+0000","last_unstale":"2024-09-12T01:08:02.471543+0000","last_undegraded":"2024-09-12T01:08:02.471543+0000","last_fullsized":"2024-09-12T01:08:02.471543+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.331770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202496,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5128,"num_write":2,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"264'68","reported_seq":266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.598342+0000","last_change":"2024-09-12T00:44:37.821656+0000","last_active":"2024-09-12T01:08:03.598342+0000","last_peered":"2024-09-12T01:08:03.598342+0000","last_clean":"2024-09-12T01:08:03.598342+0000","last_became_active":"2024-09-12T00:44:37.821192+0000","last_became_peered":"2024-09-12T00:44:37.821192+0000","last_unstale":"2024-09-12T01:08:03.598342+0000","last_undegraded":"2024-09-12T01:08:03.598342+0000","last_fullsized":"2024-09-12T01:08:03.598342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:14.342220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":323,"num_write":87,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479794+0000","last_change":"2024-09-12T00:56:52.995841+0000","last_active":"2024-09-12T01:08:57.479794+0000","last_peered":"2024-09-12T01:08:57.479794+0000","last_clean":"2024-09-12T01:08:57.479794+0000","last_became_active":"2024-09-12T00:56:52.995495+0000","last_became_peered":"2024-09-12T00:56:52.995495+0000","last_unstale":"2024-09-12T01:08:57.479794+0000","last_undegraded":"2024-09-12T01:08:57.479794+0000","last_fullsized":"2024-09-12T01:08:57.479794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:07.859390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:22.465900+0000","last_change":"2024-09-12T00:46:19.280925+0000","last_active":"2024-09-12T01:07:22.465900+0000","last_peered":"2024-09-12T01:07:22.465900+0000","last_clean":"2024-09-12T01:07:22.465900+0000","last_became_active":"2024-09-12T00:46:19.280653+0000","last_became_peered":"2024-09-12T00:46:19.280653+0000","last_unstale":"2024-09-12T01:07:22.465900+0000","last_undegraded":"2024-09-12T01:07:22.465900+0000","last_fullsized":"2024-09-12T01:07:22.465900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:20.246986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10256,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"261'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396139+0000","last_change":"2024-09-12T00:46:16.270257+0000","last_active":"2024-09-12T01:07:18.396139+0000","last_peered":"2024-09-12T01:07:18.396139+0000","last_clean":"2024-09-12T01:07:18.396139+0000","last_became_active":"2024-09-12T00:46:16.270004+0000","last_became_peered":"2024-09-12T00:46:16.270004+0000","last_unstale":"2024-09-12T01:07:18.396139+0000","last_undegraded":"2024-09-12T01:07:18.396139+0000","last_fullsized":"2024-09-12T01:07:18.396139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:08.342727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'15","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.597733+0000","last_change":"2024-09-12T00:44:37.820954+0000","last_active":"2024-09-12T01:07:58.597733+0000","last_peered":"2024-09-12T01:07:58.597733+0000","last_clean":"2024-09-12T01:07:58.597733+0000","last_became_active":"2024-09-12T00:44:37.820639+0000","last_became_peered":"2024-09-12T00:44:37.820639+0000","last_unstale":"2024-09-12T01:07:58.597733+0000","last_undegraded":"2024-09-12T01:07:58.597733+0000","last_fullsized":"2024-09-12T01:07:58.597733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:51.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391071+0000","last_change":"2024-09-12T00:56:52.991542+0000","last_active":"2024-09-12T01:08:57.391071+0000","last_peered":"2024-09-12T01:08:57.391071+0000","last_clean":"2024-09-12T01:08:57.391071+0000","last_became_active":"2024-09-12T00:56:52.991261+0000","last_became_peered":"2024-09-12T00:56:52.991261+0000","last_unstale":"2024-09-12T01:08:57.391071+0000","last_undegraded":"2024-09-12T01:08:57.391071+0000","last_fullsized":"2024-09-12T01:08:57.391071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:08.574079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"264'1","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:22.465859+0000","last_change":"2024-09-12T00:46:19.282895+0000","last_active":"2024-09-12T01:07:22.465859+0000","last_peered":"2024-09-12T01:07:22.465859+0000","last_clean":"2024-09-12T01:07:22.465859+0000","last_became_active":"2024-09-12T00:46:19.281676+0000","last_became_peered":"2024-09-12T00:46:19.281676+0000","last_unstale":"2024-09-12T01:07:22.465859+0000","last_undegraded":"2024-09-12T01:07:22.465859+0000","last_fullsized":"2024-09-12T01:07:22.465859+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.550417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465156+0000","last_change":"2024-09-12T00:46:16.276429+0000","last_active":"2024-09-12T01:07:17.465156+0000","last_peered":"2024-09-12T01:07:17.465156+0000","last_clean":"2024-09-12T01:07:17.465156+0000","last_became_active":"2024-09-12T00:46:16.276180+0000","last_became_peered":"2024-09-12T00:46:16.276180+0000","last_unstale":"2024-09-12T01:07:17.465156+0000","last_undegraded":"2024-09-12T01:07:17.465156+0000","last_fullsized":"2024-09-12T01:07:17.465156+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:48.188004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382200+0000","last_change":"2024-09-12T00:44:37.820502+0000","last_active":"2024-09-12T01:07:58.382200+0000","last_peered":"2024-09-12T01:07:58.382200+0000","last_clean":"2024-09-12T01:07:58.382200+0000","last_became_active":"2024-09-12T00:44:37.820217+0000","last_became_peered":"2024-09-12T00:44:37.820217+0000","last_unstale":"2024-09-12T01:07:58.382200+0000","last_undegraded":"2024-09-12T01:07:58.382200+0000","last_fullsized":"2024-09-12T01:07:58.382200+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.838632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":127,"num_write":61,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.517081+0000","last_change":"2024-09-12T00:56:52.989385+0000","last_active":"2024-09-12T01:08:32.517081+0000","last_peered":"2024-09-12T01:08:32.517081+0000","last_clean":"2024-09-12T01:08:32.517081+0000","last_became_active":"2024-09-12T00:56:52.988302+0000","last_became_peered":"2024-09-12T00:56:52.988302+0000","last_unstale":"2024-09-12T01:08:32.517081+0000","last_undegraded":"2024-09-12T01:08:32.517081+0000","last_fullsized":"2024-09-12T01:08:32.517081+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:40.813037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'7","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.377182+0000","last_change":"2024-09-12T00:46:19.285378+0000","last_active":"2024-09-12T01:07:23.377182+0000","last_peered":"2024-09-12T01:07:23.377182+0000","last_clean":"2024-09-12T01:07:23.377182+0000","last_became_active":"2024-09-12T00:46:19.280889+0000","last_became_peered":"2024-09-12T00:46:19.280889+0000","last_unstale":"2024-09-12T01:07:23.377182+0000","last_undegraded":"2024-09-12T01:07:23.377182+0000","last_fullsized":"2024-09-12T01:07:23.377182+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:56.282208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7182,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396190+0000","last_change":"2024-09-12T00:46:16.263413+0000","last_active":"2024-09-12T01:07:18.396190+0000","last_peered":"2024-09-12T01:07:18.396190+0000","last_clean":"2024-09-12T01:07:18.396190+0000","last_became_active":"2024-09-12T00:46:16.263065+0000","last_became_peered":"2024-09-12T00:46:16.263065+0000","last_unstale":"2024-09-12T01:07:18.396190+0000","last_undegraded":"2024-09-12T01:07:18.396190+0000","last_fullsized":"2024-09-12T01:07:18.396190+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:23.322080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.491664+0000","last_change":"2024-09-12T00:44:37.814881+0000","last_active":"2024-09-12T01:08:01.491664+0000","last_peered":"2024-09-12T01:08:01.491664+0000","last_clean":"2024-09-12T01:08:01.491664+0000","last_became_active":"2024-09-12T00:44:37.814584+0000","last_became_peered":"2024-09-12T00:44:37.814584+0000","last_unstale":"2024-09-12T01:08:01.491664+0000","last_undegraded":"2024-09-12T01:08:01.491664+0000","last_fullsized":"2024-09-12T01:08:01.491664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:18.206072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391027+0000","last_change":"2024-09-12T00:56:52.991853+0000","last_active":"2024-09-12T01:08:57.391027+0000","last_peered":"2024-09-12T01:08:57.391027+0000","last_clean":"2024-09-12T01:08:57.391027+0000","last_became_active":"2024-09-12T00:56:52.990830+0000","last_became_peered":"2024-09-12T00:56:52.990830+0000","last_unstale":"2024-09-12T01:08:57.391027+0000","last_undegraded":"2024-09-12T01:08:57.391027+0000","last_fullsized":"2024-09-12T01:08:57.391027+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:49.621390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'10","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.611466+0000","last_change":"2024-09-12T00:46:19.285059+0000","last_active":"2024-09-12T01:09:38.611466+0000","last_peered":"2024-09-12T01:09:38.611466+0000","last_clean":"2024-09-12T01:09:38.611466+0000","last_became_active":"2024-09-12T00:46:19.284748+0000","last_became_peered":"2024-09-12T00:46:19.284748+0000","last_unstale":"2024-09-12T01:09:38.611466+0000","last_undegraded":"2024-09-12T01:09:38.611466+0000","last_fullsized":"2024-09-12T01:09:38.611466+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:39.933756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8194,"num_write":15,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"261'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396223+0000","last_change":"2024-09-12T00:46:16.274496+0000","last_active":"2024-09-12T01:07:18.396223+0000","last_peered":"2024-09-12T01:07:18.396223+0000","last_clean":"2024-09-12T01:07:18.396223+0000","last_became_active":"2024-09-12T00:46:16.274209+0000","last_became_peered":"2024-09-12T00:46:16.274209+0000","last_unstale":"2024-09-12T01:07:18.396223+0000","last_undegraded":"2024-09-12T01:07:18.396223+0000","last_fullsized":"2024-09-12T01:07:18.396223+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:33.536444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":10,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382153+0000","last_change":"2024-09-12T00:44:37.819591+0000","last_active":"2024-09-12T01:07:58.382153+0000","last_peered":"2024-09-12T01:07:58.382153+0000","last_clean":"2024-09-12T01:07:58.382153+0000","last_became_active":"2024-09-12T00:44:37.819298+0000","last_became_peered":"2024-09-12T00:44:37.819298+0000","last_unstale":"2024-09-12T01:07:58.382153+0000","last_undegraded":"2024-09-12T01:07:58.382153+0000","last_fullsized":"2024-09-12T01:07:58.382153+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:00.112592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.469348+0000","last_change":"2024-09-12T00:56:52.996314+0000","last_active":"2024-09-12T01:07:47.469348+0000","last_peered":"2024-09-12T01:07:47.469348+0000","last_clean":"2024-09-12T01:07:47.469348+0000","last_became_active":"2024-09-12T00:56:52.996048+0000","last_became_peered":"2024-09-12T00:56:52.996048+0000","last_unstale":"2024-09-12T01:07:47.469348+0000","last_undegraded":"2024-09-12T01:07:47.469348+0000","last_fullsized":"2024-09-12T01:07:47.469348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.954796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.408810+0000","last_change":"2024-09-12T00:46:19.286025+0000","last_active":"2024-09-12T01:11:08.408810+0000","last_peered":"2024-09-12T01:11:08.408810+0000","last_clean":"2024-09-12T01:11:08.408810+0000","last_became_active":"2024-09-12T00:46:19.285304+0000","last_became_peered":"2024-09-12T00:46:19.285304+0000","last_unstale":"2024-09-12T01:11:08.408810+0000","last_undegraded":"2024-09-12T01:11:08.408810+0000","last_fullsized":"2024-09-12T01:11:08.408810+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:59.248323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2428,"num_write":3,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.497525+0000","last_change":"2024-09-12T00:46:16.272142+0000","last_active":"2024-09-12T01:08:46.497525+0000","last_peered":"2024-09-12T01:08:46.497525+0000","last_clean":"2024-09-12T01:08:46.497525+0000","last_became_active":"2024-09-12T00:46:16.271839+0000","last_became_peered":"2024-09-12T00:46:16.271839+0000","last_unstale":"2024-09-12T01:08:46.497525+0000","last_undegraded":"2024-09-12T01:08:46.497525+0000","last_fullsized":"2024-09-12T01:08:46.497525+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:04.288299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"264'41","reported_seq":151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.650570+0000","last_change":"2024-09-12T00:44:37.822164+0000","last_active":"2024-09-12T01:08:56.650570+0000","last_peered":"2024-09-12T01:08:56.650570+0000","last_clean":"2024-09-12T01:08:56.650570+0000","last_became_active":"2024-09-12T00:44:37.821837+0000","last_became_peered":"2024-09-12T00:44:37.821837+0000","last_unstale":"2024-09-12T01:08:56.650570+0000","last_undegraded":"2024-09-12T01:08:56.650570+0000","last_fullsized":"2024-09-12T01:08:56.650570+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:59.825047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":140,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403198+0000","last_change":"2024-09-12T00:56:52.996477+0000","last_active":"2024-09-12T01:08:08.403198+0000","last_peered":"2024-09-12T01:08:08.403198+0000","last_clean":"2024-09-12T01:08:08.403198+0000","last_became_active":"2024-09-12T00:56:52.996287+0000","last_became_peered":"2024-09-12T00:56:52.996287+0000","last_unstale":"2024-09-12T01:08:08.403198+0000","last_undegraded":"2024-09-12T01:08:08.403198+0000","last_fullsized":"2024-09-12T01:08:08.403198+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:34.040673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389308+0000","last_change":"2024-09-12T00:46:19.284780+0000","last_active":"2024-09-12T01:08:53.389308+0000","last_peered":"2024-09-12T01:08:53.389308+0000","last_clean":"2024-09-12T01:08:53.389308+0000","last_became_active":"2024-09-12T00:46:19.284490+0000","last_became_peered":"2024-09-12T00:46:19.284490+0000","last_unstale":"2024-09-12T01:08:53.389308+0000","last_undegraded":"2024-09-12T01:08:53.389308+0000","last_fullsized":"2024-09-12T01:08:53.389308+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.303903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"264'9","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389475+0000","last_change":"2024-09-12T00:46:16.275634+0000","last_active":"2024-09-12T01:08:47.389475+0000","last_peered":"2024-09-12T01:08:47.389475+0000","last_clean":"2024-09-12T01:08:47.389475+0000","last_became_active":"2024-09-12T00:46:16.275312+0000","last_became_peered":"2024-09-12T00:46:16.275312+0000","last_unstale":"2024-09-12T01:08:47.389475+0000","last_undegraded":"2024-09-12T01:08:47.389475+0000","last_fullsized":"2024-09-12T01:08:47.389475+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.528193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":20478,"num_write":19,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'42","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590315+0000","last_change":"2024-09-12T00:44:37.819546+0000","last_active":"2024-09-12T01:07:08.590315+0000","last_peered":"2024-09-12T01:07:08.590315+0000","last_clean":"2024-09-12T01:07:08.590315+0000","last_became_active":"2024-09-12T00:44:37.819289+0000","last_became_peered":"2024-09-12T00:44:37.819289+0000","last_unstale":"2024-09-12T01:07:08.590315+0000","last_undegraded":"2024-09-12T01:07:08.590315+0000","last_fullsized":"2024-09-12T01:07:08.590315+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:38.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":167,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.595680+0000","last_change":"2024-09-12T00:56:52.987494+0000","last_active":"2024-09-12T01:07:43.595680+0000","last_peered":"2024-09-12T01:07:43.595680+0000","last_clean":"2024-09-12T01:07:43.595680+0000","last_became_active":"2024-09-12T00:56:52.987226+0000","last_became_peered":"2024-09-12T00:56:52.987226+0000","last_unstale":"2024-09-12T01:07:43.595680+0000","last_undegraded":"2024-09-12T01:07:43.595680+0000","last_fullsized":"2024-09-12T01:07:43.595680+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:25.549274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389413+0000","last_change":"2024-09-12T00:46:19.287340+0000","last_active":"2024-09-12T01:08:53.389413+0000","last_peered":"2024-09-12T01:08:53.389413+0000","last_clean":"2024-09-12T01:08:53.389413+0000","last_became_active":"2024-09-12T00:46:19.287067+0000","last_became_peered":"2024-09-12T00:46:19.287067+0000","last_unstale":"2024-09-12T01:08:53.389413+0000","last_undegraded":"2024-09-12T01:08:53.389413+0000","last_fullsized":"2024-09-12T01:08:53.389413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.086451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641131,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2174,"num_write":2,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:03.408116+0000","last_change":"2024-09-12T00:46:16.278474+0000","last_active":"2024-09-12T01:11:03.408116+0000","last_peered":"2024-09-12T01:11:03.408116+0000","last_clean":"2024-09-12T01:11:03.408116+0000","last_became_active":"2024-09-12T00:46:16.278205+0000","last_became_peered":"2024-09-12T00:46:16.278205+0000","last_unstale":"2024-09-12T01:11:03.408116+0000","last_undegraded":"2024-09-12T01:11:03.408116+0000","last_fullsized":"2024-09-12T01:11:03.408116+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:45.398336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'62","reported_seq":211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.997717+0000","last_change":"2024-09-12T00:44:37.811854+0000","last_active":"2024-09-12T01:08:52.997717+0000","last_peered":"2024-09-12T01:08:52.997717+0000","last_clean":"2024-09-12T01:08:52.997717+0000","last_became_active":"2024-09-12T00:44:37.811544+0000","last_became_peered":"2024-09-12T00:44:37.811544+0000","last_unstale":"2024-09-12T01:08:52.997717+0000","last_undegraded":"2024-09-12T01:08:52.997717+0000","last_fullsized":"2024-09-12T01:08:52.997717+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:05.666736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":232,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.399787+0000","last_change":"2024-09-12T00:56:52.989633+0000","last_active":"2024-09-12T01:07:43.399787+0000","last_peered":"2024-09-12T01:07:43.399787+0000","last_clean":"2024-09-12T01:07:43.399787+0000","last_became_active":"2024-09-12T00:56:52.988985+0000","last_became_peered":"2024-09-12T00:56:52.988985+0000","last_unstale":"2024-09-12T01:07:43.399787+0000","last_undegraded":"2024-09-12T01:07:43.399787+0000","last_fullsized":"2024-09-12T01:07:43.399787+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:47.578076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'10","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479160+0000","last_change":"2024-09-12T00:46:19.279808+0000","last_active":"2024-09-12T01:08:52.479160+0000","last_peered":"2024-09-12T01:08:52.479160+0000","last_clean":"2024-09-12T01:08:52.479160+0000","last_became_active":"2024-09-12T00:46:19.279527+0000","last_became_peered":"2024-09-12T00:46:19.279527+0000","last_unstale":"2024-09-12T01:08:52.479160+0000","last_undegraded":"2024-09-12T01:08:52.479160+0000","last_fullsized":"2024-09-12T01:08:52.479160+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:07.362005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8190,"num_write":20,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388598+0000","last_change":"2024-09-12T00:46:16.273882+0000","last_active":"2024-09-12T01:08:48.388598+0000","last_peered":"2024-09-12T01:08:48.388598+0000","last_clean":"2024-09-12T01:08:48.388598+0000","last_became_active":"2024-09-12T00:46:16.273598+0000","last_became_peered":"2024-09-12T00:46:16.273598+0000","last_unstale":"2024-09-12T01:08:48.388598+0000","last_undegraded":"2024-09-12T01:08:48.388598+0000","last_fullsized":"2024-09-12T01:08:48.388598+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:16.097567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'41","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.165530+0000","last_change":"2024-09-12T00:44:37.813325+0000","last_active":"2024-09-12T01:08:57.165530+0000","last_peered":"2024-09-12T01:08:57.165530+0000","last_clean":"2024-09-12T01:08:57.165530+0000","last_became_active":"2024-09-12T00:44:37.813081+0000","last_became_peered":"2024-09-12T00:44:37.813081+0000","last_unstale":"2024-09-12T01:08:57.165530+0000","last_undegraded":"2024-09-12T01:08:57.165530+0000","last_fullsized":"2024-09-12T01:08:57.165530+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:39.795060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":146,"num_write":78,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.472330+0000","last_change":"2024-09-12T00:56:52.995736+0000","last_active":"2024-09-12T01:08:07.472330+0000","last_peered":"2024-09-12T01:08:07.472330+0000","last_clean":"2024-09-12T01:08:07.472330+0000","last_became_active":"2024-09-12T00:56:52.995412+0000","last_became_peered":"2024-09-12T00:56:52.995412+0000","last_unstale":"2024-09-12T01:08:07.472330+0000","last_undegraded":"2024-09-12T01:08:07.472330+0000","last_fullsized":"2024-09-12T01:08:07.472330+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:15.173930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.597690+0000","last_change":"2024-09-12T00:46:19.283005+0000","last_active":"2024-09-12T01:07:58.597690+0000","last_peered":"2024-09-12T01:07:58.597690+0000","last_clean":"2024-09-12T01:07:58.597690+0000","last_became_active":"2024-09-12T00:46:19.282672+0000","last_became_peered":"2024-09-12T00:46:19.282672+0000","last_unstale":"2024-09-12T01:07:58.597690+0000","last_undegraded":"2024-09-12T01:07:58.597690+0000","last_fullsized":"2024-09-12T01:07:58.597690+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:25.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'8","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.400080+0000","last_change":"2024-09-12T00:46:16.266194+0000","last_active":"2024-09-12T01:10:08.400080+0000","last_peered":"2024-09-12T01:10:08.400080+0000","last_clean":"2024-09-12T01:10:08.400080+0000","last_became_active":"2024-09-12T00:46:16.265927+0000","last_became_peered":"2024-09-12T00:46:16.265927+0000","last_unstale":"2024-09-12T01:10:08.400080+0000","last_undegraded":"2024-09-12T01:10:08.400080+0000","last_fullsized":"2024-09-12T01:10:08.400080+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:30.967366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11266,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'26","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375318+0000","last_change":"2024-09-12T00:44:37.820836+0000","last_active":"2024-09-12T01:07:07.375318+0000","last_peered":"2024-09-12T01:07:07.375318+0000","last_clean":"2024-09-12T01:07:07.375318+0000","last_became_active":"2024-09-12T00:44:37.820584+0000","last_became_peered":"2024-09-12T00:44:37.820584+0000","last_unstale":"2024-09-12T01:07:07.375318+0000","last_undegraded":"2024-09-12T01:07:07.375318+0000","last_fullsized":"2024-09-12T01:07:07.375318+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:59.394929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.493580+0000","last_change":"2024-09-12T00:56:52.994371+0000","last_active":"2024-09-12T01:08:16.493580+0000","last_peered":"2024-09-12T01:08:16.493580+0000","last_clean":"2024-09-12T01:08:16.493580+0000","last_became_active":"2024-09-12T00:56:52.994132+0000","last_became_peered":"2024-09-12T00:56:52.994132+0000","last_unstale":"2024-09-12T01:08:16.493580+0000","last_undegraded":"2024-09-12T01:08:16.493580+0000","last_fullsized":"2024-09-12T01:08:16.493580+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:57.349446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.491642+0000","last_change":"2024-09-12T00:46:19.281067+0000","last_active":"2024-09-12T01:08:01.491642+0000","last_peered":"2024-09-12T01:08:01.491642+0000","last_clean":"2024-09-12T01:08:01.491642+0000","last_became_active":"2024-09-12T00:46:19.280726+0000","last_became_peered":"2024-09-12T00:46:19.280726+0000","last_unstale":"2024-09-12T01:08:01.491642+0000","last_undegraded":"2024-09-12T01:08:01.491642+0000","last_fullsized":"2024-09-12T01:08:01.491642+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:00.902460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202496,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5128,"num_write":8,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:57.470726+0000","last_change":"2024-09-12T00:46:16.276183+0000","last_active":"2024-09-12T01:07:57.470726+0000","last_peered":"2024-09-12T01:07:57.470726+0000","last_clean":"2024-09-12T01:07:57.470726+0000","last_became_active":"2024-09-12T00:46:16.275908+0000","last_became_peered":"2024-09-12T00:46:16.275908+0000","last_unstale":"2024-09-12T01:07:57.470726+0000","last_undegraded":"2024-09-12T01:07:57.470726+0000","last_fullsized":"2024-09-12T01:07:57.470726+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:52.232454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496227+0000","last_change":"2024-09-12T00:44:37.812084+0000","last_active":"2024-09-12T01:08:36.496227+0000","last_peered":"2024-09-12T01:08:36.496227+0000","last_clean":"2024-09-12T01:08:36.496227+0000","last_became_active":"2024-09-12T00:44:37.811613+0000","last_became_peered":"2024-09-12T00:44:37.811613+0000","last_unstale":"2024-09-12T01:08:36.496227+0000","last_undegraded":"2024-09-12T01:08:36.496227+0000","last_fullsized":"2024-09-12T01:08:36.496227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:51.317906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520108+0000","last_change":"2024-09-12T00:56:52.989823+0000","last_active":"2024-09-12T01:08:08.520108+0000","last_peered":"2024-09-12T01:08:08.520108+0000","last_clean":"2024-09-12T01:08:08.520108+0000","last_became_active":"2024-09-12T00:56:52.989552+0000","last_became_peered":"2024-09-12T00:56:52.989552+0000","last_unstale":"2024-09-12T01:08:08.520108+0000","last_undegraded":"2024-09-12T01:08:08.520108+0000","last_fullsized":"2024-09-12T01:08:08.520108+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:32.733496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390164+0000","last_change":"2024-09-12T00:46:19.282416+0000","last_active":"2024-09-12T01:08:52.390164+0000","last_peered":"2024-09-12T01:08:52.390164+0000","last_clean":"2024-09-12T01:08:52.390164+0000","last_became_active":"2024-09-12T00:46:19.282137+0000","last_became_peered":"2024-09-12T00:46:19.282137+0000","last_unstale":"2024-09-12T01:08:52.390164+0000","last_undegraded":"2024-09-12T01:08:52.390164+0000","last_fullsized":"2024-09-12T01:08:52.390164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:16.519283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557118+0000","last_change":"2024-09-12T00:46:16.274482+0000","last_active":"2024-09-12T01:11:22.557118+0000","last_peered":"2024-09-12T01:11:22.557118+0000","last_clean":"2024-09-12T01:11:22.557118+0000","last_became_active":"2024-09-12T00:46:16.274198+0000","last_became_peered":"2024-09-12T00:46:16.274198+0000","last_unstale":"2024-09-12T01:11:22.557118+0000","last_undegraded":"2024-09-12T01:11:22.557118+0000","last_fullsized":"2024-09-12T01:11:22.557118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:47.458869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2619,"num_write":4,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475262+0000","last_change":"2024-09-12T00:44:37.814764+0000","last_active":"2024-09-12T01:08:27.475262+0000","last_peered":"2024-09-12T01:08:27.475262+0000","last_clean":"2024-09-12T01:08:27.475262+0000","last_became_active":"2024-09-12T00:44:37.814480+0000","last_became_peered":"2024-09-12T00:44:37.814480+0000","last_unstale":"2024-09-12T01:08:27.475262+0000","last_undegraded":"2024-09-12T01:08:27.475262+0000","last_fullsized":"2024-09-12T01:08:27.475262+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:18.473305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383351+0000","last_change":"2024-09-12T00:56:52.997107+0000","last_active":"2024-09-12T01:08:08.383351+0000","last_peered":"2024-09-12T01:08:08.383351+0000","last_clean":"2024-09-12T01:08:08.383351+0000","last_became_active":"2024-09-12T00:56:52.996816+0000","last_became_peered":"2024-09-12T00:56:52.996816+0000","last_unstale":"2024-09-12T01:08:08.383351+0000","last_undegraded":"2024-09-12T01:08:08.383351+0000","last_fullsized":"2024-09-12T01:08:08.383351+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:21.071571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519342+0000","last_change":"2024-09-12T00:46:19.276670+0000","last_active":"2024-09-12T01:08:03.519342+0000","last_peered":"2024-09-12T01:08:03.519342+0000","last_clean":"2024-09-12T01:08:03.519342+0000","last_became_active":"2024-09-12T00:46:19.276366+0000","last_became_peered":"2024-09-12T00:46:19.276366+0000","last_unstale":"2024-09-12T01:08:03.519342+0000","last_undegraded":"2024-09-12T01:08:03.519342+0000","last_fullsized":"2024-09-12T01:08:03.519342+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:52.413983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.604649+0000","last_change":"2024-09-12T00:46:16.274311+0000","last_active":"2024-09-12T01:08:48.604649+0000","last_peered":"2024-09-12T01:08:48.604649+0000","last_clean":"2024-09-12T01:08:48.604649+0000","last_became_active":"2024-09-12T00:46:16.273821+0000","last_became_peered":"2024-09-12T00:46:16.273821+0000","last_unstale":"2024-09-12T01:08:48.604649+0000","last_undegraded":"2024-09-12T01:08:48.604649+0000","last_fullsized":"2024-09-12T01:08:48.604649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:14.476953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.522282+0000","last_change":"2024-09-12T00:44:37.817651+0000","last_active":"2024-09-12T01:08:28.522282+0000","last_peered":"2024-09-12T01:08:28.522282+0000","last_clean":"2024-09-12T01:08:28.522282+0000","last_became_active":"2024-09-12T00:44:37.817357+0000","last_became_peered":"2024-09-12T00:44:37.817357+0000","last_unstale":"2024-09-12T01:08:28.522282+0000","last_undegraded":"2024-09-12T01:08:28.522282+0000","last_fullsized":"2024-09-12T01:08:28.522282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:32.676919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.513328+0000","last_change":"2024-09-12T00:56:52.991150+0000","last_active":"2024-09-12T01:07:18.513328+0000","last_peered":"2024-09-12T01:07:18.513328+0000","last_clean":"2024-09-12T01:07:18.513328+0000","last_became_active":"2024-09-12T00:56:52.990450+0000","last_became_peered":"2024-09-12T00:56:52.990450+0000","last_unstale":"2024-09-12T01:07:18.513328+0000","last_undegraded":"2024-09-12T01:07:18.513328+0000","last_fullsized":"2024-09-12T01:07:18.513328+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:08.753872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"264'7","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465243+0000","last_change":"2024-09-12T00:46:19.281700+0000","last_active":"2024-09-12T01:07:17.465243+0000","last_peered":"2024-09-12T01:07:17.465243+0000","last_clean":"2024-09-12T01:07:17.465243+0000","last_became_active":"2024-09-12T00:46:19.281413+0000","last_became_peered":"2024-09-12T00:46:19.281413+0000","last_unstale":"2024-09-12T01:07:17.465243+0000","last_undegraded":"2024-09-12T01:07:17.465243+0000","last_fullsized":"2024-09-12T01:07:17.465243+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:32.000629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":16941,"num_write":7,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"264'8","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.055888+0000","last_change":"2024-09-12T00:46:16.272138+0000","last_active":"2024-09-12T01:11:23.055888+0000","last_peered":"2024-09-12T01:11:23.055888+0000","last_clean":"2024-09-12T01:11:23.055888+0000","last_became_active":"2024-09-12T00:46:16.271730+0000","last_became_peered":"2024-09-12T00:46:16.271730+0000","last_unstale":"2024-09-12T01:11:23.055888+0000","last_undegraded":"2024-09-12T01:11:23.055888+0000","last_fullsized":"2024-09-12T01:11:23.055888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:24.991885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11841,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516358+0000","last_change":"2024-09-12T00:44:37.815831+0000","last_active":"2024-09-12T01:08:27.516358+0000","last_peered":"2024-09-12T01:08:27.516358+0000","last_clean":"2024-09-12T01:08:27.516358+0000","last_became_active":"2024-09-12T00:44:37.815542+0000","last_became_peered":"2024-09-12T00:44:37.815542+0000","last_unstale":"2024-09-12T01:08:27.516358+0000","last_undegraded":"2024-09-12T01:08:27.516358+0000","last_fullsized":"2024-09-12T01:08:27.516358+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.238225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":55,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.513375+0000","last_change":"2024-09-12T00:56:52.988965+0000","last_active":"2024-09-12T01:07:18.513375+0000","last_peered":"2024-09-12T01:07:18.513375+0000","last_clean":"2024-09-12T01:07:18.513375+0000","last_became_active":"2024-09-12T00:56:52.988702+0000","last_became_peered":"2024-09-12T00:56:52.988702+0000","last_unstale":"2024-09-12T01:07:18.513375+0000","last_undegraded":"2024-09-12T01:07:18.513375+0000","last_fullsized":"2024-09-12T01:07:18.513375+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:28.810429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.483052+0000","last_change":"2024-09-12T00:46:19.277090+0000","last_active":"2024-09-12T01:09:17.483052+0000","last_peered":"2024-09-12T01:09:17.483052+0000","last_clean":"2024-09-12T01:09:17.483052+0000","last_became_active":"2024-09-12T00:46:19.276538+0000","last_became_peered":"2024-09-12T00:46:19.276538+0000","last_unstale":"2024-09-12T01:09:17.483052+0000","last_undegraded":"2024-09-12T01:09:17.483052+0000","last_fullsized":"2024-09-12T01:09:17.483052+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.608027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.523552+0000","last_change":"2024-09-12T00:46:16.273158+0000","last_active":"2024-09-12T01:09:17.523552+0000","last_peered":"2024-09-12T01:09:17.523552+0000","last_clean":"2024-09-12T01:09:17.523552+0000","last_became_active":"2024-09-12T00:46:16.272892+0000","last_became_peered":"2024-09-12T00:46:16.272892+0000","last_unstale":"2024-09-12T01:09:17.523552+0000","last_undegraded":"2024-09-12T01:09:17.523552+0000","last_fullsized":"2024-09-12T01:09:17.523552+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.867186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"264'6","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.601661+0000","last_change":"2024-09-12T00:44:37.820513+0000","last_active":"2024-09-12T01:08:28.601661+0000","last_peered":"2024-09-12T01:08:28.601661+0000","last_clean":"2024-09-12T01:08:28.601661+0000","last_became_active":"2024-09-12T00:44:37.819232+0000","last_became_peered":"2024-09-12T00:44:37.819232+0000","last_unstale":"2024-09-12T01:08:28.601661+0000","last_undegraded":"2024-09-12T01:08:28.601661+0000","last_fullsized":"2024-09-12T01:08:28.601661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:53.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479701+0000","last_change":"2024-09-12T00:56:52.994822+0000","last_active":"2024-09-12T01:08:57.479701+0000","last_peered":"2024-09-12T01:08:57.479701+0000","last_clean":"2024-09-12T01:08:57.479701+0000","last_became_active":"2024-09-12T00:56:52.994128+0000","last_became_peered":"2024-09-12T00:56:52.994128+0000","last_unstale":"2024-09-12T01:08:57.479701+0000","last_undegraded":"2024-09-12T01:08:57.479701+0000","last_fullsized":"2024-09-12T01:08:57.479701+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:23.628943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.518602+0000","last_change":"2024-09-12T00:46:19.282799+0000","last_active":"2024-09-12T01:07:58.518602+0000","last_peered":"2024-09-12T01:07:58.518602+0000","last_clean":"2024-09-12T01:07:58.518602+0000","last_became_active":"2024-09-12T00:46:19.281782+0000","last_became_peered":"2024-09-12T00:46:19.281782+0000","last_unstale":"2024-09-12T01:07:58.518602+0000","last_undegraded":"2024-09-12T01:07:58.518602+0000","last_fullsized":"2024-09-12T01:07:58.518602+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:46.964297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.490914+0000","last_change":"2024-09-12T00:46:16.274107+0000","last_active":"2024-09-12T01:07:56.490914+0000","last_peered":"2024-09-12T01:07:56.490914+0000","last_clean":"2024-09-12T01:07:56.490914+0000","last_became_active":"2024-09-12T00:46:16.273356+0000","last_became_peered":"2024-09-12T00:46:16.273356+0000","last_unstale":"2024-09-12T01:07:56.490914+0000","last_undegraded":"2024-09-12T01:07:56.490914+0000","last_fullsized":"2024-09-12T01:07:56.490914+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:14.769067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'16","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.488931+0000","last_change":"2024-09-12T00:44:37.818413+0000","last_active":"2024-09-12T01:07:41.488931+0000","last_peered":"2024-09-12T01:07:41.488931+0000","last_clean":"2024-09-12T01:07:41.488931+0000","last_became_active":"2024-09-12T00:44:37.818054+0000","last_became_peered":"2024-09-12T00:44:37.818054+0000","last_unstale":"2024-09-12T01:07:41.488931+0000","last_undegraded":"2024-09-12T01:07:41.488931+0000","last_fullsized":"2024-09-12T01:07:41.488931+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:10.843685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.591776+0000","last_change":"2024-09-12T00:56:52.991268+0000","last_active":"2024-09-12T01:07:18.591776+0000","last_peered":"2024-09-12T01:07:18.591776+0000","last_clean":"2024-09-12T01:07:18.591776+0000","last_became_active":"2024-09-12T00:56:52.990601+0000","last_became_peered":"2024-09-12T00:56:52.990601+0000","last_unstale":"2024-09-12T01:07:18.591776+0000","last_undegraded":"2024-09-12T01:07:18.591776+0000","last_fullsized":"2024-09-12T01:07:18.591776+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:14.400256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615507+0000","last_change":"2024-09-12T00:46:19.282146+0000","last_active":"2024-09-12T01:10:08.615507+0000","last_peered":"2024-09-12T01:10:08.615507+0000","last_clean":"2024-09-12T01:10:08.615507+0000","last_became_active":"2024-09-12T00:46:19.281732+0000","last_became_peered":"2024-09-12T00:46:19.281732+0000","last_unstale":"2024-09-12T01:10:08.615507+0000","last_undegraded":"2024-09-12T01:10:08.615507+0000","last_fullsized":"2024-09-12T01:10:08.615507+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:55.852331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615530+0000","last_change":"2024-09-12T00:46:16.277570+0000","last_active":"2024-09-12T01:10:08.615530+0000","last_peered":"2024-09-12T01:10:08.615530+0000","last_clean":"2024-09-12T01:10:08.615530+0000","last_became_active":"2024-09-12T00:46:16.277261+0000","last_became_peered":"2024-09-12T00:46:16.277261+0000","last_unstale":"2024-09-12T01:10:08.615530+0000","last_undegraded":"2024-09-12T01:10:08.615530+0000","last_fullsized":"2024-09-12T01:10:08.615530+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:00.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12284,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'33","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.645110+0000","last_change":"2024-09-12T00:44:37.818362+0000","last_active":"2024-09-12T01:08:56.645110+0000","last_peered":"2024-09-12T01:08:56.645110+0000","last_clean":"2024-09-12T01:08:56.645110+0000","last_became_active":"2024-09-12T00:44:37.818055+0000","last_became_peered":"2024-09-12T00:44:37.818055+0000","last_unstale":"2024-09-12T01:08:56.645110+0000","last_undegraded":"2024-09-12T01:08:56.645110+0000","last_fullsized":"2024-09-12T01:08:56.645110+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.754260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":106,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380147+0000","last_change":"2024-09-12T00:56:52.989699+0000","last_active":"2024-09-12T01:07:43.380147+0000","last_peered":"2024-09-12T01:07:43.380147+0000","last_clean":"2024-09-12T01:07:43.380147+0000","last_became_active":"2024-09-12T00:56:52.989396+0000","last_became_peered":"2024-09-12T00:56:52.989396+0000","last_unstale":"2024-09-12T01:07:43.380147+0000","last_undegraded":"2024-09-12T01:07:43.380147+0000","last_fullsized":"2024-09-12T01:07:43.380147+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.478574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.523445+0000","last_change":"2024-09-12T00:46:19.281553+0000","last_active":"2024-09-12T01:09:17.523445+0000","last_peered":"2024-09-12T01:09:17.523445+0000","last_clean":"2024-09-12T01:09:17.523445+0000","last_became_active":"2024-09-12T00:46:19.281231+0000","last_became_peered":"2024-09-12T00:46:19.281231+0000","last_unstale":"2024-09-12T01:09:17.523445+0000","last_undegraded":"2024-09-12T01:09:17.523445+0000","last_fullsized":"2024-09-12T01:09:17.523445+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:58.529910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.494009+0000","last_change":"2024-09-12T00:46:16.277008+0000","last_active":"2024-09-12T01:08:21.494009+0000","last_peered":"2024-09-12T01:08:21.494009+0000","last_clean":"2024-09-12T01:08:21.494009+0000","last_became_active":"2024-09-12T00:46:16.276730+0000","last_became_peered":"2024-09-12T00:46:16.276730+0000","last_unstale":"2024-09-12T01:08:21.494009+0000","last_undegraded":"2024-09-12T01:08:21.494009+0000","last_fullsized":"2024-09-12T01:08:21.494009+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:54.164828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":10,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'54","reported_seq":199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.488274+0000","last_change":"2024-09-12T00:44:37.817537+0000","last_active":"2024-09-12T01:07:36.488274+0000","last_peered":"2024-09-12T01:07:36.488274+0000","last_clean":"2024-09-12T01:07:36.488274+0000","last_became_active":"2024-09-12T00:44:37.817249+0000","last_became_peered":"2024-09-12T00:44:37.817249+0000","last_unstale":"2024-09-12T01:07:36.488274+0000","last_undegraded":"2024-09-12T01:07:36.488274+0000","last_fullsized":"2024-09-12T01:07:36.488274+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.627057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":217,"num_write":83,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510158+0000","last_change":"2024-09-12T00:56:52.993381+0000","last_active":"2024-09-12T01:07:42.510158+0000","last_peered":"2024-09-12T01:07:42.510158+0000","last_clean":"2024-09-12T01:07:42.510158+0000","last_became_active":"2024-09-12T00:56:52.992289+0000","last_became_peered":"2024-09-12T00:56:52.992289+0000","last_unstale":"2024-09-12T01:07:42.510158+0000","last_undegraded":"2024-09-12T01:07:42.510158+0000","last_fullsized":"2024-09-12T01:07:42.510158+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:39.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.600810+0000","last_change":"2024-09-12T00:46:19.281027+0000","last_active":"2024-09-12T01:08:23.600810+0000","last_peered":"2024-09-12T01:08:23.600810+0000","last_clean":"2024-09-12T01:08:23.600810+0000","last_became_active":"2024-09-12T00:46:19.280725+0000","last_became_peered":"2024-09-12T00:46:19.280725+0000","last_unstale":"2024-09-12T01:08:23.600810+0000","last_undegraded":"2024-09-12T01:08:23.600810+0000","last_fullsized":"2024-09-12T01:08:23.600810+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:05.148455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.608121+0000","last_change":"2024-09-12T00:46:16.272821+0000","last_active":"2024-09-12T01:09:13.608121+0000","last_peered":"2024-09-12T01:09:13.608121+0000","last_clean":"2024-09-12T01:09:13.608121+0000","last_became_active":"2024-09-12T00:46:16.272417+0000","last_became_peered":"2024-09-12T00:46:16.272417+0000","last_unstale":"2024-09-12T01:09:13.608121+0000","last_undegraded":"2024-09-12T01:09:13.608121+0000","last_fullsized":"2024-09-12T01:09:13.608121+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:30.234992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2052,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'44","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594575+0000","last_change":"2024-09-12T00:44:37.818360+0000","last_active":"2024-09-12T01:07:33.594575+0000","last_peered":"2024-09-12T01:07:33.594575+0000","last_clean":"2024-09-12T01:07:33.594575+0000","last_became_active":"2024-09-12T00:44:37.815722+0000","last_became_peered":"2024-09-12T00:44:37.815722+0000","last_unstale":"2024-09-12T01:07:33.594575+0000","last_undegraded":"2024-09-12T01:07:33.594575+0000","last_fullsized":"2024-09-12T01:07:33.594575+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:01.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":150,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465217+0000","last_change":"2024-09-12T00:56:52.993069+0000","last_active":"2024-09-12T01:07:17.465217+0000","last_peered":"2024-09-12T01:07:17.465217+0000","last_clean":"2024-09-12T01:07:17.465217+0000","last_became_active":"2024-09-12T00:56:52.989218+0000","last_became_peered":"2024-09-12T00:56:52.989218+0000","last_unstale":"2024-09-12T01:07:17.465217+0000","last_undegraded":"2024-09-12T01:07:17.465217+0000","last_fullsized":"2024-09-12T01:07:17.465217+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:51.764331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.501310+0000","last_change":"2024-09-12T00:46:19.282564+0000","last_active":"2024-09-12T01:09:16.501310+0000","last_peered":"2024-09-12T01:09:16.501310+0000","last_clean":"2024-09-12T01:09:16.501310+0000","last_became_active":"2024-09-12T00:46:19.282270+0000","last_became_peered":"2024-09-12T00:46:19.282270+0000","last_unstale":"2024-09-12T01:09:16.501310+0000","last_undegraded":"2024-09-12T01:09:16.501310+0000","last_fullsized":"2024-09-12T01:09:16.501310+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:43.456680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.392925+0000","last_change":"2024-09-12T00:46:16.276646+0000","last_active":"2024-09-12T01:09:12.392925+0000","last_peered":"2024-09-12T01:09:12.392925+0000","last_clean":"2024-09-12T01:09:12.392925+0000","last_became_active":"2024-09-12T00:46:16.276368+0000","last_became_peered":"2024-09-12T00:46:16.276368+0000","last_unstale":"2024-09-12T01:09:12.392925+0000","last_undegraded":"2024-09-12T01:09:12.392925+0000","last_fullsized":"2024-09-12T01:09:12.392925+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:03.285958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594535+0000","last_change":"2024-09-12T00:44:37.821471+0000","last_active":"2024-09-12T01:07:33.594535+0000","last_peered":"2024-09-12T01:07:33.594535+0000","last_clean":"2024-09-12T01:07:33.594535+0000","last_became_active":"2024-09-12T00:44:37.821172+0000","last_became_peered":"2024-09-12T00:44:37.821172+0000","last_unstale":"2024-09-12T01:07:33.594535+0000","last_undegraded":"2024-09-12T01:07:33.594535+0000","last_fullsized":"2024-09-12T01:07:33.594535+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:46.622590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":156,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.592791+0000","last_change":"2024-09-12T00:56:52.993348+0000","last_active":"2024-09-12T01:07:23.592791+0000","last_peered":"2024-09-12T01:07:23.592791+0000","last_clean":"2024-09-12T01:07:23.592791+0000","last_became_active":"2024-09-12T00:56:52.993079+0000","last_became_peered":"2024-09-12T00:56:52.993079+0000","last_unstale":"2024-09-12T01:07:23.592791+0000","last_undegraded":"2024-09-12T01:07:23.592791+0000","last_fullsized":"2024-09-12T01:07:23.592791+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:13.494808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.501272+0000","last_change":"2024-09-12T00:46:19.279921+0000","last_active":"2024-09-12T01:09:16.501272+0000","last_peered":"2024-09-12T01:09:16.501272+0000","last_clean":"2024-09-12T01:09:16.501272+0000","last_became_active":"2024-09-12T00:46:19.279630+0000","last_became_peered":"2024-09-12T00:46:19.279630+0000","last_unstale":"2024-09-12T01:09:16.501272+0000","last_undegraded":"2024-09-12T01:09:16.501272+0000","last_fullsized":"2024-09-12T01:09:16.501272+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.231021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411787+0000","last_change":"2024-09-12T00:46:16.267218+0000","last_active":"2024-09-12T01:09:13.411787+0000","last_peered":"2024-09-12T01:09:13.411787+0000","last_clean":"2024-09-12T01:09:13.411787+0000","last_became_active":"2024-09-12T00:46:16.266854+0000","last_became_peered":"2024-09-12T00:46:16.266854+0000","last_unstale":"2024-09-12T01:09:13.411787+0000","last_undegraded":"2024-09-12T01:09:13.411787+0000","last_fullsized":"2024-09-12T01:09:13.411787+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:46.629498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'16","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.497466+0000","last_change":"2024-09-12T00:44:37.822549+0000","last_active":"2024-09-12T01:08:46.497466+0000","last_peered":"2024-09-12T01:08:46.497466+0000","last_clean":"2024-09-12T01:08:46.497466+0000","last_became_active":"2024-09-12T00:44:37.822277+0000","last_became_peered":"2024-09-12T00:44:37.822277+0000","last_unstale":"2024-09-12T01:08:46.497466+0000","last_undegraded":"2024-09-12T01:08:46.497466+0000","last_fullsized":"2024-09-12T01:08:46.497466+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.547476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'371","reported_seq":1142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.529637+0000","last_change":"2024-09-12T00:30:11.108085+0000","last_active":"2024-09-12T01:11:23.529637+0000","last_peered":"2024-09-12T01:11:23.529637+0000","last_clean":"2024-09-12T01:11:23.529637+0000","last_became_active":"2024-09-12T00:30:11.107706+0000","last_became_peered":"2024-09-12T00:30:11.107706+0000","last_unstale":"2024-09-12T01:11:23.529637+0000","last_undegraded":"2024-09-12T01:11:23.529637+0000","last_fullsized":"2024-09-12T01:11:23.529637+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.042423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1492023,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":736,"num_read_kb":12989,"num_write":1270,"num_write_kb":41879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'141","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.303738+0000","last_change":"2024-09-12T00:30:13.128059+0000","last_active":"2024-09-12T01:10:50.303738+0000","last_peered":"2024-09-12T01:10:50.303738+0000","last_clean":"2024-09-12T01:10:50.303738+0000","last_became_active":"2024-09-12T00:30:13.126147+0000","last_became_peered":"2024-09-12T00:30:13.126147+0000","last_unstale":"2024-09-12T01:10:50.303738+0000","last_undegraded":"2024-09-12T01:10:50.303738+0000","last_fullsized":"2024-09-12T01:10:50.303738+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:08.534438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":527,"num_write":201,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'275","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.951043+0000","last_change":"2024-09-12T00:30:11.101673+0000","last_active":"2024-09-12T01:09:23.951043+0000","last_peered":"2024-09-12T01:09:23.951043+0000","last_clean":"2024-09-12T01:09:23.951043+0000","last_became_active":"2024-09-12T00:30:11.101252+0000","last_became_peered":"2024-09-12T00:30:11.101252+0000","last_unstale":"2024-09-12T01:09:23.951043+0000","last_undegraded":"2024-09-12T01:09:23.951043+0000","last_fullsized":"2024-09-12T01:09:23.951043+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:24.037331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2397728,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":419,"num_read_kb":19965,"num_write":1005,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'209","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:30.236873+0000","last_change":"2024-09-12T00:30:13.124111+0000","last_active":"2024-09-12T01:09:30.236873+0000","last_peered":"2024-09-12T01:09:30.236873+0000","last_clean":"2024-09-12T01:09:30.236873+0000","last_became_active":"2024-09-12T00:30:13.123880+0000","last_became_peered":"2024-09-12T00:30:13.123880+0000","last_unstale":"2024-09-12T01:09:30.236873+0000","last_undegraded":"2024-09-12T01:09:30.236873+0000","last_fullsized":"2024-09-12T01:09:30.236873+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:41.642173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":720,"num_write":314,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'244","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:30.793618+0000","last_change":"2024-09-12T00:30:11.096844+0000","last_active":"2024-09-12T01:09:30.793618+0000","last_peered":"2024-09-12T01:09:30.793618+0000","last_clean":"2024-09-12T01:09:30.793618+0000","last_became_active":"2024-09-12T00:30:11.096381+0000","last_became_peered":"2024-09-12T00:30:11.096381+0000","last_unstale":"2024-09-12T01:09:30.793618+0000","last_undegraded":"2024-09-12T01:09:30.793618+0000","last_fullsized":"2024-09-12T01:09:30.793618+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:57.955383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13784106,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":389,"num_read_kb":52758,"num_write":935,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'151","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.489637+0000","last_change":"2024-09-12T00:30:13.121126+0000","last_active":"2024-09-12T01:08:45.489637+0000","last_peered":"2024-09-12T01:08:45.489637+0000","last_clean":"2024-09-12T01:08:45.489637+0000","last_became_active":"2024-09-12T00:30:13.120834+0000","last_became_peered":"2024-09-12T00:30:13.120834+0000","last_unstale":"2024-09-12T01:08:45.489637+0000","last_undegraded":"2024-09-12T01:08:45.489637+0000","last_fullsized":"2024-09-12T01:08:45.489637+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:48.681924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":556,"num_write":237,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'249","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.036676+0000","last_change":"2024-09-12T00:30:11.102160+0000","last_active":"2024-09-12T01:09:33.036676+0000","last_peered":"2024-09-12T01:09:33.036676+0000","last_clean":"2024-09-12T01:09:33.036676+0000","last_became_active":"2024-09-12T00:30:11.101773+0000","last_became_peered":"2024-09-12T00:30:11.101773+0000","last_unstale":"2024-09-12T01:09:33.036676+0000","last_undegraded":"2024-09-12T01:09:33.036676+0000","last_fullsized":"2024-09-12T01:09:33.036676+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:43.867988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3779590,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":382,"num_read_kb":6781,"num_write":869,"num_write_kb":20709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4368","reported_seq":4967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.603185+0000","last_change":"2024-09-12T00:30:13.114180+0000","last_active":"2024-09-12T01:07:47.603185+0000","last_peered":"2024-09-12T01:07:47.603185+0000","last_clean":"2024-09-12T01:07:47.603185+0000","last_became_active":"2024-09-12T00:30:13.113812+0000","last_became_peered":"2024-09-12T00:30:13.113812+0000","last_unstale":"2024-09-12T01:07:47.603185+0000","last_undegraded":"2024-09-12T01:07:47.603185+0000","last_fullsized":"2024-09-12T01:07:47.603185+0000","mapping_epoch":28,"log_start":"264'4300","ondisk_log_start":"264'4300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:35.040266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17553,"num_read_kb":14742,"num_write":6586,"num_write_kb":3311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'294","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.514337+0000","last_change":"2024-09-12T00:30:11.098446+0000","last_active":"2024-09-12T01:11:23.514337+0000","last_peered":"2024-09-12T01:11:23.514337+0000","last_clean":"2024-09-12T01:11:23.514337+0000","last_became_active":"2024-09-12T00:30:11.097339+0000","last_became_peered":"2024-09-12T00:30:11.097339+0000","last_unstale":"2024-09-12T01:11:23.514337+0000","last_undegraded":"2024-09-12T01:11:23.514337+0000","last_fullsized":"2024-09-12T01:11:23.514337+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:40.707199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1055238,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":412,"num_read_kb":4533,"num_write":1107,"num_write_kb":19662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"264'201","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.028978+0000","last_change":"2024-09-12T00:30:13.125647+0000","last_active":"2024-09-12T01:08:21.028978+0000","last_peered":"2024-09-12T01:08:21.028978+0000","last_clean":"2024-09-12T01:08:21.028978+0000","last_became_active":"2024-09-12T00:30:13.125363+0000","last_became_peered":"2024-09-12T00:30:13.125363+0000","last_unstale":"2024-09-12T01:08:21.028978+0000","last_undegraded":"2024-09-12T01:08:21.028978+0000","last_fullsized":"2024-09-12T01:08:21.028978+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:56.486136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":845,"num_read_kb":691,"num_write":311,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'280","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:29.550648+0000","last_change":"2024-09-12T00:30:11.104965+0000","last_active":"2024-09-12T01:09:29.550648+0000","last_peered":"2024-09-12T01:09:29.550648+0000","last_clean":"2024-09-12T01:09:29.550648+0000","last_became_active":"2024-09-12T00:30:11.104535+0000","last_became_peered":"2024-09-12T00:30:11.104535+0000","last_unstale":"2024-09-12T01:09:29.550648+0000","last_undegraded":"2024-09-12T01:09:29.550648+0000","last_fullsized":"2024-09-12T01:09:29.550648+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:02.250566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214355,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":410,"num_read_kb":66788,"num_write":917,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'115","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.522736+0000","last_change":"2024-09-12T00:30:13.125175+0000","last_active":"2024-09-12T01:08:53.522736+0000","last_peered":"2024-09-12T01:08:53.522736+0000","last_clean":"2024-09-12T01:08:53.522736+0000","last_became_active":"2024-09-12T00:30:13.124774+0000","last_became_peered":"2024-09-12T00:30:13.124774+0000","last_unstale":"2024-09-12T01:08:53.522736+0000","last_undegraded":"2024-09-12T01:08:53.522736+0000","last_fullsized":"2024-09-12T01:08:53.522736+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:17.846970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":451,"num_write":180,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'277","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.405774+0000","last_change":"2024-09-12T00:30:11.102635+0000","last_active":"2024-09-12T01:11:23.405774+0000","last_peered":"2024-09-12T01:11:23.405774+0000","last_clean":"2024-09-12T01:11:23.405774+0000","last_became_active":"2024-09-12T00:30:11.102281+0000","last_became_peered":"2024-09-12T00:30:11.102281+0000","last_unstale":"2024-09-12T01:11:23.405774+0000","last_undegraded":"2024-09-12T01:11:23.405774+0000","last_fullsized":"2024-09-12T01:11:23.405774+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:36.443637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706718,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":422,"num_read_kb":13880,"num_write":922,"num_write_kb":40348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'544","reported_seq":1240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.564544+0000","last_change":"2024-09-12T00:30:13.126388+0000","last_active":"2024-09-12T01:09:22.564544+0000","last_peered":"2024-09-12T01:09:22.564544+0000","last_clean":"2024-09-12T01:09:22.564544+0000","last_became_active":"2024-09-12T00:30:13.126123+0000","last_became_peered":"2024-09-12T00:30:13.126123+0000","last_unstale":"2024-09-12T01:09:22.564544+0000","last_undegraded":"2024-09-12T01:09:22.564544+0000","last_fullsized":"2024-09-12T01:09:22.564544+0000","mapping_epoch":28,"log_start":"264'500","ondisk_log_start":"264'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:46.451607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2509,"num_read_kb":2200,"num_write":899,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'251","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.535584+0000","last_change":"2024-09-12T00:30:11.104564+0000","last_active":"2024-09-12T01:09:13.535584+0000","last_peered":"2024-09-12T01:09:13.535584+0000","last_clean":"2024-09-12T01:09:13.535584+0000","last_became_active":"2024-09-12T00:30:11.104084+0000","last_became_peered":"2024-09-12T00:30:11.104084+0000","last_unstale":"2024-09-12T01:09:13.535584+0000","last_undegraded":"2024-09-12T01:09:13.535584+0000","last_fullsized":"2024-09-12T01:09:13.535584+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:20.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5497379,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":435,"num_read_kb":14633,"num_write":922,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'231","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.849014+0000","last_change":"2024-09-12T00:30:13.129106+0000","last_active":"2024-09-12T01:09:15.849014+0000","last_peered":"2024-09-12T01:09:15.849014+0000","last_clean":"2024-09-12T01:09:15.849014+0000","last_became_active":"2024-09-12T00:30:13.127581+0000","last_became_peered":"2024-09-12T00:30:13.127581+0000","last_unstale":"2024-09-12T01:09:15.849014+0000","last_undegraded":"2024-09-12T01:09:15.849014+0000","last_fullsized":"2024-09-12T01:09:15.849014+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:37.451443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1008,"num_read_kb":834,"num_write":338,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'462","reported_seq":1238,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.335798+0000","last_change":"2024-09-12T00:30:13.121457+0000","last_active":"2024-09-12T01:08:46.335798+0000","last_peered":"2024-09-12T01:08:46.335798+0000","last_clean":"2024-09-12T01:08:46.335798+0000","last_became_active":"2024-09-12T00:30:13.121154+0000","last_became_peered":"2024-09-12T00:30:13.121154+0000","last_unstale":"2024-09-12T01:08:46.335798+0000","last_undegraded":"2024-09-12T01:08:46.335798+0000","last_fullsized":"2024-09-12T01:08:46.335798+0000","mapping_epoch":28,"log_start":"264'400","ondisk_log_start":"264'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:30.709632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2284,"num_read_kb":1967,"num_write":806,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'250","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.376952+0000","last_change":"2024-09-12T00:30:11.103793+0000","last_active":"2024-09-12T01:11:23.376952+0000","last_peered":"2024-09-12T01:11:23.376952+0000","last_clean":"2024-09-12T01:11:23.376952+0000","last_became_active":"2024-09-12T00:30:11.103437+0000","last_became_peered":"2024-09-12T00:30:11.103437+0000","last_unstale":"2024-09-12T01:11:23.376952+0000","last_undegraded":"2024-09-12T01:11:23.376952+0000","last_fullsized":"2024-09-12T01:11:23.376952+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:00.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15228190,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":393,"num_read_kb":35388,"num_write":851,"num_write_kb":32368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'227","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.699341+0000","last_change":"2024-09-12T00:30:13.129323+0000","last_active":"2024-09-12T01:08:47.699341+0000","last_peered":"2024-09-12T01:08:47.699341+0000","last_clean":"2024-09-12T01:08:47.699341+0000","last_became_active":"2024-09-12T00:30:13.128977+0000","last_became_peered":"2024-09-12T00:30:13.128977+0000","last_unstale":"2024-09-12T01:08:47.699341+0000","last_undegraded":"2024-09-12T01:08:47.699341+0000","last_fullsized":"2024-09-12T01:08:47.699341+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:56.133929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1058,"num_read_kb":878,"num_write":388,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'275","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.538922+0000","last_change":"2024-09-12T00:30:11.115651+0000","last_active":"2024-09-12T01:11:23.538922+0000","last_peered":"2024-09-12T01:11:23.538922+0000","last_clean":"2024-09-12T01:11:23.538922+0000","last_became_active":"2024-09-12T00:30:11.114961+0000","last_became_peered":"2024-09-12T00:30:11.114961+0000","last_unstale":"2024-09-12T01:11:23.538922+0000","last_undegraded":"2024-09-12T01:11:23.538922+0000","last_fullsized":"2024-09-12T01:11:23.538922+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:14.975869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246923,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":398,"num_read_kb":13562,"num_write":911,"num_write_kb":25787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'212","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.269904+0000","last_change":"2024-09-12T00:30:13.127448+0000","last_active":"2024-09-12T01:09:09.269904+0000","last_peered":"2024-09-12T01:09:09.269904+0000","last_clean":"2024-09-12T01:09:09.269904+0000","last_became_active":"2024-09-12T00:30:13.127190+0000","last_became_peered":"2024-09-12T00:30:13.127190+0000","last_unstale":"2024-09-12T01:09:09.269904+0000","last_undegraded":"2024-09-12T01:09:09.269904+0000","last_fullsized":"2024-09-12T01:09:09.269904+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:54.603682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":739,"num_write":341,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'331","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.401578+0000","last_change":"2024-09-12T00:30:11.106208+0000","last_active":"2024-09-12T01:11:23.401578+0000","last_peered":"2024-09-12T01:11:23.401578+0000","last_clean":"2024-09-12T01:11:23.401578+0000","last_became_active":"2024-09-12T00:30:11.105844+0000","last_became_peered":"2024-09-12T00:30:11.105844+0000","last_unstale":"2024-09-12T01:11:23.401578+0000","last_undegraded":"2024-09-12T01:11:23.401578+0000","last_fullsized":"2024-09-12T01:11:23.401578+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:53.358144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6628298,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":482,"num_read_kb":46849,"num_write":1141,"num_write_kb":40470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'183","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390220+0000","last_change":"2024-09-12T00:30:13.125263+0000","last_active":"2024-09-12T01:08:52.390220+0000","last_peered":"2024-09-12T01:08:52.390220+0000","last_clean":"2024-09-12T01:08:52.390220+0000","last_became_active":"2024-09-12T00:30:13.124627+0000","last_became_peered":"2024-09-12T00:30:13.124627+0000","last_unstale":"2024-09-12T01:08:52.390220+0000","last_undegraded":"2024-09-12T01:08:52.390220+0000","last_fullsized":"2024-09-12T01:08:52.390220+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:42.412103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":804,"num_read_kb":662,"num_write":262,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'277","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.446898+0000","last_change":"2024-09-12T00:30:11.114785+0000","last_active":"2024-09-12T01:11:23.446898+0000","last_peered":"2024-09-12T01:11:23.446898+0000","last_clean":"2024-09-12T01:11:23.446898+0000","last_became_active":"2024-09-12T00:30:11.114309+0000","last_became_peered":"2024-09-12T00:30:11.114309+0000","last_unstale":"2024-09-12T01:11:23.446898+0000","last_undegraded":"2024-09-12T01:11:23.446898+0000","last_fullsized":"2024-09-12T01:11:23.446898+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.364638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10105484,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":480,"num_read_kb":64152,"num_write":932,"num_write_kb":27626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'205","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479130+0000","last_change":"2024-09-12T00:30:13.129990+0000","last_active":"2024-09-12T01:08:52.479130+0000","last_peered":"2024-09-12T01:08:52.479130+0000","last_clean":"2024-09-12T01:08:52.479130+0000","last_became_active":"2024-09-12T00:30:13.129718+0000","last_became_peered":"2024-09-12T00:30:13.129718+0000","last_unstale":"2024-09-12T01:08:52.479130+0000","last_undegraded":"2024-09-12T01:08:52.479130+0000","last_fullsized":"2024-09-12T01:08:52.479130+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:07.835287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":749,"num_write":336,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'328","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.471884+0000","last_change":"2024-09-12T00:30:11.109350+0000","last_active":"2024-09-12T01:09:23.471884+0000","last_peered":"2024-09-12T01:09:23.471884+0000","last_clean":"2024-09-12T01:09:23.471884+0000","last_became_active":"2024-09-12T00:30:11.108958+0000","last_became_peered":"2024-09-12T00:30:11.108958+0000","last_unstale":"2024-09-12T01:09:23.471884+0000","last_undegraded":"2024-09-12T01:09:23.471884+0000","last_fullsized":"2024-09-12T01:09:23.471884+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:47.014408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14088217,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":517,"num_read_kb":32014,"num_write":1318,"num_write_kb":50601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'152","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.409340+0000","last_change":"2024-09-12T00:30:13.126434+0000","last_active":"2024-09-12T01:08:53.409340+0000","last_peered":"2024-09-12T01:08:53.409340+0000","last_clean":"2024-09-12T01:08:53.409340+0000","last_became_active":"2024-09-12T00:30:13.126143+0000","last_became_peered":"2024-09-12T00:30:13.126143+0000","last_unstale":"2024-09-12T01:08:53.409340+0000","last_undegraded":"2024-09-12T01:08:53.409340+0000","last_fullsized":"2024-09-12T01:08:53.409340+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:20.649913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":565,"num_write":225,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'269","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.055631+0000","last_change":"2024-09-12T00:30:11.096841+0000","last_active":"2024-09-12T01:09:28.055631+0000","last_peered":"2024-09-12T01:09:28.055631+0000","last_clean":"2024-09-12T01:09:28.055631+0000","last_became_active":"2024-09-12T00:30:11.096162+0000","last_became_peered":"2024-09-12T00:30:11.096162+0000","last_unstale":"2024-09-12T01:09:28.055631+0000","last_undegraded":"2024-09-12T01:09:28.055631+0000","last_fullsized":"2024-09-12T01:09:28.055631+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:02.238568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3298821,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":397,"num_read_kb":7247,"num_write":905,"num_write_kb":14577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'148","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.870030+0000","last_change":"2024-09-12T00:30:21.192901+0000","last_active":"2024-09-12T01:09:46.870030+0000","last_peered":"2024-09-12T01:09:46.870030+0000","last_clean":"2024-09-12T01:09:46.870030+0000","last_became_active":"2024-09-12T00:30:21.192654+0000","last_became_peered":"2024-09-12T00:30:21.192654+0000","last_unstale":"2024-09-12T01:09:46.870030+0000","last_undegraded":"2024-09-12T01:09:46.870030+0000","last_fullsized":"2024-09-12T01:09:46.870030+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:51.831265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":350,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'101","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.979565+0000","last_change":"2024-09-12T00:30:13.130308+0000","last_active":"2024-09-12T01:08:53.979565+0000","last_peered":"2024-09-12T01:08:53.979565+0000","last_clean":"2024-09-12T01:08:53.979565+0000","last_became_active":"2024-09-12T00:30:13.130030+0000","last_became_peered":"2024-09-12T00:30:13.130030+0000","last_unstale":"2024-09-12T01:08:53.979565+0000","last_undegraded":"2024-09-12T01:08:53.979565+0000","last_fullsized":"2024-09-12T01:08:53.979565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:14.502318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":143,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'402","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.623591+0000","last_change":"2024-09-12T00:30:46.767993+0000","last_active":"2024-09-12T01:11:23.623591+0000","last_peered":"2024-09-12T01:11:23.623591+0000","last_clean":"2024-09-12T01:11:23.623591+0000","last_became_active":"2024-09-12T00:30:46.767516+0000","last_became_peered":"2024-09-12T00:30:46.767516+0000","last_unstale":"2024-09-12T01:11:23.623591+0000","last_undegraded":"2024-09-12T01:11:23.623591+0000","last_fullsized":"2024-09-12T01:11:23.623591+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:13.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9870247,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":590,"num_read_kb":38821,"num_write":1336,"num_write_kb":62705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,4],"acting":[3,5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605940+0000","last_change":"2024-09-12T00:30:15.127353+0000","last_active":"2024-09-12T01:08:58.605940+0000","last_peered":"2024-09-12T01:08:58.605940+0000","last_clean":"2024-09-12T01:08:58.605940+0000","last_became_active":"2024-09-12T00:30:15.127067+0000","last_became_peered":"2024-09-12T00:30:15.127067+0000","last_unstale":"2024-09-12T01:08:58.605940+0000","last_undegraded":"2024-09-12T01:08:58.605940+0000","last_fullsized":"2024-09-12T01:08:58.605940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:01.202011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'320","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.534951+0000","last_change":"2024-09-12T00:30:17.145857+0000","last_active":"2024-09-12T01:11:22.534951+0000","last_peered":"2024-09-12T01:11:22.534951+0000","last_clean":"2024-09-12T01:11:22.534951+0000","last_became_active":"2024-09-12T00:30:17.145455+0000","last_became_peered":"2024-09-12T00:30:17.145455+0000","last_unstale":"2024-09-12T01:11:22.534951+0000","last_undegraded":"2024-09-12T01:11:22.534951+0000","last_fullsized":"2024-09-12T01:11:22.534951+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:25.114718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":944,"num_write":404,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409967+0000","last_change":"2024-09-12T00:30:19.168447+0000","last_active":"2024-09-12T01:08:58.409967+0000","last_peered":"2024-09-12T01:08:58.409967+0000","last_clean":"2024-09-12T01:08:58.409967+0000","last_became_active":"2024-09-12T00:30:19.168192+0000","last_became_peered":"2024-09-12T00:30:19.168192+0000","last_unstale":"2024-09-12T01:08:58.409967+0000","last_undegraded":"2024-09-12T01:08:58.409967+0000","last_fullsized":"2024-09-12T01:08:58.409967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:11.131718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'146","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.132064+0000","last_change":"2024-09-12T00:30:21.189447+0000","last_active":"2024-09-12T01:09:43.132064+0000","last_peered":"2024-09-12T01:09:43.132064+0000","last_clean":"2024-09-12T01:09:43.132064+0000","last_became_active":"2024-09-12T00:30:21.189141+0000","last_became_peered":"2024-09-12T00:30:21.189141+0000","last_unstale":"2024-09-12T01:09:43.132064+0000","last_undegraded":"2024-09-12T01:09:43.132064+0000","last_fullsized":"2024-09-12T01:09:43.132064+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:53.347172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":204,"num_write":274,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'90","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.605253+0000","last_change":"2024-09-12T00:30:13.127898+0000","last_active":"2024-09-12T01:08:53.605253+0000","last_peered":"2024-09-12T01:08:53.605253+0000","last_clean":"2024-09-12T01:08:53.605253+0000","last_became_active":"2024-09-12T00:30:13.127577+0000","last_became_peered":"2024-09-12T00:30:13.127577+0000","last_unstale":"2024-09-12T01:08:53.605253+0000","last_undegraded":"2024-09-12T01:08:53.605253+0000","last_fullsized":"2024-09-12T01:08:53.605253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:40.499246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":367,"num_write":144,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'247","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:44.196296+0000","last_change":"2024-09-12T00:30:11.092270+0000","last_active":"2024-09-12T01:10:44.196296+0000","last_peered":"2024-09-12T01:10:44.196296+0000","last_clean":"2024-09-12T01:10:44.196296+0000","last_became_active":"2024-09-12T00:30:11.091860+0000","last_became_peered":"2024-09-12T00:30:11.091860+0000","last_unstale":"2024-09-12T01:10:44.196296+0000","last_undegraded":"2024-09-12T01:10:44.196296+0000","last_fullsized":"2024-09-12T01:10:44.196296+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:18.340874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3749324,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":390,"num_read_kb":88624,"num_write":917,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510119+0000","last_change":"2024-09-12T00:30:15.130476+0000","last_active":"2024-09-12T01:07:42.510119+0000","last_peered":"2024-09-12T01:07:42.510119+0000","last_clean":"2024-09-12T01:07:42.510119+0000","last_became_active":"2024-09-12T00:30:15.130254+0000","last_became_peered":"2024-09-12T00:30:15.130254+0000","last_unstale":"2024-09-12T01:07:42.510119+0000","last_undegraded":"2024-09-12T01:07:42.510119+0000","last_fullsized":"2024-09-12T01:07:42.510119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.906448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'108","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.183586+0000","last_change":"2024-09-12T00:30:17.148717+0000","last_active":"2024-09-12T01:10:26.183586+0000","last_peered":"2024-09-12T01:10:26.183586+0000","last_clean":"2024-09-12T01:10:26.183586+0000","last_became_active":"2024-09-12T00:30:17.148422+0000","last_became_peered":"2024-09-12T00:30:17.148422+0000","last_unstale":"2024-09-12T01:10:26.183586+0000","last_undegraded":"2024-09-12T01:10:26.183586+0000","last_fullsized":"2024-09-12T01:10:26.183586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:54.544557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":99,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409940+0000","last_change":"2024-09-12T00:30:19.163744+0000","last_active":"2024-09-12T01:08:58.409940+0000","last_peered":"2024-09-12T01:08:58.409940+0000","last_clean":"2024-09-12T01:08:58.409940+0000","last_became_active":"2024-09-12T00:30:19.163363+0000","last_became_peered":"2024-09-12T00:30:19.163363+0000","last_unstale":"2024-09-12T01:08:58.409940+0000","last_undegraded":"2024-09-12T01:08:58.409940+0000","last_fullsized":"2024-09-12T01:08:58.409940+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:34.458854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'134","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.285173+0000","last_change":"2024-09-12T00:30:21.180741+0000","last_active":"2024-09-12T01:09:46.285173+0000","last_peered":"2024-09-12T01:09:46.285173+0000","last_clean":"2024-09-12T01:09:46.285173+0000","last_became_active":"2024-09-12T00:30:21.180419+0000","last_became_peered":"2024-09-12T00:30:21.180419+0000","last_unstale":"2024-09-12T01:09:46.285173+0000","last_undegraded":"2024-09-12T01:09:46.285173+0000","last_fullsized":"2024-09-12T01:09:46.285173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.115939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":136,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'120","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.531565+0000","last_change":"2024-09-12T00:30:13.126841+0000","last_active":"2024-09-12T01:09:21.531565+0000","last_peered":"2024-09-12T01:09:21.531565+0000","last_clean":"2024-09-12T01:09:21.531565+0000","last_became_active":"2024-09-12T00:30:13.126531+0000","last_became_peered":"2024-09-12T00:30:13.126531+0000","last_unstale":"2024-09-12T01:09:21.531565+0000","last_undegraded":"2024-09-12T01:09:21.531565+0000","last_fullsized":"2024-09-12T01:09:21.531565+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:10.702442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":438,"num_write":171,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'315","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.537259+0000","last_change":"2024-09-12T00:30:11.112561+0000","last_active":"2024-09-12T01:11:23.537259+0000","last_peered":"2024-09-12T01:11:23.537259+0000","last_clean":"2024-09-12T01:11:23.537259+0000","last_became_active":"2024-09-12T00:30:11.110001+0000","last_became_peered":"2024-09-12T00:30:11.110001+0000","last_unstale":"2024-09-12T01:11:23.537259+0000","last_undegraded":"2024-09-12T01:11:23.537259+0000","last_fullsized":"2024-09-12T01:11:23.537259+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:28.054807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4638876,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":403,"num_read_kb":4100,"num_write":997,"num_write_kb":26242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.520792+0000","last_change":"2024-09-12T00:30:15.126005+0000","last_active":"2024-09-12T01:08:57.520792+0000","last_peered":"2024-09-12T01:08:57.520792+0000","last_clean":"2024-09-12T01:08:57.520792+0000","last_became_active":"2024-09-12T00:30:15.125728+0000","last_became_peered":"2024-09-12T00:30:15.125728+0000","last_unstale":"2024-09-12T01:08:57.520792+0000","last_undegraded":"2024-09-12T01:08:57.520792+0000","last_fullsized":"2024-09-12T01:08:57.520792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:00.586425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'145","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.201330+0000","last_change":"2024-09-12T00:30:17.145113+0000","last_active":"2024-09-12T01:10:26.201330+0000","last_peered":"2024-09-12T01:10:26.201330+0000","last_clean":"2024-09-12T01:10:26.201330+0000","last_became_active":"2024-09-12T00:30:17.144701+0000","last_became_peered":"2024-09-12T00:30:17.144701+0000","last_unstale":"2024-09-12T01:10:26.201330+0000","last_undegraded":"2024-09-12T01:10:26.201330+0000","last_fullsized":"2024-09-12T01:10:26.201330+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:20.054774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":141,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'771","reported_seq":2310,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.506340+0000","last_change":"2024-09-12T00:30:19.170912+0000","last_active":"2024-09-12T01:11:22.506340+0000","last_peered":"2024-09-12T01:11:22.506340+0000","last_clean":"2024-09-12T01:11:22.506340+0000","last_became_active":"2024-09-12T00:30:19.170568+0000","last_became_peered":"2024-09-12T00:30:19.170568+0000","last_unstale":"2024-09-12T01:11:22.506340+0000","last_undegraded":"2024-09-12T01:11:22.506340+0000","last_fullsized":"2024-09-12T01:11:22.506340+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:09.164786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'212","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.922971+0000","last_change":"2024-09-12T00:30:21.188577+0000","last_active":"2024-09-12T01:09:46.922971+0000","last_peered":"2024-09-12T01:09:46.922971+0000","last_clean":"2024-09-12T01:09:46.922971+0000","last_became_active":"2024-09-12T00:30:21.188312+0000","last_became_peered":"2024-09-12T00:30:21.188312+0000","last_unstale":"2024-09-12T01:09:46.922971+0000","last_undegraded":"2024-09-12T01:09:46.922971+0000","last_fullsized":"2024-09-12T01:09:46.922971+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:02.003043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":596,"num_write":468,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'84","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.925453+0000","last_change":"2024-09-12T00:30:13.128485+0000","last_active":"2024-09-12T01:09:10.925453+0000","last_peered":"2024-09-12T01:09:10.925453+0000","last_clean":"2024-09-12T01:09:10.925453+0000","last_became_active":"2024-09-12T00:30:13.125323+0000","last_became_peered":"2024-09-12T00:30:13.125323+0000","last_unstale":"2024-09-12T01:09:10.925453+0000","last_undegraded":"2024-09-12T01:09:10.925453+0000","last_fullsized":"2024-09-12T01:09:10.925453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:35.611738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":383,"num_read_kb":333,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'376","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.390231+0000","last_change":"2024-09-12T00:30:11.102149+0000","last_active":"2024-09-12T01:11:23.390231+0000","last_peered":"2024-09-12T01:11:23.390231+0000","last_clean":"2024-09-12T01:11:23.390231+0000","last_became_active":"2024-09-12T00:30:11.101745+0000","last_became_peered":"2024-09-12T00:30:11.101745+0000","last_unstale":"2024-09-12T01:11:23.390231+0000","last_undegraded":"2024-09-12T01:11:23.390231+0000","last_fullsized":"2024-09-12T01:11:23.390231+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:28.329293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270498,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":729,"num_read_kb":23420,"num_write":1224,"num_write_kb":19418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605977+0000","last_change":"2024-09-12T00:30:15.124922+0000","last_active":"2024-09-12T01:08:58.605977+0000","last_peered":"2024-09-12T01:08:58.605977+0000","last_clean":"2024-09-12T01:08:58.605977+0000","last_became_active":"2024-09-12T00:30:15.124597+0000","last_became_peered":"2024-09-12T00:30:15.124597+0000","last_unstale":"2024-09-12T01:08:58.605977+0000","last_undegraded":"2024-09-12T01:08:58.605977+0000","last_fullsized":"2024-09-12T01:08:58.605977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:33.763481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'257","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.466288+0000","last_change":"2024-09-12T00:30:17.146147+0000","last_active":"2024-09-12T01:10:51.466288+0000","last_peered":"2024-09-12T01:10:51.466288+0000","last_clean":"2024-09-12T01:10:51.466288+0000","last_became_active":"2024-09-12T00:30:17.145866+0000","last_became_peered":"2024-09-12T00:30:17.145866+0000","last_unstale":"2024-09-12T01:10:51.466288+0000","last_undegraded":"2024-09-12T01:10:51.466288+0000","last_fullsized":"2024-09-12T01:10:51.466288+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:44.866654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56379,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":424,"num_read_kb":883,"num_write":348,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'797","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.507144+0000","last_change":"2024-09-12T00:30:19.172788+0000","last_active":"2024-09-12T01:10:51.507144+0000","last_peered":"2024-09-12T01:10:51.507144+0000","last_clean":"2024-09-12T01:10:51.507144+0000","last_became_active":"2024-09-12T00:30:19.172403+0000","last_became_peered":"2024-09-12T00:30:19.172403+0000","last_unstale":"2024-09-12T01:10:51.507144+0000","last_undegraded":"2024-09-12T01:10:51.507144+0000","last_fullsized":"2024-09-12T01:10:51.507144+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:18.079531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'131","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:26.492883+0000","last_change":"2024-09-12T00:30:13.120892+0000","last_active":"2024-09-12T01:09:26.492883+0000","last_peered":"2024-09-12T01:09:26.492883+0000","last_clean":"2024-09-12T01:09:26.492883+0000","last_became_active":"2024-09-12T00:30:13.120524+0000","last_became_peered":"2024-09-12T00:30:13.120524+0000","last_unstale":"2024-09-12T01:09:26.492883+0000","last_undegraded":"2024-09-12T01:09:26.492883+0000","last_fullsized":"2024-09-12T01:09:26.492883+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:04.978011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":538,"num_write":190,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'341","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.476327+0000","last_change":"2024-09-12T00:30:11.106118+0000","last_active":"2024-09-12T01:11:23.476327+0000","last_peered":"2024-09-12T01:11:23.476327+0000","last_clean":"2024-09-12T01:11:23.476327+0000","last_became_active":"2024-09-12T00:30:11.105769+0000","last_became_peered":"2024-09-12T00:30:11.105769+0000","last_unstale":"2024-09-12T01:11:23.476327+0000","last_undegraded":"2024-09-12T01:11:23.476327+0000","last_fullsized":"2024-09-12T01:11:23.476327+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:02.413308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14227300,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":437,"num_read_kb":22715,"num_write":1071,"num_write_kb":62157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.394488+0000","last_change":"2024-09-12T00:30:15.133021+0000","last_active":"2024-09-12T01:07:08.394488+0000","last_peered":"2024-09-12T01:07:08.394488+0000","last_clean":"2024-09-12T01:07:08.394488+0000","last_became_active":"2024-09-12T00:30:15.132719+0000","last_became_peered":"2024-09-12T00:30:15.132719+0000","last_unstale":"2024-09-12T01:07:08.394488+0000","last_undegraded":"2024-09-12T01:07:08.394488+0000","last_fullsized":"2024-09-12T01:07:08.394488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:07.213409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'355","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.476977+0000","last_change":"2024-09-12T00:30:17.146741+0000","last_active":"2024-09-12T01:10:51.476977+0000","last_peered":"2024-09-12T01:10:51.476977+0000","last_clean":"2024-09-12T01:10:51.476977+0000","last_became_active":"2024-09-12T00:30:17.146465+0000","last_became_peered":"2024-09-12T00:30:17.146465+0000","last_unstale":"2024-09-12T01:10:51.476977+0000","last_undegraded":"2024-09-12T01:10:51.476977+0000","last_fullsized":"2024-09-12T01:10:51.476977+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:45.163258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59352,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":587,"num_read_kb":1107,"num_write":468,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:37.388200+0000","last_change":"2024-09-12T00:30:19.164620+0000","last_active":"2024-09-12T01:08:37.388200+0000","last_peered":"2024-09-12T01:08:37.388200+0000","last_clean":"2024-09-12T01:08:37.388200+0000","last_became_active":"2024-09-12T00:30:19.164249+0000","last_became_peered":"2024-09-12T00:30:19.164249+0000","last_unstale":"2024-09-12T01:08:37.388200+0000","last_undegraded":"2024-09-12T01:08:37.388200+0000","last_fullsized":"2024-09-12T01:08:37.388200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.473748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'544","reported_seq":1352,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490700+0000","last_change":"2024-09-12T00:30:21.189555+0000","last_active":"2024-09-12T01:10:51.490700+0000","last_peered":"2024-09-12T01:10:51.490700+0000","last_clean":"2024-09-12T01:10:51.490700+0000","last_became_active":"2024-09-12T00:30:21.189156+0000","last_became_peered":"2024-09-12T00:30:21.189156+0000","last_unstale":"2024-09-12T01:10:51.490700+0000","last_undegraded":"2024-09-12T01:10:51.490700+0000","last_fullsized":"2024-09-12T01:10:51.490700+0000","mapping_epoch":36,"log_start":"264'500","ondisk_log_start":"264'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:44.394203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1309,"num_read_kb":1298,"num_write":1161,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'143","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411766+0000","last_change":"2024-09-12T00:30:13.124257+0000","last_active":"2024-09-12T01:09:13.411766+0000","last_peered":"2024-09-12T01:09:13.411766+0000","last_clean":"2024-09-12T01:09:13.411766+0000","last_became_active":"2024-09-12T00:30:13.124006+0000","last_became_peered":"2024-09-12T00:30:13.124006+0000","last_unstale":"2024-09-12T01:09:13.411766+0000","last_undegraded":"2024-09-12T01:09:13.411766+0000","last_fullsized":"2024-09-12T01:09:13.411766+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:34.013529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":534,"num_write":203,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'349","reported_seq":1155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.750723+0000","last_change":"2024-09-12T00:30:11.104817+0000","last_active":"2024-09-12T01:09:43.750723+0000","last_peered":"2024-09-12T01:09:43.750723+0000","last_clean":"2024-09-12T01:09:43.750723+0000","last_became_active":"2024-09-12T00:30:11.104314+0000","last_became_peered":"2024-09-12T00:30:11.104314+0000","last_unstale":"2024-09-12T01:09:43.750723+0000","last_undegraded":"2024-09-12T01:09:43.750723+0000","last_fullsized":"2024-09-12T01:09:43.750723+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:39.988458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15014466,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":742,"num_read_kb":45639,"num_write":1475,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375246+0000","last_change":"2024-09-12T00:30:15.125725+0000","last_active":"2024-09-12T01:07:07.375246+0000","last_peered":"2024-09-12T01:07:07.375246+0000","last_clean":"2024-09-12T01:07:07.375246+0000","last_became_active":"2024-09-12T00:30:15.125380+0000","last_became_peered":"2024-09-12T00:30:15.125380+0000","last_unstale":"2024-09-12T01:07:07.375246+0000","last_undegraded":"2024-09-12T01:07:07.375246+0000","last_fullsized":"2024-09-12T01:07:07.375246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:13.819176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'249","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.454948+0000","last_change":"2024-09-12T00:30:17.146917+0000","last_active":"2024-09-12T01:10:51.454948+0000","last_peered":"2024-09-12T01:10:51.454948+0000","last_clean":"2024-09-12T01:10:51.454948+0000","last_became_active":"2024-09-12T00:30:17.145155+0000","last_became_peered":"2024-09-12T00:30:17.145155+0000","last_unstale":"2024-09-12T01:10:51.454948+0000","last_undegraded":"2024-09-12T01:10:51.454948+0000","last_fullsized":"2024-09-12T01:10:51.454948+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.615595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56946,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":408,"num_read_kb":855,"num_write":332,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.506558+0000","last_change":"2024-09-12T00:30:19.171499+0000","last_active":"2024-09-12T01:07:17.506558+0000","last_peered":"2024-09-12T01:07:17.506558+0000","last_clean":"2024-09-12T01:07:17.506558+0000","last_became_active":"2024-09-12T00:30:19.171189+0000","last_became_peered":"2024-09-12T00:30:19.171189+0000","last_unstale":"2024-09-12T01:07:17.506558+0000","last_undegraded":"2024-09-12T01:07:17.506558+0000","last_fullsized":"2024-09-12T01:07:17.506558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:46.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2414","reported_seq":4278,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.417930+0000","last_change":"2024-09-12T00:30:21.184001+0000","last_active":"2024-09-12T01:10:08.417930+0000","last_peered":"2024-09-12T01:10:08.417930+0000","last_clean":"2024-09-12T01:10:08.417930+0000","last_became_active":"2024-09-12T00:30:21.183561+0000","last_became_peered":"2024-09-12T00:30:21.183561+0000","last_unstale":"2024-09-12T01:10:08.417930+0000","last_undegraded":"2024-09-12T01:10:08.417930+0000","last_fullsized":"2024-09-12T01:10:08.417930+0000","mapping_epoch":36,"log_start":"264'2400","ondisk_log_start":"264'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":2400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:10.831146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6196,"num_read_kb":6147,"num_write":4885,"num_write_kb":1795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'180","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:05.091778+0000","last_change":"2024-09-12T00:30:13.122346+0000","last_active":"2024-09-12T01:08:05.091778+0000","last_peered":"2024-09-12T01:08:05.091778+0000","last_clean":"2024-09-12T01:08:05.091778+0000","last_became_active":"2024-09-12T00:30:13.122098+0000","last_became_peered":"2024-09-12T00:30:13.122098+0000","last_unstale":"2024-09-12T01:08:05.091778+0000","last_undegraded":"2024-09-12T01:08:05.091778+0000","last_fullsized":"2024-09-12T01:08:05.091778+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:08.371631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":634,"num_write":261,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'279","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.561759+0000","last_change":"2024-09-12T00:30:11.113453+0000","last_active":"2024-09-12T01:11:23.561759+0000","last_peered":"2024-09-12T01:11:23.561759+0000","last_clean":"2024-09-12T01:11:23.561759+0000","last_became_active":"2024-09-12T00:30:11.112302+0000","last_became_peered":"2024-09-12T00:30:11.112302+0000","last_unstale":"2024-09-12T01:11:23.561759+0000","last_undegraded":"2024-09-12T01:11:23.561759+0000","last_fullsized":"2024-09-12T01:11:23.561759+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:35.544849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324989,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":431,"num_read_kb":10142,"num_write":947,"num_write_kb":18823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476007+0000","last_change":"2024-09-12T00:30:15.129726+0000","last_active":"2024-09-12T01:08:32.476007+0000","last_peered":"2024-09-12T01:08:32.476007+0000","last_clean":"2024-09-12T01:08:32.476007+0000","last_became_active":"2024-09-12T00:30:15.129311+0000","last_became_peered":"2024-09-12T00:30:15.129311+0000","last_unstale":"2024-09-12T01:08:32.476007+0000","last_undegraded":"2024-09-12T01:08:32.476007+0000","last_fullsized":"2024-09-12T01:08:32.476007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.755744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'301","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.479762+0000","last_change":"2024-09-12T00:30:17.147414+0000","last_active":"2024-09-12T01:10:51.479762+0000","last_peered":"2024-09-12T01:10:51.479762+0000","last_clean":"2024-09-12T01:10:51.479762+0000","last_became_active":"2024-09-12T00:30:17.147148+0000","last_became_peered":"2024-09-12T00:30:17.147148+0000","last_unstale":"2024-09-12T01:10:51.479762+0000","last_undegraded":"2024-09-12T01:10:51.479762+0000","last_fullsized":"2024-09-12T01:10:51.479762+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:05.230391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61211,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1004,"num_write":408,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'797","reported_seq":2324,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.508156+0000","last_change":"2024-09-12T00:30:19.168748+0000","last_active":"2024-09-12T01:10:51.508156+0000","last_peered":"2024-09-12T01:10:51.508156+0000","last_clean":"2024-09-12T01:10:51.508156+0000","last_became_active":"2024-09-12T00:30:19.168419+0000","last_became_peered":"2024-09-12T00:30:19.168419+0000","last_unstale":"2024-09-12T01:10:51.508156+0000","last_undegraded":"2024-09-12T01:10:51.508156+0000","last_fullsized":"2024-09-12T01:10:51.508156+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.358636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'162","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.270455+0000","last_change":"2024-09-12T00:30:21.179851+0000","last_active":"2024-09-12T01:10:50.270455+0000","last_peered":"2024-09-12T01:10:50.270455+0000","last_clean":"2024-09-12T01:10:50.270455+0000","last_became_active":"2024-09-12T00:30:21.179533+0000","last_became_peered":"2024-09-12T00:30:21.179533+0000","last_unstale":"2024-09-12T01:10:50.270455+0000","last_undegraded":"2024-09-12T01:10:50.270455+0000","last_fullsized":"2024-09-12T01:10:50.270455+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:31.165476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":87,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'98","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.459055+0000","last_change":"2024-09-12T00:30:13.131803+0000","last_active":"2024-09-12T01:08:55.459055+0000","last_peered":"2024-09-12T01:08:55.459055+0000","last_clean":"2024-09-12T01:08:55.459055+0000","last_became_active":"2024-09-12T00:30:13.131423+0000","last_became_peered":"2024-09-12T00:30:13.131423+0000","last_unstale":"2024-09-12T01:08:55.459055+0000","last_undegraded":"2024-09-12T01:08:55.459055+0000","last_fullsized":"2024-09-12T01:08:55.459055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:28.163588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":366,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'341","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.472171+0000","last_change":"2024-09-12T00:30:11.103652+0000","last_active":"2024-09-12T01:11:23.472171+0000","last_peered":"2024-09-12T01:11:23.472171+0000","last_clean":"2024-09-12T01:11:23.472171+0000","last_became_active":"2024-09-12T00:30:11.103285+0000","last_became_peered":"2024-09-12T00:30:11.103285+0000","last_unstale":"2024-09-12T01:11:23.472171+0000","last_undegraded":"2024-09-12T01:11:23.472171+0000","last_fullsized":"2024-09-12T01:11:23.472171+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:22.473520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284123,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":536,"num_read_kb":3264,"num_write":1054,"num_write_kb":35970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.376081+0000","last_change":"2024-09-12T00:30:15.132989+0000","last_active":"2024-09-12T01:07:12.376081+0000","last_peered":"2024-09-12T01:07:12.376081+0000","last_clean":"2024-09-12T01:07:12.376081+0000","last_became_active":"2024-09-12T00:30:15.132695+0000","last_became_peered":"2024-09-12T00:30:15.132695+0000","last_unstale":"2024-09-12T01:07:12.376081+0000","last_undegraded":"2024-09-12T01:07:12.376081+0000","last_fullsized":"2024-09-12T01:07:12.376081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:47.371729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'449","reported_seq":1072,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.482261+0000","last_change":"2024-09-12T00:30:17.147365+0000","last_active":"2024-09-12T01:10:51.482261+0000","last_peered":"2024-09-12T01:10:51.482261+0000","last_clean":"2024-09-12T01:10:51.482261+0000","last_became_active":"2024-09-12T00:30:17.147015+0000","last_became_peered":"2024-09-12T00:30:17.147015+0000","last_unstale":"2024-09-12T01:10:51.482261+0000","last_undegraded":"2024-09-12T01:10:51.482261+0000","last_fullsized":"2024-09-12T01:10:51.482261+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.499988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116137,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":761,"num_read_kb":1645,"num_write":620,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.464310+0000","last_change":"2024-09-12T00:30:19.167774+0000","last_active":"2024-09-12T01:07:12.464310+0000","last_peered":"2024-09-12T01:07:12.464310+0000","last_clean":"2024-09-12T01:07:12.464310+0000","last_became_active":"2024-09-12T00:30:19.167503+0000","last_became_peered":"2024-09-12T00:30:19.167503+0000","last_unstale":"2024-09-12T01:07:12.464310+0000","last_undegraded":"2024-09-12T01:07:12.464310+0000","last_fullsized":"2024-09-12T01:07:12.464310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:36.705384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'96","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.090386+0000","last_change":"2024-09-12T00:30:21.192974+0000","last_active":"2024-09-12T01:09:27.090386+0000","last_peered":"2024-09-12T01:09:27.090386+0000","last_clean":"2024-09-12T01:09:27.090386+0000","last_became_active":"2024-09-12T00:30:21.192700+0000","last_became_peered":"2024-09-12T00:30:21.192700+0000","last_unstale":"2024-09-12T01:09:27.090386+0000","last_undegraded":"2024-09-12T01:09:27.090386+0000","last_fullsized":"2024-09-12T01:09:27.090386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:29.992638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":205,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'119","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.885840+0000","last_change":"2024-09-12T00:30:13.128514+0000","last_active":"2024-09-12T01:09:23.885840+0000","last_peered":"2024-09-12T01:09:23.885840+0000","last_clean":"2024-09-12T01:09:23.885840+0000","last_became_active":"2024-09-12T00:30:13.128253+0000","last_became_peered":"2024-09-12T00:30:13.128253+0000","last_unstale":"2024-09-12T01:09:23.885840+0000","last_undegraded":"2024-09-12T01:09:23.885840+0000","last_fullsized":"2024-09-12T01:09:23.885840+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:27.745822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":431,"num_write":189,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'277","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.249150+0000","last_change":"2024-09-12T00:30:11.100672+0000","last_active":"2024-09-12T01:11:23.249150+0000","last_peered":"2024-09-12T01:11:23.249150+0000","last_clean":"2024-09-12T01:11:23.249150+0000","last_became_active":"2024-09-12T00:30:11.100056+0000","last_became_peered":"2024-09-12T00:30:11.100056+0000","last_unstale":"2024-09-12T01:11:23.249150+0000","last_undegraded":"2024-09-12T01:11:23.249150+0000","last_fullsized":"2024-09-12T01:11:23.249150+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:16.381329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380833,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":444,"num_read_kb":62849,"num_write":1050,"num_write_kb":31335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.386352+0000","last_change":"2024-09-12T00:30:15.133052+0000","last_active":"2024-09-12T01:08:33.386352+0000","last_peered":"2024-09-12T01:08:33.386352+0000","last_clean":"2024-09-12T01:08:33.386352+0000","last_became_active":"2024-09-12T00:30:15.132801+0000","last_became_peered":"2024-09-12T00:30:15.132801+0000","last_unstale":"2024-09-12T01:08:33.386352+0000","last_undegraded":"2024-09-12T01:08:33.386352+0000","last_fullsized":"2024-09-12T01:08:33.386352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:47.232632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'293","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.966157+0000","last_change":"2024-09-12T00:30:17.149925+0000","last_active":"2024-09-12T01:11:22.966157+0000","last_peered":"2024-09-12T01:11:22.966157+0000","last_clean":"2024-09-12T01:11:22.966157+0000","last_became_active":"2024-09-12T00:30:17.149603+0000","last_became_peered":"2024-09-12T00:30:17.149603+0000","last_unstale":"2024-09-12T01:11:22.966157+0000","last_undegraded":"2024-09-12T01:11:22.966157+0000","last_fullsized":"2024-09-12T01:11:22.966157+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.420246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57292,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":510,"num_read_kb":1117,"num_write":456,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.387057+0000","last_change":"2024-09-12T00:30:19.168486+0000","last_active":"2024-09-12T01:08:38.387057+0000","last_peered":"2024-09-12T01:08:38.387057+0000","last_clean":"2024-09-12T01:08:38.387057+0000","last_became_active":"2024-09-12T00:30:19.168223+0000","last_became_peered":"2024-09-12T00:30:19.168223+0000","last_unstale":"2024-09-12T01:08:38.387057+0000","last_undegraded":"2024-09-12T01:08:38.387057+0000","last_fullsized":"2024-09-12T01:08:38.387057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'123","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:27.493758+0000","last_change":"2024-09-12T00:30:21.192816+0000","last_active":"2024-09-12T01:10:27.493758+0000","last_peered":"2024-09-12T01:10:27.493758+0000","last_clean":"2024-09-12T01:10:27.493758+0000","last_became_active":"2024-09-12T00:30:21.192509+0000","last_became_peered":"2024-09-12T00:30:21.192509+0000","last_unstale":"2024-09-12T01:10:27.493758+0000","last_undegraded":"2024-09-12T01:10:27.493758+0000","last_fullsized":"2024-09-12T01:10:27.493758+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:26.935855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'134","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.147039+0000","last_change":"2024-09-12T00:30:13.123694+0000","last_active":"2024-09-12T01:09:32.147039+0000","last_peered":"2024-09-12T01:09:32.147039+0000","last_clean":"2024-09-12T01:09:32.147039+0000","last_became_active":"2024-09-12T00:30:13.123412+0000","last_became_peered":"2024-09-12T00:30:13.123412+0000","last_unstale":"2024-09-12T01:09:32.147039+0000","last_undegraded":"2024-09-12T01:09:32.147039+0000","last_fullsized":"2024-09-12T01:09:32.147039+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:23.159421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":514,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'258","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.603553+0000","last_change":"2024-09-12T00:30:11.098282+0000","last_active":"2024-09-12T01:11:23.603553+0000","last_peered":"2024-09-12T01:11:23.603553+0000","last_clean":"2024-09-12T01:11:23.603553+0000","last_became_active":"2024-09-12T00:30:11.097902+0000","last_became_peered":"2024-09-12T00:30:11.097902+0000","last_unstale":"2024-09-12T01:11:23.603553+0000","last_undegraded":"2024-09-12T01:11:23.603553+0000","last_fullsized":"2024-09-12T01:11:23.603553+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.859119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2387060,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":404,"num_read_kb":17154,"num_write":960,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476034+0000","last_change":"2024-09-12T00:30:15.125920+0000","last_active":"2024-09-12T01:08:32.476034+0000","last_peered":"2024-09-12T01:08:32.476034+0000","last_clean":"2024-09-12T01:08:32.476034+0000","last_became_active":"2024-09-12T00:30:15.125629+0000","last_became_peered":"2024-09-12T00:30:15.125629+0000","last_unstale":"2024-09-12T01:08:32.476034+0000","last_undegraded":"2024-09-12T01:08:32.476034+0000","last_fullsized":"2024-09-12T01:08:32.476034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:47.978464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'278","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.489267+0000","last_change":"2024-09-12T00:30:17.149967+0000","last_active":"2024-09-12T01:10:51.489267+0000","last_peered":"2024-09-12T01:10:51.489267+0000","last_clean":"2024-09-12T01:10:51.489267+0000","last_became_active":"2024-09-12T00:30:17.149661+0000","last_became_peered":"2024-09-12T00:30:17.149661+0000","last_unstale":"2024-09-12T01:10:51.489267+0000","last_undegraded":"2024-09-12T01:10:51.489267+0000","last_fullsized":"2024-09-12T01:10:51.489267+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:40.653446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61294,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":921,"num_write":366,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'761","reported_seq":2256,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.506608+0000","last_change":"2024-09-12T00:30:19.167751+0000","last_active":"2024-09-12T01:11:22.506608+0000","last_peered":"2024-09-12T01:11:22.506608+0000","last_clean":"2024-09-12T01:11:22.506608+0000","last_became_active":"2024-09-12T00:30:19.167476+0000","last_became_peered":"2024-09-12T00:30:19.167476+0000","last_unstale":"2024-09-12T01:11:22.506608+0000","last_undegraded":"2024-09-12T01:11:22.506608+0000","last_fullsized":"2024-09-12T01:11:22.506608+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:15.217938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'158","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.465466+0000","last_change":"2024-09-12T00:30:21.187022+0000","last_active":"2024-09-12T01:08:14.465466+0000","last_peered":"2024-09-12T01:08:14.465466+0000","last_clean":"2024-09-12T01:08:14.465466+0000","last_became_active":"2024-09-12T00:30:21.185553+0000","last_became_peered":"2024-09-12T00:30:21.185553+0000","last_unstale":"2024-09-12T01:08:14.465466+0000","last_undegraded":"2024-09-12T01:08:14.465466+0000","last_fullsized":"2024-09-12T01:08:14.465466+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:17.382517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":222,"num_write":391,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'167","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:31.495475+0000","last_change":"2024-09-12T00:30:13.121937+0000","last_active":"2024-09-12T01:08:31.495475+0000","last_peered":"2024-09-12T01:08:31.495475+0000","last_clean":"2024-09-12T01:08:31.495475+0000","last_became_active":"2024-09-12T00:30:13.121664+0000","last_became_peered":"2024-09-12T00:30:13.121664+0000","last_unstale":"2024-09-12T01:08:31.495475+0000","last_undegraded":"2024-09-12T01:08:31.495475+0000","last_fullsized":"2024-09-12T01:08:31.495475+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:50.278462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":568,"num_write":259,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'492","reported_seq":1306,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.628816+0000","last_change":"2024-09-12T00:30:11.112653+0000","last_active":"2024-09-12T01:11:23.628816+0000","last_peered":"2024-09-12T01:11:23.628816+0000","last_clean":"2024-09-12T01:11:23.628816+0000","last_became_active":"2024-09-12T00:30:11.110370+0000","last_became_peered":"2024-09-12T00:30:11.110370+0000","last_unstale":"2024-09-12T01:11:23.628816+0000","last_undegraded":"2024-09-12T01:11:23.628816+0000","last_fullsized":"2024-09-12T01:11:23.628816+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:29.346634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181242,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":1197,"num_read_kb":75458,"num_write":1566,"num_write_kb":22075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.488233+0000","last_change":"2024-09-12T00:30:15.133096+0000","last_active":"2024-09-12T01:11:22.488233+0000","last_peered":"2024-09-12T01:11:22.488233+0000","last_clean":"2024-09-12T01:11:22.488233+0000","last_became_active":"2024-09-12T00:30:15.132802+0000","last_became_peered":"2024-09-12T00:30:15.132802+0000","last_unstale":"2024-09-12T01:11:22.488233+0000","last_undegraded":"2024-09-12T01:11:22.488233+0000","last_fullsized":"2024-09-12T01:11:22.488233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:41.563778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'74","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.169269+0000","last_change":"2024-09-12T00:30:17.148149+0000","last_active":"2024-09-12T01:10:26.169269+0000","last_peered":"2024-09-12T01:10:26.169269+0000","last_clean":"2024-09-12T01:10:26.169269+0000","last_became_active":"2024-09-12T00:30:17.147864+0000","last_became_peered":"2024-09-12T00:30:17.147864+0000","last_unstale":"2024-09-12T01:10:26.169269+0000","last_undegraded":"2024-09-12T01:10:26.169269+0000","last_fullsized":"2024-09-12T01:10:26.169269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.850618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'782","reported_seq":2333,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.507478+0000","last_change":"2024-09-12T00:30:19.169220+0000","last_active":"2024-09-12T01:11:22.507478+0000","last_peered":"2024-09-12T01:11:22.507478+0000","last_clean":"2024-09-12T01:11:22.507478+0000","last_became_active":"2024-09-12T00:30:19.168960+0000","last_became_peered":"2024-09-12T00:30:19.168960+0000","last_unstale":"2024-09-12T01:11:22.507478+0000","last_undegraded":"2024-09-12T01:11:22.507478+0000","last_fullsized":"2024-09-12T01:11:22.507478+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:05.977565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.244027+0000","last_change":"2024-09-12T00:30:21.186976+0000","last_active":"2024-09-12T01:08:47.244027+0000","last_peered":"2024-09-12T01:08:47.244027+0000","last_clean":"2024-09-12T01:08:47.244027+0000","last_became_active":"2024-09-12T00:30:21.185618+0000","last_became_peered":"2024-09-12T00:30:21.185618+0000","last_unstale":"2024-09-12T01:08:47.244027+0000","last_undegraded":"2024-09-12T01:08:47.244027+0000","last_fullsized":"2024-09-12T01:08:47.244027+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:37.276257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":151,"num_write":299,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:49.019799+0000","last_change":"2024-09-12T00:30:13.130144+0000","last_active":"2024-09-12T01:08:49.019799+0000","last_peered":"2024-09-12T01:08:49.019799+0000","last_clean":"2024-09-12T01:08:49.019799+0000","last_became_active":"2024-09-12T00:30:13.129892+0000","last_became_peered":"2024-09-12T00:30:13.129892+0000","last_unstale":"2024-09-12T01:08:49.019799+0000","last_undegraded":"2024-09-12T01:08:49.019799+0000","last_fullsized":"2024-09-12T01:08:49.019799+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:52.379617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":984,"num_read_kb":836,"num_write":303,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'260","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:42.940671+0000","last_change":"2024-09-12T00:30:11.103543+0000","last_active":"2024-09-12T01:10:42.940671+0000","last_peered":"2024-09-12T01:10:42.940671+0000","last_clean":"2024-09-12T01:10:42.940671+0000","last_became_active":"2024-09-12T00:30:11.103195+0000","last_became_peered":"2024-09-12T00:30:11.103195+0000","last_unstale":"2024-09-12T01:10:42.940671+0000","last_undegraded":"2024-09-12T01:10:42.940671+0000","last_fullsized":"2024-09-12T01:10:42.940671+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:34.854760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6563396,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":379,"num_read_kb":8246,"num_write":884,"num_write_kb":41947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.602445+0000","last_change":"2024-09-12T00:30:15.128205+0000","last_active":"2024-09-12T01:08:33.602445+0000","last_peered":"2024-09-12T01:08:33.602445+0000","last_clean":"2024-09-12T01:08:33.602445+0000","last_became_active":"2024-09-12T00:30:15.127047+0000","last_became_peered":"2024-09-12T00:30:15.127047+0000","last_unstale":"2024-09-12T01:08:33.602445+0000","last_undegraded":"2024-09-12T01:08:33.602445+0000","last_fullsized":"2024-09-12T01:08:33.602445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:24.381773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'306","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.473780+0000","last_change":"2024-09-12T00:30:17.149883+0000","last_active":"2024-09-12T01:10:51.473780+0000","last_peered":"2024-09-12T01:10:51.473780+0000","last_clean":"2024-09-12T01:10:51.473780+0000","last_became_active":"2024-09-12T00:30:17.149579+0000","last_became_peered":"2024-09-12T00:30:17.149579+0000","last_unstale":"2024-09-12T01:10:51.473780+0000","last_undegraded":"2024-09-12T01:10:51.473780+0000","last_fullsized":"2024-09-12T01:10:51.473780+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:00.182066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49466,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":910,"num_write":384,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496293+0000","last_change":"2024-09-12T00:30:19.169963+0000","last_active":"2024-09-12T01:08:36.496293+0000","last_peered":"2024-09-12T01:08:36.496293+0000","last_clean":"2024-09-12T01:08:36.496293+0000","last_became_active":"2024-09-12T00:30:19.169468+0000","last_became_peered":"2024-09-12T00:30:19.169468+0000","last_unstale":"2024-09-12T01:08:36.496293+0000","last_undegraded":"2024-09-12T01:08:36.496293+0000","last_fullsized":"2024-09-12T01:08:36.496293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.885333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'111","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.875182+0000","last_change":"2024-09-12T00:30:21.184306+0000","last_active":"2024-09-12T01:09:46.875182+0000","last_peered":"2024-09-12T01:09:46.875182+0000","last_clean":"2024-09-12T01:09:46.875182+0000","last_became_active":"2024-09-12T00:30:21.184033+0000","last_became_peered":"2024-09-12T00:30:21.184033+0000","last_unstale":"2024-09-12T01:09:46.875182+0000","last_undegraded":"2024-09-12T01:09:46.875182+0000","last_fullsized":"2024-09-12T01:09:46.875182+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.799929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":266,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'245","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.688573+0000","last_change":"2024-09-12T00:30:13.121232+0000","last_active":"2024-09-12T01:08:19.688573+0000","last_peered":"2024-09-12T01:08:19.688573+0000","last_clean":"2024-09-12T01:08:19.688573+0000","last_became_active":"2024-09-12T00:30:13.120962+0000","last_became_peered":"2024-09-12T00:30:13.120962+0000","last_unstale":"2024-09-12T01:08:19.688573+0000","last_undegraded":"2024-09-12T01:08:19.688573+0000","last_fullsized":"2024-09-12T01:08:19.688573+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:29.222097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":839,"num_write":403,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403142+0000","last_change":"2024-09-12T00:29:54.471707+0000","last_active":"2024-09-12T01:08:08.403142+0000","last_peered":"2024-09-12T01:08:08.403142+0000","last_clean":"2024-09-12T01:08:08.403142+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T01:08:08.403142+0000","last_undegraded":"2024-09-12T01:08:08.403142+0000","last_fullsized":"2024-09-12T01:08:08.403142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_clean_scrub_stamp":"2024-09-12T00:29:53.438265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.897736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594622+0000","last_change":"2024-09-12T00:30:01.530800+0000","last_active":"2024-09-12T01:07:33.594622+0000","last_peered":"2024-09-12T01:07:33.594622+0000","last_clean":"2024-09-12T01:07:33.594622+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T01:07:33.594622+0000","last_undegraded":"2024-09-12T01:07:33.594622+0000","last_fullsized":"2024-09-12T01:07:33.594622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:58.930249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'255","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.751009+0000","last_change":"2024-09-12T00:30:11.102970+0000","last_active":"2024-09-12T01:09:43.751009+0000","last_peered":"2024-09-12T01:09:43.751009+0000","last_clean":"2024-09-12T01:09:43.751009+0000","last_became_active":"2024-09-12T00:30:11.102144+0000","last_became_peered":"2024-09-12T00:30:11.102144+0000","last_unstale":"2024-09-12T01:09:43.751009+0000","last_undegraded":"2024-09-12T01:09:43.751009+0000","last_fullsized":"2024-09-12T01:09:43.751009+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:38.319543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14238165,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":368,"num_read_kb":17991,"num_write":923,"num_write_kb":40410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"38'3","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.477731+0000","last_change":"2024-09-12T00:30:15.132691+0000","last_active":"2024-09-12T01:11:22.477731+0000","last_peered":"2024-09-12T01:11:22.477731+0000","last_clean":"2024-09-12T01:11:22.477731+0000","last_became_active":"2024-09-12T00:30:15.132332+0000","last_became_peered":"2024-09-12T00:30:15.132332+0000","last_unstale":"2024-09-12T01:11:22.477731+0000","last_undegraded":"2024-09-12T01:11:22.477731+0000","last_fullsized":"2024-09-12T01:11:22.477731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:09.196418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'701","reported_seq":1384,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.593925+0000","last_change":"2024-09-12T00:30:17.150136+0000","last_active":"2024-09-12T01:11:23.593925+0000","last_peered":"2024-09-12T01:11:23.593925+0000","last_clean":"2024-09-12T01:11:23.593925+0000","last_became_active":"2024-09-12T00:30:17.149842+0000","last_became_peered":"2024-09-12T00:30:17.149842+0000","last_unstale":"2024-09-12T01:11:23.593925+0000","last_undegraded":"2024-09-12T01:11:23.593925+0000","last_fullsized":"2024-09-12T01:11:23.593925+0000","mapping_epoch":32,"log_start":"264'600","ondisk_log_start":"264'600","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.362386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185190,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1370,"num_read_kb":2889,"num_write":1303,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.464436+0000","last_change":"2024-09-12T00:30:19.168459+0000","last_active":"2024-09-12T01:07:12.464436+0000","last_peered":"2024-09-12T01:07:12.464436+0000","last_clean":"2024-09-12T01:07:12.464436+0000","last_became_active":"2024-09-12T00:30:19.168219+0000","last_became_peered":"2024-09-12T00:30:19.168219+0000","last_unstale":"2024-09-12T01:07:12.464436+0000","last_undegraded":"2024-09-12T01:07:12.464436+0000","last_fullsized":"2024-09-12T01:07:12.464436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:10.717786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'214","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:45.780203+0000","last_change":"2024-09-12T00:30:21.192045+0000","last_active":"2024-09-12T01:09:45.780203+0000","last_peered":"2024-09-12T01:09:45.780203+0000","last_clean":"2024-09-12T01:09:45.780203+0000","last_became_active":"2024-09-12T00:30:21.191389+0000","last_became_peered":"2024-09-12T00:30:21.191389+0000","last_unstale":"2024-09-12T01:09:45.780203+0000","last_undegraded":"2024-09-12T01:09:45.780203+0000","last_fullsized":"2024-09-12T01:09:45.780203+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:50.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":544,"num_write":463,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'83","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.482265+0000","last_change":"2024-09-12T00:30:13.124765+0000","last_active":"2024-09-12T01:09:12.482265+0000","last_peered":"2024-09-12T01:09:12.482265+0000","last_clean":"2024-09-12T01:09:12.482265+0000","last_became_active":"2024-09-12T00:30:13.124407+0000","last_became_peered":"2024-09-12T00:30:13.124407+0000","last_unstale":"2024-09-12T01:09:12.482265+0000","last_undegraded":"2024-09-12T01:09:12.482265+0000","last_fullsized":"2024-09-12T01:09:12.482265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:33.269760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":258,"num_write":150,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.598985+0000","last_change":"2024-09-12T00:30:01.530206+0000","last_active":"2024-09-12T01:08:08.598985+0000","last_peered":"2024-09-12T01:08:08.598985+0000","last_clean":"2024-09-12T01:08:08.598985+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T01:08:08.598985+0000","last_undegraded":"2024-09-12T01:08:08.598985+0000","last_fullsized":"2024-09-12T01:08:08.598985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:48.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'316","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.470506+0000","last_change":"2024-09-12T00:30:11.099484+0000","last_active":"2024-09-12T01:09:23.470506+0000","last_peered":"2024-09-12T01:09:23.470506+0000","last_clean":"2024-09-12T01:09:23.470506+0000","last_became_active":"2024-09-12T00:30:11.099065+0000","last_became_peered":"2024-09-12T00:30:11.099065+0000","last_unstale":"2024-09-12T01:09:23.470506+0000","last_undegraded":"2024-09-12T01:09:23.470506+0000","last_fullsized":"2024-09-12T01:09:23.470506+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:19.401122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2020207,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":452,"num_read_kb":8968,"num_write":1100,"num_write_kb":21800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590364+0000","last_change":"2024-09-12T00:30:15.130834+0000","last_active":"2024-09-12T01:07:08.590364+0000","last_peered":"2024-09-12T01:07:08.590364+0000","last_clean":"2024-09-12T01:07:08.590364+0000","last_became_active":"2024-09-12T00:30:15.130490+0000","last_became_peered":"2024-09-12T00:30:15.130490+0000","last_unstale":"2024-09-12T01:07:08.590364+0000","last_undegraded":"2024-09-12T01:07:08.590364+0000","last_fullsized":"2024-09-12T01:07:08.590364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:41.519057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'1348","reported_seq":2766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.768645+0000","last_change":"2024-09-12T00:30:17.146700+0000","last_active":"2024-09-12T01:11:22.768645+0000","last_peered":"2024-09-12T01:11:22.768645+0000","last_clean":"2024-09-12T01:11:22.768645+0000","last_became_active":"2024-09-12T00:30:17.146374+0000","last_became_peered":"2024-09-12T00:30:17.146374+0000","last_unstale":"2024-09-12T01:11:22.768645+0000","last_undegraded":"2024-09-12T01:11:22.768645+0000","last_fullsized":"2024-09-12T01:11:22.768645+0000","mapping_epoch":32,"log_start":"264'1300","ondisk_log_start":"264'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:46.392573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186701,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2147,"num_read_kb":3978,"num_write":1250,"num_write_kb":1090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.597073+0000","last_change":"2024-09-12T00:30:19.169975+0000","last_active":"2024-09-12T01:07:53.597073+0000","last_peered":"2024-09-12T01:07:53.597073+0000","last_clean":"2024-09-12T01:07:53.597073+0000","last_became_active":"2024-09-12T00:30:19.169700+0000","last_became_peered":"2024-09-12T00:30:19.169700+0000","last_unstale":"2024-09-12T01:07:53.597073+0000","last_undegraded":"2024-09-12T01:07:53.597073+0000","last_fullsized":"2024-09-12T01:07:53.597073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:43.445292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'95","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.451982+0000","last_change":"2024-09-12T00:30:21.193756+0000","last_active":"2024-09-12T01:09:28.451982+0000","last_peered":"2024-09-12T01:09:28.451982+0000","last_clean":"2024-09-12T01:09:28.451982+0000","last_became_active":"2024-09-12T00:30:21.193491+0000","last_became_peered":"2024-09-12T00:30:21.193491+0000","last_unstale":"2024-09-12T01:09:28.451982+0000","last_undegraded":"2024-09-12T01:09:28.451982+0000","last_fullsized":"2024-09-12T01:09:28.451982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:22.498346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":108,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'101","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.393014+0000","last_change":"2024-09-12T00:30:13.124361+0000","last_active":"2024-09-12T01:09:12.393014+0000","last_peered":"2024-09-12T01:09:12.393014+0000","last_clean":"2024-09-12T01:09:12.393014+0000","last_became_active":"2024-09-12T00:30:13.124085+0000","last_became_peered":"2024-09-12T00:30:13.124085+0000","last_unstale":"2024-09-12T01:09:12.393014+0000","last_undegraded":"2024-09-12T01:09:12.393014+0000","last_fullsized":"2024-09-12T01:09:12.393014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:04.474974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":146,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.378595+0000","last_change":"2024-09-12T00:30:01.610469+0000","last_active":"2024-09-12T01:07:33.378595+0000","last_peered":"2024-09-12T01:07:33.378595+0000","last_clean":"2024-09-12T01:07:33.378595+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T01:07:33.378595+0000","last_undegraded":"2024-09-12T01:07:33.378595+0000","last_fullsized":"2024-09-12T01:07:33.378595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:35.665518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'292","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.649534+0000","last_change":"2024-09-12T00:30:46.767164+0000","last_active":"2024-09-12T01:09:33.649534+0000","last_peered":"2024-09-12T01:09:33.649534+0000","last_clean":"2024-09-12T01:09:33.649534+0000","last_became_active":"2024-09-12T00:30:46.766731+0000","last_became_peered":"2024-09-12T00:30:46.766731+0000","last_unstale":"2024-09-12T01:09:33.649534+0000","last_undegraded":"2024-09-12T01:09:33.649534+0000","last_fullsized":"2024-09-12T01:09:33.649534+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:46.403345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13020287,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":466,"num_read_kb":16356,"num_write":1122,"num_write_kb":34470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,4],"acting":[5,7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.374902+0000","last_change":"2024-09-12T00:30:15.133051+0000","last_active":"2024-09-12T01:07:08.374902+0000","last_peered":"2024-09-12T01:07:08.374902+0000","last_clean":"2024-09-12T01:07:08.374902+0000","last_became_active":"2024-09-12T00:30:15.132744+0000","last_became_peered":"2024-09-12T00:30:15.132744+0000","last_unstale":"2024-09-12T01:07:08.374902+0000","last_undegraded":"2024-09-12T01:07:08.374902+0000","last_fullsized":"2024-09-12T01:07:08.374902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:50.803146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'217","reported_seq":1253,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.310283+0000","last_change":"2024-09-12T00:30:17.145576+0000","last_active":"2024-09-12T01:10:50.310283+0000","last_peered":"2024-09-12T01:10:50.310283+0000","last_clean":"2024-09-12T01:10:50.310283+0000","last_became_active":"2024-09-12T00:30:17.145284+0000","last_became_peered":"2024-09-12T00:30:17.145284+0000","last_unstale":"2024-09-12T01:10:50.310283+0000","last_undegraded":"2024-09-12T01:10:50.310283+0000","last_fullsized":"2024-09-12T01:10:50.310283+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:04.503798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":145,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511658+0000","last_change":"2024-09-12T00:30:19.169714+0000","last_active":"2024-09-12T01:07:52.511658+0000","last_peered":"2024-09-12T01:07:52.511658+0000","last_clean":"2024-09-12T01:07:52.511658+0000","last_became_active":"2024-09-12T00:30:19.169439+0000","last_became_peered":"2024-09-12T00:30:19.169439+0000","last_unstale":"2024-09-12T01:07:52.511658+0000","last_undegraded":"2024-09-12T01:07:52.511658+0000","last_fullsized":"2024-09-12T01:07:52.511658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:26.888194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'342","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.969662+0000","last_change":"2024-09-12T00:30:21.187938+0000","last_active":"2024-09-12T01:09:46.969662+0000","last_peered":"2024-09-12T01:09:46.969662+0000","last_clean":"2024-09-12T01:09:46.969662+0000","last_became_active":"2024-09-12T00:30:21.187616+0000","last_became_peered":"2024-09-12T00:30:21.187616+0000","last_unstale":"2024-09-12T01:09:46.969662+0000","last_undegraded":"2024-09-12T01:09:46.969662+0000","last_fullsized":"2024-09-12T01:09:46.969662+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:17.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":676,"num_read_kb":665,"num_write":755,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'375","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.067358+0000","last_change":"2024-09-12T00:30:13.123029+0000","last_active":"2024-09-12T01:09:09.067358+0000","last_peered":"2024-09-12T01:09:09.067358+0000","last_clean":"2024-09-12T01:09:09.067358+0000","last_became_active":"2024-09-12T00:30:13.122751+0000","last_became_peered":"2024-09-12T00:30:13.122751+0000","last_unstale":"2024-09-12T01:09:09.067358+0000","last_undegraded":"2024-09-12T01:09:09.067358+0000","last_fullsized":"2024-09-12T01:09:09.067358+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:58.496482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1941,"num_read_kb":1679,"num_write":648,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594595+0000","last_change":"2024-09-12T00:30:01.530685+0000","last_active":"2024-09-12T01:07:33.594595+0000","last_peered":"2024-09-12T01:07:33.594595+0000","last_clean":"2024-09-12T01:07:33.594595+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T01:07:33.594595+0000","last_undegraded":"2024-09-12T01:07:33.594595+0000","last_fullsized":"2024-09-12T01:07:33.594595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:49.919156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'359","reported_seq":1092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.439930+0000","last_change":"2024-09-12T00:30:11.100580+0000","last_active":"2024-09-12T01:11:23.439930+0000","last_peered":"2024-09-12T01:11:23.439930+0000","last_clean":"2024-09-12T01:11:23.439930+0000","last_became_active":"2024-09-12T00:30:11.100253+0000","last_became_peered":"2024-09-12T00:30:11.100253+0000","last_unstale":"2024-09-12T01:11:23.439930+0000","last_undegraded":"2024-09-12T01:11:23.439930+0000","last_fullsized":"2024-09-12T01:11:23.439930+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:01.683692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12863237,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":812,"num_read_kb":32409,"num_write":1218,"num_write_kb":44212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.380734+0000","last_change":"2024-09-12T00:30:15.128086+0000","last_active":"2024-09-12T01:07:48.380734+0000","last_peered":"2024-09-12T01:07:48.380734+0000","last_clean":"2024-09-12T01:07:48.380734+0000","last_became_active":"2024-09-12T00:30:15.127835+0000","last_became_peered":"2024-09-12T00:30:15.127835+0000","last_unstale":"2024-09-12T01:07:48.380734+0000","last_undegraded":"2024-09-12T01:07:48.380734+0000","last_fullsized":"2024-09-12T01:07:48.380734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:47.620246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'123","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.156498+0000","last_change":"2024-09-12T00:30:17.148863+0000","last_active":"2024-09-12T01:10:26.156498+0000","last_peered":"2024-09-12T01:10:26.156498+0000","last_clean":"2024-09-12T01:10:26.156498+0000","last_became_active":"2024-09-12T00:30:17.148548+0000","last_became_peered":"2024-09-12T00:30:17.148548+0000","last_unstale":"2024-09-12T01:10:26.156498+0000","last_undegraded":"2024-09-12T01:10:26.156498+0000","last_fullsized":"2024-09-12T01:10:26.156498+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590341+0000","last_change":"2024-09-12T00:30:19.165383+0000","last_active":"2024-09-12T01:07:08.590341+0000","last_peered":"2024-09-12T01:07:08.590341+0000","last_clean":"2024-09-12T01:07:08.590341+0000","last_became_active":"2024-09-12T00:30:19.165120+0000","last_became_peered":"2024-09-12T00:30:19.165120+0000","last_unstale":"2024-09-12T01:07:08.590341+0000","last_undegraded":"2024-09-12T01:07:08.590341+0000","last_fullsized":"2024-09-12T01:07:08.590341+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:24.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'134","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.882688+0000","last_change":"2024-09-12T00:30:21.181012+0000","last_active":"2024-09-12T01:09:23.882688+0000","last_peered":"2024-09-12T01:09:23.882688+0000","last_clean":"2024-09-12T01:09:23.882688+0000","last_became_active":"2024-09-12T00:30:21.180708+0000","last_became_peered":"2024-09-12T00:30:21.180708+0000","last_unstale":"2024-09-12T01:09:23.882688+0000","last_undegraded":"2024-09-12T01:09:23.882688+0000","last_fullsized":"2024-09-12T01:09:23.882688+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:50.395523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":239,"num_write":325,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'170","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.380239+0000","last_change":"2024-09-12T00:30:13.130893+0000","last_active":"2024-09-12T01:07:42.380239+0000","last_peered":"2024-09-12T01:07:42.380239+0000","last_clean":"2024-09-12T01:07:42.380239+0000","last_became_active":"2024-09-12T00:30:13.130610+0000","last_became_peered":"2024-09-12T00:30:13.130610+0000","last_unstale":"2024-09-12T01:07:42.380239+0000","last_undegraded":"2024-09-12T01:07:42.380239+0000","last_fullsized":"2024-09-12T01:07:42.380239+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:26.005542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":757,"num_read_kb":608,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'255","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:26.086446+0000","last_change":"2024-09-12T00:30:11.104365+0000","last_active":"2024-09-12T01:09:26.086446+0000","last_peered":"2024-09-12T01:09:26.086446+0000","last_clean":"2024-09-12T01:09:26.086446+0000","last_became_active":"2024-09-12T00:30:11.104002+0000","last_became_peered":"2024-09-12T00:30:11.104002+0000","last_unstale":"2024-09-12T01:09:26.086446+0000","last_undegraded":"2024-09-12T01:09:26.086446+0000","last_fullsized":"2024-09-12T01:09:26.086446+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:42.652998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8724393,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":344,"num_read_kb":13267,"num_write":870,"num_write_kb":33802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:32.467396+0000","last_change":"2024-09-12T00:30:01.575846+0000","last_active":"2024-09-12T01:07:32.467396+0000","last_peered":"2024-09-12T01:07:32.467396+0000","last_clean":"2024-09-12T01:07:32.467396+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T01:07:32.467396+0000","last_undegraded":"2024-09-12T01:07:32.467396+0000","last_fullsized":"2024-09-12T01:07:32.467396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:02.507794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510721+0000","last_change":"2024-09-12T00:30:15.127858+0000","last_active":"2024-09-12T01:07:47.510721+0000","last_peered":"2024-09-12T01:07:47.510721+0000","last_clean":"2024-09-12T01:07:47.510721+0000","last_became_active":"2024-09-12T00:30:15.127513+0000","last_became_peered":"2024-09-12T00:30:15.127513+0000","last_unstale":"2024-09-12T01:07:47.510721+0000","last_undegraded":"2024-09-12T01:07:47.510721+0000","last_fullsized":"2024-09-12T01:07:47.510721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:13.431995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'557","reported_seq":1215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.530330+0000","last_change":"2024-09-12T00:30:17.146701+0000","last_active":"2024-09-12T01:11:22.530330+0000","last_peered":"2024-09-12T01:11:22.530330+0000","last_clean":"2024-09-12T01:11:22.530330+0000","last_became_active":"2024-09-12T00:30:17.146141+0000","last_became_peered":"2024-09-12T00:30:17.146141+0000","last_unstale":"2024-09-12T01:11:22.530330+0000","last_undegraded":"2024-09-12T01:11:22.530330+0000","last_fullsized":"2024-09-12T01:11:22.530330+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:34.957314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112160,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1533,"num_read_kb":2449,"num_write":2006,"num_write_kb":1846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.490280+0000","last_change":"2024-09-12T00:30:19.168100+0000","last_active":"2024-09-12T01:07:51.490280+0000","last_peered":"2024-09-12T01:07:51.490280+0000","last_clean":"2024-09-12T01:07:51.490280+0000","last_became_active":"2024-09-12T00:30:19.167819+0000","last_became_peered":"2024-09-12T00:30:19.167819+0000","last_unstale":"2024-09-12T01:07:51.490280+0000","last_undegraded":"2024-09-12T01:07:51.490280+0000","last_fullsized":"2024-09-12T01:07:51.490280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:06.580191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'175","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.532966+0000","last_change":"2024-09-12T00:30:21.193170+0000","last_active":"2024-09-12T01:09:21.532966+0000","last_peered":"2024-09-12T01:09:21.532966+0000","last_clean":"2024-09-12T01:09:21.532966+0000","last_became_active":"2024-09-12T00:30:21.192893+0000","last_became_peered":"2024-09-12T00:30:21.192893+0000","last_unstale":"2024-09-12T01:09:21.532966+0000","last_undegraded":"2024-09-12T01:09:21.532966+0000","last_fullsized":"2024-09-12T01:09:21.532966+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.137808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":195,"num_read_kb":181,"num_write":424,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'295","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.821157+0000","last_change":"2024-09-12T00:30:13.125785+0000","last_active":"2024-09-12T01:07:43.821157+0000","last_peered":"2024-09-12T01:07:43.821157+0000","last_clean":"2024-09-12T01:07:43.821157+0000","last_became_active":"2024-09-12T00:30:13.125487+0000","last_became_peered":"2024-09-12T00:30:13.125487+0000","last_unstale":"2024-09-12T01:07:43.821157+0000","last_undegraded":"2024-09-12T01:07:43.821157+0000","last_fullsized":"2024-09-12T01:07:43.821157+0000","mapping_epoch":28,"log_start":"261'200","ondisk_log_start":"261'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:38.141488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1016,"num_write":432,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'241","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.516205+0000","last_change":"2024-09-12T00:30:11.108644+0000","last_active":"2024-09-12T01:08:19.516205+0000","last_peered":"2024-09-12T01:08:19.516205+0000","last_clean":"2024-09-12T01:08:19.516205+0000","last_became_active":"2024-09-12T00:30:11.108257+0000","last_became_peered":"2024-09-12T00:30:11.108257+0000","last_unstale":"2024-09-12T01:08:19.516205+0000","last_undegraded":"2024-09-12T01:08:19.516205+0000","last_fullsized":"2024-09-12T01:08:19.516205+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:15.455005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12965617,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":381,"num_read_kb":29050,"num_write":885,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.595234+0000","last_change":"2024-09-12T00:30:01.530154+0000","last_active":"2024-09-12T01:07:38.595234+0000","last_peered":"2024-09-12T01:07:38.595234+0000","last_clean":"2024-09-12T01:07:38.595234+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T01:07:38.595234+0000","last_undegraded":"2024-09-12T01:07:38.595234+0000","last_fullsized":"2024-09-12T01:07:38.595234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:56.892481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.517391+0000","last_change":"2024-09-12T00:30:15.125077+0000","last_active":"2024-09-12T01:07:48.517391+0000","last_peered":"2024-09-12T01:07:48.517391+0000","last_clean":"2024-09-12T01:07:48.517391+0000","last_became_active":"2024-09-12T00:30:15.124765+0000","last_became_peered":"2024-09-12T00:30:15.124765+0000","last_unstale":"2024-09-12T01:07:48.517391+0000","last_undegraded":"2024-09-12T01:07:48.517391+0000","last_fullsized":"2024-09-12T01:07:48.517391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:26.426998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'162","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.221326+0000","last_change":"2024-09-12T00:30:17.147603+0000","last_active":"2024-09-12T01:10:26.221326+0000","last_peered":"2024-09-12T01:10:26.221326+0000","last_clean":"2024-09-12T01:10:26.221326+0000","last_became_active":"2024-09-12T00:30:17.147297+0000","last_became_peered":"2024-09-12T00:30:17.147297+0000","last_unstale":"2024-09-12T01:10:26.221326+0000","last_undegraded":"2024-09-12T01:10:26.221326+0000","last_fullsized":"2024-09-12T01:10:26.221326+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:26.332646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":197,"num_write":138,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'781","reported_seq":4275,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.503994+0000","last_change":"2024-09-12T00:30:19.169985+0000","last_active":"2024-09-12T01:11:22.503994+0000","last_peered":"2024-09-12T01:11:22.503994+0000","last_clean":"2024-09-12T01:11:22.503994+0000","last_became_active":"2024-09-12T00:30:19.169689+0000","last_became_peered":"2024-09-12T00:30:19.169689+0000","last_unstale":"2024-09-12T01:11:22.503994+0000","last_undegraded":"2024-09-12T01:11:22.503994+0000","last_fullsized":"2024-09-12T01:11:22.503994+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:18.977023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'135","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.493856+0000","last_change":"2024-09-12T00:30:21.189863+0000","last_active":"2024-09-12T01:10:51.493856+0000","last_peered":"2024-09-12T01:10:51.493856+0000","last_clean":"2024-09-12T01:10:51.493856+0000","last_became_active":"2024-09-12T00:30:21.189546+0000","last_became_peered":"2024-09-12T00:30:21.189546+0000","last_unstale":"2024-09-12T01:10:51.493856+0000","last_undegraded":"2024-09-12T01:10:51.493856+0000","last_fullsized":"2024-09-12T01:10:51.493856+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.427001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":147,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'196","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.514948+0000","last_change":"2024-09-12T00:30:13.118911+0000","last_active":"2024-09-12T01:08:17.514948+0000","last_peered":"2024-09-12T01:08:17.514948+0000","last_clean":"2024-09-12T01:08:17.514948+0000","last_became_active":"2024-09-12T00:30:13.118656+0000","last_became_peered":"2024-09-12T00:30:13.118656+0000","last_unstale":"2024-09-12T01:08:17.514948+0000","last_undegraded":"2024-09-12T01:08:17.514948+0000","last_fullsized":"2024-09-12T01:08:17.514948+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:57.996691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":942,"num_read_kb":795,"num_write":340,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'312","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.522829+0000","last_change":"2024-09-12T00:30:11.090609+0000","last_active":"2024-09-12T01:09:12.522829+0000","last_peered":"2024-09-12T01:09:12.522829+0000","last_clean":"2024-09-12T01:09:12.522829+0000","last_became_active":"2024-09-12T00:30:11.090114+0000","last_became_peered":"2024-09-12T00:30:11.090114+0000","last_unstale":"2024-09-12T01:09:12.522829+0000","last_undegraded":"2024-09-12T01:09:12.522829+0000","last_fullsized":"2024-09-12T01:09:12.522829+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:10.941716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19194423,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":547,"num_read_kb":27250,"num_write":1213,"num_write_kb":43330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.521544+0000","last_change":"2024-09-12T00:30:01.610276+0000","last_active":"2024-09-12T01:09:02.521544+0000","last_peered":"2024-09-12T01:09:02.521544+0000","last_clean":"2024-09-12T01:09:02.521544+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T01:09:02.521544+0000","last_undegraded":"2024-09-12T01:09:02.521544+0000","last_fullsized":"2024-09-12T01:09:02.521544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:31.655155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596333+0000","last_change":"2024-09-12T00:30:15.127408+0000","last_active":"2024-09-12T01:07:48.596333+0000","last_peered":"2024-09-12T01:07:48.596333+0000","last_clean":"2024-09-12T01:07:48.596333+0000","last_became_active":"2024-09-12T00:30:15.126949+0000","last_became_peered":"2024-09-12T00:30:15.126949+0000","last_unstale":"2024-09-12T01:07:48.596333+0000","last_undegraded":"2024-09-12T01:07:48.596333+0000","last_fullsized":"2024-09-12T01:07:48.596333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:24.696309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.206045+0000","last_change":"2024-09-12T00:30:17.150111+0000","last_active":"2024-09-12T01:10:26.206045+0000","last_peered":"2024-09-12T01:10:26.206045+0000","last_clean":"2024-09-12T01:10:26.206045+0000","last_became_active":"2024-09-12T00:30:17.149791+0000","last_became_peered":"2024-09-12T00:30:17.149791+0000","last_unstale":"2024-09-12T01:10:26.206045+0000","last_undegraded":"2024-09-12T01:10:26.206045+0000","last_fullsized":"2024-09-12T01:10:26.206045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.663317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'797","reported_seq":4535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.506132+0000","last_change":"2024-09-12T00:30:19.167079+0000","last_active":"2024-09-12T01:10:51.506132+0000","last_peered":"2024-09-12T01:10:51.506132+0000","last_clean":"2024-09-12T01:10:51.506132+0000","last_became_active":"2024-09-12T00:30:19.166687+0000","last_became_peered":"2024-09-12T00:30:19.166687+0000","last_unstale":"2024-09-12T01:10:51.506132+0000","last_undegraded":"2024-09-12T01:10:51.506132+0000","last_fullsized":"2024-09-12T01:10:51.506132+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:58.724984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.877133+0000","last_change":"2024-09-12T00:30:21.192502+0000","last_active":"2024-09-12T01:09:46.877133+0000","last_peered":"2024-09-12T01:09:46.877133+0000","last_clean":"2024-09-12T01:09:46.877133+0000","last_became_active":"2024-09-12T00:30:21.192189+0000","last_became_peered":"2024-09-12T00:30:21.192189+0000","last_unstale":"2024-09-12T01:09:46.877133+0000","last_undegraded":"2024-09-12T01:09:46.877133+0000","last_fullsized":"2024-09-12T01:09:46.877133+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:51.071766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":326,"num_read_kb":325,"num_write":560,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'395","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489484+0000","last_change":"2024-09-12T00:30:13.121172+0000","last_active":"2024-09-12T01:07:46.489484+0000","last_peered":"2024-09-12T01:07:46.489484+0000","last_clean":"2024-09-12T01:07:46.489484+0000","last_became_active":"2024-09-12T00:30:13.120906+0000","last_became_peered":"2024-09-12T00:30:13.120906+0000","last_unstale":"2024-09-12T01:07:46.489484+0000","last_undegraded":"2024-09-12T01:07:46.489484+0000","last_fullsized":"2024-09-12T01:07:46.489484+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:54.969193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1876,"num_read_kb":1541,"num_write":715,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'272","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.720910+0000","last_change":"2024-09-12T00:30:11.102338+0000","last_active":"2024-09-12T01:09:31.720910+0000","last_peered":"2024-09-12T01:09:31.720910+0000","last_clean":"2024-09-12T01:09:31.720910+0000","last_became_active":"2024-09-12T00:30:11.101931+0000","last_became_peered":"2024-09-12T00:30:11.101931+0000","last_unstale":"2024-09-12T01:09:31.720910+0000","last_undegraded":"2024-09-12T01:09:31.720910+0000","last_fullsized":"2024-09-12T01:09:31.720910+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:00.380675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10543400,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":444,"num_read_kb":50202,"num_write":1005,"num_write_kb":37284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.606593+0000","last_change":"2024-09-12T00:30:01.530986+0000","last_active":"2024-09-12T01:09:03.606593+0000","last_peered":"2024-09-12T01:09:03.606593+0000","last_clean":"2024-09-12T01:09:03.606593+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T01:09:03.606593+0000","last_undegraded":"2024-09-12T01:09:03.606593+0000","last_fullsized":"2024-09-12T01:09:03.606593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:52.048191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.515540+0000","last_change":"2024-09-12T00:30:15.126298+0000","last_active":"2024-09-12T01:08:22.515540+0000","last_peered":"2024-09-12T01:08:22.515540+0000","last_clean":"2024-09-12T01:08:22.515540+0000","last_became_active":"2024-09-12T00:30:15.126041+0000","last_became_peered":"2024-09-12T00:30:15.126041+0000","last_unstale":"2024-09-12T01:08:22.515540+0000","last_undegraded":"2024-09-12T01:08:22.515540+0000","last_fullsized":"2024-09-12T01:08:22.515540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:47.264234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'761","reported_seq":1478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.300374+0000","last_change":"2024-09-12T00:30:17.149254+0000","last_active":"2024-09-12T01:11:23.300374+0000","last_peered":"2024-09-12T01:11:23.300374+0000","last_clean":"2024-09-12T01:11:23.300374+0000","last_became_active":"2024-09-12T00:30:17.148954+0000","last_became_peered":"2024-09-12T00:30:17.148954+0000","last_unstale":"2024-09-12T01:11:23.300374+0000","last_undegraded":"2024-09-12T01:11:23.300374+0000","last_fullsized":"2024-09-12T01:11:23.300374+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:23.398387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155985,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1373,"num_read_kb":3176,"num_write":1136,"num_write_kb":954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511612+0000","last_change":"2024-09-12T00:30:19.169337+0000","last_active":"2024-09-12T01:07:52.511612+0000","last_peered":"2024-09-12T01:07:52.511612+0000","last_clean":"2024-09-12T01:07:52.511612+0000","last_became_active":"2024-09-12T00:30:19.168965+0000","last_became_peered":"2024-09-12T00:30:19.168965+0000","last_unstale":"2024-09-12T01:07:52.511612+0000","last_undegraded":"2024-09-12T01:07:52.511612+0000","last_fullsized":"2024-09-12T01:07:52.511612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:32.282990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'132","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.271173+0000","last_change":"2024-09-12T00:30:21.186564+0000","last_active":"2024-09-12T01:09:46.271173+0000","last_peered":"2024-09-12T01:09:46.271173+0000","last_clean":"2024-09-12T01:09:46.271173+0000","last_became_active":"2024-09-12T00:30:21.186262+0000","last_became_peered":"2024-09-12T00:30:21.186262+0000","last_unstale":"2024-09-12T01:09:46.271173+0000","last_undegraded":"2024-09-12T01:09:46.271173+0000","last_fullsized":"2024-09-12T01:09:46.271173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:19.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":332,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'144","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.925813+0000","last_change":"2024-09-12T00:30:21.193317+0000","last_active":"2024-09-12T01:09:46.925813+0000","last_peered":"2024-09-12T01:09:46.925813+0000","last_clean":"2024-09-12T01:09:46.925813+0000","last_became_active":"2024-09-12T00:30:21.193010+0000","last_became_peered":"2024-09-12T00:30:21.193010+0000","last_unstale":"2024-09-12T01:09:46.925813+0000","last_undegraded":"2024-09-12T01:09:46.925813+0000","last_fullsized":"2024-09-12T01:09:46.925813+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:25.295748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'64","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.214217+0000","last_change":"2024-09-12T00:30:13.122292+0000","last_active":"2024-09-12T01:09:31.214217+0000","last_peered":"2024-09-12T01:09:31.214217+0000","last_clean":"2024-09-12T01:09:31.214217+0000","last_became_active":"2024-09-12T00:30:13.121613+0000","last_became_peered":"2024-09-12T00:30:13.121613+0000","last_unstale":"2024-09-12T01:09:31.214217+0000","last_undegraded":"2024-09-12T01:09:31.214217+0000","last_fullsized":"2024-09-12T01:09:31.214217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:01.317063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":107,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'334","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.566770+0000","last_change":"2024-09-12T00:30:11.110609+0000","last_active":"2024-09-12T01:11:23.566770+0000","last_peered":"2024-09-12T01:11:23.566770+0000","last_clean":"2024-09-12T01:11:23.566770+0000","last_became_active":"2024-09-12T00:30:11.109653+0000","last_became_peered":"2024-09-12T00:30:11.109653+0000","last_unstale":"2024-09-12T01:11:23.566770+0000","last_undegraded":"2024-09-12T01:11:23.566770+0000","last_fullsized":"2024-09-12T01:11:23.566770+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:12.419689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2133189,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":660,"num_read_kb":3250,"num_write":1191,"num_write_kb":30224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.379544+0000","last_change":"2024-09-12T00:30:15.133054+0000","last_active":"2024-09-12T01:07:37.379544+0000","last_peered":"2024-09-12T01:07:37.379544+0000","last_clean":"2024-09-12T01:07:37.379544+0000","last_became_active":"2024-09-12T00:30:15.132784+0000","last_became_peered":"2024-09-12T00:30:15.132784+0000","last_unstale":"2024-09-12T01:07:37.379544+0000","last_undegraded":"2024-09-12T01:07:37.379544+0000","last_fullsized":"2024-09-12T01:07:37.379544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:01.793710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'255","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.224691+0000","last_change":"2024-09-12T00:30:17.146875+0000","last_active":"2024-09-12T01:10:26.224691+0000","last_peered":"2024-09-12T01:10:26.224691+0000","last_clean":"2024-09-12T01:10:26.224691+0000","last_became_active":"2024-09-12T00:30:17.146483+0000","last_became_peered":"2024-09-12T00:30:17.146483+0000","last_unstale":"2024-09-12T01:10:26.224691+0000","last_undegraded":"2024-09-12T01:10:26.224691+0000","last_fullsized":"2024-09-12T01:10:26.224691+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:14.781544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52591,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":415,"num_read_kb":851,"num_write":332,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380029+0000","last_change":"2024-09-12T00:30:19.169288+0000","last_active":"2024-09-12T01:07:43.380029+0000","last_peered":"2024-09-12T01:07:43.380029+0000","last_clean":"2024-09-12T01:07:43.380029+0000","last_became_active":"2024-09-12T00:30:19.168980+0000","last_became_peered":"2024-09-12T00:30:19.168980+0000","last_unstale":"2024-09-12T01:07:43.380029+0000","last_undegraded":"2024-09-12T01:07:43.380029+0000","last_fullsized":"2024-09-12T01:07:43.380029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:55.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'108","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.943994+0000","last_change":"2024-09-12T00:30:21.188045+0000","last_active":"2024-09-12T01:08:50.943994+0000","last_peered":"2024-09-12T01:08:50.943994+0000","last_clean":"2024-09-12T01:08:50.943994+0000","last_became_active":"2024-09-12T00:30:21.187742+0000","last_became_peered":"2024-09-12T00:30:21.187742+0000","last_unstale":"2024-09-12T01:08:50.943994+0000","last_undegraded":"2024-09-12T01:08:50.943994+0000","last_fullsized":"2024-09-12T01:08:50.943994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'264","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.741230+0000","last_change":"2024-09-12T00:30:13.131517+0000","last_active":"2024-09-12T01:08:03.741230+0000","last_peered":"2024-09-12T01:08:03.741230+0000","last_clean":"2024-09-12T01:08:03.741230+0000","last_became_active":"2024-09-12T00:30:13.131204+0000","last_became_peered":"2024-09-12T00:30:13.131204+0000","last_unstale":"2024-09-12T01:08:03.741230+0000","last_undegraded":"2024-09-12T01:08:03.741230+0000","last_fullsized":"2024-09-12T01:08:03.741230+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:06.638417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":908,"num_write":395,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'329","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.445894+0000","last_change":"2024-09-12T00:30:11.104784+0000","last_active":"2024-09-12T01:11:23.445894+0000","last_peered":"2024-09-12T01:11:23.445894+0000","last_clean":"2024-09-12T01:11:23.445894+0000","last_became_active":"2024-09-12T00:30:11.104403+0000","last_became_peered":"2024-09-12T00:30:11.104403+0000","last_unstale":"2024-09-12T01:11:23.445894+0000","last_undegraded":"2024-09-12T01:11:23.445894+0000","last_fullsized":"2024-09-12T01:11:23.445894+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.674612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5276601,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":555,"num_read_kb":58051,"num_write":1182,"num_write_kb":38205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.509453+0000","last_change":"2024-09-12T00:30:15.128673+0000","last_active":"2024-09-12T01:07:37.509453+0000","last_peered":"2024-09-12T01:07:37.509453+0000","last_clean":"2024-09-12T01:07:37.509453+0000","last_became_active":"2024-09-12T00:30:15.128366+0000","last_became_peered":"2024-09-12T00:30:15.128366+0000","last_unstale":"2024-09-12T01:07:37.509453+0000","last_undegraded":"2024-09-12T01:07:37.509453+0000","last_fullsized":"2024-09-12T01:07:37.509453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:18.808966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'45","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.025516+0000","last_change":"2024-09-12T00:30:17.139289+0000","last_active":"2024-09-12T01:10:26.025516+0000","last_peered":"2024-09-12T01:10:26.025516+0000","last_clean":"2024-09-12T01:10:26.025516+0000","last_became_active":"2024-09-12T00:30:17.138399+0000","last_became_peered":"2024-09-12T00:30:17.138399+0000","last_unstale":"2024-09-12T01:10:26.025516+0000","last_undegraded":"2024-09-12T01:10:26.025516+0000","last_fullsized":"2024-09-12T01:10:26.025516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:34.631922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":31,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.488873+0000","last_change":"2024-09-12T00:30:19.167516+0000","last_active":"2024-09-12T01:07:41.488873+0000","last_peered":"2024-09-12T01:07:41.488873+0000","last_clean":"2024-09-12T01:07:41.488873+0000","last_became_active":"2024-09-12T00:30:19.167213+0000","last_became_peered":"2024-09-12T00:30:19.167213+0000","last_unstale":"2024-09-12T01:07:41.488873+0000","last_undegraded":"2024-09-12T01:07:41.488873+0000","last_fullsized":"2024-09-12T01:07:41.488873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:20.695360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'202","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.271103+0000","last_change":"2024-09-12T00:30:21.185959+0000","last_active":"2024-09-12T01:10:50.271103+0000","last_peered":"2024-09-12T01:10:50.271103+0000","last_clean":"2024-09-12T01:10:50.271103+0000","last_became_active":"2024-09-12T00:30:21.185636+0000","last_became_peered":"2024-09-12T00:30:21.185636+0000","last_unstale":"2024-09-12T01:10:50.271103+0000","last_undegraded":"2024-09-12T01:10:50.271103+0000","last_fullsized":"2024-09-12T01:10:50.271103+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:18.839590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":299,"num_write":483,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'101","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.233430+0000","last_change":"2024-09-12T00:30:13.124435+0000","last_active":"2024-09-12T01:08:23.233430+0000","last_peered":"2024-09-12T01:08:23.233430+0000","last_clean":"2024-09-12T01:08:23.233430+0000","last_became_active":"2024-09-12T00:30:13.124163+0000","last_became_peered":"2024-09-12T00:30:13.124163+0000","last_unstale":"2024-09-12T01:08:23.233430+0000","last_undegraded":"2024-09-12T01:08:23.233430+0000","last_fullsized":"2024-09-12T01:08:23.233430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:34.854665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":380,"num_write":155,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'283","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.749795+0000","last_change":"2024-09-12T00:30:11.111101+0000","last_active":"2024-09-12T01:09:43.749795+0000","last_peered":"2024-09-12T01:09:43.749795+0000","last_clean":"2024-09-12T01:09:43.749795+0000","last_became_active":"2024-09-12T00:30:11.110736+0000","last_became_peered":"2024-09-12T00:30:11.110736+0000","last_unstale":"2024-09-12T01:09:43.749795+0000","last_undegraded":"2024-09-12T01:09:43.749795+0000","last_fullsized":"2024-09-12T01:09:43.749795+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:36.799456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14685817,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":756,"num_read_kb":34556,"num_write":1099,"num_write_kb":41998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.488227+0000","last_change":"2024-09-12T00:30:15.121446+0000","last_active":"2024-09-12T01:07:36.488227+0000","last_peered":"2024-09-12T01:07:36.488227+0000","last_clean":"2024-09-12T01:07:36.488227+0000","last_became_active":"2024-09-12T00:30:15.121068+0000","last_became_peered":"2024-09-12T00:30:15.121068+0000","last_unstale":"2024-09-12T01:07:36.488227+0000","last_undegraded":"2024-09-12T01:07:36.488227+0000","last_fullsized":"2024-09-12T01:07:36.488227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:39.771010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'314","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.380796+0000","last_change":"2024-09-12T00:30:17.148244+0000","last_active":"2024-09-12T01:11:23.380796+0000","last_peered":"2024-09-12T01:11:23.380796+0000","last_clean":"2024-09-12T01:11:23.380796+0000","last_became_active":"2024-09-12T00:30:17.147946+0000","last_became_peered":"2024-09-12T00:30:17.147946+0000","last_unstale":"2024-09-12T01:11:23.380796+0000","last_undegraded":"2024-09-12T01:11:23.380796+0000","last_fullsized":"2024-09-12T01:11:23.380796+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:12.212273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":1151,"num_write":414,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.399089+0000","last_change":"2024-09-12T00:30:19.167688+0000","last_active":"2024-09-12T01:07:38.399089+0000","last_peered":"2024-09-12T01:07:38.399089+0000","last_clean":"2024-09-12T01:07:38.399089+0000","last_became_active":"2024-09-12T00:30:19.167407+0000","last_became_peered":"2024-09-12T00:30:19.167407+0000","last_unstale":"2024-09-12T01:07:38.399089+0000","last_undegraded":"2024-09-12T01:07:38.399089+0000","last_fullsized":"2024-09-12T01:07:38.399089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:37.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.270721+0000","last_change":"2024-09-12T00:30:21.189080+0000","last_active":"2024-09-12T01:09:23.270721+0000","last_peered":"2024-09-12T01:09:23.270721+0000","last_clean":"2024-09-12T01:09:23.270721+0000","last_became_active":"2024-09-12T00:30:21.188801+0000","last_became_peered":"2024-09-12T00:30:21.188801+0000","last_unstale":"2024-09-12T01:09:23.270721+0000","last_undegraded":"2024-09-12T01:09:23.270721+0000","last_fullsized":"2024-09-12T01:09:23.270721+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:52.941694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":174,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'271","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.925751+0000","last_change":"2024-09-12T00:30:13.122096+0000","last_active":"2024-09-12T01:07:50.925751+0000","last_peered":"2024-09-12T01:07:50.925751+0000","last_clean":"2024-09-12T01:07:50.925751+0000","last_became_active":"2024-09-12T00:30:13.121687+0000","last_became_peered":"2024-09-12T00:30:13.121687+0000","last_unstale":"2024-09-12T01:07:50.925751+0000","last_undegraded":"2024-09-12T01:07:50.925751+0000","last_fullsized":"2024-09-12T01:07:50.925751+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:11.931962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1180,"num_read_kb":936,"num_write":465,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'272","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.150176+0000","last_change":"2024-09-12T00:30:11.098286+0000","last_active":"2024-09-12T01:08:57.150176+0000","last_peered":"2024-09-12T01:08:57.150176+0000","last_clean":"2024-09-12T01:08:57.150176+0000","last_became_active":"2024-09-12T00:30:11.097863+0000","last_became_peered":"2024-09-12T00:30:11.097863+0000","last_unstale":"2024-09-12T01:08:57.150176+0000","last_undegraded":"2024-09-12T01:08:57.150176+0000","last_fullsized":"2024-09-12T01:08:57.150176+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:12.507001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9451713,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":456,"num_read_kb":74370,"num_write":1043,"num_write_kb":34671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.595145+0000","last_change":"2024-09-12T00:30:15.125794+0000","last_active":"2024-09-12T01:07:38.595145+0000","last_peered":"2024-09-12T01:07:38.595145+0000","last_clean":"2024-09-12T01:07:38.595145+0000","last_became_active":"2024-09-12T00:30:15.125505+0000","last_became_peered":"2024-09-12T00:30:15.125505+0000","last_unstale":"2024-09-12T01:07:38.595145+0000","last_undegraded":"2024-09-12T01:07:38.595145+0000","last_fullsized":"2024-09-12T01:07:38.595145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:58.671332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'278","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.131148+0000","last_change":"2024-09-12T00:30:17.146728+0000","last_active":"2024-09-12T01:11:23.131148+0000","last_peered":"2024-09-12T01:11:23.131148+0000","last_clean":"2024-09-12T01:11:23.131148+0000","last_became_active":"2024-09-12T00:30:17.146112+0000","last_became_peered":"2024-09-12T00:30:17.146112+0000","last_unstale":"2024-09-12T01:11:23.131148+0000","last_undegraded":"2024-09-12T01:11:23.131148+0000","last_fullsized":"2024-09-12T01:11:23.131148+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:53.604417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56907,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":1155,"num_write":390,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380111+0000","last_change":"2024-09-12T00:30:19.165113+0000","last_active":"2024-09-12T01:07:43.380111+0000","last_peered":"2024-09-12T01:07:43.380111+0000","last_clean":"2024-09-12T01:07:43.380111+0000","last_became_active":"2024-09-12T00:30:19.164820+0000","last_became_peered":"2024-09-12T00:30:19.164820+0000","last_unstale":"2024-09-12T01:07:43.380111+0000","last_undegraded":"2024-09-12T01:07:43.380111+0000","last_fullsized":"2024-09-12T01:07:43.380111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:05.633814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'177","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.659876+0000","last_change":"2024-09-12T00:30:13.124841+0000","last_active":"2024-09-12T01:08:12.659876+0000","last_peered":"2024-09-12T01:08:12.659876+0000","last_clean":"2024-09-12T01:08:12.659876+0000","last_became_active":"2024-09-12T00:30:13.124584+0000","last_became_peered":"2024-09-12T00:30:13.124584+0000","last_unstale":"2024-09-12T01:08:12.659876+0000","last_undegraded":"2024-09-12T01:08:12.659876+0000","last_fullsized":"2024-09-12T01:08:12.659876+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.463711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":813,"num_read_kb":670,"num_write":272,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'289","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:24.698763+0000","last_change":"2024-09-12T00:30:11.098303+0000","last_active":"2024-09-12T01:09:24.698763+0000","last_peered":"2024-09-12T01:09:24.698763+0000","last_clean":"2024-09-12T01:09:24.698763+0000","last_became_active":"2024-09-12T00:30:11.097890+0000","last_became_peered":"2024-09-12T00:30:11.097890+0000","last_unstale":"2024-09-12T01:09:24.698763+0000","last_undegraded":"2024-09-12T01:09:24.698763+0000","last_fullsized":"2024-09-12T01:09:24.698763+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:22.964167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8875917,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":488,"num_read_kb":38571,"num_write":1081,"num_write_kb":31383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'5","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.210840+0000","last_change":"2024-09-12T00:30:15.122461+0000","last_active":"2024-09-12T01:10:51.210840+0000","last_peered":"2024-09-12T01:10:51.210840+0000","last_clean":"2024-09-12T01:10:51.210840+0000","last_became_active":"2024-09-12T00:30:15.122172+0000","last_became_peered":"2024-09-12T00:30:15.122172+0000","last_unstale":"2024-09-12T01:10:51.210840+0000","last_undegraded":"2024-09-12T01:10:51.210840+0000","last_fullsized":"2024-09-12T01:10:51.210840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:40.318954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'502","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.460544+0000","last_change":"2024-09-12T00:30:17.146325+0000","last_active":"2024-09-12T01:10:51.460544+0000","last_peered":"2024-09-12T01:10:51.460544+0000","last_clean":"2024-09-12T01:10:51.460544+0000","last_became_active":"2024-09-12T00:30:17.145882+0000","last_became_peered":"2024-09-12T00:30:17.145882+0000","last_unstale":"2024-09-12T01:10:51.460544+0000","last_undegraded":"2024-09-12T01:10:51.460544+0000","last_fullsized":"2024-09-12T01:10:51.460544+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:43.412234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124876,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":923,"num_read_kb":2013,"num_write":816,"num_write_kb":741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.490351+0000","last_change":"2024-09-12T00:30:19.171021+0000","last_active":"2024-09-12T01:07:51.490351+0000","last_peered":"2024-09-12T01:07:51.490351+0000","last_clean":"2024-09-12T01:07:51.490351+0000","last_became_active":"2024-09-12T00:30:19.170776+0000","last_became_peered":"2024-09-12T00:30:19.170776+0000","last_unstale":"2024-09-12T01:07:51.490351+0000","last_undegraded":"2024-09-12T01:07:51.490351+0000","last_fullsized":"2024-09-12T01:07:51.490351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:45.791234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'142","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.220138+0000","last_change":"2024-09-12T00:30:21.188712+0000","last_active":"2024-09-12T01:09:12.220138+0000","last_peered":"2024-09-12T01:09:12.220138+0000","last_clean":"2024-09-12T01:09:12.220138+0000","last_became_active":"2024-09-12T00:30:21.188376+0000","last_became_peered":"2024-09-12T00:30:21.188376+0000","last_unstale":"2024-09-12T01:09:12.220138+0000","last_undegraded":"2024-09-12T01:09:12.220138+0000","last_fullsized":"2024-09-12T01:09:12.220138+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:33.881129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":168,"num_write":312,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'188","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.553795+0000","last_change":"2024-09-12T00:30:13.119832+0000","last_active":"2024-09-12T01:08:48.553795+0000","last_peered":"2024-09-12T01:08:48.553795+0000","last_clean":"2024-09-12T01:08:48.553795+0000","last_became_active":"2024-09-12T00:30:13.118251+0000","last_became_peered":"2024-09-12T00:30:13.118251+0000","last_unstale":"2024-09-12T01:08:48.553795+0000","last_undegraded":"2024-09-12T01:08:48.553795+0000","last_fullsized":"2024-09-12T01:08:48.553795+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:08.129477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":709,"num_write":308,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'301","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:49.565897+0000","last_change":"2024-09-12T00:30:11.103265+0000","last_active":"2024-09-12T01:10:49.565897+0000","last_peered":"2024-09-12T01:10:49.565897+0000","last_clean":"2024-09-12T01:10:49.565897+0000","last_became_active":"2024-09-12T00:30:11.102929+0000","last_became_peered":"2024-09-12T00:30:11.102929+0000","last_unstale":"2024-09-12T01:10:49.565897+0000","last_undegraded":"2024-09-12T01:10:49.565897+0000","last_fullsized":"2024-09-12T01:10:49.565897+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:09.657923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4555234,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":415,"num_read_kb":62693,"num_write":1017,"num_write_kb":37872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489602+0000","last_change":"2024-09-12T00:30:15.127559+0000","last_active":"2024-09-12T01:07:46.489602+0000","last_peered":"2024-09-12T01:07:46.489602+0000","last_clean":"2024-09-12T01:07:46.489602+0000","last_became_active":"2024-09-12T00:30:15.127268+0000","last_became_peered":"2024-09-12T00:30:15.127268+0000","last_unstale":"2024-09-12T01:07:46.489602+0000","last_undegraded":"2024-09-12T01:07:46.489602+0000","last_fullsized":"2024-09-12T01:07:46.489602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:40.481520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'306","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.215461+0000","last_change":"2024-09-12T00:30:17.145767+0000","last_active":"2024-09-12T01:11:23.215461+0000","last_peered":"2024-09-12T01:11:23.215461+0000","last_clean":"2024-09-12T01:11:23.215461+0000","last_became_active":"2024-09-12T00:30:17.145504+0000","last_became_peered":"2024-09-12T00:30:17.145504+0000","last_unstale":"2024-09-12T01:11:23.215461+0000","last_undegraded":"2024-09-12T01:11:23.215461+0000","last_fullsized":"2024-09-12T01:11:23.215461+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.680720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1192,"num_write":444,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.470054+0000","last_change":"2024-09-12T00:30:19.169885+0000","last_active":"2024-09-12T01:07:52.470054+0000","last_peered":"2024-09-12T01:07:52.470054+0000","last_clean":"2024-09-12T01:07:52.470054+0000","last_became_active":"2024-09-12T00:30:19.169558+0000","last_became_peered":"2024-09-12T00:30:19.169558+0000","last_unstale":"2024-09-12T01:07:52.470054+0000","last_undegraded":"2024-09-12T01:07:52.470054+0000","last_fullsized":"2024-09-12T01:07:52.470054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:54.438982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'175","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.845489+0000","last_change":"2024-09-12T00:30:21.188671+0000","last_active":"2024-09-12T01:09:16.845489+0000","last_peered":"2024-09-12T01:09:16.845489+0000","last_clean":"2024-09-12T01:09:16.845489+0000","last_became_active":"2024-09-12T00:30:21.188350+0000","last_became_peered":"2024-09-12T00:30:21.188350+0000","last_unstale":"2024-09-12T01:09:16.845489+0000","last_undegraded":"2024-09-12T01:09:16.845489+0000","last_fullsized":"2024-09-12T01:09:16.845489+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.291083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2246,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":214,"num_write":509,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'191","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.825959+0000","last_change":"2024-09-12T00:30:13.127956+0000","last_active":"2024-09-12T01:09:09.825959+0000","last_peered":"2024-09-12T01:09:09.825959+0000","last_clean":"2024-09-12T01:09:09.825959+0000","last_became_active":"2024-09-12T00:30:13.127294+0000","last_became_peered":"2024-09-12T00:30:13.127294+0000","last_unstale":"2024-09-12T01:09:09.825959+0000","last_undegraded":"2024-09-12T01:09:09.825959+0000","last_fullsized":"2024-09-12T01:09:09.825959+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:36.940318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":881,"num_read_kb":750,"num_write":313,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'305","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.411781+0000","last_change":"2024-09-12T00:30:11.091385+0000","last_active":"2024-09-12T01:11:23.411781+0000","last_peered":"2024-09-12T01:11:23.411781+0000","last_clean":"2024-09-12T01:11:23.411781+0000","last_became_active":"2024-09-12T00:30:11.091027+0000","last_became_peered":"2024-09-12T00:30:11.091027+0000","last_unstale":"2024-09-12T01:11:23.411781+0000","last_undegraded":"2024-09-12T01:11:23.411781+0000","last_fullsized":"2024-09-12T01:11:23.411781+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:30.586849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6384977,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":466,"num_read_kb":8604,"num_write":1126,"num_write_kb":27793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489557+0000","last_change":"2024-09-12T00:30:15.126670+0000","last_active":"2024-09-12T01:07:46.489557+0000","last_peered":"2024-09-12T01:07:46.489557+0000","last_clean":"2024-09-12T01:07:46.489557+0000","last_became_active":"2024-09-12T00:30:15.126254+0000","last_became_peered":"2024-09-12T00:30:15.126254+0000","last_unstale":"2024-09-12T01:07:46.489557+0000","last_undegraded":"2024-09-12T01:07:46.489557+0000","last_fullsized":"2024-09-12T01:07:46.489557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:45.385397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'279","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.226884+0000","last_change":"2024-09-12T00:30:17.146500+0000","last_active":"2024-09-12T01:10:26.226884+0000","last_peered":"2024-09-12T01:10:26.226884+0000","last_clean":"2024-09-12T01:10:26.226884+0000","last_became_active":"2024-09-12T00:30:17.146106+0000","last_became_peered":"2024-09-12T00:30:17.146106+0000","last_unstale":"2024-09-12T01:10:26.226884+0000","last_undegraded":"2024-09-12T01:10:26.226884+0000","last_fullsized":"2024-09-12T01:10:26.226884+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:56.226270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62267,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":947,"num_write":382,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.385079+0000","last_change":"2024-09-12T00:30:19.167702+0000","last_active":"2024-09-12T01:08:23.385079+0000","last_peered":"2024-09-12T01:08:23.385079+0000","last_clean":"2024-09-12T01:08:23.385079+0000","last_became_active":"2024-09-12T00:30:19.167119+0000","last_became_peered":"2024-09-12T00:30:19.167119+0000","last_unstale":"2024-09-12T01:08:23.385079+0000","last_undegraded":"2024-09-12T01:08:23.385079+0000","last_fullsized":"2024-09-12T01:08:23.385079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:22.072993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'97","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490235+0000","last_change":"2024-09-12T00:30:21.191304+0000","last_active":"2024-09-12T01:10:51.490235+0000","last_peered":"2024-09-12T01:10:51.490235+0000","last_clean":"2024-09-12T01:10:51.490235+0000","last_became_active":"2024-09-12T00:30:21.190937+0000","last_became_peered":"2024-09-12T00:30:21.190937+0000","last_unstale":"2024-09-12T01:10:51.490235+0000","last_undegraded":"2024-09-12T01:10:51.490235+0000","last_fullsized":"2024-09-12T01:10:51.490235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:04.164418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":102,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'207","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:24.682793+0000","last_change":"2024-09-12T00:30:13.120652+0000","last_active":"2024-09-12T01:09:24.682793+0000","last_peered":"2024-09-12T01:09:24.682793+0000","last_clean":"2024-09-12T01:09:24.682793+0000","last_became_active":"2024-09-12T00:30:13.119843+0000","last_became_peered":"2024-09-12T00:30:13.119843+0000","last_unstale":"2024-09-12T01:09:24.682793+0000","last_undegraded":"2024-09-12T01:09:24.682793+0000","last_fullsized":"2024-09-12T01:09:24.682793+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.594925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":901,"num_read_kb":747,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'304","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.375447+0000","last_change":"2024-09-12T00:30:11.101174+0000","last_active":"2024-09-12T01:09:27.375447+0000","last_peered":"2024-09-12T01:09:27.375447+0000","last_clean":"2024-09-12T01:09:27.375447+0000","last_became_active":"2024-09-12T00:30:11.100750+0000","last_became_peered":"2024-09-12T00:30:11.100750+0000","last_unstale":"2024-09-12T01:09:27.375447+0000","last_undegraded":"2024-09-12T01:09:27.375447+0000","last_fullsized":"2024-09-12T01:09:27.375447+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:57.978779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7989139,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":511,"num_read_kb":31919,"num_write":1235,"num_write_kb":26213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510757+0000","last_change":"2024-09-12T00:30:15.127738+0000","last_active":"2024-09-12T01:07:47.510757+0000","last_peered":"2024-09-12T01:07:47.510757+0000","last_clean":"2024-09-12T01:07:47.510757+0000","last_became_active":"2024-09-12T00:30:15.127444+0000","last_became_peered":"2024-09-12T00:30:15.127444+0000","last_unstale":"2024-09-12T01:07:47.510757+0000","last_undegraded":"2024-09-12T01:07:47.510757+0000","last_fullsized":"2024-09-12T01:07:47.510757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:29.367406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'84","reported_seq":596,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.218785+0000","last_change":"2024-09-12T00:30:17.144599+0000","last_active":"2024-09-12T01:10:26.218785+0000","last_peered":"2024-09-12T01:10:26.218785+0000","last_clean":"2024-09-12T01:10:26.218785+0000","last_became_active":"2024-09-12T00:30:17.144283+0000","last_became_peered":"2024-09-12T00:30:17.144283+0000","last_unstale":"2024-09-12T01:10:26.218785+0000","last_undegraded":"2024-09-12T01:10:26.218785+0000","last_fullsized":"2024-09-12T01:10:26.218785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:42.626907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":66,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'767","reported_seq":2395,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.504014+0000","last_change":"2024-09-12T00:30:19.167155+0000","last_active":"2024-09-12T01:11:22.504014+0000","last_peered":"2024-09-12T01:11:22.504014+0000","last_clean":"2024-09-12T01:11:22.504014+0000","last_became_active":"2024-09-12T00:30:19.166851+0000","last_became_peered":"2024-09-12T00:30:19.166851+0000","last_unstale":"2024-09-12T01:11:22.504014+0000","last_undegraded":"2024-09-12T01:11:22.504014+0000","last_fullsized":"2024-09-12T01:11:22.504014+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:22.407452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'131","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.215109+0000","last_change":"2024-09-12T00:30:21.190459+0000","last_active":"2024-09-12T01:09:31.215109+0000","last_peered":"2024-09-12T01:09:31.215109+0000","last_clean":"2024-09-12T01:09:31.215109+0000","last_became_active":"2024-09-12T00:30:21.190151+0000","last_became_peered":"2024-09-12T00:30:21.190151+0000","last_unstale":"2024-09-12T01:09:31.215109+0000","last_undegraded":"2024-09-12T01:09:31.215109+0000","last_fullsized":"2024-09-12T01:09:31.215109+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:54.921241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'111","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489533+0000","last_change":"2024-09-12T00:30:13.124415+0000","last_active":"2024-09-12T01:07:46.489533+0000","last_peered":"2024-09-12T01:07:46.489533+0000","last_clean":"2024-09-12T01:07:46.489533+0000","last_became_active":"2024-09-12T00:30:13.124167+0000","last_became_peered":"2024-09-12T00:30:13.124167+0000","last_unstale":"2024-09-12T01:07:46.489533+0000","last_undegraded":"2024-09-12T01:07:46.489533+0000","last_fullsized":"2024-09-12T01:07:46.489533+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:40.559024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":425,"num_write":152,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'404","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.415150+0000","last_change":"2024-09-12T00:30:11.109569+0000","last_active":"2024-09-12T01:11:23.415150+0000","last_peered":"2024-09-12T01:11:23.415150+0000","last_clean":"2024-09-12T01:11:23.415150+0000","last_became_active":"2024-09-12T00:30:11.108422+0000","last_became_peered":"2024-09-12T00:30:11.108422+0000","last_unstale":"2024-09-12T01:11:23.415150+0000","last_undegraded":"2024-09-12T01:11:23.415150+0000","last_fullsized":"2024-09-12T01:11:23.415150+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:38.097953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345472,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":814,"num_read_kb":2763,"num_write":1276,"num_write_kb":29562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.400338+0000","last_change":"2024-09-12T00:30:15.125457+0000","last_active":"2024-09-12T01:07:48.400338+0000","last_peered":"2024-09-12T01:07:48.400338+0000","last_clean":"2024-09-12T01:07:48.400338+0000","last_became_active":"2024-09-12T00:30:15.124922+0000","last_became_peered":"2024-09-12T00:30:15.124922+0000","last_unstale":"2024-09-12T01:07:48.400338+0000","last_undegraded":"2024-09-12T01:07:48.400338+0000","last_fullsized":"2024-09-12T01:07:48.400338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:27.550117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'346","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.452379+0000","last_change":"2024-09-12T00:30:17.149283+0000","last_active":"2024-09-12T01:10:51.452379+0000","last_peered":"2024-09-12T01:10:51.452379+0000","last_clean":"2024-09-12T01:10:51.452379+0000","last_became_active":"2024-09-12T00:30:17.148793+0000","last_became_peered":"2024-09-12T00:30:17.148793+0000","last_unstale":"2024-09-12T01:10:51.452379+0000","last_undegraded":"2024-09-12T01:10:51.452379+0000","last_fullsized":"2024-09-12T01:10:51.452379+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:33.498700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81032,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1086,"num_write":448,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:37.500323+0000","last_change":"2024-09-12T00:30:19.170247+0000","last_active":"2024-09-12T01:06:37.500323+0000","last_peered":"2024-09-12T01:06:37.500323+0000","last_clean":"2024-09-12T01:06:37.500323+0000","last_became_active":"2024-09-12T00:30:19.169982+0000","last_became_peered":"2024-09-12T00:30:19.169982+0000","last_unstale":"2024-09-12T01:06:37.500323+0000","last_undegraded":"2024-09-12T01:06:37.500323+0000","last_fullsized":"2024-09-12T01:06:37.500323+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'144","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.849786+0000","last_change":"2024-09-12T00:30:21.187973+0000","last_active":"2024-09-12T01:09:32.849786+0000","last_peered":"2024-09-12T01:09:32.849786+0000","last_clean":"2024-09-12T01:09:32.849786+0000","last_became_active":"2024-09-12T00:30:21.187641+0000","last_became_peered":"2024-09-12T00:30:21.187641+0000","last_unstale":"2024-09-12T01:09:32.849786+0000","last_undegraded":"2024-09-12T01:09:32.849786+0000","last_fullsized":"2024-09-12T01:09:32.849786+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:39.449383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":136,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'194","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.088663+0000","last_change":"2024-09-12T00:30:13.123094+0000","last_active":"2024-09-12T01:09:27.088663+0000","last_peered":"2024-09-12T01:09:27.088663+0000","last_clean":"2024-09-12T01:09:27.088663+0000","last_became_active":"2024-09-12T00:30:13.122622+0000","last_became_peered":"2024-09-12T00:30:13.122622+0000","last_unstale":"2024-09-12T01:09:27.088663+0000","last_undegraded":"2024-09-12T01:09:27.088663+0000","last_fullsized":"2024-09-12T01:09:27.088663+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:35.254290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":295,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'302","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.405819+0000","last_change":"2024-09-12T00:30:11.110375+0000","last_active":"2024-09-12T01:11:23.405819+0000","last_peered":"2024-09-12T01:11:23.405819+0000","last_clean":"2024-09-12T01:11:23.405819+0000","last_became_active":"2024-09-12T00:30:11.109855+0000","last_became_peered":"2024-09-12T00:30:11.109855+0000","last_unstale":"2024-09-12T01:11:23.405819+0000","last_undegraded":"2024-09-12T01:11:23.405819+0000","last_fullsized":"2024-09-12T01:11:23.405819+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:19.550416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1639977,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":575,"num_read_kb":64470,"num_write":1004,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489543+0000","last_change":"2024-09-12T00:30:15.126170+0000","last_active":"2024-09-12T01:07:46.489543+0000","last_peered":"2024-09-12T01:07:46.489543+0000","last_clean":"2024-09-12T01:07:46.489543+0000","last_became_active":"2024-09-12T00:30:15.125870+0000","last_became_peered":"2024-09-12T00:30:15.125870+0000","last_unstale":"2024-09-12T01:07:46.489543+0000","last_undegraded":"2024-09-12T01:07:46.489543+0000","last_fullsized":"2024-09-12T01:07:46.489543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:51.538427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'273","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.516204+0000","last_change":"2024-09-12T00:30:17.149628+0000","last_active":"2024-09-12T01:11:22.516204+0000","last_peered":"2024-09-12T01:11:22.516204+0000","last_clean":"2024-09-12T01:11:22.516204+0000","last_became_active":"2024-09-12T00:30:17.149226+0000","last_became_peered":"2024-09-12T00:30:17.149226+0000","last_unstale":"2024-09-12T01:11:22.516204+0000","last_undegraded":"2024-09-12T01:11:22.516204+0000","last_fullsized":"2024-09-12T01:11:22.516204+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:10.554142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":439,"num_read_kb":908,"num_write":362,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:38.585722+0000","last_change":"2024-09-12T00:30:19.164875+0000","last_active":"2024-09-12T01:06:38.585722+0000","last_peered":"2024-09-12T01:06:38.585722+0000","last_clean":"2024-09-12T01:06:38.585722+0000","last_became_active":"2024-09-12T00:30:19.164556+0000","last_became_peered":"2024-09-12T00:30:19.164556+0000","last_unstale":"2024-09-12T01:06:38.585722+0000","last_undegraded":"2024-09-12T01:06:38.585722+0000","last_fullsized":"2024-09-12T01:06:38.585722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:05.138428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'135","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.064016+0000","last_change":"2024-09-12T00:30:21.193857+0000","last_active":"2024-09-12T01:09:09.064016+0000","last_peered":"2024-09-12T01:09:09.064016+0000","last_clean":"2024-09-12T01:09:09.064016+0000","last_became_active":"2024-09-12T00:30:21.193606+0000","last_became_peered":"2024-09-12T00:30:21.193606+0000","last_unstale":"2024-09-12T01:09:09.064016+0000","last_undegraded":"2024-09-12T01:09:09.064016+0000","last_fullsized":"2024-09-12T01:09:09.064016+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:56.806530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":946,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":239,"num_write":347,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'4096","reported_seq":4671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.218622+0000","last_change":"2024-09-12T00:30:13.121220+0000","last_active":"2024-09-12T01:09:12.218622+0000","last_peered":"2024-09-12T01:09:12.218622+0000","last_clean":"2024-09-12T01:09:12.218622+0000","last_became_active":"2024-09-12T00:30:13.120940+0000","last_became_peered":"2024-09-12T00:30:13.120940+0000","last_unstale":"2024-09-12T01:09:12.218622+0000","last_undegraded":"2024-09-12T01:09:12.218622+0000","last_fullsized":"2024-09-12T01:09:12.218622+0000","mapping_epoch":28,"log_start":"264'4000","ondisk_log_start":"264'4000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.657138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16459,"num_read_kb":13812,"num_write":6134,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'290","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.722385+0000","last_change":"2024-09-12T00:30:11.099270+0000","last_active":"2024-09-12T01:09:31.722385+0000","last_peered":"2024-09-12T01:09:31.722385+0000","last_clean":"2024-09-12T01:09:31.722385+0000","last_became_active":"2024-09-12T00:30:11.098879+0000","last_became_peered":"2024-09-12T00:30:11.098879+0000","last_unstale":"2024-09-12T01:09:31.722385+0000","last_undegraded":"2024-09-12T01:09:31.722385+0000","last_fullsized":"2024-09-12T01:09:31.722385+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:03.440870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18151009,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":534,"num_read_kb":44110,"num_write":978,"num_write_kb":43739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409893+0000","last_change":"2024-09-12T00:30:15.125790+0000","last_active":"2024-09-12T01:08:58.409893+0000","last_peered":"2024-09-12T01:08:58.409893+0000","last_clean":"2024-09-12T01:08:58.409893+0000","last_became_active":"2024-09-12T00:30:15.125452+0000","last_became_peered":"2024-09-12T00:30:15.125452+0000","last_unstale":"2024-09-12T01:08:58.409893+0000","last_undegraded":"2024-09-12T01:08:58.409893+0000","last_fullsized":"2024-09-12T01:08:58.409893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:30.616035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'229","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.097745+0000","last_change":"2024-09-12T00:30:17.146683+0000","last_active":"2024-09-12T01:10:26.097745+0000","last_peered":"2024-09-12T01:10:26.097745+0000","last_clean":"2024-09-12T01:10:26.097745+0000","last_became_active":"2024-09-12T00:30:17.145961+0000","last_became_peered":"2024-09-12T00:30:17.145961+0000","last_unstale":"2024-09-12T01:10:26.097745+0000","last_undegraded":"2024-09-12T01:10:26.097745+0000","last_fullsized":"2024-09-12T01:10:26.097745+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:39.502275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44597,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":363,"num_read_kb":767,"num_write":298,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596405+0000","last_change":"2024-09-12T00:30:19.168010+0000","last_active":"2024-09-12T01:07:48.596405+0000","last_peered":"2024-09-12T01:07:48.596405+0000","last_clean":"2024-09-12T01:07:48.596405+0000","last_became_active":"2024-09-12T00:30:19.167723+0000","last_became_peered":"2024-09-12T00:30:19.167723+0000","last_unstale":"2024-09-12T01:07:48.596405+0000","last_undegraded":"2024-09-12T01:07:48.596405+0000","last_fullsized":"2024-09-12T01:07:48.596405+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:31.864085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'170","reported_seq":1613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:44.737494+0000","last_change":"2024-09-12T00:30:21.188654+0000","last_active":"2024-09-12T01:09:44.737494+0000","last_peered":"2024-09-12T01:09:44.737494+0000","last_clean":"2024-09-12T01:09:44.737494+0000","last_became_active":"2024-09-12T00:30:21.188363+0000","last_became_peered":"2024-09-12T00:30:21.188363+0000","last_unstale":"2024-09-12T01:09:44.737494+0000","last_undegraded":"2024-09-12T01:09:44.737494+0000","last_fullsized":"2024-09-12T01:09:44.737494+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:40.099921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1158,"num_read_kb":1157,"num_write":386,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'184","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.498641+0000","last_change":"2024-09-12T00:30:13.126020+0000","last_active":"2024-09-12T01:08:56.498641+0000","last_peered":"2024-09-12T01:08:56.498641+0000","last_clean":"2024-09-12T01:08:56.498641+0000","last_became_active":"2024-09-12T00:30:13.125727+0000","last_became_peered":"2024-09-12T00:30:13.125727+0000","last_unstale":"2024-09-12T01:08:56.498641+0000","last_undegraded":"2024-09-12T01:08:56.498641+0000","last_fullsized":"2024-09-12T01:08:56.498641+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:09.160490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":704,"num_write":275,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'257","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.754496+0000","last_change":"2024-09-12T00:30:11.092275+0000","last_active":"2024-09-12T01:09:43.754496+0000","last_peered":"2024-09-12T01:09:43.754496+0000","last_clean":"2024-09-12T01:09:43.754496+0000","last_became_active":"2024-09-12T00:30:11.091808+0000","last_became_peered":"2024-09-12T00:30:11.091808+0000","last_unstale":"2024-09-12T01:09:43.754496+0000","last_undegraded":"2024-09-12T01:09:43.754496+0000","last_fullsized":"2024-09-12T01:09:43.754496+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:26.055957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13691604,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":368,"num_read_kb":10677,"num_write":922,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:37.500363+0000","last_change":"2024-09-12T00:30:15.127289+0000","last_active":"2024-09-12T01:06:37.500363+0000","last_peered":"2024-09-12T01:06:37.500363+0000","last_clean":"2024-09-12T01:06:37.500363+0000","last_became_active":"2024-09-12T00:30:15.126206+0000","last_became_peered":"2024-09-12T00:30:15.126206+0000","last_unstale":"2024-09-12T01:06:37.500363+0000","last_undegraded":"2024-09-12T01:06:37.500363+0000","last_fullsized":"2024-09-12T01:06:37.500363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:39.699331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'298","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.484314+0000","last_change":"2024-09-12T00:30:17.145025+0000","last_active":"2024-09-12T01:10:51.484314+0000","last_peered":"2024-09-12T01:10:51.484314+0000","last_clean":"2024-09-12T01:10:51.484314+0000","last_became_active":"2024-09-12T00:30:17.144724+0000","last_became_peered":"2024-09-12T00:30:17.144724+0000","last_unstale":"2024-09-12T01:10:51.484314+0000","last_undegraded":"2024-09-12T01:10:51.484314+0000","last_fullsized":"2024-09-12T01:10:51.484314+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:32.229866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56482,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":949,"num_write":392,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511636+0000","last_change":"2024-09-12T00:30:19.172540+0000","last_active":"2024-09-12T01:07:52.511636+0000","last_peered":"2024-09-12T01:07:52.511636+0000","last_clean":"2024-09-12T01:07:52.511636+0000","last_became_active":"2024-09-12T00:30:19.172265+0000","last_became_peered":"2024-09-12T00:30:19.172265+0000","last_unstale":"2024-09-12T01:07:52.511636+0000","last_undegraded":"2024-09-12T01:07:52.511636+0000","last_fullsized":"2024-09-12T01:07:52.511636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:34.189913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'129","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.303430+0000","last_change":"2024-09-12T00:30:21.192137+0000","last_active":"2024-09-12T01:10:50.303430+0000","last_peered":"2024-09-12T01:10:50.303430+0000","last_clean":"2024-09-12T01:10:50.303430+0000","last_became_active":"2024-09-12T00:30:21.191837+0000","last_became_peered":"2024-09-12T00:30:21.191837+0000","last_unstale":"2024-09-12T01:10:50.303430+0000","last_undegraded":"2024-09-12T01:10:50.303430+0000","last_fullsized":"2024-09-12T01:10:50.303430+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:51.812234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":99,"num_write":307,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'142","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.522841+0000","last_change":"2024-09-12T00:30:13.122097+0000","last_active":"2024-09-12T01:09:12.522841+0000","last_peered":"2024-09-12T01:09:12.522841+0000","last_clean":"2024-09-12T01:09:12.522841+0000","last_became_active":"2024-09-12T00:30:13.121828+0000","last_became_peered":"2024-09-12T00:30:13.121828+0000","last_unstale":"2024-09-12T01:09:12.522841+0000","last_undegraded":"2024-09-12T01:09:12.522841+0000","last_fullsized":"2024-09-12T01:09:12.522841+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.165397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":656,"num_read_kb":543,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'307","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.172050+0000","last_change":"2024-09-12T00:30:11.106219+0000","last_active":"2024-09-12T01:09:22.172050+0000","last_peered":"2024-09-12T01:09:22.172050+0000","last_clean":"2024-09-12T01:09:22.172050+0000","last_became_active":"2024-09-12T00:30:11.105480+0000","last_became_peered":"2024-09-12T00:30:11.105480+0000","last_unstale":"2024-09-12T01:09:22.172050+0000","last_undegraded":"2024-09-12T01:09:22.172050+0000","last_fullsized":"2024-09-12T01:09:22.172050+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:30.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6161693,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":716,"num_read_kb":27112,"num_write":1158,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'88","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:25.698914+0000","last_change":"2024-09-12T00:30:13.130762+0000","last_active":"2024-09-12T01:09:25.698914+0000","last_peered":"2024-09-12T01:09:25.698914+0000","last_clean":"2024-09-12T01:09:25.698914+0000","last_became_active":"2024-09-12T00:30:13.130421+0000","last_became_peered":"2024-09-12T00:30:13.130421+0000","last_unstale":"2024-09-12T01:09:25.698914+0000","last_undegraded":"2024-09-12T01:09:25.698914+0000","last_fullsized":"2024-09-12T01:09:25.698914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:30.693777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":312,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'307","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.399705+0000","last_change":"2024-09-12T00:30:11.092694+0000","last_active":"2024-09-12T01:11:23.399705+0000","last_peered":"2024-09-12T01:11:23.399705+0000","last_clean":"2024-09-12T01:11:23.399705+0000","last_became_active":"2024-09-12T00:30:11.092318+0000","last_became_peered":"2024-09-12T00:30:11.092318+0000","last_unstale":"2024-09-12T01:11:23.399705+0000","last_undegraded":"2024-09-12T01:11:23.399705+0000","last_fullsized":"2024-09-12T01:11:23.399705+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:49.888269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4851765,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":385,"num_read_kb":12148,"num_write":1029,"num_write_kb":57585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'403","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.766486+0000","last_change":"2024-09-12T00:30:13.127156+0000","last_active":"2024-09-12T01:09:27.766486+0000","last_peered":"2024-09-12T01:09:27.766486+0000","last_clean":"2024-09-12T01:09:27.766486+0000","last_became_active":"2024-09-12T00:30:13.126912+0000","last_became_peered":"2024-09-12T00:30:13.126912+0000","last_unstale":"2024-09-12T01:09:27.766486+0000","last_undegraded":"2024-09-12T01:09:27.766486+0000","last_fullsized":"2024-09-12T01:09:27.766486+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:42.227244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1731,"num_read_kb":1377,"num_write":679,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'387","reported_seq":1048,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.556410+0000","last_change":"2024-09-12T00:30:11.099450+0000","last_active":"2024-09-12T01:11:23.556410+0000","last_peered":"2024-09-12T01:11:23.556410+0000","last_clean":"2024-09-12T01:11:23.556410+0000","last_became_active":"2024-09-12T00:30:11.099069+0000","last_became_peered":"2024-09-12T00:30:11.099069+0000","last_unstale":"2024-09-12T01:11:23.556410+0000","last_undegraded":"2024-09-12T01:11:23.556410+0000","last_fullsized":"2024-09-12T01:11:23.556410+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:15.083942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20449928,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":648,"num_read_kb":70901,"num_write":1239,"num_write_kb":51705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'117","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.482213+0000","last_change":"2024-09-12T00:30:13.127130+0000","last_active":"2024-09-12T01:09:12.482213+0000","last_peered":"2024-09-12T01:09:12.482213+0000","last_clean":"2024-09-12T01:09:12.482213+0000","last_became_active":"2024-09-12T00:30:13.126860+0000","last_became_peered":"2024-09-12T00:30:13.126860+0000","last_unstale":"2024-09-12T01:09:12.482213+0000","last_undegraded":"2024-09-12T01:09:12.482213+0000","last_fullsized":"2024-09-12T01:09:12.482213+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:11.846692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":463,"num_write":200,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'271","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:44.896946+0000","last_change":"2024-09-12T00:30:11.105582+0000","last_active":"2024-09-12T01:08:44.896946+0000","last_peered":"2024-09-12T01:08:44.896946+0000","last_clean":"2024-09-12T01:08:44.896946+0000","last_became_active":"2024-09-12T00:30:11.105196+0000","last_became_peered":"2024-09-12T00:30:11.105196+0000","last_unstale":"2024-09-12T01:08:44.896946+0000","last_undegraded":"2024-09-12T01:08:44.896946+0000","last_fullsized":"2024-09-12T01:08:44.896946+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:05.512265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4571982,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":405,"num_read_kb":8471,"num_write":945,"num_write_kb":46203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'4191","reported_seq":4832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.275772+0000","last_change":"2024-09-12T00:30:13.125779+0000","last_active":"2024-09-12T01:09:46.275772+0000","last_peered":"2024-09-12T01:09:46.275772+0000","last_clean":"2024-09-12T01:09:46.275772+0000","last_became_active":"2024-09-12T00:30:13.125353+0000","last_became_peered":"2024-09-12T00:30:13.125353+0000","last_unstale":"2024-09-12T01:09:46.275772+0000","last_undegraded":"2024-09-12T01:09:46.275772+0000","last_fullsized":"2024-09-12T01:09:46.275772+0000","mapping_epoch":28,"log_start":"264'4100","ondisk_log_start":"264'4100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":3000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:27.342797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16885,"num_read_kb":14166,"num_write":6282,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'310","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.392972+0000","last_change":"2024-09-12T00:30:11.108515+0000","last_active":"2024-09-12T01:09:12.392972+0000","last_peered":"2024-09-12T01:09:12.392972+0000","last_clean":"2024-09-12T01:09:12.392972+0000","last_became_active":"2024-09-12T00:30:11.108127+0000","last_became_peered":"2024-09-12T00:30:11.108127+0000","last_unstale":"2024-09-12T01:09:12.392972+0000","last_undegraded":"2024-09-12T01:09:12.392972+0000","last_fullsized":"2024-09-12T01:09:12.392972+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:39.466509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7349140,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":396,"num_read_kb":2771,"num_write":1025,"num_write_kb":29841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'185","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.516867+0000","last_change":"2024-09-12T00:30:13.129689+0000","last_active":"2024-09-12T01:07:43.516867+0000","last_peered":"2024-09-12T01:07:43.516867+0000","last_clean":"2024-09-12T01:07:43.516867+0000","last_became_active":"2024-09-12T00:30:13.129432+0000","last_became_peered":"2024-09-12T00:30:13.129432+0000","last_unstale":"2024-09-12T01:07:43.516867+0000","last_undegraded":"2024-09-12T01:07:43.516867+0000","last_fullsized":"2024-09-12T01:07:43.516867+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:23.760718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":694,"num_write":316,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'306","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:46.120237+0000","last_change":"2024-09-12T00:30:11.108733+0000","last_active":"2024-09-12T01:10:46.120237+0000","last_peered":"2024-09-12T01:10:46.120237+0000","last_clean":"2024-09-12T01:10:46.120237+0000","last_became_active":"2024-09-12T00:30:11.108351+0000","last_became_peered":"2024-09-12T00:30:11.108351+0000","last_unstale":"2024-09-12T01:10:46.120237+0000","last_undegraded":"2024-09-12T01:10:46.120237+0000","last_fullsized":"2024-09-12T01:10:46.120237+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:25.752418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5893721,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":609,"num_read_kb":30774,"num_write":1189,"num_write_kb":36026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'163","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.830877+0000","last_change":"2024-09-12T00:30:13.124976+0000","last_active":"2024-09-12T01:08:14.830877+0000","last_peered":"2024-09-12T01:08:14.830877+0000","last_clean":"2024-09-12T01:08:14.830877+0000","last_became_active":"2024-09-12T00:30:13.124637+0000","last_became_peered":"2024-09-12T00:30:13.124637+0000","last_unstale":"2024-09-12T01:08:14.830877+0000","last_undegraded":"2024-09-12T01:08:14.830877+0000","last_fullsized":"2024-09-12T01:08:14.830877+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:27.099393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":588,"num_write":241,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'307","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.749414+0000","last_change":"2024-09-12T00:30:11.110962+0000","last_active":"2024-09-12T01:09:43.749414+0000","last_peered":"2024-09-12T01:09:43.749414+0000","last_clean":"2024-09-12T01:09:43.749414+0000","last_became_active":"2024-09-12T00:30:11.108084+0000","last_became_peered":"2024-09-12T00:30:11.108084+0000","last_unstale":"2024-09-12T01:09:43.749414+0000","last_undegraded":"2024-09-12T01:09:43.749414+0000","last_fullsized":"2024-09-12T01:09:43.749414+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:46.496743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5227247,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":551,"num_read_kb":11433,"num_write":1172,"num_write_kb":28830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'237","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.819696+0000","last_change":"2024-09-12T00:30:13.129156+0000","last_active":"2024-09-12T01:09:46.819696+0000","last_peered":"2024-09-12T01:09:46.819696+0000","last_clean":"2024-09-12T01:09:46.819696+0000","last_became_active":"2024-09-12T00:30:13.128799+0000","last_became_peered":"2024-09-12T00:30:13.128799+0000","last_unstale":"2024-09-12T01:09:46.819696+0000","last_undegraded":"2024-09-12T01:09:46.819696+0000","last_fullsized":"2024-09-12T01:09:46.819696+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:02.256587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":871,"num_write":360,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'278","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.795326+0000","last_change":"2024-09-12T00:30:11.103076+0000","last_active":"2024-09-12T01:09:28.795326+0000","last_peered":"2024-09-12T01:09:28.795326+0000","last_clean":"2024-09-12T01:09:28.795326+0000","last_became_active":"2024-09-12T00:30:11.102617+0000","last_became_peered":"2024-09-12T00:30:11.102617+0000","last_unstale":"2024-09-12T01:09:28.795326+0000","last_undegraded":"2024-09-12T01:09:28.795326+0000","last_fullsized":"2024-09-12T01:09:28.795326+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11054816,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":401,"num_read_kb":18669,"num_write":949,"num_write_kb":28835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'52","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.491391+0000","last_change":"2024-09-12T00:30:13.123470+0000","last_active":"2024-09-12T01:08:22.491391+0000","last_peered":"2024-09-12T01:08:22.491391+0000","last_clean":"2024-09-12T01:08:22.491391+0000","last_became_active":"2024-09-12T00:30:13.123035+0000","last_became_peered":"2024-09-12T00:30:13.123035+0000","last_unstale":"2024-09-12T01:08:22.491391+0000","last_undegraded":"2024-09-12T01:08:22.491391+0000","last_fullsized":"2024-09-12T01:08:22.491391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.860214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":222,"num_write":77,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'300","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.517801+0000","last_change":"2024-09-12T00:30:11.112796+0000","last_active":"2024-09-12T01:11:23.517801+0000","last_peered":"2024-09-12T01:11:23.517801+0000","last_clean":"2024-09-12T01:11:23.517801+0000","last_became_active":"2024-09-12T00:30:11.110299+0000","last_became_peered":"2024-09-12T00:30:11.110299+0000","last_unstale":"2024-09-12T01:11:23.517801+0000","last_undegraded":"2024-09-12T01:11:23.517801+0000","last_fullsized":"2024-09-12T01:11:23.517801+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:24.673935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4218838,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":407,"num_read_kb":30015,"num_write":1010,"num_write_kb":30187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'180","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.132211+0000","last_change":"2024-09-12T00:30:13.124078+0000","last_active":"2024-09-12T01:09:12.132211+0000","last_peered":"2024-09-12T01:09:12.132211+0000","last_clean":"2024-09-12T01:09:12.132211+0000","last_became_active":"2024-09-12T00:30:13.123217+0000","last_became_peered":"2024-09-12T00:30:13.123217+0000","last_unstale":"2024-09-12T01:09:12.132211+0000","last_undegraded":"2024-09-12T01:09:12.132211+0000","last_fullsized":"2024-09-12T01:09:12.132211+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:27.761815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":608,"num_write":257,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'267","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475274+0000","last_change":"2024-09-12T00:30:11.103101+0000","last_active":"2024-09-12T01:08:27.475274+0000","last_peered":"2024-09-12T01:08:27.475274+0000","last_clean":"2024-09-12T01:08:27.475274+0000","last_became_active":"2024-09-12T00:30:11.102436+0000","last_became_peered":"2024-09-12T00:30:11.102436+0000","last_unstale":"2024-09-12T01:08:27.475274+0000","last_undegraded":"2024-09-12T01:08:27.475274+0000","last_fullsized":"2024-09-12T01:08:27.475274+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:41.189010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7688011,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":458,"num_read_kb":79108,"num_write":1057,"num_write_kb":40469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'217","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.852926+0000","last_change":"2024-09-12T00:30:13.130944+0000","last_active":"2024-09-12T01:09:32.852926+0000","last_peered":"2024-09-12T01:09:32.852926+0000","last_clean":"2024-09-12T01:09:32.852926+0000","last_became_active":"2024-09-12T00:30:13.129733+0000","last_became_peered":"2024-09-12T00:30:13.129733+0000","last_unstale":"2024-09-12T01:09:32.852926+0000","last_undegraded":"2024-09-12T01:09:32.852926+0000","last_fullsized":"2024-09-12T01:09:32.852926+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.671267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":953,"num_read_kb":786,"num_write":335,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'345","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.387259+0000","last_change":"2024-09-12T00:30:11.106483+0000","last_active":"2024-09-12T01:11:23.387259+0000","last_peered":"2024-09-12T01:11:23.387259+0000","last_clean":"2024-09-12T01:11:23.387259+0000","last_became_active":"2024-09-12T00:30:11.105950+0000","last_became_peered":"2024-09-12T00:30:11.105950+0000","last_unstale":"2024-09-12T01:11:23.387259+0000","last_undegraded":"2024-09-12T01:11:23.387259+0000","last_fullsized":"2024-09-12T01:11:23.387259+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:12.198729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8540255,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":552,"num_read_kb":20760,"num_write":1305,"num_write_kb":32414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'172","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.452544+0000","last_change":"2024-09-12T00:30:13.128272+0000","last_active":"2024-09-12T01:09:33.452544+0000","last_peered":"2024-09-12T01:09:33.452544+0000","last_clean":"2024-09-12T01:09:33.452544+0000","last_became_active":"2024-09-12T00:30:13.128009+0000","last_became_peered":"2024-09-12T00:30:13.128009+0000","last_unstale":"2024-09-12T01:09:33.452544+0000","last_undegraded":"2024-09-12T01:09:33.452544+0000","last_fullsized":"2024-09-12T01:09:33.452544+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:55.279618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":738,"num_read_kb":604,"num_write":258,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'329","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:42.536640+0000","last_change":"2024-09-12T00:30:11.097300+0000","last_active":"2024-09-12T01:10:42.536640+0000","last_peered":"2024-09-12T01:10:42.536640+0000","last_clean":"2024-09-12T01:10:42.536640+0000","last_became_active":"2024-09-12T00:30:11.096908+0000","last_became_peered":"2024-09-12T00:30:11.096908+0000","last_unstale":"2024-09-12T01:10:42.536640+0000","last_undegraded":"2024-09-12T01:10:42.536640+0000","last_fullsized":"2024-09-12T01:10:42.536640+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:48.080479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8750206,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":529,"num_read_kb":27822,"num_write":1259,"num_write_kb":35997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'129","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.405828+0000","last_change":"2024-09-12T00:30:13.127092+0000","last_active":"2024-09-12T01:08:28.405828+0000","last_peered":"2024-09-12T01:08:28.405828+0000","last_clean":"2024-09-12T01:08:28.405828+0000","last_became_active":"2024-09-12T00:30:13.126817+0000","last_became_peered":"2024-09-12T00:30:13.126817+0000","last_unstale":"2024-09-12T01:08:28.405828+0000","last_undegraded":"2024-09-12T01:08:28.405828+0000","last_fullsized":"2024-09-12T01:08:28.405828+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.950480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":588,"num_read_kb":486,"num_write":195,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'304","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.446448+0000","last_change":"2024-09-12T00:30:11.105919+0000","last_active":"2024-09-12T01:11:23.446448+0000","last_peered":"2024-09-12T01:11:23.446448+0000","last_clean":"2024-09-12T01:11:23.446448+0000","last_became_active":"2024-09-12T00:30:11.105575+0000","last_became_peered":"2024-09-12T00:30:11.105575+0000","last_unstale":"2024-09-12T01:11:23.446448+0000","last_undegraded":"2024-09-12T01:11:23.446448+0000","last_fullsized":"2024-09-12T01:11:23.446448+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:20.050929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10282395,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":548,"num_read_kb":45130,"num_write":1123,"num_write_kb":46621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'202","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.432143+0000","last_change":"2024-09-12T00:30:13.129377+0000","last_active":"2024-09-12T01:09:03.432143+0000","last_peered":"2024-09-12T01:09:03.432143+0000","last_clean":"2024-09-12T01:09:03.432143+0000","last_became_active":"2024-09-12T00:30:13.129092+0000","last_became_peered":"2024-09-12T00:30:13.129092+0000","last_unstale":"2024-09-12T01:09:03.432143+0000","last_undegraded":"2024-09-12T01:09:03.432143+0000","last_fullsized":"2024-09-12T01:09:03.432143+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:03.194905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":854,"num_read_kb":707,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'314","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.579292+0000","last_change":"2024-09-12T00:30:11.109364+0000","last_active":"2024-09-12T01:11:23.579292+0000","last_peered":"2024-09-12T01:11:23.579292+0000","last_clean":"2024-09-12T01:11:23.579292+0000","last_became_active":"2024-09-12T00:30:11.108616+0000","last_became_peered":"2024-09-12T00:30:11.108616+0000","last_unstale":"2024-09-12T01:11:23.579292+0000","last_undegraded":"2024-09-12T01:11:23.579292+0000","last_fullsized":"2024-09-12T01:11:23.579292+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:22.828086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505504,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":922,"num_read_kb":21858,"num_write":1119,"num_write_kb":27958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'147","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516270+0000","last_change":"2024-09-12T00:30:13.127131+0000","last_active":"2024-09-12T01:08:27.516270+0000","last_peered":"2024-09-12T01:08:27.516270+0000","last_clean":"2024-09-12T01:08:27.516270+0000","last_became_active":"2024-09-12T00:30:13.125887+0000","last_became_peered":"2024-09-12T00:30:13.125887+0000","last_unstale":"2024-09-12T01:08:27.516270+0000","last_undegraded":"2024-09-12T01:08:27.516270+0000","last_fullsized":"2024-09-12T01:08:27.516270+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:40.857952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":559,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'294","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.378697+0000","last_change":"2024-09-12T00:30:46.396636+0000","last_active":"2024-09-12T01:11:23.378697+0000","last_peered":"2024-09-12T01:11:23.378697+0000","last_clean":"2024-09-12T01:11:23.378697+0000","last_became_active":"2024-09-12T00:30:46.396288+0000","last_became_peered":"2024-09-12T00:30:46.396288+0000","last_unstale":"2024-09-12T01:11:23.378697+0000","last_undegraded":"2024-09-12T01:11:23.378697+0000","last_fullsized":"2024-09-12T01:11:23.378697+0000","mapping_epoch":39,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:48.101790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10096145,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":500,"num_read_kb":21012,"num_write":1019,"num_write_kb":30668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'249","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.546201+0000","last_change":"2024-09-12T00:30:13.127777+0000","last_active":"2024-09-12T01:09:43.546201+0000","last_peered":"2024-09-12T01:09:43.546201+0000","last_clean":"2024-09-12T01:09:43.546201+0000","last_became_active":"2024-09-12T00:30:13.127513+0000","last_became_peered":"2024-09-12T00:30:13.127513+0000","last_unstale":"2024-09-12T01:09:43.546201+0000","last_undegraded":"2024-09-12T01:09:43.546201+0000","last_fullsized":"2024-09-12T01:09:43.546201+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:22.047664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":791,"num_write":358,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'299","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.550256+0000","last_change":"2024-09-12T00:30:11.110035+0000","last_active":"2024-09-12T01:11:23.550256+0000","last_peered":"2024-09-12T01:11:23.550256+0000","last_clean":"2024-09-12T01:11:23.550256+0000","last_became_active":"2024-09-12T00:30:11.109661+0000","last_became_peered":"2024-09-12T00:30:11.109661+0000","last_unstale":"2024-09-12T01:11:23.550256+0000","last_undegraded":"2024-09-12T01:11:23.550256+0000","last_fullsized":"2024-09-12T01:11:23.550256+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:51.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8646628,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":422,"num_read_kb":8210,"num_write":1051,"num_write_kb":36173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'284","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.578179+0000","last_change":"2024-09-12T00:30:11.113547+0000","last_active":"2024-09-12T01:11:23.578179+0000","last_peered":"2024-09-12T01:11:23.578179+0000","last_clean":"2024-09-12T01:11:23.578179+0000","last_became_active":"2024-09-12T00:30:11.113173+0000","last_became_peered":"2024-09-12T00:30:11.113173+0000","last_unstale":"2024-09-12T01:11:23.578179+0000","last_undegraded":"2024-09-12T01:11:23.578179+0000","last_fullsized":"2024-09-12T01:11:23.578179+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:20.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8387571,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":453,"num_read_kb":50214,"num_write":1026,"num_write_kb":47204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'24","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.520781+0000","last_change":"2024-09-12T00:30:13.126552+0000","last_active":"2024-09-12T01:08:57.520781+0000","last_peered":"2024-09-12T01:08:57.520781+0000","last_clean":"2024-09-12T01:08:57.520781+0000","last_became_active":"2024-09-12T00:30:13.126264+0000","last_became_peered":"2024-09-12T00:30:13.126264+0000","last_unstale":"2024-09-12T01:08:57.520781+0000","last_undegraded":"2024-09-12T01:08:57.520781+0000","last_fullsized":"2024-09-12T01:08:57.520781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:09.574554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":113,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'304","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.038387+0000","last_change":"2024-09-12T00:30:11.102417+0000","last_active":"2024-09-12T01:09:33.038387+0000","last_peered":"2024-09-12T01:09:33.038387+0000","last_clean":"2024-09-12T01:09:33.038387+0000","last_became_active":"2024-09-12T00:30:11.102026+0000","last_became_peered":"2024-09-12T00:30:11.102026+0000","last_unstale":"2024-09-12T01:09:33.038387+0000","last_undegraded":"2024-09-12T01:09:33.038387+0000","last_fullsized":"2024-09-12T01:09:33.038387+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:54.893481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5791192,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":599,"num_read_kb":9482,"num_write":1140,"num_write_kb":28977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'250","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.409374+0000","last_change":"2024-09-12T00:30:13.120189+0000","last_active":"2024-09-12T01:08:53.409374+0000","last_peered":"2024-09-12T01:08:53.409374+0000","last_clean":"2024-09-12T01:08:53.409374+0000","last_became_active":"2024-09-12T00:30:13.119872+0000","last_became_peered":"2024-09-12T00:30:13.119872+0000","last_unstale":"2024-09-12T01:08:53.409374+0000","last_undegraded":"2024-09-12T01:08:53.409374+0000","last_fullsized":"2024-09-12T01:08:53.409374+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:30.740866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":987,"num_write":428,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5946,"num_read_kb":4236,"num_write":1962,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1033,"ondisk_log_size":1033,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15005,"num_read_kb":14670,"num_write":16786,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1559,"ondisk_log_size":1559,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":653,"ondisk_log_size":653,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1834349,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17337,"num_read_kb":33944,"num_write":14556,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2678784,"data_stored":2188983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2120,"ondisk_log_size":2120,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2429,"num_read_kb":2894,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102018,"num_read_kb":85254,"num_write":36979,"num_write_kb":18604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4230,"ondisk_log_size":4230,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":484632839,"num_objects":3635,"num_object_clones":0,"num_object_copies":14540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3635,"num_whiteouts":0,"num_read":32867,"num_read_kb":1917388,"num_write":68791,"num_write_kb":2191736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":694988800,"data_stored":694988800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4493,"ondisk_log_size":4493,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59550535,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":139,"num_read_kb":170064,"num_write":163,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127492096,"data_stored":127481486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":53477376,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":141,"num_read_kb":168795,"num_write":167,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122466304,"data_stored":122460999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509946,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":360208,"kb_used_data":144384,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94011632,"statfs":{"total":96636764160,"available":96267911168,"internally_reserved":0,"allocated":147849216,"data_stored":145818234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":220985799},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509943,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398712,"kb_used_data":118920,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93973128,"statfs":{"total":96636764160,"available":96228483072,"internally_reserved":0,"allocated":121774080,"data_stored":119734403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509943,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":219716,"kb_used_data":89836,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94152124,"statfs":{"total":96636764160,"available":96411774976,"internally_reserved":0,"allocated":91992064,"data_stored":89952552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542648,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345276,"kb_used_data":137836,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94026564,"statfs":{"total":96636764160,"available":96283201536,"internally_reserved":0,"allocated":141144064,"data_stored":139135656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212400586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542647,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248136,"kb_used_data":148984,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94123704,"statfs":{"total":96636764160,"available":96382672896,"internally_reserved":0,"allocated":152559616,"data_stored":150532187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":101513671},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542645,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373592,"kb_used_data":148040,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93998248,"statfs":{"total":96636764160,"available":96254205952,"internally_reserved":0,"allocated":151592960,"data_stored":149551159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542648,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316856,"kb_used_data":127464,"kb_used_omap":1,"kb_used_meta":189374,"kb_avail":94054984,"statfs":{"total":96636764160,"available":96312303616,"internally_reserved":0,"allocated":130523136,"data_stored":128478045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":193919429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575351,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280840,"kb_used_data":155256,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94091000,"statfs":{"total":96636764160,"available":96349184000,"internally_reserved":0,"allocated":158982144,"data_stored":156982372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":70447104,"data_stored":70447104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65097728,"data_stored":65097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":124665856,"data_stored":124665856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":79831040,"data_stored":79831040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":108998656,"data_stored":108998656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98582528,"data_stored":98582528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83771392,"data_stored":83771392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63594496,"data_stored":63594496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":281248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":291285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":127269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":208702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":361226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":391794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":348198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":179261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15749120,"data_stored":15749120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13627392,"data_stored":13627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":10017451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23072768,"data_stored":23072768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24358912,"data_stored":24354972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14667776,"data_stored":14667776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9105408,"data_stored":9102833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14221312,"data_stored":14219947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6287360,"data_stored":6287360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6881280,"data_stored":6879915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24694784,"data_stored":24693419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39837696,"data_stored":39837696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17031168,"data_stored":17027228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:27.347 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:11:27.667 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:11:27.667 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":264,"fsid":"a5119e9a-d5dd-4b87-aa73-8e94e0fd509b","created":"2024-09-12T00:29:40.268728+0000","modified":"2024-09-12T00:56:53.979601+0000","last_up_change":"2024-09-12T00:29:52.428909+0000","last_in_change":"2024-09-12T00:29:42.616371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:29:53.309907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:29:58.459554+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:30:09.066888+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:30:11.409997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:30:13.279867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:30:15.183992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:30:17.155284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:30:19.232450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:44:36.300056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:46:15.104959+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:46:17.353081+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"261","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T00:56:51.742137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66ca4695-461e-4894-8262-9a5a269ebf19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6809","nonce":1437963911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6811","nonce":1437963911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6819","nonce":1437963911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1437963911},{"type":"v1","addr":"172.21.15.83:6815","nonce":1437963911}]},"public_addr":"172.21.15.83:6809/1437963911","cluster_addr":"172.21.15.83:6811/1437963911","heartbeat_back_addr":"172.21.15.83:6819/1437963911","heartbeat_front_addr":"172.21.15.83:6815/1437963911","state":["exists","up"]},{"osd":1,"uuid":"d8f74abe-19a0-42c6-a142-179b54a63203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6814","nonce":514291182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6818","nonce":514291182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6825","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6827","nonce":514291182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":514291182},{"type":"v1","addr":"172.21.15.83:6823","nonce":514291182}]},"public_addr":"172.21.15.83:6814/514291182","cluster_addr":"172.21.15.83:6818/514291182","heartbeat_back_addr":"172.21.15.83:6827/514291182","heartbeat_front_addr":"172.21.15.83:6823/514291182","state":["exists","up"]},{"osd":2,"uuid":"3c379ffa-cb5a-437f-9733-62cac8619a76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6801","nonce":1337722402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6803","nonce":1337722402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6807","nonce":1337722402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337722402},{"type":"v1","addr":"172.21.15.83:6805","nonce":1337722402}]},"public_addr":"172.21.15.83:6801/1337722402","cluster_addr":"172.21.15.83:6803/1337722402","heartbeat_back_addr":"172.21.15.83:6807/1337722402","heartbeat_front_addr":"172.21.15.83:6805/1337722402","state":["exists","up"]},{"osd":3,"uuid":"7fc14beb-1ccb-4c8e-abcc-7063db951995","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6822","nonce":2252380026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6826","nonce":2252380026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6831","nonce":2252380026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2252380026},{"type":"v1","addr":"172.21.15.83:6829","nonce":2252380026}]},"public_addr":"172.21.15.83:6822/2252380026","cluster_addr":"172.21.15.83:6826/2252380026","heartbeat_back_addr":"172.21.15.83:6831/2252380026","heartbeat_front_addr":"172.21.15.83:6829/2252380026","state":["exists","up"]},{"osd":4,"uuid":"e5fb1b81-0151-46e1-afb2-476e3c46412e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6801","nonce":3447039892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6803","nonce":3447039892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6807","nonce":3447039892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3447039892},{"type":"v1","addr":"172.21.15.120:6805","nonce":3447039892}]},"public_addr":"172.21.15.120:6801/3447039892","cluster_addr":"172.21.15.120:6803/3447039892","heartbeat_back_addr":"172.21.15.120:6807/3447039892","heartbeat_front_addr":"172.21.15.120:6805/3447039892","state":["exists","up"]},{"osd":5,"uuid":"815f737a-4801-4c11-8564-c3b99138dfda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6825","nonce":1608674593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6827","nonce":1608674593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6831","nonce":1608674593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1608674593},{"type":"v1","addr":"172.21.15.120:6829","nonce":1608674593}]},"public_addr":"172.21.15.120:6825/1608674593","cluster_addr":"172.21.15.120:6827/1608674593","heartbeat_back_addr":"172.21.15.120:6831/1608674593","heartbeat_front_addr":"172.21.15.120:6829/1608674593","state":["exists","up"]},{"osd":6,"uuid":"afdea4da-e9bf-47fe-b8f0-57fb8fafa707","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6809","nonce":566663973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6811","nonce":566663973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6815","nonce":566663973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":566663973},{"type":"v1","addr":"172.21.15.120:6813","nonce":566663973}]},"public_addr":"172.21.15.120:6809/566663973","cluster_addr":"172.21.15.120:6811/566663973","heartbeat_back_addr":"172.21.15.120:6815/566663973","heartbeat_front_addr":"172.21.15.120:6813/566663973","state":["exists","up"]},{"osd":7,"uuid":"077e1c60-be91-456c-abdf-317856836e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6817","nonce":3242240032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6819","nonce":3242240032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6823","nonce":3242240032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3242240032},{"type":"v1","addr":"172.21.15.120:6821","nonce":3242240032}]},"public_addr":"172.21.15.120:6817/3242240032","cluster_addr":"172.21.15.120:6819/3242240032","heartbeat_back_addr":"172.21.15.120:6823/3242240032","heartbeat_front_addr":"172.21.15.120:6821/3242240032","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.551622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.500926+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.877705+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.484797+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.857567+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.434709+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:48.947665+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:29:49.211481+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":2,"to":6}]},{"pgid":"3.13","mappings":[{"from":0,"to":5}]},{"pgid":"3.2e","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:11:28.682 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:11:28.682 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:28.831 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T01:11:28.832 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:28.832 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T01:11:28.843 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:11:29.139 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:11:29.152 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:11:29.152 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:29.289 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T01:11:29.289 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:29.289 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T01:11:29.299 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:11:29.600 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:11:29.613 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:11:29.613 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:29.750 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T01:11:29.750 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:29.750 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T01:11:29.760 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:11:30.081 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:11:30.094 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:11:30.094 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:30.231 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T01:11:30.231 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:30.231 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T01:11:30.241 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:11:30.548 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:11:30.561 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:11:30.562 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:30.700 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T01:11:30.701 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:30.701 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T01:11:30.711 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:11:31.015 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:11:31.028 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:11:31.028 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:31.164 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T01:11:31.164 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:31.164 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T01:11:31.175 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:11:31.484 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:11:31.496 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:11:31.496 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:31.633 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T01:11:31.634 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:31.634 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T01:11:31.645 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:11:31.945 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:11:31.959 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:11:31.959 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:32.097 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-12T01:11:32.098 INFO:teuthology.orchestra.run.smithi083.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:32.098 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-12T01:11:32.109 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:11:32.416 INFO:teuthology.orchestra.run.smithi083.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:11:32.430 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:32.749 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:11:32.760 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T01:11:32.762 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":1507,"stamp":"2024-09-12T01:11:32.234269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":168845237,"num_objects":756,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":179589,"num_read_kb":2400386,"num_write":143007,"num_write_kb":2482898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13540,"ondisk_log_size":13540,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1876744,"kb_used_data":253528,"kb_used_omap":12,"kb_used_meta":1622067,"kb_avail":753097976,"statfs":{"total":773094113280,"available":771172327424,"internally_reserved":0,"allocated":259612672,"data_stored":243654306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1660997170},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-548555948,"num_objects":-4140,"num_object_clones":0,"num_object_copies":-16448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4140,"num_whiteouts":0,"num_read":4620,"num_read_kb":4132,"num_write":4387,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004875"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509864+0000","last_change":"2024-09-12T00:56:52.991247+0000","last_active":"2024-09-12T01:06:53.509864+0000","last_peered":"2024-09-12T01:06:53.509864+0000","last_clean":"2024-09-12T01:06:53.509864+0000","last_became_active":"2024-09-12T00:56:52.990975+0000","last_became_peered":"2024-09-12T00:56:52.990975+0000","last_unstale":"2024-09-12T01:06:53.509864+0000","last_undegraded":"2024-09-12T01:06:53.509864+0000","last_fullsized":"2024-09-12T01:06:53.509864+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:25.467438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.408743+0000","last_change":"2024-09-12T00:46:19.285045+0000","last_active":"2024-09-12T01:08:48.408743+0000","last_peered":"2024-09-12T01:08:48.408743+0000","last_clean":"2024-09-12T01:08:48.408743+0000","last_became_active":"2024-09-12T00:46:19.284774+0000","last_became_peered":"2024-09-12T00:46:19.284774+0000","last_unstale":"2024-09-12T01:08:48.408743+0000","last_undegraded":"2024-09-12T01:08:48.408743+0000","last_fullsized":"2024-09-12T01:08:48.408743+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:05.942678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.410391+0000","last_change":"2024-09-12T00:46:16.275794+0000","last_active":"2024-09-12T01:11:18.410391+0000","last_peered":"2024-09-12T01:11:18.410391+0000","last_clean":"2024-09-12T01:11:18.410391+0000","last_became_active":"2024-09-12T00:46:16.275529+0000","last_became_peered":"2024-09-12T00:46:16.275529+0000","last_unstale":"2024-09-12T01:11:18.410391+0000","last_undegraded":"2024-09-12T01:11:18.410391+0000","last_fullsized":"2024-09-12T01:11:18.410391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:10.602032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'24","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.244847+0000","last_change":"2024-09-12T00:44:37.816651+0000","last_active":"2024-09-12T01:08:22.244847+0000","last_peered":"2024-09-12T01:08:22.244847+0000","last_clean":"2024-09-12T01:08:22.244847+0000","last_became_active":"2024-09-12T00:44:37.816192+0000","last_became_peered":"2024-09-12T00:44:37.816192+0000","last_unstale":"2024-09-12T01:08:22.244847+0000","last_undegraded":"2024-09-12T01:08:22.244847+0000","last_fullsized":"2024-09-12T01:08:22.244847+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:52.133009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:52.373304+0000","last_change":"2024-09-12T00:56:52.996167+0000","last_active":"2024-09-12T01:06:52.373304+0000","last_peered":"2024-09-12T01:06:52.373304+0000","last_clean":"2024-09-12T01:06:52.373304+0000","last_became_active":"2024-09-12T00:56:52.995871+0000","last_became_peered":"2024-09-12T00:56:52.995871+0000","last_unstale":"2024-09-12T01:06:52.373304+0000","last_undegraded":"2024-09-12T01:06:52.373304+0000","last_fullsized":"2024-09-12T01:06:52.373304+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:23.434095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:51.498180+0000","last_change":"2024-09-12T00:46:19.285212+0000","last_active":"2024-09-12T01:08:51.498180+0000","last_peered":"2024-09-12T01:08:51.498180+0000","last_clean":"2024-09-12T01:08:51.498180+0000","last_became_active":"2024-09-12T00:46:19.284875+0000","last_became_peered":"2024-09-12T00:46:19.284875+0000","last_unstale":"2024-09-12T01:08:51.498180+0000","last_undegraded":"2024-09-12T01:08:51.498180+0000","last_fullsized":"2024-09-12T01:08:51.498180+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:33.439048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.478299+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:08:47.478299+0000","last_peered":"2024-09-12T01:08:47.478299+0000","last_clean":"2024-09-12T01:08:47.478299+0000","last_became_active":"2024-09-12T00:46:16.275381+0000","last_became_peered":"2024-09-12T00:46:16.275381+0000","last_unstale":"2024-09-12T01:08:47.478299+0000","last_undegraded":"2024-09-12T01:08:47.478299+0000","last_fullsized":"2024-09-12T01:08:47.478299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.675654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'45","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.444239+0000","last_change":"2024-09-12T00:44:37.819913+0000","last_active":"2024-09-12T01:08:56.444239+0000","last_peered":"2024-09-12T01:08:56.444239+0000","last_clean":"2024-09-12T01:08:56.444239+0000","last_became_active":"2024-09-12T00:44:37.819561+0000","last_became_peered":"2024-09-12T00:44:37.819561+0000","last_unstale":"2024-09-12T01:08:56.444239+0000","last_undegraded":"2024-09-12T01:08:56.444239+0000","last_fullsized":"2024-09-12T01:08:56.444239+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:18.208589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":164,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409863+0000","last_change":"2024-09-12T00:56:52.990647+0000","last_active":"2024-09-12T01:08:58.409863+0000","last_peered":"2024-09-12T01:08:58.409863+0000","last_clean":"2024-09-12T01:08:58.409863+0000","last_became_active":"2024-09-12T00:56:52.990364+0000","last_became_peered":"2024-09-12T00:56:52.990364+0000","last_unstale":"2024-09-12T01:08:58.409863+0000","last_undegraded":"2024-09-12T01:08:58.409863+0000","last_fullsized":"2024-09-12T01:08:58.409863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:34.228970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557370+0000","last_change":"2024-09-12T00:46:19.285614+0000","last_active":"2024-09-12T01:11:22.557370+0000","last_peered":"2024-09-12T01:11:22.557370+0000","last_clean":"2024-09-12T01:11:22.557370+0000","last_became_active":"2024-09-12T00:46:19.285357+0000","last_became_peered":"2024-09-12T00:46:19.285357+0000","last_unstale":"2024-09-12T01:11:22.557370+0000","last_undegraded":"2024-09-12T01:11:22.557370+0000","last_fullsized":"2024-09-12T01:11:22.557370+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:02.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.384512+0000","last_change":"2024-09-12T00:46:16.278495+0000","last_active":"2024-09-12T01:08:18.384512+0000","last_peered":"2024-09-12T01:08:18.384512+0000","last_clean":"2024-09-12T01:08:18.384512+0000","last_became_active":"2024-09-12T00:46:16.278221+0000","last_became_peered":"2024-09-12T00:46:16.278221+0000","last_unstale":"2024-09-12T01:08:18.384512+0000","last_undegraded":"2024-09-12T01:08:18.384512+0000","last_fullsized":"2024-09-12T01:08:18.384512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:42.560119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5130,"num_write":12,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'37","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375379+0000","last_change":"2024-09-12T00:44:37.818554+0000","last_active":"2024-09-12T01:07:07.375379+0000","last_peered":"2024-09-12T01:07:07.375379+0000","last_clean":"2024-09-12T01:07:07.375379+0000","last_became_active":"2024-09-12T00:44:37.818239+0000","last_became_peered":"2024-09-12T00:44:37.818239+0000","last_unstale":"2024-09-12T01:07:07.375379+0000","last_undegraded":"2024-09-12T01:07:07.375379+0000","last_fullsized":"2024-09-12T01:07:07.375379+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:53.443510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":144,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.480542+0000","last_change":"2024-09-12T00:56:52.995412+0000","last_active":"2024-09-12T01:09:02.480542+0000","last_peered":"2024-09-12T01:09:02.480542+0000","last_clean":"2024-09-12T01:09:02.480542+0000","last_became_active":"2024-09-12T00:56:52.995062+0000","last_became_peered":"2024-09-12T00:56:52.995062+0000","last_unstale":"2024-09-12T01:09:02.480542+0000","last_undegraded":"2024-09-12T01:09:02.480542+0000","last_fullsized":"2024-09-12T01:09:02.480542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.136639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475349+0000","last_change":"2024-09-12T00:46:19.285095+0000","last_active":"2024-09-12T01:08:27.475349+0000","last_peered":"2024-09-12T01:08:27.475349+0000","last_clean":"2024-09-12T01:08:27.475349+0000","last_became_active":"2024-09-12T00:46:19.284822+0000","last_became_peered":"2024-09-12T00:46:19.284822+0000","last_unstale":"2024-09-12T01:08:27.475349+0000","last_undegraded":"2024-09-12T01:08:27.475349+0000","last_fullsized":"2024-09-12T01:08:27.475349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:42.407553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411818+0000","last_change":"2024-09-12T00:46:16.261917+0000","last_active":"2024-09-12T01:09:13.411818+0000","last_peered":"2024-09-12T01:09:13.411818+0000","last_clean":"2024-09-12T01:09:13.411818+0000","last_became_active":"2024-09-12T00:46:16.261617+0000","last_became_peered":"2024-09-12T00:46:16.261617+0000","last_unstale":"2024-09-12T01:09:13.411818+0000","last_undegraded":"2024-09-12T01:09:13.411818+0000","last_fullsized":"2024-09-12T01:09:13.411818+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:45.217925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.392519+0000","last_change":"2024-09-12T00:44:37.815822+0000","last_active":"2024-09-12T01:08:00.392519+0000","last_peered":"2024-09-12T01:08:00.392519+0000","last_clean":"2024-09-12T01:08:00.392519+0000","last_became_active":"2024-09-12T00:44:37.815325+0000","last_became_peered":"2024-09-12T00:44:37.815325+0000","last_unstale":"2024-09-12T01:08:00.392519+0000","last_undegraded":"2024-09-12T01:08:00.392519+0000","last_fullsized":"2024-09-12T01:08:00.392519+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:41.073259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":218,"num_write":105,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389388+0000","last_change":"2024-09-12T00:56:52.991644+0000","last_active":"2024-09-12T01:08:53.389388+0000","last_peered":"2024-09-12T01:08:53.389388+0000","last_clean":"2024-09-12T01:08:53.389388+0000","last_became_active":"2024-09-12T00:56:52.991358+0000","last_became_peered":"2024-09-12T00:56:52.991358+0000","last_unstale":"2024-09-12T01:08:53.389388+0000","last_undegraded":"2024-09-12T01:08:53.389388+0000","last_fullsized":"2024-09-12T01:08:53.389388+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:23.445118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520059+0000","last_change":"2024-09-12T00:46:19.274308+0000","last_active":"2024-09-12T01:08:08.520059+0000","last_peered":"2024-09-12T01:08:08.520059+0000","last_clean":"2024-09-12T01:08:08.520059+0000","last_became_active":"2024-09-12T00:46:19.274024+0000","last_became_peered":"2024-09-12T00:46:19.274024+0000","last_unstale":"2024-09-12T01:08:08.520059+0000","last_undegraded":"2024-09-12T01:08:08.520059+0000","last_fullsized":"2024-09-12T01:08:08.520059+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.097376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.471438+0000","last_change":"2024-09-12T00:46:16.272503+0000","last_active":"2024-09-12T01:08:02.471438+0000","last_peered":"2024-09-12T01:08:02.471438+0000","last_clean":"2024-09-12T01:08:02.471438+0000","last_became_active":"2024-09-12T00:46:16.272230+0000","last_became_peered":"2024-09-12T00:46:16.272230+0000","last_unstale":"2024-09-12T01:08:02.471438+0000","last_undegraded":"2024-09-12T01:08:02.471438+0000","last_fullsized":"2024-09-12T01:08:02.471438+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:22.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'26","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375307+0000","last_change":"2024-09-12T00:44:37.821557+0000","last_active":"2024-09-12T01:07:07.375307+0000","last_peered":"2024-09-12T01:07:07.375307+0000","last_clean":"2024-09-12T01:07:07.375307+0000","last_became_active":"2024-09-12T00:44:37.821297+0000","last_became_peered":"2024-09-12T00:44:37.821297+0000","last_unstale":"2024-09-12T01:07:07.375307+0000","last_undegraded":"2024-09-12T01:07:07.375307+0000","last_fullsized":"2024-09-12T01:07:07.375307+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.631261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.524444+0000","last_change":"2024-09-12T00:56:52.990792+0000","last_active":"2024-09-12T01:09:22.524444+0000","last_peered":"2024-09-12T01:09:22.524444+0000","last_clean":"2024-09-12T01:09:22.524444+0000","last_became_active":"2024-09-12T00:56:52.990528+0000","last_became_peered":"2024-09-12T00:56:52.990528+0000","last_unstale":"2024-09-12T01:09:22.524444+0000","last_undegraded":"2024-09-12T01:09:22.524444+0000","last_fullsized":"2024-09-12T01:09:22.524444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:30.175859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.597263+0000","last_change":"2024-09-12T00:46:19.281162+0000","last_active":"2024-09-12T01:11:23.597263+0000","last_peered":"2024-09-12T01:11:23.597263+0000","last_clean":"2024-09-12T01:11:23.597263+0000","last_became_active":"2024-09-12T00:46:19.280794+0000","last_became_peered":"2024-09-12T00:46:19.280794+0000","last_unstale":"2024-09-12T01:11:23.597263+0000","last_undegraded":"2024-09-12T01:11:23.597263+0000","last_fullsized":"2024-09-12T01:11:23.597263+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:50.182755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12296,"num_write":8,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.736721+0000","last_change":"2024-09-12T00:46:16.267841+0000","last_active":"2024-09-12T01:11:23.736721+0000","last_peered":"2024-09-12T01:11:23.736721+0000","last_clean":"2024-09-12T01:11:23.736721+0000","last_became_active":"2024-09-12T00:46:16.267528+0000","last_became_peered":"2024-09-12T00:46:16.267528+0000","last_unstale":"2024-09-12T01:11:23.736721+0000","last_undegraded":"2024-09-12T01:11:23.736721+0000","last_fullsized":"2024-09-12T01:11:23.736721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8204,"num_write":6,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'128","reported_seq":430,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.484992+0000","last_change":"2024-09-12T00:44:37.819828+0000","last_active":"2024-09-12T01:07:11.484992+0000","last_peered":"2024-09-12T01:07:11.484992+0000","last_clean":"2024-09-12T01:07:11.484992+0000","last_became_active":"2024-09-12T00:44:37.819556+0000","last_became_peered":"2024-09-12T00:44:37.819556+0000","last_unstale":"2024-09-12T01:07:11.484992+0000","last_undegraded":"2024-09-12T01:07:11.484992+0000","last_fullsized":"2024-09-12T01:07:11.484992+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:37.132092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":767,"num_read_kb":571,"num_write":157,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.482640+0000","last_change":"2024-09-12T00:56:52.992341+0000","last_active":"2024-09-12T01:06:56.482640+0000","last_peered":"2024-09-12T01:06:56.482640+0000","last_clean":"2024-09-12T01:06:56.482640+0000","last_became_active":"2024-09-12T00:56:52.992081+0000","last_became_peered":"2024-09-12T00:56:52.992081+0000","last_unstale":"2024-09-12T01:06:56.482640+0000","last_undegraded":"2024-09-12T01:06:56.482640+0000","last_fullsized":"2024-09-12T01:06:56.482640+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:38.856681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'7","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.517722+0000","last_change":"2024-09-12T00:46:19.280066+0000","last_active":"2024-09-12T01:11:21.517722+0000","last_peered":"2024-09-12T01:11:21.517722+0000","last_clean":"2024-09-12T01:11:21.517722+0000","last_became_active":"2024-09-12T00:46:19.279811+0000","last_became_peered":"2024-09-12T00:46:19.279811+0000","last_unstale":"2024-09-12T01:11:21.517722+0000","last_undegraded":"2024-09-12T01:11:21.517722+0000","last_fullsized":"2024-09-12T01:11:21.517722+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.923506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13308,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'5","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.542962+0000","last_change":"2024-09-12T00:46:16.274833+0000","last_active":"2024-09-12T01:11:18.542962+0000","last_peered":"2024-09-12T01:11:18.542962+0000","last_clean":"2024-09-12T01:11:18.542962+0000","last_became_active":"2024-09-12T00:46:16.274541+0000","last_became_peered":"2024-09-12T00:46:16.274541+0000","last_unstale":"2024-09-12T01:11:18.542962+0000","last_undegraded":"2024-09-12T01:11:18.542962+0000","last_fullsized":"2024-09-12T01:11:18.542962+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:58.251023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'13","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388468+0000","last_change":"2024-09-12T00:44:37.817411+0000","last_active":"2024-09-12T01:08:48.388468+0000","last_peered":"2024-09-12T01:08:48.388468+0000","last_clean":"2024-09-12T01:08:48.388468+0000","last_became_active":"2024-09-12T00:44:37.817108+0000","last_became_peered":"2024-09-12T00:44:37.817108+0000","last_unstale":"2024-09-12T01:08:48.388468+0000","last_undegraded":"2024-09-12T01:08:48.388468+0000","last_fullsized":"2024-09-12T01:08:48.388468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:45.282350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509925+0000","last_change":"2024-09-12T00:56:52.989648+0000","last_active":"2024-09-12T01:06:53.509925+0000","last_peered":"2024-09-12T01:06:53.509925+0000","last_clean":"2024-09-12T01:06:53.509925+0000","last_became_active":"2024-09-12T00:56:52.989394+0000","last_became_peered":"2024-09-12T00:56:52.989394+0000","last_unstale":"2024-09-12T01:06:53.509925+0000","last_undegraded":"2024-09-12T01:06:53.509925+0000","last_fullsized":"2024-09-12T01:06:53.509925+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:17.324226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"264'7","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.458831+0000","last_change":"2024-09-12T00:46:19.282381+0000","last_active":"2024-09-12T01:11:23.458831+0000","last_peered":"2024-09-12T01:11:23.458831+0000","last_clean":"2024-09-12T01:11:23.458831+0000","last_became_active":"2024-09-12T00:46:19.280878+0000","last_became_peered":"2024-09-12T00:46:19.280878+0000","last_unstale":"2024-09-12T01:11:23.458831+0000","last_undegraded":"2024-09-12T01:11:23.458831+0000","last_fullsized":"2024-09-12T01:11:23.458831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:37.733061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.411092+0000","last_change":"2024-09-12T00:46:16.278285+0000","last_active":"2024-09-12T01:11:17.411092+0000","last_peered":"2024-09-12T01:11:17.411092+0000","last_clean":"2024-09-12T01:11:17.411092+0000","last_became_active":"2024-09-12T00:46:16.277776+0000","last_became_peered":"2024-09-12T00:46:16.277776+0000","last_unstale":"2024-09-12T01:11:17.411092+0000","last_undegraded":"2024-09-12T01:11:17.411092+0000","last_fullsized":"2024-09-12T01:11:17.411092+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:47.993297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'18","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389367+0000","last_change":"2024-09-12T00:44:37.816393+0000","last_active":"2024-09-12T01:08:47.389367+0000","last_peered":"2024-09-12T01:08:47.389367+0000","last_clean":"2024-09-12T01:08:47.389367+0000","last_became_active":"2024-09-12T00:44:37.815820+0000","last_became_peered":"2024-09-12T00:44:37.815820+0000","last_unstale":"2024-09-12T01:08:47.389367+0000","last_undegraded":"2024-09-12T01:08:47.389367+0000","last_fullsized":"2024-09-12T01:08:47.389367+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:49.470552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.475979+0000","last_change":"2024-09-12T00:56:52.996102+0000","last_active":"2024-09-12T01:08:32.475979+0000","last_peered":"2024-09-12T01:08:32.475979+0000","last_clean":"2024-09-12T01:08:32.475979+0000","last_became_active":"2024-09-12T00:56:52.995696+0000","last_became_peered":"2024-09-12T00:56:52.995696+0000","last_unstale":"2024-09-12T01:08:32.475979+0000","last_undegraded":"2024-09-12T01:08:32.475979+0000","last_fullsized":"2024-09-12T01:08:32.475979+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:57.634150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.403783+0000","last_change":"2024-09-12T00:46:19.282715+0000","last_active":"2024-09-12T01:10:33.403783+0000","last_peered":"2024-09-12T01:10:33.403783+0000","last_clean":"2024-09-12T01:10:33.403783+0000","last_became_active":"2024-09-12T00:46:19.282466+0000","last_became_peered":"2024-09-12T00:46:19.282466+0000","last_unstale":"2024-09-12T01:10:33.403783+0000","last_undegraded":"2024-09-12T01:10:33.403783+0000","last_fullsized":"2024-09-12T01:10:33.403783+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.083481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.612173+0000","last_change":"2024-09-12T00:46:16.268948+0000","last_active":"2024-09-12T01:09:43.612173+0000","last_peered":"2024-09-12T01:09:43.612173+0000","last_clean":"2024-09-12T01:09:43.612173+0000","last_became_active":"2024-09-12T00:46:16.268479+0000","last_became_peered":"2024-09-12T00:46:16.268479+0000","last_unstale":"2024-09-12T01:09:43.612173+0000","last_undegraded":"2024-09-12T01:09:43.612173+0000","last_fullsized":"2024-09-12T01:09:43.612173+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:29.450733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519282+0000","last_change":"2024-09-12T00:44:37.811999+0000","last_active":"2024-09-12T01:08:47.519282+0000","last_peered":"2024-09-12T01:08:47.519282+0000","last_clean":"2024-09-12T01:08:47.519282+0000","last_became_active":"2024-09-12T00:44:37.811697+0000","last_became_peered":"2024-09-12T00:44:37.811697+0000","last_unstale":"2024-09-12T01:08:47.519282+0000","last_undegraded":"2024-09-12T01:08:47.519282+0000","last_fullsized":"2024-09-12T01:08:47.519282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:46.654992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":57,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.387544+0000","last_change":"2024-09-12T00:56:52.985166+0000","last_active":"2024-09-12T01:08:32.387544+0000","last_peered":"2024-09-12T01:08:32.387544+0000","last_clean":"2024-09-12T01:08:32.387544+0000","last_became_active":"2024-09-12T00:56:52.984878+0000","last_became_peered":"2024-09-12T00:56:52.984878+0000","last_unstale":"2024-09-12T01:08:32.387544+0000","last_undegraded":"2024-09-12T01:08:32.387544+0000","last_fullsized":"2024-09-12T01:08:32.387544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.409540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.466660+0000","last_change":"2024-09-12T00:46:19.276813+0000","last_active":"2024-09-12T01:07:27.466660+0000","last_peered":"2024-09-12T01:07:27.466660+0000","last_clean":"2024-09-12T01:07:27.466660+0000","last_became_active":"2024-09-12T00:46:19.276197+0000","last_became_peered":"2024-09-12T00:46:19.276197+0000","last_unstale":"2024-09-12T01:07:27.466660+0000","last_undegraded":"2024-09-12T01:07:27.466660+0000","last_fullsized":"2024-09-12T01:07:27.466660+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:53.182491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:28.536284+0000","last_change":"2024-09-12T00:46:16.264295+0000","last_active":"2024-09-12T01:10:28.536284+0000","last_peered":"2024-09-12T01:10:28.536284+0000","last_clean":"2024-09-12T01:10:28.536284+0000","last_became_active":"2024-09-12T00:46:16.263870+0000","last_became_peered":"2024-09-12T00:46:16.263870+0000","last_unstale":"2024-09-12T01:10:28.536284+0000","last_undegraded":"2024-09-12T01:10:28.536284+0000","last_fullsized":"2024-09-12T01:10:28.536284+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:24.692637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2048,"num_write":18,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'37","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519258+0000","last_change":"2024-09-12T00:44:37.820673+0000","last_active":"2024-09-12T01:08:47.519258+0000","last_peered":"2024-09-12T01:08:47.519258+0000","last_clean":"2024-09-12T01:08:47.519258+0000","last_became_active":"2024-09-12T00:44:37.820232+0000","last_became_peered":"2024-09-12T00:44:37.820232+0000","last_unstale":"2024-09-12T01:08:47.519258+0000","last_undegraded":"2024-09-12T01:08:47.519258+0000","last_fullsized":"2024-09-12T01:08:47.519258+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.688623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496180+0000","last_change":"2024-09-12T00:56:52.987731+0000","last_active":"2024-09-12T01:08:36.496180+0000","last_peered":"2024-09-12T01:08:36.496180+0000","last_clean":"2024-09-12T01:08:36.496180+0000","last_became_active":"2024-09-12T00:56:52.987492+0000","last_became_peered":"2024-09-12T00:56:52.987492+0000","last_unstale":"2024-09-12T01:08:36.496180+0000","last_undegraded":"2024-09-12T01:08:36.496180+0000","last_fullsized":"2024-09-12T01:08:36.496180+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.155360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'9","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383413+0000","last_change":"2024-09-12T00:46:19.287908+0000","last_active":"2024-09-12T01:08:08.383413+0000","last_peered":"2024-09-12T01:08:08.383413+0000","last_clean":"2024-09-12T01:08:08.383413+0000","last_became_active":"2024-09-12T00:46:19.286860+0000","last_became_peered":"2024-09-12T00:46:19.286860+0000","last_unstale":"2024-09-12T01:08:08.383413+0000","last_undegraded":"2024-09-12T01:08:08.383413+0000","last_fullsized":"2024-09-12T01:08:08.383413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:54.927557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13316,"num_write":14,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.735722+0000","last_change":"2024-09-12T00:46:16.279497+0000","last_active":"2024-09-12T01:11:23.735722+0000","last_peered":"2024-09-12T01:11:23.735722+0000","last_clean":"2024-09-12T01:11:23.735722+0000","last_became_active":"2024-09-12T00:46:16.279114+0000","last_became_peered":"2024-09-12T00:46:16.279114+0000","last_unstale":"2024-09-12T01:11:23.735722+0000","last_undegraded":"2024-09-12T01:11:23.735722+0000","last_fullsized":"2024-09-12T01:11:23.735722+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:42.826584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'25","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388537+0000","last_change":"2024-09-12T00:44:37.819571+0000","last_active":"2024-09-12T01:08:48.388537+0000","last_peered":"2024-09-12T01:08:48.388537+0000","last_clean":"2024-09-12T01:08:48.388537+0000","last_became_active":"2024-09-12T00:44:37.819153+0000","last_became_peered":"2024-09-12T00:44:37.819153+0000","last_unstale":"2024-09-12T01:08:48.388537+0000","last_undegraded":"2024-09-12T01:08:48.388537+0000","last_fullsized":"2024-09-12T01:08:48.388537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:27.117588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":89,"num_write":41,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.523138+0000","last_change":"2024-09-12T00:56:52.990539+0000","last_active":"2024-09-12T01:08:33.523138+0000","last_peered":"2024-09-12T01:08:33.523138+0000","last_clean":"2024-09-12T01:08:33.523138+0000","last_became_active":"2024-09-12T00:56:52.990265+0000","last_became_peered":"2024-09-12T00:56:52.990265+0000","last_unstale":"2024-09-12T01:08:33.523138+0000","last_undegraded":"2024-09-12T01:08:33.523138+0000","last_fullsized":"2024-09-12T01:08:33.523138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:41.315107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519397+0000","last_change":"2024-09-12T00:46:19.277307+0000","last_active":"2024-09-12T01:08:03.519397+0000","last_peered":"2024-09-12T01:08:03.519397+0000","last_clean":"2024-09-12T01:08:03.519397+0000","last_became_active":"2024-09-12T00:46:19.277011+0000","last_became_peered":"2024-09-12T00:46:19.277011+0000","last_unstale":"2024-09-12T01:08:03.519397+0000","last_undegraded":"2024-09-12T01:08:03.519397+0000","last_fullsized":"2024-09-12T01:08:03.519397+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:43.590749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694341+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:11:22.694341+0000","last_peered":"2024-09-12T01:11:22.694341+0000","last_clean":"2024-09-12T01:11:22.694341+0000","last_became_active":"2024-09-12T00:46:16.275403+0000","last_became_peered":"2024-09-12T00:46:16.275403+0000","last_unstale":"2024-09-12T01:11:22.694341+0000","last_undegraded":"2024-09-12T01:11:22.694341+0000","last_fullsized":"2024-09-12T01:11:22.694341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.331770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"264'68","reported_seq":266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.598342+0000","last_change":"2024-09-12T00:44:37.821656+0000","last_active":"2024-09-12T01:08:03.598342+0000","last_peered":"2024-09-12T01:08:03.598342+0000","last_clean":"2024-09-12T01:08:03.598342+0000","last_became_active":"2024-09-12T00:44:37.821192+0000","last_became_peered":"2024-09-12T00:44:37.821192+0000","last_unstale":"2024-09-12T01:08:03.598342+0000","last_undegraded":"2024-09-12T01:08:03.598342+0000","last_fullsized":"2024-09-12T01:08:03.598342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:14.342220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":323,"num_write":87,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479794+0000","last_change":"2024-09-12T00:56:52.995841+0000","last_active":"2024-09-12T01:08:57.479794+0000","last_peered":"2024-09-12T01:08:57.479794+0000","last_clean":"2024-09-12T01:08:57.479794+0000","last_became_active":"2024-09-12T00:56:52.995495+0000","last_became_peered":"2024-09-12T00:56:52.995495+0000","last_unstale":"2024-09-12T01:08:57.479794+0000","last_undegraded":"2024-09-12T01:08:57.479794+0000","last_fullsized":"2024-09-12T01:08:57.479794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:07.859390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557616+0000","last_change":"2024-09-12T00:46:19.280925+0000","last_active":"2024-09-12T01:11:22.557616+0000","last_peered":"2024-09-12T01:11:22.557616+0000","last_clean":"2024-09-12T01:11:22.557616+0000","last_became_active":"2024-09-12T00:46:19.280653+0000","last_became_peered":"2024-09-12T00:46:19.280653+0000","last_unstale":"2024-09-12T01:11:22.557616+0000","last_undegraded":"2024-09-12T01:11:22.557616+0000","last_fullsized":"2024-09-12T01:11:22.557616+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:20.246986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10256,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"261'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396139+0000","last_change":"2024-09-12T00:46:16.270257+0000","last_active":"2024-09-12T01:07:18.396139+0000","last_peered":"2024-09-12T01:07:18.396139+0000","last_clean":"2024-09-12T01:07:18.396139+0000","last_became_active":"2024-09-12T00:46:16.270004+0000","last_became_peered":"2024-09-12T00:46:16.270004+0000","last_unstale":"2024-09-12T01:07:18.396139+0000","last_undegraded":"2024-09-12T01:07:18.396139+0000","last_fullsized":"2024-09-12T01:07:18.396139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:08.342727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'15","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.597733+0000","last_change":"2024-09-12T00:44:37.820954+0000","last_active":"2024-09-12T01:07:58.597733+0000","last_peered":"2024-09-12T01:07:58.597733+0000","last_clean":"2024-09-12T01:07:58.597733+0000","last_became_active":"2024-09-12T00:44:37.820639+0000","last_became_peered":"2024-09-12T00:44:37.820639+0000","last_unstale":"2024-09-12T01:07:58.597733+0000","last_undegraded":"2024-09-12T01:07:58.597733+0000","last_fullsized":"2024-09-12T01:07:58.597733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:51.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391071+0000","last_change":"2024-09-12T00:56:52.991542+0000","last_active":"2024-09-12T01:08:57.391071+0000","last_peered":"2024-09-12T01:08:57.391071+0000","last_clean":"2024-09-12T01:08:57.391071+0000","last_became_active":"2024-09-12T00:56:52.991261+0000","last_became_peered":"2024-09-12T00:56:52.991261+0000","last_unstale":"2024-09-12T01:08:57.391071+0000","last_undegraded":"2024-09-12T01:08:57.391071+0000","last_fullsized":"2024-09-12T01:08:57.391071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:08.574079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:42.486590+0000","last_change":"2024-09-12T00:46:19.282895+0000","last_active":"2024-09-12T01:09:42.486590+0000","last_peered":"2024-09-12T01:09:42.486590+0000","last_clean":"2024-09-12T01:09:42.486590+0000","last_became_active":"2024-09-12T00:46:19.281676+0000","last_became_peered":"2024-09-12T00:46:19.281676+0000","last_unstale":"2024-09-12T01:09:42.486590+0000","last_undegraded":"2024-09-12T01:09:42.486590+0000","last_fullsized":"2024-09-12T01:09:42.486590+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.550417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465156+0000","last_change":"2024-09-12T00:46:16.276429+0000","last_active":"2024-09-12T01:07:17.465156+0000","last_peered":"2024-09-12T01:07:17.465156+0000","last_clean":"2024-09-12T01:07:17.465156+0000","last_became_active":"2024-09-12T00:46:16.276180+0000","last_became_peered":"2024-09-12T00:46:16.276180+0000","last_unstale":"2024-09-12T01:07:17.465156+0000","last_undegraded":"2024-09-12T01:07:17.465156+0000","last_fullsized":"2024-09-12T01:07:17.465156+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:48.188004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382200+0000","last_change":"2024-09-12T00:44:37.820502+0000","last_active":"2024-09-12T01:07:58.382200+0000","last_peered":"2024-09-12T01:07:58.382200+0000","last_clean":"2024-09-12T01:07:58.382200+0000","last_became_active":"2024-09-12T00:44:37.820217+0000","last_became_peered":"2024-09-12T00:44:37.820217+0000","last_unstale":"2024-09-12T01:07:58.382200+0000","last_undegraded":"2024-09-12T01:07:58.382200+0000","last_fullsized":"2024-09-12T01:07:58.382200+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.838632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":127,"num_write":61,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.517081+0000","last_change":"2024-09-12T00:56:52.989385+0000","last_active":"2024-09-12T01:08:32.517081+0000","last_peered":"2024-09-12T01:08:32.517081+0000","last_clean":"2024-09-12T01:08:32.517081+0000","last_became_active":"2024-09-12T00:56:52.988302+0000","last_became_peered":"2024-09-12T00:56:52.988302+0000","last_unstale":"2024-09-12T01:08:32.517081+0000","last_undegraded":"2024-09-12T01:08:32.517081+0000","last_fullsized":"2024-09-12T01:08:32.517081+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:40.813037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'7","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.377182+0000","last_change":"2024-09-12T00:46:19.285378+0000","last_active":"2024-09-12T01:07:23.377182+0000","last_peered":"2024-09-12T01:07:23.377182+0000","last_clean":"2024-09-12T01:07:23.377182+0000","last_became_active":"2024-09-12T00:46:19.280889+0000","last_became_peered":"2024-09-12T00:46:19.280889+0000","last_unstale":"2024-09-12T01:07:23.377182+0000","last_undegraded":"2024-09-12T01:07:23.377182+0000","last_fullsized":"2024-09-12T01:07:23.377182+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:56.282208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7182,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.414382+0000","last_change":"2024-09-12T00:46:16.263413+0000","last_active":"2024-09-12T01:09:38.414382+0000","last_peered":"2024-09-12T01:09:38.414382+0000","last_clean":"2024-09-12T01:09:38.414382+0000","last_became_active":"2024-09-12T00:46:16.263065+0000","last_became_peered":"2024-09-12T00:46:16.263065+0000","last_unstale":"2024-09-12T01:09:38.414382+0000","last_undegraded":"2024-09-12T01:09:38.414382+0000","last_fullsized":"2024-09-12T01:09:38.414382+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:23.322080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.491664+0000","last_change":"2024-09-12T00:44:37.814881+0000","last_active":"2024-09-12T01:08:01.491664+0000","last_peered":"2024-09-12T01:08:01.491664+0000","last_clean":"2024-09-12T01:08:01.491664+0000","last_became_active":"2024-09-12T00:44:37.814584+0000","last_became_peered":"2024-09-12T00:44:37.814584+0000","last_unstale":"2024-09-12T01:08:01.491664+0000","last_undegraded":"2024-09-12T01:08:01.491664+0000","last_fullsized":"2024-09-12T01:08:01.491664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:18.206072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391027+0000","last_change":"2024-09-12T00:56:52.991853+0000","last_active":"2024-09-12T01:08:57.391027+0000","last_peered":"2024-09-12T01:08:57.391027+0000","last_clean":"2024-09-12T01:08:57.391027+0000","last_became_active":"2024-09-12T00:56:52.990830+0000","last_became_peered":"2024-09-12T00:56:52.990830+0000","last_unstale":"2024-09-12T01:08:57.391027+0000","last_undegraded":"2024-09-12T01:08:57.391027+0000","last_fullsized":"2024-09-12T01:08:57.391027+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:49.621390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'11","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.223259+0000","last_change":"2024-09-12T00:46:19.285059+0000","last_active":"2024-09-12T01:11:23.223259+0000","last_peered":"2024-09-12T01:11:23.223259+0000","last_clean":"2024-09-12T01:11:23.223259+0000","last_became_active":"2024-09-12T00:46:19.284748+0000","last_became_peered":"2024-09-12T00:46:19.284748+0000","last_unstale":"2024-09-12T01:11:23.223259+0000","last_undegraded":"2024-09-12T01:11:23.223259+0000","last_fullsized":"2024-09-12T01:11:23.223259+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:39.933756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"261'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396223+0000","last_change":"2024-09-12T00:46:16.274496+0000","last_active":"2024-09-12T01:07:18.396223+0000","last_peered":"2024-09-12T01:07:18.396223+0000","last_clean":"2024-09-12T01:07:18.396223+0000","last_became_active":"2024-09-12T00:46:16.274209+0000","last_became_peered":"2024-09-12T00:46:16.274209+0000","last_unstale":"2024-09-12T01:07:18.396223+0000","last_undegraded":"2024-09-12T01:07:18.396223+0000","last_fullsized":"2024-09-12T01:07:18.396223+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:33.536444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":10,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382153+0000","last_change":"2024-09-12T00:44:37.819591+0000","last_active":"2024-09-12T01:07:58.382153+0000","last_peered":"2024-09-12T01:07:58.382153+0000","last_clean":"2024-09-12T01:07:58.382153+0000","last_became_active":"2024-09-12T00:44:37.819298+0000","last_became_peered":"2024-09-12T00:44:37.819298+0000","last_unstale":"2024-09-12T01:07:58.382153+0000","last_undegraded":"2024-09-12T01:07:58.382153+0000","last_fullsized":"2024-09-12T01:07:58.382153+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:00.112592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.469348+0000","last_change":"2024-09-12T00:56:52.996314+0000","last_active":"2024-09-12T01:07:47.469348+0000","last_peered":"2024-09-12T01:07:47.469348+0000","last_clean":"2024-09-12T01:07:47.469348+0000","last_became_active":"2024-09-12T00:56:52.996048+0000","last_became_peered":"2024-09-12T00:56:52.996048+0000","last_unstale":"2024-09-12T01:07:47.469348+0000","last_undegraded":"2024-09-12T01:07:47.469348+0000","last_fullsized":"2024-09-12T01:07:47.469348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.954796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.222509+0000","last_change":"2024-09-12T00:46:19.286025+0000","last_active":"2024-09-12T01:11:23.222509+0000","last_peered":"2024-09-12T01:11:23.222509+0000","last_clean":"2024-09-12T01:11:23.222509+0000","last_became_active":"2024-09-12T00:46:19.285304+0000","last_became_peered":"2024-09-12T00:46:19.285304+0000","last_unstale":"2024-09-12T01:11:23.222509+0000","last_undegraded":"2024-09-12T01:11:23.222509+0000","last_fullsized":"2024-09-12T01:11:23.222509+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:59.248323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2428,"num_write":4,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:01.514702+0000","last_change":"2024-09-12T00:46:16.272142+0000","last_active":"2024-09-12T01:11:01.514702+0000","last_peered":"2024-09-12T01:11:01.514702+0000","last_clean":"2024-09-12T01:11:01.514702+0000","last_became_active":"2024-09-12T00:46:16.271839+0000","last_became_peered":"2024-09-12T00:46:16.271839+0000","last_unstale":"2024-09-12T01:11:01.514702+0000","last_undegraded":"2024-09-12T01:11:01.514702+0000","last_fullsized":"2024-09-12T01:11:01.514702+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:04.288299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"264'41","reported_seq":151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.650570+0000","last_change":"2024-09-12T00:44:37.822164+0000","last_active":"2024-09-12T01:08:56.650570+0000","last_peered":"2024-09-12T01:08:56.650570+0000","last_clean":"2024-09-12T01:08:56.650570+0000","last_became_active":"2024-09-12T00:44:37.821837+0000","last_became_peered":"2024-09-12T00:44:37.821837+0000","last_unstale":"2024-09-12T01:08:56.650570+0000","last_undegraded":"2024-09-12T01:08:56.650570+0000","last_fullsized":"2024-09-12T01:08:56.650570+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:59.825047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":140,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403198+0000","last_change":"2024-09-12T00:56:52.996477+0000","last_active":"2024-09-12T01:08:08.403198+0000","last_peered":"2024-09-12T01:08:08.403198+0000","last_clean":"2024-09-12T01:08:08.403198+0000","last_became_active":"2024-09-12T00:56:52.996287+0000","last_became_peered":"2024-09-12T00:56:52.996287+0000","last_unstale":"2024-09-12T01:08:08.403198+0000","last_undegraded":"2024-09-12T01:08:08.403198+0000","last_fullsized":"2024-09-12T01:08:08.403198+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:34.040673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.408768+0000","last_change":"2024-09-12T00:46:19.284780+0000","last_active":"2024-09-12T01:11:08.408768+0000","last_peered":"2024-09-12T01:11:08.408768+0000","last_clean":"2024-09-12T01:11:08.408768+0000","last_became_active":"2024-09-12T00:46:19.284490+0000","last_became_peered":"2024-09-12T00:46:19.284490+0000","last_unstale":"2024-09-12T01:11:08.408768+0000","last_undegraded":"2024-09-12T01:11:08.408768+0000","last_fullsized":"2024-09-12T01:11:08.408768+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.303903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"264'10","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:02.408785+0000","last_change":"2024-09-12T00:46:16.275634+0000","last_active":"2024-09-12T01:11:02.408785+0000","last_peered":"2024-09-12T01:11:02.408785+0000","last_clean":"2024-09-12T01:11:02.408785+0000","last_became_active":"2024-09-12T00:46:16.275312+0000","last_became_peered":"2024-09-12T00:46:16.275312+0000","last_unstale":"2024-09-12T01:11:02.408785+0000","last_undegraded":"2024-09-12T01:11:02.408785+0000","last_fullsized":"2024-09-12T01:11:02.408785+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.528193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20478,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'42","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.590315+0000","last_change":"2024-09-12T00:44:37.819546+0000","last_active":"2024-09-12T01:07:08.590315+0000","last_peered":"2024-09-12T01:07:08.590315+0000","last_clean":"2024-09-12T01:07:08.590315+0000","last_became_active":"2024-09-12T00:44:37.819289+0000","last_became_peered":"2024-09-12T00:44:37.819289+0000","last_unstale":"2024-09-12T01:07:08.590315+0000","last_undegraded":"2024-09-12T01:07:08.590315+0000","last_fullsized":"2024-09-12T01:07:08.590315+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:38.531263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":167,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.595680+0000","last_change":"2024-09-12T00:56:52.987494+0000","last_active":"2024-09-12T01:07:43.595680+0000","last_peered":"2024-09-12T01:07:43.595680+0000","last_clean":"2024-09-12T01:07:43.595680+0000","last_became_active":"2024-09-12T00:56:52.987226+0000","last_became_peered":"2024-09-12T00:56:52.987226+0000","last_unstale":"2024-09-12T01:07:43.595680+0000","last_undegraded":"2024-09-12T01:07:43.595680+0000","last_fullsized":"2024-09-12T01:07:43.595680+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:25.549274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.458461+0000","last_change":"2024-09-12T00:46:19.287340+0000","last_active":"2024-09-12T01:11:23.458461+0000","last_peered":"2024-09-12T01:11:23.458461+0000","last_clean":"2024-09-12T01:11:23.458461+0000","last_became_active":"2024-09-12T00:46:19.287067+0000","last_became_peered":"2024-09-12T00:46:19.287067+0000","last_unstale":"2024-09-12T01:11:23.458461+0000","last_undegraded":"2024-09-12T01:11:23.458461+0000","last_fullsized":"2024-09-12T01:11:23.458461+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.086451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2174,"num_write":4,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:03.408116+0000","last_change":"2024-09-12T00:46:16.278474+0000","last_active":"2024-09-12T01:11:03.408116+0000","last_peered":"2024-09-12T01:11:03.408116+0000","last_clean":"2024-09-12T01:11:03.408116+0000","last_became_active":"2024-09-12T00:46:16.278205+0000","last_became_peered":"2024-09-12T00:46:16.278205+0000","last_unstale":"2024-09-12T01:11:03.408116+0000","last_undegraded":"2024-09-12T01:11:03.408116+0000","last_fullsized":"2024-09-12T01:11:03.408116+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:45.398336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'62","reported_seq":211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.997717+0000","last_change":"2024-09-12T00:44:37.811854+0000","last_active":"2024-09-12T01:08:52.997717+0000","last_peered":"2024-09-12T01:08:52.997717+0000","last_clean":"2024-09-12T01:08:52.997717+0000","last_became_active":"2024-09-12T00:44:37.811544+0000","last_became_peered":"2024-09-12T00:44:37.811544+0000","last_unstale":"2024-09-12T01:08:52.997717+0000","last_undegraded":"2024-09-12T01:08:52.997717+0000","last_fullsized":"2024-09-12T01:08:52.997717+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:05.666736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":232,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.399787+0000","last_change":"2024-09-12T00:56:52.989633+0000","last_active":"2024-09-12T01:07:43.399787+0000","last_peered":"2024-09-12T01:07:43.399787+0000","last_clean":"2024-09-12T01:07:43.399787+0000","last_became_active":"2024-09-12T00:56:52.988985+0000","last_became_peered":"2024-09-12T00:56:52.988985+0000","last_unstale":"2024-09-12T01:07:43.399787+0000","last_undegraded":"2024-09-12T01:07:43.399787+0000","last_fullsized":"2024-09-12T01:07:43.399787+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:47.578076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'10","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479160+0000","last_change":"2024-09-12T00:46:19.279808+0000","last_active":"2024-09-12T01:08:52.479160+0000","last_peered":"2024-09-12T01:08:52.479160+0000","last_clean":"2024-09-12T01:08:52.479160+0000","last_became_active":"2024-09-12T00:46:19.279527+0000","last_became_peered":"2024-09-12T00:46:19.279527+0000","last_unstale":"2024-09-12T01:08:52.479160+0000","last_undegraded":"2024-09-12T01:08:52.479160+0000","last_fullsized":"2024-09-12T01:08:52.479160+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:07.362005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8190,"num_write":20,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388598+0000","last_change":"2024-09-12T00:46:16.273882+0000","last_active":"2024-09-12T01:08:48.388598+0000","last_peered":"2024-09-12T01:08:48.388598+0000","last_clean":"2024-09-12T01:08:48.388598+0000","last_became_active":"2024-09-12T00:46:16.273598+0000","last_became_peered":"2024-09-12T00:46:16.273598+0000","last_unstale":"2024-09-12T01:08:48.388598+0000","last_undegraded":"2024-09-12T01:08:48.388598+0000","last_fullsized":"2024-09-12T01:08:48.388598+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:16.097567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'41","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.165530+0000","last_change":"2024-09-12T00:44:37.813325+0000","last_active":"2024-09-12T01:08:57.165530+0000","last_peered":"2024-09-12T01:08:57.165530+0000","last_clean":"2024-09-12T01:08:57.165530+0000","last_became_active":"2024-09-12T00:44:37.813081+0000","last_became_peered":"2024-09-12T00:44:37.813081+0000","last_unstale":"2024-09-12T01:08:57.165530+0000","last_undegraded":"2024-09-12T01:08:57.165530+0000","last_fullsized":"2024-09-12T01:08:57.165530+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:39.795060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":146,"num_write":78,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.472330+0000","last_change":"2024-09-12T00:56:52.995736+0000","last_active":"2024-09-12T01:08:07.472330+0000","last_peered":"2024-09-12T01:08:07.472330+0000","last_clean":"2024-09-12T01:08:07.472330+0000","last_became_active":"2024-09-12T00:56:52.995412+0000","last_became_peered":"2024-09-12T00:56:52.995412+0000","last_unstale":"2024-09-12T01:08:07.472330+0000","last_undegraded":"2024-09-12T01:08:07.472330+0000","last_fullsized":"2024-09-12T01:08:07.472330+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:15.173930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615387+0000","last_change":"2024-09-12T00:46:19.283005+0000","last_active":"2024-09-12T01:10:08.615387+0000","last_peered":"2024-09-12T01:10:08.615387+0000","last_clean":"2024-09-12T01:10:08.615387+0000","last_became_active":"2024-09-12T00:46:19.282672+0000","last_became_peered":"2024-09-12T00:46:19.282672+0000","last_unstale":"2024-09-12T01:10:08.615387+0000","last_undegraded":"2024-09-12T01:10:08.615387+0000","last_fullsized":"2024-09-12T01:10:08.615387+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:25.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'9","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694865+0000","last_change":"2024-09-12T00:46:16.266194+0000","last_active":"2024-09-12T01:11:22.694865+0000","last_peered":"2024-09-12T01:11:22.694865+0000","last_clean":"2024-09-12T01:11:22.694865+0000","last_became_active":"2024-09-12T00:46:16.265927+0000","last_became_peered":"2024-09-12T00:46:16.265927+0000","last_unstale":"2024-09-12T01:11:22.694865+0000","last_undegraded":"2024-09-12T01:11:22.694865+0000","last_fullsized":"2024-09-12T01:11:22.694865+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:30.967366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'26","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375318+0000","last_change":"2024-09-12T00:44:37.820836+0000","last_active":"2024-09-12T01:07:07.375318+0000","last_peered":"2024-09-12T01:07:07.375318+0000","last_clean":"2024-09-12T01:07:07.375318+0000","last_became_active":"2024-09-12T00:44:37.820584+0000","last_became_peered":"2024-09-12T00:44:37.820584+0000","last_unstale":"2024-09-12T01:07:07.375318+0000","last_undegraded":"2024-09-12T01:07:07.375318+0000","last_fullsized":"2024-09-12T01:07:07.375318+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:59.394929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.493580+0000","last_change":"2024-09-12T00:56:52.994371+0000","last_active":"2024-09-12T01:08:16.493580+0000","last_peered":"2024-09-12T01:08:16.493580+0000","last_clean":"2024-09-12T01:08:16.493580+0000","last_became_active":"2024-09-12T00:56:52.994132+0000","last_became_peered":"2024-09-12T00:56:52.994132+0000","last_unstale":"2024-09-12T01:08:16.493580+0000","last_undegraded":"2024-09-12T01:08:16.493580+0000","last_fullsized":"2024-09-12T01:08:16.493580+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:57.349446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.218560+0000","last_change":"2024-09-12T00:46:19.281067+0000","last_active":"2024-09-12T01:11:24.218560+0000","last_peered":"2024-09-12T01:11:24.218560+0000","last_clean":"2024-09-12T01:11:24.218560+0000","last_became_active":"2024-09-12T00:46:19.280726+0000","last_became_peered":"2024-09-12T00:46:19.280726+0000","last_unstale":"2024-09-12T01:11:24.218560+0000","last_undegraded":"2024-09-12T01:11:24.218560+0000","last_fullsized":"2024-09-12T01:11:24.218560+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:00.902460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:07.490813+0000","last_change":"2024-09-12T00:46:16.276183+0000","last_active":"2024-09-12T01:10:07.490813+0000","last_peered":"2024-09-12T01:10:07.490813+0000","last_clean":"2024-09-12T01:10:07.490813+0000","last_became_active":"2024-09-12T00:46:16.275908+0000","last_became_peered":"2024-09-12T00:46:16.275908+0000","last_unstale":"2024-09-12T01:10:07.490813+0000","last_undegraded":"2024-09-12T01:10:07.490813+0000","last_fullsized":"2024-09-12T01:10:07.490813+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:52.232454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496227+0000","last_change":"2024-09-12T00:44:37.812084+0000","last_active":"2024-09-12T01:08:36.496227+0000","last_peered":"2024-09-12T01:08:36.496227+0000","last_clean":"2024-09-12T01:08:36.496227+0000","last_became_active":"2024-09-12T00:44:37.811613+0000","last_became_peered":"2024-09-12T00:44:37.811613+0000","last_unstale":"2024-09-12T01:08:36.496227+0000","last_undegraded":"2024-09-12T01:08:36.496227+0000","last_fullsized":"2024-09-12T01:08:36.496227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:51.317906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520108+0000","last_change":"2024-09-12T00:56:52.989823+0000","last_active":"2024-09-12T01:08:08.520108+0000","last_peered":"2024-09-12T01:08:08.520108+0000","last_clean":"2024-09-12T01:08:08.520108+0000","last_became_active":"2024-09-12T00:56:52.989552+0000","last_became_peered":"2024-09-12T00:56:52.989552+0000","last_unstale":"2024-09-12T01:08:08.520108+0000","last_undegraded":"2024-09-12T01:08:08.520108+0000","last_fullsized":"2024-09-12T01:08:08.520108+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:32.733496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390164+0000","last_change":"2024-09-12T00:46:19.282416+0000","last_active":"2024-09-12T01:08:52.390164+0000","last_peered":"2024-09-12T01:08:52.390164+0000","last_clean":"2024-09-12T01:08:52.390164+0000","last_became_active":"2024-09-12T00:46:19.282137+0000","last_became_peered":"2024-09-12T00:46:19.282137+0000","last_unstale":"2024-09-12T01:08:52.390164+0000","last_undegraded":"2024-09-12T01:08:52.390164+0000","last_fullsized":"2024-09-12T01:08:52.390164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:16.519283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557118+0000","last_change":"2024-09-12T00:46:16.274482+0000","last_active":"2024-09-12T01:11:22.557118+0000","last_peered":"2024-09-12T01:11:22.557118+0000","last_clean":"2024-09-12T01:11:22.557118+0000","last_became_active":"2024-09-12T00:46:16.274198+0000","last_became_peered":"2024-09-12T00:46:16.274198+0000","last_unstale":"2024-09-12T01:11:22.557118+0000","last_undegraded":"2024-09-12T01:11:22.557118+0000","last_fullsized":"2024-09-12T01:11:22.557118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:47.458869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2619,"num_write":4,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475262+0000","last_change":"2024-09-12T00:44:37.814764+0000","last_active":"2024-09-12T01:08:27.475262+0000","last_peered":"2024-09-12T01:08:27.475262+0000","last_clean":"2024-09-12T01:08:27.475262+0000","last_became_active":"2024-09-12T00:44:37.814480+0000","last_became_peered":"2024-09-12T00:44:37.814480+0000","last_unstale":"2024-09-12T01:08:27.475262+0000","last_undegraded":"2024-09-12T01:08:27.475262+0000","last_fullsized":"2024-09-12T01:08:27.475262+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:18.473305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383351+0000","last_change":"2024-09-12T00:56:52.997107+0000","last_active":"2024-09-12T01:08:08.383351+0000","last_peered":"2024-09-12T01:08:08.383351+0000","last_clean":"2024-09-12T01:08:08.383351+0000","last_became_active":"2024-09-12T00:56:52.996816+0000","last_became_peered":"2024-09-12T00:56:52.996816+0000","last_unstale":"2024-09-12T01:08:08.383351+0000","last_undegraded":"2024-09-12T01:08:08.383351+0000","last_fullsized":"2024-09-12T01:08:08.383351+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:21.071571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:13.534332+0000","last_change":"2024-09-12T00:46:19.276670+0000","last_active":"2024-09-12T01:10:13.534332+0000","last_peered":"2024-09-12T01:10:13.534332+0000","last_clean":"2024-09-12T01:10:13.534332+0000","last_became_active":"2024-09-12T00:46:19.276366+0000","last_became_peered":"2024-09-12T00:46:19.276366+0000","last_unstale":"2024-09-12T01:10:13.534332+0000","last_undegraded":"2024-09-12T01:10:13.534332+0000","last_fullsized":"2024-09-12T01:10:13.534332+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:52.413983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.604649+0000","last_change":"2024-09-12T00:46:16.274311+0000","last_active":"2024-09-12T01:08:48.604649+0000","last_peered":"2024-09-12T01:08:48.604649+0000","last_clean":"2024-09-12T01:08:48.604649+0000","last_became_active":"2024-09-12T00:46:16.273821+0000","last_became_peered":"2024-09-12T00:46:16.273821+0000","last_unstale":"2024-09-12T01:08:48.604649+0000","last_undegraded":"2024-09-12T01:08:48.604649+0000","last_fullsized":"2024-09-12T01:08:48.604649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:14.476953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.522282+0000","last_change":"2024-09-12T00:44:37.817651+0000","last_active":"2024-09-12T01:08:28.522282+0000","last_peered":"2024-09-12T01:08:28.522282+0000","last_clean":"2024-09-12T01:08:28.522282+0000","last_became_active":"2024-09-12T00:44:37.817357+0000","last_became_peered":"2024-09-12T00:44:37.817357+0000","last_unstale":"2024-09-12T01:08:28.522282+0000","last_undegraded":"2024-09-12T01:08:28.522282+0000","last_fullsized":"2024-09-12T01:08:28.522282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:32.676919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.528666+0000","last_change":"2024-09-12T00:56:52.991150+0000","last_active":"2024-09-12T01:09:23.528666+0000","last_peered":"2024-09-12T01:09:23.528666+0000","last_clean":"2024-09-12T01:09:23.528666+0000","last_became_active":"2024-09-12T00:56:52.990450+0000","last_became_peered":"2024-09-12T00:56:52.990450+0000","last_unstale":"2024-09-12T01:09:23.528666+0000","last_undegraded":"2024-09-12T01:09:23.528666+0000","last_fullsized":"2024-09-12T01:09:23.528666+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:08.753872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.218151+0000","last_change":"2024-09-12T00:46:19.281700+0000","last_active":"2024-09-12T01:11:24.218151+0000","last_peered":"2024-09-12T01:11:24.218151+0000","last_clean":"2024-09-12T01:11:24.218151+0000","last_became_active":"2024-09-12T00:46:19.281413+0000","last_became_peered":"2024-09-12T00:46:19.281413+0000","last_unstale":"2024-09-12T01:11:24.218151+0000","last_undegraded":"2024-09-12T01:11:24.218151+0000","last_fullsized":"2024-09-12T01:11:24.218151+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:32.000629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16941,"num_write":8,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"264'8","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.055888+0000","last_change":"2024-09-12T00:46:16.272138+0000","last_active":"2024-09-12T01:11:23.055888+0000","last_peered":"2024-09-12T01:11:23.055888+0000","last_clean":"2024-09-12T01:11:23.055888+0000","last_became_active":"2024-09-12T00:46:16.271730+0000","last_became_peered":"2024-09-12T00:46:16.271730+0000","last_unstale":"2024-09-12T01:11:23.055888+0000","last_undegraded":"2024-09-12T01:11:23.055888+0000","last_fullsized":"2024-09-12T01:11:23.055888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:24.991885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11841,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516358+0000","last_change":"2024-09-12T00:44:37.815831+0000","last_active":"2024-09-12T01:08:27.516358+0000","last_peered":"2024-09-12T01:08:27.516358+0000","last_clean":"2024-09-12T01:08:27.516358+0000","last_became_active":"2024-09-12T00:44:37.815542+0000","last_became_peered":"2024-09-12T00:44:37.815542+0000","last_unstale":"2024-09-12T01:08:27.516358+0000","last_undegraded":"2024-09-12T01:08:27.516358+0000","last_fullsized":"2024-09-12T01:08:27.516358+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.238225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":55,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.528696+0000","last_change":"2024-09-12T00:56:52.988965+0000","last_active":"2024-09-12T01:09:23.528696+0000","last_peered":"2024-09-12T01:09:23.528696+0000","last_clean":"2024-09-12T01:09:23.528696+0000","last_became_active":"2024-09-12T00:56:52.988702+0000","last_became_peered":"2024-09-12T00:56:52.988702+0000","last_unstale":"2024-09-12T01:09:23.528696+0000","last_undegraded":"2024-09-12T01:09:23.528696+0000","last_fullsized":"2024-09-12T01:09:23.528696+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:28.810429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.501938+0000","last_change":"2024-09-12T00:46:19.277090+0000","last_active":"2024-09-12T01:11:22.501938+0000","last_peered":"2024-09-12T01:11:22.501938+0000","last_clean":"2024-09-12T01:11:22.501938+0000","last_became_active":"2024-09-12T00:46:19.276538+0000","last_became_peered":"2024-09-12T00:46:19.276538+0000","last_unstale":"2024-09-12T01:11:22.501938+0000","last_undegraded":"2024-09-12T01:11:22.501938+0000","last_fullsized":"2024-09-12T01:11:22.501938+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.608027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.542531+0000","last_change":"2024-09-12T00:46:16.273158+0000","last_active":"2024-09-12T01:11:22.542531+0000","last_peered":"2024-09-12T01:11:22.542531+0000","last_clean":"2024-09-12T01:11:22.542531+0000","last_became_active":"2024-09-12T00:46:16.272892+0000","last_became_peered":"2024-09-12T00:46:16.272892+0000","last_unstale":"2024-09-12T01:11:22.542531+0000","last_undegraded":"2024-09-12T01:11:22.542531+0000","last_fullsized":"2024-09-12T01:11:22.542531+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.867186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"264'6","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.601661+0000","last_change":"2024-09-12T00:44:37.820513+0000","last_active":"2024-09-12T01:08:28.601661+0000","last_peered":"2024-09-12T01:08:28.601661+0000","last_clean":"2024-09-12T01:08:28.601661+0000","last_became_active":"2024-09-12T00:44:37.819232+0000","last_became_peered":"2024-09-12T00:44:37.819232+0000","last_unstale":"2024-09-12T01:08:28.601661+0000","last_undegraded":"2024-09-12T01:08:28.601661+0000","last_fullsized":"2024-09-12T01:08:28.601661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:53.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479701+0000","last_change":"2024-09-12T00:56:52.994822+0000","last_active":"2024-09-12T01:08:57.479701+0000","last_peered":"2024-09-12T01:08:57.479701+0000","last_clean":"2024-09-12T01:08:57.479701+0000","last_became_active":"2024-09-12T00:56:52.994128+0000","last_became_peered":"2024-09-12T00:56:52.994128+0000","last_unstale":"2024-09-12T01:08:57.479701+0000","last_undegraded":"2024-09-12T01:08:57.479701+0000","last_fullsized":"2024-09-12T01:08:57.479701+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:23.628943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.533743+0000","last_change":"2024-09-12T00:46:19.282799+0000","last_active":"2024-09-12T01:10:08.533743+0000","last_peered":"2024-09-12T01:10:08.533743+0000","last_clean":"2024-09-12T01:10:08.533743+0000","last_became_active":"2024-09-12T00:46:19.281782+0000","last_became_peered":"2024-09-12T00:46:19.281782+0000","last_unstale":"2024-09-12T01:10:08.533743+0000","last_undegraded":"2024-09-12T01:10:08.533743+0000","last_fullsized":"2024-09-12T01:10:08.533743+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:46.964297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.490914+0000","last_change":"2024-09-12T00:46:16.274107+0000","last_active":"2024-09-12T01:07:56.490914+0000","last_peered":"2024-09-12T01:07:56.490914+0000","last_clean":"2024-09-12T01:07:56.490914+0000","last_became_active":"2024-09-12T00:46:16.273356+0000","last_became_peered":"2024-09-12T00:46:16.273356+0000","last_unstale":"2024-09-12T01:07:56.490914+0000","last_undegraded":"2024-09-12T01:07:56.490914+0000","last_fullsized":"2024-09-12T01:07:56.490914+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:14.769067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'16","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.488931+0000","last_change":"2024-09-12T00:44:37.818413+0000","last_active":"2024-09-12T01:07:41.488931+0000","last_peered":"2024-09-12T01:07:41.488931+0000","last_clean":"2024-09-12T01:07:41.488931+0000","last_became_active":"2024-09-12T00:44:37.818054+0000","last_became_peered":"2024-09-12T00:44:37.818054+0000","last_unstale":"2024-09-12T01:07:41.488931+0000","last_undegraded":"2024-09-12T01:07:41.488931+0000","last_fullsized":"2024-09-12T01:07:41.488931+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:10.843685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.609549+0000","last_change":"2024-09-12T00:56:52.991268+0000","last_active":"2024-09-12T01:09:23.609549+0000","last_peered":"2024-09-12T01:09:23.609549+0000","last_clean":"2024-09-12T01:09:23.609549+0000","last_became_active":"2024-09-12T00:56:52.990601+0000","last_became_peered":"2024-09-12T00:56:52.990601+0000","last_unstale":"2024-09-12T01:09:23.609549+0000","last_undegraded":"2024-09-12T01:09:23.609549+0000","last_fullsized":"2024-09-12T01:09:23.609549+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:14.400256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615507+0000","last_change":"2024-09-12T00:46:19.282146+0000","last_active":"2024-09-12T01:10:08.615507+0000","last_peered":"2024-09-12T01:10:08.615507+0000","last_clean":"2024-09-12T01:10:08.615507+0000","last_became_active":"2024-09-12T00:46:19.281732+0000","last_became_peered":"2024-09-12T00:46:19.281732+0000","last_unstale":"2024-09-12T01:10:08.615507+0000","last_undegraded":"2024-09-12T01:10:08.615507+0000","last_fullsized":"2024-09-12T01:10:08.615507+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:55.852331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694639+0000","last_change":"2024-09-12T00:46:16.277570+0000","last_active":"2024-09-12T01:11:22.694639+0000","last_peered":"2024-09-12T01:11:22.694639+0000","last_clean":"2024-09-12T01:11:22.694639+0000","last_became_active":"2024-09-12T00:46:16.277261+0000","last_became_peered":"2024-09-12T00:46:16.277261+0000","last_unstale":"2024-09-12T01:11:22.694639+0000","last_undegraded":"2024-09-12T01:11:22.694639+0000","last_fullsized":"2024-09-12T01:11:22.694639+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:00.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'33","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.645110+0000","last_change":"2024-09-12T00:44:37.818362+0000","last_active":"2024-09-12T01:08:56.645110+0000","last_peered":"2024-09-12T01:08:56.645110+0000","last_clean":"2024-09-12T01:08:56.645110+0000","last_became_active":"2024-09-12T00:44:37.818055+0000","last_became_peered":"2024-09-12T00:44:37.818055+0000","last_unstale":"2024-09-12T01:08:56.645110+0000","last_undegraded":"2024-09-12T01:08:56.645110+0000","last_fullsized":"2024-09-12T01:08:56.645110+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:12.754260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":106,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380147+0000","last_change":"2024-09-12T00:56:52.989699+0000","last_active":"2024-09-12T01:07:43.380147+0000","last_peered":"2024-09-12T01:07:43.380147+0000","last_clean":"2024-09-12T01:07:43.380147+0000","last_became_active":"2024-09-12T00:56:52.989396+0000","last_became_peered":"2024-09-12T00:56:52.989396+0000","last_unstale":"2024-09-12T01:07:43.380147+0000","last_undegraded":"2024-09-12T01:07:43.380147+0000","last_fullsized":"2024-09-12T01:07:43.380147+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.478574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.523445+0000","last_change":"2024-09-12T00:46:19.281553+0000","last_active":"2024-09-12T01:09:17.523445+0000","last_peered":"2024-09-12T01:09:17.523445+0000","last_clean":"2024-09-12T01:09:17.523445+0000","last_became_active":"2024-09-12T00:46:19.281231+0000","last_became_peered":"2024-09-12T00:46:19.281231+0000","last_unstale":"2024-09-12T01:09:17.523445+0000","last_undegraded":"2024-09-12T01:09:17.523445+0000","last_fullsized":"2024-09-12T01:09:17.523445+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:58.529910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"264'7","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694407+0000","last_change":"2024-09-12T00:46:16.277008+0000","last_active":"2024-09-12T01:11:22.694407+0000","last_peered":"2024-09-12T01:11:22.694407+0000","last_clean":"2024-09-12T01:11:22.694407+0000","last_became_active":"2024-09-12T00:46:16.276730+0000","last_became_peered":"2024-09-12T00:46:16.276730+0000","last_unstale":"2024-09-12T01:11:22.694407+0000","last_undegraded":"2024-09-12T01:11:22.694407+0000","last_fullsized":"2024-09-12T01:11:22.694407+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:54.164828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7172,"num_write":12,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'54","reported_seq":199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.488274+0000","last_change":"2024-09-12T00:44:37.817537+0000","last_active":"2024-09-12T01:07:36.488274+0000","last_peered":"2024-09-12T01:07:36.488274+0000","last_clean":"2024-09-12T01:07:36.488274+0000","last_became_active":"2024-09-12T00:44:37.817249+0000","last_became_peered":"2024-09-12T00:44:37.817249+0000","last_unstale":"2024-09-12T01:07:36.488274+0000","last_undegraded":"2024-09-12T01:07:36.488274+0000","last_fullsized":"2024-09-12T01:07:36.488274+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.627057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":217,"num_write":83,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510158+0000","last_change":"2024-09-12T00:56:52.993381+0000","last_active":"2024-09-12T01:07:42.510158+0000","last_peered":"2024-09-12T01:07:42.510158+0000","last_clean":"2024-09-12T01:07:42.510158+0000","last_became_active":"2024-09-12T00:56:52.992289+0000","last_became_peered":"2024-09-12T00:56:52.992289+0000","last_unstale":"2024-09-12T01:07:42.510158+0000","last_undegraded":"2024-09-12T01:07:42.510158+0000","last_fullsized":"2024-09-12T01:07:42.510158+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:39.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.600810+0000","last_change":"2024-09-12T00:46:19.281027+0000","last_active":"2024-09-12T01:08:23.600810+0000","last_peered":"2024-09-12T01:08:23.600810+0000","last_clean":"2024-09-12T01:08:23.600810+0000","last_became_active":"2024-09-12T00:46:19.280725+0000","last_became_peered":"2024-09-12T00:46:19.280725+0000","last_unstale":"2024-09-12T01:08:23.600810+0000","last_undegraded":"2024-09-12T01:08:23.600810+0000","last_fullsized":"2024-09-12T01:08:23.600810+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:05.148455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.608121+0000","last_change":"2024-09-12T00:46:16.272821+0000","last_active":"2024-09-12T01:09:13.608121+0000","last_peered":"2024-09-12T01:09:13.608121+0000","last_clean":"2024-09-12T01:09:13.608121+0000","last_became_active":"2024-09-12T00:46:16.272417+0000","last_became_peered":"2024-09-12T00:46:16.272417+0000","last_unstale":"2024-09-12T01:09:13.608121+0000","last_undegraded":"2024-09-12T01:09:13.608121+0000","last_fullsized":"2024-09-12T01:09:13.608121+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:30.234992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2052,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'44","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594575+0000","last_change":"2024-09-12T00:44:37.818360+0000","last_active":"2024-09-12T01:07:33.594575+0000","last_peered":"2024-09-12T01:07:33.594575+0000","last_clean":"2024-09-12T01:07:33.594575+0000","last_became_active":"2024-09-12T00:44:37.815722+0000","last_became_peered":"2024-09-12T00:44:37.815722+0000","last_unstale":"2024-09-12T01:07:33.594575+0000","last_undegraded":"2024-09-12T01:07:33.594575+0000","last_fullsized":"2024-09-12T01:07:33.594575+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:01.014094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":150,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.483749+0000","last_change":"2024-09-12T00:56:52.993069+0000","last_active":"2024-09-12T01:09:22.483749+0000","last_peered":"2024-09-12T01:09:22.483749+0000","last_clean":"2024-09-12T01:09:22.483749+0000","last_became_active":"2024-09-12T00:56:52.989218+0000","last_became_peered":"2024-09-12T00:56:52.989218+0000","last_unstale":"2024-09-12T01:09:22.483749+0000","last_undegraded":"2024-09-12T01:09:22.483749+0000","last_fullsized":"2024-09-12T01:09:22.483749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:51.764331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.501310+0000","last_change":"2024-09-12T00:46:19.282564+0000","last_active":"2024-09-12T01:09:16.501310+0000","last_peered":"2024-09-12T01:09:16.501310+0000","last_clean":"2024-09-12T01:09:16.501310+0000","last_became_active":"2024-09-12T00:46:19.282270+0000","last_became_peered":"2024-09-12T00:46:19.282270+0000","last_unstale":"2024-09-12T01:09:16.501310+0000","last_undegraded":"2024-09-12T01:09:16.501310+0000","last_fullsized":"2024-09-12T01:09:16.501310+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:43.456680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.392925+0000","last_change":"2024-09-12T00:46:16.276646+0000","last_active":"2024-09-12T01:09:12.392925+0000","last_peered":"2024-09-12T01:09:12.392925+0000","last_clean":"2024-09-12T01:09:12.392925+0000","last_became_active":"2024-09-12T00:46:16.276368+0000","last_became_peered":"2024-09-12T00:46:16.276368+0000","last_unstale":"2024-09-12T01:09:12.392925+0000","last_undegraded":"2024-09-12T01:09:12.392925+0000","last_fullsized":"2024-09-12T01:09:12.392925+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:03.285958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594535+0000","last_change":"2024-09-12T00:44:37.821471+0000","last_active":"2024-09-12T01:07:33.594535+0000","last_peered":"2024-09-12T01:07:33.594535+0000","last_clean":"2024-09-12T01:07:33.594535+0000","last_became_active":"2024-09-12T00:44:37.821172+0000","last_became_peered":"2024-09-12T00:44:37.821172+0000","last_unstale":"2024-09-12T01:07:33.594535+0000","last_undegraded":"2024-09-12T01:07:33.594535+0000","last_fullsized":"2024-09-12T01:07:33.594535+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:46.622590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":156,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.592791+0000","last_change":"2024-09-12T00:56:52.993348+0000","last_active":"2024-09-12T01:07:23.592791+0000","last_peered":"2024-09-12T01:07:23.592791+0000","last_clean":"2024-09-12T01:07:23.592791+0000","last_became_active":"2024-09-12T00:56:52.993079+0000","last_became_peered":"2024-09-12T00:56:52.993079+0000","last_unstale":"2024-09-12T01:07:23.592791+0000","last_undegraded":"2024-09-12T01:07:23.592791+0000","last_fullsized":"2024-09-12T01:07:23.592791+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:13.494808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.517662+0000","last_change":"2024-09-12T00:46:19.279921+0000","last_active":"2024-09-12T01:11:21.517662+0000","last_peered":"2024-09-12T01:11:21.517662+0000","last_clean":"2024-09-12T01:11:21.517662+0000","last_became_active":"2024-09-12T00:46:19.279630+0000","last_became_peered":"2024-09-12T00:46:19.279630+0000","last_unstale":"2024-09-12T01:11:21.517662+0000","last_undegraded":"2024-09-12T01:11:21.517662+0000","last_fullsized":"2024-09-12T01:11:21.517662+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.231021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.427462+0000","last_change":"2024-09-12T00:46:16.267218+0000","last_active":"2024-09-12T01:11:18.427462+0000","last_peered":"2024-09-12T01:11:18.427462+0000","last_clean":"2024-09-12T01:11:18.427462+0000","last_became_active":"2024-09-12T00:46:16.266854+0000","last_became_peered":"2024-09-12T00:46:16.266854+0000","last_unstale":"2024-09-12T01:11:18.427462+0000","last_undegraded":"2024-09-12T01:11:18.427462+0000","last_fullsized":"2024-09-12T01:11:18.427462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:46.629498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'16","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.497466+0000","last_change":"2024-09-12T00:44:37.822549+0000","last_active":"2024-09-12T01:08:46.497466+0000","last_peered":"2024-09-12T01:08:46.497466+0000","last_clean":"2024-09-12T01:08:46.497466+0000","last_became_active":"2024-09-12T00:44:37.822277+0000","last_became_peered":"2024-09-12T00:44:37.822277+0000","last_unstale":"2024-09-12T01:08:46.497466+0000","last_undegraded":"2024-09-12T01:08:46.497466+0000","last_fullsized":"2024-09-12T01:08:46.497466+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.547476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'407","reported_seq":1178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.836214+0000","last_change":"2024-09-12T00:30:11.108085+0000","last_active":"2024-09-12T01:11:24.836214+0000","last_peered":"2024-09-12T01:11:24.836214+0000","last_clean":"2024-09-12T01:11:24.836214+0000","last_became_active":"2024-09-12T00:30:11.107706+0000","last_became_peered":"2024-09-12T00:30:11.107706+0000","last_unstale":"2024-09-12T01:11:24.836214+0000","last_undegraded":"2024-09-12T01:11:24.836214+0000","last_fullsized":"2024-09-12T01:11:24.836214+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.042423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436870,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":772,"num_read_kb":12989,"num_write":1306,"num_write_kb":41879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'141","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.303738+0000","last_change":"2024-09-12T00:30:13.128059+0000","last_active":"2024-09-12T01:10:50.303738+0000","last_peered":"2024-09-12T01:10:50.303738+0000","last_clean":"2024-09-12T01:10:50.303738+0000","last_became_active":"2024-09-12T00:30:13.126147+0000","last_became_peered":"2024-09-12T00:30:13.126147+0000","last_unstale":"2024-09-12T01:10:50.303738+0000","last_undegraded":"2024-09-12T01:10:50.303738+0000","last_fullsized":"2024-09-12T01:10:50.303738+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:08.534438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":527,"num_write":201,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'354","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.801303+0000","last_change":"2024-09-12T00:30:11.101673+0000","last_active":"2024-09-12T01:11:24.801303+0000","last_peered":"2024-09-12T01:11:24.801303+0000","last_clean":"2024-09-12T01:11:24.801303+0000","last_became_active":"2024-09-12T00:30:11.101252+0000","last_became_peered":"2024-09-12T00:30:11.101252+0000","last_unstale":"2024-09-12T01:11:24.801303+0000","last_undegraded":"2024-09-12T01:11:24.801303+0000","last_fullsized":"2024-09-12T01:11:24.801303+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:24.037331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":19965,"num_write":1084,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'209","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:30.236873+0000","last_change":"2024-09-12T00:30:13.124111+0000","last_active":"2024-09-12T01:09:30.236873+0000","last_peered":"2024-09-12T01:09:30.236873+0000","last_clean":"2024-09-12T01:09:30.236873+0000","last_became_active":"2024-09-12T00:30:13.123880+0000","last_became_peered":"2024-09-12T00:30:13.123880+0000","last_unstale":"2024-09-12T01:09:30.236873+0000","last_undegraded":"2024-09-12T01:09:30.236873+0000","last_fullsized":"2024-09-12T01:09:30.236873+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:41.642173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":720,"num_write":314,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'300","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.852629+0000","last_change":"2024-09-12T00:30:11.096844+0000","last_active":"2024-09-12T01:11:24.852629+0000","last_peered":"2024-09-12T01:11:24.852629+0000","last_clean":"2024-09-12T01:11:24.852629+0000","last_became_active":"2024-09-12T00:30:11.096381+0000","last_became_peered":"2024-09-12T00:30:11.096381+0000","last_unstale":"2024-09-12T01:11:24.852629+0000","last_undegraded":"2024-09-12T01:11:24.852629+0000","last_fullsized":"2024-09-12T01:11:24.852629+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:57.955383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155766,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":52760,"num_write":991,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'151","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.489637+0000","last_change":"2024-09-12T00:30:13.121126+0000","last_active":"2024-09-12T01:08:45.489637+0000","last_peered":"2024-09-12T01:08:45.489637+0000","last_clean":"2024-09-12T01:08:45.489637+0000","last_became_active":"2024-09-12T00:30:13.120834+0000","last_became_peered":"2024-09-12T00:30:13.120834+0000","last_unstale":"2024-09-12T01:08:45.489637+0000","last_undegraded":"2024-09-12T01:08:45.489637+0000","last_fullsized":"2024-09-12T01:08:45.489637+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:48.681924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":556,"num_write":237,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'320","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.836168+0000","last_change":"2024-09-12T00:30:11.102160+0000","last_active":"2024-09-12T01:11:24.836168+0000","last_peered":"2024-09-12T01:11:24.836168+0000","last_clean":"2024-09-12T01:11:24.836168+0000","last_became_active":"2024-09-12T00:30:11.101773+0000","last_became_peered":"2024-09-12T00:30:11.101773+0000","last_unstale":"2024-09-12T01:11:24.836168+0000","last_undegraded":"2024-09-12T01:11:24.836168+0000","last_fullsized":"2024-09-12T01:11:24.836168+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:43.867988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262280,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":453,"num_read_kb":6783,"num_write":940,"num_write_kb":20709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4368","reported_seq":4967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.603185+0000","last_change":"2024-09-12T00:30:13.114180+0000","last_active":"2024-09-12T01:07:47.603185+0000","last_peered":"2024-09-12T01:07:47.603185+0000","last_clean":"2024-09-12T01:07:47.603185+0000","last_became_active":"2024-09-12T00:30:13.113812+0000","last_became_peered":"2024-09-12T00:30:13.113812+0000","last_unstale":"2024-09-12T01:07:47.603185+0000","last_undegraded":"2024-09-12T01:07:47.603185+0000","last_fullsized":"2024-09-12T01:07:47.603185+0000","mapping_epoch":28,"log_start":"264'4300","ondisk_log_start":"264'4300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:35.040266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17553,"num_read_kb":14742,"num_write":6586,"num_write_kb":3311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'326","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.750745+0000","last_change":"2024-09-12T00:30:11.098446+0000","last_active":"2024-09-12T01:11:24.750745+0000","last_peered":"2024-09-12T01:11:24.750745+0000","last_clean":"2024-09-12T01:11:24.750745+0000","last_became_active":"2024-09-12T00:30:11.097339+0000","last_became_peered":"2024-09-12T00:30:11.097339+0000","last_unstale":"2024-09-12T01:11:24.750745+0000","last_undegraded":"2024-09-12T01:11:24.750745+0000","last_fullsized":"2024-09-12T01:11:24.750745+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:40.707199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":4533,"num_write":1139,"num_write_kb":19662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"264'201","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.028978+0000","last_change":"2024-09-12T00:30:13.125647+0000","last_active":"2024-09-12T01:08:21.028978+0000","last_peered":"2024-09-12T01:08:21.028978+0000","last_clean":"2024-09-12T01:08:21.028978+0000","last_became_active":"2024-09-12T00:30:13.125363+0000","last_became_peered":"2024-09-12T00:30:13.125363+0000","last_unstale":"2024-09-12T01:08:21.028978+0000","last_undegraded":"2024-09-12T01:08:21.028978+0000","last_fullsized":"2024-09-12T01:08:21.028978+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:56.486136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":845,"num_read_kb":691,"num_write":311,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'352","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.770078+0000","last_change":"2024-09-12T00:30:11.104965+0000","last_active":"2024-09-12T01:11:24.770078+0000","last_peered":"2024-09-12T01:11:24.770078+0000","last_clean":"2024-09-12T01:11:24.770078+0000","last_became_active":"2024-09-12T00:30:11.104535+0000","last_became_peered":"2024-09-12T00:30:11.104535+0000","last_unstale":"2024-09-12T01:11:24.770078+0000","last_undegraded":"2024-09-12T01:11:24.770078+0000","last_fullsized":"2024-09-12T01:11:24.770078+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:02.250566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174750,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":66788,"num_write":989,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'115","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.522736+0000","last_change":"2024-09-12T00:30:13.125175+0000","last_active":"2024-09-12T01:08:53.522736+0000","last_peered":"2024-09-12T01:08:53.522736+0000","last_clean":"2024-09-12T01:08:53.522736+0000","last_became_active":"2024-09-12T00:30:13.124774+0000","last_became_peered":"2024-09-12T00:30:13.124774+0000","last_unstale":"2024-09-12T01:08:53.522736+0000","last_undegraded":"2024-09-12T01:08:53.522736+0000","last_fullsized":"2024-09-12T01:08:53.522736+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:17.846970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":451,"num_write":180,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'309","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.788804+0000","last_change":"2024-09-12T00:30:11.102635+0000","last_active":"2024-09-12T01:11:24.788804+0000","last_peered":"2024-09-12T01:11:24.788804+0000","last_clean":"2024-09-12T01:11:24.788804+0000","last_became_active":"2024-09-12T00:30:11.102281+0000","last_became_peered":"2024-09-12T00:30:11.102281+0000","last_unstale":"2024-09-12T01:11:24.788804+0000","last_undegraded":"2024-09-12T01:11:24.788804+0000","last_fullsized":"2024-09-12T01:11:24.788804+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:36.443637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3622998,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":454,"num_read_kb":13880,"num_write":954,"num_write_kb":40348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'544","reported_seq":1240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.564544+0000","last_change":"2024-09-12T00:30:13.126388+0000","last_active":"2024-09-12T01:09:22.564544+0000","last_peered":"2024-09-12T01:09:22.564544+0000","last_clean":"2024-09-12T01:09:22.564544+0000","last_became_active":"2024-09-12T00:30:13.126123+0000","last_became_peered":"2024-09-12T00:30:13.126123+0000","last_unstale":"2024-09-12T01:09:22.564544+0000","last_undegraded":"2024-09-12T01:09:22.564544+0000","last_fullsized":"2024-09-12T01:09:22.564544+0000","mapping_epoch":28,"log_start":"264'500","ondisk_log_start":"264'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:46.451607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2509,"num_read_kb":2200,"num_write":899,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'299","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.785839+0000","last_change":"2024-09-12T00:30:11.104564+0000","last_active":"2024-09-12T01:11:24.785839+0000","last_peered":"2024-09-12T01:11:24.785839+0000","last_clean":"2024-09-12T01:11:24.785839+0000","last_became_active":"2024-09-12T00:30:11.104084+0000","last_became_peered":"2024-09-12T00:30:11.104084+0000","last_unstale":"2024-09-12T01:11:24.785839+0000","last_undegraded":"2024-09-12T01:11:24.785839+0000","last_fullsized":"2024-09-12T01:11:24.785839+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:20.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":483,"num_read_kb":14633,"num_write":970,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'231","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.849014+0000","last_change":"2024-09-12T00:30:13.129106+0000","last_active":"2024-09-12T01:09:15.849014+0000","last_peered":"2024-09-12T01:09:15.849014+0000","last_clean":"2024-09-12T01:09:15.849014+0000","last_became_active":"2024-09-12T00:30:13.127581+0000","last_became_peered":"2024-09-12T00:30:13.127581+0000","last_unstale":"2024-09-12T01:09:15.849014+0000","last_undegraded":"2024-09-12T01:09:15.849014+0000","last_fullsized":"2024-09-12T01:09:15.849014+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:37.451443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1008,"num_read_kb":834,"num_write":338,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'462","reported_seq":1238,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.335798+0000","last_change":"2024-09-12T00:30:13.121457+0000","last_active":"2024-09-12T01:08:46.335798+0000","last_peered":"2024-09-12T01:08:46.335798+0000","last_clean":"2024-09-12T01:08:46.335798+0000","last_became_active":"2024-09-12T00:30:13.121154+0000","last_became_peered":"2024-09-12T00:30:13.121154+0000","last_unstale":"2024-09-12T01:08:46.335798+0000","last_undegraded":"2024-09-12T01:08:46.335798+0000","last_fullsized":"2024-09-12T01:08:46.335798+0000","mapping_epoch":28,"log_start":"264'400","ondisk_log_start":"264'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:30.709632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2284,"num_read_kb":1967,"num_write":806,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'287","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.847281+0000","last_change":"2024-09-12T00:30:11.103793+0000","last_active":"2024-09-12T01:11:24.847281+0000","last_peered":"2024-09-12T01:11:24.847281+0000","last_clean":"2024-09-12T01:11:24.847281+0000","last_became_active":"2024-09-12T00:30:11.103437+0000","last_became_peered":"2024-09-12T00:30:11.103437+0000","last_unstale":"2024-09-12T01:11:24.847281+0000","last_undegraded":"2024-09-12T01:11:24.847281+0000","last_fullsized":"2024-09-12T01:11:24.847281+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:00.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767235,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":430,"num_read_kb":35388,"num_write":888,"num_write_kb":32368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'227","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.699341+0000","last_change":"2024-09-12T00:30:13.129323+0000","last_active":"2024-09-12T01:08:47.699341+0000","last_peered":"2024-09-12T01:08:47.699341+0000","last_clean":"2024-09-12T01:08:47.699341+0000","last_became_active":"2024-09-12T00:30:13.128977+0000","last_became_peered":"2024-09-12T00:30:13.128977+0000","last_unstale":"2024-09-12T01:08:47.699341+0000","last_undegraded":"2024-09-12T01:08:47.699341+0000","last_fullsized":"2024-09-12T01:08:47.699341+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:56.133929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1058,"num_read_kb":878,"num_write":388,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'310","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.757363+0000","last_change":"2024-09-12T00:30:11.115651+0000","last_active":"2024-09-12T01:11:24.757363+0000","last_peered":"2024-09-12T01:11:24.757363+0000","last_clean":"2024-09-12T01:11:24.757363+0000","last_became_active":"2024-09-12T00:30:11.114961+0000","last_became_peered":"2024-09-12T00:30:11.114961+0000","last_unstale":"2024-09-12T01:11:24.757363+0000","last_undegraded":"2024-09-12T01:11:24.757363+0000","last_fullsized":"2024-09-12T01:11:24.757363+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:14.975869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":433,"num_read_kb":13562,"num_write":946,"num_write_kb":25787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'212","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.269904+0000","last_change":"2024-09-12T00:30:13.127448+0000","last_active":"2024-09-12T01:09:09.269904+0000","last_peered":"2024-09-12T01:09:09.269904+0000","last_clean":"2024-09-12T01:09:09.269904+0000","last_became_active":"2024-09-12T00:30:13.127190+0000","last_became_peered":"2024-09-12T00:30:13.127190+0000","last_unstale":"2024-09-12T01:09:09.269904+0000","last_undegraded":"2024-09-12T01:09:09.269904+0000","last_fullsized":"2024-09-12T01:09:09.269904+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:54.603682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":739,"num_write":341,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'368","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.853318+0000","last_change":"2024-09-12T00:30:11.106208+0000","last_active":"2024-09-12T01:11:24.853318+0000","last_peered":"2024-09-12T01:11:24.853318+0000","last_clean":"2024-09-12T01:11:24.853318+0000","last_became_active":"2024-09-12T00:30:11.105844+0000","last_became_peered":"2024-09-12T00:30:11.105844+0000","last_unstale":"2024-09-12T01:11:24.853318+0000","last_undegraded":"2024-09-12T01:11:24.853318+0000","last_fullsized":"2024-09-12T01:11:24.853318+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:53.358144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242896,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":46849,"num_write":1178,"num_write_kb":40470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'183","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390220+0000","last_change":"2024-09-12T00:30:13.125263+0000","last_active":"2024-09-12T01:08:52.390220+0000","last_peered":"2024-09-12T01:08:52.390220+0000","last_clean":"2024-09-12T01:08:52.390220+0000","last_became_active":"2024-09-12T00:30:13.124627+0000","last_became_peered":"2024-09-12T00:30:13.124627+0000","last_unstale":"2024-09-12T01:08:52.390220+0000","last_undegraded":"2024-09-12T01:08:52.390220+0000","last_fullsized":"2024-09-12T01:08:52.390220+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:42.412103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":804,"num_read_kb":662,"num_write":262,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'315","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.713046+0000","last_change":"2024-09-12T00:30:11.114785+0000","last_active":"2024-09-12T01:11:24.713046+0000","last_peered":"2024-09-12T01:11:24.713046+0000","last_clean":"2024-09-12T01:11:24.713046+0000","last_became_active":"2024-09-12T00:30:11.114309+0000","last_became_peered":"2024-09-12T00:30:11.114309+0000","last_unstale":"2024-09-12T01:11:24.713046+0000","last_undegraded":"2024-09-12T01:11:24.713046+0000","last_fullsized":"2024-09-12T01:11:24.713046+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.364638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052685,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":64152,"num_write":970,"num_write_kb":27626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'205","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479130+0000","last_change":"2024-09-12T00:30:13.129990+0000","last_active":"2024-09-12T01:08:52.479130+0000","last_peered":"2024-09-12T01:08:52.479130+0000","last_clean":"2024-09-12T01:08:52.479130+0000","last_became_active":"2024-09-12T00:30:13.129718+0000","last_became_peered":"2024-09-12T00:30:13.129718+0000","last_unstale":"2024-09-12T01:08:52.479130+0000","last_undegraded":"2024-09-12T01:08:52.479130+0000","last_fullsized":"2024-09-12T01:08:52.479130+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:07.835287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":749,"num_write":336,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'388","reported_seq":1044,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.838040+0000","last_change":"2024-09-12T00:30:11.109350+0000","last_active":"2024-09-12T01:11:24.838040+0000","last_peered":"2024-09-12T01:11:24.838040+0000","last_clean":"2024-09-12T01:11:24.838040+0000","last_became_active":"2024-09-12T00:30:11.108958+0000","last_became_peered":"2024-09-12T00:30:11.108958+0000","last_unstale":"2024-09-12T01:11:24.838040+0000","last_undegraded":"2024-09-12T01:11:24.838040+0000","last_fullsized":"2024-09-12T01:11:24.838040+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:47.014408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1489630,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":577,"num_read_kb":32016,"num_write":1378,"num_write_kb":50601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'152","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.409340+0000","last_change":"2024-09-12T00:30:13.126434+0000","last_active":"2024-09-12T01:08:53.409340+0000","last_peered":"2024-09-12T01:08:53.409340+0000","last_clean":"2024-09-12T01:08:53.409340+0000","last_became_active":"2024-09-12T00:30:13.126143+0000","last_became_peered":"2024-09-12T00:30:13.126143+0000","last_unstale":"2024-09-12T01:08:53.409340+0000","last_undegraded":"2024-09-12T01:08:53.409340+0000","last_fullsized":"2024-09-12T01:08:53.409340+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:20.649913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":565,"num_write":225,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'347","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.819421+0000","last_change":"2024-09-12T00:30:11.096841+0000","last_active":"2024-09-12T01:11:24.819421+0000","last_peered":"2024-09-12T01:11:24.819421+0000","last_clean":"2024-09-12T01:11:24.819421+0000","last_became_active":"2024-09-12T00:30:11.096162+0000","last_became_peered":"2024-09-12T00:30:11.096162+0000","last_unstale":"2024-09-12T01:11:24.819421+0000","last_undegraded":"2024-09-12T01:11:24.819421+0000","last_fullsized":"2024-09-12T01:11:24.819421+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:02.238568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340490,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":7249,"num_write":983,"num_write_kb":14577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'148","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.879667+0000","last_change":"2024-09-12T00:30:21.192901+0000","last_active":"2024-09-12T01:09:46.879667+0000","last_peered":"2024-09-12T01:09:46.879667+0000","last_clean":"2024-09-12T01:09:46.879667+0000","last_became_active":"2024-09-12T00:30:21.192654+0000","last_became_peered":"2024-09-12T00:30:21.192654+0000","last_unstale":"2024-09-12T01:09:46.879667+0000","last_undegraded":"2024-09-12T01:09:46.879667+0000","last_fullsized":"2024-09-12T01:09:46.879667+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:51.831265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":350,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'101","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.979565+0000","last_change":"2024-09-12T00:30:13.130308+0000","last_active":"2024-09-12T01:08:53.979565+0000","last_peered":"2024-09-12T01:08:53.979565+0000","last_clean":"2024-09-12T01:08:53.979565+0000","last_became_active":"2024-09-12T00:30:13.130030+0000","last_became_peered":"2024-09-12T00:30:13.130030+0000","last_unstale":"2024-09-12T01:08:53.979565+0000","last_undegraded":"2024-09-12T01:08:53.979565+0000","last_fullsized":"2024-09-12T01:08:53.979565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:14.502318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":143,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'440","reported_seq":1093,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.848349+0000","last_change":"2024-09-12T00:30:46.767993+0000","last_active":"2024-09-12T01:11:24.848349+0000","last_peered":"2024-09-12T01:11:24.848349+0000","last_clean":"2024-09-12T01:11:24.848349+0000","last_became_active":"2024-09-12T00:30:46.767516+0000","last_became_peered":"2024-09-12T00:30:46.767516+0000","last_unstale":"2024-09-12T01:11:24.848349+0000","last_undegraded":"2024-09-12T01:11:24.848349+0000","last_fullsized":"2024-09-12T01:11:24.848349+0000","mapping_epoch":39,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:13.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1451987,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38823,"num_write":1374,"num_write_kb":62705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,4],"acting":[3,5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605940+0000","last_change":"2024-09-12T00:30:15.127353+0000","last_active":"2024-09-12T01:08:58.605940+0000","last_peered":"2024-09-12T01:08:58.605940+0000","last_clean":"2024-09-12T01:08:58.605940+0000","last_became_active":"2024-09-12T00:30:15.127067+0000","last_became_peered":"2024-09-12T00:30:15.127067+0000","last_unstale":"2024-09-12T01:08:58.605940+0000","last_undegraded":"2024-09-12T01:08:58.605940+0000","last_fullsized":"2024-09-12T01:08:58.605940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:01.202011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'324","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.795522+0000","last_change":"2024-09-12T00:30:17.145857+0000","last_active":"2024-09-12T01:11:23.795522+0000","last_peered":"2024-09-12T01:11:23.795522+0000","last_clean":"2024-09-12T01:11:23.795522+0000","last_became_active":"2024-09-12T00:30:17.145455+0000","last_became_peered":"2024-09-12T00:30:17.145455+0000","last_unstale":"2024-09-12T01:11:23.795522+0000","last_undegraded":"2024-09-12T01:11:23.795522+0000","last_fullsized":"2024-09-12T01:11:23.795522+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:25.114718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45268,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":1055,"num_write":410,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409967+0000","last_change":"2024-09-12T00:30:19.168447+0000","last_active":"2024-09-12T01:08:58.409967+0000","last_peered":"2024-09-12T01:08:58.409967+0000","last_clean":"2024-09-12T01:08:58.409967+0000","last_became_active":"2024-09-12T00:30:19.168192+0000","last_became_peered":"2024-09-12T00:30:19.168192+0000","last_unstale":"2024-09-12T01:08:58.409967+0000","last_undegraded":"2024-09-12T01:08:58.409967+0000","last_fullsized":"2024-09-12T01:08:58.409967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:11.131718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'146","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.132064+0000","last_change":"2024-09-12T00:30:21.189447+0000","last_active":"2024-09-12T01:09:43.132064+0000","last_peered":"2024-09-12T01:09:43.132064+0000","last_clean":"2024-09-12T01:09:43.132064+0000","last_became_active":"2024-09-12T00:30:21.189141+0000","last_became_peered":"2024-09-12T00:30:21.189141+0000","last_unstale":"2024-09-12T01:09:43.132064+0000","last_undegraded":"2024-09-12T01:09:43.132064+0000","last_fullsized":"2024-09-12T01:09:43.132064+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:53.347172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":204,"num_write":274,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'90","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.605253+0000","last_change":"2024-09-12T00:30:13.127898+0000","last_active":"2024-09-12T01:08:53.605253+0000","last_peered":"2024-09-12T01:08:53.605253+0000","last_clean":"2024-09-12T01:08:53.605253+0000","last_became_active":"2024-09-12T00:30:13.127577+0000","last_became_peered":"2024-09-12T00:30:13.127577+0000","last_unstale":"2024-09-12T01:08:53.605253+0000","last_undegraded":"2024-09-12T01:08:53.605253+0000","last_fullsized":"2024-09-12T01:08:53.605253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:40.499246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":367,"num_write":144,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'311","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.841396+0000","last_change":"2024-09-12T00:30:11.092270+0000","last_active":"2024-09-12T01:11:24.841396+0000","last_peered":"2024-09-12T01:11:24.841396+0000","last_clean":"2024-09-12T01:11:24.841396+0000","last_became_active":"2024-09-12T00:30:11.091860+0000","last_became_peered":"2024-09-12T00:30:11.091860+0000","last_unstale":"2024-09-12T01:11:24.841396+0000","last_undegraded":"2024-09-12T01:11:24.841396+0000","last_fullsized":"2024-09-12T01:11:24.841396+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:18.340874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":88630,"num_write":981,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510119+0000","last_change":"2024-09-12T00:30:15.130476+0000","last_active":"2024-09-12T01:07:42.510119+0000","last_peered":"2024-09-12T01:07:42.510119+0000","last_clean":"2024-09-12T01:07:42.510119+0000","last_became_active":"2024-09-12T00:30:15.130254+0000","last_became_peered":"2024-09-12T00:30:15.130254+0000","last_unstale":"2024-09-12T01:07:42.510119+0000","last_undegraded":"2024-09-12T01:07:42.510119+0000","last_fullsized":"2024-09-12T01:07:42.510119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.906448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'108","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.183586+0000","last_change":"2024-09-12T00:30:17.148717+0000","last_active":"2024-09-12T01:10:26.183586+0000","last_peered":"2024-09-12T01:10:26.183586+0000","last_clean":"2024-09-12T01:10:26.183586+0000","last_became_active":"2024-09-12T00:30:17.148422+0000","last_became_peered":"2024-09-12T00:30:17.148422+0000","last_unstale":"2024-09-12T01:10:26.183586+0000","last_undegraded":"2024-09-12T01:10:26.183586+0000","last_fullsized":"2024-09-12T01:10:26.183586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:54.544557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":99,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409940+0000","last_change":"2024-09-12T00:30:19.163744+0000","last_active":"2024-09-12T01:08:58.409940+0000","last_peered":"2024-09-12T01:08:58.409940+0000","last_clean":"2024-09-12T01:08:58.409940+0000","last_became_active":"2024-09-12T00:30:19.163363+0000","last_became_peered":"2024-09-12T00:30:19.163363+0000","last_unstale":"2024-09-12T01:08:58.409940+0000","last_undegraded":"2024-09-12T01:08:58.409940+0000","last_fullsized":"2024-09-12T01:08:58.409940+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:34.458854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'134","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.285173+0000","last_change":"2024-09-12T00:30:21.180741+0000","last_active":"2024-09-12T01:09:46.285173+0000","last_peered":"2024-09-12T01:09:46.285173+0000","last_clean":"2024-09-12T01:09:46.285173+0000","last_became_active":"2024-09-12T00:30:21.180419+0000","last_became_peered":"2024-09-12T00:30:21.180419+0000","last_unstale":"2024-09-12T01:09:46.285173+0000","last_undegraded":"2024-09-12T01:09:46.285173+0000","last_fullsized":"2024-09-12T01:09:46.285173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.115939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":136,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'120","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.531565+0000","last_change":"2024-09-12T00:30:13.126841+0000","last_active":"2024-09-12T01:09:21.531565+0000","last_peered":"2024-09-12T01:09:21.531565+0000","last_clean":"2024-09-12T01:09:21.531565+0000","last_became_active":"2024-09-12T00:30:13.126531+0000","last_became_peered":"2024-09-12T00:30:13.126531+0000","last_unstale":"2024-09-12T01:09:21.531565+0000","last_undegraded":"2024-09-12T01:09:21.531565+0000","last_fullsized":"2024-09-12T01:09:21.531565+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:10.702442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":438,"num_write":171,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'350","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.734629+0000","last_change":"2024-09-12T00:30:11.112561+0000","last_active":"2024-09-12T01:11:24.734629+0000","last_peered":"2024-09-12T01:11:24.734629+0000","last_clean":"2024-09-12T01:11:24.734629+0000","last_became_active":"2024-09-12T00:30:11.110001+0000","last_became_peered":"2024-09-12T00:30:11.110001+0000","last_unstale":"2024-09-12T01:11:24.734629+0000","last_undegraded":"2024-09-12T01:11:24.734629+0000","last_fullsized":"2024-09-12T01:11:24.734629+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:28.054807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371860,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":4100,"num_write":1032,"num_write_kb":26242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.520792+0000","last_change":"2024-09-12T00:30:15.126005+0000","last_active":"2024-09-12T01:08:57.520792+0000","last_peered":"2024-09-12T01:08:57.520792+0000","last_clean":"2024-09-12T01:08:57.520792+0000","last_became_active":"2024-09-12T00:30:15.125728+0000","last_became_peered":"2024-09-12T00:30:15.125728+0000","last_unstale":"2024-09-12T01:08:57.520792+0000","last_undegraded":"2024-09-12T01:08:57.520792+0000","last_fullsized":"2024-09-12T01:08:57.520792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:00.586425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'145","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.201330+0000","last_change":"2024-09-12T00:30:17.145113+0000","last_active":"2024-09-12T01:10:26.201330+0000","last_peered":"2024-09-12T01:10:26.201330+0000","last_clean":"2024-09-12T01:10:26.201330+0000","last_became_active":"2024-09-12T00:30:17.144701+0000","last_became_peered":"2024-09-12T00:30:17.144701+0000","last_unstale":"2024-09-12T01:10:26.201330+0000","last_undegraded":"2024-09-12T01:10:26.201330+0000","last_fullsized":"2024-09-12T01:10:26.201330+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:20.054774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":141,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'777","reported_seq":2316,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.343925+0000","last_change":"2024-09-12T00:30:19.170912+0000","last_active":"2024-09-12T01:11:24.343925+0000","last_peered":"2024-09-12T01:11:24.343925+0000","last_clean":"2024-09-12T01:11:24.343925+0000","last_became_active":"2024-09-12T00:30:19.170568+0000","last_became_peered":"2024-09-12T00:30:19.170568+0000","last_unstale":"2024-09-12T01:11:24.343925+0000","last_undegraded":"2024-09-12T01:11:24.343925+0000","last_fullsized":"2024-09-12T01:11:24.343925+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:09.164786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'212","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.922971+0000","last_change":"2024-09-12T00:30:21.188577+0000","last_active":"2024-09-12T01:09:46.922971+0000","last_peered":"2024-09-12T01:09:46.922971+0000","last_clean":"2024-09-12T01:09:46.922971+0000","last_became_active":"2024-09-12T00:30:21.188312+0000","last_became_peered":"2024-09-12T00:30:21.188312+0000","last_unstale":"2024-09-12T01:09:46.922971+0000","last_undegraded":"2024-09-12T01:09:46.922971+0000","last_fullsized":"2024-09-12T01:09:46.922971+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:02.003043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":596,"num_write":468,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'84","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.925453+0000","last_change":"2024-09-12T00:30:13.128485+0000","last_active":"2024-09-12T01:09:10.925453+0000","last_peered":"2024-09-12T01:09:10.925453+0000","last_clean":"2024-09-12T01:09:10.925453+0000","last_became_active":"2024-09-12T00:30:13.125323+0000","last_became_peered":"2024-09-12T00:30:13.125323+0000","last_unstale":"2024-09-12T01:09:10.925453+0000","last_undegraded":"2024-09-12T01:09:10.925453+0000","last_fullsized":"2024-09-12T01:09:10.925453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:35.611738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":383,"num_read_kb":333,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'407","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.740554+0000","last_change":"2024-09-12T00:30:11.102149+0000","last_active":"2024-09-12T01:11:24.740554+0000","last_peered":"2024-09-12T01:11:24.740554+0000","last_clean":"2024-09-12T01:11:24.740554+0000","last_became_active":"2024-09-12T00:30:11.101745+0000","last_became_peered":"2024-09-12T00:30:11.101745+0000","last_unstale":"2024-09-12T01:11:24.740554+0000","last_undegraded":"2024-09-12T01:11:24.740554+0000","last_fullsized":"2024-09-12T01:11:24.740554+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:28.329293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":23420,"num_write":1255,"num_write_kb":19418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605977+0000","last_change":"2024-09-12T00:30:15.124922+0000","last_active":"2024-09-12T01:08:58.605977+0000","last_peered":"2024-09-12T01:08:58.605977+0000","last_clean":"2024-09-12T01:08:58.605977+0000","last_became_active":"2024-09-12T00:30:15.124597+0000","last_became_peered":"2024-09-12T00:30:15.124597+0000","last_unstale":"2024-09-12T01:08:58.605977+0000","last_undegraded":"2024-09-12T01:08:58.605977+0000","last_fullsized":"2024-09-12T01:08:58.605977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:33.763481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'262","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.451446+0000","last_change":"2024-09-12T00:30:17.146147+0000","last_active":"2024-09-12T01:11:23.451446+0000","last_peered":"2024-09-12T01:11:23.451446+0000","last_clean":"2024-09-12T01:11:23.451446+0000","last_became_active":"2024-09-12T00:30:17.145866+0000","last_became_peered":"2024-09-12T00:30:17.145866+0000","last_unstale":"2024-09-12T01:11:23.451446+0000","last_undegraded":"2024-09-12T01:11:23.451446+0000","last_fullsized":"2024-09-12T01:11:23.451446+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:44.866654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47562,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":1006,"num_write":354,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'802","reported_seq":2260,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.376695+0000","last_change":"2024-09-12T00:30:19.172788+0000","last_active":"2024-09-12T01:11:24.376695+0000","last_peered":"2024-09-12T01:11:24.376695+0000","last_clean":"2024-09-12T01:11:24.376695+0000","last_became_active":"2024-09-12T00:30:19.172403+0000","last_became_peered":"2024-09-12T00:30:19.172403+0000","last_unstale":"2024-09-12T01:11:24.376695+0000","last_undegraded":"2024-09-12T01:11:24.376695+0000","last_fullsized":"2024-09-12T01:11:24.376695+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:18.079531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'131","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:26.492883+0000","last_change":"2024-09-12T00:30:13.120892+0000","last_active":"2024-09-12T01:09:26.492883+0000","last_peered":"2024-09-12T01:09:26.492883+0000","last_clean":"2024-09-12T01:09:26.492883+0000","last_became_active":"2024-09-12T00:30:13.120524+0000","last_became_peered":"2024-09-12T00:30:13.120524+0000","last_unstale":"2024-09-12T01:09:26.492883+0000","last_undegraded":"2024-09-12T01:09:26.492883+0000","last_fullsized":"2024-09-12T01:09:26.492883+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:04.978011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":538,"num_write":190,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'385","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.806501+0000","last_change":"2024-09-12T00:30:11.106118+0000","last_active":"2024-09-12T01:11:24.806501+0000","last_peered":"2024-09-12T01:11:24.806501+0000","last_clean":"2024-09-12T01:11:24.806501+0000","last_became_active":"2024-09-12T00:30:11.105769+0000","last_became_peered":"2024-09-12T00:30:11.105769+0000","last_unstale":"2024-09-12T01:11:24.806501+0000","last_undegraded":"2024-09-12T01:11:24.806501+0000","last_fullsized":"2024-09-12T01:11:24.806501+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:02.413308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8955677,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":22715,"num_write":1115,"num_write_kb":62157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:18.412264+0000","last_change":"2024-09-12T00:30:15.133021+0000","last_active":"2024-09-12T01:09:18.412264+0000","last_peered":"2024-09-12T01:09:18.412264+0000","last_clean":"2024-09-12T01:09:18.412264+0000","last_became_active":"2024-09-12T00:30:15.132719+0000","last_became_peered":"2024-09-12T00:30:15.132719+0000","last_unstale":"2024-09-12T01:09:18.412264+0000","last_undegraded":"2024-09-12T01:09:18.412264+0000","last_fullsized":"2024-09-12T01:09:18.412264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:07.213409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'359","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.073073+0000","last_change":"2024-09-12T00:30:17.146741+0000","last_active":"2024-09-12T01:11:24.073073+0000","last_peered":"2024-09-12T01:11:24.073073+0000","last_clean":"2024-09-12T01:11:24.073073+0000","last_became_active":"2024-09-12T00:30:17.146465+0000","last_became_peered":"2024-09-12T00:30:17.146465+0000","last_unstale":"2024-09-12T01:11:24.073073+0000","last_undegraded":"2024-09-12T01:11:24.073073+0000","last_fullsized":"2024-09-12T01:11:24.073073+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:45.163258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45471,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":600,"num_read_kb":1250,"num_write":474,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:37.388200+0000","last_change":"2024-09-12T00:30:19.164620+0000","last_active":"2024-09-12T01:08:37.388200+0000","last_peered":"2024-09-12T01:08:37.388200+0000","last_clean":"2024-09-12T01:08:37.388200+0000","last_became_active":"2024-09-12T00:30:19.164249+0000","last_became_peered":"2024-09-12T00:30:19.164249+0000","last_unstale":"2024-09-12T01:08:37.388200+0000","last_undegraded":"2024-09-12T01:08:37.388200+0000","last_fullsized":"2024-09-12T01:08:37.388200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.473748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'544","reported_seq":1352,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490700+0000","last_change":"2024-09-12T00:30:21.189555+0000","last_active":"2024-09-12T01:10:51.490700+0000","last_peered":"2024-09-12T01:10:51.490700+0000","last_clean":"2024-09-12T01:10:51.490700+0000","last_became_active":"2024-09-12T00:30:21.189156+0000","last_became_peered":"2024-09-12T00:30:21.189156+0000","last_unstale":"2024-09-12T01:10:51.490700+0000","last_undegraded":"2024-09-12T01:10:51.490700+0000","last_fullsized":"2024-09-12T01:10:51.490700+0000","mapping_epoch":36,"log_start":"264'500","ondisk_log_start":"264'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:44.394203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1309,"num_read_kb":1298,"num_write":1161,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'143","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411766+0000","last_change":"2024-09-12T00:30:13.124257+0000","last_active":"2024-09-12T01:09:13.411766+0000","last_peered":"2024-09-12T01:09:13.411766+0000","last_clean":"2024-09-12T01:09:13.411766+0000","last_became_active":"2024-09-12T00:30:13.124006+0000","last_became_peered":"2024-09-12T00:30:13.124006+0000","last_unstale":"2024-09-12T01:09:13.411766+0000","last_undegraded":"2024-09-12T01:09:13.411766+0000","last_fullsized":"2024-09-12T01:09:13.411766+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:34.013529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":534,"num_write":203,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'416","reported_seq":1230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.346226+0000","last_change":"2024-09-12T01:11:30.346226+0000","last_active":"2024-09-12T01:11:30.346226+0000","last_peered":"2024-09-12T01:11:30.346226+0000","last_clean":"2024-09-12T01:11:30.346226+0000","last_became_active":"2024-09-12T00:30:11.104314+0000","last_became_peered":"2024-09-12T00:30:11.104314+0000","last_unstale":"2024-09-12T01:11:30.346226+0000","last_undegraded":"2024-09-12T01:11:30.346226+0000","last_fullsized":"2024-09-12T01:11:30.346226+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.346090+0000","objects_scrubbed":12,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:23.118149+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496547,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":809,"num_read_kb":45639,"num_write":1542,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.393497+0000","last_change":"2024-09-12T00:30:15.125725+0000","last_active":"2024-09-12T01:09:17.393497+0000","last_peered":"2024-09-12T01:09:17.393497+0000","last_clean":"2024-09-12T01:09:17.393497+0000","last_became_active":"2024-09-12T00:30:15.125380+0000","last_became_peered":"2024-09-12T00:30:15.125380+0000","last_unstale":"2024-09-12T01:09:17.393497+0000","last_undegraded":"2024-09-12T01:09:17.393497+0000","last_fullsized":"2024-09-12T01:09:17.393497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:13.819176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'253","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.688748+0000","last_change":"2024-09-12T00:30:17.146917+0000","last_active":"2024-09-12T01:11:22.688748+0000","last_peered":"2024-09-12T01:11:22.688748+0000","last_clean":"2024-09-12T01:11:22.688748+0000","last_became_active":"2024-09-12T00:30:17.145155+0000","last_became_peered":"2024-09-12T00:30:17.145155+0000","last_unstale":"2024-09-12T01:11:22.688748+0000","last_undegraded":"2024-09-12T01:11:22.688748+0000","last_fullsized":"2024-09-12T01:11:22.688748+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.615595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53484,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":958,"num_write":338,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.506558+0000","last_change":"2024-09-12T00:30:19.171499+0000","last_active":"2024-09-12T01:07:17.506558+0000","last_peered":"2024-09-12T01:07:17.506558+0000","last_clean":"2024-09-12T01:07:17.506558+0000","last_became_active":"2024-09-12T00:30:19.171189+0000","last_became_peered":"2024-09-12T00:30:19.171189+0000","last_unstale":"2024-09-12T01:07:17.506558+0000","last_undegraded":"2024-09-12T01:07:17.506558+0000","last_fullsized":"2024-09-12T01:07:17.506558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:46.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2414","reported_seq":4278,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.417930+0000","last_change":"2024-09-12T00:30:21.184001+0000","last_active":"2024-09-12T01:10:08.417930+0000","last_peered":"2024-09-12T01:10:08.417930+0000","last_clean":"2024-09-12T01:10:08.417930+0000","last_became_active":"2024-09-12T00:30:21.183561+0000","last_became_peered":"2024-09-12T00:30:21.183561+0000","last_unstale":"2024-09-12T01:10:08.417930+0000","last_undegraded":"2024-09-12T01:10:08.417930+0000","last_fullsized":"2024-09-12T01:10:08.417930+0000","mapping_epoch":36,"log_start":"264'2400","ondisk_log_start":"264'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":2400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:10.831146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6196,"num_read_kb":6147,"num_write":4885,"num_write_kb":1795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'180","reported_seq":800,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.501869+0000","last_change":"2024-09-12T00:30:13.122346+0000","last_active":"2024-09-12T01:09:21.501869+0000","last_peered":"2024-09-12T01:09:21.501869+0000","last_clean":"2024-09-12T01:09:21.501869+0000","last_became_active":"2024-09-12T00:30:13.122098+0000","last_became_peered":"2024-09-12T00:30:13.122098+0000","last_unstale":"2024-09-12T01:09:21.501869+0000","last_undegraded":"2024-09-12T01:09:21.501869+0000","last_fullsized":"2024-09-12T01:09:21.501869+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":634,"num_write":261,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'304","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.689490+0000","last_change":"2024-09-12T00:30:11.113453+0000","last_active":"2024-09-12T01:11:24.689490+0000","last_peered":"2024-09-12T01:11:24.689490+0000","last_clean":"2024-09-12T01:11:24.689490+0000","last_became_active":"2024-09-12T00:30:11.112302+0000","last_became_peered":"2024-09-12T00:30:11.112302+0000","last_unstale":"2024-09-12T01:11:24.689490+0000","last_undegraded":"2024-09-12T01:11:24.689490+0000","last_fullsized":"2024-09-12T01:11:24.689490+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:35.544849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":10144,"num_write":972,"num_write_kb":18823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476007+0000","last_change":"2024-09-12T00:30:15.129726+0000","last_active":"2024-09-12T01:08:32.476007+0000","last_peered":"2024-09-12T01:08:32.476007+0000","last_clean":"2024-09-12T01:08:32.476007+0000","last_became_active":"2024-09-12T00:30:15.129311+0000","last_became_peered":"2024-09-12T00:30:15.129311+0000","last_unstale":"2024-09-12T01:08:32.476007+0000","last_undegraded":"2024-09-12T01:08:32.476007+0000","last_fullsized":"2024-09-12T01:08:32.476007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.755744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'305","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.212913+0000","last_change":"2024-09-12T00:30:17.147414+0000","last_active":"2024-09-12T01:11:24.212913+0000","last_peered":"2024-09-12T01:11:24.212913+0000","last_clean":"2024-09-12T01:11:24.212913+0000","last_became_active":"2024-09-12T00:30:17.147148+0000","last_became_peered":"2024-09-12T00:30:17.147148+0000","last_unstale":"2024-09-12T01:11:24.212913+0000","last_undegraded":"2024-09-12T01:11:24.212913+0000","last_fullsized":"2024-09-12T01:11:24.212913+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:05.230391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47594,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":517,"num_read_kb":1147,"num_write":414,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'802","reported_seq":2329,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.376494+0000","last_change":"2024-09-12T00:30:19.168748+0000","last_active":"2024-09-12T01:11:24.376494+0000","last_peered":"2024-09-12T01:11:24.376494+0000","last_clean":"2024-09-12T01:11:24.376494+0000","last_became_active":"2024-09-12T00:30:19.168419+0000","last_became_peered":"2024-09-12T00:30:19.168419+0000","last_unstale":"2024-09-12T01:11:24.376494+0000","last_undegraded":"2024-09-12T01:11:24.376494+0000","last_fullsized":"2024-09-12T01:11:24.376494+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.358636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'162","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.270455+0000","last_change":"2024-09-12T00:30:21.179851+0000","last_active":"2024-09-12T01:10:50.270455+0000","last_peered":"2024-09-12T01:10:50.270455+0000","last_clean":"2024-09-12T01:10:50.270455+0000","last_became_active":"2024-09-12T00:30:21.179533+0000","last_became_peered":"2024-09-12T00:30:21.179533+0000","last_unstale":"2024-09-12T01:10:50.270455+0000","last_undegraded":"2024-09-12T01:10:50.270455+0000","last_fullsized":"2024-09-12T01:10:50.270455+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:31.165476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":87,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'98","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.459055+0000","last_change":"2024-09-12T00:30:13.131803+0000","last_active":"2024-09-12T01:08:55.459055+0000","last_peered":"2024-09-12T01:08:55.459055+0000","last_clean":"2024-09-12T01:08:55.459055+0000","last_became_active":"2024-09-12T00:30:13.131423+0000","last_became_peered":"2024-09-12T00:30:13.131423+0000","last_unstale":"2024-09-12T01:08:55.459055+0000","last_undegraded":"2024-09-12T01:08:55.459055+0000","last_fullsized":"2024-09-12T01:08:55.459055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:28.163588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":366,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'380","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.821891+0000","last_change":"2024-09-12T00:30:11.103652+0000","last_active":"2024-09-12T01:11:24.821891+0000","last_peered":"2024-09-12T01:11:24.821891+0000","last_clean":"2024-09-12T01:11:24.821891+0000","last_became_active":"2024-09-12T00:30:11.103285+0000","last_became_peered":"2024-09-12T00:30:11.103285+0000","last_unstale":"2024-09-12T01:11:24.821891+0000","last_undegraded":"2024-09-12T01:11:24.821891+0000","last_fullsized":"2024-09-12T01:11:24.821891+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:22.473520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":3264,"num_write":1093,"num_write_kb":35970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.376081+0000","last_change":"2024-09-12T00:30:15.132989+0000","last_active":"2024-09-12T01:07:12.376081+0000","last_peered":"2024-09-12T01:07:12.376081+0000","last_clean":"2024-09-12T01:07:12.376081+0000","last_became_active":"2024-09-12T00:30:15.132695+0000","last_became_peered":"2024-09-12T00:30:15.132695+0000","last_unstale":"2024-09-12T01:07:12.376081+0000","last_undegraded":"2024-09-12T01:07:12.376081+0000","last_fullsized":"2024-09-12T01:07:12.376081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:47.371729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'457","reported_seq":1090,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.348642+0000","last_change":"2024-09-12T00:30:17.147365+0000","last_active":"2024-09-12T01:11:24.348642+0000","last_peered":"2024-09-12T01:11:24.348642+0000","last_clean":"2024-09-12T01:11:24.348642+0000","last_became_active":"2024-09-12T00:30:17.147015+0000","last_became_peered":"2024-09-12T00:30:17.147015+0000","last_unstale":"2024-09-12T01:11:24.348642+0000","last_undegraded":"2024-09-12T01:11:24.348642+0000","last_fullsized":"2024-09-12T01:11:24.348642+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.499988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69788,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":1853,"num_write":630,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.464310+0000","last_change":"2024-09-12T00:30:19.167774+0000","last_active":"2024-09-12T01:07:12.464310+0000","last_peered":"2024-09-12T01:07:12.464310+0000","last_clean":"2024-09-12T01:07:12.464310+0000","last_became_active":"2024-09-12T00:30:19.167503+0000","last_became_peered":"2024-09-12T00:30:19.167503+0000","last_unstale":"2024-09-12T01:07:12.464310+0000","last_undegraded":"2024-09-12T01:07:12.464310+0000","last_fullsized":"2024-09-12T01:07:12.464310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:36.705384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'96","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.090386+0000","last_change":"2024-09-12T00:30:21.192974+0000","last_active":"2024-09-12T01:09:27.090386+0000","last_peered":"2024-09-12T01:09:27.090386+0000","last_clean":"2024-09-12T01:09:27.090386+0000","last_became_active":"2024-09-12T00:30:21.192700+0000","last_became_peered":"2024-09-12T00:30:21.192700+0000","last_unstale":"2024-09-12T01:09:27.090386+0000","last_undegraded":"2024-09-12T01:09:27.090386+0000","last_fullsized":"2024-09-12T01:09:27.090386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:29.992638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":205,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'119","reported_seq":725,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.885840+0000","last_change":"2024-09-12T00:30:13.128514+0000","last_active":"2024-09-12T01:09:23.885840+0000","last_peered":"2024-09-12T01:09:23.885840+0000","last_clean":"2024-09-12T01:09:23.885840+0000","last_became_active":"2024-09-12T00:30:13.128253+0000","last_became_peered":"2024-09-12T00:30:13.128253+0000","last_unstale":"2024-09-12T01:09:23.885840+0000","last_undegraded":"2024-09-12T01:09:23.885840+0000","last_fullsized":"2024-09-12T01:09:23.885840+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:27.745822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":431,"num_write":189,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'311","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.693593+0000","last_change":"2024-09-12T00:30:11.100672+0000","last_active":"2024-09-12T01:11:24.693593+0000","last_peered":"2024-09-12T01:11:24.693593+0000","last_clean":"2024-09-12T01:11:24.693593+0000","last_became_active":"2024-09-12T00:30:11.100056+0000","last_became_peered":"2024-09-12T00:30:11.100056+0000","last_unstale":"2024-09-12T01:11:24.693593+0000","last_undegraded":"2024-09-12T01:11:24.693593+0000","last_fullsized":"2024-09-12T01:11:24.693593+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:16.381329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":62849,"num_write":1084,"num_write_kb":31335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.386352+0000","last_change":"2024-09-12T00:30:15.133052+0000","last_active":"2024-09-12T01:08:33.386352+0000","last_peered":"2024-09-12T01:08:33.386352+0000","last_clean":"2024-09-12T01:08:33.386352+0000","last_became_active":"2024-09-12T00:30:15.132801+0000","last_became_peered":"2024-09-12T00:30:15.132801+0000","last_unstale":"2024-09-12T01:08:33.386352+0000","last_undegraded":"2024-09-12T01:08:33.386352+0000","last_fullsized":"2024-09-12T01:08:33.386352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:47.232632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'293","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.966157+0000","last_change":"2024-09-12T00:30:17.149925+0000","last_active":"2024-09-12T01:11:22.966157+0000","last_peered":"2024-09-12T01:11:22.966157+0000","last_clean":"2024-09-12T01:11:22.966157+0000","last_became_active":"2024-09-12T00:30:17.149603+0000","last_became_peered":"2024-09-12T00:30:17.149603+0000","last_unstale":"2024-09-12T01:11:22.966157+0000","last_undegraded":"2024-09-12T01:11:22.966157+0000","last_fullsized":"2024-09-12T01:11:22.966157+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.420246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57292,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":510,"num_read_kb":1117,"num_write":456,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.387057+0000","last_change":"2024-09-12T00:30:19.168486+0000","last_active":"2024-09-12T01:08:38.387057+0000","last_peered":"2024-09-12T01:08:38.387057+0000","last_clean":"2024-09-12T01:08:38.387057+0000","last_became_active":"2024-09-12T00:30:19.168223+0000","last_became_peered":"2024-09-12T00:30:19.168223+0000","last_unstale":"2024-09-12T01:08:38.387057+0000","last_undegraded":"2024-09-12T01:08:38.387057+0000","last_fullsized":"2024-09-12T01:08:38.387057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'123","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:27.493758+0000","last_change":"2024-09-12T00:30:21.192816+0000","last_active":"2024-09-12T01:10:27.493758+0000","last_peered":"2024-09-12T01:10:27.493758+0000","last_clean":"2024-09-12T01:10:27.493758+0000","last_became_active":"2024-09-12T00:30:21.192509+0000","last_became_peered":"2024-09-12T00:30:21.192509+0000","last_unstale":"2024-09-12T01:10:27.493758+0000","last_undegraded":"2024-09-12T01:10:27.493758+0000","last_fullsized":"2024-09-12T01:10:27.493758+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:26.935855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'134","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.147039+0000","last_change":"2024-09-12T00:30:13.123694+0000","last_active":"2024-09-12T01:09:32.147039+0000","last_peered":"2024-09-12T01:09:32.147039+0000","last_clean":"2024-09-12T01:09:32.147039+0000","last_became_active":"2024-09-12T00:30:13.123412+0000","last_became_peered":"2024-09-12T00:30:13.123412+0000","last_unstale":"2024-09-12T01:09:32.147039+0000","last_undegraded":"2024-09-12T01:09:32.147039+0000","last_fullsized":"2024-09-12T01:09:32.147039+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:23.159421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":514,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'283","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.861569+0000","last_change":"2024-09-12T00:30:11.098282+0000","last_active":"2024-09-12T01:11:24.861569+0000","last_peered":"2024-09-12T01:11:24.861569+0000","last_clean":"2024-09-12T01:11:24.861569+0000","last_became_active":"2024-09-12T00:30:11.097902+0000","last_became_peered":"2024-09-12T00:30:11.097902+0000","last_unstale":"2024-09-12T01:11:24.861569+0000","last_undegraded":"2024-09-12T01:11:24.861569+0000","last_fullsized":"2024-09-12T01:11:24.861569+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.859119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170421,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":17154,"num_write":985,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476034+0000","last_change":"2024-09-12T00:30:15.125920+0000","last_active":"2024-09-12T01:08:32.476034+0000","last_peered":"2024-09-12T01:08:32.476034+0000","last_clean":"2024-09-12T01:08:32.476034+0000","last_became_active":"2024-09-12T00:30:15.125629+0000","last_became_peered":"2024-09-12T00:30:15.125629+0000","last_unstale":"2024-09-12T01:08:32.476034+0000","last_undegraded":"2024-09-12T01:08:32.476034+0000","last_fullsized":"2024-09-12T01:08:32.476034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:47.978464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'283","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.777898+0000","last_change":"2024-09-12T00:30:17.149967+0000","last_active":"2024-09-12T01:11:24.777898+0000","last_peered":"2024-09-12T01:11:24.777898+0000","last_clean":"2024-09-12T01:11:24.777898+0000","last_became_active":"2024-09-12T00:30:17.149661+0000","last_became_peered":"2024-09-12T00:30:17.149661+0000","last_unstale":"2024-09-12T01:11:24.777898+0000","last_undegraded":"2024-09-12T01:11:24.777898+0000","last_fullsized":"2024-09-12T01:11:24.777898+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:40.653446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59535,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":1016,"num_write":372,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'762","reported_seq":2257,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.507613+0000","last_change":"2024-09-12T00:30:19.167751+0000","last_active":"2024-09-12T01:11:22.507613+0000","last_peered":"2024-09-12T01:11:22.507613+0000","last_clean":"2024-09-12T01:11:22.507613+0000","last_became_active":"2024-09-12T00:30:19.167476+0000","last_became_peered":"2024-09-12T00:30:19.167476+0000","last_unstale":"2024-09-12T01:11:22.507613+0000","last_undegraded":"2024-09-12T01:11:22.507613+0000","last_fullsized":"2024-09-12T01:11:22.507613+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:15.217938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'158","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.465466+0000","last_change":"2024-09-12T00:30:21.187022+0000","last_active":"2024-09-12T01:08:14.465466+0000","last_peered":"2024-09-12T01:08:14.465466+0000","last_clean":"2024-09-12T01:08:14.465466+0000","last_became_active":"2024-09-12T00:30:21.185553+0000","last_became_peered":"2024-09-12T00:30:21.185553+0000","last_unstale":"2024-09-12T01:08:14.465466+0000","last_undegraded":"2024-09-12T01:08:14.465466+0000","last_fullsized":"2024-09-12T01:08:14.465466+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:17.382517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":222,"num_write":391,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'167","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:31.495475+0000","last_change":"2024-09-12T00:30:13.121937+0000","last_active":"2024-09-12T01:08:31.495475+0000","last_peered":"2024-09-12T01:08:31.495475+0000","last_clean":"2024-09-12T01:08:31.495475+0000","last_became_active":"2024-09-12T00:30:13.121664+0000","last_became_peered":"2024-09-12T00:30:13.121664+0000","last_unstale":"2024-09-12T01:08:31.495475+0000","last_undegraded":"2024-09-12T01:08:31.495475+0000","last_fullsized":"2024-09-12T01:08:31.495475+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:50.278462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":568,"num_write":259,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'538","reported_seq":1352,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.816177+0000","last_change":"2024-09-12T00:30:11.112653+0000","last_active":"2024-09-12T01:11:24.816177+0000","last_peered":"2024-09-12T01:11:24.816177+0000","last_clean":"2024-09-12T01:11:24.816177+0000","last_became_active":"2024-09-12T00:30:11.110370+0000","last_became_peered":"2024-09-12T00:30:11.110370+0000","last_unstale":"2024-09-12T01:11:24.816177+0000","last_undegraded":"2024-09-12T01:11:24.816177+0000","last_fullsized":"2024-09-12T01:11:24.816177+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:29.346634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174759,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1243,"num_read_kb":75461,"num_write":1612,"num_write_kb":22075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.488233+0000","last_change":"2024-09-12T00:30:15.133096+0000","last_active":"2024-09-12T01:11:22.488233+0000","last_peered":"2024-09-12T01:11:22.488233+0000","last_clean":"2024-09-12T01:11:22.488233+0000","last_became_active":"2024-09-12T00:30:15.132802+0000","last_became_peered":"2024-09-12T00:30:15.132802+0000","last_unstale":"2024-09-12T01:11:22.488233+0000","last_undegraded":"2024-09-12T01:11:22.488233+0000","last_fullsized":"2024-09-12T01:11:22.488233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:41.563778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'74","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.169269+0000","last_change":"2024-09-12T00:30:17.148149+0000","last_active":"2024-09-12T01:10:26.169269+0000","last_peered":"2024-09-12T01:10:26.169269+0000","last_clean":"2024-09-12T01:10:26.169269+0000","last_became_active":"2024-09-12T00:30:17.147864+0000","last_became_peered":"2024-09-12T00:30:17.147864+0000","last_unstale":"2024-09-12T01:10:26.169269+0000","last_undegraded":"2024-09-12T01:10:26.169269+0000","last_fullsized":"2024-09-12T01:10:26.169269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.850618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'783","reported_seq":2334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.508524+0000","last_change":"2024-09-12T00:30:19.169220+0000","last_active":"2024-09-12T01:11:22.508524+0000","last_peered":"2024-09-12T01:11:22.508524+0000","last_clean":"2024-09-12T01:11:22.508524+0000","last_became_active":"2024-09-12T00:30:19.168960+0000","last_became_peered":"2024-09-12T00:30:19.168960+0000","last_unstale":"2024-09-12T01:11:22.508524+0000","last_undegraded":"2024-09-12T01:11:22.508524+0000","last_fullsized":"2024-09-12T01:11:22.508524+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:05.977565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.244027+0000","last_change":"2024-09-12T00:30:21.186976+0000","last_active":"2024-09-12T01:08:47.244027+0000","last_peered":"2024-09-12T01:08:47.244027+0000","last_clean":"2024-09-12T01:08:47.244027+0000","last_became_active":"2024-09-12T00:30:21.185618+0000","last_became_peered":"2024-09-12T00:30:21.185618+0000","last_unstale":"2024-09-12T01:08:47.244027+0000","last_undegraded":"2024-09-12T01:08:47.244027+0000","last_fullsized":"2024-09-12T01:08:47.244027+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:37.276257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":151,"num_write":299,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:49.019799+0000","last_change":"2024-09-12T00:30:13.130144+0000","last_active":"2024-09-12T01:08:49.019799+0000","last_peered":"2024-09-12T01:08:49.019799+0000","last_clean":"2024-09-12T01:08:49.019799+0000","last_became_active":"2024-09-12T00:30:13.129892+0000","last_became_peered":"2024-09-12T00:30:13.129892+0000","last_unstale":"2024-09-12T01:08:49.019799+0000","last_undegraded":"2024-09-12T01:08:49.019799+0000","last_fullsized":"2024-09-12T01:08:49.019799+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:52.379617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":984,"num_read_kb":836,"num_write":303,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'321","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.801244+0000","last_change":"2024-09-12T00:30:11.103543+0000","last_active":"2024-09-12T01:11:24.801244+0000","last_peered":"2024-09-12T01:11:24.801244+0000","last_clean":"2024-09-12T01:11:24.801244+0000","last_became_active":"2024-09-12T00:30:11.103195+0000","last_became_peered":"2024-09-12T00:30:11.103195+0000","last_unstale":"2024-09-12T01:11:24.801244+0000","last_undegraded":"2024-09-12T01:11:24.801244+0000","last_fullsized":"2024-09-12T01:11:24.801244+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:34.854760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254394,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":8246,"num_write":945,"num_write_kb":41947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.602445+0000","last_change":"2024-09-12T00:30:15.128205+0000","last_active":"2024-09-12T01:08:33.602445+0000","last_peered":"2024-09-12T01:08:33.602445+0000","last_clean":"2024-09-12T01:08:33.602445+0000","last_became_active":"2024-09-12T00:30:15.127047+0000","last_became_peered":"2024-09-12T00:30:15.127047+0000","last_unstale":"2024-09-12T01:08:33.602445+0000","last_undegraded":"2024-09-12T01:08:33.602445+0000","last_fullsized":"2024-09-12T01:08:33.602445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:24.381773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'309","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.851128+0000","last_change":"2024-09-12T00:30:17.149883+0000","last_active":"2024-09-12T01:11:23.851128+0000","last_peered":"2024-09-12T01:11:23.851128+0000","last_clean":"2024-09-12T01:11:23.851128+0000","last_became_active":"2024-09-12T00:30:17.149579+0000","last_became_peered":"2024-09-12T00:30:17.149579+0000","last_unstale":"2024-09-12T01:11:23.851128+0000","last_undegraded":"2024-09-12T01:11:23.851128+0000","last_fullsized":"2024-09-12T01:11:23.851128+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:00.182066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":993,"num_write":388,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496293+0000","last_change":"2024-09-12T00:30:19.169963+0000","last_active":"2024-09-12T01:08:36.496293+0000","last_peered":"2024-09-12T01:08:36.496293+0000","last_clean":"2024-09-12T01:08:36.496293+0000","last_became_active":"2024-09-12T00:30:19.169468+0000","last_became_peered":"2024-09-12T00:30:19.169468+0000","last_unstale":"2024-09-12T01:08:36.496293+0000","last_undegraded":"2024-09-12T01:08:36.496293+0000","last_fullsized":"2024-09-12T01:08:36.496293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.885333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'111","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.875182+0000","last_change":"2024-09-12T00:30:21.184306+0000","last_active":"2024-09-12T01:09:46.875182+0000","last_peered":"2024-09-12T01:09:46.875182+0000","last_clean":"2024-09-12T01:09:46.875182+0000","last_became_active":"2024-09-12T00:30:21.184033+0000","last_became_peered":"2024-09-12T00:30:21.184033+0000","last_unstale":"2024-09-12T01:09:46.875182+0000","last_undegraded":"2024-09-12T01:09:46.875182+0000","last_fullsized":"2024-09-12T01:09:46.875182+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.799929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":266,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'245","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.688573+0000","last_change":"2024-09-12T00:30:13.121232+0000","last_active":"2024-09-12T01:08:19.688573+0000","last_peered":"2024-09-12T01:08:19.688573+0000","last_clean":"2024-09-12T01:08:19.688573+0000","last_became_active":"2024-09-12T00:30:13.120962+0000","last_became_peered":"2024-09-12T00:30:13.120962+0000","last_unstale":"2024-09-12T01:08:19.688573+0000","last_undegraded":"2024-09-12T01:08:19.688573+0000","last_fullsized":"2024-09-12T01:08:19.688573+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:29.222097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":839,"num_write":403,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403142+0000","last_change":"2024-09-12T00:29:54.471707+0000","last_active":"2024-09-12T01:08:08.403142+0000","last_peered":"2024-09-12T01:08:08.403142+0000","last_clean":"2024-09-12T01:08:08.403142+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T01:08:08.403142+0000","last_undegraded":"2024-09-12T01:08:08.403142+0000","last_fullsized":"2024-09-12T01:08:08.403142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:53.438265+0000","last_clean_scrub_stamp":"2024-09-12T00:29:53.438265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.897736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594622+0000","last_change":"2024-09-12T00:30:01.530800+0000","last_active":"2024-09-12T01:07:33.594622+0000","last_peered":"2024-09-12T01:07:33.594622+0000","last_clean":"2024-09-12T01:07:33.594622+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T01:07:33.594622+0000","last_undegraded":"2024-09-12T01:07:33.594622+0000","last_fullsized":"2024-09-12T01:07:33.594622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:58.930249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'317","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.814286+0000","last_change":"2024-09-12T00:30:11.102970+0000","last_active":"2024-09-12T01:11:24.814286+0000","last_peered":"2024-09-12T01:11:24.814286+0000","last_clean":"2024-09-12T01:11:24.814286+0000","last_became_active":"2024-09-12T00:30:11.102144+0000","last_became_peered":"2024-09-12T00:30:11.102144+0000","last_unstale":"2024-09-12T01:11:24.814286+0000","last_undegraded":"2024-09-12T01:11:24.814286+0000","last_fullsized":"2024-09-12T01:11:24.814286+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:38.319543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505108,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":430,"num_read_kb":17991,"num_write":985,"num_write_kb":40410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"38'3","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.477731+0000","last_change":"2024-09-12T00:30:15.132691+0000","last_active":"2024-09-12T01:11:22.477731+0000","last_peered":"2024-09-12T01:11:22.477731+0000","last_clean":"2024-09-12T01:11:22.477731+0000","last_became_active":"2024-09-12T00:30:15.132332+0000","last_became_peered":"2024-09-12T00:30:15.132332+0000","last_unstale":"2024-09-12T01:11:22.477731+0000","last_undegraded":"2024-09-12T01:11:22.477731+0000","last_fullsized":"2024-09-12T01:11:22.477731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:09.196418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'712","reported_seq":1407,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.638181+0000","last_change":"2024-09-12T00:30:17.150136+0000","last_active":"2024-09-12T01:11:24.638181+0000","last_peered":"2024-09-12T01:11:24.638181+0000","last_clean":"2024-09-12T01:11:24.638181+0000","last_became_active":"2024-09-12T00:30:17.149842+0000","last_became_peered":"2024-09-12T00:30:17.149842+0000","last_unstale":"2024-09-12T01:11:24.638181+0000","last_undegraded":"2024-09-12T01:11:24.638181+0000","last_fullsized":"2024-09-12T01:11:24.638181+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.362386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1403,"num_read_kb":3182,"num_write":1320,"num_write_kb":1183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.464436+0000","last_change":"2024-09-12T00:30:19.168459+0000","last_active":"2024-09-12T01:07:12.464436+0000","last_peered":"2024-09-12T01:07:12.464436+0000","last_clean":"2024-09-12T01:07:12.464436+0000","last_became_active":"2024-09-12T00:30:19.168219+0000","last_became_peered":"2024-09-12T00:30:19.168219+0000","last_unstale":"2024-09-12T01:07:12.464436+0000","last_undegraded":"2024-09-12T01:07:12.464436+0000","last_fullsized":"2024-09-12T01:07:12.464436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:10.717786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'214","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:45.780203+0000","last_change":"2024-09-12T00:30:21.192045+0000","last_active":"2024-09-12T01:09:45.780203+0000","last_peered":"2024-09-12T01:09:45.780203+0000","last_clean":"2024-09-12T01:09:45.780203+0000","last_became_active":"2024-09-12T00:30:21.191389+0000","last_became_peered":"2024-09-12T00:30:21.191389+0000","last_unstale":"2024-09-12T01:09:45.780203+0000","last_undegraded":"2024-09-12T01:09:45.780203+0000","last_fullsized":"2024-09-12T01:09:45.780203+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:50.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":544,"num_write":463,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'83","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.482265+0000","last_change":"2024-09-12T00:30:13.124765+0000","last_active":"2024-09-12T01:09:12.482265+0000","last_peered":"2024-09-12T01:09:12.482265+0000","last_clean":"2024-09-12T01:09:12.482265+0000","last_became_active":"2024-09-12T00:30:13.124407+0000","last_became_peered":"2024-09-12T00:30:13.124407+0000","last_unstale":"2024-09-12T01:09:12.482265+0000","last_undegraded":"2024-09-12T01:09:12.482265+0000","last_fullsized":"2024-09-12T01:09:12.482265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:33.269760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":258,"num_write":150,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.598985+0000","last_change":"2024-09-12T00:30:01.530206+0000","last_active":"2024-09-12T01:08:08.598985+0000","last_peered":"2024-09-12T01:08:08.598985+0000","last_clean":"2024-09-12T01:08:08.598985+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T01:08:08.598985+0000","last_undegraded":"2024-09-12T01:08:08.598985+0000","last_fullsized":"2024-09-12T01:08:08.598985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:48.786695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'385","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.635190+0000","last_change":"2024-09-12T00:30:11.099484+0000","last_active":"2024-09-12T01:11:24.635190+0000","last_peered":"2024-09-12T01:11:24.635190+0000","last_clean":"2024-09-12T01:11:24.635190+0000","last_became_active":"2024-09-12T00:30:11.099065+0000","last_became_peered":"2024-09-12T00:30:11.099065+0000","last_unstale":"2024-09-12T01:11:24.635190+0000","last_undegraded":"2024-09-12T01:11:24.635190+0000","last_fullsized":"2024-09-12T01:11:24.635190+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:19.401122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":8968,"num_write":1169,"num_write_kb":21800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:18.608995+0000","last_change":"2024-09-12T00:30:15.130834+0000","last_active":"2024-09-12T01:09:18.608995+0000","last_peered":"2024-09-12T01:09:18.608995+0000","last_clean":"2024-09-12T01:09:18.608995+0000","last_became_active":"2024-09-12T00:30:15.130490+0000","last_became_peered":"2024-09-12T00:30:15.130490+0000","last_unstale":"2024-09-12T01:09:18.608995+0000","last_undegraded":"2024-09-12T01:09:18.608995+0000","last_fullsized":"2024-09-12T01:09:18.608995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:41.519057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'1357","reported_seq":2785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.930043+0000","last_change":"2024-09-12T00:30:17.146700+0000","last_active":"2024-09-12T01:11:23.930043+0000","last_peered":"2024-09-12T01:11:23.930043+0000","last_clean":"2024-09-12T01:11:23.930043+0000","last_became_active":"2024-09-12T00:30:17.146374+0000","last_became_peered":"2024-09-12T00:30:17.146374+0000","last_unstale":"2024-09-12T01:11:23.930043+0000","last_undegraded":"2024-09-12T01:11:23.930043+0000","last_fullsized":"2024-09-12T01:11:23.930043+0000","mapping_epoch":32,"log_start":"264'1300","ondisk_log_start":"264'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:46.392573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162102,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2173,"num_read_kb":4252,"num_write":1262,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.597073+0000","last_change":"2024-09-12T00:30:19.169975+0000","last_active":"2024-09-12T01:07:53.597073+0000","last_peered":"2024-09-12T01:07:53.597073+0000","last_clean":"2024-09-12T01:07:53.597073+0000","last_became_active":"2024-09-12T00:30:19.169700+0000","last_became_peered":"2024-09-12T00:30:19.169700+0000","last_unstale":"2024-09-12T01:07:53.597073+0000","last_undegraded":"2024-09-12T01:07:53.597073+0000","last_fullsized":"2024-09-12T01:07:53.597073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:43.445292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'95","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.451982+0000","last_change":"2024-09-12T00:30:21.193756+0000","last_active":"2024-09-12T01:09:28.451982+0000","last_peered":"2024-09-12T01:09:28.451982+0000","last_clean":"2024-09-12T01:09:28.451982+0000","last_became_active":"2024-09-12T00:30:21.193491+0000","last_became_peered":"2024-09-12T00:30:21.193491+0000","last_unstale":"2024-09-12T01:09:28.451982+0000","last_undegraded":"2024-09-12T01:09:28.451982+0000","last_fullsized":"2024-09-12T01:09:28.451982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:22.498346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":108,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'101","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.393014+0000","last_change":"2024-09-12T00:30:13.124361+0000","last_active":"2024-09-12T01:09:12.393014+0000","last_peered":"2024-09-12T01:09:12.393014+0000","last_clean":"2024-09-12T01:09:12.393014+0000","last_became_active":"2024-09-12T00:30:13.124085+0000","last_became_peered":"2024-09-12T00:30:13.124085+0000","last_unstale":"2024-09-12T01:09:12.393014+0000","last_undegraded":"2024-09-12T01:09:12.393014+0000","last_fullsized":"2024-09-12T01:09:12.393014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:04.474974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":146,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.378595+0000","last_change":"2024-09-12T00:30:01.610469+0000","last_active":"2024-09-12T01:07:33.378595+0000","last_peered":"2024-09-12T01:07:33.378595+0000","last_clean":"2024-09-12T01:07:33.378595+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T01:07:33.378595+0000","last_undegraded":"2024-09-12T01:07:33.378595+0000","last_fullsized":"2024-09-12T01:07:33.378595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:35.665518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'337","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.706385+0000","last_change":"2024-09-12T00:30:46.767164+0000","last_active":"2024-09-12T01:11:24.706385+0000","last_peered":"2024-09-12T01:11:24.706385+0000","last_clean":"2024-09-12T01:11:24.706385+0000","last_became_active":"2024-09-12T00:30:46.766731+0000","last_became_peered":"2024-09-12T00:30:46.766731+0000","last_unstale":"2024-09-12T01:11:24.706385+0000","last_undegraded":"2024-09-12T01:11:24.706385+0000","last_fullsized":"2024-09-12T01:11:24.706385+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:46.403345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7776863,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":511,"num_read_kb":16356,"num_write":1167,"num_write_kb":34470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,4],"acting":[5,7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:18.393126+0000","last_change":"2024-09-12T00:30:15.133051+0000","last_active":"2024-09-12T01:09:18.393126+0000","last_peered":"2024-09-12T01:09:18.393126+0000","last_clean":"2024-09-12T01:09:18.393126+0000","last_became_active":"2024-09-12T00:30:15.132744+0000","last_became_peered":"2024-09-12T00:30:15.132744+0000","last_unstale":"2024-09-12T01:09:18.393126+0000","last_undegraded":"2024-09-12T01:09:18.393126+0000","last_fullsized":"2024-09-12T01:09:18.393126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:50.803146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'217","reported_seq":1253,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.310283+0000","last_change":"2024-09-12T00:30:17.145576+0000","last_active":"2024-09-12T01:10:50.310283+0000","last_peered":"2024-09-12T01:10:50.310283+0000","last_clean":"2024-09-12T01:10:50.310283+0000","last_became_active":"2024-09-12T00:30:17.145284+0000","last_became_peered":"2024-09-12T00:30:17.145284+0000","last_unstale":"2024-09-12T01:10:50.310283+0000","last_undegraded":"2024-09-12T01:10:50.310283+0000","last_fullsized":"2024-09-12T01:10:50.310283+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:04.503798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":145,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511658+0000","last_change":"2024-09-12T00:30:19.169714+0000","last_active":"2024-09-12T01:07:52.511658+0000","last_peered":"2024-09-12T01:07:52.511658+0000","last_clean":"2024-09-12T01:07:52.511658+0000","last_became_active":"2024-09-12T00:30:19.169439+0000","last_became_peered":"2024-09-12T00:30:19.169439+0000","last_unstale":"2024-09-12T01:07:52.511658+0000","last_undegraded":"2024-09-12T01:07:52.511658+0000","last_fullsized":"2024-09-12T01:07:52.511658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:26.888194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'342","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.969662+0000","last_change":"2024-09-12T00:30:21.187938+0000","last_active":"2024-09-12T01:09:46.969662+0000","last_peered":"2024-09-12T01:09:46.969662+0000","last_clean":"2024-09-12T01:09:46.969662+0000","last_became_active":"2024-09-12T00:30:21.187616+0000","last_became_peered":"2024-09-12T00:30:21.187616+0000","last_unstale":"2024-09-12T01:09:46.969662+0000","last_undegraded":"2024-09-12T01:09:46.969662+0000","last_fullsized":"2024-09-12T01:09:46.969662+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:17.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":676,"num_read_kb":665,"num_write":755,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'375","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.067358+0000","last_change":"2024-09-12T00:30:13.123029+0000","last_active":"2024-09-12T01:09:09.067358+0000","last_peered":"2024-09-12T01:09:09.067358+0000","last_clean":"2024-09-12T01:09:09.067358+0000","last_became_active":"2024-09-12T00:30:13.122751+0000","last_became_peered":"2024-09-12T00:30:13.122751+0000","last_unstale":"2024-09-12T01:09:09.067358+0000","last_undegraded":"2024-09-12T01:09:09.067358+0000","last_fullsized":"2024-09-12T01:09:09.067358+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:58.496482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1941,"num_read_kb":1679,"num_write":648,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.594595+0000","last_change":"2024-09-12T00:30:01.530685+0000","last_active":"2024-09-12T01:07:33.594595+0000","last_peered":"2024-09-12T01:07:33.594595+0000","last_clean":"2024-09-12T01:07:33.594595+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T01:07:33.594595+0000","last_undegraded":"2024-09-12T01:07:33.594595+0000","last_fullsized":"2024-09-12T01:07:33.594595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:49.919156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'399","reported_seq":1132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.809373+0000","last_change":"2024-09-12T00:30:11.100580+0000","last_active":"2024-09-12T01:11:24.809373+0000","last_peered":"2024-09-12T01:11:24.809373+0000","last_clean":"2024-09-12T01:11:24.809373+0000","last_became_active":"2024-09-12T00:30:11.100253+0000","last_became_peered":"2024-09-12T00:30:11.100253+0000","last_unstale":"2024-09-12T01:11:24.809373+0000","last_undegraded":"2024-09-12T01:11:24.809373+0000","last_fullsized":"2024-09-12T01:11:24.809373+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:01.683692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7586776,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":852,"num_read_kb":32409,"num_write":1258,"num_write_kb":44212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.380734+0000","last_change":"2024-09-12T00:30:15.128086+0000","last_active":"2024-09-12T01:07:48.380734+0000","last_peered":"2024-09-12T01:07:48.380734+0000","last_clean":"2024-09-12T01:07:48.380734+0000","last_became_active":"2024-09-12T00:30:15.127835+0000","last_became_peered":"2024-09-12T00:30:15.127835+0000","last_unstale":"2024-09-12T01:07:48.380734+0000","last_undegraded":"2024-09-12T01:07:48.380734+0000","last_fullsized":"2024-09-12T01:07:48.380734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:47.620246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'123","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.647217+0000","last_change":"2024-09-12T00:30:17.148863+0000","last_active":"2024-09-12T01:10:51.647217+0000","last_peered":"2024-09-12T01:10:51.647217+0000","last_clean":"2024-09-12T01:10:51.647217+0000","last_became_active":"2024-09-12T00:30:17.148548+0000","last_became_peered":"2024-09-12T00:30:17.148548+0000","last_unstale":"2024-09-12T01:10:51.647217+0000","last_undegraded":"2024-09-12T01:10:51.647217+0000","last_fullsized":"2024-09-12T01:10:51.647217+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:18.608977+0000","last_change":"2024-09-12T00:30:19.165383+0000","last_active":"2024-09-12T01:09:18.608977+0000","last_peered":"2024-09-12T01:09:18.608977+0000","last_clean":"2024-09-12T01:09:18.608977+0000","last_became_active":"2024-09-12T00:30:19.165120+0000","last_became_peered":"2024-09-12T00:30:19.165120+0000","last_unstale":"2024-09-12T01:09:18.608977+0000","last_undegraded":"2024-09-12T01:09:18.608977+0000","last_fullsized":"2024-09-12T01:09:18.608977+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:24.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'134","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.882688+0000","last_change":"2024-09-12T00:30:21.181012+0000","last_active":"2024-09-12T01:09:23.882688+0000","last_peered":"2024-09-12T01:09:23.882688+0000","last_clean":"2024-09-12T01:09:23.882688+0000","last_became_active":"2024-09-12T00:30:21.180708+0000","last_became_peered":"2024-09-12T00:30:21.180708+0000","last_unstale":"2024-09-12T01:09:23.882688+0000","last_undegraded":"2024-09-12T01:09:23.882688+0000","last_fullsized":"2024-09-12T01:09:23.882688+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:50.395523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":239,"num_write":325,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'170","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.380239+0000","last_change":"2024-09-12T00:30:13.130893+0000","last_active":"2024-09-12T01:07:42.380239+0000","last_peered":"2024-09-12T01:07:42.380239+0000","last_clean":"2024-09-12T01:07:42.380239+0000","last_became_active":"2024-09-12T00:30:13.130610+0000","last_became_peered":"2024-09-12T00:30:13.130610+0000","last_unstale":"2024-09-12T01:07:42.380239+0000","last_undegraded":"2024-09-12T01:07:42.380239+0000","last_fullsized":"2024-09-12T01:07:42.380239+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:26.005542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":757,"num_read_kb":608,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'326","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.394860+0000","last_change":"2024-09-12T01:11:31.394860+0000","last_active":"2024-09-12T01:11:31.394860+0000","last_peered":"2024-09-12T01:11:31.394860+0000","last_clean":"2024-09-12T01:11:31.394860+0000","last_became_active":"2024-09-12T00:30:11.104002+0000","last_became_peered":"2024-09-12T00:30:11.104002+0000","last_unstale":"2024-09-12T01:11:31.394860+0000","last_undegraded":"2024-09-12T01:11:31.394860+0000","last_fullsized":"2024-09-12T01:11:31.394860+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.394736+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:03.175443+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452439,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":13269,"num_write":941,"num_write_kb":33802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:32.467396+0000","last_change":"2024-09-12T00:30:01.575846+0000","last_active":"2024-09-12T01:07:32.467396+0000","last_peered":"2024-09-12T01:07:32.467396+0000","last_clean":"2024-09-12T01:07:32.467396+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T01:07:32.467396+0000","last_undegraded":"2024-09-12T01:07:32.467396+0000","last_fullsized":"2024-09-12T01:07:32.467396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:02.507794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510721+0000","last_change":"2024-09-12T00:30:15.127858+0000","last_active":"2024-09-12T01:07:47.510721+0000","last_peered":"2024-09-12T01:07:47.510721+0000","last_clean":"2024-09-12T01:07:47.510721+0000","last_became_active":"2024-09-12T00:30:15.127513+0000","last_became_peered":"2024-09-12T00:30:15.127513+0000","last_unstale":"2024-09-12T01:07:47.510721+0000","last_undegraded":"2024-09-12T01:07:47.510721+0000","last_fullsized":"2024-09-12T01:07:47.510721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:13.431995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'565","reported_seq":1233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.717154+0000","last_change":"2024-09-12T00:30:17.146701+0000","last_active":"2024-09-12T01:11:24.717154+0000","last_peered":"2024-09-12T01:11:24.717154+0000","last_clean":"2024-09-12T01:11:24.717154+0000","last_became_active":"2024-09-12T00:30:17.146141+0000","last_became_peered":"2024-09-12T00:30:17.146141+0000","last_unstale":"2024-09-12T01:11:24.717154+0000","last_undegraded":"2024-09-12T01:11:24.717154+0000","last_fullsized":"2024-09-12T01:11:24.717154+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:34.957314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1559,"num_read_kb":2701,"num_write":2018,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.490280+0000","last_change":"2024-09-12T00:30:19.168100+0000","last_active":"2024-09-12T01:07:51.490280+0000","last_peered":"2024-09-12T01:07:51.490280+0000","last_clean":"2024-09-12T01:07:51.490280+0000","last_became_active":"2024-09-12T00:30:19.167819+0000","last_became_peered":"2024-09-12T00:30:19.167819+0000","last_unstale":"2024-09-12T01:07:51.490280+0000","last_undegraded":"2024-09-12T01:07:51.490280+0000","last_fullsized":"2024-09-12T01:07:51.490280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:06.580191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'175","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.532966+0000","last_change":"2024-09-12T00:30:21.193170+0000","last_active":"2024-09-12T01:09:21.532966+0000","last_peered":"2024-09-12T01:09:21.532966+0000","last_clean":"2024-09-12T01:09:21.532966+0000","last_became_active":"2024-09-12T00:30:21.192893+0000","last_became_peered":"2024-09-12T00:30:21.192893+0000","last_unstale":"2024-09-12T01:09:21.532966+0000","last_undegraded":"2024-09-12T01:09:21.532966+0000","last_fullsized":"2024-09-12T01:09:21.532966+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.137808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":195,"num_read_kb":181,"num_write":424,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'295","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.821157+0000","last_change":"2024-09-12T00:30:13.125785+0000","last_active":"2024-09-12T01:07:43.821157+0000","last_peered":"2024-09-12T01:07:43.821157+0000","last_clean":"2024-09-12T01:07:43.821157+0000","last_became_active":"2024-09-12T00:30:13.125487+0000","last_became_peered":"2024-09-12T00:30:13.125487+0000","last_unstale":"2024-09-12T01:07:43.821157+0000","last_undegraded":"2024-09-12T01:07:43.821157+0000","last_fullsized":"2024-09-12T01:07:43.821157+0000","mapping_epoch":28,"log_start":"261'200","ondisk_log_start":"261'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:38.141488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1016,"num_write":432,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'308","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.836152+0000","last_change":"2024-09-12T00:30:11.108644+0000","last_active":"2024-09-12T01:11:24.836152+0000","last_peered":"2024-09-12T01:11:24.836152+0000","last_clean":"2024-09-12T01:11:24.836152+0000","last_became_active":"2024-09-12T00:30:11.108257+0000","last_became_peered":"2024-09-12T00:30:11.108257+0000","last_unstale":"2024-09-12T01:11:24.836152+0000","last_undegraded":"2024-09-12T01:11:24.836152+0000","last_fullsized":"2024-09-12T01:11:24.836152+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:15.455005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":29050,"num_write":952,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.595234+0000","last_change":"2024-09-12T00:30:01.530154+0000","last_active":"2024-09-12T01:07:38.595234+0000","last_peered":"2024-09-12T01:07:38.595234+0000","last_clean":"2024-09-12T01:07:38.595234+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T01:07:38.595234+0000","last_undegraded":"2024-09-12T01:07:38.595234+0000","last_fullsized":"2024-09-12T01:07:38.595234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:56.892481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.517391+0000","last_change":"2024-09-12T00:30:15.125077+0000","last_active":"2024-09-12T01:07:48.517391+0000","last_peered":"2024-09-12T01:07:48.517391+0000","last_clean":"2024-09-12T01:07:48.517391+0000","last_became_active":"2024-09-12T00:30:15.124765+0000","last_became_peered":"2024-09-12T00:30:15.124765+0000","last_unstale":"2024-09-12T01:07:48.517391+0000","last_undegraded":"2024-09-12T01:07:48.517391+0000","last_fullsized":"2024-09-12T01:07:48.517391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:26.426998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'162","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.221326+0000","last_change":"2024-09-12T00:30:17.147603+0000","last_active":"2024-09-12T01:10:26.221326+0000","last_peered":"2024-09-12T01:10:26.221326+0000","last_clean":"2024-09-12T01:10:26.221326+0000","last_became_active":"2024-09-12T00:30:17.147297+0000","last_became_peered":"2024-09-12T00:30:17.147297+0000","last_unstale":"2024-09-12T01:10:26.221326+0000","last_undegraded":"2024-09-12T01:10:26.221326+0000","last_fullsized":"2024-09-12T01:10:26.221326+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:26.332646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":197,"num_write":138,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'782","reported_seq":4276,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.505081+0000","last_change":"2024-09-12T00:30:19.169985+0000","last_active":"2024-09-12T01:11:22.505081+0000","last_peered":"2024-09-12T01:11:22.505081+0000","last_clean":"2024-09-12T01:11:22.505081+0000","last_became_active":"2024-09-12T00:30:19.169689+0000","last_became_peered":"2024-09-12T00:30:19.169689+0000","last_unstale":"2024-09-12T01:11:22.505081+0000","last_undegraded":"2024-09-12T01:11:22.505081+0000","last_fullsized":"2024-09-12T01:11:22.505081+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:18.977023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'135","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.493856+0000","last_change":"2024-09-12T00:30:21.189863+0000","last_active":"2024-09-12T01:10:51.493856+0000","last_peered":"2024-09-12T01:10:51.493856+0000","last_clean":"2024-09-12T01:10:51.493856+0000","last_became_active":"2024-09-12T00:30:21.189546+0000","last_became_peered":"2024-09-12T00:30:21.189546+0000","last_unstale":"2024-09-12T01:10:51.493856+0000","last_undegraded":"2024-09-12T01:10:51.493856+0000","last_fullsized":"2024-09-12T01:10:51.493856+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.427001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":147,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'196","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:17.514948+0000","last_change":"2024-09-12T00:30:13.118911+0000","last_active":"2024-09-12T01:08:17.514948+0000","last_peered":"2024-09-12T01:08:17.514948+0000","last_clean":"2024-09-12T01:08:17.514948+0000","last_became_active":"2024-09-12T00:30:13.118656+0000","last_became_peered":"2024-09-12T00:30:13.118656+0000","last_unstale":"2024-09-12T01:08:17.514948+0000","last_undegraded":"2024-09-12T01:08:17.514948+0000","last_fullsized":"2024-09-12T01:08:17.514948+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:57.996691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":942,"num_read_kb":795,"num_write":340,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'370","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.799928+0000","last_change":"2024-09-12T00:30:11.090609+0000","last_active":"2024-09-12T01:11:24.799928+0000","last_peered":"2024-09-12T01:11:24.799928+0000","last_clean":"2024-09-12T01:11:24.799928+0000","last_became_active":"2024-09-12T00:30:11.090114+0000","last_became_peered":"2024-09-12T00:30:11.090114+0000","last_unstale":"2024-09-12T01:11:24.799928+0000","last_undegraded":"2024-09-12T01:11:24.799928+0000","last_fullsized":"2024-09-12T01:11:24.799928+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:10.941716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9433118,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":605,"num_read_kb":27258,"num_write":1271,"num_write_kb":43330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.521544+0000","last_change":"2024-09-12T00:30:01.610276+0000","last_active":"2024-09-12T01:09:02.521544+0000","last_peered":"2024-09-12T01:09:02.521544+0000","last_clean":"2024-09-12T01:09:02.521544+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T01:09:02.521544+0000","last_undegraded":"2024-09-12T01:09:02.521544+0000","last_fullsized":"2024-09-12T01:09:02.521544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:31.655155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596333+0000","last_change":"2024-09-12T00:30:15.127408+0000","last_active":"2024-09-12T01:07:48.596333+0000","last_peered":"2024-09-12T01:07:48.596333+0000","last_clean":"2024-09-12T01:07:48.596333+0000","last_became_active":"2024-09-12T00:30:15.126949+0000","last_became_peered":"2024-09-12T00:30:15.126949+0000","last_unstale":"2024-09-12T01:07:48.596333+0000","last_undegraded":"2024-09-12T01:07:48.596333+0000","last_fullsized":"2024-09-12T01:07:48.596333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:24.696309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.206045+0000","last_change":"2024-09-12T00:30:17.150111+0000","last_active":"2024-09-12T01:10:26.206045+0000","last_peered":"2024-09-12T01:10:26.206045+0000","last_clean":"2024-09-12T01:10:26.206045+0000","last_became_active":"2024-09-12T00:30:17.149791+0000","last_became_peered":"2024-09-12T00:30:17.149791+0000","last_unstale":"2024-09-12T01:10:26.206045+0000","last_undegraded":"2024-09-12T01:10:26.206045+0000","last_fullsized":"2024-09-12T01:10:26.206045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.663317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'802","reported_seq":4540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.376141+0000","last_change":"2024-09-12T00:30:19.167079+0000","last_active":"2024-09-12T01:11:24.376141+0000","last_peered":"2024-09-12T01:11:24.376141+0000","last_clean":"2024-09-12T01:11:24.376141+0000","last_became_active":"2024-09-12T00:30:19.166687+0000","last_became_peered":"2024-09-12T00:30:19.166687+0000","last_unstale":"2024-09-12T01:11:24.376141+0000","last_undegraded":"2024-09-12T01:11:24.376141+0000","last_fullsized":"2024-09-12T01:11:24.376141+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:58.724984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.877133+0000","last_change":"2024-09-12T00:30:21.192502+0000","last_active":"2024-09-12T01:09:46.877133+0000","last_peered":"2024-09-12T01:09:46.877133+0000","last_clean":"2024-09-12T01:09:46.877133+0000","last_became_active":"2024-09-12T00:30:21.192189+0000","last_became_peered":"2024-09-12T00:30:21.192189+0000","last_unstale":"2024-09-12T01:09:46.877133+0000","last_undegraded":"2024-09-12T01:09:46.877133+0000","last_fullsized":"2024-09-12T01:09:46.877133+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:51.071766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":326,"num_read_kb":325,"num_write":560,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'395","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489484+0000","last_change":"2024-09-12T00:30:13.121172+0000","last_active":"2024-09-12T01:07:46.489484+0000","last_peered":"2024-09-12T01:07:46.489484+0000","last_clean":"2024-09-12T01:07:46.489484+0000","last_became_active":"2024-09-12T00:30:13.120906+0000","last_became_peered":"2024-09-12T00:30:13.120906+0000","last_unstale":"2024-09-12T01:07:46.489484+0000","last_undegraded":"2024-09-12T01:07:46.489484+0000","last_fullsized":"2024-09-12T01:07:46.489484+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:54.969193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1876,"num_read_kb":1541,"num_write":715,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'329","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.736853+0000","last_change":"2024-09-12T00:30:11.102338+0000","last_active":"2024-09-12T01:11:24.736853+0000","last_peered":"2024-09-12T01:11:24.736853+0000","last_clean":"2024-09-12T01:11:24.736853+0000","last_became_active":"2024-09-12T00:30:11.101931+0000","last_became_peered":"2024-09-12T00:30:11.101931+0000","last_unstale":"2024-09-12T01:11:24.736853+0000","last_undegraded":"2024-09-12T01:11:24.736853+0000","last_fullsized":"2024-09-12T01:11:24.736853+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:00.380675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359495,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":501,"num_read_kb":50204,"num_write":1062,"num_write_kb":37284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.606593+0000","last_change":"2024-09-12T00:30:01.530986+0000","last_active":"2024-09-12T01:09:03.606593+0000","last_peered":"2024-09-12T01:09:03.606593+0000","last_clean":"2024-09-12T01:09:03.606593+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T01:09:03.606593+0000","last_undegraded":"2024-09-12T01:09:03.606593+0000","last_fullsized":"2024-09-12T01:09:03.606593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:29:58.509720+0000","last_clean_scrub_stamp":"2024-09-12T00:29:58.509720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:52.048191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.515540+0000","last_change":"2024-09-12T00:30:15.126298+0000","last_active":"2024-09-12T01:08:22.515540+0000","last_peered":"2024-09-12T01:08:22.515540+0000","last_clean":"2024-09-12T01:08:22.515540+0000","last_became_active":"2024-09-12T00:30:15.126041+0000","last_became_peered":"2024-09-12T00:30:15.126041+0000","last_unstale":"2024-09-12T01:08:22.515540+0000","last_undegraded":"2024-09-12T01:08:22.515540+0000","last_fullsized":"2024-09-12T01:08:22.515540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:47.264234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'765","reported_seq":1487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.729583+0000","last_change":"2024-09-12T00:30:17.149254+0000","last_active":"2024-09-12T01:11:23.729583+0000","last_peered":"2024-09-12T01:11:23.729583+0000","last_clean":"2024-09-12T01:11:23.729583+0000","last_became_active":"2024-09-12T00:30:17.148954+0000","last_became_peered":"2024-09-12T00:30:17.148954+0000","last_unstale":"2024-09-12T01:11:23.729583+0000","last_undegraded":"2024-09-12T01:11:23.729583+0000","last_fullsized":"2024-09-12T01:11:23.729583+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:23.398387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141519,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1386,"num_read_kb":3323,"num_write":1142,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511612+0000","last_change":"2024-09-12T00:30:19.169337+0000","last_active":"2024-09-12T01:07:52.511612+0000","last_peered":"2024-09-12T01:07:52.511612+0000","last_clean":"2024-09-12T01:07:52.511612+0000","last_became_active":"2024-09-12T00:30:19.168965+0000","last_became_peered":"2024-09-12T00:30:19.168965+0000","last_unstale":"2024-09-12T01:07:52.511612+0000","last_undegraded":"2024-09-12T01:07:52.511612+0000","last_fullsized":"2024-09-12T01:07:52.511612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:32.282990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'132","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.271173+0000","last_change":"2024-09-12T00:30:21.186564+0000","last_active":"2024-09-12T01:09:46.271173+0000","last_peered":"2024-09-12T01:09:46.271173+0000","last_clean":"2024-09-12T01:09:46.271173+0000","last_became_active":"2024-09-12T00:30:21.186262+0000","last_became_peered":"2024-09-12T00:30:21.186262+0000","last_unstale":"2024-09-12T01:09:46.271173+0000","last_undegraded":"2024-09-12T01:09:46.271173+0000","last_fullsized":"2024-09-12T01:09:46.271173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:19.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":332,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'144","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.925813+0000","last_change":"2024-09-12T00:30:21.193317+0000","last_active":"2024-09-12T01:09:46.925813+0000","last_peered":"2024-09-12T01:09:46.925813+0000","last_clean":"2024-09-12T01:09:46.925813+0000","last_became_active":"2024-09-12T00:30:21.193010+0000","last_became_peered":"2024-09-12T00:30:21.193010+0000","last_unstale":"2024-09-12T01:09:46.925813+0000","last_undegraded":"2024-09-12T01:09:46.925813+0000","last_fullsized":"2024-09-12T01:09:46.925813+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:25.295748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'64","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.214217+0000","last_change":"2024-09-12T00:30:13.122292+0000","last_active":"2024-09-12T01:09:31.214217+0000","last_peered":"2024-09-12T01:09:31.214217+0000","last_clean":"2024-09-12T01:09:31.214217+0000","last_became_active":"2024-09-12T00:30:13.121613+0000","last_became_peered":"2024-09-12T00:30:13.121613+0000","last_unstale":"2024-09-12T01:09:31.214217+0000","last_undegraded":"2024-09-12T01:09:31.214217+0000","last_fullsized":"2024-09-12T01:09:31.214217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:01.317063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":107,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'377","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.812323+0000","last_change":"2024-09-12T00:30:11.110609+0000","last_active":"2024-09-12T01:11:24.812323+0000","last_peered":"2024-09-12T01:11:24.812323+0000","last_clean":"2024-09-12T01:11:24.812323+0000","last_became_active":"2024-09-12T00:30:11.109653+0000","last_became_peered":"2024-09-12T00:30:11.109653+0000","last_unstale":"2024-09-12T01:11:24.812323+0000","last_undegraded":"2024-09-12T01:11:24.812323+0000","last_fullsized":"2024-09-12T01:11:24.812323+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:12.419689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105416,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":3254,"num_write":1234,"num_write_kb":30224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.379544+0000","last_change":"2024-09-12T00:30:15.133054+0000","last_active":"2024-09-12T01:07:37.379544+0000","last_peered":"2024-09-12T01:07:37.379544+0000","last_clean":"2024-09-12T01:07:37.379544+0000","last_became_active":"2024-09-12T00:30:15.132784+0000","last_became_peered":"2024-09-12T00:30:15.132784+0000","last_unstale":"2024-09-12T01:07:37.379544+0000","last_undegraded":"2024-09-12T01:07:37.379544+0000","last_fullsized":"2024-09-12T01:07:37.379544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:01.793710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'260","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.134150+0000","last_change":"2024-09-12T00:30:17.146875+0000","last_active":"2024-09-12T01:11:24.134150+0000","last_peered":"2024-09-12T01:11:24.134150+0000","last_clean":"2024-09-12T01:11:24.134150+0000","last_became_active":"2024-09-12T00:30:17.146483+0000","last_became_peered":"2024-09-12T00:30:17.146483+0000","last_unstale":"2024-09-12T01:11:24.134150+0000","last_undegraded":"2024-09-12T01:11:24.134150+0000","last_fullsized":"2024-09-12T01:11:24.134150+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:14.781544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51465,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":944,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380029+0000","last_change":"2024-09-12T00:30:19.169288+0000","last_active":"2024-09-12T01:07:43.380029+0000","last_peered":"2024-09-12T01:07:43.380029+0000","last_clean":"2024-09-12T01:07:43.380029+0000","last_became_active":"2024-09-12T00:30:19.168980+0000","last_became_peered":"2024-09-12T00:30:19.168980+0000","last_unstale":"2024-09-12T01:07:43.380029+0000","last_undegraded":"2024-09-12T01:07:43.380029+0000","last_fullsized":"2024-09-12T01:07:43.380029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:55.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'108","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.943994+0000","last_change":"2024-09-12T00:30:21.188045+0000","last_active":"2024-09-12T01:08:50.943994+0000","last_peered":"2024-09-12T01:08:50.943994+0000","last_clean":"2024-09-12T01:08:50.943994+0000","last_became_active":"2024-09-12T00:30:21.187742+0000","last_became_peered":"2024-09-12T00:30:21.187742+0000","last_unstale":"2024-09-12T01:08:50.943994+0000","last_undegraded":"2024-09-12T01:08:50.943994+0000","last_fullsized":"2024-09-12T01:08:50.943994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'264","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.741230+0000","last_change":"2024-09-12T00:30:13.131517+0000","last_active":"2024-09-12T01:08:03.741230+0000","last_peered":"2024-09-12T01:08:03.741230+0000","last_clean":"2024-09-12T01:08:03.741230+0000","last_became_active":"2024-09-12T00:30:13.131204+0000","last_became_peered":"2024-09-12T00:30:13.131204+0000","last_unstale":"2024-09-12T01:08:03.741230+0000","last_undegraded":"2024-09-12T01:08:03.741230+0000","last_fullsized":"2024-09-12T01:08:03.741230+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:06.638417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":908,"num_write":395,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'365","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.710669+0000","last_change":"2024-09-12T00:30:11.104784+0000","last_active":"2024-09-12T01:11:24.710669+0000","last_peered":"2024-09-12T01:11:24.710669+0000","last_clean":"2024-09-12T01:11:24.710669+0000","last_became_active":"2024-09-12T00:30:11.104403+0000","last_became_peered":"2024-09-12T00:30:11.104403+0000","last_unstale":"2024-09-12T01:11:24.710669+0000","last_undegraded":"2024-09-12T01:11:24.710669+0000","last_fullsized":"2024-09-12T01:11:24.710669+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.674612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190266,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":58051,"num_write":1218,"num_write_kb":38205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.509453+0000","last_change":"2024-09-12T00:30:15.128673+0000","last_active":"2024-09-12T01:07:37.509453+0000","last_peered":"2024-09-12T01:07:37.509453+0000","last_clean":"2024-09-12T01:07:37.509453+0000","last_became_active":"2024-09-12T00:30:15.128366+0000","last_became_peered":"2024-09-12T00:30:15.128366+0000","last_unstale":"2024-09-12T01:07:37.509453+0000","last_undegraded":"2024-09-12T01:07:37.509453+0000","last_fullsized":"2024-09-12T01:07:37.509453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:18.808966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'45","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.025516+0000","last_change":"2024-09-12T00:30:17.139289+0000","last_active":"2024-09-12T01:10:26.025516+0000","last_peered":"2024-09-12T01:10:26.025516+0000","last_clean":"2024-09-12T01:10:26.025516+0000","last_became_active":"2024-09-12T00:30:17.138399+0000","last_became_peered":"2024-09-12T00:30:17.138399+0000","last_unstale":"2024-09-12T01:10:26.025516+0000","last_undegraded":"2024-09-12T01:10:26.025516+0000","last_fullsized":"2024-09-12T01:10:26.025516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:34.631922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":31,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.488873+0000","last_change":"2024-09-12T00:30:19.167516+0000","last_active":"2024-09-12T01:07:41.488873+0000","last_peered":"2024-09-12T01:07:41.488873+0000","last_clean":"2024-09-12T01:07:41.488873+0000","last_became_active":"2024-09-12T00:30:19.167213+0000","last_became_peered":"2024-09-12T00:30:19.167213+0000","last_unstale":"2024-09-12T01:07:41.488873+0000","last_undegraded":"2024-09-12T01:07:41.488873+0000","last_fullsized":"2024-09-12T01:07:41.488873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:20.695360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'202","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.271103+0000","last_change":"2024-09-12T00:30:21.185959+0000","last_active":"2024-09-12T01:10:50.271103+0000","last_peered":"2024-09-12T01:10:50.271103+0000","last_clean":"2024-09-12T01:10:50.271103+0000","last_became_active":"2024-09-12T00:30:21.185636+0000","last_became_peered":"2024-09-12T00:30:21.185636+0000","last_unstale":"2024-09-12T01:10:50.271103+0000","last_undegraded":"2024-09-12T01:10:50.271103+0000","last_fullsized":"2024-09-12T01:10:50.271103+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:18.839590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":299,"num_write":483,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'101","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.233430+0000","last_change":"2024-09-12T00:30:13.124435+0000","last_active":"2024-09-12T01:08:23.233430+0000","last_peered":"2024-09-12T01:08:23.233430+0000","last_clean":"2024-09-12T01:08:23.233430+0000","last_became_active":"2024-09-12T00:30:13.124163+0000","last_became_peered":"2024-09-12T00:30:13.124163+0000","last_unstale":"2024-09-12T01:08:23.233430+0000","last_undegraded":"2024-09-12T01:08:23.233430+0000","last_fullsized":"2024-09-12T01:08:23.233430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:34.854665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":380,"num_write":155,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'347","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.822456+0000","last_change":"2024-09-12T00:30:11.111101+0000","last_active":"2024-09-12T01:11:24.822456+0000","last_peered":"2024-09-12T01:11:24.822456+0000","last_clean":"2024-09-12T01:11:24.822456+0000","last_became_active":"2024-09-12T00:30:11.110736+0000","last_became_peered":"2024-09-12T00:30:11.110736+0000","last_unstale":"2024-09-12T01:11:24.822456+0000","last_undegraded":"2024-09-12T01:11:24.822456+0000","last_fullsized":"2024-09-12T01:11:24.822456+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:36.799456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380458,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":820,"num_read_kb":34556,"num_write":1163,"num_write_kb":41998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:36.488227+0000","last_change":"2024-09-12T00:30:15.121446+0000","last_active":"2024-09-12T01:07:36.488227+0000","last_peered":"2024-09-12T01:07:36.488227+0000","last_clean":"2024-09-12T01:07:36.488227+0000","last_became_active":"2024-09-12T00:30:15.121068+0000","last_became_peered":"2024-09-12T00:30:15.121068+0000","last_unstale":"2024-09-12T01:07:36.488227+0000","last_undegraded":"2024-09-12T01:07:36.488227+0000","last_fullsized":"2024-09-12T01:07:36.488227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:39.771010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'314","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.380796+0000","last_change":"2024-09-12T00:30:17.148244+0000","last_active":"2024-09-12T01:11:23.380796+0000","last_peered":"2024-09-12T01:11:23.380796+0000","last_clean":"2024-09-12T01:11:23.380796+0000","last_became_active":"2024-09-12T00:30:17.147946+0000","last_became_peered":"2024-09-12T00:30:17.147946+0000","last_unstale":"2024-09-12T01:11:23.380796+0000","last_undegraded":"2024-09-12T01:11:23.380796+0000","last_fullsized":"2024-09-12T01:11:23.380796+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:12.212273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":1151,"num_write":414,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.399089+0000","last_change":"2024-09-12T00:30:19.167688+0000","last_active":"2024-09-12T01:07:38.399089+0000","last_peered":"2024-09-12T01:07:38.399089+0000","last_clean":"2024-09-12T01:07:38.399089+0000","last_became_active":"2024-09-12T00:30:19.167407+0000","last_became_peered":"2024-09-12T00:30:19.167407+0000","last_unstale":"2024-09-12T01:07:38.399089+0000","last_undegraded":"2024-09-12T01:07:38.399089+0000","last_fullsized":"2024-09-12T01:07:38.399089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:37.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.270721+0000","last_change":"2024-09-12T00:30:21.189080+0000","last_active":"2024-09-12T01:09:23.270721+0000","last_peered":"2024-09-12T01:09:23.270721+0000","last_clean":"2024-09-12T01:09:23.270721+0000","last_became_active":"2024-09-12T00:30:21.188801+0000","last_became_peered":"2024-09-12T00:30:21.188801+0000","last_unstale":"2024-09-12T01:09:23.270721+0000","last_undegraded":"2024-09-12T01:09:23.270721+0000","last_fullsized":"2024-09-12T01:09:23.270721+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:52.941694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":174,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'271","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.925751+0000","last_change":"2024-09-12T00:30:13.122096+0000","last_active":"2024-09-12T01:07:50.925751+0000","last_peered":"2024-09-12T01:07:50.925751+0000","last_clean":"2024-09-12T01:07:50.925751+0000","last_became_active":"2024-09-12T00:30:13.121687+0000","last_became_peered":"2024-09-12T00:30:13.121687+0000","last_unstale":"2024-09-12T01:07:50.925751+0000","last_undegraded":"2024-09-12T01:07:50.925751+0000","last_fullsized":"2024-09-12T01:07:50.925751+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:11.931962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1180,"num_read_kb":936,"num_write":465,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'332","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.795289+0000","last_change":"2024-09-12T00:30:11.098286+0000","last_active":"2024-09-12T01:11:24.795289+0000","last_peered":"2024-09-12T01:11:24.795289+0000","last_clean":"2024-09-12T01:11:24.795289+0000","last_became_active":"2024-09-12T00:30:11.097863+0000","last_became_peered":"2024-09-12T00:30:11.097863+0000","last_unstale":"2024-09-12T01:11:24.795289+0000","last_undegraded":"2024-09-12T01:11:24.795289+0000","last_fullsized":"2024-09-12T01:11:24.795289+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:12.507001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4714622,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":74376,"num_write":1103,"num_write_kb":34671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.595145+0000","last_change":"2024-09-12T00:30:15.125794+0000","last_active":"2024-09-12T01:07:38.595145+0000","last_peered":"2024-09-12T01:07:38.595145+0000","last_clean":"2024-09-12T01:07:38.595145+0000","last_became_active":"2024-09-12T00:30:15.125505+0000","last_became_peered":"2024-09-12T00:30:15.125505+0000","last_unstale":"2024-09-12T01:07:38.595145+0000","last_undegraded":"2024-09-12T01:07:38.595145+0000","last_fullsized":"2024-09-12T01:07:38.595145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:58.671332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'278","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.131148+0000","last_change":"2024-09-12T00:30:17.146728+0000","last_active":"2024-09-12T01:11:23.131148+0000","last_peered":"2024-09-12T01:11:23.131148+0000","last_clean":"2024-09-12T01:11:23.131148+0000","last_became_active":"2024-09-12T00:30:17.146112+0000","last_became_peered":"2024-09-12T00:30:17.146112+0000","last_unstale":"2024-09-12T01:11:23.131148+0000","last_undegraded":"2024-09-12T01:11:23.131148+0000","last_fullsized":"2024-09-12T01:11:23.131148+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:53.604417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56907,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":1155,"num_write":390,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380111+0000","last_change":"2024-09-12T00:30:19.165113+0000","last_active":"2024-09-12T01:07:43.380111+0000","last_peered":"2024-09-12T01:07:43.380111+0000","last_clean":"2024-09-12T01:07:43.380111+0000","last_became_active":"2024-09-12T00:30:19.164820+0000","last_became_peered":"2024-09-12T00:30:19.164820+0000","last_unstale":"2024-09-12T01:07:43.380111+0000","last_undegraded":"2024-09-12T01:07:43.380111+0000","last_fullsized":"2024-09-12T01:07:43.380111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:05.633814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'177","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.659876+0000","last_change":"2024-09-12T00:30:13.124841+0000","last_active":"2024-09-12T01:08:12.659876+0000","last_peered":"2024-09-12T01:08:12.659876+0000","last_clean":"2024-09-12T01:08:12.659876+0000","last_became_active":"2024-09-12T00:30:13.124584+0000","last_became_peered":"2024-09-12T00:30:13.124584+0000","last_unstale":"2024-09-12T01:08:12.659876+0000","last_undegraded":"2024-09-12T01:08:12.659876+0000","last_fullsized":"2024-09-12T01:08:12.659876+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.463711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":813,"num_read_kb":670,"num_write":272,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'359","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.836429+0000","last_change":"2024-09-12T00:30:11.098303+0000","last_active":"2024-09-12T01:11:24.836429+0000","last_peered":"2024-09-12T01:11:24.836429+0000","last_clean":"2024-09-12T01:11:24.836429+0000","last_became_active":"2024-09-12T00:30:11.097890+0000","last_became_peered":"2024-09-12T00:30:11.097890+0000","last_unstale":"2024-09-12T01:11:24.836429+0000","last_undegraded":"2024-09-12T01:11:24.836429+0000","last_fullsized":"2024-09-12T01:11:24.836429+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:22.964167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":38574,"num_write":1151,"num_write_kb":31383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'5","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.477005+0000","last_change":"2024-09-12T00:30:15.122461+0000","last_active":"2024-09-12T01:11:22.477005+0000","last_peered":"2024-09-12T01:11:22.477005+0000","last_clean":"2024-09-12T01:11:22.477005+0000","last_became_active":"2024-09-12T00:30:15.122172+0000","last_became_peered":"2024-09-12T00:30:15.122172+0000","last_unstale":"2024-09-12T01:11:22.477005+0000","last_undegraded":"2024-09-12T01:11:22.477005+0000","last_fullsized":"2024-09-12T01:11:22.477005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:40.318954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'512","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.566682+0000","last_change":"2024-09-12T00:30:17.146325+0000","last_active":"2024-09-12T01:11:24.566682+0000","last_peered":"2024-09-12T01:11:24.566682+0000","last_clean":"2024-09-12T01:11:24.566682+0000","last_became_active":"2024-09-12T00:30:17.145882+0000","last_became_peered":"2024-09-12T00:30:17.145882+0000","last_unstale":"2024-09-12T01:11:24.566682+0000","last_undegraded":"2024-09-12T01:11:24.566682+0000","last_fullsized":"2024-09-12T01:11:24.566682+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:43.412234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96845,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":949,"num_read_kb":2301,"num_write":828,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.490351+0000","last_change":"2024-09-12T00:30:19.171021+0000","last_active":"2024-09-12T01:07:51.490351+0000","last_peered":"2024-09-12T01:07:51.490351+0000","last_clean":"2024-09-12T01:07:51.490351+0000","last_became_active":"2024-09-12T00:30:19.170776+0000","last_became_peered":"2024-09-12T00:30:19.170776+0000","last_unstale":"2024-09-12T01:07:51.490351+0000","last_undegraded":"2024-09-12T01:07:51.490351+0000","last_fullsized":"2024-09-12T01:07:51.490351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:45.791234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'142","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.220138+0000","last_change":"2024-09-12T00:30:21.188712+0000","last_active":"2024-09-12T01:09:12.220138+0000","last_peered":"2024-09-12T01:09:12.220138+0000","last_clean":"2024-09-12T01:09:12.220138+0000","last_became_active":"2024-09-12T00:30:21.188376+0000","last_became_peered":"2024-09-12T00:30:21.188376+0000","last_unstale":"2024-09-12T01:09:12.220138+0000","last_undegraded":"2024-09-12T01:09:12.220138+0000","last_fullsized":"2024-09-12T01:09:12.220138+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:33.881129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":168,"num_write":312,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'188","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.553795+0000","last_change":"2024-09-12T00:30:13.119832+0000","last_active":"2024-09-12T01:08:48.553795+0000","last_peered":"2024-09-12T01:08:48.553795+0000","last_clean":"2024-09-12T01:08:48.553795+0000","last_became_active":"2024-09-12T00:30:13.118251+0000","last_became_peered":"2024-09-12T00:30:13.118251+0000","last_unstale":"2024-09-12T01:08:48.553795+0000","last_undegraded":"2024-09-12T01:08:48.553795+0000","last_fullsized":"2024-09-12T01:08:48.553795+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:08.129477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":709,"num_write":308,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'375","reported_seq":1012,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.801015+0000","last_change":"2024-09-12T00:30:11.103265+0000","last_active":"2024-09-12T01:11:24.801015+0000","last_peered":"2024-09-12T01:11:24.801015+0000","last_clean":"2024-09-12T01:11:24.801015+0000","last_became_active":"2024-09-12T00:30:11.102929+0000","last_became_peered":"2024-09-12T00:30:11.102929+0000","last_unstale":"2024-09-12T01:11:24.801015+0000","last_undegraded":"2024-09-12T01:11:24.801015+0000","last_fullsized":"2024-09-12T01:11:24.801015+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:09.657923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":62693,"num_write":1091,"num_write_kb":37872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489602+0000","last_change":"2024-09-12T00:30:15.127559+0000","last_active":"2024-09-12T01:07:46.489602+0000","last_peered":"2024-09-12T01:07:46.489602+0000","last_clean":"2024-09-12T01:07:46.489602+0000","last_became_active":"2024-09-12T00:30:15.127268+0000","last_became_peered":"2024-09-12T00:30:15.127268+0000","last_unstale":"2024-09-12T01:07:46.489602+0000","last_undegraded":"2024-09-12T01:07:46.489602+0000","last_fullsized":"2024-09-12T01:07:46.489602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:40.481520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'306","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.215461+0000","last_change":"2024-09-12T00:30:17.145767+0000","last_active":"2024-09-12T01:11:23.215461+0000","last_peered":"2024-09-12T01:11:23.215461+0000","last_clean":"2024-09-12T01:11:23.215461+0000","last_became_active":"2024-09-12T00:30:17.145504+0000","last_became_peered":"2024-09-12T00:30:17.145504+0000","last_unstale":"2024-09-12T01:11:23.215461+0000","last_undegraded":"2024-09-12T01:11:23.215461+0000","last_fullsized":"2024-09-12T01:11:23.215461+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.680720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1192,"num_write":444,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.470054+0000","last_change":"2024-09-12T00:30:19.169885+0000","last_active":"2024-09-12T01:07:52.470054+0000","last_peered":"2024-09-12T01:07:52.470054+0000","last_clean":"2024-09-12T01:07:52.470054+0000","last_became_active":"2024-09-12T00:30:19.169558+0000","last_became_peered":"2024-09-12T00:30:19.169558+0000","last_unstale":"2024-09-12T01:07:52.470054+0000","last_undegraded":"2024-09-12T01:07:52.470054+0000","last_fullsized":"2024-09-12T01:07:52.470054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:54.438982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'175","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.845489+0000","last_change":"2024-09-12T00:30:21.188671+0000","last_active":"2024-09-12T01:09:16.845489+0000","last_peered":"2024-09-12T01:09:16.845489+0000","last_clean":"2024-09-12T01:09:16.845489+0000","last_became_active":"2024-09-12T00:30:21.188350+0000","last_became_peered":"2024-09-12T00:30:21.188350+0000","last_unstale":"2024-09-12T01:09:16.845489+0000","last_undegraded":"2024-09-12T01:09:16.845489+0000","last_fullsized":"2024-09-12T01:09:16.845489+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.291083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2246,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":214,"num_write":509,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'191","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.825959+0000","last_change":"2024-09-12T00:30:13.127956+0000","last_active":"2024-09-12T01:09:09.825959+0000","last_peered":"2024-09-12T01:09:09.825959+0000","last_clean":"2024-09-12T01:09:09.825959+0000","last_became_active":"2024-09-12T00:30:13.127294+0000","last_became_peered":"2024-09-12T00:30:13.127294+0000","last_unstale":"2024-09-12T01:09:09.825959+0000","last_undegraded":"2024-09-12T01:09:09.825959+0000","last_fullsized":"2024-09-12T01:09:09.825959+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:36.940318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":881,"num_read_kb":750,"num_write":313,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'341","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.815737+0000","last_change":"2024-09-12T00:30:11.091385+0000","last_active":"2024-09-12T01:11:24.815737+0000","last_peered":"2024-09-12T01:11:24.815737+0000","last_clean":"2024-09-12T01:11:24.815737+0000","last_became_active":"2024-09-12T00:30:11.091027+0000","last_became_peered":"2024-09-12T00:30:11.091027+0000","last_unstale":"2024-09-12T01:11:24.815737+0000","last_undegraded":"2024-09-12T01:11:24.815737+0000","last_fullsized":"2024-09-12T01:11:24.815737+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:30.586849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4477982,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":8604,"num_write":1162,"num_write_kb":27793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489557+0000","last_change":"2024-09-12T00:30:15.126670+0000","last_active":"2024-09-12T01:07:46.489557+0000","last_peered":"2024-09-12T01:07:46.489557+0000","last_clean":"2024-09-12T01:07:46.489557+0000","last_became_active":"2024-09-12T00:30:15.126254+0000","last_became_peered":"2024-09-12T00:30:15.126254+0000","last_unstale":"2024-09-12T01:07:46.489557+0000","last_undegraded":"2024-09-12T01:07:46.489557+0000","last_fullsized":"2024-09-12T01:07:46.489557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:45.385397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'284","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.425385+0000","last_change":"2024-09-12T00:30:17.146500+0000","last_active":"2024-09-12T01:11:24.425385+0000","last_peered":"2024-09-12T01:11:24.425385+0000","last_clean":"2024-09-12T01:11:24.425385+0000","last_became_active":"2024-09-12T00:30:17.146106+0000","last_became_peered":"2024-09-12T00:30:17.146106+0000","last_unstale":"2024-09-12T01:11:24.425385+0000","last_undegraded":"2024-09-12T01:11:24.425385+0000","last_fullsized":"2024-09-12T01:11:24.425385+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:56.226270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1084,"num_write":388,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.385079+0000","last_change":"2024-09-12T00:30:19.167702+0000","last_active":"2024-09-12T01:08:23.385079+0000","last_peered":"2024-09-12T01:08:23.385079+0000","last_clean":"2024-09-12T01:08:23.385079+0000","last_became_active":"2024-09-12T00:30:19.167119+0000","last_became_peered":"2024-09-12T00:30:19.167119+0000","last_unstale":"2024-09-12T01:08:23.385079+0000","last_undegraded":"2024-09-12T01:08:23.385079+0000","last_fullsized":"2024-09-12T01:08:23.385079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:22.072993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'97","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490235+0000","last_change":"2024-09-12T00:30:21.191304+0000","last_active":"2024-09-12T01:10:51.490235+0000","last_peered":"2024-09-12T01:10:51.490235+0000","last_clean":"2024-09-12T01:10:51.490235+0000","last_became_active":"2024-09-12T00:30:21.190937+0000","last_became_peered":"2024-09-12T00:30:21.190937+0000","last_unstale":"2024-09-12T01:10:51.490235+0000","last_undegraded":"2024-09-12T01:10:51.490235+0000","last_fullsized":"2024-09-12T01:10:51.490235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:04.164418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":102,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'207","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:24.682793+0000","last_change":"2024-09-12T00:30:13.120652+0000","last_active":"2024-09-12T01:09:24.682793+0000","last_peered":"2024-09-12T01:09:24.682793+0000","last_clean":"2024-09-12T01:09:24.682793+0000","last_became_active":"2024-09-12T00:30:13.119843+0000","last_became_peered":"2024-09-12T00:30:13.119843+0000","last_unstale":"2024-09-12T01:09:24.682793+0000","last_undegraded":"2024-09-12T01:09:24.682793+0000","last_fullsized":"2024-09-12T01:09:24.682793+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:21.594925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":901,"num_read_kb":747,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'375","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.809955+0000","last_change":"2024-09-12T00:30:11.101174+0000","last_active":"2024-09-12T01:11:24.809955+0000","last_peered":"2024-09-12T01:11:24.809955+0000","last_clean":"2024-09-12T01:11:24.809955+0000","last_became_active":"2024-09-12T00:30:11.100750+0000","last_became_peered":"2024-09-12T00:30:11.100750+0000","last_unstale":"2024-09-12T01:11:24.809955+0000","last_undegraded":"2024-09-12T01:11:24.809955+0000","last_fullsized":"2024-09-12T01:11:24.809955+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:57.978779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1340812,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":582,"num_read_kb":31919,"num_write":1306,"num_write_kb":26213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510757+0000","last_change":"2024-09-12T00:30:15.127738+0000","last_active":"2024-09-12T01:07:47.510757+0000","last_peered":"2024-09-12T01:07:47.510757+0000","last_clean":"2024-09-12T01:07:47.510757+0000","last_became_active":"2024-09-12T00:30:15.127444+0000","last_became_peered":"2024-09-12T00:30:15.127444+0000","last_unstale":"2024-09-12T01:07:47.510757+0000","last_undegraded":"2024-09-12T01:07:47.510757+0000","last_fullsized":"2024-09-12T01:07:47.510757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:29.367406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'84","reported_seq":596,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.218785+0000","last_change":"2024-09-12T00:30:17.144599+0000","last_active":"2024-09-12T01:10:26.218785+0000","last_peered":"2024-09-12T01:10:26.218785+0000","last_clean":"2024-09-12T01:10:26.218785+0000","last_became_active":"2024-09-12T00:30:17.144283+0000","last_became_peered":"2024-09-12T00:30:17.144283+0000","last_unstale":"2024-09-12T01:10:26.218785+0000","last_undegraded":"2024-09-12T01:10:26.218785+0000","last_fullsized":"2024-09-12T01:10:26.218785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:42.626907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":66,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'770","reported_seq":2398,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.152809+0000","last_change":"2024-09-12T00:30:19.167155+0000","last_active":"2024-09-12T01:11:24.152809+0000","last_peered":"2024-09-12T01:11:24.152809+0000","last_clean":"2024-09-12T01:11:24.152809+0000","last_became_active":"2024-09-12T00:30:19.166851+0000","last_became_peered":"2024-09-12T00:30:19.166851+0000","last_unstale":"2024-09-12T01:11:24.152809+0000","last_undegraded":"2024-09-12T01:11:24.152809+0000","last_fullsized":"2024-09-12T01:11:24.152809+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:22.407452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'131","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.215109+0000","last_change":"2024-09-12T00:30:21.190459+0000","last_active":"2024-09-12T01:09:31.215109+0000","last_peered":"2024-09-12T01:09:31.215109+0000","last_clean":"2024-09-12T01:09:31.215109+0000","last_became_active":"2024-09-12T00:30:21.190151+0000","last_became_peered":"2024-09-12T00:30:21.190151+0000","last_unstale":"2024-09-12T01:09:31.215109+0000","last_undegraded":"2024-09-12T01:09:31.215109+0000","last_fullsized":"2024-09-12T01:09:31.215109+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:54.921241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'111","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489533+0000","last_change":"2024-09-12T00:30:13.124415+0000","last_active":"2024-09-12T01:07:46.489533+0000","last_peered":"2024-09-12T01:07:46.489533+0000","last_clean":"2024-09-12T01:07:46.489533+0000","last_became_active":"2024-09-12T00:30:13.124167+0000","last_became_peered":"2024-09-12T00:30:13.124167+0000","last_unstale":"2024-09-12T01:07:46.489533+0000","last_undegraded":"2024-09-12T01:07:46.489533+0000","last_fullsized":"2024-09-12T01:07:46.489533+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:40.559024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":425,"num_write":152,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'457","reported_seq":1153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.749658+0000","last_change":"2024-09-12T00:30:11.109569+0000","last_active":"2024-09-12T01:11:24.749658+0000","last_peered":"2024-09-12T01:11:24.749658+0000","last_clean":"2024-09-12T01:11:24.749658+0000","last_became_active":"2024-09-12T00:30:11.108422+0000","last_became_peered":"2024-09-12T00:30:11.108422+0000","last_unstale":"2024-09-12T01:11:24.749658+0000","last_undegraded":"2024-09-12T01:11:24.749658+0000","last_fullsized":"2024-09-12T01:11:24.749658+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:38.097953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314887,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":867,"num_read_kb":2765,"num_write":1329,"num_write_kb":29562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.400338+0000","last_change":"2024-09-12T00:30:15.125457+0000","last_active":"2024-09-12T01:07:48.400338+0000","last_peered":"2024-09-12T01:07:48.400338+0000","last_clean":"2024-09-12T01:07:48.400338+0000","last_became_active":"2024-09-12T00:30:15.124922+0000","last_became_peered":"2024-09-12T00:30:15.124922+0000","last_unstale":"2024-09-12T01:07:48.400338+0000","last_undegraded":"2024-09-12T01:07:48.400338+0000","last_fullsized":"2024-09-12T01:07:48.400338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:27.550117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'350","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.866350+0000","last_change":"2024-09-12T00:30:17.149283+0000","last_active":"2024-09-12T01:11:24.866350+0000","last_peered":"2024-09-12T01:11:24.866350+0000","last_clean":"2024-09-12T01:11:24.866350+0000","last_became_active":"2024-09-12T00:30:17.148793+0000","last_became_peered":"2024-09-12T00:30:17.148793+0000","last_unstale":"2024-09-12T01:11:24.866350+0000","last_undegraded":"2024-09-12T01:11:24.866350+0000","last_fullsized":"2024-09-12T01:11:24.866350+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:33.498700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62476,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1247,"num_write":454,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.521435+0000","last_change":"2024-09-12T00:30:19.170247+0000","last_active":"2024-09-12T01:09:02.521435+0000","last_peered":"2024-09-12T01:09:02.521435+0000","last_clean":"2024-09-12T01:09:02.521435+0000","last_became_active":"2024-09-12T00:30:19.169982+0000","last_became_peered":"2024-09-12T00:30:19.169982+0000","last_unstale":"2024-09-12T01:09:02.521435+0000","last_undegraded":"2024-09-12T01:09:02.521435+0000","last_fullsized":"2024-09-12T01:09:02.521435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'144","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.854030+0000","last_change":"2024-09-12T00:30:21.187973+0000","last_active":"2024-09-12T01:09:32.854030+0000","last_peered":"2024-09-12T01:09:32.854030+0000","last_clean":"2024-09-12T01:09:32.854030+0000","last_became_active":"2024-09-12T00:30:21.187641+0000","last_became_peered":"2024-09-12T00:30:21.187641+0000","last_unstale":"2024-09-12T01:09:32.854030+0000","last_undegraded":"2024-09-12T01:09:32.854030+0000","last_fullsized":"2024-09-12T01:09:32.854030+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:39.449383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":136,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'194","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.088663+0000","last_change":"2024-09-12T00:30:13.123094+0000","last_active":"2024-09-12T01:09:27.088663+0000","last_peered":"2024-09-12T01:09:27.088663+0000","last_clean":"2024-09-12T01:09:27.088663+0000","last_became_active":"2024-09-12T00:30:13.122622+0000","last_became_peered":"2024-09-12T00:30:13.122622+0000","last_unstale":"2024-09-12T01:09:27.088663+0000","last_undegraded":"2024-09-12T01:09:27.088663+0000","last_fullsized":"2024-09-12T01:09:27.088663+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:35.254290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":295,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'335","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.790583+0000","last_change":"2024-09-12T00:30:11.110375+0000","last_active":"2024-09-12T01:11:24.790583+0000","last_peered":"2024-09-12T01:11:24.790583+0000","last_clean":"2024-09-12T01:11:24.790583+0000","last_became_active":"2024-09-12T00:30:11.109855+0000","last_became_peered":"2024-09-12T00:30:11.109855+0000","last_unstale":"2024-09-12T01:11:24.790583+0000","last_undegraded":"2024-09-12T01:11:24.790583+0000","last_fullsized":"2024-09-12T01:11:24.790583+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:19.550416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314923,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":64470,"num_write":1037,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:46.489543+0000","last_change":"2024-09-12T00:30:15.126170+0000","last_active":"2024-09-12T01:07:46.489543+0000","last_peered":"2024-09-12T01:07:46.489543+0000","last_clean":"2024-09-12T01:07:46.489543+0000","last_became_active":"2024-09-12T00:30:15.125870+0000","last_became_peered":"2024-09-12T00:30:15.125870+0000","last_unstale":"2024-09-12T01:07:46.489543+0000","last_undegraded":"2024-09-12T01:07:46.489543+0000","last_fullsized":"2024-09-12T01:07:46.489543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:51.538427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'277","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.627432+0000","last_change":"2024-09-12T00:30:17.149628+0000","last_active":"2024-09-12T01:11:22.627432+0000","last_peered":"2024-09-12T01:11:22.627432+0000","last_clean":"2024-09-12T01:11:22.627432+0000","last_became_active":"2024-09-12T00:30:17.149226+0000","last_became_peered":"2024-09-12T00:30:17.149226+0000","last_unstale":"2024-09-12T01:11:22.627432+0000","last_undegraded":"2024-09-12T01:11:22.627432+0000","last_fullsized":"2024-09-12T01:11:22.627432+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:10.554142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":1045,"num_write":368,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.606510+0000","last_change":"2024-09-12T00:30:19.164875+0000","last_active":"2024-09-12T01:09:03.606510+0000","last_peered":"2024-09-12T01:09:03.606510+0000","last_clean":"2024-09-12T01:09:03.606510+0000","last_became_active":"2024-09-12T00:30:19.164556+0000","last_became_peered":"2024-09-12T00:30:19.164556+0000","last_unstale":"2024-09-12T01:09:03.606510+0000","last_undegraded":"2024-09-12T01:09:03.606510+0000","last_fullsized":"2024-09-12T01:09:03.606510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:05.138428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'135","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.068765+0000","last_change":"2024-09-12T00:30:21.193857+0000","last_active":"2024-09-12T01:09:09.068765+0000","last_peered":"2024-09-12T01:09:09.068765+0000","last_clean":"2024-09-12T01:09:09.068765+0000","last_became_active":"2024-09-12T00:30:21.193606+0000","last_became_peered":"2024-09-12T00:30:21.193606+0000","last_unstale":"2024-09-12T01:09:09.068765+0000","last_undegraded":"2024-09-12T01:09:09.068765+0000","last_fullsized":"2024-09-12T01:09:09.068765+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:56.806530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":946,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":239,"num_write":347,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'4096","reported_seq":4671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.218622+0000","last_change":"2024-09-12T00:30:13.121220+0000","last_active":"2024-09-12T01:09:12.218622+0000","last_peered":"2024-09-12T01:09:12.218622+0000","last_clean":"2024-09-12T01:09:12.218622+0000","last_became_active":"2024-09-12T00:30:13.120940+0000","last_became_peered":"2024-09-12T00:30:13.120940+0000","last_unstale":"2024-09-12T01:09:12.218622+0000","last_undegraded":"2024-09-12T01:09:12.218622+0000","last_fullsized":"2024-09-12T01:09:12.218622+0000","mapping_epoch":28,"log_start":"264'4000","ondisk_log_start":"264'4000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:07.657138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16459,"num_read_kb":13812,"num_write":6134,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'369","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.753416+0000","last_change":"2024-09-12T00:30:11.099270+0000","last_active":"2024-09-12T01:11:24.753416+0000","last_peered":"2024-09-12T01:11:24.753416+0000","last_clean":"2024-09-12T01:11:24.753416+0000","last_became_active":"2024-09-12T00:30:11.098879+0000","last_became_peered":"2024-09-12T00:30:11.098879+0000","last_unstale":"2024-09-12T01:11:24.753416+0000","last_undegraded":"2024-09-12T01:11:24.753416+0000","last_fullsized":"2024-09-12T01:11:24.753416+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:03.440870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4317103,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":44113,"num_write":1057,"num_write_kb":43739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409893+0000","last_change":"2024-09-12T00:30:15.125790+0000","last_active":"2024-09-12T01:08:58.409893+0000","last_peered":"2024-09-12T01:08:58.409893+0000","last_clean":"2024-09-12T01:08:58.409893+0000","last_became_active":"2024-09-12T00:30:15.125452+0000","last_became_peered":"2024-09-12T00:30:15.125452+0000","last_unstale":"2024-09-12T01:08:58.409893+0000","last_undegraded":"2024-09-12T01:08:58.409893+0000","last_fullsized":"2024-09-12T01:08:58.409893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:30.616035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'234","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.275770+0000","last_change":"2024-09-12T00:30:17.146683+0000","last_active":"2024-09-12T01:11:24.275770+0000","last_peered":"2024-09-12T01:11:24.275770+0000","last_clean":"2024-09-12T01:11:24.275770+0000","last_became_active":"2024-09-12T00:30:17.145961+0000","last_became_peered":"2024-09-12T00:30:17.145961+0000","last_unstale":"2024-09-12T01:11:24.275770+0000","last_undegraded":"2024-09-12T01:11:24.275770+0000","last_fullsized":"2024-09-12T01:11:24.275770+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:39.502275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":376,"num_read_kb":862,"num_write":304,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596405+0000","last_change":"2024-09-12T00:30:19.168010+0000","last_active":"2024-09-12T01:07:48.596405+0000","last_peered":"2024-09-12T01:07:48.596405+0000","last_clean":"2024-09-12T01:07:48.596405+0000","last_became_active":"2024-09-12T00:30:19.167723+0000","last_became_peered":"2024-09-12T00:30:19.167723+0000","last_unstale":"2024-09-12T01:07:48.596405+0000","last_undegraded":"2024-09-12T01:07:48.596405+0000","last_fullsized":"2024-09-12T01:07:48.596405+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:31.864085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'170","reported_seq":1614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:44.781840+0000","last_change":"2024-09-12T00:30:21.188654+0000","last_active":"2024-09-12T01:09:44.781840+0000","last_peered":"2024-09-12T01:09:44.781840+0000","last_clean":"2024-09-12T01:09:44.781840+0000","last_became_active":"2024-09-12T00:30:21.188363+0000","last_became_peered":"2024-09-12T00:30:21.188363+0000","last_unstale":"2024-09-12T01:09:44.781840+0000","last_undegraded":"2024-09-12T01:09:44.781840+0000","last_fullsized":"2024-09-12T01:09:44.781840+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:40.099921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1158,"num_read_kb":1157,"num_write":386,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'184","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.498641+0000","last_change":"2024-09-12T00:30:13.126020+0000","last_active":"2024-09-12T01:08:56.498641+0000","last_peered":"2024-09-12T01:08:56.498641+0000","last_clean":"2024-09-12T01:08:56.498641+0000","last_became_active":"2024-09-12T00:30:13.125727+0000","last_became_peered":"2024-09-12T00:30:13.125727+0000","last_unstale":"2024-09-12T01:08:56.498641+0000","last_undegraded":"2024-09-12T01:08:56.498641+0000","last_fullsized":"2024-09-12T01:08:56.498641+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:09.160490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":704,"num_write":275,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'321","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.788619+0000","last_change":"2024-09-12T00:30:11.092275+0000","last_active":"2024-09-12T01:11:24.788619+0000","last_peered":"2024-09-12T01:11:24.788619+0000","last_clean":"2024-09-12T01:11:24.788619+0000","last_became_active":"2024-09-12T00:30:11.091808+0000","last_became_peered":"2024-09-12T00:30:11.091808+0000","last_unstale":"2024-09-12T01:11:24.788619+0000","last_undegraded":"2024-09-12T01:11:24.788619+0000","last_fullsized":"2024-09-12T01:11:24.788619+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:26.055957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380471,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":432,"num_read_kb":10679,"num_write":986,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.521489+0000","last_change":"2024-09-12T00:30:15.127289+0000","last_active":"2024-09-12T01:09:02.521489+0000","last_peered":"2024-09-12T01:09:02.521489+0000","last_clean":"2024-09-12T01:09:02.521489+0000","last_became_active":"2024-09-12T00:30:15.126206+0000","last_became_peered":"2024-09-12T00:30:15.126206+0000","last_unstale":"2024-09-12T01:09:02.521489+0000","last_undegraded":"2024-09-12T01:09:02.521489+0000","last_fullsized":"2024-09-12T01:09:02.521489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:39.699331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'302","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.494698+0000","last_change":"2024-09-12T00:30:17.145025+0000","last_active":"2024-09-12T01:11:24.494698+0000","last_peered":"2024-09-12T01:11:24.494698+0000","last_clean":"2024-09-12T01:11:24.494698+0000","last_became_active":"2024-09-12T00:30:17.144724+0000","last_became_peered":"2024-09-12T00:30:17.144724+0000","last_unstale":"2024-09-12T01:11:24.494698+0000","last_undegraded":"2024-09-12T01:11:24.494698+0000","last_fullsized":"2024-09-12T01:11:24.494698+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:32.229866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48397,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":1068,"num_write":398,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511636+0000","last_change":"2024-09-12T00:30:19.172540+0000","last_active":"2024-09-12T01:07:52.511636+0000","last_peered":"2024-09-12T01:07:52.511636+0000","last_clean":"2024-09-12T01:07:52.511636+0000","last_became_active":"2024-09-12T00:30:19.172265+0000","last_became_peered":"2024-09-12T00:30:19.172265+0000","last_unstale":"2024-09-12T01:07:52.511636+0000","last_undegraded":"2024-09-12T01:07:52.511636+0000","last_fullsized":"2024-09-12T01:07:52.511636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:34.189913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'129","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.303430+0000","last_change":"2024-09-12T00:30:21.192137+0000","last_active":"2024-09-12T01:10:50.303430+0000","last_peered":"2024-09-12T01:10:50.303430+0000","last_clean":"2024-09-12T01:10:50.303430+0000","last_became_active":"2024-09-12T00:30:21.191837+0000","last_became_peered":"2024-09-12T00:30:21.191837+0000","last_unstale":"2024-09-12T01:10:50.303430+0000","last_undegraded":"2024-09-12T01:10:50.303430+0000","last_fullsized":"2024-09-12T01:10:50.303430+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:51.812234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":99,"num_write":307,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'142","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.522841+0000","last_change":"2024-09-12T00:30:13.122097+0000","last_active":"2024-09-12T01:09:12.522841+0000","last_peered":"2024-09-12T01:09:12.522841+0000","last_clean":"2024-09-12T01:09:12.522841+0000","last_became_active":"2024-09-12T00:30:13.121828+0000","last_became_peered":"2024-09-12T00:30:13.121828+0000","last_unstale":"2024-09-12T01:09:12.522841+0000","last_undegraded":"2024-09-12T01:09:12.522841+0000","last_fullsized":"2024-09-12T01:09:12.522841+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.165397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":656,"num_read_kb":543,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'369","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.775621+0000","last_change":"2024-09-12T00:30:11.106219+0000","last_active":"2024-09-12T01:11:24.775621+0000","last_peered":"2024-09-12T01:11:24.775621+0000","last_clean":"2024-09-12T01:11:24.775621+0000","last_became_active":"2024-09-12T00:30:11.105480+0000","last_became_peered":"2024-09-12T00:30:11.105480+0000","last_unstale":"2024-09-12T01:11:24.775621+0000","last_undegraded":"2024-09-12T01:11:24.775621+0000","last_fullsized":"2024-09-12T01:11:24.775621+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:30.955171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029011,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":778,"num_read_kb":27112,"num_write":1220,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'88","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:25.698914+0000","last_change":"2024-09-12T00:30:13.130762+0000","last_active":"2024-09-12T01:09:25.698914+0000","last_peered":"2024-09-12T01:09:25.698914+0000","last_clean":"2024-09-12T01:09:25.698914+0000","last_became_active":"2024-09-12T00:30:13.130421+0000","last_became_peered":"2024-09-12T00:30:13.130421+0000","last_unstale":"2024-09-12T01:09:25.698914+0000","last_undegraded":"2024-09-12T01:09:25.698914+0000","last_fullsized":"2024-09-12T01:09:25.698914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:30.693777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":312,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'345","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.764253+0000","last_change":"2024-09-12T00:30:11.092694+0000","last_active":"2024-09-12T01:11:24.764253+0000","last_peered":"2024-09-12T01:11:24.764253+0000","last_clean":"2024-09-12T01:11:24.764253+0000","last_became_active":"2024-09-12T00:30:11.092318+0000","last_became_peered":"2024-09-12T00:30:11.092318+0000","last_unstale":"2024-09-12T01:11:24.764253+0000","last_undegraded":"2024-09-12T01:11:24.764253+0000","last_fullsized":"2024-09-12T01:11:24.764253+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:49.888269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287236,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":12148,"num_write":1066,"num_write_kb":57585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'403","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.766486+0000","last_change":"2024-09-12T00:30:13.127156+0000","last_active":"2024-09-12T01:09:27.766486+0000","last_peered":"2024-09-12T01:09:27.766486+0000","last_clean":"2024-09-12T01:09:27.766486+0000","last_became_active":"2024-09-12T00:30:13.126912+0000","last_became_peered":"2024-09-12T00:30:13.126912+0000","last_unstale":"2024-09-12T01:09:27.766486+0000","last_undegraded":"2024-09-12T01:09:27.766486+0000","last_fullsized":"2024-09-12T01:09:27.766486+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:42.227244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1731,"num_read_kb":1377,"num_write":679,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'430","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.775574+0000","last_change":"2024-09-12T00:30:11.099450+0000","last_active":"2024-09-12T01:11:24.775574+0000","last_peered":"2024-09-12T01:11:24.775574+0000","last_clean":"2024-09-12T01:11:24.775574+0000","last_became_active":"2024-09-12T00:30:11.099069+0000","last_became_peered":"2024-09-12T00:30:11.099069+0000","last_unstale":"2024-09-12T01:11:24.775574+0000","last_undegraded":"2024-09-12T01:11:24.775574+0000","last_fullsized":"2024-09-12T01:11:24.775574+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:15.083942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380696,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":691,"num_read_kb":70901,"num_write":1282,"num_write_kb":51705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'117","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.482213+0000","last_change":"2024-09-12T00:30:13.127130+0000","last_active":"2024-09-12T01:09:12.482213+0000","last_peered":"2024-09-12T01:09:12.482213+0000","last_clean":"2024-09-12T01:09:12.482213+0000","last_became_active":"2024-09-12T00:30:13.126860+0000","last_became_peered":"2024-09-12T00:30:13.126860+0000","last_unstale":"2024-09-12T01:09:12.482213+0000","last_undegraded":"2024-09-12T01:09:12.482213+0000","last_fullsized":"2024-09-12T01:09:12.482213+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:11.846692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":463,"num_write":200,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'328","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.810637+0000","last_change":"2024-09-12T00:30:11.105582+0000","last_active":"2024-09-12T01:11:24.810637+0000","last_peered":"2024-09-12T01:11:24.810637+0000","last_clean":"2024-09-12T01:11:24.810637+0000","last_became_active":"2024-09-12T00:30:11.105196+0000","last_became_peered":"2024-09-12T00:30:11.105196+0000","last_unstale":"2024-09-12T01:11:24.810637+0000","last_undegraded":"2024-09-12T01:11:24.810637+0000","last_fullsized":"2024-09-12T01:11:24.810637+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:05.512265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":8473,"num_write":1002,"num_write_kb":46203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'4191","reported_seq":4832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.275772+0000","last_change":"2024-09-12T00:30:13.125779+0000","last_active":"2024-09-12T01:09:46.275772+0000","last_peered":"2024-09-12T01:09:46.275772+0000","last_clean":"2024-09-12T01:09:46.275772+0000","last_became_active":"2024-09-12T00:30:13.125353+0000","last_became_peered":"2024-09-12T00:30:13.125353+0000","last_unstale":"2024-09-12T01:09:46.275772+0000","last_undegraded":"2024-09-12T01:09:46.275772+0000","last_fullsized":"2024-09-12T01:09:46.275772+0000","mapping_epoch":28,"log_start":"264'4100","ondisk_log_start":"264'4100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":3000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:27.342797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16885,"num_read_kb":14166,"num_write":6282,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'387","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.785621+0000","last_change":"2024-09-12T00:30:11.108515+0000","last_active":"2024-09-12T01:11:24.785621+0000","last_peered":"2024-09-12T01:11:24.785621+0000","last_clean":"2024-09-12T01:11:24.785621+0000","last_became_active":"2024-09-12T00:30:11.108127+0000","last_became_peered":"2024-09-12T00:30:11.108127+0000","last_unstale":"2024-09-12T01:11:24.785621+0000","last_undegraded":"2024-09-12T01:11:24.785621+0000","last_fullsized":"2024-09-12T01:11:24.785621+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:39.466509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105411,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":473,"num_read_kb":2771,"num_write":1102,"num_write_kb":29841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'185","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.516867+0000","last_change":"2024-09-12T00:30:13.129689+0000","last_active":"2024-09-12T01:07:43.516867+0000","last_peered":"2024-09-12T01:07:43.516867+0000","last_clean":"2024-09-12T01:07:43.516867+0000","last_became_active":"2024-09-12T00:30:13.129432+0000","last_became_peered":"2024-09-12T00:30:13.129432+0000","last_unstale":"2024-09-12T01:07:43.516867+0000","last_undegraded":"2024-09-12T01:07:43.516867+0000","last_fullsized":"2024-09-12T01:07:43.516867+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:23.760718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":694,"num_write":316,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'364","reported_seq":1072,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.814109+0000","last_change":"2024-09-12T00:30:11.108733+0000","last_active":"2024-09-12T01:11:24.814109+0000","last_peered":"2024-09-12T01:11:24.814109+0000","last_clean":"2024-09-12T01:11:24.814109+0000","last_became_active":"2024-09-12T00:30:11.108351+0000","last_became_peered":"2024-09-12T00:30:11.108351+0000","last_unstale":"2024-09-12T01:11:24.814109+0000","last_undegraded":"2024-09-12T01:11:24.814109+0000","last_fullsized":"2024-09-12T01:11:24.814109+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:25.752418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648362,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":667,"num_read_kb":30774,"num_write":1247,"num_write_kb":36026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'163","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.830877+0000","last_change":"2024-09-12T00:30:13.124976+0000","last_active":"2024-09-12T01:08:14.830877+0000","last_peered":"2024-09-12T01:08:14.830877+0000","last_clean":"2024-09-12T01:08:14.830877+0000","last_became_active":"2024-09-12T00:30:13.124637+0000","last_became_peered":"2024-09-12T00:30:13.124637+0000","last_unstale":"2024-09-12T01:08:14.830877+0000","last_undegraded":"2024-09-12T01:08:14.830877+0000","last_fullsized":"2024-09-12T01:08:14.830877+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:27.099393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":588,"num_write":241,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'372","reported_seq":1035,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.841790+0000","last_change":"2024-09-12T00:30:11.110962+0000","last_active":"2024-09-12T01:11:24.841790+0000","last_peered":"2024-09-12T01:11:24.841790+0000","last_clean":"2024-09-12T01:11:24.841790+0000","last_became_active":"2024-09-12T00:30:11.108084+0000","last_became_peered":"2024-09-12T00:30:11.108084+0000","last_unstale":"2024-09-12T01:11:24.841790+0000","last_undegraded":"2024-09-12T01:11:24.841790+0000","last_fullsized":"2024-09-12T01:11:24.841790+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:46.496743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5025600,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":616,"num_read_kb":11433,"num_write":1237,"num_write_kb":28830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'237","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.819696+0000","last_change":"2024-09-12T00:30:13.129156+0000","last_active":"2024-09-12T01:09:46.819696+0000","last_peered":"2024-09-12T01:09:46.819696+0000","last_clean":"2024-09-12T01:09:46.819696+0000","last_became_active":"2024-09-12T00:30:13.128799+0000","last_became_peered":"2024-09-12T00:30:13.128799+0000","last_unstale":"2024-09-12T01:09:46.819696+0000","last_undegraded":"2024-09-12T01:09:46.819696+0000","last_fullsized":"2024-09-12T01:09:46.819696+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:02.256587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":871,"num_write":360,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'352","reported_seq":975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.853375+0000","last_change":"2024-09-12T00:30:11.103076+0000","last_active":"2024-09-12T01:11:24.853375+0000","last_peered":"2024-09-12T01:11:24.853375+0000","last_clean":"2024-09-12T01:11:24.853375+0000","last_became_active":"2024-09-12T00:30:11.102617+0000","last_became_peered":"2024-09-12T00:30:11.102617+0000","last_unstale":"2024-09-12T01:11:24.853375+0000","last_undegraded":"2024-09-12T01:11:24.853375+0000","last_fullsized":"2024-09-12T01:11:24.853375+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364846,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":18671,"num_write":1023,"num_write_kb":28835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'52","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.491391+0000","last_change":"2024-09-12T00:30:13.123470+0000","last_active":"2024-09-12T01:08:22.491391+0000","last_peered":"2024-09-12T01:08:22.491391+0000","last_clean":"2024-09-12T01:08:22.491391+0000","last_became_active":"2024-09-12T00:30:13.123035+0000","last_became_peered":"2024-09-12T00:30:13.123035+0000","last_unstale":"2024-09-12T01:08:22.491391+0000","last_undegraded":"2024-09-12T01:08:22.491391+0000","last_fullsized":"2024-09-12T01:08:22.491391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.860214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":222,"num_write":77,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'336","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.858748+0000","last_change":"2024-09-12T00:30:11.112796+0000","last_active":"2024-09-12T01:11:24.858748+0000","last_peered":"2024-09-12T01:11:24.858748+0000","last_clean":"2024-09-12T01:11:24.858748+0000","last_became_active":"2024-09-12T00:30:11.110299+0000","last_became_peered":"2024-09-12T00:30:11.110299+0000","last_unstale":"2024-09-12T01:11:24.858748+0000","last_undegraded":"2024-09-12T01:11:24.858748+0000","last_fullsized":"2024-09-12T01:11:24.858748+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:24.673935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":443,"num_read_kb":30015,"num_write":1046,"num_write_kb":30187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'180","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.132211+0000","last_change":"2024-09-12T00:30:13.124078+0000","last_active":"2024-09-12T01:09:12.132211+0000","last_peered":"2024-09-12T01:09:12.132211+0000","last_clean":"2024-09-12T01:09:12.132211+0000","last_became_active":"2024-09-12T00:30:13.123217+0000","last_became_peered":"2024-09-12T00:30:13.123217+0000","last_unstale":"2024-09-12T01:09:12.132211+0000","last_undegraded":"2024-09-12T01:09:12.132211+0000","last_fullsized":"2024-09-12T01:09:12.132211+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:27.761815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":608,"num_write":257,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'316","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.707571+0000","last_change":"2024-09-12T00:30:11.103101+0000","last_active":"2024-09-12T01:11:24.707571+0000","last_peered":"2024-09-12T01:11:24.707571+0000","last_clean":"2024-09-12T01:11:24.707571+0000","last_became_active":"2024-09-12T00:30:11.102436+0000","last_became_peered":"2024-09-12T00:30:11.102436+0000","last_unstale":"2024-09-12T01:11:24.707571+0000","last_undegraded":"2024-09-12T01:11:24.707571+0000","last_fullsized":"2024-09-12T01:11:24.707571+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:41.189010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315002,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":79108,"num_write":1106,"num_write_kb":40469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'217","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.852926+0000","last_change":"2024-09-12T00:30:13.130944+0000","last_active":"2024-09-12T01:09:32.852926+0000","last_peered":"2024-09-12T01:09:32.852926+0000","last_clean":"2024-09-12T01:09:32.852926+0000","last_became_active":"2024-09-12T00:30:13.129733+0000","last_became_peered":"2024-09-12T00:30:13.129733+0000","last_unstale":"2024-09-12T01:09:32.852926+0000","last_undegraded":"2024-09-12T01:09:32.852926+0000","last_fullsized":"2024-09-12T01:09:32.852926+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.671267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":953,"num_read_kb":786,"num_write":335,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'382","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.836077+0000","last_change":"2024-09-12T00:30:11.106483+0000","last_active":"2024-09-12T01:11:24.836077+0000","last_peered":"2024-09-12T01:11:24.836077+0000","last_clean":"2024-09-12T01:11:24.836077+0000","last_became_active":"2024-09-12T00:30:11.105950+0000","last_became_peered":"2024-09-12T00:30:11.105950+0000","last_unstale":"2024-09-12T01:11:24.836077+0000","last_undegraded":"2024-09-12T01:11:24.836077+0000","last_fullsized":"2024-09-12T01:11:24.836077+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:12.198729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4299828,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":589,"num_read_kb":20762,"num_write":1342,"num_write_kb":32414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'172","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:33.452544+0000","last_change":"2024-09-12T00:30:13.128272+0000","last_active":"2024-09-12T01:09:33.452544+0000","last_peered":"2024-09-12T01:09:33.452544+0000","last_clean":"2024-09-12T01:09:33.452544+0000","last_became_active":"2024-09-12T00:30:13.128009+0000","last_became_peered":"2024-09-12T00:30:13.128009+0000","last_unstale":"2024-09-12T01:09:33.452544+0000","last_undegraded":"2024-09-12T01:09:33.452544+0000","last_fullsized":"2024-09-12T01:09:33.452544+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:55.279618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":738,"num_read_kb":604,"num_write":258,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'395","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.836387+0000","last_change":"2024-09-12T00:30:11.097300+0000","last_active":"2024-09-12T01:11:24.836387+0000","last_peered":"2024-09-12T01:11:24.836387+0000","last_clean":"2024-09-12T01:11:24.836387+0000","last_became_active":"2024-09-12T00:30:11.096908+0000","last_became_peered":"2024-09-12T00:30:11.096908+0000","last_unstale":"2024-09-12T01:11:24.836387+0000","last_undegraded":"2024-09-12T01:11:24.836387+0000","last_fullsized":"2024-09-12T01:11:24.836387+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:48.080479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":27824,"num_write":1325,"num_write_kb":35997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'129","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.405828+0000","last_change":"2024-09-12T00:30:13.127092+0000","last_active":"2024-09-12T01:08:28.405828+0000","last_peered":"2024-09-12T01:08:28.405828+0000","last_clean":"2024-09-12T01:08:28.405828+0000","last_became_active":"2024-09-12T00:30:13.126817+0000","last_became_peered":"2024-09-12T00:30:13.126817+0000","last_unstale":"2024-09-12T01:08:28.405828+0000","last_undegraded":"2024-09-12T01:08:28.405828+0000","last_fullsized":"2024-09-12T01:08:28.405828+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:29.950480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":588,"num_read_kb":486,"num_write":195,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'337","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.830298+0000","last_change":"2024-09-12T00:30:11.105919+0000","last_active":"2024-09-12T01:11:24.830298+0000","last_peered":"2024-09-12T01:11:24.830298+0000","last_clean":"2024-09-12T01:11:24.830298+0000","last_became_active":"2024-09-12T00:30:11.105575+0000","last_became_peered":"2024-09-12T00:30:11.105575+0000","last_unstale":"2024-09-12T01:11:24.830298+0000","last_undegraded":"2024-09-12T01:11:24.830298+0000","last_fullsized":"2024-09-12T01:11:24.830298+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:20.050929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":45130,"num_write":1156,"num_write_kb":46621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'202","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.432143+0000","last_change":"2024-09-12T00:30:13.129377+0000","last_active":"2024-09-12T01:09:03.432143+0000","last_peered":"2024-09-12T01:09:03.432143+0000","last_clean":"2024-09-12T01:09:03.432143+0000","last_became_active":"2024-09-12T00:30:13.129092+0000","last_became_peered":"2024-09-12T00:30:13.129092+0000","last_unstale":"2024-09-12T01:09:03.432143+0000","last_undegraded":"2024-09-12T01:09:03.432143+0000","last_fullsized":"2024-09-12T01:09:03.432143+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:03.194905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":854,"num_read_kb":707,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'347","reported_seq":1187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.828604+0000","last_change":"2024-09-12T00:30:11.109364+0000","last_active":"2024-09-12T01:11:24.828604+0000","last_peered":"2024-09-12T01:11:24.828604+0000","last_clean":"2024-09-12T01:11:24.828604+0000","last_became_active":"2024-09-12T00:30:11.108616+0000","last_became_peered":"2024-09-12T00:30:11.108616+0000","last_unstale":"2024-09-12T01:11:24.828604+0000","last_undegraded":"2024-09-12T01:11:24.828604+0000","last_fullsized":"2024-09-12T01:11:24.828604+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:22.828086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":955,"num_read_kb":21858,"num_write":1152,"num_write_kb":27958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'147","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516270+0000","last_change":"2024-09-12T00:30:13.127131+0000","last_active":"2024-09-12T01:08:27.516270+0000","last_peered":"2024-09-12T01:08:27.516270+0000","last_clean":"2024-09-12T01:08:27.516270+0000","last_became_active":"2024-09-12T00:30:13.125887+0000","last_became_peered":"2024-09-12T00:30:13.125887+0000","last_unstale":"2024-09-12T01:08:27.516270+0000","last_undegraded":"2024-09-12T01:08:27.516270+0000","last_fullsized":"2024-09-12T01:08:27.516270+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:40.857952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":559,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'335","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.801302+0000","last_change":"2024-09-12T00:30:46.396636+0000","last_active":"2024-09-12T01:11:24.801302+0000","last_peered":"2024-09-12T01:11:24.801302+0000","last_clean":"2024-09-12T01:11:24.801302+0000","last_became_active":"2024-09-12T00:30:46.396288+0000","last_became_peered":"2024-09-12T00:30:46.396288+0000","last_unstale":"2024-09-12T01:11:24.801302+0000","last_undegraded":"2024-09-12T01:11:24.801302+0000","last_fullsized":"2024-09-12T01:11:24.801302+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:48.101790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8687076,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":21015,"num_write":1060,"num_write_kb":30668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'249","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.546201+0000","last_change":"2024-09-12T00:30:13.127777+0000","last_active":"2024-09-12T01:09:43.546201+0000","last_peered":"2024-09-12T01:09:43.546201+0000","last_clean":"2024-09-12T01:09:43.546201+0000","last_became_active":"2024-09-12T00:30:13.127513+0000","last_became_peered":"2024-09-12T00:30:13.127513+0000","last_unstale":"2024-09-12T01:09:43.546201+0000","last_undegraded":"2024-09-12T01:09:43.546201+0000","last_fullsized":"2024-09-12T01:09:43.546201+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:22.047664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":791,"num_write":358,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'328","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.688230+0000","last_change":"2024-09-12T00:30:11.110035+0000","last_active":"2024-09-12T01:11:24.688230+0000","last_peered":"2024-09-12T01:11:24.688230+0000","last_clean":"2024-09-12T01:11:24.688230+0000","last_became_active":"2024-09-12T00:30:11.109661+0000","last_became_peered":"2024-09-12T00:30:11.109661+0000","last_unstale":"2024-09-12T01:11:24.688230+0000","last_undegraded":"2024-09-12T01:11:24.688230+0000","last_fullsized":"2024-09-12T01:11:24.688230+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:51.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":8210,"num_write":1080,"num_write_kb":36173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'315","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.853615+0000","last_change":"2024-09-12T00:30:11.113547+0000","last_active":"2024-09-12T01:11:24.853615+0000","last_peered":"2024-09-12T01:11:24.853615+0000","last_clean":"2024-09-12T01:11:24.853615+0000","last_became_active":"2024-09-12T00:30:11.113173+0000","last_became_peered":"2024-09-12T00:30:11.113173+0000","last_unstale":"2024-09-12T01:11:24.853615+0000","last_undegraded":"2024-09-12T01:11:24.853615+0000","last_fullsized":"2024-09-12T01:11:24.853615+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:20.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":50214,"num_write":1057,"num_write_kb":47204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'24","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.520781+0000","last_change":"2024-09-12T00:30:13.126552+0000","last_active":"2024-09-12T01:08:57.520781+0000","last_peered":"2024-09-12T01:08:57.520781+0000","last_clean":"2024-09-12T01:08:57.520781+0000","last_became_active":"2024-09-12T00:30:13.126264+0000","last_became_peered":"2024-09-12T00:30:13.126264+0000","last_unstale":"2024-09-12T01:08:57.520781+0000","last_undegraded":"2024-09-12T01:08:57.520781+0000","last_fullsized":"2024-09-12T01:08:57.520781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:09.574554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":113,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'377","reported_seq":1093,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.826160+0000","last_change":"2024-09-12T00:30:11.102417+0000","last_active":"2024-09-12T01:11:24.826160+0000","last_peered":"2024-09-12T01:11:24.826160+0000","last_clean":"2024-09-12T01:11:24.826160+0000","last_became_active":"2024-09-12T00:30:11.102026+0000","last_became_peered":"2024-09-12T00:30:11.102026+0000","last_unstale":"2024-09-12T01:11:24.826160+0000","last_undegraded":"2024-09-12T01:11:24.826160+0000","last_fullsized":"2024-09-12T01:11:24.826160+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:54.893481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4360630,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":672,"num_read_kb":9482,"num_write":1213,"num_write_kb":28977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'250","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.409374+0000","last_change":"2024-09-12T00:30:13.120189+0000","last_active":"2024-09-12T01:08:53.409374+0000","last_peered":"2024-09-12T01:08:53.409374+0000","last_clean":"2024-09-12T01:08:53.409374+0000","last_became_active":"2024-09-12T00:30:13.119872+0000","last_became_peered":"2024-09-12T00:30:13.119872+0000","last_unstale":"2024-09-12T01:08:53.409374+0000","last_undegraded":"2024-09-12T01:08:53.409374+0000","last_fullsized":"2024-09-12T01:08:53.409374+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:30.740866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":987,"num_write":428,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5946,"num_read_kb":4236,"num_write":1962,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1033,"ondisk_log_size":1033,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15005,"num_read_kb":14670,"num_write":16786,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1559,"ondisk_log_size":1559,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548725,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17648,"num_read_kb":36949,"num_write":14701,"num_write_kb":11551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2026,"ondisk_log_size":2026,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102018,"num_read_kb":85254,"num_write":36979,"num_write_kb":18604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4230,"ondisk_log_size":4230,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":166688013,"num_objects":400,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":400,"num_whiteouts":0,"num_read":36140,"num_read_kb":1917452,"num_write":72064,"num_write_kb":2191736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":224706560,"data_stored":224706560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3667,"ondisk_log_size":3667,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170064,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168795,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509947,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264892,"kb_used_data":35040,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94106948,"statfs":{"total":96636764160,"available":96365514752,"internally_reserved":0,"allocated":35880960,"data_stored":33872164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509944,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337676,"kb_used_data":31528,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94034164,"statfs":{"total":96636764160,"available":96290983936,"internally_reserved":0,"allocated":32284672,"data_stored":30297333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509944,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156232,"kb_used_data":34728,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94215608,"statfs":{"total":96636764160,"available":96476782592,"internally_reserved":0,"allocated":35561472,"data_stored":33552270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542649,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252416,"kb_used_data":32448,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94119424,"statfs":{"total":96636764160,"available":96378290176,"internally_reserved":0,"allocated":33226752,"data_stored":31260225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542648,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151872,"kb_used_data":21868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94219968,"statfs":{"total":96636764160,"available":96481247232,"internally_reserved":0,"allocated":22392832,"data_stored":20398857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542646,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289820,"kb_used_data":33604,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94082020,"statfs":{"total":96636764160,"available":96339988480,"internally_reserved":0,"allocated":34410496,"data_stored":32405240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262207941},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542649,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251232,"kb_used_data":31180,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94120608,"statfs":{"total":96636764160,"available":96379502592,"internally_reserved":0,"allocated":31928320,"data_stored":29931227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225180101},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575353,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172604,"kb_used_data":33132,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94199236,"statfs":{"total":96636764160,"available":96460017664,"internally_reserved":0,"allocated":33927168,"data_stored":31936990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31330304,"data_stored":31330304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27488256,"data_stored":27488256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29716480,"data_stored":29716480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31649792,"data_stored":31649792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":27709440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29593600,"data_stored":29593600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18178048,"data_stored":18178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29040640,"data_stored":29040640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:32.781 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.781 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.781 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.781 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.781 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.781 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.782 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.782 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.782 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.782 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.782 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.782 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.782 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.782 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.782 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.783 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.783 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.783 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.783 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.783 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.783 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.783 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.783 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.783 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.784 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.785 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.785 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.785 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.785 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.785 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.785 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.785 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.785 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.785 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.786 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.786 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.786 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.786 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.786 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.786 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.786 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.786 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.786 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.787 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.787 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.787 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.787 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.787 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.787 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.787 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.787 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.787 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.788 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.789 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.789 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.789 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.789 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.789 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.789 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.789 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.789 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.789 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.790 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.790 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.790 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.790 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.790 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.790 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.790 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.790 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.790 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.791 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.792 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.793 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.793 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.793 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.793 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.793 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.793 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.793 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.793 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.793 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.794 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.795 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.796 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.796 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.796 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.796 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.796 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.796 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.796 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.796 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.796 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.797 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.797 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.797 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.797 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.797 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.797 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.797 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.797 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.797 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.798 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.799 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.799 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.799 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.799 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.799 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.799 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.799 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.799 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.799 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.800 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.801 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.801 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.801 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.801 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.801 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.801 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.801 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.801 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.802 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.802 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.802 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.802 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.802 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.802 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.802 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.802 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.802 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.803 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.804 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.804 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.804 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.804 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.804 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.804 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.804 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.804 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.805 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.805 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.805 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.805 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.805 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.805 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.805 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.805 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.805 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:29:53.438265+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.806 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:29:58.509720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=29, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.806 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.806 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.806 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.806 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.806 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.806 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.806 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:29:58.509720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=29, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.806 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:29:58.509720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=29, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.807 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.808 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.808 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.808 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:29:58.509720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=29, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.808 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.808 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.808 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.808 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.808 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.809 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.809 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:29:58.509720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=29, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.809 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.809 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.809 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.809 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.809 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.809 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.809 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:29:58.509720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=29, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.810 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.810 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.810 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.810 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.810 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.810 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.810 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:29:58.509720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=29, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.810 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.810 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.811 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.811 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.811 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.811 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.811 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:29:58.509720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=29, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.811 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.811 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.811 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.811 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.812 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.812 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.812 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.812 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.812 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.812 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.812 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.812 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.812 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.813 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.813 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.813 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.813 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.813 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.813 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.813 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.813 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.814 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.815 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.815 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.815 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.815 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.815 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.815 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.815 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.815 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.815 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.816 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.816 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.816 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.816 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.816 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.816 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.816 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.816 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.816 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.817 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.817 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.817 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.817 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.817 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.817 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.817 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.817 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.817 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.818 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.818 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.818 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.818 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.818 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.818 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.818 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.818 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.818 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.819 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.819 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.819 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.819 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.819 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.819 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.819 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.819 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.819 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.820 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.820 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.820 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.820 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.820 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.820 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.820 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.820 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.820 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.821 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.821 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.821 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.821 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.821 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.821 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.821 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.821 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.821 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.822 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.822 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.822 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.822 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.822 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.822 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.822 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.822 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.822 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.823 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.823 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.823 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.823 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.823 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.823 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.823 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.823 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.823 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:32.824 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:11:52.825 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:53.158 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:11:53.169 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T01:11:53.171 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":1517,"stamp":"2024-09-12T01:11:52.243530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":168845237,"num_objects":756,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":179589,"num_read_kb":2400386,"num_write":143007,"num_write_kb":2482898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":563687,"num_omap_keys":1360,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13504,"ondisk_log_size":13504,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1875736,"kb_used_data":253528,"kb_used_omap":12,"kb_used_meta":1622067,"kb_avail":753098984,"statfs":{"total":773094113280,"available":771173359616,"internally_reserved":0,"allocated":259612672,"data_stored":243654306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1660997170},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":555387,"num_omap_keys":1327,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005651"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509864+0000","last_change":"2024-09-12T00:56:52.991247+0000","last_active":"2024-09-12T01:06:53.509864+0000","last_peered":"2024-09-12T01:06:53.509864+0000","last_clean":"2024-09-12T01:06:53.509864+0000","last_became_active":"2024-09-12T00:56:52.990975+0000","last_became_peered":"2024-09-12T00:56:52.990975+0000","last_unstale":"2024-09-12T01:06:53.509864+0000","last_undegraded":"2024-09-12T01:06:53.509864+0000","last_fullsized":"2024-09-12T01:06:53.509864+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:25.467438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.408743+0000","last_change":"2024-09-12T00:46:19.285045+0000","last_active":"2024-09-12T01:08:48.408743+0000","last_peered":"2024-09-12T01:08:48.408743+0000","last_clean":"2024-09-12T01:08:48.408743+0000","last_became_active":"2024-09-12T00:46:19.284774+0000","last_became_peered":"2024-09-12T00:46:19.284774+0000","last_unstale":"2024-09-12T01:08:48.408743+0000","last_undegraded":"2024-09-12T01:08:48.408743+0000","last_fullsized":"2024-09-12T01:08:48.408743+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:05.942678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.410391+0000","last_change":"2024-09-12T00:46:16.275794+0000","last_active":"2024-09-12T01:11:18.410391+0000","last_peered":"2024-09-12T01:11:18.410391+0000","last_clean":"2024-09-12T01:11:18.410391+0000","last_became_active":"2024-09-12T00:46:16.275529+0000","last_became_peered":"2024-09-12T00:46:16.275529+0000","last_unstale":"2024-09-12T01:11:18.410391+0000","last_undegraded":"2024-09-12T01:11:18.410391+0000","last_fullsized":"2024-09-12T01:11:18.410391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:10.602032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'24","reported_seq":105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:37.526703+0000","last_change":"2024-09-12T00:44:37.816651+0000","last_active":"2024-09-12T01:09:37.526703+0000","last_peered":"2024-09-12T01:09:37.526703+0000","last_clean":"2024-09-12T01:09:37.526703+0000","last_became_active":"2024-09-12T00:44:37.816192+0000","last_became_peered":"2024-09-12T00:44:37.816192+0000","last_unstale":"2024-09-12T01:09:37.526703+0000","last_undegraded":"2024-09-12T01:09:37.526703+0000","last_fullsized":"2024-09-12T01:09:37.526703+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:52.373304+0000","last_change":"2024-09-12T00:56:52.996167+0000","last_active":"2024-09-12T01:06:52.373304+0000","last_peered":"2024-09-12T01:06:52.373304+0000","last_clean":"2024-09-12T01:06:52.373304+0000","last_became_active":"2024-09-12T00:56:52.995871+0000","last_became_peered":"2024-09-12T00:56:52.995871+0000","last_unstale":"2024-09-12T01:06:52.373304+0000","last_undegraded":"2024-09-12T01:06:52.373304+0000","last_fullsized":"2024-09-12T01:06:52.373304+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:23.434095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:51.498180+0000","last_change":"2024-09-12T00:46:19.285212+0000","last_active":"2024-09-12T01:08:51.498180+0000","last_peered":"2024-09-12T01:08:51.498180+0000","last_clean":"2024-09-12T01:08:51.498180+0000","last_became_active":"2024-09-12T00:46:19.284875+0000","last_became_peered":"2024-09-12T00:46:19.284875+0000","last_unstale":"2024-09-12T01:08:51.498180+0000","last_undegraded":"2024-09-12T01:08:51.498180+0000","last_fullsized":"2024-09-12T01:08:51.498180+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:33.439048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.478299+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:08:47.478299+0000","last_peered":"2024-09-12T01:08:47.478299+0000","last_clean":"2024-09-12T01:08:47.478299+0000","last_became_active":"2024-09-12T00:46:16.275381+0000","last_became_peered":"2024-09-12T00:46:16.275381+0000","last_unstale":"2024-09-12T01:08:47.478299+0000","last_undegraded":"2024-09-12T01:08:47.478299+0000","last_fullsized":"2024-09-12T01:08:47.478299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.675654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'45","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.444239+0000","last_change":"2024-09-12T00:44:37.819913+0000","last_active":"2024-09-12T01:08:56.444239+0000","last_peered":"2024-09-12T01:08:56.444239+0000","last_clean":"2024-09-12T01:08:56.444239+0000","last_became_active":"2024-09-12T00:44:37.819561+0000","last_became_peered":"2024-09-12T00:44:37.819561+0000","last_unstale":"2024-09-12T01:08:56.444239+0000","last_undegraded":"2024-09-12T01:08:56.444239+0000","last_fullsized":"2024-09-12T01:08:56.444239+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:18.208589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":164,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409863+0000","last_change":"2024-09-12T00:56:52.990647+0000","last_active":"2024-09-12T01:08:58.409863+0000","last_peered":"2024-09-12T01:08:58.409863+0000","last_clean":"2024-09-12T01:08:58.409863+0000","last_became_active":"2024-09-12T00:56:52.990364+0000","last_became_peered":"2024-09-12T00:56:52.990364+0000","last_unstale":"2024-09-12T01:08:58.409863+0000","last_undegraded":"2024-09-12T01:08:58.409863+0000","last_fullsized":"2024-09-12T01:08:58.409863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:34.228970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557370+0000","last_change":"2024-09-12T00:46:19.285614+0000","last_active":"2024-09-12T01:11:22.557370+0000","last_peered":"2024-09-12T01:11:22.557370+0000","last_clean":"2024-09-12T01:11:22.557370+0000","last_became_active":"2024-09-12T00:46:19.285357+0000","last_became_peered":"2024-09-12T00:46:19.285357+0000","last_unstale":"2024-09-12T01:11:22.557370+0000","last_undegraded":"2024-09-12T01:11:22.557370+0000","last_fullsized":"2024-09-12T01:11:22.557370+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:02.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.384512+0000","last_change":"2024-09-12T00:46:16.278495+0000","last_active":"2024-09-12T01:08:18.384512+0000","last_peered":"2024-09-12T01:08:18.384512+0000","last_clean":"2024-09-12T01:08:18.384512+0000","last_became_active":"2024-09-12T00:46:16.278221+0000","last_became_peered":"2024-09-12T00:46:16.278221+0000","last_unstale":"2024-09-12T01:08:18.384512+0000","last_undegraded":"2024-09-12T01:08:18.384512+0000","last_fullsized":"2024-09-12T01:08:18.384512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:42.560119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5130,"num_write":12,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'37","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375379+0000","last_change":"2024-09-12T00:44:37.818554+0000","last_active":"2024-09-12T01:07:07.375379+0000","last_peered":"2024-09-12T01:07:07.375379+0000","last_clean":"2024-09-12T01:07:07.375379+0000","last_became_active":"2024-09-12T00:44:37.818239+0000","last_became_peered":"2024-09-12T00:44:37.818239+0000","last_unstale":"2024-09-12T01:07:07.375379+0000","last_undegraded":"2024-09-12T01:07:07.375379+0000","last_fullsized":"2024-09-12T01:07:07.375379+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:53.443510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":144,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.480542+0000","last_change":"2024-09-12T00:56:52.995412+0000","last_active":"2024-09-12T01:09:02.480542+0000","last_peered":"2024-09-12T01:09:02.480542+0000","last_clean":"2024-09-12T01:09:02.480542+0000","last_became_active":"2024-09-12T00:56:52.995062+0000","last_became_peered":"2024-09-12T00:56:52.995062+0000","last_unstale":"2024-09-12T01:09:02.480542+0000","last_undegraded":"2024-09-12T01:09:02.480542+0000","last_fullsized":"2024-09-12T01:09:02.480542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.136639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475349+0000","last_change":"2024-09-12T00:46:19.285095+0000","last_active":"2024-09-12T01:08:27.475349+0000","last_peered":"2024-09-12T01:08:27.475349+0000","last_clean":"2024-09-12T01:08:27.475349+0000","last_became_active":"2024-09-12T00:46:19.284822+0000","last_became_peered":"2024-09-12T00:46:19.284822+0000","last_unstale":"2024-09-12T01:08:27.475349+0000","last_undegraded":"2024-09-12T01:08:27.475349+0000","last_fullsized":"2024-09-12T01:08:27.475349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:42.407553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.411818+0000","last_change":"2024-09-12T00:46:16.261917+0000","last_active":"2024-09-12T01:09:13.411818+0000","last_peered":"2024-09-12T01:09:13.411818+0000","last_clean":"2024-09-12T01:09:13.411818+0000","last_became_active":"2024-09-12T00:46:16.261617+0000","last_became_peered":"2024-09-12T00:46:16.261617+0000","last_unstale":"2024-09-12T01:09:13.411818+0000","last_undegraded":"2024-09-12T01:09:13.411818+0000","last_fullsized":"2024-09-12T01:09:13.411818+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:45.217925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.392519+0000","last_change":"2024-09-12T00:44:37.815822+0000","last_active":"2024-09-12T01:08:00.392519+0000","last_peered":"2024-09-12T01:08:00.392519+0000","last_clean":"2024-09-12T01:08:00.392519+0000","last_became_active":"2024-09-12T00:44:37.815325+0000","last_became_peered":"2024-09-12T00:44:37.815325+0000","last_unstale":"2024-09-12T01:08:00.392519+0000","last_undegraded":"2024-09-12T01:08:00.392519+0000","last_fullsized":"2024-09-12T01:08:00.392519+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:41.073259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":218,"num_write":105,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389388+0000","last_change":"2024-09-12T00:56:52.991644+0000","last_active":"2024-09-12T01:08:53.389388+0000","last_peered":"2024-09-12T01:08:53.389388+0000","last_clean":"2024-09-12T01:08:53.389388+0000","last_became_active":"2024-09-12T00:56:52.991358+0000","last_became_peered":"2024-09-12T00:56:52.991358+0000","last_unstale":"2024-09-12T01:08:53.389388+0000","last_undegraded":"2024-09-12T01:08:53.389388+0000","last_fullsized":"2024-09-12T01:08:53.389388+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:23.445118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520059+0000","last_change":"2024-09-12T00:46:19.274308+0000","last_active":"2024-09-12T01:08:08.520059+0000","last_peered":"2024-09-12T01:08:08.520059+0000","last_clean":"2024-09-12T01:08:08.520059+0000","last_became_active":"2024-09-12T00:46:19.274024+0000","last_became_peered":"2024-09-12T00:46:19.274024+0000","last_unstale":"2024-09-12T01:08:08.520059+0000","last_undegraded":"2024-09-12T01:08:08.520059+0000","last_fullsized":"2024-09-12T01:08:08.520059+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.097376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.471438+0000","last_change":"2024-09-12T00:46:16.272503+0000","last_active":"2024-09-12T01:08:02.471438+0000","last_peered":"2024-09-12T01:08:02.471438+0000","last_clean":"2024-09-12T01:08:02.471438+0000","last_became_active":"2024-09-12T00:46:16.272230+0000","last_became_peered":"2024-09-12T00:46:16.272230+0000","last_unstale":"2024-09-12T01:08:02.471438+0000","last_undegraded":"2024-09-12T01:08:02.471438+0000","last_fullsized":"2024-09-12T01:08:02.471438+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:22.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'26","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:07.375307+0000","last_change":"2024-09-12T00:44:37.821557+0000","last_active":"2024-09-12T01:07:07.375307+0000","last_peered":"2024-09-12T01:07:07.375307+0000","last_clean":"2024-09-12T01:07:07.375307+0000","last_became_active":"2024-09-12T00:44:37.821297+0000","last_became_peered":"2024-09-12T00:44:37.821297+0000","last_unstale":"2024-09-12T01:07:07.375307+0000","last_undegraded":"2024-09-12T01:07:07.375307+0000","last_fullsized":"2024-09-12T01:07:07.375307+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.631261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.524444+0000","last_change":"2024-09-12T00:56:52.990792+0000","last_active":"2024-09-12T01:09:22.524444+0000","last_peered":"2024-09-12T01:09:22.524444+0000","last_clean":"2024-09-12T01:09:22.524444+0000","last_became_active":"2024-09-12T00:56:52.990528+0000","last_became_peered":"2024-09-12T00:56:52.990528+0000","last_unstale":"2024-09-12T01:09:22.524444+0000","last_undegraded":"2024-09-12T01:09:22.524444+0000","last_fullsized":"2024-09-12T01:09:22.524444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:30.175859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.597263+0000","last_change":"2024-09-12T00:46:19.281162+0000","last_active":"2024-09-12T01:11:23.597263+0000","last_peered":"2024-09-12T01:11:23.597263+0000","last_clean":"2024-09-12T01:11:23.597263+0000","last_became_active":"2024-09-12T00:46:19.280794+0000","last_became_peered":"2024-09-12T00:46:19.280794+0000","last_unstale":"2024-09-12T01:11:23.597263+0000","last_undegraded":"2024-09-12T01:11:23.597263+0000","last_fullsized":"2024-09-12T01:11:23.597263+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:50.182755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12296,"num_write":8,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.736721+0000","last_change":"2024-09-12T00:46:16.267841+0000","last_active":"2024-09-12T01:11:23.736721+0000","last_peered":"2024-09-12T01:11:23.736721+0000","last_clean":"2024-09-12T01:11:23.736721+0000","last_became_active":"2024-09-12T00:46:16.267528+0000","last_became_peered":"2024-09-12T00:46:16.267528+0000","last_unstale":"2024-09-12T01:11:23.736721+0000","last_undegraded":"2024-09-12T01:11:23.736721+0000","last_fullsized":"2024-09-12T01:11:23.736721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8204,"num_write":6,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'128","reported_seq":430,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:11.484992+0000","last_change":"2024-09-12T00:44:37.819828+0000","last_active":"2024-09-12T01:07:11.484992+0000","last_peered":"2024-09-12T01:07:11.484992+0000","last_clean":"2024-09-12T01:07:11.484992+0000","last_became_active":"2024-09-12T00:44:37.819556+0000","last_became_peered":"2024-09-12T00:44:37.819556+0000","last_unstale":"2024-09-12T01:07:11.484992+0000","last_undegraded":"2024-09-12T01:07:11.484992+0000","last_fullsized":"2024-09-12T01:07:11.484992+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:37.132092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":767,"num_read_kb":571,"num_write":157,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.482640+0000","last_change":"2024-09-12T00:56:52.992341+0000","last_active":"2024-09-12T01:06:56.482640+0000","last_peered":"2024-09-12T01:06:56.482640+0000","last_clean":"2024-09-12T01:06:56.482640+0000","last_became_active":"2024-09-12T00:56:52.992081+0000","last_became_peered":"2024-09-12T00:56:52.992081+0000","last_unstale":"2024-09-12T01:06:56.482640+0000","last_undegraded":"2024-09-12T01:06:56.482640+0000","last_fullsized":"2024-09-12T01:06:56.482640+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:38.856681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'7","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.517722+0000","last_change":"2024-09-12T00:46:19.280066+0000","last_active":"2024-09-12T01:11:21.517722+0000","last_peered":"2024-09-12T01:11:21.517722+0000","last_clean":"2024-09-12T01:11:21.517722+0000","last_became_active":"2024-09-12T00:46:19.279811+0000","last_became_peered":"2024-09-12T00:46:19.279811+0000","last_unstale":"2024-09-12T01:11:21.517722+0000","last_undegraded":"2024-09-12T01:11:21.517722+0000","last_fullsized":"2024-09-12T01:11:21.517722+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.923506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13308,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'5","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.542962+0000","last_change":"2024-09-12T00:46:16.274833+0000","last_active":"2024-09-12T01:11:18.542962+0000","last_peered":"2024-09-12T01:11:18.542962+0000","last_clean":"2024-09-12T01:11:18.542962+0000","last_became_active":"2024-09-12T00:46:16.274541+0000","last_became_peered":"2024-09-12T00:46:16.274541+0000","last_unstale":"2024-09-12T01:11:18.542962+0000","last_undegraded":"2024-09-12T01:11:18.542962+0000","last_fullsized":"2024-09-12T01:11:18.542962+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:58.251023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'13","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388468+0000","last_change":"2024-09-12T00:44:37.817411+0000","last_active":"2024-09-12T01:08:48.388468+0000","last_peered":"2024-09-12T01:08:48.388468+0000","last_clean":"2024-09-12T01:08:48.388468+0000","last_became_active":"2024-09-12T00:44:37.817108+0000","last_became_peered":"2024-09-12T00:44:37.817108+0000","last_unstale":"2024-09-12T01:08:48.388468+0000","last_undegraded":"2024-09-12T01:08:48.388468+0000","last_fullsized":"2024-09-12T01:08:48.388468+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:45.282350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:06:53.509925+0000","last_change":"2024-09-12T00:56:52.989648+0000","last_active":"2024-09-12T01:06:53.509925+0000","last_peered":"2024-09-12T01:06:53.509925+0000","last_clean":"2024-09-12T01:06:53.509925+0000","last_became_active":"2024-09-12T00:56:52.989394+0000","last_became_peered":"2024-09-12T00:56:52.989394+0000","last_unstale":"2024-09-12T01:06:53.509925+0000","last_undegraded":"2024-09-12T01:06:53.509925+0000","last_fullsized":"2024-09-12T01:06:53.509925+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:17.324226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"264'7","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.458831+0000","last_change":"2024-09-12T00:46:19.282381+0000","last_active":"2024-09-12T01:11:23.458831+0000","last_peered":"2024-09-12T01:11:23.458831+0000","last_clean":"2024-09-12T01:11:23.458831+0000","last_became_active":"2024-09-12T00:46:19.280878+0000","last_became_peered":"2024-09-12T00:46:19.280878+0000","last_unstale":"2024-09-12T01:11:23.458831+0000","last_undegraded":"2024-09-12T01:11:23.458831+0000","last_fullsized":"2024-09-12T01:11:23.458831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:37.733061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.411092+0000","last_change":"2024-09-12T00:46:16.278285+0000","last_active":"2024-09-12T01:11:17.411092+0000","last_peered":"2024-09-12T01:11:17.411092+0000","last_clean":"2024-09-12T01:11:17.411092+0000","last_became_active":"2024-09-12T00:46:16.277776+0000","last_became_peered":"2024-09-12T00:46:16.277776+0000","last_unstale":"2024-09-12T01:11:17.411092+0000","last_undegraded":"2024-09-12T01:11:17.411092+0000","last_fullsized":"2024-09-12T01:11:17.411092+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:47.993297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'18","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.389367+0000","last_change":"2024-09-12T00:44:37.816393+0000","last_active":"2024-09-12T01:08:47.389367+0000","last_peered":"2024-09-12T01:08:47.389367+0000","last_clean":"2024-09-12T01:08:47.389367+0000","last_became_active":"2024-09-12T00:44:37.815820+0000","last_became_peered":"2024-09-12T00:44:37.815820+0000","last_unstale":"2024-09-12T01:08:47.389367+0000","last_undegraded":"2024-09-12T01:08:47.389367+0000","last_fullsized":"2024-09-12T01:08:47.389367+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:49.470552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.475979+0000","last_change":"2024-09-12T00:56:52.996102+0000","last_active":"2024-09-12T01:08:32.475979+0000","last_peered":"2024-09-12T01:08:32.475979+0000","last_clean":"2024-09-12T01:08:32.475979+0000","last_became_active":"2024-09-12T00:56:52.995696+0000","last_became_peered":"2024-09-12T00:56:52.995696+0000","last_unstale":"2024-09-12T01:08:32.475979+0000","last_undegraded":"2024-09-12T01:08:32.475979+0000","last_fullsized":"2024-09-12T01:08:32.475979+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:57.634150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.403783+0000","last_change":"2024-09-12T00:46:19.282715+0000","last_active":"2024-09-12T01:10:33.403783+0000","last_peered":"2024-09-12T01:10:33.403783+0000","last_clean":"2024-09-12T01:10:33.403783+0000","last_became_active":"2024-09-12T00:46:19.282466+0000","last_became_peered":"2024-09-12T00:46:19.282466+0000","last_unstale":"2024-09-12T01:10:33.403783+0000","last_undegraded":"2024-09-12T01:10:33.403783+0000","last_fullsized":"2024-09-12T01:10:33.403783+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.083481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.612173+0000","last_change":"2024-09-12T00:46:16.268948+0000","last_active":"2024-09-12T01:09:43.612173+0000","last_peered":"2024-09-12T01:09:43.612173+0000","last_clean":"2024-09-12T01:09:43.612173+0000","last_became_active":"2024-09-12T00:46:16.268479+0000","last_became_peered":"2024-09-12T00:46:16.268479+0000","last_unstale":"2024-09-12T01:09:43.612173+0000","last_undegraded":"2024-09-12T01:09:43.612173+0000","last_fullsized":"2024-09-12T01:09:43.612173+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:29.450733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519282+0000","last_change":"2024-09-12T00:44:37.811999+0000","last_active":"2024-09-12T01:08:47.519282+0000","last_peered":"2024-09-12T01:08:47.519282+0000","last_clean":"2024-09-12T01:08:47.519282+0000","last_became_active":"2024-09-12T00:44:37.811697+0000","last_became_peered":"2024-09-12T00:44:37.811697+0000","last_unstale":"2024-09-12T01:08:47.519282+0000","last_undegraded":"2024-09-12T01:08:47.519282+0000","last_fullsized":"2024-09-12T01:08:47.519282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:46.654992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":57,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.387544+0000","last_change":"2024-09-12T00:56:52.985166+0000","last_active":"2024-09-12T01:08:32.387544+0000","last_peered":"2024-09-12T01:08:32.387544+0000","last_clean":"2024-09-12T01:08:32.387544+0000","last_became_active":"2024-09-12T00:56:52.984878+0000","last_became_peered":"2024-09-12T00:56:52.984878+0000","last_unstale":"2024-09-12T01:08:32.387544+0000","last_undegraded":"2024-09-12T01:08:32.387544+0000","last_fullsized":"2024-09-12T01:08:32.387544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.409540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:27.466660+0000","last_change":"2024-09-12T00:46:19.276813+0000","last_active":"2024-09-12T01:07:27.466660+0000","last_peered":"2024-09-12T01:07:27.466660+0000","last_clean":"2024-09-12T01:07:27.466660+0000","last_became_active":"2024-09-12T00:46:19.276197+0000","last_became_peered":"2024-09-12T00:46:19.276197+0000","last_unstale":"2024-09-12T01:07:27.466660+0000","last_undegraded":"2024-09-12T01:07:27.466660+0000","last_fullsized":"2024-09-12T01:07:27.466660+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:53.182491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:28.536284+0000","last_change":"2024-09-12T00:46:16.264295+0000","last_active":"2024-09-12T01:10:28.536284+0000","last_peered":"2024-09-12T01:10:28.536284+0000","last_clean":"2024-09-12T01:10:28.536284+0000","last_became_active":"2024-09-12T00:46:16.263870+0000","last_became_peered":"2024-09-12T00:46:16.263870+0000","last_unstale":"2024-09-12T01:10:28.536284+0000","last_undegraded":"2024-09-12T01:10:28.536284+0000","last_fullsized":"2024-09-12T01:10:28.536284+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:24.692637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2048,"num_write":18,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'37","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519258+0000","last_change":"2024-09-12T00:44:37.820673+0000","last_active":"2024-09-12T01:08:47.519258+0000","last_peered":"2024-09-12T01:08:47.519258+0000","last_clean":"2024-09-12T01:08:47.519258+0000","last_became_active":"2024-09-12T00:44:37.820232+0000","last_became_peered":"2024-09-12T00:44:37.820232+0000","last_unstale":"2024-09-12T01:08:47.519258+0000","last_undegraded":"2024-09-12T01:08:47.519258+0000","last_fullsized":"2024-09-12T01:08:47.519258+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.688623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496180+0000","last_change":"2024-09-12T00:56:52.987731+0000","last_active":"2024-09-12T01:08:36.496180+0000","last_peered":"2024-09-12T01:08:36.496180+0000","last_clean":"2024-09-12T01:08:36.496180+0000","last_became_active":"2024-09-12T00:56:52.987492+0000","last_became_peered":"2024-09-12T00:56:52.987492+0000","last_unstale":"2024-09-12T01:08:36.496180+0000","last_undegraded":"2024-09-12T01:08:36.496180+0000","last_fullsized":"2024-09-12T01:08:36.496180+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.155360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'9","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383413+0000","last_change":"2024-09-12T00:46:19.287908+0000","last_active":"2024-09-12T01:08:08.383413+0000","last_peered":"2024-09-12T01:08:08.383413+0000","last_clean":"2024-09-12T01:08:08.383413+0000","last_became_active":"2024-09-12T00:46:19.286860+0000","last_became_peered":"2024-09-12T00:46:19.286860+0000","last_unstale":"2024-09-12T01:08:08.383413+0000","last_undegraded":"2024-09-12T01:08:08.383413+0000","last_fullsized":"2024-09-12T01:08:08.383413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:54.927557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13316,"num_write":14,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.735722+0000","last_change":"2024-09-12T00:46:16.279497+0000","last_active":"2024-09-12T01:11:23.735722+0000","last_peered":"2024-09-12T01:11:23.735722+0000","last_clean":"2024-09-12T01:11:23.735722+0000","last_became_active":"2024-09-12T00:46:16.279114+0000","last_became_peered":"2024-09-12T00:46:16.279114+0000","last_unstale":"2024-09-12T01:11:23.735722+0000","last_undegraded":"2024-09-12T01:11:23.735722+0000","last_fullsized":"2024-09-12T01:11:23.735722+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:42.826584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'25","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388537+0000","last_change":"2024-09-12T00:44:37.819571+0000","last_active":"2024-09-12T01:08:48.388537+0000","last_peered":"2024-09-12T01:08:48.388537+0000","last_clean":"2024-09-12T01:08:48.388537+0000","last_became_active":"2024-09-12T00:44:37.819153+0000","last_became_peered":"2024-09-12T00:44:37.819153+0000","last_unstale":"2024-09-12T01:08:48.388537+0000","last_undegraded":"2024-09-12T01:08:48.388537+0000","last_fullsized":"2024-09-12T01:08:48.388537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:27.117588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":89,"num_write":41,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.523138+0000","last_change":"2024-09-12T00:56:52.990539+0000","last_active":"2024-09-12T01:08:33.523138+0000","last_peered":"2024-09-12T01:08:33.523138+0000","last_clean":"2024-09-12T01:08:33.523138+0000","last_became_active":"2024-09-12T00:56:52.990265+0000","last_became_peered":"2024-09-12T00:56:52.990265+0000","last_unstale":"2024-09-12T01:08:33.523138+0000","last_undegraded":"2024-09-12T01:08:33.523138+0000","last_fullsized":"2024-09-12T01:08:33.523138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:41.315107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.519397+0000","last_change":"2024-09-12T00:46:19.277307+0000","last_active":"2024-09-12T01:08:03.519397+0000","last_peered":"2024-09-12T01:08:03.519397+0000","last_clean":"2024-09-12T01:08:03.519397+0000","last_became_active":"2024-09-12T00:46:19.277011+0000","last_became_peered":"2024-09-12T00:46:19.277011+0000","last_unstale":"2024-09-12T01:08:03.519397+0000","last_undegraded":"2024-09-12T01:08:03.519397+0000","last_fullsized":"2024-09-12T01:08:03.519397+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:43.590749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694341+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:11:22.694341+0000","last_peered":"2024-09-12T01:11:22.694341+0000","last_clean":"2024-09-12T01:11:22.694341+0000","last_became_active":"2024-09-12T00:46:16.275403+0000","last_became_peered":"2024-09-12T00:46:16.275403+0000","last_unstale":"2024-09-12T01:11:22.694341+0000","last_undegraded":"2024-09-12T01:11:22.694341+0000","last_fullsized":"2024-09-12T01:11:22.694341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.331770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"264'68","reported_seq":266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.598342+0000","last_change":"2024-09-12T00:44:37.821656+0000","last_active":"2024-09-12T01:08:03.598342+0000","last_peered":"2024-09-12T01:08:03.598342+0000","last_clean":"2024-09-12T01:08:03.598342+0000","last_became_active":"2024-09-12T00:44:37.821192+0000","last_became_peered":"2024-09-12T00:44:37.821192+0000","last_unstale":"2024-09-12T01:08:03.598342+0000","last_undegraded":"2024-09-12T01:08:03.598342+0000","last_fullsized":"2024-09-12T01:08:03.598342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:14.342220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":323,"num_write":87,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479794+0000","last_change":"2024-09-12T00:56:52.995841+0000","last_active":"2024-09-12T01:08:57.479794+0000","last_peered":"2024-09-12T01:08:57.479794+0000","last_clean":"2024-09-12T01:08:57.479794+0000","last_became_active":"2024-09-12T00:56:52.995495+0000","last_became_peered":"2024-09-12T00:56:52.995495+0000","last_unstale":"2024-09-12T01:08:57.479794+0000","last_undegraded":"2024-09-12T01:08:57.479794+0000","last_fullsized":"2024-09-12T01:08:57.479794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:07.859390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557616+0000","last_change":"2024-09-12T00:46:19.280925+0000","last_active":"2024-09-12T01:11:22.557616+0000","last_peered":"2024-09-12T01:11:22.557616+0000","last_clean":"2024-09-12T01:11:22.557616+0000","last_became_active":"2024-09-12T00:46:19.280653+0000","last_became_peered":"2024-09-12T00:46:19.280653+0000","last_unstale":"2024-09-12T01:11:22.557616+0000","last_undegraded":"2024-09-12T01:11:22.557616+0000","last_fullsized":"2024-09-12T01:11:22.557616+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:20.246986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10256,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"261'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396139+0000","last_change":"2024-09-12T00:46:16.270257+0000","last_active":"2024-09-12T01:07:18.396139+0000","last_peered":"2024-09-12T01:07:18.396139+0000","last_clean":"2024-09-12T01:07:18.396139+0000","last_became_active":"2024-09-12T00:46:16.270004+0000","last_became_peered":"2024-09-12T00:46:16.270004+0000","last_unstale":"2024-09-12T01:07:18.396139+0000","last_undegraded":"2024-09-12T01:07:18.396139+0000","last_fullsized":"2024-09-12T01:07:18.396139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:08.342727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'15","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.597733+0000","last_change":"2024-09-12T00:44:37.820954+0000","last_active":"2024-09-12T01:07:58.597733+0000","last_peered":"2024-09-12T01:07:58.597733+0000","last_clean":"2024-09-12T01:07:58.597733+0000","last_became_active":"2024-09-12T00:44:37.820639+0000","last_became_peered":"2024-09-12T00:44:37.820639+0000","last_unstale":"2024-09-12T01:07:58.597733+0000","last_undegraded":"2024-09-12T01:07:58.597733+0000","last_fullsized":"2024-09-12T01:07:58.597733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:51.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391071+0000","last_change":"2024-09-12T00:56:52.991542+0000","last_active":"2024-09-12T01:08:57.391071+0000","last_peered":"2024-09-12T01:08:57.391071+0000","last_clean":"2024-09-12T01:08:57.391071+0000","last_became_active":"2024-09-12T00:56:52.991261+0000","last_became_peered":"2024-09-12T00:56:52.991261+0000","last_unstale":"2024-09-12T01:08:57.391071+0000","last_undegraded":"2024-09-12T01:08:57.391071+0000","last_fullsized":"2024-09-12T01:08:57.391071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:08.574079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:42.486590+0000","last_change":"2024-09-12T00:46:19.282895+0000","last_active":"2024-09-12T01:09:42.486590+0000","last_peered":"2024-09-12T01:09:42.486590+0000","last_clean":"2024-09-12T01:09:42.486590+0000","last_became_active":"2024-09-12T00:46:19.281676+0000","last_became_peered":"2024-09-12T00:46:19.281676+0000","last_unstale":"2024-09-12T01:09:42.486590+0000","last_undegraded":"2024-09-12T01:09:42.486590+0000","last_fullsized":"2024-09-12T01:09:42.486590+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.550417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:17.465156+0000","last_change":"2024-09-12T00:46:16.276429+0000","last_active":"2024-09-12T01:07:17.465156+0000","last_peered":"2024-09-12T01:07:17.465156+0000","last_clean":"2024-09-12T01:07:17.465156+0000","last_became_active":"2024-09-12T00:46:16.276180+0000","last_became_peered":"2024-09-12T00:46:16.276180+0000","last_unstale":"2024-09-12T01:07:17.465156+0000","last_undegraded":"2024-09-12T01:07:17.465156+0000","last_fullsized":"2024-09-12T01:07:17.465156+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:48.188004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382200+0000","last_change":"2024-09-12T00:44:37.820502+0000","last_active":"2024-09-12T01:07:58.382200+0000","last_peered":"2024-09-12T01:07:58.382200+0000","last_clean":"2024-09-12T01:07:58.382200+0000","last_became_active":"2024-09-12T00:44:37.820217+0000","last_became_peered":"2024-09-12T00:44:37.820217+0000","last_unstale":"2024-09-12T01:07:58.382200+0000","last_undegraded":"2024-09-12T01:07:58.382200+0000","last_fullsized":"2024-09-12T01:07:58.382200+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.838632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":127,"num_write":61,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.517081+0000","last_change":"2024-09-12T00:56:52.989385+0000","last_active":"2024-09-12T01:08:32.517081+0000","last_peered":"2024-09-12T01:08:32.517081+0000","last_clean":"2024-09-12T01:08:32.517081+0000","last_became_active":"2024-09-12T00:56:52.988302+0000","last_became_peered":"2024-09-12T00:56:52.988302+0000","last_unstale":"2024-09-12T01:08:32.517081+0000","last_undegraded":"2024-09-12T01:08:32.517081+0000","last_fullsized":"2024-09-12T01:08:32.517081+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:40.813037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'7","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:23.377182+0000","last_change":"2024-09-12T00:46:19.285378+0000","last_active":"2024-09-12T01:07:23.377182+0000","last_peered":"2024-09-12T01:07:23.377182+0000","last_clean":"2024-09-12T01:07:23.377182+0000","last_became_active":"2024-09-12T00:46:19.280889+0000","last_became_peered":"2024-09-12T00:46:19.280889+0000","last_unstale":"2024-09-12T01:07:23.377182+0000","last_undegraded":"2024-09-12T01:07:23.377182+0000","last_fullsized":"2024-09-12T01:07:23.377182+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:56.282208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7182,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.414382+0000","last_change":"2024-09-12T00:46:16.263413+0000","last_active":"2024-09-12T01:09:38.414382+0000","last_peered":"2024-09-12T01:09:38.414382+0000","last_clean":"2024-09-12T01:09:38.414382+0000","last_became_active":"2024-09-12T00:46:16.263065+0000","last_became_peered":"2024-09-12T00:46:16.263065+0000","last_unstale":"2024-09-12T01:09:38.414382+0000","last_undegraded":"2024-09-12T01:09:38.414382+0000","last_fullsized":"2024-09-12T01:09:38.414382+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:23.322080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:01.491664+0000","last_change":"2024-09-12T00:44:37.814881+0000","last_active":"2024-09-12T01:08:01.491664+0000","last_peered":"2024-09-12T01:08:01.491664+0000","last_clean":"2024-09-12T01:08:01.491664+0000","last_became_active":"2024-09-12T00:44:37.814584+0000","last_became_peered":"2024-09-12T00:44:37.814584+0000","last_unstale":"2024-09-12T01:08:01.491664+0000","last_undegraded":"2024-09-12T01:08:01.491664+0000","last_fullsized":"2024-09-12T01:08:01.491664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:18.206072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391027+0000","last_change":"2024-09-12T00:56:52.991853+0000","last_active":"2024-09-12T01:08:57.391027+0000","last_peered":"2024-09-12T01:08:57.391027+0000","last_clean":"2024-09-12T01:08:57.391027+0000","last_became_active":"2024-09-12T00:56:52.990830+0000","last_became_peered":"2024-09-12T00:56:52.990830+0000","last_unstale":"2024-09-12T01:08:57.391027+0000","last_undegraded":"2024-09-12T01:08:57.391027+0000","last_fullsized":"2024-09-12T01:08:57.391027+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:49.621390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'11","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.223259+0000","last_change":"2024-09-12T00:46:19.285059+0000","last_active":"2024-09-12T01:11:23.223259+0000","last_peered":"2024-09-12T01:11:23.223259+0000","last_clean":"2024-09-12T01:11:23.223259+0000","last_became_active":"2024-09-12T00:46:19.284748+0000","last_became_peered":"2024-09-12T00:46:19.284748+0000","last_unstale":"2024-09-12T01:11:23.223259+0000","last_undegraded":"2024-09-12T01:11:23.223259+0000","last_fullsized":"2024-09-12T01:11:23.223259+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:39.933756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"261'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:18.396223+0000","last_change":"2024-09-12T00:46:16.274496+0000","last_active":"2024-09-12T01:07:18.396223+0000","last_peered":"2024-09-12T01:07:18.396223+0000","last_clean":"2024-09-12T01:07:18.396223+0000","last_became_active":"2024-09-12T00:46:16.274209+0000","last_became_peered":"2024-09-12T00:46:16.274209+0000","last_unstale":"2024-09-12T01:07:18.396223+0000","last_undegraded":"2024-09-12T01:07:18.396223+0000","last_fullsized":"2024-09-12T01:07:18.396223+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:33.536444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":10,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.382153+0000","last_change":"2024-09-12T00:44:37.819591+0000","last_active":"2024-09-12T01:07:58.382153+0000","last_peered":"2024-09-12T01:07:58.382153+0000","last_clean":"2024-09-12T01:07:58.382153+0000","last_became_active":"2024-09-12T00:44:37.819298+0000","last_became_peered":"2024-09-12T00:44:37.819298+0000","last_unstale":"2024-09-12T01:07:58.382153+0000","last_undegraded":"2024-09-12T01:07:58.382153+0000","last_fullsized":"2024-09-12T01:07:58.382153+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:00.112592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.469348+0000","last_change":"2024-09-12T00:56:52.996314+0000","last_active":"2024-09-12T01:07:47.469348+0000","last_peered":"2024-09-12T01:07:47.469348+0000","last_clean":"2024-09-12T01:07:47.469348+0000","last_became_active":"2024-09-12T00:56:52.996048+0000","last_became_peered":"2024-09-12T00:56:52.996048+0000","last_unstale":"2024-09-12T01:07:47.469348+0000","last_undegraded":"2024-09-12T01:07:47.469348+0000","last_fullsized":"2024-09-12T01:07:47.469348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.954796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.222509+0000","last_change":"2024-09-12T00:46:19.286025+0000","last_active":"2024-09-12T01:11:23.222509+0000","last_peered":"2024-09-12T01:11:23.222509+0000","last_clean":"2024-09-12T01:11:23.222509+0000","last_became_active":"2024-09-12T00:46:19.285304+0000","last_became_peered":"2024-09-12T00:46:19.285304+0000","last_unstale":"2024-09-12T01:11:23.222509+0000","last_undegraded":"2024-09-12T01:11:23.222509+0000","last_fullsized":"2024-09-12T01:11:23.222509+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:59.248323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2428,"num_write":4,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:01.514702+0000","last_change":"2024-09-12T00:46:16.272142+0000","last_active":"2024-09-12T01:11:01.514702+0000","last_peered":"2024-09-12T01:11:01.514702+0000","last_clean":"2024-09-12T01:11:01.514702+0000","last_became_active":"2024-09-12T00:46:16.271839+0000","last_became_peered":"2024-09-12T00:46:16.271839+0000","last_unstale":"2024-09-12T01:11:01.514702+0000","last_undegraded":"2024-09-12T01:11:01.514702+0000","last_fullsized":"2024-09-12T01:11:01.514702+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:04.288299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"264'41","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.393738+0000","last_change":"2024-09-12T00:44:37.822164+0000","last_active":"2024-09-12T01:09:23.393738+0000","last_peered":"2024-09-12T01:09:23.393738+0000","last_clean":"2024-09-12T01:09:23.393738+0000","last_became_active":"2024-09-12T00:44:37.821837+0000","last_became_peered":"2024-09-12T00:44:37.821837+0000","last_unstale":"2024-09-12T01:09:23.393738+0000","last_undegraded":"2024-09-12T01:09:23.393738+0000","last_fullsized":"2024-09-12T01:09:23.393738+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":140,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403198+0000","last_change":"2024-09-12T00:56:52.996477+0000","last_active":"2024-09-12T01:08:08.403198+0000","last_peered":"2024-09-12T01:08:08.403198+0000","last_clean":"2024-09-12T01:08:08.403198+0000","last_became_active":"2024-09-12T00:56:52.996287+0000","last_became_peered":"2024-09-12T00:56:52.996287+0000","last_unstale":"2024-09-12T01:08:08.403198+0000","last_undegraded":"2024-09-12T01:08:08.403198+0000","last_fullsized":"2024-09-12T01:08:08.403198+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:34.040673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.408768+0000","last_change":"2024-09-12T00:46:19.284780+0000","last_active":"2024-09-12T01:11:08.408768+0000","last_peered":"2024-09-12T01:11:08.408768+0000","last_clean":"2024-09-12T01:11:08.408768+0000","last_became_active":"2024-09-12T00:46:19.284490+0000","last_became_peered":"2024-09-12T00:46:19.284490+0000","last_unstale":"2024-09-12T01:11:08.408768+0000","last_undegraded":"2024-09-12T01:11:08.408768+0000","last_fullsized":"2024-09-12T01:11:08.408768+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.303903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"264'10","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:02.408785+0000","last_change":"2024-09-12T00:46:16.275634+0000","last_active":"2024-09-12T01:11:02.408785+0000","last_peered":"2024-09-12T01:11:02.408785+0000","last_clean":"2024-09-12T01:11:02.408785+0000","last_became_active":"2024-09-12T00:46:16.275312+0000","last_became_peered":"2024-09-12T00:46:16.275312+0000","last_unstale":"2024-09-12T01:11:02.408785+0000","last_undegraded":"2024-09-12T01:11:02.408785+0000","last_fullsized":"2024-09-12T01:11:02.408785+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.528193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20478,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'42","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.609631+0000","last_change":"2024-09-12T00:44:37.819546+0000","last_active":"2024-09-12T01:09:23.609631+0000","last_peered":"2024-09-12T01:09:23.609631+0000","last_clean":"2024-09-12T01:09:23.609631+0000","last_became_active":"2024-09-12T00:44:37.819289+0000","last_became_peered":"2024-09-12T00:44:37.819289+0000","last_unstale":"2024-09-12T01:09:23.609631+0000","last_undegraded":"2024-09-12T01:09:23.609631+0000","last_fullsized":"2024-09-12T01:09:23.609631+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":167,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.595680+0000","last_change":"2024-09-12T00:56:52.987494+0000","last_active":"2024-09-12T01:07:43.595680+0000","last_peered":"2024-09-12T01:07:43.595680+0000","last_clean":"2024-09-12T01:07:43.595680+0000","last_became_active":"2024-09-12T00:56:52.987226+0000","last_became_peered":"2024-09-12T00:56:52.987226+0000","last_unstale":"2024-09-12T01:07:43.595680+0000","last_undegraded":"2024-09-12T01:07:43.595680+0000","last_fullsized":"2024-09-12T01:07:43.595680+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:25.549274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.458461+0000","last_change":"2024-09-12T00:46:19.287340+0000","last_active":"2024-09-12T01:11:23.458461+0000","last_peered":"2024-09-12T01:11:23.458461+0000","last_clean":"2024-09-12T01:11:23.458461+0000","last_became_active":"2024-09-12T00:46:19.287067+0000","last_became_peered":"2024-09-12T00:46:19.287067+0000","last_unstale":"2024-09-12T01:11:23.458461+0000","last_undegraded":"2024-09-12T01:11:23.458461+0000","last_fullsized":"2024-09-12T01:11:23.458461+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.086451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2174,"num_write":4,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:03.408116+0000","last_change":"2024-09-12T00:46:16.278474+0000","last_active":"2024-09-12T01:11:03.408116+0000","last_peered":"2024-09-12T01:11:03.408116+0000","last_clean":"2024-09-12T01:11:03.408116+0000","last_became_active":"2024-09-12T00:46:16.278205+0000","last_became_peered":"2024-09-12T00:46:16.278205+0000","last_unstale":"2024-09-12T01:11:03.408116+0000","last_undegraded":"2024-09-12T01:11:03.408116+0000","last_fullsized":"2024-09-12T01:11:03.408116+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:45.398336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'62","reported_seq":212,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.412833+0000","last_change":"2024-09-12T00:44:37.811854+0000","last_active":"2024-09-12T01:09:23.412833+0000","last_peered":"2024-09-12T01:09:23.412833+0000","last_clean":"2024-09-12T01:09:23.412833+0000","last_became_active":"2024-09-12T00:44:37.811544+0000","last_became_peered":"2024-09-12T00:44:37.811544+0000","last_unstale":"2024-09-12T01:09:23.412833+0000","last_undegraded":"2024-09-12T01:09:23.412833+0000","last_fullsized":"2024-09-12T01:09:23.412833+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":232,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.399787+0000","last_change":"2024-09-12T00:56:52.989633+0000","last_active":"2024-09-12T01:07:43.399787+0000","last_peered":"2024-09-12T01:07:43.399787+0000","last_clean":"2024-09-12T01:07:43.399787+0000","last_became_active":"2024-09-12T00:56:52.988985+0000","last_became_peered":"2024-09-12T00:56:52.988985+0000","last_unstale":"2024-09-12T01:07:43.399787+0000","last_undegraded":"2024-09-12T01:07:43.399787+0000","last_fullsized":"2024-09-12T01:07:43.399787+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:47.578076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'10","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479160+0000","last_change":"2024-09-12T00:46:19.279808+0000","last_active":"2024-09-12T01:08:52.479160+0000","last_peered":"2024-09-12T01:08:52.479160+0000","last_clean":"2024-09-12T01:08:52.479160+0000","last_became_active":"2024-09-12T00:46:19.279527+0000","last_became_peered":"2024-09-12T00:46:19.279527+0000","last_unstale":"2024-09-12T01:08:52.479160+0000","last_undegraded":"2024-09-12T01:08:52.479160+0000","last_fullsized":"2024-09-12T01:08:52.479160+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:07.362005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8190,"num_write":20,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.388598+0000","last_change":"2024-09-12T00:46:16.273882+0000","last_active":"2024-09-12T01:08:48.388598+0000","last_peered":"2024-09-12T01:08:48.388598+0000","last_clean":"2024-09-12T01:08:48.388598+0000","last_became_active":"2024-09-12T00:46:16.273598+0000","last_became_peered":"2024-09-12T00:46:16.273598+0000","last_unstale":"2024-09-12T01:08:48.388598+0000","last_undegraded":"2024-09-12T01:08:48.388598+0000","last_fullsized":"2024-09-12T01:08:48.388598+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:16.097567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'41","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.394348+0000","last_change":"2024-09-12T00:44:37.813325+0000","last_active":"2024-09-12T01:09:22.394348+0000","last_peered":"2024-09-12T01:09:22.394348+0000","last_clean":"2024-09-12T01:09:22.394348+0000","last_became_active":"2024-09-12T00:44:37.813081+0000","last_became_peered":"2024-09-12T00:44:37.813081+0000","last_unstale":"2024-09-12T01:09:22.394348+0000","last_undegraded":"2024-09-12T01:09:22.394348+0000","last_fullsized":"2024-09-12T01:09:22.394348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":146,"num_write":78,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.472330+0000","last_change":"2024-09-12T00:56:52.995736+0000","last_active":"2024-09-12T01:08:07.472330+0000","last_peered":"2024-09-12T01:08:07.472330+0000","last_clean":"2024-09-12T01:08:07.472330+0000","last_became_active":"2024-09-12T00:56:52.995412+0000","last_became_peered":"2024-09-12T00:56:52.995412+0000","last_unstale":"2024-09-12T01:08:07.472330+0000","last_undegraded":"2024-09-12T01:08:07.472330+0000","last_fullsized":"2024-09-12T01:08:07.472330+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:15.173930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615387+0000","last_change":"2024-09-12T00:46:19.283005+0000","last_active":"2024-09-12T01:10:08.615387+0000","last_peered":"2024-09-12T01:10:08.615387+0000","last_clean":"2024-09-12T01:10:08.615387+0000","last_became_active":"2024-09-12T00:46:19.282672+0000","last_became_peered":"2024-09-12T00:46:19.282672+0000","last_unstale":"2024-09-12T01:10:08.615387+0000","last_undegraded":"2024-09-12T01:10:08.615387+0000","last_fullsized":"2024-09-12T01:10:08.615387+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:25.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'9","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694865+0000","last_change":"2024-09-12T00:46:16.266194+0000","last_active":"2024-09-12T01:11:22.694865+0000","last_peered":"2024-09-12T01:11:22.694865+0000","last_clean":"2024-09-12T01:11:22.694865+0000","last_became_active":"2024-09-12T00:46:16.265927+0000","last_became_peered":"2024-09-12T00:46:16.265927+0000","last_unstale":"2024-09-12T01:11:22.694865+0000","last_undegraded":"2024-09-12T01:11:22.694865+0000","last_fullsized":"2024-09-12T01:11:22.694865+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:30.967366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'26","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.394324+0000","last_change":"2024-09-12T00:44:37.820836+0000","last_active":"2024-09-12T01:09:22.394324+0000","last_peered":"2024-09-12T01:09:22.394324+0000","last_clean":"2024-09-12T01:09:22.394324+0000","last_became_active":"2024-09-12T00:44:37.820584+0000","last_became_peered":"2024-09-12T00:44:37.820584+0000","last_unstale":"2024-09-12T01:09:22.394324+0000","last_undegraded":"2024-09-12T01:09:22.394324+0000","last_fullsized":"2024-09-12T01:09:22.394324+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.493580+0000","last_change":"2024-09-12T00:56:52.994371+0000","last_active":"2024-09-12T01:08:16.493580+0000","last_peered":"2024-09-12T01:08:16.493580+0000","last_clean":"2024-09-12T01:08:16.493580+0000","last_became_active":"2024-09-12T00:56:52.994132+0000","last_became_peered":"2024-09-12T00:56:52.994132+0000","last_unstale":"2024-09-12T01:08:16.493580+0000","last_undegraded":"2024-09-12T01:08:16.493580+0000","last_fullsized":"2024-09-12T01:08:16.493580+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:57.349446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.218560+0000","last_change":"2024-09-12T00:46:19.281067+0000","last_active":"2024-09-12T01:11:24.218560+0000","last_peered":"2024-09-12T01:11:24.218560+0000","last_clean":"2024-09-12T01:11:24.218560+0000","last_became_active":"2024-09-12T00:46:19.280726+0000","last_became_peered":"2024-09-12T00:46:19.280726+0000","last_unstale":"2024-09-12T01:11:24.218560+0000","last_undegraded":"2024-09-12T01:11:24.218560+0000","last_fullsized":"2024-09-12T01:11:24.218560+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:00.902460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:07.490813+0000","last_change":"2024-09-12T00:46:16.276183+0000","last_active":"2024-09-12T01:10:07.490813+0000","last_peered":"2024-09-12T01:10:07.490813+0000","last_clean":"2024-09-12T01:10:07.490813+0000","last_became_active":"2024-09-12T00:46:16.275908+0000","last_became_peered":"2024-09-12T00:46:16.275908+0000","last_unstale":"2024-09-12T01:10:07.490813+0000","last_undegraded":"2024-09-12T01:10:07.490813+0000","last_fullsized":"2024-09-12T01:10:07.490813+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:52.232454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496227+0000","last_change":"2024-09-12T00:44:37.812084+0000","last_active":"2024-09-12T01:08:36.496227+0000","last_peered":"2024-09-12T01:08:36.496227+0000","last_clean":"2024-09-12T01:08:36.496227+0000","last_became_active":"2024-09-12T00:44:37.811613+0000","last_became_peered":"2024-09-12T00:44:37.811613+0000","last_unstale":"2024-09-12T01:08:36.496227+0000","last_undegraded":"2024-09-12T01:08:36.496227+0000","last_fullsized":"2024-09-12T01:08:36.496227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:51.317906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.520108+0000","last_change":"2024-09-12T00:56:52.989823+0000","last_active":"2024-09-12T01:08:08.520108+0000","last_peered":"2024-09-12T01:08:08.520108+0000","last_clean":"2024-09-12T01:08:08.520108+0000","last_became_active":"2024-09-12T00:56:52.989552+0000","last_became_peered":"2024-09-12T00:56:52.989552+0000","last_unstale":"2024-09-12T01:08:08.520108+0000","last_undegraded":"2024-09-12T01:08:08.520108+0000","last_fullsized":"2024-09-12T01:08:08.520108+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:32.733496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390164+0000","last_change":"2024-09-12T00:46:19.282416+0000","last_active":"2024-09-12T01:08:52.390164+0000","last_peered":"2024-09-12T01:08:52.390164+0000","last_clean":"2024-09-12T01:08:52.390164+0000","last_became_active":"2024-09-12T00:46:19.282137+0000","last_became_peered":"2024-09-12T00:46:19.282137+0000","last_unstale":"2024-09-12T01:08:52.390164+0000","last_undegraded":"2024-09-12T01:08:52.390164+0000","last_fullsized":"2024-09-12T01:08:52.390164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:16.519283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557118+0000","last_change":"2024-09-12T00:46:16.274482+0000","last_active":"2024-09-12T01:11:22.557118+0000","last_peered":"2024-09-12T01:11:22.557118+0000","last_clean":"2024-09-12T01:11:22.557118+0000","last_became_active":"2024-09-12T00:46:16.274198+0000","last_became_peered":"2024-09-12T00:46:16.274198+0000","last_unstale":"2024-09-12T01:11:22.557118+0000","last_undegraded":"2024-09-12T01:11:22.557118+0000","last_fullsized":"2024-09-12T01:11:22.557118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:47.458869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2619,"num_write":4,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475262+0000","last_change":"2024-09-12T00:44:37.814764+0000","last_active":"2024-09-12T01:08:27.475262+0000","last_peered":"2024-09-12T01:08:27.475262+0000","last_clean":"2024-09-12T01:08:27.475262+0000","last_became_active":"2024-09-12T00:44:37.814480+0000","last_became_peered":"2024-09-12T00:44:37.814480+0000","last_unstale":"2024-09-12T01:08:27.475262+0000","last_undegraded":"2024-09-12T01:08:27.475262+0000","last_fullsized":"2024-09-12T01:08:27.475262+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:18.473305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383351+0000","last_change":"2024-09-12T00:56:52.997107+0000","last_active":"2024-09-12T01:08:08.383351+0000","last_peered":"2024-09-12T01:08:08.383351+0000","last_clean":"2024-09-12T01:08:08.383351+0000","last_became_active":"2024-09-12T00:56:52.996816+0000","last_became_peered":"2024-09-12T00:56:52.996816+0000","last_unstale":"2024-09-12T01:08:08.383351+0000","last_undegraded":"2024-09-12T01:08:08.383351+0000","last_fullsized":"2024-09-12T01:08:08.383351+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:21.071571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:13.534332+0000","last_change":"2024-09-12T00:46:19.276670+0000","last_active":"2024-09-12T01:10:13.534332+0000","last_peered":"2024-09-12T01:10:13.534332+0000","last_clean":"2024-09-12T01:10:13.534332+0000","last_became_active":"2024-09-12T00:46:19.276366+0000","last_became_peered":"2024-09-12T00:46:19.276366+0000","last_unstale":"2024-09-12T01:10:13.534332+0000","last_undegraded":"2024-09-12T01:10:13.534332+0000","last_fullsized":"2024-09-12T01:10:13.534332+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:52.413983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.604649+0000","last_change":"2024-09-12T00:46:16.274311+0000","last_active":"2024-09-12T01:08:48.604649+0000","last_peered":"2024-09-12T01:08:48.604649+0000","last_clean":"2024-09-12T01:08:48.604649+0000","last_became_active":"2024-09-12T00:46:16.273821+0000","last_became_peered":"2024-09-12T00:46:16.273821+0000","last_unstale":"2024-09-12T01:08:48.604649+0000","last_undegraded":"2024-09-12T01:08:48.604649+0000","last_fullsized":"2024-09-12T01:08:48.604649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:14.476953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'33","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.522282+0000","last_change":"2024-09-12T00:44:37.817651+0000","last_active":"2024-09-12T01:08:28.522282+0000","last_peered":"2024-09-12T01:08:28.522282+0000","last_clean":"2024-09-12T01:08:28.522282+0000","last_became_active":"2024-09-12T00:44:37.817357+0000","last_became_peered":"2024-09-12T00:44:37.817357+0000","last_unstale":"2024-09-12T01:08:28.522282+0000","last_undegraded":"2024-09-12T01:08:28.522282+0000","last_fullsized":"2024-09-12T01:08:28.522282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:32.676919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.528666+0000","last_change":"2024-09-12T00:56:52.991150+0000","last_active":"2024-09-12T01:09:23.528666+0000","last_peered":"2024-09-12T01:09:23.528666+0000","last_clean":"2024-09-12T01:09:23.528666+0000","last_became_active":"2024-09-12T00:56:52.990450+0000","last_became_peered":"2024-09-12T00:56:52.990450+0000","last_unstale":"2024-09-12T01:09:23.528666+0000","last_undegraded":"2024-09-12T01:09:23.528666+0000","last_fullsized":"2024-09-12T01:09:23.528666+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:08.753872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.218151+0000","last_change":"2024-09-12T00:46:19.281700+0000","last_active":"2024-09-12T01:11:24.218151+0000","last_peered":"2024-09-12T01:11:24.218151+0000","last_clean":"2024-09-12T01:11:24.218151+0000","last_became_active":"2024-09-12T00:46:19.281413+0000","last_became_peered":"2024-09-12T00:46:19.281413+0000","last_unstale":"2024-09-12T01:11:24.218151+0000","last_undegraded":"2024-09-12T01:11:24.218151+0000","last_fullsized":"2024-09-12T01:11:24.218151+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:32.000629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16941,"num_write":8,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"264'8","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.055888+0000","last_change":"2024-09-12T00:46:16.272138+0000","last_active":"2024-09-12T01:11:23.055888+0000","last_peered":"2024-09-12T01:11:23.055888+0000","last_clean":"2024-09-12T01:11:23.055888+0000","last_became_active":"2024-09-12T00:46:16.271730+0000","last_became_peered":"2024-09-12T00:46:16.271730+0000","last_unstale":"2024-09-12T01:11:23.055888+0000","last_undegraded":"2024-09-12T01:11:23.055888+0000","last_fullsized":"2024-09-12T01:11:23.055888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:24.991885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11841,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516358+0000","last_change":"2024-09-12T00:44:37.815831+0000","last_active":"2024-09-12T01:08:27.516358+0000","last_peered":"2024-09-12T01:08:27.516358+0000","last_clean":"2024-09-12T01:08:27.516358+0000","last_became_active":"2024-09-12T00:44:37.815542+0000","last_became_peered":"2024-09-12T00:44:37.815542+0000","last_unstale":"2024-09-12T01:08:27.516358+0000","last_undegraded":"2024-09-12T01:08:27.516358+0000","last_fullsized":"2024-09-12T01:08:27.516358+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.238225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":55,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.528696+0000","last_change":"2024-09-12T00:56:52.988965+0000","last_active":"2024-09-12T01:09:23.528696+0000","last_peered":"2024-09-12T01:09:23.528696+0000","last_clean":"2024-09-12T01:09:23.528696+0000","last_became_active":"2024-09-12T00:56:52.988702+0000","last_became_peered":"2024-09-12T00:56:52.988702+0000","last_unstale":"2024-09-12T01:09:23.528696+0000","last_undegraded":"2024-09-12T01:09:23.528696+0000","last_fullsized":"2024-09-12T01:09:23.528696+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:28.810429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.501938+0000","last_change":"2024-09-12T00:46:19.277090+0000","last_active":"2024-09-12T01:11:22.501938+0000","last_peered":"2024-09-12T01:11:22.501938+0000","last_clean":"2024-09-12T01:11:22.501938+0000","last_became_active":"2024-09-12T00:46:19.276538+0000","last_became_peered":"2024-09-12T00:46:19.276538+0000","last_unstale":"2024-09-12T01:11:22.501938+0000","last_undegraded":"2024-09-12T01:11:22.501938+0000","last_fullsized":"2024-09-12T01:11:22.501938+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.608027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.542531+0000","last_change":"2024-09-12T00:46:16.273158+0000","last_active":"2024-09-12T01:11:22.542531+0000","last_peered":"2024-09-12T01:11:22.542531+0000","last_clean":"2024-09-12T01:11:22.542531+0000","last_became_active":"2024-09-12T00:46:16.272892+0000","last_became_peered":"2024-09-12T00:46:16.272892+0000","last_unstale":"2024-09-12T01:11:22.542531+0000","last_undegraded":"2024-09-12T01:11:22.542531+0000","last_fullsized":"2024-09-12T01:11:22.542531+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.867186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"264'6","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.601661+0000","last_change":"2024-09-12T00:44:37.820513+0000","last_active":"2024-09-12T01:08:28.601661+0000","last_peered":"2024-09-12T01:08:28.601661+0000","last_clean":"2024-09-12T01:08:28.601661+0000","last_became_active":"2024-09-12T00:44:37.819232+0000","last_became_peered":"2024-09-12T00:44:37.819232+0000","last_unstale":"2024-09-12T01:08:28.601661+0000","last_undegraded":"2024-09-12T01:08:28.601661+0000","last_fullsized":"2024-09-12T01:08:28.601661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:53.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479701+0000","last_change":"2024-09-12T00:56:52.994822+0000","last_active":"2024-09-12T01:08:57.479701+0000","last_peered":"2024-09-12T01:08:57.479701+0000","last_clean":"2024-09-12T01:08:57.479701+0000","last_became_active":"2024-09-12T00:56:52.994128+0000","last_became_peered":"2024-09-12T00:56:52.994128+0000","last_unstale":"2024-09-12T01:08:57.479701+0000","last_undegraded":"2024-09-12T01:08:57.479701+0000","last_fullsized":"2024-09-12T01:08:57.479701+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:23.628943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.533743+0000","last_change":"2024-09-12T00:46:19.282799+0000","last_active":"2024-09-12T01:10:08.533743+0000","last_peered":"2024-09-12T01:10:08.533743+0000","last_clean":"2024-09-12T01:10:08.533743+0000","last_became_active":"2024-09-12T00:46:19.281782+0000","last_became_peered":"2024-09-12T00:46:19.281782+0000","last_unstale":"2024-09-12T01:10:08.533743+0000","last_undegraded":"2024-09-12T01:10:08.533743+0000","last_fullsized":"2024-09-12T01:10:08.533743+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:46.964297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:56.490914+0000","last_change":"2024-09-12T00:46:16.274107+0000","last_active":"2024-09-12T01:07:56.490914+0000","last_peered":"2024-09-12T01:07:56.490914+0000","last_clean":"2024-09-12T01:07:56.490914+0000","last_became_active":"2024-09-12T00:46:16.273356+0000","last_became_peered":"2024-09-12T00:46:16.273356+0000","last_unstale":"2024-09-12T01:07:56.490914+0000","last_undegraded":"2024-09-12T01:07:56.490914+0000","last_fullsized":"2024-09-12T01:07:56.490914+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:14.769067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'16","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.504950+0000","last_change":"2024-09-12T00:44:37.818413+0000","last_active":"2024-09-12T01:09:46.504950+0000","last_peered":"2024-09-12T01:09:46.504950+0000","last_clean":"2024-09-12T01:09:46.504950+0000","last_became_active":"2024-09-12T00:44:37.818054+0000","last_became_peered":"2024-09-12T00:44:37.818054+0000","last_unstale":"2024-09-12T01:09:46.504950+0000","last_undegraded":"2024-09-12T01:09:46.504950+0000","last_fullsized":"2024-09-12T01:09:46.504950+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.609549+0000","last_change":"2024-09-12T00:56:52.991268+0000","last_active":"2024-09-12T01:09:23.609549+0000","last_peered":"2024-09-12T01:09:23.609549+0000","last_clean":"2024-09-12T01:09:23.609549+0000","last_became_active":"2024-09-12T00:56:52.990601+0000","last_became_peered":"2024-09-12T00:56:52.990601+0000","last_unstale":"2024-09-12T01:09:23.609549+0000","last_undegraded":"2024-09-12T01:09:23.609549+0000","last_fullsized":"2024-09-12T01:09:23.609549+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:14.400256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615507+0000","last_change":"2024-09-12T00:46:19.282146+0000","last_active":"2024-09-12T01:10:08.615507+0000","last_peered":"2024-09-12T01:10:08.615507+0000","last_clean":"2024-09-12T01:10:08.615507+0000","last_became_active":"2024-09-12T00:46:19.281732+0000","last_became_peered":"2024-09-12T00:46:19.281732+0000","last_unstale":"2024-09-12T01:10:08.615507+0000","last_undegraded":"2024-09-12T01:10:08.615507+0000","last_fullsized":"2024-09-12T01:10:08.615507+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:55.852331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694639+0000","last_change":"2024-09-12T00:46:16.277570+0000","last_active":"2024-09-12T01:11:22.694639+0000","last_peered":"2024-09-12T01:11:22.694639+0000","last_clean":"2024-09-12T01:11:22.694639+0000","last_became_active":"2024-09-12T00:46:16.277261+0000","last_became_peered":"2024-09-12T00:46:16.277261+0000","last_unstale":"2024-09-12T01:11:22.694639+0000","last_undegraded":"2024-09-12T01:11:22.694639+0000","last_fullsized":"2024-09-12T01:11:22.694639+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:00.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'33","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.395845+0000","last_change":"2024-09-12T00:44:37.818362+0000","last_active":"2024-09-12T01:09:38.395845+0000","last_peered":"2024-09-12T01:09:38.395845+0000","last_clean":"2024-09-12T01:09:38.395845+0000","last_became_active":"2024-09-12T00:44:37.818055+0000","last_became_peered":"2024-09-12T00:44:37.818055+0000","last_unstale":"2024-09-12T01:09:38.395845+0000","last_undegraded":"2024-09-12T01:09:38.395845+0000","last_fullsized":"2024-09-12T01:09:38.395845+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":106,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380147+0000","last_change":"2024-09-12T00:56:52.989699+0000","last_active":"2024-09-12T01:07:43.380147+0000","last_peered":"2024-09-12T01:07:43.380147+0000","last_clean":"2024-09-12T01:07:43.380147+0000","last_became_active":"2024-09-12T00:56:52.989396+0000","last_became_peered":"2024-09-12T00:56:52.989396+0000","last_unstale":"2024-09-12T01:07:43.380147+0000","last_undegraded":"2024-09-12T01:07:43.380147+0000","last_fullsized":"2024-09-12T01:07:43.380147+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:26.478574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.523445+0000","last_change":"2024-09-12T00:46:19.281553+0000","last_active":"2024-09-12T01:09:17.523445+0000","last_peered":"2024-09-12T01:09:17.523445+0000","last_clean":"2024-09-12T01:09:17.523445+0000","last_became_active":"2024-09-12T00:46:19.281231+0000","last_became_peered":"2024-09-12T00:46:19.281231+0000","last_unstale":"2024-09-12T01:09:17.523445+0000","last_undegraded":"2024-09-12T01:09:17.523445+0000","last_fullsized":"2024-09-12T01:09:17.523445+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:58.529910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"264'7","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694407+0000","last_change":"2024-09-12T00:46:16.277008+0000","last_active":"2024-09-12T01:11:22.694407+0000","last_peered":"2024-09-12T01:11:22.694407+0000","last_clean":"2024-09-12T01:11:22.694407+0000","last_became_active":"2024-09-12T00:46:16.276730+0000","last_became_peered":"2024-09-12T00:46:16.276730+0000","last_unstale":"2024-09-12T01:11:22.694407+0000","last_undegraded":"2024-09-12T01:11:22.694407+0000","last_fullsized":"2024-09-12T01:11:22.694407+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:54.164828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7172,"num_write":12,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'54","reported_seq":200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:41.504168+0000","last_change":"2024-09-12T00:44:37.817537+0000","last_active":"2024-09-12T01:09:41.504168+0000","last_peered":"2024-09-12T01:09:41.504168+0000","last_clean":"2024-09-12T01:09:41.504168+0000","last_became_active":"2024-09-12T00:44:37.817249+0000","last_became_peered":"2024-09-12T00:44:37.817249+0000","last_unstale":"2024-09-12T01:09:41.504168+0000","last_undegraded":"2024-09-12T01:09:41.504168+0000","last_fullsized":"2024-09-12T01:09:41.504168+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":217,"num_write":83,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510158+0000","last_change":"2024-09-12T00:56:52.993381+0000","last_active":"2024-09-12T01:07:42.510158+0000","last_peered":"2024-09-12T01:07:42.510158+0000","last_clean":"2024-09-12T01:07:42.510158+0000","last_became_active":"2024-09-12T00:56:52.992289+0000","last_became_peered":"2024-09-12T00:56:52.992289+0000","last_unstale":"2024-09-12T01:07:42.510158+0000","last_undegraded":"2024-09-12T01:07:42.510158+0000","last_fullsized":"2024-09-12T01:07:42.510158+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:39.371458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.600810+0000","last_change":"2024-09-12T00:46:19.281027+0000","last_active":"2024-09-12T01:08:23.600810+0000","last_peered":"2024-09-12T01:08:23.600810+0000","last_clean":"2024-09-12T01:08:23.600810+0000","last_became_active":"2024-09-12T00:46:19.280725+0000","last_became_peered":"2024-09-12T00:46:19.280725+0000","last_unstale":"2024-09-12T01:08:23.600810+0000","last_undegraded":"2024-09-12T01:08:23.600810+0000","last_fullsized":"2024-09-12T01:08:23.600810+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:05.148455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.608121+0000","last_change":"2024-09-12T00:46:16.272821+0000","last_active":"2024-09-12T01:09:13.608121+0000","last_peered":"2024-09-12T01:09:13.608121+0000","last_clean":"2024-09-12T01:09:13.608121+0000","last_became_active":"2024-09-12T00:46:16.272417+0000","last_became_peered":"2024-09-12T00:46:16.272417+0000","last_unstale":"2024-09-12T01:09:13.608121+0000","last_undegraded":"2024-09-12T01:09:13.608121+0000","last_fullsized":"2024-09-12T01:09:13.608121+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:30.234992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2052,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'44","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.611486+0000","last_change":"2024-09-12T00:44:37.818360+0000","last_active":"2024-09-12T01:09:38.611486+0000","last_peered":"2024-09-12T01:09:38.611486+0000","last_clean":"2024-09-12T01:09:38.611486+0000","last_became_active":"2024-09-12T00:44:37.815722+0000","last_became_peered":"2024-09-12T00:44:37.815722+0000","last_unstale":"2024-09-12T01:09:38.611486+0000","last_undegraded":"2024-09-12T01:09:38.611486+0000","last_fullsized":"2024-09-12T01:09:38.611486+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":150,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.483749+0000","last_change":"2024-09-12T00:56:52.993069+0000","last_active":"2024-09-12T01:09:22.483749+0000","last_peered":"2024-09-12T01:09:22.483749+0000","last_clean":"2024-09-12T01:09:22.483749+0000","last_became_active":"2024-09-12T00:56:52.989218+0000","last_became_peered":"2024-09-12T00:56:52.989218+0000","last_unstale":"2024-09-12T01:09:22.483749+0000","last_undegraded":"2024-09-12T01:09:22.483749+0000","last_fullsized":"2024-09-12T01:09:22.483749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:51.764331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.501310+0000","last_change":"2024-09-12T00:46:19.282564+0000","last_active":"2024-09-12T01:09:16.501310+0000","last_peered":"2024-09-12T01:09:16.501310+0000","last_clean":"2024-09-12T01:09:16.501310+0000","last_became_active":"2024-09-12T00:46:19.282270+0000","last_became_peered":"2024-09-12T00:46:19.282270+0000","last_unstale":"2024-09-12T01:09:16.501310+0000","last_undegraded":"2024-09-12T01:09:16.501310+0000","last_fullsized":"2024-09-12T01:09:16.501310+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:43.456680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.392925+0000","last_change":"2024-09-12T00:46:16.276646+0000","last_active":"2024-09-12T01:09:12.392925+0000","last_peered":"2024-09-12T01:09:12.392925+0000","last_clean":"2024-09-12T01:09:12.392925+0000","last_became_active":"2024-09-12T00:46:16.276368+0000","last_became_peered":"2024-09-12T00:46:16.276368+0000","last_unstale":"2024-09-12T01:09:12.392925+0000","last_undegraded":"2024-09-12T01:09:12.392925+0000","last_fullsized":"2024-09-12T01:09:12.392925+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:03.285958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.611417+0000","last_change":"2024-09-12T00:44:37.821471+0000","last_active":"2024-09-12T01:09:38.611417+0000","last_peered":"2024-09-12T01:09:38.611417+0000","last_clean":"2024-09-12T01:09:38.611417+0000","last_became_active":"2024-09-12T00:44:37.821172+0000","last_became_peered":"2024-09-12T00:44:37.821172+0000","last_unstale":"2024-09-12T01:09:38.611417+0000","last_undegraded":"2024-09-12T01:09:38.611417+0000","last_fullsized":"2024-09-12T01:09:38.611417+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":156,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.610223+0000","last_change":"2024-09-12T00:56:52.993348+0000","last_active":"2024-09-12T01:09:28.610223+0000","last_peered":"2024-09-12T01:09:28.610223+0000","last_clean":"2024-09-12T01:09:28.610223+0000","last_became_active":"2024-09-12T00:56:52.993079+0000","last_became_peered":"2024-09-12T00:56:52.993079+0000","last_unstale":"2024-09-12T01:09:28.610223+0000","last_undegraded":"2024-09-12T01:09:28.610223+0000","last_fullsized":"2024-09-12T01:09:28.610223+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.517662+0000","last_change":"2024-09-12T00:46:19.279921+0000","last_active":"2024-09-12T01:11:21.517662+0000","last_peered":"2024-09-12T01:11:21.517662+0000","last_clean":"2024-09-12T01:11:21.517662+0000","last_became_active":"2024-09-12T00:46:19.279630+0000","last_became_peered":"2024-09-12T00:46:19.279630+0000","last_unstale":"2024-09-12T01:11:21.517662+0000","last_undegraded":"2024-09-12T01:11:21.517662+0000","last_fullsized":"2024-09-12T01:11:21.517662+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:49.231021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.427462+0000","last_change":"2024-09-12T00:46:16.267218+0000","last_active":"2024-09-12T01:11:18.427462+0000","last_peered":"2024-09-12T01:11:18.427462+0000","last_clean":"2024-09-12T01:11:18.427462+0000","last_became_active":"2024-09-12T00:46:16.266854+0000","last_became_peered":"2024-09-12T00:46:16.266854+0000","last_unstale":"2024-09-12T01:11:18.427462+0000","last_undegraded":"2024-09-12T01:11:18.427462+0000","last_fullsized":"2024-09-12T01:11:18.427462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:46.629498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'16","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.497466+0000","last_change":"2024-09-12T00:44:37.822549+0000","last_active":"2024-09-12T01:08:46.497466+0000","last_peered":"2024-09-12T01:08:46.497466+0000","last_clean":"2024-09-12T01:08:46.497466+0000","last_became_active":"2024-09-12T00:44:37.822277+0000","last_became_peered":"2024-09-12T00:44:37.822277+0000","last_unstale":"2024-09-12T01:08:46.497466+0000","last_undegraded":"2024-09-12T01:08:46.497466+0000","last_fullsized":"2024-09-12T01:08:46.497466+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:57.547476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'407","reported_seq":1186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.407090+0000","last_change":"2024-09-12T01:11:48.407090+0000","last_active":"2024-09-12T01:11:48.407090+0000","last_peered":"2024-09-12T01:11:48.407090+0000","last_clean":"2024-09-12T01:11:48.407090+0000","last_became_active":"2024-09-12T00:30:11.107706+0000","last_became_peered":"2024-09-12T00:30:11.107706+0000","last_unstale":"2024-09-12T01:11:48.407090+0000","last_undegraded":"2024-09-12T01:11:48.407090+0000","last_fullsized":"2024-09-12T01:11:48.407090+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T01:11:48.406922+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T01:11:48.406922+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.406922+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:05.383919+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436870,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":772,"num_read_kb":12989,"num_write":1306,"num_write_kb":41879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'141","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.834184+0000","last_change":"2024-09-12T01:11:47.834184+0000","last_active":"2024-09-12T01:11:47.834184+0000","last_peered":"2024-09-12T01:11:47.834184+0000","last_clean":"2024-09-12T01:11:47.834184+0000","last_became_active":"2024-09-12T00:30:13.126147+0000","last_became_peered":"2024-09-12T00:30:13.126147+0000","last_unstale":"2024-09-12T01:11:47.834184+0000","last_undegraded":"2024-09-12T01:11:47.834184+0000","last_fullsized":"2024-09-12T01:11:47.834184+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T01:11:47.834094+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T01:11:47.834094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.834094+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:12.812212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":527,"num_write":201,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'354","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.354725+0000","last_change":"2024-09-12T01:11:44.354725+0000","last_active":"2024-09-12T01:11:44.354725+0000","last_peered":"2024-09-12T01:11:44.354725+0000","last_clean":"2024-09-12T01:11:44.354725+0000","last_became_active":"2024-09-12T00:30:11.101252+0000","last_became_peered":"2024-09-12T00:30:11.101252+0000","last_unstale":"2024-09-12T01:11:44.354725+0000","last_undegraded":"2024-09-12T01:11:44.354725+0000","last_fullsized":"2024-09-12T01:11:44.354725+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-12T01:11:44.354589+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-12T01:11:44.354589+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.354589+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:43.412106+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":19965,"num_write":1084,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'209","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:30.236873+0000","last_change":"2024-09-12T00:30:13.124111+0000","last_active":"2024-09-12T01:09:30.236873+0000","last_peered":"2024-09-12T01:09:30.236873+0000","last_clean":"2024-09-12T01:09:30.236873+0000","last_became_active":"2024-09-12T00:30:13.123880+0000","last_became_peered":"2024-09-12T00:30:13.123880+0000","last_unstale":"2024-09-12T01:09:30.236873+0000","last_undegraded":"2024-09-12T01:09:30.236873+0000","last_fullsized":"2024-09-12T01:09:30.236873+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:41.642173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":720,"num_write":314,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'300","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.325526+0000","last_change":"2024-09-12T01:11:43.325526+0000","last_active":"2024-09-12T01:11:43.325526+0000","last_peered":"2024-09-12T01:11:43.325526+0000","last_clean":"2024-09-12T01:11:43.325526+0000","last_became_active":"2024-09-12T00:30:11.096381+0000","last_became_peered":"2024-09-12T00:30:11.096381+0000","last_unstale":"2024-09-12T01:11:43.325526+0000","last_undegraded":"2024-09-12T01:11:43.325526+0000","last_fullsized":"2024-09-12T01:11:43.325526+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'300","last_scrub_stamp":"2024-09-12T01:11:43.325415+0000","last_deep_scrub":"264'300","last_deep_scrub_stamp":"2024-09-12T01:11:43.325415+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.325415+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:58.190997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155766,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":52760,"num_write":991,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'151","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.489637+0000","last_change":"2024-09-12T00:30:13.121126+0000","last_active":"2024-09-12T01:08:45.489637+0000","last_peered":"2024-09-12T01:08:45.489637+0000","last_clean":"2024-09-12T01:08:45.489637+0000","last_became_active":"2024-09-12T00:30:13.120834+0000","last_became_peered":"2024-09-12T00:30:13.120834+0000","last_unstale":"2024-09-12T01:08:45.489637+0000","last_undegraded":"2024-09-12T01:08:45.489637+0000","last_fullsized":"2024-09-12T01:08:45.489637+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:48.681924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":556,"num_write":237,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'320","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.443053+0000","last_change":"2024-09-12T01:11:35.443053+0000","last_active":"2024-09-12T01:11:35.443053+0000","last_peered":"2024-09-12T01:11:35.443053+0000","last_clean":"2024-09-12T01:11:35.443053+0000","last_became_active":"2024-09-12T00:30:11.101773+0000","last_became_peered":"2024-09-12T00:30:11.101773+0000","last_unstale":"2024-09-12T01:11:35.443053+0000","last_undegraded":"2024-09-12T01:11:35.443053+0000","last_fullsized":"2024-09-12T01:11:35.443053+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'320","last_scrub_stamp":"2024-09-12T01:11:35.442897+0000","last_deep_scrub":"264'320","last_deep_scrub_stamp":"2024-09-12T01:11:35.442897+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.442897+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:33.195530+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262280,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":453,"num_read_kb":6783,"num_write":940,"num_write_kb":20709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4368","reported_seq":4975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.323139+0000","last_change":"2024-09-12T01:11:46.323139+0000","last_active":"2024-09-12T01:11:46.323139+0000","last_peered":"2024-09-12T01:11:46.323139+0000","last_clean":"2024-09-12T01:11:46.323139+0000","last_became_active":"2024-09-12T00:30:13.113812+0000","last_became_peered":"2024-09-12T00:30:13.113812+0000","last_unstale":"2024-09-12T01:11:46.323139+0000","last_undegraded":"2024-09-12T01:11:46.323139+0000","last_fullsized":"2024-09-12T01:11:46.323139+0000","mapping_epoch":28,"log_start":"264'4300","ondisk_log_start":"264'4300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4368","last_scrub_stamp":"2024-09-12T01:11:46.323056+0000","last_deep_scrub":"264'4368","last_deep_scrub_stamp":"2024-09-12T01:11:46.323056+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.323056+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:31.432326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17553,"num_read_kb":14742,"num_write":6586,"num_write_kb":3311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'326","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.473231+0000","last_change":"2024-09-12T01:11:37.473231+0000","last_active":"2024-09-12T01:11:37.473231+0000","last_peered":"2024-09-12T01:11:37.473231+0000","last_clean":"2024-09-12T01:11:37.473231+0000","last_became_active":"2024-09-12T00:30:11.097339+0000","last_became_peered":"2024-09-12T00:30:11.097339+0000","last_unstale":"2024-09-12T01:11:37.473231+0000","last_undegraded":"2024-09-12T01:11:37.473231+0000","last_fullsized":"2024-09-12T01:11:37.473231+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T01:11:37.473039+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T01:11:37.473039+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.473039+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:13.523857+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":4533,"num_write":1139,"num_write_kb":19662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"264'201","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:21.028978+0000","last_change":"2024-09-12T00:30:13.125647+0000","last_active":"2024-09-12T01:08:21.028978+0000","last_peered":"2024-09-12T01:08:21.028978+0000","last_clean":"2024-09-12T01:08:21.028978+0000","last_became_active":"2024-09-12T00:30:13.125363+0000","last_became_peered":"2024-09-12T00:30:13.125363+0000","last_unstale":"2024-09-12T01:08:21.028978+0000","last_undegraded":"2024-09-12T01:08:21.028978+0000","last_fullsized":"2024-09-12T01:08:21.028978+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:56.486136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":845,"num_read_kb":691,"num_write":311,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'352","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.393821+0000","last_change":"2024-09-12T01:11:34.393821+0000","last_active":"2024-09-12T01:11:34.393821+0000","last_peered":"2024-09-12T01:11:34.393821+0000","last_clean":"2024-09-12T01:11:34.393821+0000","last_became_active":"2024-09-12T00:30:11.104535+0000","last_became_peered":"2024-09-12T00:30:11.104535+0000","last_unstale":"2024-09-12T01:11:34.393821+0000","last_undegraded":"2024-09-12T01:11:34.393821+0000","last_fullsized":"2024-09-12T01:11:34.393821+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-12T01:11:34.393680+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-12T01:11:34.393680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.393680+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:03.783815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174750,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":66788,"num_write":989,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'115","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.451717+0000","last_change":"2024-09-12T01:11:44.451717+0000","last_active":"2024-09-12T01:11:44.451717+0000","last_peered":"2024-09-12T01:11:44.451717+0000","last_clean":"2024-09-12T01:11:44.451717+0000","last_became_active":"2024-09-12T00:30:13.124774+0000","last_became_peered":"2024-09-12T00:30:13.124774+0000","last_unstale":"2024-09-12T01:11:44.451717+0000","last_undegraded":"2024-09-12T01:11:44.451717+0000","last_fullsized":"2024-09-12T01:11:44.451717+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T01:11:44.451630+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T01:11:44.451630+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.451630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.872379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":451,"num_write":180,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'309","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.403865+0000","last_change":"2024-09-12T01:11:40.403865+0000","last_active":"2024-09-12T01:11:40.403865+0000","last_peered":"2024-09-12T01:11:40.403865+0000","last_clean":"2024-09-12T01:11:40.403865+0000","last_became_active":"2024-09-12T00:30:11.102281+0000","last_became_peered":"2024-09-12T00:30:11.102281+0000","last_unstale":"2024-09-12T01:11:40.403865+0000","last_undegraded":"2024-09-12T01:11:40.403865+0000","last_fullsized":"2024-09-12T01:11:40.403865+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T01:11:40.403724+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T01:11:40.403724+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.403724+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:13.642901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3622998,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":454,"num_read_kb":13880,"num_write":954,"num_write_kb":40348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'545","reported_seq":1249,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.361112+0000","last_change":"2024-09-12T01:11:45.361112+0000","last_active":"2024-09-12T01:11:45.361112+0000","last_peered":"2024-09-12T01:11:45.361112+0000","last_clean":"2024-09-12T01:11:45.361112+0000","last_became_active":"2024-09-12T00:30:13.126123+0000","last_became_peered":"2024-09-12T00:30:13.126123+0000","last_unstale":"2024-09-12T01:11:45.361112+0000","last_undegraded":"2024-09-12T01:11:45.361112+0000","last_fullsized":"2024-09-12T01:11:45.361112+0000","mapping_epoch":28,"log_start":"264'500","ondisk_log_start":"264'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'545","last_scrub_stamp":"2024-09-12T01:11:45.361027+0000","last_deep_scrub":"264'545","last_deep_scrub_stamp":"2024-09-12T01:11:45.361027+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.361027+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:32.122143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2509,"num_read_kb":2200,"num_write":899,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25757,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'299","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.286745+0000","last_change":"2024-09-12T01:11:42.286745+0000","last_active":"2024-09-12T01:11:42.286745+0000","last_peered":"2024-09-12T01:11:42.286745+0000","last_clean":"2024-09-12T01:11:42.286745+0000","last_became_active":"2024-09-12T00:30:11.104084+0000","last_became_peered":"2024-09-12T00:30:11.104084+0000","last_unstale":"2024-09-12T01:11:42.286745+0000","last_undegraded":"2024-09-12T01:11:42.286745+0000","last_fullsized":"2024-09-12T01:11:42.286745+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T01:11:42.286619+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T01:11:42.286619+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.286619+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:50.160187+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":483,"num_read_kb":14633,"num_write":970,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'231","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.849014+0000","last_change":"2024-09-12T00:30:13.129106+0000","last_active":"2024-09-12T01:09:15.849014+0000","last_peered":"2024-09-12T01:09:15.849014+0000","last_clean":"2024-09-12T01:09:15.849014+0000","last_became_active":"2024-09-12T00:30:13.127581+0000","last_became_peered":"2024-09-12T00:30:13.127581+0000","last_unstale":"2024-09-12T01:09:15.849014+0000","last_undegraded":"2024-09-12T01:09:15.849014+0000","last_fullsized":"2024-09-12T01:09:15.849014+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:37.451443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1008,"num_read_kb":834,"num_write":338,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'462","reported_seq":1238,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:46.335798+0000","last_change":"2024-09-12T00:30:13.121457+0000","last_active":"2024-09-12T01:08:46.335798+0000","last_peered":"2024-09-12T01:08:46.335798+0000","last_clean":"2024-09-12T01:08:46.335798+0000","last_became_active":"2024-09-12T00:30:13.121154+0000","last_became_peered":"2024-09-12T00:30:13.121154+0000","last_unstale":"2024-09-12T01:08:46.335798+0000","last_undegraded":"2024-09-12T01:08:46.335798+0000","last_fullsized":"2024-09-12T01:08:46.335798+0000","mapping_epoch":28,"log_start":"264'400","ondisk_log_start":"264'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:30.709632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2284,"num_read_kb":1967,"num_write":806,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'287","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.803024+0000","last_change":"2024-09-12T01:11:31.803024+0000","last_active":"2024-09-12T01:11:31.803024+0000","last_peered":"2024-09-12T01:11:31.803024+0000","last_clean":"2024-09-12T01:11:31.803024+0000","last_became_active":"2024-09-12T00:30:11.103437+0000","last_became_peered":"2024-09-12T00:30:11.103437+0000","last_unstale":"2024-09-12T01:11:31.803024+0000","last_undegraded":"2024-09-12T01:11:31.803024+0000","last_fullsized":"2024-09-12T01:11:31.803024+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'287","last_scrub_stamp":"2024-09-12T01:11:31.802921+0000","last_deep_scrub":"264'287","last_deep_scrub_stamp":"2024-09-12T01:11:31.802921+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.802921+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:24.521722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767235,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":430,"num_read_kb":35388,"num_write":888,"num_write_kb":32368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'227","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.432953+0000","last_change":"2024-09-12T01:11:45.432953+0000","last_active":"2024-09-12T01:11:45.432953+0000","last_peered":"2024-09-12T01:11:45.432953+0000","last_clean":"2024-09-12T01:11:45.432953+0000","last_became_active":"2024-09-12T00:30:13.128977+0000","last_became_peered":"2024-09-12T00:30:13.128977+0000","last_unstale":"2024-09-12T01:11:45.432953+0000","last_undegraded":"2024-09-12T01:11:45.432953+0000","last_fullsized":"2024-09-12T01:11:45.432953+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-12T01:11:45.432855+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-12T01:11:45.432855+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.432855+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.213964+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1058,"num_read_kb":878,"num_write":388,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'310","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.446257+0000","last_change":"2024-09-12T01:11:36.446257+0000","last_active":"2024-09-12T01:11:36.446257+0000","last_peered":"2024-09-12T01:11:36.446257+0000","last_clean":"2024-09-12T01:11:36.446257+0000","last_became_active":"2024-09-12T00:30:11.114961+0000","last_became_peered":"2024-09-12T00:30:11.114961+0000","last_unstale":"2024-09-12T01:11:36.446257+0000","last_undegraded":"2024-09-12T01:11:36.446257+0000","last_fullsized":"2024-09-12T01:11:36.446257+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T01:11:36.446124+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T01:11:36.446124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.446124+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.906220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":433,"num_read_kb":13562,"num_write":946,"num_write_kb":25787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'212","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.855585+0000","last_change":"2024-09-12T01:11:39.855585+0000","last_active":"2024-09-12T01:11:39.855585+0000","last_peered":"2024-09-12T01:11:39.855585+0000","last_clean":"2024-09-12T01:11:39.855585+0000","last_became_active":"2024-09-12T00:30:13.127190+0000","last_became_peered":"2024-09-12T00:30:13.127190+0000","last_unstale":"2024-09-12T01:11:39.855585+0000","last_undegraded":"2024-09-12T01:11:39.855585+0000","last_fullsized":"2024-09-12T01:11:39.855585+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T01:11:39.855488+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T01:11:39.855488+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.855488+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:33.985807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":739,"num_write":341,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'368","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.424540+0000","last_change":"2024-09-12T01:11:35.424540+0000","last_active":"2024-09-12T01:11:35.424540+0000","last_peered":"2024-09-12T01:11:35.424540+0000","last_clean":"2024-09-12T01:11:35.424540+0000","last_became_active":"2024-09-12T00:30:11.105844+0000","last_became_peered":"2024-09-12T00:30:11.105844+0000","last_unstale":"2024-09-12T01:11:35.424540+0000","last_undegraded":"2024-09-12T01:11:35.424540+0000","last_fullsized":"2024-09-12T01:11:35.424540+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-12T01:11:35.424385+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-12T01:11:35.424385+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.424385+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:55.565109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242896,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":46849,"num_write":1178,"num_write_kb":40470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'183","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.095594+0000","last_change":"2024-09-12T01:11:44.095594+0000","last_active":"2024-09-12T01:11:44.095594+0000","last_peered":"2024-09-12T01:11:44.095594+0000","last_clean":"2024-09-12T01:11:44.095594+0000","last_became_active":"2024-09-12T00:30:13.124627+0000","last_became_peered":"2024-09-12T00:30:13.124627+0000","last_unstale":"2024-09-12T01:11:44.095594+0000","last_undegraded":"2024-09-12T01:11:44.095594+0000","last_fullsized":"2024-09-12T01:11:44.095594+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-09-12T01:11:44.095499+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-09-12T01:11:44.095499+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.095499+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:48.009771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":804,"num_read_kb":662,"num_write":262,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'315","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.375607+0000","last_change":"2024-09-12T01:11:34.375607+0000","last_active":"2024-09-12T01:11:34.375607+0000","last_peered":"2024-09-12T01:11:34.375607+0000","last_clean":"2024-09-12T01:11:34.375607+0000","last_became_active":"2024-09-12T00:30:11.114309+0000","last_became_peered":"2024-09-12T00:30:11.114309+0000","last_unstale":"2024-09-12T01:11:34.375607+0000","last_undegraded":"2024-09-12T01:11:34.375607+0000","last_fullsized":"2024-09-12T01:11:34.375607+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T01:11:34.375465+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T01:11:34.375465+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.375465+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.864011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052685,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":64152,"num_write":970,"num_write_kb":27626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'205","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479130+0000","last_change":"2024-09-12T00:30:13.129990+0000","last_active":"2024-09-12T01:08:52.479130+0000","last_peered":"2024-09-12T01:08:52.479130+0000","last_clean":"2024-09-12T01:08:52.479130+0000","last_became_active":"2024-09-12T00:30:13.129718+0000","last_became_peered":"2024-09-12T00:30:13.129718+0000","last_unstale":"2024-09-12T01:08:52.479130+0000","last_undegraded":"2024-09-12T01:08:52.479130+0000","last_fullsized":"2024-09-12T01:08:52.479130+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:07.835287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":749,"num_write":336,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'388","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.074143+0000","last_change":"2024-09-12T01:11:37.074143+0000","last_active":"2024-09-12T01:11:37.074143+0000","last_peered":"2024-09-12T01:11:37.074143+0000","last_clean":"2024-09-12T01:11:37.074143+0000","last_became_active":"2024-09-12T00:30:11.108958+0000","last_became_peered":"2024-09-12T00:30:11.108958+0000","last_unstale":"2024-09-12T01:11:37.074143+0000","last_undegraded":"2024-09-12T01:11:37.074143+0000","last_fullsized":"2024-09-12T01:11:37.074143+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'388","last_scrub_stamp":"2024-09-12T01:11:37.074011+0000","last_deep_scrub":"264'388","last_deep_scrub_stamp":"2024-09-12T01:11:37.074011+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.074011+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:15.101690+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1489630,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":577,"num_read_kb":32016,"num_write":1378,"num_write_kb":50601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'152","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.881871+0000","last_change":"2024-09-12T01:11:41.881871+0000","last_active":"2024-09-12T01:11:41.881871+0000","last_peered":"2024-09-12T01:11:41.881871+0000","last_clean":"2024-09-12T01:11:41.881871+0000","last_became_active":"2024-09-12T00:30:13.126143+0000","last_became_peered":"2024-09-12T00:30:13.126143+0000","last_unstale":"2024-09-12T01:11:41.881871+0000","last_undegraded":"2024-09-12T01:11:41.881871+0000","last_fullsized":"2024-09-12T01:11:41.881871+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T01:11:41.881760+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T01:11:41.881760+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.881760+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:50.664271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":565,"num_write":225,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'347","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.071064+0000","last_change":"2024-09-12T01:11:38.071064+0000","last_active":"2024-09-12T01:11:38.071064+0000","last_peered":"2024-09-12T01:11:38.071064+0000","last_clean":"2024-09-12T01:11:38.071064+0000","last_became_active":"2024-09-12T00:30:11.096162+0000","last_became_peered":"2024-09-12T00:30:11.096162+0000","last_unstale":"2024-09-12T01:11:38.071064+0000","last_undegraded":"2024-09-12T01:11:38.071064+0000","last_fullsized":"2024-09-12T01:11:38.071064+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:38.070939+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:38.070939+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.070939+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.813945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340490,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":7249,"num_write":983,"num_write_kb":14577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'148","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.879667+0000","last_change":"2024-09-12T00:30:21.192901+0000","last_active":"2024-09-12T01:09:46.879667+0000","last_peered":"2024-09-12T01:09:46.879667+0000","last_clean":"2024-09-12T01:09:46.879667+0000","last_became_active":"2024-09-12T00:30:21.192654+0000","last_became_peered":"2024-09-12T00:30:21.192654+0000","last_unstale":"2024-09-12T01:09:46.879667+0000","last_undegraded":"2024-09-12T01:09:46.879667+0000","last_fullsized":"2024-09-12T01:09:46.879667+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:51.831265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":350,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'101","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.031586+0000","last_change":"2024-09-12T01:11:42.031586+0000","last_active":"2024-09-12T01:11:42.031586+0000","last_peered":"2024-09-12T01:11:42.031586+0000","last_clean":"2024-09-12T01:11:42.031586+0000","last_became_active":"2024-09-12T00:30:13.130030+0000","last_became_peered":"2024-09-12T00:30:13.130030+0000","last_unstale":"2024-09-12T01:11:42.031586+0000","last_undegraded":"2024-09-12T01:11:42.031586+0000","last_fullsized":"2024-09-12T01:11:42.031586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T01:11:42.031492+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T01:11:42.031492+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.031492+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:53.639664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":143,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'440","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.883016+0000","last_change":"2024-09-12T01:11:38.883016+0000","last_active":"2024-09-12T01:11:38.883016+0000","last_peered":"2024-09-12T01:11:38.883016+0000","last_clean":"2024-09-12T01:11:38.883016+0000","last_became_active":"2024-09-12T00:30:46.767516+0000","last_became_peered":"2024-09-12T00:30:46.767516+0000","last_unstale":"2024-09-12T01:11:38.883016+0000","last_undegraded":"2024-09-12T01:11:38.883016+0000","last_fullsized":"2024-09-12T01:11:38.883016+0000","mapping_epoch":39,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'440","last_scrub_stamp":"2024-09-12T01:11:38.882878+0000","last_deep_scrub":"264'440","last_deep_scrub_stamp":"2024-09-12T01:11:38.882878+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.882878+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:35.403537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1451987,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38823,"num_write":1374,"num_write_kb":62705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,4],"acting":[3,5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605940+0000","last_change":"2024-09-12T00:30:15.127353+0000","last_active":"2024-09-12T01:08:58.605940+0000","last_peered":"2024-09-12T01:08:58.605940+0000","last_clean":"2024-09-12T01:08:58.605940+0000","last_became_active":"2024-09-12T00:30:15.127067+0000","last_became_peered":"2024-09-12T00:30:15.127067+0000","last_unstale":"2024-09-12T01:08:58.605940+0000","last_undegraded":"2024-09-12T01:08:58.605940+0000","last_fullsized":"2024-09-12T01:08:58.605940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:01.202011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'324","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.795522+0000","last_change":"2024-09-12T00:30:17.145857+0000","last_active":"2024-09-12T01:11:23.795522+0000","last_peered":"2024-09-12T01:11:23.795522+0000","last_clean":"2024-09-12T01:11:23.795522+0000","last_became_active":"2024-09-12T00:30:17.145455+0000","last_became_peered":"2024-09-12T00:30:17.145455+0000","last_unstale":"2024-09-12T01:11:23.795522+0000","last_undegraded":"2024-09-12T01:11:23.795522+0000","last_fullsized":"2024-09-12T01:11:23.795522+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:25.114718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45268,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":1055,"num_write":410,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409967+0000","last_change":"2024-09-12T00:30:19.168447+0000","last_active":"2024-09-12T01:08:58.409967+0000","last_peered":"2024-09-12T01:08:58.409967+0000","last_clean":"2024-09-12T01:08:58.409967+0000","last_became_active":"2024-09-12T00:30:19.168192+0000","last_became_peered":"2024-09-12T00:30:19.168192+0000","last_unstale":"2024-09-12T01:08:58.409967+0000","last_undegraded":"2024-09-12T01:08:58.409967+0000","last_fullsized":"2024-09-12T01:08:58.409967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:11.131718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'146","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.236629+0000","last_change":"2024-09-12T00:30:21.189447+0000","last_active":"2024-09-12T01:09:43.236629+0000","last_peered":"2024-09-12T01:09:43.236629+0000","last_clean":"2024-09-12T01:09:43.236629+0000","last_became_active":"2024-09-12T00:30:21.189141+0000","last_became_peered":"2024-09-12T00:30:21.189141+0000","last_unstale":"2024-09-12T01:09:43.236629+0000","last_undegraded":"2024-09-12T01:09:43.236629+0000","last_fullsized":"2024-09-12T01:09:43.236629+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":204,"num_write":274,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'90","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.605253+0000","last_change":"2024-09-12T00:30:13.127898+0000","last_active":"2024-09-12T01:08:53.605253+0000","last_peered":"2024-09-12T01:08:53.605253+0000","last_clean":"2024-09-12T01:08:53.605253+0000","last_became_active":"2024-09-12T00:30:13.127577+0000","last_became_peered":"2024-09-12T00:30:13.127577+0000","last_unstale":"2024-09-12T01:08:53.605253+0000","last_undegraded":"2024-09-12T01:08:53.605253+0000","last_fullsized":"2024-09-12T01:08:53.605253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:40.499246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":367,"num_write":144,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'311","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.095067+0000","last_change":"2024-09-12T01:11:35.095067+0000","last_active":"2024-09-12T01:11:35.095067+0000","last_peered":"2024-09-12T01:11:35.095067+0000","last_clean":"2024-09-12T01:11:35.095067+0000","last_became_active":"2024-09-12T00:30:11.091860+0000","last_became_peered":"2024-09-12T00:30:11.091860+0000","last_unstale":"2024-09-12T01:11:35.095067+0000","last_undegraded":"2024-09-12T01:11:35.095067+0000","last_fullsized":"2024-09-12T01:11:35.095067+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T01:11:35.094942+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T01:11:35.094942+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.094942+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:31.385294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":88630,"num_write":981,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.510119+0000","last_change":"2024-09-12T00:30:15.130476+0000","last_active":"2024-09-12T01:07:42.510119+0000","last_peered":"2024-09-12T01:07:42.510119+0000","last_clean":"2024-09-12T01:07:42.510119+0000","last_became_active":"2024-09-12T00:30:15.130254+0000","last_became_peered":"2024-09-12T00:30:15.130254+0000","last_unstale":"2024-09-12T01:07:42.510119+0000","last_undegraded":"2024-09-12T01:07:42.510119+0000","last_fullsized":"2024-09-12T01:07:42.510119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.906448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'108","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.183586+0000","last_change":"2024-09-12T00:30:17.148717+0000","last_active":"2024-09-12T01:10:26.183586+0000","last_peered":"2024-09-12T01:10:26.183586+0000","last_clean":"2024-09-12T01:10:26.183586+0000","last_became_active":"2024-09-12T00:30:17.148422+0000","last_became_peered":"2024-09-12T00:30:17.148422+0000","last_unstale":"2024-09-12T01:10:26.183586+0000","last_undegraded":"2024-09-12T01:10:26.183586+0000","last_fullsized":"2024-09-12T01:10:26.183586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:54.544557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":99,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409940+0000","last_change":"2024-09-12T00:30:19.163744+0000","last_active":"2024-09-12T01:08:58.409940+0000","last_peered":"2024-09-12T01:08:58.409940+0000","last_clean":"2024-09-12T01:08:58.409940+0000","last_became_active":"2024-09-12T00:30:19.163363+0000","last_became_peered":"2024-09-12T00:30:19.163363+0000","last_unstale":"2024-09-12T01:08:58.409940+0000","last_undegraded":"2024-09-12T01:08:58.409940+0000","last_fullsized":"2024-09-12T01:08:58.409940+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:34.458854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'134","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.285173+0000","last_change":"2024-09-12T00:30:21.180741+0000","last_active":"2024-09-12T01:09:46.285173+0000","last_peered":"2024-09-12T01:09:46.285173+0000","last_clean":"2024-09-12T01:09:46.285173+0000","last_became_active":"2024-09-12T00:30:21.180419+0000","last_became_peered":"2024-09-12T00:30:21.180419+0000","last_unstale":"2024-09-12T01:09:46.285173+0000","last_undegraded":"2024-09-12T01:09:46.285173+0000","last_fullsized":"2024-09-12T01:09:46.285173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.115939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":136,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'120","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.315178+0000","last_change":"2024-09-12T01:11:47.315178+0000","last_active":"2024-09-12T01:11:47.315178+0000","last_peered":"2024-09-12T01:11:47.315178+0000","last_clean":"2024-09-12T01:11:47.315178+0000","last_became_active":"2024-09-12T00:30:13.126531+0000","last_became_peered":"2024-09-12T00:30:13.126531+0000","last_unstale":"2024-09-12T01:11:47.315178+0000","last_undegraded":"2024-09-12T01:11:47.315178+0000","last_fullsized":"2024-09-12T01:11:47.315178+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T01:11:47.315083+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T01:11:47.315083+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.315083+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:02.492593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":438,"num_write":171,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'350","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.902895+0000","last_change":"2024-09-12T01:11:40.902895+0000","last_active":"2024-09-12T01:11:40.902895+0000","last_peered":"2024-09-12T01:11:40.902895+0000","last_clean":"2024-09-12T01:11:40.902895+0000","last_became_active":"2024-09-12T00:30:11.110001+0000","last_became_peered":"2024-09-12T00:30:11.110001+0000","last_unstale":"2024-09-12T01:11:40.902895+0000","last_undegraded":"2024-09-12T01:11:40.902895+0000","last_fullsized":"2024-09-12T01:11:40.902895+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T01:11:40.902786+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T01:11:40.902786+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.902786+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:44.491567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371860,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":4100,"num_write":1032,"num_write_kb":26242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.520792+0000","last_change":"2024-09-12T00:30:15.126005+0000","last_active":"2024-09-12T01:08:57.520792+0000","last_peered":"2024-09-12T01:08:57.520792+0000","last_clean":"2024-09-12T01:08:57.520792+0000","last_became_active":"2024-09-12T00:30:15.125728+0000","last_became_peered":"2024-09-12T00:30:15.125728+0000","last_unstale":"2024-09-12T01:08:57.520792+0000","last_undegraded":"2024-09-12T01:08:57.520792+0000","last_fullsized":"2024-09-12T01:08:57.520792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:00.586425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'145","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.201330+0000","last_change":"2024-09-12T00:30:17.145113+0000","last_active":"2024-09-12T01:10:26.201330+0000","last_peered":"2024-09-12T01:10:26.201330+0000","last_clean":"2024-09-12T01:10:26.201330+0000","last_became_active":"2024-09-12T00:30:17.144701+0000","last_became_peered":"2024-09-12T00:30:17.144701+0000","last_unstale":"2024-09-12T01:10:26.201330+0000","last_undegraded":"2024-09-12T01:10:26.201330+0000","last_fullsized":"2024-09-12T01:10:26.201330+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:20.054774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":141,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'777","reported_seq":2316,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.343925+0000","last_change":"2024-09-12T00:30:19.170912+0000","last_active":"2024-09-12T01:11:24.343925+0000","last_peered":"2024-09-12T01:11:24.343925+0000","last_clean":"2024-09-12T01:11:24.343925+0000","last_became_active":"2024-09-12T00:30:19.170568+0000","last_became_peered":"2024-09-12T00:30:19.170568+0000","last_unstale":"2024-09-12T01:11:24.343925+0000","last_undegraded":"2024-09-12T01:11:24.343925+0000","last_fullsized":"2024-09-12T01:11:24.343925+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:09.164786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'212","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.922971+0000","last_change":"2024-09-12T00:30:21.188577+0000","last_active":"2024-09-12T01:09:46.922971+0000","last_peered":"2024-09-12T01:09:46.922971+0000","last_clean":"2024-09-12T01:09:46.922971+0000","last_became_active":"2024-09-12T00:30:21.188312+0000","last_became_peered":"2024-09-12T00:30:21.188312+0000","last_unstale":"2024-09-12T01:09:46.922971+0000","last_undegraded":"2024-09-12T01:09:46.922971+0000","last_fullsized":"2024-09-12T01:09:46.922971+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:02.003043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":596,"num_write":468,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'84","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.925453+0000","last_change":"2024-09-12T00:30:13.128485+0000","last_active":"2024-09-12T01:09:10.925453+0000","last_peered":"2024-09-12T01:09:10.925453+0000","last_clean":"2024-09-12T01:09:10.925453+0000","last_became_active":"2024-09-12T00:30:13.125323+0000","last_became_peered":"2024-09-12T00:30:13.125323+0000","last_unstale":"2024-09-12T01:09:10.925453+0000","last_undegraded":"2024-09-12T01:09:10.925453+0000","last_fullsized":"2024-09-12T01:09:10.925453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:35.611738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":383,"num_read_kb":333,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'407","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.820266+0000","last_change":"2024-09-12T01:11:30.820266+0000","last_active":"2024-09-12T01:11:30.820266+0000","last_peered":"2024-09-12T01:11:30.820266+0000","last_clean":"2024-09-12T01:11:30.820266+0000","last_became_active":"2024-09-12T00:30:11.101745+0000","last_became_peered":"2024-09-12T00:30:11.101745+0000","last_unstale":"2024-09-12T01:11:30.820266+0000","last_undegraded":"2024-09-12T01:11:30.820266+0000","last_fullsized":"2024-09-12T01:11:30.820266+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T01:11:30.820135+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T01:11:30.820135+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.820135+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:48.119318+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":23420,"num_write":1255,"num_write_kb":19418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.605977+0000","last_change":"2024-09-12T00:30:15.124922+0000","last_active":"2024-09-12T01:08:58.605977+0000","last_peered":"2024-09-12T01:08:58.605977+0000","last_clean":"2024-09-12T01:08:58.605977+0000","last_became_active":"2024-09-12T00:30:15.124597+0000","last_became_peered":"2024-09-12T00:30:15.124597+0000","last_unstale":"2024-09-12T01:08:58.605977+0000","last_undegraded":"2024-09-12T01:08:58.605977+0000","last_fullsized":"2024-09-12T01:08:58.605977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:33.763481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'266","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.322995+0000","last_change":"2024-09-12T01:11:48.322995+0000","last_active":"2024-09-12T01:11:48.322995+0000","last_peered":"2024-09-12T01:11:48.322995+0000","last_clean":"2024-09-12T01:11:48.322995+0000","last_became_active":"2024-09-12T00:30:17.145866+0000","last_became_peered":"2024-09-12T00:30:17.145866+0000","last_unstale":"2024-09-12T01:11:48.322995+0000","last_undegraded":"2024-09-12T01:11:48.322995+0000","last_fullsized":"2024-09-12T01:11:48.322995+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T01:11:48.322893+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T01:11:48.322893+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.322893+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:17.414187+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47562,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":1006,"num_write":354,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'802","reported_seq":2260,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.376695+0000","last_change":"2024-09-12T00:30:19.172788+0000","last_active":"2024-09-12T01:11:24.376695+0000","last_peered":"2024-09-12T01:11:24.376695+0000","last_clean":"2024-09-12T01:11:24.376695+0000","last_became_active":"2024-09-12T00:30:19.172403+0000","last_became_peered":"2024-09-12T00:30:19.172403+0000","last_unstale":"2024-09-12T01:11:24.376695+0000","last_undegraded":"2024-09-12T01:11:24.376695+0000","last_fullsized":"2024-09-12T01:11:24.376695+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:18.079531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'133","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.840668+0000","last_change":"2024-09-12T01:11:46.840668+0000","last_active":"2024-09-12T01:11:46.840668+0000","last_peered":"2024-09-12T01:11:46.840668+0000","last_clean":"2024-09-12T01:11:46.840668+0000","last_became_active":"2024-09-12T00:30:13.120524+0000","last_became_peered":"2024-09-12T00:30:13.120524+0000","last_unstale":"2024-09-12T01:11:46.840668+0000","last_undegraded":"2024-09-12T01:11:46.840668+0000","last_fullsized":"2024-09-12T01:11:46.840668+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-09-12T01:11:46.840552+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-09-12T01:11:46.840552+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.840552+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:14.214542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":538,"num_write":190,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3594,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'385","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.397564+0000","last_change":"2024-09-12T01:11:31.397564+0000","last_active":"2024-09-12T01:11:31.397564+0000","last_peered":"2024-09-12T01:11:31.397564+0000","last_clean":"2024-09-12T01:11:31.397564+0000","last_became_active":"2024-09-12T00:30:11.105769+0000","last_became_peered":"2024-09-12T00:30:11.105769+0000","last_unstale":"2024-09-12T01:11:31.397564+0000","last_undegraded":"2024-09-12T01:11:31.397564+0000","last_fullsized":"2024-09-12T01:11:31.397564+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T01:11:31.397440+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T01:11:31.397440+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.397440+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:46.946497+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8955677,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":22715,"num_write":1115,"num_write_kb":62157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.860393+0000","last_change":"2024-09-12T01:11:43.860393+0000","last_active":"2024-09-12T01:11:43.860393+0000","last_peered":"2024-09-12T01:11:43.860393+0000","last_clean":"2024-09-12T01:11:43.860393+0000","last_became_active":"2024-09-12T00:30:15.132719+0000","last_became_peered":"2024-09-12T00:30:15.132719+0000","last_unstale":"2024-09-12T01:11:43.860393+0000","last_undegraded":"2024-09-12T01:11:43.860393+0000","last_fullsized":"2024-09-12T01:11:43.860393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:43.860305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:43.860305+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.860305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:54.848289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'359","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.074111+0000","last_change":"2024-09-12T00:30:17.146741+0000","last_active":"2024-09-12T01:11:24.074111+0000","last_peered":"2024-09-12T01:11:24.074111+0000","last_clean":"2024-09-12T01:11:24.074111+0000","last_became_active":"2024-09-12T00:30:17.146465+0000","last_became_peered":"2024-09-12T00:30:17.146465+0000","last_unstale":"2024-09-12T01:11:24.074111+0000","last_undegraded":"2024-09-12T01:11:24.074111+0000","last_fullsized":"2024-09-12T01:11:24.074111+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45471,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":600,"num_read_kb":1250,"num_write":474,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:37.388200+0000","last_change":"2024-09-12T00:30:19.164620+0000","last_active":"2024-09-12T01:08:37.388200+0000","last_peered":"2024-09-12T01:08:37.388200+0000","last_clean":"2024-09-12T01:08:37.388200+0000","last_became_active":"2024-09-12T00:30:19.164249+0000","last_became_peered":"2024-09-12T00:30:19.164249+0000","last_unstale":"2024-09-12T01:08:37.388200+0000","last_undegraded":"2024-09-12T01:08:37.388200+0000","last_fullsized":"2024-09-12T01:08:37.388200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.473748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'544","reported_seq":1352,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490700+0000","last_change":"2024-09-12T00:30:21.189555+0000","last_active":"2024-09-12T01:10:51.490700+0000","last_peered":"2024-09-12T01:10:51.490700+0000","last_clean":"2024-09-12T01:10:51.490700+0000","last_became_active":"2024-09-12T00:30:21.189156+0000","last_became_peered":"2024-09-12T00:30:21.189156+0000","last_unstale":"2024-09-12T01:10:51.490700+0000","last_undegraded":"2024-09-12T01:10:51.490700+0000","last_fullsized":"2024-09-12T01:10:51.490700+0000","mapping_epoch":36,"log_start":"264'500","ondisk_log_start":"264'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:44.394203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1309,"num_read_kb":1298,"num_write":1161,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'143","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.841516+0000","last_change":"2024-09-12T01:11:34.841516+0000","last_active":"2024-09-12T01:11:34.841516+0000","last_peered":"2024-09-12T01:11:34.841516+0000","last_clean":"2024-09-12T01:11:34.841516+0000","last_became_active":"2024-09-12T00:30:13.124006+0000","last_became_peered":"2024-09-12T00:30:13.124006+0000","last_unstale":"2024-09-12T01:11:34.841516+0000","last_undegraded":"2024-09-12T01:11:34.841516+0000","last_fullsized":"2024-09-12T01:11:34.841516+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-09-12T01:11:34.841433+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-09-12T01:11:34.841433+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.841433+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:22.429642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":534,"num_write":203,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'416","reported_seq":1230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.346226+0000","last_change":"2024-09-12T01:11:30.346226+0000","last_active":"2024-09-12T01:11:30.346226+0000","last_peered":"2024-09-12T01:11:30.346226+0000","last_clean":"2024-09-12T01:11:30.346226+0000","last_became_active":"2024-09-12T00:30:11.104314+0000","last_became_peered":"2024-09-12T00:30:11.104314+0000","last_unstale":"2024-09-12T01:11:30.346226+0000","last_undegraded":"2024-09-12T01:11:30.346226+0000","last_fullsized":"2024-09-12T01:11:30.346226+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.346090+0000","objects_scrubbed":12,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:23.118149+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496547,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":809,"num_read_kb":45639,"num_write":1542,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.086776+0000","last_change":"2024-09-12T01:11:45.086776+0000","last_active":"2024-09-12T01:11:45.086776+0000","last_peered":"2024-09-12T01:11:45.086776+0000","last_clean":"2024-09-12T01:11:45.086776+0000","last_became_active":"2024-09-12T00:30:15.125380+0000","last_became_peered":"2024-09-12T00:30:15.125380+0000","last_unstale":"2024-09-12T01:11:45.086776+0000","last_undegraded":"2024-09-12T01:11:45.086776+0000","last_fullsized":"2024-09-12T01:11:45.086776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.086679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.086679+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.086679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.313099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'253","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.688748+0000","last_change":"2024-09-12T00:30:17.146917+0000","last_active":"2024-09-12T01:11:22.688748+0000","last_peered":"2024-09-12T01:11:22.688748+0000","last_clean":"2024-09-12T01:11:22.688748+0000","last_became_active":"2024-09-12T00:30:17.145155+0000","last_became_peered":"2024-09-12T00:30:17.145155+0000","last_unstale":"2024-09-12T01:11:22.688748+0000","last_undegraded":"2024-09-12T01:11:22.688748+0000","last_fullsized":"2024-09-12T01:11:22.688748+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.615595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53484,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":958,"num_write":338,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.525016+0000","last_change":"2024-09-12T00:30:19.171499+0000","last_active":"2024-09-12T01:09:27.525016+0000","last_peered":"2024-09-12T01:09:27.525016+0000","last_clean":"2024-09-12T01:09:27.525016+0000","last_became_active":"2024-09-12T00:30:19.171189+0000","last_became_peered":"2024-09-12T00:30:19.171189+0000","last_unstale":"2024-09-12T01:09:27.525016+0000","last_undegraded":"2024-09-12T01:09:27.525016+0000","last_fullsized":"2024-09-12T01:09:27.525016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2414","reported_seq":4278,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.417930+0000","last_change":"2024-09-12T00:30:21.184001+0000","last_active":"2024-09-12T01:10:08.417930+0000","last_peered":"2024-09-12T01:10:08.417930+0000","last_clean":"2024-09-12T01:10:08.417930+0000","last_became_active":"2024-09-12T00:30:21.183561+0000","last_became_peered":"2024-09-12T00:30:21.183561+0000","last_unstale":"2024-09-12T01:10:08.417930+0000","last_undegraded":"2024-09-12T01:10:08.417930+0000","last_fullsized":"2024-09-12T01:10:08.417930+0000","mapping_epoch":36,"log_start":"264'2400","ondisk_log_start":"264'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":2400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:10.831146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6196,"num_read_kb":6147,"num_write":4885,"num_write_kb":1795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'180","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.419931+0000","last_change":"2024-09-12T01:11:37.419931+0000","last_active":"2024-09-12T01:11:37.419931+0000","last_peered":"2024-09-12T01:11:37.419931+0000","last_clean":"2024-09-12T01:11:37.419931+0000","last_became_active":"2024-09-12T00:30:13.122098+0000","last_became_peered":"2024-09-12T00:30:13.122098+0000","last_unstale":"2024-09-12T01:11:37.419931+0000","last_undegraded":"2024-09-12T01:11:37.419931+0000","last_fullsized":"2024-09-12T01:11:37.419931+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T01:11:37.419846+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T01:11:37.419846+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.419846+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:33.172289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":634,"num_write":261,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'304","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.852338+0000","last_change":"2024-09-12T01:11:35.852338+0000","last_active":"2024-09-12T01:11:35.852338+0000","last_peered":"2024-09-12T01:11:35.852338+0000","last_clean":"2024-09-12T01:11:35.852338+0000","last_became_active":"2024-09-12T00:30:11.112302+0000","last_became_peered":"2024-09-12T00:30:11.112302+0000","last_unstale":"2024-09-12T01:11:35.852338+0000","last_undegraded":"2024-09-12T01:11:35.852338+0000","last_fullsized":"2024-09-12T01:11:35.852338+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-12T01:11:35.852227+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-12T01:11:35.852227+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.852227+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:03.092960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":10144,"num_write":972,"num_write_kb":18823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476007+0000","last_change":"2024-09-12T00:30:15.129726+0000","last_active":"2024-09-12T01:08:32.476007+0000","last_peered":"2024-09-12T01:08:32.476007+0000","last_clean":"2024-09-12T01:08:32.476007+0000","last_became_active":"2024-09-12T00:30:15.129311+0000","last_became_peered":"2024-09-12T00:30:15.129311+0000","last_unstale":"2024-09-12T01:08:32.476007+0000","last_undegraded":"2024-09-12T01:08:32.476007+0000","last_fullsized":"2024-09-12T01:08:32.476007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.755744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'305","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.212913+0000","last_change":"2024-09-12T00:30:17.147414+0000","last_active":"2024-09-12T01:11:24.212913+0000","last_peered":"2024-09-12T01:11:24.212913+0000","last_clean":"2024-09-12T01:11:24.212913+0000","last_became_active":"2024-09-12T00:30:17.147148+0000","last_became_peered":"2024-09-12T00:30:17.147148+0000","last_unstale":"2024-09-12T01:11:24.212913+0000","last_undegraded":"2024-09-12T01:11:24.212913+0000","last_fullsized":"2024-09-12T01:11:24.212913+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:05.230391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47594,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":517,"num_read_kb":1147,"num_write":414,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'802","reported_seq":2330,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.875963+0000","last_change":"2024-09-12T00:30:19.168748+0000","last_active":"2024-09-12T01:11:24.875963+0000","last_peered":"2024-09-12T01:11:24.875963+0000","last_clean":"2024-09-12T01:11:24.875963+0000","last_became_active":"2024-09-12T00:30:19.168419+0000","last_became_peered":"2024-09-12T00:30:19.168419+0000","last_unstale":"2024-09-12T01:11:24.875963+0000","last_undegraded":"2024-09-12T01:11:24.875963+0000","last_fullsized":"2024-09-12T01:11:24.875963+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'162","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.305353+0000","last_change":"2024-09-12T00:30:21.179851+0000","last_active":"2024-09-12T01:10:50.305353+0000","last_peered":"2024-09-12T01:10:50.305353+0000","last_clean":"2024-09-12T01:10:50.305353+0000","last_became_active":"2024-09-12T00:30:21.179533+0000","last_became_peered":"2024-09-12T00:30:21.179533+0000","last_unstale":"2024-09-12T01:10:50.305353+0000","last_undegraded":"2024-09-12T01:10:50.305353+0000","last_fullsized":"2024-09-12T01:10:50.305353+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":87,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'98","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.293986+0000","last_change":"2024-09-12T01:11:46.293986+0000","last_active":"2024-09-12T01:11:46.293986+0000","last_peered":"2024-09-12T01:11:46.293986+0000","last_clean":"2024-09-12T01:11:46.293986+0000","last_became_active":"2024-09-12T00:30:13.131423+0000","last_became_peered":"2024-09-12T00:30:13.131423+0000","last_unstale":"2024-09-12T01:11:46.293986+0000","last_undegraded":"2024-09-12T01:11:46.293986+0000","last_fullsized":"2024-09-12T01:11:46.293986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'98","last_scrub_stamp":"2024-09-12T01:11:46.293901+0000","last_deep_scrub":"264'98","last_deep_scrub_stamp":"2024-09-12T01:11:46.293901+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.293901+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:41.760950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":366,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'380","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.402539+0000","last_change":"2024-09-12T01:11:33.402539+0000","last_active":"2024-09-12T01:11:33.402539+0000","last_peered":"2024-09-12T01:11:33.402539+0000","last_clean":"2024-09-12T01:11:33.402539+0000","last_became_active":"2024-09-12T00:30:11.103285+0000","last_became_peered":"2024-09-12T00:30:11.103285+0000","last_unstale":"2024-09-12T01:11:33.402539+0000","last_undegraded":"2024-09-12T01:11:33.402539+0000","last_fullsized":"2024-09-12T01:11:33.402539+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-12T01:11:33.402382+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-12T01:11:33.402382+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.402382+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:57.850138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":3264,"num_write":1093,"num_write_kb":35970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.102852+0000","last_change":"2024-09-12T01:11:46.102852+0000","last_active":"2024-09-12T01:11:46.102852+0000","last_peered":"2024-09-12T01:11:46.102852+0000","last_clean":"2024-09-12T01:11:46.102852+0000","last_became_active":"2024-09-12T00:30:15.132695+0000","last_became_peered":"2024-09-12T00:30:15.132695+0000","last_unstale":"2024-09-12T01:11:46.102852+0000","last_undegraded":"2024-09-12T01:11:46.102852+0000","last_fullsized":"2024-09-12T01:11:46.102852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.102769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.102769+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.102769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:16.249060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'457","reported_seq":1090,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.348642+0000","last_change":"2024-09-12T00:30:17.147365+0000","last_active":"2024-09-12T01:11:24.348642+0000","last_peered":"2024-09-12T01:11:24.348642+0000","last_clean":"2024-09-12T01:11:24.348642+0000","last_became_active":"2024-09-12T00:30:17.147015+0000","last_became_peered":"2024-09-12T00:30:17.147015+0000","last_unstale":"2024-09-12T01:11:24.348642+0000","last_undegraded":"2024-09-12T01:11:24.348642+0000","last_fullsized":"2024-09-12T01:11:24.348642+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.499988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69788,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":1853,"num_write":630,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.483664+0000","last_change":"2024-09-12T00:30:19.167774+0000","last_active":"2024-09-12T01:09:22.483664+0000","last_peered":"2024-09-12T01:09:22.483664+0000","last_clean":"2024-09-12T01:09:22.483664+0000","last_became_active":"2024-09-12T00:30:19.167503+0000","last_became_peered":"2024-09-12T00:30:19.167503+0000","last_unstale":"2024-09-12T01:09:22.483664+0000","last_undegraded":"2024-09-12T01:09:22.483664+0000","last_fullsized":"2024-09-12T01:09:22.483664+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'96","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.492061+0000","last_change":"2024-09-12T00:30:21.192974+0000","last_active":"2024-09-12T01:10:51.492061+0000","last_peered":"2024-09-12T01:10:51.492061+0000","last_clean":"2024-09-12T01:10:51.492061+0000","last_became_active":"2024-09-12T00:30:21.192700+0000","last_became_peered":"2024-09-12T00:30:21.192700+0000","last_unstale":"2024-09-12T01:10:51.492061+0000","last_undegraded":"2024-09-12T01:10:51.492061+0000","last_fullsized":"2024-09-12T01:10:51.492061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":205,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'119","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.435937+0000","last_change":"2024-09-12T01:11:38.435937+0000","last_active":"2024-09-12T01:11:38.435937+0000","last_peered":"2024-09-12T01:11:38.435937+0000","last_clean":"2024-09-12T01:11:38.435937+0000","last_became_active":"2024-09-12T00:30:13.128253+0000","last_became_peered":"2024-09-12T00:30:13.128253+0000","last_unstale":"2024-09-12T01:11:38.435937+0000","last_undegraded":"2024-09-12T01:11:38.435937+0000","last_fullsized":"2024-09-12T01:11:38.435937+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T01:11:38.435862+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T01:11:38.435862+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.435862+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.099253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":431,"num_write":189,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'311","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.492446+0000","last_change":"2024-09-12T01:11:33.492446+0000","last_active":"2024-09-12T01:11:33.492446+0000","last_peered":"2024-09-12T01:11:33.492446+0000","last_clean":"2024-09-12T01:11:33.492446+0000","last_became_active":"2024-09-12T00:30:11.100056+0000","last_became_peered":"2024-09-12T00:30:11.100056+0000","last_unstale":"2024-09-12T01:11:33.492446+0000","last_undegraded":"2024-09-12T01:11:33.492446+0000","last_fullsized":"2024-09-12T01:11:33.492446+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T01:11:33.492354+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T01:11:33.492354+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.492354+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:25.053401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":62849,"num_write":1084,"num_write_kb":31335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.557200+0000","last_change":"2024-09-12T01:11:47.557200+0000","last_active":"2024-09-12T01:11:47.557200+0000","last_peered":"2024-09-12T01:11:47.557200+0000","last_clean":"2024-09-12T01:11:47.557200+0000","last_became_active":"2024-09-12T00:30:15.132801+0000","last_became_peered":"2024-09-12T00:30:15.132801+0000","last_unstale":"2024-09-12T01:11:47.557200+0000","last_undegraded":"2024-09-12T01:11:47.557200+0000","last_fullsized":"2024-09-12T01:11:47.557200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.557077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.557077+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.557077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:33.239839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'293","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.966157+0000","last_change":"2024-09-12T00:30:17.149925+0000","last_active":"2024-09-12T01:11:22.966157+0000","last_peered":"2024-09-12T01:11:22.966157+0000","last_clean":"2024-09-12T01:11:22.966157+0000","last_became_active":"2024-09-12T00:30:17.149603+0000","last_became_peered":"2024-09-12T00:30:17.149603+0000","last_unstale":"2024-09-12T01:11:22.966157+0000","last_undegraded":"2024-09-12T01:11:22.966157+0000","last_fullsized":"2024-09-12T01:11:22.966157+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.420246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57292,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":510,"num_read_kb":1117,"num_write":456,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.387057+0000","last_change":"2024-09-12T00:30:19.168486+0000","last_active":"2024-09-12T01:08:38.387057+0000","last_peered":"2024-09-12T01:08:38.387057+0000","last_clean":"2024-09-12T01:08:38.387057+0000","last_became_active":"2024-09-12T00:30:19.168223+0000","last_became_peered":"2024-09-12T00:30:19.168223+0000","last_unstale":"2024-09-12T01:08:38.387057+0000","last_undegraded":"2024-09-12T01:08:38.387057+0000","last_fullsized":"2024-09-12T01:08:38.387057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.132937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'123","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:27.493758+0000","last_change":"2024-09-12T00:30:21.192816+0000","last_active":"2024-09-12T01:10:27.493758+0000","last_peered":"2024-09-12T01:10:27.493758+0000","last_clean":"2024-09-12T01:10:27.493758+0000","last_became_active":"2024-09-12T00:30:21.192509+0000","last_became_peered":"2024-09-12T00:30:21.192509+0000","last_unstale":"2024-09-12T01:10:27.493758+0000","last_undegraded":"2024-09-12T01:10:27.493758+0000","last_fullsized":"2024-09-12T01:10:27.493758+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:26.935855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'134","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.147039+0000","last_change":"2024-09-12T00:30:13.123694+0000","last_active":"2024-09-12T01:09:32.147039+0000","last_peered":"2024-09-12T01:09:32.147039+0000","last_clean":"2024-09-12T01:09:32.147039+0000","last_became_active":"2024-09-12T00:30:13.123412+0000","last_became_peered":"2024-09-12T00:30:13.123412+0000","last_unstale":"2024-09-12T01:09:32.147039+0000","last_undegraded":"2024-09-12T01:09:32.147039+0000","last_fullsized":"2024-09-12T01:09:32.147039+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:23.159421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":514,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'283","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.891985+0000","last_change":"2024-09-12T01:11:37.891985+0000","last_active":"2024-09-12T01:11:37.891985+0000","last_peered":"2024-09-12T01:11:37.891985+0000","last_clean":"2024-09-12T01:11:37.891985+0000","last_became_active":"2024-09-12T00:30:11.097902+0000","last_became_peered":"2024-09-12T00:30:11.097902+0000","last_unstale":"2024-09-12T01:11:37.891985+0000","last_undegraded":"2024-09-12T01:11:37.891985+0000","last_fullsized":"2024-09-12T01:11:37.891985+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T01:11:37.891780+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T01:11:37.891780+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.891780+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:26.776654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170421,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":17154,"num_write":985,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.476034+0000","last_change":"2024-09-12T00:30:15.125920+0000","last_active":"2024-09-12T01:08:32.476034+0000","last_peered":"2024-09-12T01:08:32.476034+0000","last_clean":"2024-09-12T01:08:32.476034+0000","last_became_active":"2024-09-12T00:30:15.125629+0000","last_became_peered":"2024-09-12T00:30:15.125629+0000","last_unstale":"2024-09-12T01:08:32.476034+0000","last_undegraded":"2024-09-12T01:08:32.476034+0000","last_fullsized":"2024-09-12T01:08:32.476034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:47.978464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'283","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.777898+0000","last_change":"2024-09-12T00:30:17.149967+0000","last_active":"2024-09-12T01:11:24.777898+0000","last_peered":"2024-09-12T01:11:24.777898+0000","last_clean":"2024-09-12T01:11:24.777898+0000","last_became_active":"2024-09-12T00:30:17.149661+0000","last_became_peered":"2024-09-12T00:30:17.149661+0000","last_unstale":"2024-09-12T01:11:24.777898+0000","last_undegraded":"2024-09-12T01:11:24.777898+0000","last_fullsized":"2024-09-12T01:11:24.777898+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:40.653446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59535,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":1016,"num_write":372,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'762","reported_seq":2257,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.507613+0000","last_change":"2024-09-12T00:30:19.167751+0000","last_active":"2024-09-12T01:11:22.507613+0000","last_peered":"2024-09-12T01:11:22.507613+0000","last_clean":"2024-09-12T01:11:22.507613+0000","last_became_active":"2024-09-12T00:30:19.167476+0000","last_became_peered":"2024-09-12T00:30:19.167476+0000","last_unstale":"2024-09-12T01:11:22.507613+0000","last_undegraded":"2024-09-12T01:11:22.507613+0000","last_fullsized":"2024-09-12T01:11:22.507613+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:15.217938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'158","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:14.465466+0000","last_change":"2024-09-12T00:30:21.187022+0000","last_active":"2024-09-12T01:08:14.465466+0000","last_peered":"2024-09-12T01:08:14.465466+0000","last_clean":"2024-09-12T01:08:14.465466+0000","last_became_active":"2024-09-12T00:30:21.185553+0000","last_became_peered":"2024-09-12T00:30:21.185553+0000","last_unstale":"2024-09-12T01:08:14.465466+0000","last_undegraded":"2024-09-12T01:08:14.465466+0000","last_fullsized":"2024-09-12T01:08:14.465466+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:17.382517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":222,"num_write":391,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'167","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.347977+0000","last_change":"2024-09-12T01:11:40.347977+0000","last_active":"2024-09-12T01:11:40.347977+0000","last_peered":"2024-09-12T01:11:40.347977+0000","last_clean":"2024-09-12T01:11:40.347977+0000","last_became_active":"2024-09-12T00:30:13.121664+0000","last_became_peered":"2024-09-12T00:30:13.121664+0000","last_unstale":"2024-09-12T01:11:40.347977+0000","last_undegraded":"2024-09-12T01:11:40.347977+0000","last_fullsized":"2024-09-12T01:11:40.347977+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-09-12T01:11:40.347879+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-09-12T01:11:40.347879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.347879+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:35.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":568,"num_write":259,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'538","reported_seq":1360,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.895438+0000","last_change":"2024-09-12T01:11:34.895438+0000","last_active":"2024-09-12T01:11:34.895438+0000","last_peered":"2024-09-12T01:11:34.895438+0000","last_clean":"2024-09-12T01:11:34.895438+0000","last_became_active":"2024-09-12T00:30:11.110370+0000","last_became_peered":"2024-09-12T00:30:11.110370+0000","last_unstale":"2024-09-12T01:11:34.895438+0000","last_undegraded":"2024-09-12T01:11:34.895438+0000","last_fullsized":"2024-09-12T01:11:34.895438+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'538","last_scrub_stamp":"2024-09-12T01:11:34.895276+0000","last_deep_scrub":"264'538","last_deep_scrub_stamp":"2024-09-12T01:11:34.895276+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.895276+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:45.682560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174759,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1243,"num_read_kb":75461,"num_write":1612,"num_write_kb":22075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1463,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.870320+0000","last_change":"2024-09-12T01:11:44.870320+0000","last_active":"2024-09-12T01:11:44.870320+0000","last_peered":"2024-09-12T01:11:44.870320+0000","last_clean":"2024-09-12T01:11:44.870320+0000","last_became_active":"2024-09-12T00:30:15.132802+0000","last_became_peered":"2024-09-12T00:30:15.132802+0000","last_unstale":"2024-09-12T01:11:44.870320+0000","last_undegraded":"2024-09-12T01:11:44.870320+0000","last_fullsized":"2024-09-12T01:11:44.870320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:11:44.870207+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:11:44.870207+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.870207+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:45.970093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'74","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.169269+0000","last_change":"2024-09-12T00:30:17.148149+0000","last_active":"2024-09-12T01:10:26.169269+0000","last_peered":"2024-09-12T01:10:26.169269+0000","last_clean":"2024-09-12T01:10:26.169269+0000","last_became_active":"2024-09-12T00:30:17.147864+0000","last_became_peered":"2024-09-12T00:30:17.147864+0000","last_unstale":"2024-09-12T01:10:26.169269+0000","last_undegraded":"2024-09-12T01:10:26.169269+0000","last_fullsized":"2024-09-12T01:10:26.169269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.850618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'783","reported_seq":2334,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.508524+0000","last_change":"2024-09-12T00:30:19.169220+0000","last_active":"2024-09-12T01:11:22.508524+0000","last_peered":"2024-09-12T01:11:22.508524+0000","last_clean":"2024-09-12T01:11:22.508524+0000","last_became_active":"2024-09-12T00:30:19.168960+0000","last_became_peered":"2024-09-12T00:30:19.168960+0000","last_unstale":"2024-09-12T01:11:22.508524+0000","last_undegraded":"2024-09-12T01:11:22.508524+0000","last_fullsized":"2024-09-12T01:11:22.508524+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:05.977565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'119","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.244027+0000","last_change":"2024-09-12T00:30:21.186976+0000","last_active":"2024-09-12T01:08:47.244027+0000","last_peered":"2024-09-12T01:08:47.244027+0000","last_clean":"2024-09-12T01:08:47.244027+0000","last_became_active":"2024-09-12T00:30:21.185618+0000","last_became_peered":"2024-09-12T00:30:21.185618+0000","last_unstale":"2024-09-12T01:08:47.244027+0000","last_undegraded":"2024-09-12T01:08:47.244027+0000","last_fullsized":"2024-09-12T01:08:47.244027+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:37.276257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":151,"num_write":299,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":906,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.526779+0000","last_change":"2024-09-12T01:11:35.526779+0000","last_active":"2024-09-12T01:11:35.526779+0000","last_peered":"2024-09-12T01:11:35.526779+0000","last_clean":"2024-09-12T01:11:35.526779+0000","last_became_active":"2024-09-12T00:30:13.129892+0000","last_became_peered":"2024-09-12T00:30:13.129892+0000","last_unstale":"2024-09-12T01:11:35.526779+0000","last_undegraded":"2024-09-12T01:11:35.526779+0000","last_fullsized":"2024-09-12T01:11:35.526779+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T01:11:35.526685+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T01:11:35.526685+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.526685+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:59.274285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":984,"num_read_kb":836,"num_write":303,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'321","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.382246+0000","last_change":"2024-09-12T01:11:34.382246+0000","last_active":"2024-09-12T01:11:34.382246+0000","last_peered":"2024-09-12T01:11:34.382246+0000","last_clean":"2024-09-12T01:11:34.382246+0000","last_became_active":"2024-09-12T00:30:11.103195+0000","last_became_peered":"2024-09-12T00:30:11.103195+0000","last_unstale":"2024-09-12T01:11:34.382246+0000","last_undegraded":"2024-09-12T01:11:34.382246+0000","last_fullsized":"2024-09-12T01:11:34.382246+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T01:11:34.382128+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T01:11:34.382128+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.382128+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:39.745506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254394,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":8246,"num_write":945,"num_write_kb":41947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.602445+0000","last_change":"2024-09-12T00:30:15.128205+0000","last_active":"2024-09-12T01:08:33.602445+0000","last_peered":"2024-09-12T01:08:33.602445+0000","last_clean":"2024-09-12T01:08:33.602445+0000","last_became_active":"2024-09-12T00:30:15.127047+0000","last_became_peered":"2024-09-12T00:30:15.127047+0000","last_unstale":"2024-09-12T01:08:33.602445+0000","last_undegraded":"2024-09-12T01:08:33.602445+0000","last_fullsized":"2024-09-12T01:08:33.602445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:24.381773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'316","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.848686+0000","last_change":"2024-09-12T01:11:46.848686+0000","last_active":"2024-09-12T01:11:46.848686+0000","last_peered":"2024-09-12T01:11:46.848686+0000","last_clean":"2024-09-12T01:11:46.848686+0000","last_became_active":"2024-09-12T00:30:17.149579+0000","last_became_peered":"2024-09-12T00:30:17.149579+0000","last_unstale":"2024-09-12T01:11:46.848686+0000","last_undegraded":"2024-09-12T01:11:46.848686+0000","last_fullsized":"2024-09-12T01:11:46.848686+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T01:11:46.848586+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T01:11:46.848586+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.848586+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:28.252461+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":993,"num_write":388,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.363086+0000","last_change":"2024-09-12T01:11:51.363086+0000","last_active":"2024-09-12T01:11:51.363086+0000","last_peered":"2024-09-12T01:11:51.363086+0000","last_clean":"2024-09-12T01:11:51.363086+0000","last_became_active":"2024-09-12T00:30:19.169468+0000","last_became_peered":"2024-09-12T00:30:19.169468+0000","last_unstale":"2024-09-12T01:11:51.363086+0000","last_undegraded":"2024-09-12T01:11:51.363086+0000","last_fullsized":"2024-09-12T01:11:51.363086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.362984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.362984+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.362984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:04.867972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'111","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.875182+0000","last_change":"2024-09-12T00:30:21.184306+0000","last_active":"2024-09-12T01:09:46.875182+0000","last_peered":"2024-09-12T01:09:46.875182+0000","last_clean":"2024-09-12T01:09:46.875182+0000","last_became_active":"2024-09-12T00:30:21.184033+0000","last_became_peered":"2024-09-12T00:30:21.184033+0000","last_unstale":"2024-09-12T01:09:46.875182+0000","last_undegraded":"2024-09-12T01:09:46.875182+0000","last_fullsized":"2024-09-12T01:09:46.875182+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.799929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":266,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'245","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.861264+0000","last_change":"2024-09-12T01:11:47.861264+0000","last_active":"2024-09-12T01:11:47.861264+0000","last_peered":"2024-09-12T01:11:47.861264+0000","last_clean":"2024-09-12T01:11:47.861264+0000","last_became_active":"2024-09-12T00:30:13.120962+0000","last_became_peered":"2024-09-12T00:30:13.120962+0000","last_unstale":"2024-09-12T01:11:47.861264+0000","last_undegraded":"2024-09-12T01:11:47.861264+0000","last_fullsized":"2024-09-12T01:11:47.861264+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T01:11:47.861179+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T01:11:47.861179+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.861179+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:22.003599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":839,"num_write":403,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":617,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.846210+0000","last_change":"2024-09-12T01:11:29.846210+0000","last_active":"2024-09-12T01:11:29.846210+0000","last_peered":"2024-09-12T01:11:29.846210+0000","last_clean":"2024-09-12T01:11:29.846210+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T01:11:29.846210+0000","last_undegraded":"2024-09-12T01:11:29.846210+0000","last_fullsized":"2024-09-12T01:11:29.846210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T01:11:29.846146+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T01:11:29.846146+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.846146+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:43.920303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.905025+0000","last_change":"2024-09-12T01:11:30.904927+0000","last_active":"2024-09-12T01:11:30.905025+0000","last_peered":"2024-09-12T01:11:30.905025+0000","last_clean":"2024-09-12T01:11:30.905025+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T01:11:30.905025+0000","last_undegraded":"2024-09-12T01:11:30.905025+0000","last_fullsized":"2024-09-12T01:11:30.905025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:30.904805+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:30.904805+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.904805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:38.997041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'317","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.380726+0000","last_change":"2024-09-12T01:11:32.380726+0000","last_active":"2024-09-12T01:11:32.380726+0000","last_peered":"2024-09-12T01:11:32.380726+0000","last_clean":"2024-09-12T01:11:32.380726+0000","last_became_active":"2024-09-12T00:30:11.102144+0000","last_became_peered":"2024-09-12T00:30:11.102144+0000","last_unstale":"2024-09-12T01:11:32.380726+0000","last_undegraded":"2024-09-12T01:11:32.380726+0000","last_fullsized":"2024-09-12T01:11:32.380726+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T01:11:32.380545+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T01:11:32.380545+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.380545+0000","objects_scrubbed":12,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:59.777398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505108,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":430,"num_read_kb":17991,"num_write":985,"num_write_kb":40410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"264'4","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.366234+0000","last_change":"2024-09-12T01:11:42.366234+0000","last_active":"2024-09-12T01:11:42.366234+0000","last_peered":"2024-09-12T01:11:42.366234+0000","last_clean":"2024-09-12T01:11:42.366234+0000","last_became_active":"2024-09-12T00:30:15.132332+0000","last_became_peered":"2024-09-12T00:30:15.132332+0000","last_unstale":"2024-09-12T01:11:42.366234+0000","last_undegraded":"2024-09-12T01:11:42.366234+0000","last_fullsized":"2024-09-12T01:11:42.366234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:11:42.366139+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:11:42.366139+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.366139+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:39.262944+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'712","reported_seq":1407,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.638181+0000","last_change":"2024-09-12T00:30:17.150136+0000","last_active":"2024-09-12T01:11:24.638181+0000","last_peered":"2024-09-12T01:11:24.638181+0000","last_clean":"2024-09-12T01:11:24.638181+0000","last_became_active":"2024-09-12T00:30:17.149842+0000","last_became_peered":"2024-09-12T00:30:17.149842+0000","last_unstale":"2024-09-12T01:11:24.638181+0000","last_undegraded":"2024-09-12T01:11:24.638181+0000","last_fullsized":"2024-09-12T01:11:24.638181+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.362386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1403,"num_read_kb":3182,"num_write":1320,"num_write_kb":1183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.483807+0000","last_change":"2024-09-12T00:30:19.168459+0000","last_active":"2024-09-12T01:09:22.483807+0000","last_peered":"2024-09-12T01:09:22.483807+0000","last_clean":"2024-09-12T01:09:22.483807+0000","last_became_active":"2024-09-12T00:30:19.168219+0000","last_became_peered":"2024-09-12T00:30:19.168219+0000","last_unstale":"2024-09-12T01:09:22.483807+0000","last_undegraded":"2024-09-12T01:09:22.483807+0000","last_fullsized":"2024-09-12T01:09:22.483807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'214","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.824758+0000","last_change":"2024-09-12T00:30:21.192045+0000","last_active":"2024-09-12T01:09:46.824758+0000","last_peered":"2024-09-12T01:09:46.824758+0000","last_clean":"2024-09-12T01:09:46.824758+0000","last_became_active":"2024-09-12T00:30:21.191389+0000","last_became_peered":"2024-09-12T00:30:21.191389+0000","last_unstale":"2024-09-12T01:09:46.824758+0000","last_undegraded":"2024-09-12T01:09:46.824758+0000","last_fullsized":"2024-09-12T01:09:46.824758+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":544,"num_write":463,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'84","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.322102+0000","last_change":"2024-09-12T01:11:45.322102+0000","last_active":"2024-09-12T01:11:45.322102+0000","last_peered":"2024-09-12T01:11:45.322102+0000","last_clean":"2024-09-12T01:11:45.322102+0000","last_became_active":"2024-09-12T00:30:13.124407+0000","last_became_peered":"2024-09-12T00:30:13.124407+0000","last_unstale":"2024-09-12T01:11:45.322102+0000","last_undegraded":"2024-09-12T01:11:45.322102+0000","last_fullsized":"2024-09-12T01:11:45.322102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T01:11:45.322015+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T01:11:45.322015+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.322015+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:57.115441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":258,"num_write":150,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.850934+0000","last_change":"2024-09-12T01:11:36.850934+0000","last_active":"2024-09-12T01:11:36.850934+0000","last_peered":"2024-09-12T01:11:36.850934+0000","last_clean":"2024-09-12T01:11:36.850934+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T01:11:36.850934+0000","last_undegraded":"2024-09-12T01:11:36.850934+0000","last_fullsized":"2024-09-12T01:11:36.850934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.850849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.850849+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.850849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:50.093006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'385","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.093255+0000","last_change":"2024-09-12T01:11:32.093255+0000","last_active":"2024-09-12T01:11:32.093255+0000","last_peered":"2024-09-12T01:11:32.093255+0000","last_clean":"2024-09-12T01:11:32.093255+0000","last_became_active":"2024-09-12T00:30:11.099065+0000","last_became_peered":"2024-09-12T00:30:11.099065+0000","last_unstale":"2024-09-12T01:11:32.093255+0000","last_undegraded":"2024-09-12T01:11:32.093255+0000","last_fullsized":"2024-09-12T01:11:32.093255+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T01:11:32.093094+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T01:11:32.093094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.093094+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:51.292680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":8968,"num_write":1169,"num_write_kb":21800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:18.608995+0000","last_change":"2024-09-12T00:30:15.130834+0000","last_active":"2024-09-12T01:09:18.608995+0000","last_peered":"2024-09-12T01:09:18.608995+0000","last_clean":"2024-09-12T01:09:18.608995+0000","last_became_active":"2024-09-12T00:30:15.130490+0000","last_became_peered":"2024-09-12T00:30:15.130490+0000","last_unstale":"2024-09-12T01:09:18.608995+0000","last_undegraded":"2024-09-12T01:09:18.608995+0000","last_fullsized":"2024-09-12T01:09:18.608995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:41.519057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'1365","reported_seq":2801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.529275+0000","last_change":"2024-09-12T01:11:46.529275+0000","last_active":"2024-09-12T01:11:46.529275+0000","last_peered":"2024-09-12T01:11:46.529275+0000","last_clean":"2024-09-12T01:11:46.529275+0000","last_became_active":"2024-09-12T00:30:17.146374+0000","last_became_peered":"2024-09-12T00:30:17.146374+0000","last_unstale":"2024-09-12T01:11:46.529275+0000","last_undegraded":"2024-09-12T01:11:46.529275+0000","last_fullsized":"2024-09-12T01:11:46.529275+0000","mapping_epoch":32,"log_start":"264'1300","ondisk_log_start":"264'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1365","last_scrub_stamp":"2024-09-12T01:11:46.529145+0000","last_deep_scrub":"264'1365","last_deep_scrub_stamp":"2024-09-12T01:11:46.529145+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.529145+0000","objects_scrubbed":12,"log_size":65,"log_dups_size":1300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:23.834431+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162102,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2173,"num_read_kb":4252,"num_write":1262,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:53.597073+0000","last_change":"2024-09-12T00:30:19.169975+0000","last_active":"2024-09-12T01:07:53.597073+0000","last_peered":"2024-09-12T01:07:53.597073+0000","last_clean":"2024-09-12T01:07:53.597073+0000","last_became_active":"2024-09-12T00:30:19.169700+0000","last_became_peered":"2024-09-12T00:30:19.169700+0000","last_unstale":"2024-09-12T01:07:53.597073+0000","last_undegraded":"2024-09-12T01:07:53.597073+0000","last_fullsized":"2024-09-12T01:07:53.597073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:43.445292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'95","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.456529+0000","last_change":"2024-09-12T00:30:21.193756+0000","last_active":"2024-09-12T01:09:28.456529+0000","last_peered":"2024-09-12T01:09:28.456529+0000","last_clean":"2024-09-12T01:09:28.456529+0000","last_became_active":"2024-09-12T00:30:21.193491+0000","last_became_peered":"2024-09-12T00:30:21.193491+0000","last_unstale":"2024-09-12T01:09:28.456529+0000","last_undegraded":"2024-09-12T01:09:28.456529+0000","last_fullsized":"2024-09-12T01:09:28.456529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":108,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'102","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.003162+0000","last_change":"2024-09-12T01:11:41.003162+0000","last_active":"2024-09-12T01:11:41.003162+0000","last_peered":"2024-09-12T01:11:41.003162+0000","last_clean":"2024-09-12T01:11:41.003162+0000","last_became_active":"2024-09-12T00:30:13.124085+0000","last_became_peered":"2024-09-12T00:30:13.124085+0000","last_unstale":"2024-09-12T01:11:41.003162+0000","last_undegraded":"2024-09-12T01:11:41.003162+0000","last_fullsized":"2024-09-12T01:11:41.003162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-12T01:11:41.003082+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-12T01:11:41.003082+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.003082+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:30.129863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":146,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.502852+0000","last_change":"2024-09-12T01:11:32.502795+0000","last_active":"2024-09-12T01:11:32.502852+0000","last_peered":"2024-09-12T01:11:32.502852+0000","last_clean":"2024-09-12T01:11:32.502852+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T01:11:32.502852+0000","last_undegraded":"2024-09-12T01:11:32.502852+0000","last_fullsized":"2024-09-12T01:11:32.502852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.502719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.502719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.502719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:31.918266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'337","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.312196+0000","last_change":"2024-09-12T01:11:34.312196+0000","last_active":"2024-09-12T01:11:34.312196+0000","last_peered":"2024-09-12T01:11:34.312196+0000","last_clean":"2024-09-12T01:11:34.312196+0000","last_became_active":"2024-09-12T00:30:46.766731+0000","last_became_peered":"2024-09-12T00:30:46.766731+0000","last_unstale":"2024-09-12T01:11:34.312196+0000","last_undegraded":"2024-09-12T01:11:34.312196+0000","last_fullsized":"2024-09-12T01:11:34.312196+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T01:11:34.311972+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T01:11:34.311972+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.311972+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:31.110464+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7776863,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":511,"num_read_kb":16356,"num_write":1167,"num_write_kb":34470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,4],"acting":[5,7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.573198+0000","last_change":"2024-09-12T01:11:45.573198+0000","last_active":"2024-09-12T01:11:45.573198+0000","last_peered":"2024-09-12T01:11:45.573198+0000","last_clean":"2024-09-12T01:11:45.573198+0000","last_became_active":"2024-09-12T00:30:15.132744+0000","last_became_peered":"2024-09-12T00:30:15.132744+0000","last_unstale":"2024-09-12T01:11:45.573198+0000","last_undegraded":"2024-09-12T01:11:45.573198+0000","last_fullsized":"2024-09-12T01:11:45.573198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:45.573109+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:45.573109+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.573109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:55.353583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'226","reported_seq":1270,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.460831+0000","last_change":"2024-09-12T01:11:46.460831+0000","last_active":"2024-09-12T01:11:46.460831+0000","last_peered":"2024-09-12T01:11:46.460831+0000","last_clean":"2024-09-12T01:11:46.460831+0000","last_became_active":"2024-09-12T00:30:17.145284+0000","last_became_peered":"2024-09-12T00:30:17.145284+0000","last_unstale":"2024-09-12T01:11:46.460831+0000","last_undegraded":"2024-09-12T01:11:46.460831+0000","last_fullsized":"2024-09-12T01:11:46.460831+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-09-12T01:11:46.460719+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-09-12T01:11:46.460719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.460719+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:56.553885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":145,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511658+0000","last_change":"2024-09-12T00:30:19.169714+0000","last_active":"2024-09-12T01:07:52.511658+0000","last_peered":"2024-09-12T01:07:52.511658+0000","last_clean":"2024-09-12T01:07:52.511658+0000","last_became_active":"2024-09-12T00:30:19.169439+0000","last_became_peered":"2024-09-12T00:30:19.169439+0000","last_unstale":"2024-09-12T01:07:52.511658+0000","last_undegraded":"2024-09-12T01:07:52.511658+0000","last_fullsized":"2024-09-12T01:07:52.511658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:26.888194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'342","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.969662+0000","last_change":"2024-09-12T00:30:21.187938+0000","last_active":"2024-09-12T01:09:46.969662+0000","last_peered":"2024-09-12T01:09:46.969662+0000","last_clean":"2024-09-12T01:09:46.969662+0000","last_became_active":"2024-09-12T00:30:21.187616+0000","last_became_peered":"2024-09-12T00:30:21.187616+0000","last_unstale":"2024-09-12T01:09:46.969662+0000","last_undegraded":"2024-09-12T01:09:46.969662+0000","last_fullsized":"2024-09-12T01:09:46.969662+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:17.982171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":676,"num_read_kb":665,"num_write":755,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'375","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.030234+0000","last_change":"2024-09-12T01:11:40.030234+0000","last_active":"2024-09-12T01:11:40.030234+0000","last_peered":"2024-09-12T01:11:40.030234+0000","last_clean":"2024-09-12T01:11:40.030234+0000","last_became_active":"2024-09-12T00:30:13.122751+0000","last_became_peered":"2024-09-12T00:30:13.122751+0000","last_unstale":"2024-09-12T01:11:40.030234+0000","last_undegraded":"2024-09-12T01:11:40.030234+0000","last_fullsized":"2024-09-12T01:11:40.030234+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:40.030125+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:40.030125+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.030125+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:16.425527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1941,"num_read_kb":1679,"num_write":648,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.926825+0000","last_change":"2024-09-12T01:11:32.926782+0000","last_active":"2024-09-12T01:11:32.926825+0000","last_peered":"2024-09-12T01:11:32.926825+0000","last_clean":"2024-09-12T01:11:32.926825+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T01:11:32.926825+0000","last_undegraded":"2024-09-12T01:11:32.926825+0000","last_fullsized":"2024-09-12T01:11:32.926825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:11:32.926707+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:11:32.926707+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.926707+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:26.696475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'399","reported_seq":1140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.438397+0000","last_change":"2024-09-12T01:11:32.438397+0000","last_active":"2024-09-12T01:11:32.438397+0000","last_peered":"2024-09-12T01:11:32.438397+0000","last_clean":"2024-09-12T01:11:32.438397+0000","last_became_active":"2024-09-12T00:30:11.100253+0000","last_became_peered":"2024-09-12T00:30:11.100253+0000","last_unstale":"2024-09-12T01:11:32.438397+0000","last_undegraded":"2024-09-12T01:11:32.438397+0000","last_fullsized":"2024-09-12T01:11:32.438397+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'399","last_scrub_stamp":"2024-09-12T01:11:32.438283+0000","last_deep_scrub":"264'399","last_deep_scrub_stamp":"2024-09-12T01:11:32.438283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.438283+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:47.427418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7586776,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":852,"num_read_kb":32409,"num_write":1258,"num_write_kb":44212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.603535+0000","last_change":"2024-09-12T01:11:44.603535+0000","last_active":"2024-09-12T01:11:44.603535+0000","last_peered":"2024-09-12T01:11:44.603535+0000","last_clean":"2024-09-12T01:11:44.603535+0000","last_became_active":"2024-09-12T00:30:15.127835+0000","last_became_peered":"2024-09-12T00:30:15.127835+0000","last_unstale":"2024-09-12T01:11:44.603535+0000","last_undegraded":"2024-09-12T01:11:44.603535+0000","last_fullsized":"2024-09-12T01:11:44.603535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.603445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.603445+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.603445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:54.508744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'123","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.647217+0000","last_change":"2024-09-12T00:30:17.148863+0000","last_active":"2024-09-12T01:10:51.647217+0000","last_peered":"2024-09-12T01:10:51.647217+0000","last_clean":"2024-09-12T01:10:51.647217+0000","last_became_active":"2024-09-12T00:30:17.148548+0000","last_became_peered":"2024-09-12T00:30:17.148548+0000","last_unstale":"2024-09-12T01:10:51.647217+0000","last_undegraded":"2024-09-12T01:10:51.647217+0000","last_fullsized":"2024-09-12T01:10:51.647217+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:18.608977+0000","last_change":"2024-09-12T00:30:19.165383+0000","last_active":"2024-09-12T01:09:18.608977+0000","last_peered":"2024-09-12T01:09:18.608977+0000","last_clean":"2024-09-12T01:09:18.608977+0000","last_became_active":"2024-09-12T00:30:19.165120+0000","last_became_peered":"2024-09-12T00:30:19.165120+0000","last_unstale":"2024-09-12T01:09:18.608977+0000","last_undegraded":"2024-09-12T01:09:18.608977+0000","last_fullsized":"2024-09-12T01:09:18.608977+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:24.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'134","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.886962+0000","last_change":"2024-09-12T00:30:21.181012+0000","last_active":"2024-09-12T01:09:23.886962+0000","last_peered":"2024-09-12T01:09:23.886962+0000","last_clean":"2024-09-12T01:09:23.886962+0000","last_became_active":"2024-09-12T00:30:21.180708+0000","last_became_peered":"2024-09-12T00:30:21.180708+0000","last_unstale":"2024-09-12T01:09:23.886962+0000","last_undegraded":"2024-09-12T01:09:23.886962+0000","last_fullsized":"2024-09-12T01:09:23.886962+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":239,"num_write":325,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'171","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.027134+0000","last_change":"2024-09-12T01:11:39.027134+0000","last_active":"2024-09-12T01:11:39.027134+0000","last_peered":"2024-09-12T01:11:39.027134+0000","last_clean":"2024-09-12T01:11:39.027134+0000","last_became_active":"2024-09-12T00:30:13.130610+0000","last_became_peered":"2024-09-12T00:30:13.130610+0000","last_unstale":"2024-09-12T01:11:39.027134+0000","last_undegraded":"2024-09-12T01:11:39.027134+0000","last_fullsized":"2024-09-12T01:11:39.027134+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T01:11:39.027047+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T01:11:39.027047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.027047+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:23.518560+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":757,"num_read_kb":608,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'326","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.394860+0000","last_change":"2024-09-12T01:11:31.394860+0000","last_active":"2024-09-12T01:11:31.394860+0000","last_peered":"2024-09-12T01:11:31.394860+0000","last_clean":"2024-09-12T01:11:31.394860+0000","last_became_active":"2024-09-12T00:30:11.104002+0000","last_became_peered":"2024-09-12T00:30:11.104002+0000","last_unstale":"2024-09-12T01:11:31.394860+0000","last_undegraded":"2024-09-12T01:11:31.394860+0000","last_fullsized":"2024-09-12T01:11:31.394860+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.394736+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:03.175443+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452439,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":13269,"num_write":941,"num_write_kb":33802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.213348+0000","last_change":"2024-09-12T01:11:32.213270+0000","last_active":"2024-09-12T01:11:32.213348+0000","last_peered":"2024-09-12T01:11:32.213348+0000","last_clean":"2024-09-12T01:11:32.213348+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T01:11:32.213348+0000","last_undegraded":"2024-09-12T01:11:32.213348+0000","last_fullsized":"2024-09-12T01:11:32.213348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.213181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.213181+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.213181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:55.736193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510721+0000","last_change":"2024-09-12T00:30:15.127858+0000","last_active":"2024-09-12T01:07:47.510721+0000","last_peered":"2024-09-12T01:07:47.510721+0000","last_clean":"2024-09-12T01:07:47.510721+0000","last_became_active":"2024-09-12T00:30:15.127513+0000","last_became_peered":"2024-09-12T00:30:15.127513+0000","last_unstale":"2024-09-12T01:07:47.510721+0000","last_undegraded":"2024-09-12T01:07:47.510721+0000","last_fullsized":"2024-09-12T01:07:47.510721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:13.431995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'574","reported_seq":1250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.625759+0000","last_change":"2024-09-12T01:11:43.625759+0000","last_active":"2024-09-12T01:11:43.625759+0000","last_peered":"2024-09-12T01:11:43.625759+0000","last_clean":"2024-09-12T01:11:43.625759+0000","last_became_active":"2024-09-12T00:30:17.146141+0000","last_became_peered":"2024-09-12T00:30:17.146141+0000","last_unstale":"2024-09-12T01:11:43.625759+0000","last_undegraded":"2024-09-12T01:11:43.625759+0000","last_fullsized":"2024-09-12T01:11:43.625759+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'574","last_scrub_stamp":"2024-09-12T01:11:43.625634+0000","last_deep_scrub":"264'574","last_deep_scrub_stamp":"2024-09-12T01:11:43.625634+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.625634+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:48.119734+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1559,"num_read_kb":2701,"num_write":2018,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":507816,"num_omap_keys":1152,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.331499+0000","last_change":"2024-09-12T01:11:50.331499+0000","last_active":"2024-09-12T01:11:50.331499+0000","last_peered":"2024-09-12T01:11:50.331499+0000","last_clean":"2024-09-12T01:11:50.331499+0000","last_became_active":"2024-09-12T00:30:19.167819+0000","last_became_peered":"2024-09-12T00:30:19.167819+0000","last_unstale":"2024-09-12T01:11:50.331499+0000","last_undegraded":"2024-09-12T01:11:50.331499+0000","last_fullsized":"2024-09-12T01:11:50.331499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.331408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.331408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.331408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:26.591133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'175","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.532966+0000","last_change":"2024-09-12T00:30:21.193170+0000","last_active":"2024-09-12T01:09:21.532966+0000","last_peered":"2024-09-12T01:09:21.532966+0000","last_clean":"2024-09-12T01:09:21.532966+0000","last_became_active":"2024-09-12T00:30:21.192893+0000","last_became_peered":"2024-09-12T00:30:21.192893+0000","last_unstale":"2024-09-12T01:09:21.532966+0000","last_undegraded":"2024-09-12T01:09:21.532966+0000","last_fullsized":"2024-09-12T01:09:21.532966+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.137808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":195,"num_read_kb":181,"num_write":424,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'295","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.072329+0000","last_change":"2024-09-12T01:11:43.072329+0000","last_active":"2024-09-12T01:11:43.072329+0000","last_peered":"2024-09-12T01:11:43.072329+0000","last_clean":"2024-09-12T01:11:43.072329+0000","last_became_active":"2024-09-12T00:30:13.125487+0000","last_became_peered":"2024-09-12T00:30:13.125487+0000","last_unstale":"2024-09-12T01:11:43.072329+0000","last_undegraded":"2024-09-12T01:11:43.072329+0000","last_fullsized":"2024-09-12T01:11:43.072329+0000","mapping_epoch":28,"log_start":"261'200","ondisk_log_start":"261'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'295","last_scrub_stamp":"2024-09-12T01:11:43.072246+0000","last_deep_scrub":"264'295","last_deep_scrub_stamp":"2024-09-12T01:11:43.072246+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.072246+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:38.938472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1016,"num_write":432,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'308","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.079611+0000","last_change":"2024-09-12T01:11:33.079611+0000","last_active":"2024-09-12T01:11:33.079611+0000","last_peered":"2024-09-12T01:11:33.079611+0000","last_clean":"2024-09-12T01:11:33.079611+0000","last_became_active":"2024-09-12T00:30:11.108257+0000","last_became_peered":"2024-09-12T00:30:11.108257+0000","last_unstale":"2024-09-12T01:11:33.079611+0000","last_undegraded":"2024-09-12T01:11:33.079611+0000","last_fullsized":"2024-09-12T01:11:33.079611+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-12T01:11:33.079481+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-12T01:11:33.079481+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.079481+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:37.289345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":29050,"num_write":952,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.924888+0000","last_change":"2024-09-12T01:11:31.924834+0000","last_active":"2024-09-12T01:11:31.924888+0000","last_peered":"2024-09-12T01:11:31.924888+0000","last_clean":"2024-09-12T01:11:31.924888+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T01:11:31.924888+0000","last_undegraded":"2024-09-12T01:11:31.924888+0000","last_fullsized":"2024-09-12T01:11:31.924888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.924761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.924761+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.924761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.589363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.448139+0000","last_change":"2024-09-12T01:11:47.448139+0000","last_active":"2024-09-12T01:11:47.448139+0000","last_peered":"2024-09-12T01:11:47.448139+0000","last_clean":"2024-09-12T01:11:47.448139+0000","last_became_active":"2024-09-12T00:30:15.124765+0000","last_became_peered":"2024-09-12T00:30:15.124765+0000","last_unstale":"2024-09-12T01:11:47.448139+0000","last_undegraded":"2024-09-12T01:11:47.448139+0000","last_fullsized":"2024-09-12T01:11:47.448139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.448047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.448047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.448047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:26.268517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'162","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.221326+0000","last_change":"2024-09-12T00:30:17.147603+0000","last_active":"2024-09-12T01:10:26.221326+0000","last_peered":"2024-09-12T01:10:26.221326+0000","last_clean":"2024-09-12T01:10:26.221326+0000","last_became_active":"2024-09-12T00:30:17.147297+0000","last_became_peered":"2024-09-12T00:30:17.147297+0000","last_unstale":"2024-09-12T01:10:26.221326+0000","last_undegraded":"2024-09-12T01:10:26.221326+0000","last_fullsized":"2024-09-12T01:10:26.221326+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:26.332646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":197,"num_write":138,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'782","reported_seq":4276,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.505081+0000","last_change":"2024-09-12T00:30:19.169985+0000","last_active":"2024-09-12T01:11:22.505081+0000","last_peered":"2024-09-12T01:11:22.505081+0000","last_clean":"2024-09-12T01:11:22.505081+0000","last_became_active":"2024-09-12T00:30:19.169689+0000","last_became_peered":"2024-09-12T00:30:19.169689+0000","last_unstale":"2024-09-12T01:11:22.505081+0000","last_undegraded":"2024-09-12T01:11:22.505081+0000","last_fullsized":"2024-09-12T01:11:22.505081+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:18.977023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'135","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.493856+0000","last_change":"2024-09-12T00:30:21.189863+0000","last_active":"2024-09-12T01:10:51.493856+0000","last_peered":"2024-09-12T01:10:51.493856+0000","last_clean":"2024-09-12T01:10:51.493856+0000","last_became_active":"2024-09-12T00:30:21.189546+0000","last_became_peered":"2024-09-12T00:30:21.189546+0000","last_unstale":"2024-09-12T01:10:51.493856+0000","last_undegraded":"2024-09-12T01:10:51.493856+0000","last_fullsized":"2024-09-12T01:10:51.493856+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.427001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":147,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'196","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.285722+0000","last_change":"2024-09-12T01:11:37.285722+0000","last_active":"2024-09-12T01:11:37.285722+0000","last_peered":"2024-09-12T01:11:37.285722+0000","last_clean":"2024-09-12T01:11:37.285722+0000","last_became_active":"2024-09-12T00:30:13.118656+0000","last_became_peered":"2024-09-12T00:30:13.118656+0000","last_unstale":"2024-09-12T01:11:37.285722+0000","last_undegraded":"2024-09-12T01:11:37.285722+0000","last_fullsized":"2024-09-12T01:11:37.285722+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T01:11:37.285627+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T01:11:37.285627+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.285627+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:30.901502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":942,"num_read_kb":795,"num_write":340,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'370","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.361161+0000","last_change":"2024-09-12T01:11:35.361161+0000","last_active":"2024-09-12T01:11:35.361161+0000","last_peered":"2024-09-12T01:11:35.361161+0000","last_clean":"2024-09-12T01:11:35.361161+0000","last_became_active":"2024-09-12T00:30:11.090114+0000","last_became_peered":"2024-09-12T00:30:11.090114+0000","last_unstale":"2024-09-12T01:11:35.361161+0000","last_undegraded":"2024-09-12T01:11:35.361161+0000","last_fullsized":"2024-09-12T01:11:35.361161+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'370","last_scrub_stamp":"2024-09-12T01:11:35.360991+0000","last_deep_scrub":"264'370","last_deep_scrub_stamp":"2024-09-12T01:11:35.360991+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.360991+0000","objects_scrubbed":10,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.207634+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9433118,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":605,"num_read_kb":27258,"num_write":1271,"num_write_kb":43330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.405044+0000","last_change":"2024-09-12T01:11:31.405044+0000","last_active":"2024-09-12T01:11:31.405044+0000","last_peered":"2024-09-12T01:11:31.405044+0000","last_clean":"2024-09-12T01:11:31.405044+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T01:11:31.405044+0000","last_undegraded":"2024-09-12T01:11:31.405044+0000","last_fullsized":"2024-09-12T01:11:31.405044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.404954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.404954+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.404954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:13.972945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596333+0000","last_change":"2024-09-12T00:30:15.127408+0000","last_active":"2024-09-12T01:07:48.596333+0000","last_peered":"2024-09-12T01:07:48.596333+0000","last_clean":"2024-09-12T01:07:48.596333+0000","last_became_active":"2024-09-12T00:30:15.126949+0000","last_became_peered":"2024-09-12T00:30:15.126949+0000","last_unstale":"2024-09-12T01:07:48.596333+0000","last_undegraded":"2024-09-12T01:07:48.596333+0000","last_fullsized":"2024-09-12T01:07:48.596333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:24.696309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.206045+0000","last_change":"2024-09-12T00:30:17.150111+0000","last_active":"2024-09-12T01:10:26.206045+0000","last_peered":"2024-09-12T01:10:26.206045+0000","last_clean":"2024-09-12T01:10:26.206045+0000","last_became_active":"2024-09-12T00:30:17.149791+0000","last_became_peered":"2024-09-12T00:30:17.149791+0000","last_unstale":"2024-09-12T01:10:26.206045+0000","last_undegraded":"2024-09-12T01:10:26.206045+0000","last_fullsized":"2024-09-12T01:10:26.206045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.663317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'802","reported_seq":4540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.376141+0000","last_change":"2024-09-12T00:30:19.167079+0000","last_active":"2024-09-12T01:11:24.376141+0000","last_peered":"2024-09-12T01:11:24.376141+0000","last_clean":"2024-09-12T01:11:24.376141+0000","last_became_active":"2024-09-12T00:30:19.166687+0000","last_became_peered":"2024-09-12T00:30:19.166687+0000","last_unstale":"2024-09-12T01:11:24.376141+0000","last_undegraded":"2024-09-12T01:11:24.376141+0000","last_fullsized":"2024-09-12T01:11:24.376141+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:58.724984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.877133+0000","last_change":"2024-09-12T00:30:21.192502+0000","last_active":"2024-09-12T01:09:46.877133+0000","last_peered":"2024-09-12T01:09:46.877133+0000","last_clean":"2024-09-12T01:09:46.877133+0000","last_became_active":"2024-09-12T00:30:21.192189+0000","last_became_peered":"2024-09-12T00:30:21.192189+0000","last_unstale":"2024-09-12T01:09:46.877133+0000","last_undegraded":"2024-09-12T01:09:46.877133+0000","last_fullsized":"2024-09-12T01:09:46.877133+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:51.071766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":326,"num_read_kb":325,"num_write":560,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'395","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.432024+0000","last_change":"2024-09-12T01:11:36.432024+0000","last_active":"2024-09-12T01:11:36.432024+0000","last_peered":"2024-09-12T01:11:36.432024+0000","last_clean":"2024-09-12T01:11:36.432024+0000","last_became_active":"2024-09-12T00:30:13.120906+0000","last_became_peered":"2024-09-12T00:30:13.120906+0000","last_unstale":"2024-09-12T01:11:36.432024+0000","last_undegraded":"2024-09-12T01:11:36.432024+0000","last_fullsized":"2024-09-12T01:11:36.432024+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-12T01:11:36.431932+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-12T01:11:36.431932+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.431932+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:46.567143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1876,"num_read_kb":1541,"num_write":715,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'329","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.404850+0000","last_change":"2024-09-12T01:11:33.404850+0000","last_active":"2024-09-12T01:11:33.404850+0000","last_peered":"2024-09-12T01:11:33.404850+0000","last_clean":"2024-09-12T01:11:33.404850+0000","last_became_active":"2024-09-12T00:30:11.101931+0000","last_became_peered":"2024-09-12T00:30:11.101931+0000","last_unstale":"2024-09-12T01:11:33.404850+0000","last_undegraded":"2024-09-12T01:11:33.404850+0000","last_fullsized":"2024-09-12T01:11:33.404850+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T01:11:33.404737+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T01:11:33.404737+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.404737+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:04.479639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359495,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":501,"num_read_kb":50204,"num_write":1062,"num_write_kb":37284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.877931+0000","last_change":"2024-09-12T01:11:33.877931+0000","last_active":"2024-09-12T01:11:33.877931+0000","last_peered":"2024-09-12T01:11:33.877931+0000","last_clean":"2024-09-12T01:11:33.877931+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T01:11:33.877931+0000","last_undegraded":"2024-09-12T01:11:33.877931+0000","last_fullsized":"2024-09-12T01:11:33.877931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.877841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.877841+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.877841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:36.694365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:22.515540+0000","last_change":"2024-09-12T00:30:15.126298+0000","last_active":"2024-09-12T01:08:22.515540+0000","last_peered":"2024-09-12T01:08:22.515540+0000","last_clean":"2024-09-12T01:08:22.515540+0000","last_became_active":"2024-09-12T00:30:15.126041+0000","last_became_peered":"2024-09-12T00:30:15.126041+0000","last_unstale":"2024-09-12T01:08:22.515540+0000","last_undegraded":"2024-09-12T01:08:22.515540+0000","last_fullsized":"2024-09-12T01:08:22.515540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:47.264234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'771","reported_seq":1501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.419218+0000","last_change":"2024-09-12T01:11:43.419218+0000","last_active":"2024-09-12T01:11:43.419218+0000","last_peered":"2024-09-12T01:11:43.419218+0000","last_clean":"2024-09-12T01:11:43.419218+0000","last_became_active":"2024-09-12T00:30:17.148954+0000","last_became_peered":"2024-09-12T00:30:17.148954+0000","last_unstale":"2024-09-12T01:11:43.419218+0000","last_undegraded":"2024-09-12T01:11:43.419218+0000","last_fullsized":"2024-09-12T01:11:43.419218+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-12T01:11:43.419108+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-12T01:11:43.419108+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.419108+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:57.967218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141519,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1386,"num_read_kb":3323,"num_write":1142,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511612+0000","last_change":"2024-09-12T00:30:19.169337+0000","last_active":"2024-09-12T01:07:52.511612+0000","last_peered":"2024-09-12T01:07:52.511612+0000","last_clean":"2024-09-12T01:07:52.511612+0000","last_became_active":"2024-09-12T00:30:19.168965+0000","last_became_peered":"2024-09-12T00:30:19.168965+0000","last_unstale":"2024-09-12T01:07:52.511612+0000","last_undegraded":"2024-09-12T01:07:52.511612+0000","last_fullsized":"2024-09-12T01:07:52.511612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:32.282990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'132","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.271173+0000","last_change":"2024-09-12T00:30:21.186564+0000","last_active":"2024-09-12T01:09:46.271173+0000","last_peered":"2024-09-12T01:09:46.271173+0000","last_clean":"2024-09-12T01:09:46.271173+0000","last_became_active":"2024-09-12T00:30:21.186262+0000","last_became_peered":"2024-09-12T00:30:21.186262+0000","last_unstale":"2024-09-12T01:09:46.271173+0000","last_undegraded":"2024-09-12T01:09:46.271173+0000","last_fullsized":"2024-09-12T01:09:46.271173+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:19.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":332,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'144","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.925813+0000","last_change":"2024-09-12T00:30:21.193317+0000","last_active":"2024-09-12T01:09:46.925813+0000","last_peered":"2024-09-12T01:09:46.925813+0000","last_clean":"2024-09-12T01:09:46.925813+0000","last_became_active":"2024-09-12T00:30:21.193010+0000","last_became_peered":"2024-09-12T00:30:21.193010+0000","last_unstale":"2024-09-12T01:09:46.925813+0000","last_undegraded":"2024-09-12T01:09:46.925813+0000","last_fullsized":"2024-09-12T01:09:46.925813+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:25.295748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'64","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.347695+0000","last_change":"2024-09-12T01:11:39.347695+0000","last_active":"2024-09-12T01:11:39.347695+0000","last_peered":"2024-09-12T01:11:39.347695+0000","last_clean":"2024-09-12T01:11:39.347695+0000","last_became_active":"2024-09-12T00:30:13.121613+0000","last_became_peered":"2024-09-12T00:30:13.121613+0000","last_unstale":"2024-09-12T01:11:39.347695+0000","last_undegraded":"2024-09-12T01:11:39.347695+0000","last_fullsized":"2024-09-12T01:11:39.347695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-12T01:11:39.347611+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-12T01:11:39.347611+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.347611+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:04.410478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":107,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'377","reported_seq":1094,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.884100+0000","last_change":"2024-09-12T01:11:41.884100+0000","last_active":"2024-09-12T01:11:41.884100+0000","last_peered":"2024-09-12T01:11:41.884100+0000","last_clean":"2024-09-12T01:11:41.884100+0000","last_became_active":"2024-09-12T00:30:11.109653+0000","last_became_peered":"2024-09-12T00:30:11.109653+0000","last_unstale":"2024-09-12T01:11:41.884100+0000","last_undegraded":"2024-09-12T01:11:41.884100+0000","last_fullsized":"2024-09-12T01:11:41.884100+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-12T01:11:41.883946+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-12T01:11:41.883946+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.883946+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:36.450437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105416,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":3254,"num_write":1234,"num_write_kb":30224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.379544+0000","last_change":"2024-09-12T00:30:15.133054+0000","last_active":"2024-09-12T01:07:37.379544+0000","last_peered":"2024-09-12T01:07:37.379544+0000","last_clean":"2024-09-12T01:07:37.379544+0000","last_became_active":"2024-09-12T00:30:15.132784+0000","last_became_peered":"2024-09-12T00:30:15.132784+0000","last_unstale":"2024-09-12T01:07:37.379544+0000","last_undegraded":"2024-09-12T01:07:37.379544+0000","last_fullsized":"2024-09-12T01:07:37.379544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:01.793710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'260","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.134150+0000","last_change":"2024-09-12T00:30:17.146875+0000","last_active":"2024-09-12T01:11:24.134150+0000","last_peered":"2024-09-12T01:11:24.134150+0000","last_clean":"2024-09-12T01:11:24.134150+0000","last_became_active":"2024-09-12T00:30:17.146483+0000","last_became_peered":"2024-09-12T00:30:17.146483+0000","last_unstale":"2024-09-12T01:11:24.134150+0000","last_undegraded":"2024-09-12T01:11:24.134150+0000","last_fullsized":"2024-09-12T01:11:24.134150+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:14.781544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51465,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":944,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380029+0000","last_change":"2024-09-12T00:30:19.169288+0000","last_active":"2024-09-12T01:07:43.380029+0000","last_peered":"2024-09-12T01:07:43.380029+0000","last_clean":"2024-09-12T01:07:43.380029+0000","last_became_active":"2024-09-12T00:30:19.168980+0000","last_became_peered":"2024-09-12T00:30:19.168980+0000","last_unstale":"2024-09-12T01:07:43.380029+0000","last_undegraded":"2024-09-12T01:07:43.380029+0000","last_fullsized":"2024-09-12T01:07:43.380029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:55.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'108","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.943994+0000","last_change":"2024-09-12T00:30:21.188045+0000","last_active":"2024-09-12T01:08:50.943994+0000","last_peered":"2024-09-12T01:08:50.943994+0000","last_clean":"2024-09-12T01:08:50.943994+0000","last_became_active":"2024-09-12T00:30:21.187742+0000","last_became_peered":"2024-09-12T00:30:21.187742+0000","last_unstale":"2024-09-12T01:08:50.943994+0000","last_undegraded":"2024-09-12T01:08:50.943994+0000","last_fullsized":"2024-09-12T01:08:50.943994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'264","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.224777+0000","last_change":"2024-09-12T01:11:40.224777+0000","last_active":"2024-09-12T01:11:40.224777+0000","last_peered":"2024-09-12T01:11:40.224777+0000","last_clean":"2024-09-12T01:11:40.224777+0000","last_became_active":"2024-09-12T00:30:13.131204+0000","last_became_peered":"2024-09-12T00:30:13.131204+0000","last_unstale":"2024-09-12T01:11:40.224777+0000","last_undegraded":"2024-09-12T01:11:40.224777+0000","last_fullsized":"2024-09-12T01:11:40.224777+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-12T01:11:40.224678+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-12T01:11:40.224678+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.224678+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:44.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":908,"num_write":395,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'365","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.378631+0000","last_change":"2024-09-12T01:11:29.378631+0000","last_active":"2024-09-12T01:11:29.378631+0000","last_peered":"2024-09-12T01:11:29.378631+0000","last_clean":"2024-09-12T01:11:29.378631+0000","last_became_active":"2024-09-12T00:30:11.104403+0000","last_became_peered":"2024-09-12T00:30:11.104403+0000","last_unstale":"2024-09-12T01:11:29.378631+0000","last_undegraded":"2024-09-12T01:11:29.378631+0000","last_fullsized":"2024-09-12T01:11:29.378631+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'365","last_scrub_stamp":"2024-09-12T01:11:29.378485+0000","last_deep_scrub":"264'365","last_deep_scrub_stamp":"2024-09-12T01:11:29.378485+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.378485+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.993161+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190266,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":58051,"num_write":1218,"num_write_kb":38205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:37.509453+0000","last_change":"2024-09-12T00:30:15.128673+0000","last_active":"2024-09-12T01:07:37.509453+0000","last_peered":"2024-09-12T01:07:37.509453+0000","last_clean":"2024-09-12T01:07:37.509453+0000","last_became_active":"2024-09-12T00:30:15.128366+0000","last_became_peered":"2024-09-12T00:30:15.128366+0000","last_unstale":"2024-09-12T01:07:37.509453+0000","last_undegraded":"2024-09-12T01:07:37.509453+0000","last_fullsized":"2024-09-12T01:07:37.509453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:18.808966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'45","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.025516+0000","last_change":"2024-09-12T00:30:17.139289+0000","last_active":"2024-09-12T01:10:26.025516+0000","last_peered":"2024-09-12T01:10:26.025516+0000","last_clean":"2024-09-12T01:10:26.025516+0000","last_became_active":"2024-09-12T00:30:17.138399+0000","last_became_peered":"2024-09-12T00:30:17.138399+0000","last_unstale":"2024-09-12T01:10:26.025516+0000","last_undegraded":"2024-09-12T01:10:26.025516+0000","last_fullsized":"2024-09-12T01:10:26.025516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:34.631922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":31,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.488873+0000","last_change":"2024-09-12T00:30:19.167516+0000","last_active":"2024-09-12T01:07:41.488873+0000","last_peered":"2024-09-12T01:07:41.488873+0000","last_clean":"2024-09-12T01:07:41.488873+0000","last_became_active":"2024-09-12T00:30:19.167213+0000","last_became_peered":"2024-09-12T00:30:19.167213+0000","last_unstale":"2024-09-12T01:07:41.488873+0000","last_undegraded":"2024-09-12T01:07:41.488873+0000","last_fullsized":"2024-09-12T01:07:41.488873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:20.695360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'202","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.271103+0000","last_change":"2024-09-12T00:30:21.185959+0000","last_active":"2024-09-12T01:10:50.271103+0000","last_peered":"2024-09-12T01:10:50.271103+0000","last_clean":"2024-09-12T01:10:50.271103+0000","last_became_active":"2024-09-12T00:30:21.185636+0000","last_became_peered":"2024-09-12T00:30:21.185636+0000","last_unstale":"2024-09-12T01:10:50.271103+0000","last_undegraded":"2024-09-12T01:10:50.271103+0000","last_fullsized":"2024-09-12T01:10:50.271103+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:18.839590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":299,"num_write":483,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'101","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.369628+0000","last_change":"2024-09-12T01:11:47.369628+0000","last_active":"2024-09-12T01:11:47.369628+0000","last_peered":"2024-09-12T01:11:47.369628+0000","last_clean":"2024-09-12T01:11:47.369628+0000","last_became_active":"2024-09-12T00:30:13.124163+0000","last_became_peered":"2024-09-12T00:30:13.124163+0000","last_unstale":"2024-09-12T01:11:47.369628+0000","last_undegraded":"2024-09-12T01:11:47.369628+0000","last_fullsized":"2024-09-12T01:11:47.369628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T01:11:47.369535+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T01:11:47.369535+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.369535+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:17.905362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":380,"num_write":155,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'347","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.398998+0000","last_change":"2024-09-12T01:11:32.398998+0000","last_active":"2024-09-12T01:11:32.398998+0000","last_peered":"2024-09-12T01:11:32.398998+0000","last_clean":"2024-09-12T01:11:32.398998+0000","last_became_active":"2024-09-12T00:30:11.110736+0000","last_became_peered":"2024-09-12T00:30:11.110736+0000","last_unstale":"2024-09-12T01:11:32.398998+0000","last_undegraded":"2024-09-12T01:11:32.398998+0000","last_fullsized":"2024-09-12T01:11:32.398998+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:32.398902+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:32.398902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.398902+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:00.088675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380458,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":820,"num_read_kb":34556,"num_write":1163,"num_write_kb":41998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.333925+0000","last_change":"2024-09-12T01:11:44.333925+0000","last_active":"2024-09-12T01:11:44.333925+0000","last_peered":"2024-09-12T01:11:44.333925+0000","last_clean":"2024-09-12T01:11:44.333925+0000","last_became_active":"2024-09-12T00:30:15.121068+0000","last_became_peered":"2024-09-12T00:30:15.121068+0000","last_unstale":"2024-09-12T01:11:44.333925+0000","last_undegraded":"2024-09-12T01:11:44.333925+0000","last_fullsized":"2024-09-12T01:11:44.333925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.333836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.333836+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.333836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:08.954732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'314","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.380796+0000","last_change":"2024-09-12T00:30:17.148244+0000","last_active":"2024-09-12T01:11:23.380796+0000","last_peered":"2024-09-12T01:11:23.380796+0000","last_clean":"2024-09-12T01:11:23.380796+0000","last_became_active":"2024-09-12T00:30:17.147946+0000","last_became_peered":"2024-09-12T00:30:17.147946+0000","last_unstale":"2024-09-12T01:11:23.380796+0000","last_undegraded":"2024-09-12T01:11:23.380796+0000","last_fullsized":"2024-09-12T01:11:23.380796+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:12.212273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":1151,"num_write":414,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.399089+0000","last_change":"2024-09-12T00:30:19.167688+0000","last_active":"2024-09-12T01:07:38.399089+0000","last_peered":"2024-09-12T01:07:38.399089+0000","last_clean":"2024-09-12T01:07:38.399089+0000","last_became_active":"2024-09-12T00:30:19.167407+0000","last_became_peered":"2024-09-12T00:30:19.167407+0000","last_unstale":"2024-09-12T01:07:38.399089+0000","last_undegraded":"2024-09-12T01:07:38.399089+0000","last_fullsized":"2024-09-12T01:07:38.399089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:37.869657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.270721+0000","last_change":"2024-09-12T00:30:21.189080+0000","last_active":"2024-09-12T01:09:23.270721+0000","last_peered":"2024-09-12T01:09:23.270721+0000","last_clean":"2024-09-12T01:09:23.270721+0000","last_became_active":"2024-09-12T00:30:21.188801+0000","last_became_peered":"2024-09-12T00:30:21.188801+0000","last_unstale":"2024-09-12T01:09:23.270721+0000","last_undegraded":"2024-09-12T01:09:23.270721+0000","last_fullsized":"2024-09-12T01:09:23.270721+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:52.941694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":174,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'271","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.567103+0000","last_change":"2024-09-12T01:11:38.567103+0000","last_active":"2024-09-12T01:11:38.567103+0000","last_peered":"2024-09-12T01:11:38.567103+0000","last_clean":"2024-09-12T01:11:38.567103+0000","last_became_active":"2024-09-12T00:30:13.121687+0000","last_became_peered":"2024-09-12T00:30:13.121687+0000","last_unstale":"2024-09-12T01:11:38.567103+0000","last_undegraded":"2024-09-12T01:11:38.567103+0000","last_fullsized":"2024-09-12T01:11:38.567103+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T01:11:38.566980+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T01:11:38.566980+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.566980+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:30.059821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1180,"num_read_kb":936,"num_write":465,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'332","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.265680+0000","last_change":"2024-09-12T01:11:33.265680+0000","last_active":"2024-09-12T01:11:33.265680+0000","last_peered":"2024-09-12T01:11:33.265680+0000","last_clean":"2024-09-12T01:11:33.265680+0000","last_became_active":"2024-09-12T00:30:11.097863+0000","last_became_peered":"2024-09-12T00:30:11.097863+0000","last_unstale":"2024-09-12T01:11:33.265680+0000","last_undegraded":"2024-09-12T01:11:33.265680+0000","last_fullsized":"2024-09-12T01:11:33.265680+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T01:11:33.265543+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T01:11:33.265543+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.265543+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:12.068841+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4714622,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":74376,"num_write":1103,"num_write_kb":34671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.595145+0000","last_change":"2024-09-12T00:30:15.125794+0000","last_active":"2024-09-12T01:07:38.595145+0000","last_peered":"2024-09-12T01:07:38.595145+0000","last_clean":"2024-09-12T01:07:38.595145+0000","last_became_active":"2024-09-12T00:30:15.125505+0000","last_became_peered":"2024-09-12T00:30:15.125505+0000","last_unstale":"2024-09-12T01:07:38.595145+0000","last_undegraded":"2024-09-12T01:07:38.595145+0000","last_fullsized":"2024-09-12T01:07:38.595145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:58.671332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'278","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.131148+0000","last_change":"2024-09-12T00:30:17.146728+0000","last_active":"2024-09-12T01:11:23.131148+0000","last_peered":"2024-09-12T01:11:23.131148+0000","last_clean":"2024-09-12T01:11:23.131148+0000","last_became_active":"2024-09-12T00:30:17.146112+0000","last_became_peered":"2024-09-12T00:30:17.146112+0000","last_unstale":"2024-09-12T01:11:23.131148+0000","last_undegraded":"2024-09-12T01:11:23.131148+0000","last_fullsized":"2024-09-12T01:11:23.131148+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:53.604417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56907,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":1155,"num_write":390,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.380111+0000","last_change":"2024-09-12T00:30:19.165113+0000","last_active":"2024-09-12T01:07:43.380111+0000","last_peered":"2024-09-12T01:07:43.380111+0000","last_clean":"2024-09-12T01:07:43.380111+0000","last_became_active":"2024-09-12T00:30:19.164820+0000","last_became_peered":"2024-09-12T00:30:19.164820+0000","last_unstale":"2024-09-12T01:07:43.380111+0000","last_undegraded":"2024-09-12T01:07:43.380111+0000","last_fullsized":"2024-09-12T01:07:43.380111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:05.633814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'177","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.659876+0000","last_change":"2024-09-12T00:30:13.124841+0000","last_active":"2024-09-12T01:08:12.659876+0000","last_peered":"2024-09-12T01:08:12.659876+0000","last_clean":"2024-09-12T01:08:12.659876+0000","last_became_active":"2024-09-12T00:30:13.124584+0000","last_became_peered":"2024-09-12T00:30:13.124584+0000","last_unstale":"2024-09-12T01:08:12.659876+0000","last_undegraded":"2024-09-12T01:08:12.659876+0000","last_fullsized":"2024-09-12T01:08:12.659876+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:20.463711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":813,"num_read_kb":670,"num_write":272,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'359","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.309657+0000","last_change":"2024-09-12T01:11:36.309657+0000","last_active":"2024-09-12T01:11:36.309657+0000","last_peered":"2024-09-12T01:11:36.309657+0000","last_clean":"2024-09-12T01:11:36.309657+0000","last_became_active":"2024-09-12T00:30:11.097890+0000","last_became_peered":"2024-09-12T00:30:11.097890+0000","last_unstale":"2024-09-12T01:11:36.309657+0000","last_undegraded":"2024-09-12T01:11:36.309657+0000","last_fullsized":"2024-09-12T01:11:36.309657+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-12T01:11:36.309476+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-12T01:11:36.309476+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.309476+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:38.549094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":38574,"num_write":1151,"num_write_kb":31383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'5","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.477005+0000","last_change":"2024-09-12T00:30:15.122461+0000","last_active":"2024-09-12T01:11:22.477005+0000","last_peered":"2024-09-12T01:11:22.477005+0000","last_clean":"2024-09-12T01:11:22.477005+0000","last_became_active":"2024-09-12T00:30:15.122172+0000","last_became_peered":"2024-09-12T00:30:15.122172+0000","last_unstale":"2024-09-12T01:11:22.477005+0000","last_undegraded":"2024-09-12T01:11:22.477005+0000","last_fullsized":"2024-09-12T01:11:22.477005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:40.318954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'512","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.566682+0000","last_change":"2024-09-12T00:30:17.146325+0000","last_active":"2024-09-12T01:11:24.566682+0000","last_peered":"2024-09-12T01:11:24.566682+0000","last_clean":"2024-09-12T01:11:24.566682+0000","last_became_active":"2024-09-12T00:30:17.145882+0000","last_became_peered":"2024-09-12T00:30:17.145882+0000","last_unstale":"2024-09-12T01:11:24.566682+0000","last_undegraded":"2024-09-12T01:11:24.566682+0000","last_fullsized":"2024-09-12T01:11:24.566682+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:43.412234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96845,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":949,"num_read_kb":2301,"num_write":828,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.490351+0000","last_change":"2024-09-12T00:30:19.171021+0000","last_active":"2024-09-12T01:07:51.490351+0000","last_peered":"2024-09-12T01:07:51.490351+0000","last_clean":"2024-09-12T01:07:51.490351+0000","last_became_active":"2024-09-12T00:30:19.170776+0000","last_became_peered":"2024-09-12T00:30:19.170776+0000","last_unstale":"2024-09-12T01:07:51.490351+0000","last_undegraded":"2024-09-12T01:07:51.490351+0000","last_fullsized":"2024-09-12T01:07:51.490351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:45.791234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'142","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.220138+0000","last_change":"2024-09-12T00:30:21.188712+0000","last_active":"2024-09-12T01:09:12.220138+0000","last_peered":"2024-09-12T01:09:12.220138+0000","last_clean":"2024-09-12T01:09:12.220138+0000","last_became_active":"2024-09-12T00:30:21.188376+0000","last_became_peered":"2024-09-12T00:30:21.188376+0000","last_unstale":"2024-09-12T01:09:12.220138+0000","last_undegraded":"2024-09-12T01:09:12.220138+0000","last_fullsized":"2024-09-12T01:09:12.220138+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:33.881129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":168,"num_write":312,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'188","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.280000+0000","last_change":"2024-09-12T01:11:42.280000+0000","last_active":"2024-09-12T01:11:42.280000+0000","last_peered":"2024-09-12T01:11:42.280000+0000","last_clean":"2024-09-12T01:11:42.280000+0000","last_became_active":"2024-09-12T00:30:13.118251+0000","last_became_peered":"2024-09-12T00:30:13.118251+0000","last_unstale":"2024-09-12T01:11:42.280000+0000","last_undegraded":"2024-09-12T01:11:42.280000+0000","last_fullsized":"2024-09-12T01:11:42.280000+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-09-12T01:11:42.279891+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-09-12T01:11:42.279891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.279891+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:04.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":709,"num_write":308,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'375","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.312581+0000","last_change":"2024-09-12T01:11:36.312581+0000","last_active":"2024-09-12T01:11:36.312581+0000","last_peered":"2024-09-12T01:11:36.312581+0000","last_clean":"2024-09-12T01:11:36.312581+0000","last_became_active":"2024-09-12T00:30:11.102929+0000","last_became_peered":"2024-09-12T00:30:11.102929+0000","last_unstale":"2024-09-12T01:11:36.312581+0000","last_undegraded":"2024-09-12T01:11:36.312581+0000","last_fullsized":"2024-09-12T01:11:36.312581+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:36.312446+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:36.312446+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.312446+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:28.083174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":62693,"num_write":1091,"num_write_kb":37872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.271635+0000","last_change":"2024-09-12T01:11:47.271635+0000","last_active":"2024-09-12T01:11:47.271635+0000","last_peered":"2024-09-12T01:11:47.271635+0000","last_clean":"2024-09-12T01:11:47.271635+0000","last_became_active":"2024-09-12T00:30:15.127268+0000","last_became_peered":"2024-09-12T00:30:15.127268+0000","last_unstale":"2024-09-12T01:11:47.271635+0000","last_undegraded":"2024-09-12T01:11:47.271635+0000","last_fullsized":"2024-09-12T01:11:47.271635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.271530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.271530+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.271530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.919338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'306","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.215461+0000","last_change":"2024-09-12T00:30:17.145767+0000","last_active":"2024-09-12T01:11:23.215461+0000","last_peered":"2024-09-12T01:11:23.215461+0000","last_clean":"2024-09-12T01:11:23.215461+0000","last_became_active":"2024-09-12T00:30:17.145504+0000","last_became_peered":"2024-09-12T00:30:17.145504+0000","last_unstale":"2024-09-12T01:11:23.215461+0000","last_undegraded":"2024-09-12T01:11:23.215461+0000","last_fullsized":"2024-09-12T01:11:23.215461+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:08.680720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1192,"num_write":444,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.470054+0000","last_change":"2024-09-12T00:30:19.169885+0000","last_active":"2024-09-12T01:07:52.470054+0000","last_peered":"2024-09-12T01:07:52.470054+0000","last_clean":"2024-09-12T01:07:52.470054+0000","last_became_active":"2024-09-12T00:30:19.169558+0000","last_became_peered":"2024-09-12T00:30:19.169558+0000","last_unstale":"2024-09-12T01:07:52.470054+0000","last_undegraded":"2024-09-12T01:07:52.470054+0000","last_fullsized":"2024-09-12T01:07:52.470054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:54.438982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'175","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.845489+0000","last_change":"2024-09-12T00:30:21.188671+0000","last_active":"2024-09-12T01:09:16.845489+0000","last_peered":"2024-09-12T01:09:16.845489+0000","last_clean":"2024-09-12T01:09:16.845489+0000","last_became_active":"2024-09-12T00:30:21.188350+0000","last_became_peered":"2024-09-12T00:30:21.188350+0000","last_unstale":"2024-09-12T01:09:16.845489+0000","last_undegraded":"2024-09-12T01:09:16.845489+0000","last_fullsized":"2024-09-12T01:09:16.845489+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.291083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2246,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":214,"num_write":509,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'191","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.526183+0000","last_change":"2024-09-12T01:11:39.526183+0000","last_active":"2024-09-12T01:11:39.526183+0000","last_peered":"2024-09-12T01:11:39.526183+0000","last_clean":"2024-09-12T01:11:39.526183+0000","last_became_active":"2024-09-12T00:30:13.127294+0000","last_became_peered":"2024-09-12T00:30:13.127294+0000","last_unstale":"2024-09-12T01:11:39.526183+0000","last_undegraded":"2024-09-12T01:11:39.526183+0000","last_fullsized":"2024-09-12T01:11:39.526183+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'191","last_scrub_stamp":"2024-09-12T01:11:39.526081+0000","last_deep_scrub":"264'191","last_deep_scrub_stamp":"2024-09-12T01:11:39.526081+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.526081+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.075674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":881,"num_read_kb":750,"num_write":313,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'341","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.807113+0000","last_change":"2024-09-12T01:11:32.807113+0000","last_active":"2024-09-12T01:11:32.807113+0000","last_peered":"2024-09-12T01:11:32.807113+0000","last_clean":"2024-09-12T01:11:32.807113+0000","last_became_active":"2024-09-12T00:30:11.091027+0000","last_became_peered":"2024-09-12T00:30:11.091027+0000","last_unstale":"2024-09-12T01:11:32.807113+0000","last_undegraded":"2024-09-12T01:11:32.807113+0000","last_fullsized":"2024-09-12T01:11:32.807113+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T01:11:32.806954+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T01:11:32.806954+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.806954+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:48.132495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4477982,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":8604,"num_write":1162,"num_write_kb":27793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.318124+0000","last_change":"2024-09-12T01:11:49.318124+0000","last_active":"2024-09-12T01:11:49.318124+0000","last_peered":"2024-09-12T01:11:49.318124+0000","last_clean":"2024-09-12T01:11:49.318124+0000","last_became_active":"2024-09-12T00:30:15.126254+0000","last_became_peered":"2024-09-12T00:30:15.126254+0000","last_unstale":"2024-09-12T01:11:49.318124+0000","last_undegraded":"2024-09-12T01:11:49.318124+0000","last_fullsized":"2024-09-12T01:11:49.318124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.318016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.318016+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.318016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:56.146698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'284","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.425385+0000","last_change":"2024-09-12T00:30:17.146500+0000","last_active":"2024-09-12T01:11:24.425385+0000","last_peered":"2024-09-12T01:11:24.425385+0000","last_clean":"2024-09-12T01:11:24.425385+0000","last_became_active":"2024-09-12T00:30:17.146106+0000","last_became_peered":"2024-09-12T00:30:17.146106+0000","last_unstale":"2024-09-12T01:11:24.425385+0000","last_undegraded":"2024-09-12T01:11:24.425385+0000","last_fullsized":"2024-09-12T01:11:24.425385+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:56.226270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1084,"num_write":388,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.385079+0000","last_change":"2024-09-12T00:30:19.167702+0000","last_active":"2024-09-12T01:08:23.385079+0000","last_peered":"2024-09-12T01:08:23.385079+0000","last_clean":"2024-09-12T01:08:23.385079+0000","last_became_active":"2024-09-12T00:30:19.167119+0000","last_became_peered":"2024-09-12T00:30:19.167119+0000","last_unstale":"2024-09-12T01:08:23.385079+0000","last_undegraded":"2024-09-12T01:08:23.385079+0000","last_fullsized":"2024-09-12T01:08:23.385079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:22.072993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'97","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490235+0000","last_change":"2024-09-12T00:30:21.191304+0000","last_active":"2024-09-12T01:10:51.490235+0000","last_peered":"2024-09-12T01:10:51.490235+0000","last_clean":"2024-09-12T01:10:51.490235+0000","last_became_active":"2024-09-12T00:30:21.190937+0000","last_became_peered":"2024-09-12T00:30:21.190937+0000","last_unstale":"2024-09-12T01:10:51.490235+0000","last_undegraded":"2024-09-12T01:10:51.490235+0000","last_fullsized":"2024-09-12T01:10:51.490235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:04.164418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":102,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'208","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.235533+0000","last_change":"2024-09-12T01:11:41.235533+0000","last_active":"2024-09-12T01:11:41.235533+0000","last_peered":"2024-09-12T01:11:41.235533+0000","last_clean":"2024-09-12T01:11:41.235533+0000","last_became_active":"2024-09-12T00:30:13.119843+0000","last_became_peered":"2024-09-12T00:30:13.119843+0000","last_unstale":"2024-09-12T01:11:41.235533+0000","last_undegraded":"2024-09-12T01:11:41.235533+0000","last_fullsized":"2024-09-12T01:11:41.235533+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T01:11:41.235444+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T01:11:41.235444+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.235444+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:10.729092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":901,"num_read_kb":747,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'375","reported_seq":1048,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.260021+0000","last_change":"2024-09-12T01:11:39.260021+0000","last_active":"2024-09-12T01:11:39.260021+0000","last_peered":"2024-09-12T01:11:39.260021+0000","last_clean":"2024-09-12T01:11:39.260021+0000","last_became_active":"2024-09-12T00:30:11.100750+0000","last_became_peered":"2024-09-12T00:30:11.100750+0000","last_unstale":"2024-09-12T01:11:39.260021+0000","last_undegraded":"2024-09-12T01:11:39.260021+0000","last_fullsized":"2024-09-12T01:11:39.260021+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:39.259889+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:39.259889+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.259889+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:23.779675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1340812,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":582,"num_read_kb":31919,"num_write":1306,"num_write_kb":26213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:47.510757+0000","last_change":"2024-09-12T00:30:15.127738+0000","last_active":"2024-09-12T01:07:47.510757+0000","last_peered":"2024-09-12T01:07:47.510757+0000","last_clean":"2024-09-12T01:07:47.510757+0000","last_became_active":"2024-09-12T00:30:15.127444+0000","last_became_peered":"2024-09-12T00:30:15.127444+0000","last_unstale":"2024-09-12T01:07:47.510757+0000","last_undegraded":"2024-09-12T01:07:47.510757+0000","last_fullsized":"2024-09-12T01:07:47.510757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:29.367406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'84","reported_seq":596,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:26.218785+0000","last_change":"2024-09-12T00:30:17.144599+0000","last_active":"2024-09-12T01:10:26.218785+0000","last_peered":"2024-09-12T01:10:26.218785+0000","last_clean":"2024-09-12T01:10:26.218785+0000","last_became_active":"2024-09-12T00:30:17.144283+0000","last_became_peered":"2024-09-12T00:30:17.144283+0000","last_unstale":"2024-09-12T01:10:26.218785+0000","last_undegraded":"2024-09-12T01:10:26.218785+0000","last_fullsized":"2024-09-12T01:10:26.218785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:42.626907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":66,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'770","reported_seq":2398,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.152809+0000","last_change":"2024-09-12T00:30:19.167155+0000","last_active":"2024-09-12T01:11:24.152809+0000","last_peered":"2024-09-12T01:11:24.152809+0000","last_clean":"2024-09-12T01:11:24.152809+0000","last_became_active":"2024-09-12T00:30:19.166851+0000","last_became_peered":"2024-09-12T00:30:19.166851+0000","last_unstale":"2024-09-12T01:11:24.152809+0000","last_undegraded":"2024-09-12T01:11:24.152809+0000","last_fullsized":"2024-09-12T01:11:24.152809+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:22.407452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'131","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.215109+0000","last_change":"2024-09-12T00:30:21.190459+0000","last_active":"2024-09-12T01:09:31.215109+0000","last_peered":"2024-09-12T01:09:31.215109+0000","last_clean":"2024-09-12T01:09:31.215109+0000","last_became_active":"2024-09-12T00:30:21.190151+0000","last_became_peered":"2024-09-12T00:30:21.190151+0000","last_unstale":"2024-09-12T01:09:31.215109+0000","last_undegraded":"2024-09-12T01:09:31.215109+0000","last_fullsized":"2024-09-12T01:09:31.215109+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:54.921241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'111","reported_seq":715,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.353880+0000","last_change":"2024-09-12T01:11:43.353880+0000","last_active":"2024-09-12T01:11:43.353880+0000","last_peered":"2024-09-12T01:11:43.353880+0000","last_clean":"2024-09-12T01:11:43.353880+0000","last_became_active":"2024-09-12T00:30:13.124167+0000","last_became_peered":"2024-09-12T00:30:13.124167+0000","last_unstale":"2024-09-12T01:11:43.353880+0000","last_undegraded":"2024-09-12T01:11:43.353880+0000","last_fullsized":"2024-09-12T01:11:43.353880+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-12T01:11:43.353764+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-12T01:11:43.353764+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.353764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:12.072323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":425,"num_write":152,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'457","reported_seq":1161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.807625+0000","last_change":"2024-09-12T01:11:33.807625+0000","last_active":"2024-09-12T01:11:33.807625+0000","last_peered":"2024-09-12T01:11:33.807625+0000","last_clean":"2024-09-12T01:11:33.807625+0000","last_became_active":"2024-09-12T00:30:11.108422+0000","last_became_peered":"2024-09-12T00:30:11.108422+0000","last_unstale":"2024-09-12T01:11:33.807625+0000","last_undegraded":"2024-09-12T01:11:33.807625+0000","last_fullsized":"2024-09-12T01:11:33.807625+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'457","last_scrub_stamp":"2024-09-12T01:11:33.807436+0000","last_deep_scrub":"264'457","last_deep_scrub_stamp":"2024-09-12T01:11:33.807436+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.807436+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:14.406328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314887,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":867,"num_read_kb":2765,"num_write":1329,"num_write_kb":29562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.823293+0000","last_change":"2024-09-12T01:11:45.823293+0000","last_active":"2024-09-12T01:11:45.823293+0000","last_peered":"2024-09-12T01:11:45.823293+0000","last_clean":"2024-09-12T01:11:45.823293+0000","last_became_active":"2024-09-12T00:30:15.124922+0000","last_became_peered":"2024-09-12T00:30:15.124922+0000","last_unstale":"2024-09-12T01:11:45.823293+0000","last_undegraded":"2024-09-12T01:11:45.823293+0000","last_fullsized":"2024-09-12T01:11:45.823293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.823172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.823172+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.823172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:20.010059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'350","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.866350+0000","last_change":"2024-09-12T00:30:17.149283+0000","last_active":"2024-09-12T01:11:24.866350+0000","last_peered":"2024-09-12T01:11:24.866350+0000","last_clean":"2024-09-12T01:11:24.866350+0000","last_became_active":"2024-09-12T00:30:17.148793+0000","last_became_peered":"2024-09-12T00:30:17.148793+0000","last_unstale":"2024-09-12T01:11:24.866350+0000","last_undegraded":"2024-09-12T01:11:24.866350+0000","last_fullsized":"2024-09-12T01:11:24.866350+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:33.498700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62476,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1247,"num_write":454,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.521435+0000","last_change":"2024-09-12T00:30:19.170247+0000","last_active":"2024-09-12T01:09:02.521435+0000","last_peered":"2024-09-12T01:09:02.521435+0000","last_clean":"2024-09-12T01:09:02.521435+0000","last_became_active":"2024-09-12T00:30:19.169982+0000","last_became_peered":"2024-09-12T00:30:19.169982+0000","last_unstale":"2024-09-12T01:09:02.521435+0000","last_undegraded":"2024-09-12T01:09:02.521435+0000","last_fullsized":"2024-09-12T01:09:02.521435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:58.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'144","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.854030+0000","last_change":"2024-09-12T00:30:21.187973+0000","last_active":"2024-09-12T01:09:32.854030+0000","last_peered":"2024-09-12T01:09:32.854030+0000","last_clean":"2024-09-12T01:09:32.854030+0000","last_became_active":"2024-09-12T00:30:21.187641+0000","last_became_peered":"2024-09-12T00:30:21.187641+0000","last_unstale":"2024-09-12T01:09:32.854030+0000","last_undegraded":"2024-09-12T01:09:32.854030+0000","last_fullsized":"2024-09-12T01:09:32.854030+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:39.449383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":136,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'195","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.316905+0000","last_change":"2024-09-12T01:11:42.316905+0000","last_active":"2024-09-12T01:11:42.316905+0000","last_peered":"2024-09-12T01:11:42.316905+0000","last_clean":"2024-09-12T01:11:42.316905+0000","last_became_active":"2024-09-12T00:30:13.122622+0000","last_became_peered":"2024-09-12T00:30:13.122622+0000","last_unstale":"2024-09-12T01:11:42.316905+0000","last_undegraded":"2024-09-12T01:11:42.316905+0000","last_fullsized":"2024-09-12T01:11:42.316905+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T01:11:42.316822+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T01:11:42.316822+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.316822+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:34.809995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":295,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'335","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.919664+0000","last_change":"2024-09-12T01:11:39.919664+0000","last_active":"2024-09-12T01:11:39.919664+0000","last_peered":"2024-09-12T01:11:39.919664+0000","last_clean":"2024-09-12T01:11:39.919664+0000","last_became_active":"2024-09-12T00:30:11.109855+0000","last_became_peered":"2024-09-12T00:30:11.109855+0000","last_unstale":"2024-09-12T01:11:39.919664+0000","last_undegraded":"2024-09-12T01:11:39.919664+0000","last_fullsized":"2024-09-12T01:11:39.919664+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T01:11:39.919561+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T01:11:39.919561+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.919561+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:13.840279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314923,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":64470,"num_write":1037,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.316987+0000","last_change":"2024-09-12T01:11:46.316987+0000","last_active":"2024-09-12T01:11:46.316987+0000","last_peered":"2024-09-12T01:11:46.316987+0000","last_clean":"2024-09-12T01:11:46.316987+0000","last_became_active":"2024-09-12T00:30:15.125870+0000","last_became_peered":"2024-09-12T00:30:15.125870+0000","last_unstale":"2024-09-12T01:11:46.316987+0000","last_undegraded":"2024-09-12T01:11:46.316987+0000","last_fullsized":"2024-09-12T01:11:46.316987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.316891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.316891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.316891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:19.260779+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'277","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.627432+0000","last_change":"2024-09-12T00:30:17.149628+0000","last_active":"2024-09-12T01:11:22.627432+0000","last_peered":"2024-09-12T01:11:22.627432+0000","last_clean":"2024-09-12T01:11:22.627432+0000","last_became_active":"2024-09-12T00:30:17.149226+0000","last_became_peered":"2024-09-12T00:30:17.149226+0000","last_unstale":"2024-09-12T01:11:22.627432+0000","last_undegraded":"2024-09-12T01:11:22.627432+0000","last_fullsized":"2024-09-12T01:11:22.627432+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:10.554142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":1045,"num_write":368,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.606510+0000","last_change":"2024-09-12T00:30:19.164875+0000","last_active":"2024-09-12T01:09:03.606510+0000","last_peered":"2024-09-12T01:09:03.606510+0000","last_clean":"2024-09-12T01:09:03.606510+0000","last_became_active":"2024-09-12T00:30:19.164556+0000","last_became_peered":"2024-09-12T00:30:19.164556+0000","last_unstale":"2024-09-12T01:09:03.606510+0000","last_undegraded":"2024-09-12T01:09:03.606510+0000","last_fullsized":"2024-09-12T01:09:03.606510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:05.138428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'135","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.068765+0000","last_change":"2024-09-12T00:30:21.193857+0000","last_active":"2024-09-12T01:09:09.068765+0000","last_peered":"2024-09-12T01:09:09.068765+0000","last_clean":"2024-09-12T01:09:09.068765+0000","last_became_active":"2024-09-12T00:30:21.193606+0000","last_became_peered":"2024-09-12T00:30:21.193606+0000","last_unstale":"2024-09-12T01:09:09.068765+0000","last_undegraded":"2024-09-12T01:09:09.068765+0000","last_fullsized":"2024-09-12T01:09:09.068765+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:56.806530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":946,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":239,"num_write":347,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'4096","reported_seq":4679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.542179+0000","last_change":"2024-09-12T01:11:37.542179+0000","last_active":"2024-09-12T01:11:37.542179+0000","last_peered":"2024-09-12T01:11:37.542179+0000","last_clean":"2024-09-12T01:11:37.542179+0000","last_became_active":"2024-09-12T00:30:13.120940+0000","last_became_peered":"2024-09-12T00:30:13.120940+0000","last_unstale":"2024-09-12T01:11:37.542179+0000","last_undegraded":"2024-09-12T01:11:37.542179+0000","last_fullsized":"2024-09-12T01:11:37.542179+0000","mapping_epoch":28,"log_start":"264'4000","ondisk_log_start":"264'4000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4096","last_scrub_stamp":"2024-09-12T01:11:37.542072+0000","last_deep_scrub":"264'4096","last_deep_scrub_stamp":"2024-09-12T01:11:37.542072+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.542072+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:02.815247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16459,"num_read_kb":13812,"num_write":6134,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'369","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.291283+0000","last_change":"2024-09-12T01:11:35.291283+0000","last_active":"2024-09-12T01:11:35.291283+0000","last_peered":"2024-09-12T01:11:35.291283+0000","last_clean":"2024-09-12T01:11:35.291283+0000","last_became_active":"2024-09-12T00:30:11.098879+0000","last_became_peered":"2024-09-12T00:30:11.098879+0000","last_unstale":"2024-09-12T01:11:35.291283+0000","last_undegraded":"2024-09-12T01:11:35.291283+0000","last_fullsized":"2024-09-12T01:11:35.291283+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T01:11:35.291178+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T01:11:35.291178+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.291178+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.339007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4317103,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":44113,"num_write":1057,"num_write_kb":43739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409893+0000","last_change":"2024-09-12T00:30:15.125790+0000","last_active":"2024-09-12T01:08:58.409893+0000","last_peered":"2024-09-12T01:08:58.409893+0000","last_clean":"2024-09-12T01:08:58.409893+0000","last_became_active":"2024-09-12T00:30:15.125452+0000","last_became_peered":"2024-09-12T00:30:15.125452+0000","last_unstale":"2024-09-12T01:08:58.409893+0000","last_undegraded":"2024-09-12T01:08:58.409893+0000","last_fullsized":"2024-09-12T01:08:58.409893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:30.616035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'234","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.275770+0000","last_change":"2024-09-12T00:30:17.146683+0000","last_active":"2024-09-12T01:11:24.275770+0000","last_peered":"2024-09-12T01:11:24.275770+0000","last_clean":"2024-09-12T01:11:24.275770+0000","last_became_active":"2024-09-12T00:30:17.145961+0000","last_became_peered":"2024-09-12T00:30:17.145961+0000","last_unstale":"2024-09-12T01:11:24.275770+0000","last_undegraded":"2024-09-12T01:11:24.275770+0000","last_fullsized":"2024-09-12T01:11:24.275770+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:39.502275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":376,"num_read_kb":862,"num_write":304,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596405+0000","last_change":"2024-09-12T00:30:19.168010+0000","last_active":"2024-09-12T01:07:48.596405+0000","last_peered":"2024-09-12T01:07:48.596405+0000","last_clean":"2024-09-12T01:07:48.596405+0000","last_became_active":"2024-09-12T00:30:19.167723+0000","last_became_peered":"2024-09-12T00:30:19.167723+0000","last_unstale":"2024-09-12T01:07:48.596405+0000","last_undegraded":"2024-09-12T01:07:48.596405+0000","last_fullsized":"2024-09-12T01:07:48.596405+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:31.864085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'170","reported_seq":1614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:44.781840+0000","last_change":"2024-09-12T00:30:21.188654+0000","last_active":"2024-09-12T01:09:44.781840+0000","last_peered":"2024-09-12T01:09:44.781840+0000","last_clean":"2024-09-12T01:09:44.781840+0000","last_became_active":"2024-09-12T00:30:21.188363+0000","last_became_peered":"2024-09-12T00:30:21.188363+0000","last_unstale":"2024-09-12T01:09:44.781840+0000","last_undegraded":"2024-09-12T01:09:44.781840+0000","last_fullsized":"2024-09-12T01:09:44.781840+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:40.099921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1158,"num_read_kb":1157,"num_write":386,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'184","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.326891+0000","last_change":"2024-09-12T01:11:41.326891+0000","last_active":"2024-09-12T01:11:41.326891+0000","last_peered":"2024-09-12T01:11:41.326891+0000","last_clean":"2024-09-12T01:11:41.326891+0000","last_became_active":"2024-09-12T00:30:13.125727+0000","last_became_peered":"2024-09-12T00:30:13.125727+0000","last_unstale":"2024-09-12T01:11:41.326891+0000","last_undegraded":"2024-09-12T01:11:41.326891+0000","last_fullsized":"2024-09-12T01:11:41.326891+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-12T01:11:41.326789+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-12T01:11:41.326789+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.326789+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:11.817358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":704,"num_write":275,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'321","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.361524+0000","last_change":"2024-09-12T01:11:37.361524+0000","last_active":"2024-09-12T01:11:37.361524+0000","last_peered":"2024-09-12T01:11:37.361524+0000","last_clean":"2024-09-12T01:11:37.361524+0000","last_became_active":"2024-09-12T00:30:11.091808+0000","last_became_peered":"2024-09-12T00:30:11.091808+0000","last_unstale":"2024-09-12T01:11:37.361524+0000","last_undegraded":"2024-09-12T01:11:37.361524+0000","last_fullsized":"2024-09-12T01:11:37.361524+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T01:11:37.361380+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T01:11:37.361380+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.361380+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:30.917946+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380471,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":432,"num_read_kb":10679,"num_write":986,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.521489+0000","last_change":"2024-09-12T00:30:15.127289+0000","last_active":"2024-09-12T01:09:02.521489+0000","last_peered":"2024-09-12T01:09:02.521489+0000","last_clean":"2024-09-12T01:09:02.521489+0000","last_became_active":"2024-09-12T00:30:15.126206+0000","last_became_peered":"2024-09-12T00:30:15.126206+0000","last_unstale":"2024-09-12T01:09:02.521489+0000","last_undegraded":"2024-09-12T01:09:02.521489+0000","last_fullsized":"2024-09-12T01:09:02.521489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:14.104786+0000","last_clean_scrub_stamp":"2024-09-12T00:30:14.104786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:39.699331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'302","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.494698+0000","last_change":"2024-09-12T00:30:17.145025+0000","last_active":"2024-09-12T01:11:24.494698+0000","last_peered":"2024-09-12T01:11:24.494698+0000","last_clean":"2024-09-12T01:11:24.494698+0000","last_became_active":"2024-09-12T00:30:17.144724+0000","last_became_peered":"2024-09-12T00:30:17.144724+0000","last_unstale":"2024-09-12T01:11:24.494698+0000","last_undegraded":"2024-09-12T01:11:24.494698+0000","last_fullsized":"2024-09-12T01:11:24.494698+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.119185+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.119185+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:32.229866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48397,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":1068,"num_write":398,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:52.511636+0000","last_change":"2024-09-12T00:30:19.172540+0000","last_active":"2024-09-12T01:07:52.511636+0000","last_peered":"2024-09-12T01:07:52.511636+0000","last_clean":"2024-09-12T01:07:52.511636+0000","last_became_active":"2024-09-12T00:30:19.172265+0000","last_became_peered":"2024-09-12T00:30:19.172265+0000","last_unstale":"2024-09-12T01:07:52.511636+0000","last_undegraded":"2024-09-12T01:07:52.511636+0000","last_fullsized":"2024-09-12T01:07:52.511636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:34.189913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'129","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.303430+0000","last_change":"2024-09-12T00:30:21.192137+0000","last_active":"2024-09-12T01:10:50.303430+0000","last_peered":"2024-09-12T01:10:50.303430+0000","last_clean":"2024-09-12T01:10:50.303430+0000","last_became_active":"2024-09-12T00:30:21.191837+0000","last_became_peered":"2024-09-12T00:30:21.191837+0000","last_unstale":"2024-09-12T01:10:50.303430+0000","last_undegraded":"2024-09-12T01:10:50.303430+0000","last_fullsized":"2024-09-12T01:10:50.303430+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:51.812234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":99,"num_write":307,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'142","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.285051+0000","last_change":"2024-09-12T01:11:43.285051+0000","last_active":"2024-09-12T01:11:43.285051+0000","last_peered":"2024-09-12T01:11:43.285051+0000","last_clean":"2024-09-12T01:11:43.285051+0000","last_became_active":"2024-09-12T00:30:13.121828+0000","last_became_peered":"2024-09-12T00:30:13.121828+0000","last_unstale":"2024-09-12T01:11:43.285051+0000","last_undegraded":"2024-09-12T01:11:43.285051+0000","last_fullsized":"2024-09-12T01:11:43.285051+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T01:11:43.284952+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T01:11:43.284952+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.284952+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:06.141716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":656,"num_read_kb":543,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'369","reported_seq":1110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.422327+0000","last_change":"2024-09-12T01:11:33.422242+0000","last_active":"2024-09-12T01:11:33.422327+0000","last_peered":"2024-09-12T01:11:33.422327+0000","last_clean":"2024-09-12T01:11:33.422327+0000","last_became_active":"2024-09-12T00:30:11.105480+0000","last_became_peered":"2024-09-12T00:30:11.105480+0000","last_unstale":"2024-09-12T01:11:33.422327+0000","last_undegraded":"2024-09-12T01:11:33.422327+0000","last_fullsized":"2024-09-12T01:11:33.422327+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T01:11:33.422113+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T01:11:33.422113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.422113+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:29.910170+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029011,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":778,"num_read_kb":27112,"num_write":1220,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'88","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.550819+0000","last_change":"2024-09-12T01:11:40.550819+0000","last_active":"2024-09-12T01:11:40.550819+0000","last_peered":"2024-09-12T01:11:40.550819+0000","last_clean":"2024-09-12T01:11:40.550819+0000","last_became_active":"2024-09-12T00:30:13.130421+0000","last_became_peered":"2024-09-12T00:30:13.130421+0000","last_unstale":"2024-09-12T01:11:40.550819+0000","last_undegraded":"2024-09-12T01:11:40.550819+0000","last_fullsized":"2024-09-12T01:11:40.550819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'88","last_scrub_stamp":"2024-09-12T01:11:40.550737+0000","last_deep_scrub":"264'88","last_deep_scrub_stamp":"2024-09-12T01:11:40.550737+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.550737+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:24.149286+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":312,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'345","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.529826+0000","last_change":"2024-09-12T01:11:34.529826+0000","last_active":"2024-09-12T01:11:34.529826+0000","last_peered":"2024-09-12T01:11:34.529826+0000","last_clean":"2024-09-12T01:11:34.529826+0000","last_became_active":"2024-09-12T00:30:11.092318+0000","last_became_peered":"2024-09-12T00:30:11.092318+0000","last_unstale":"2024-09-12T01:11:34.529826+0000","last_undegraded":"2024-09-12T01:11:34.529826+0000","last_fullsized":"2024-09-12T01:11:34.529826+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T01:11:34.529704+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T01:11:34.529704+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.529704+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:03.024603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287236,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":12148,"num_write":1066,"num_write_kb":57585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'403","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:27.766486+0000","last_change":"2024-09-12T00:30:13.127156+0000","last_active":"2024-09-12T01:09:27.766486+0000","last_peered":"2024-09-12T01:09:27.766486+0000","last_clean":"2024-09-12T01:09:27.766486+0000","last_became_active":"2024-09-12T00:30:13.126912+0000","last_became_peered":"2024-09-12T00:30:13.126912+0000","last_unstale":"2024-09-12T01:09:27.766486+0000","last_undegraded":"2024-09-12T01:09:27.766486+0000","last_fullsized":"2024-09-12T01:09:27.766486+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:42.227244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1731,"num_read_kb":1377,"num_write":679,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'430","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.905031+0000","last_change":"2024-09-12T01:11:42.905031+0000","last_active":"2024-09-12T01:11:42.905031+0000","last_peered":"2024-09-12T01:11:42.905031+0000","last_clean":"2024-09-12T01:11:42.905031+0000","last_became_active":"2024-09-12T00:30:11.099069+0000","last_became_peered":"2024-09-12T00:30:11.099069+0000","last_unstale":"2024-09-12T01:11:42.905031+0000","last_undegraded":"2024-09-12T01:11:42.905031+0000","last_fullsized":"2024-09-12T01:11:42.905031+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-09-12T01:11:42.904875+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-09-12T01:11:42.904875+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.904875+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:17.846461+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380696,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":691,"num_read_kb":70901,"num_write":1282,"num_write_kb":51705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'117","reported_seq":693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.482213+0000","last_change":"2024-09-12T00:30:13.127130+0000","last_active":"2024-09-12T01:09:12.482213+0000","last_peered":"2024-09-12T01:09:12.482213+0000","last_clean":"2024-09-12T01:09:12.482213+0000","last_became_active":"2024-09-12T00:30:13.126860+0000","last_became_peered":"2024-09-12T00:30:13.126860+0000","last_unstale":"2024-09-12T01:09:12.482213+0000","last_undegraded":"2024-09-12T01:09:12.482213+0000","last_fullsized":"2024-09-12T01:09:12.482213+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:11.846692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":463,"num_write":200,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'328","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.324299+0000","last_change":"2024-09-12T01:11:38.324299+0000","last_active":"2024-09-12T01:11:38.324299+0000","last_peered":"2024-09-12T01:11:38.324299+0000","last_clean":"2024-09-12T01:11:38.324299+0000","last_became_active":"2024-09-12T00:30:11.105196+0000","last_became_peered":"2024-09-12T00:30:11.105196+0000","last_unstale":"2024-09-12T01:11:38.324299+0000","last_undegraded":"2024-09-12T01:11:38.324299+0000","last_fullsized":"2024-09-12T01:11:38.324299+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'328","last_scrub_stamp":"2024-09-12T01:11:38.324193+0000","last_deep_scrub":"264'328","last_deep_scrub_stamp":"2024-09-12T01:11:38.324193+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.324193+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.266767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":8473,"num_write":1002,"num_write_kb":46203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'4191","reported_seq":4832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:46.275772+0000","last_change":"2024-09-12T00:30:13.125779+0000","last_active":"2024-09-12T01:09:46.275772+0000","last_peered":"2024-09-12T01:09:46.275772+0000","last_clean":"2024-09-12T01:09:46.275772+0000","last_became_active":"2024-09-12T00:30:13.125353+0000","last_became_peered":"2024-09-12T00:30:13.125353+0000","last_unstale":"2024-09-12T01:09:46.275772+0000","last_undegraded":"2024-09-12T01:09:46.275772+0000","last_fullsized":"2024-09-12T01:09:46.275772+0000","mapping_epoch":28,"log_start":"264'4100","ondisk_log_start":"264'4100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":3000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:27.342797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16885,"num_read_kb":14166,"num_write":6282,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'387","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.090306+0000","last_change":"2024-09-12T01:11:34.090306+0000","last_active":"2024-09-12T01:11:34.090306+0000","last_peered":"2024-09-12T01:11:34.090306+0000","last_clean":"2024-09-12T01:11:34.090306+0000","last_became_active":"2024-09-12T00:30:11.108127+0000","last_became_peered":"2024-09-12T00:30:11.108127+0000","last_unstale":"2024-09-12T01:11:34.090306+0000","last_undegraded":"2024-09-12T01:11:34.090306+0000","last_fullsized":"2024-09-12T01:11:34.090306+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'387","last_scrub_stamp":"2024-09-12T01:11:34.090152+0000","last_deep_scrub":"264'387","last_deep_scrub_stamp":"2024-09-12T01:11:34.090152+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.090152+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.953945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105411,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":473,"num_read_kb":2771,"num_write":1102,"num_write_kb":29841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'185","reported_seq":784,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.371298+0000","last_change":"2024-09-12T01:11:41.371298+0000","last_active":"2024-09-12T01:11:41.371298+0000","last_peered":"2024-09-12T01:11:41.371298+0000","last_clean":"2024-09-12T01:11:41.371298+0000","last_became_active":"2024-09-12T00:30:13.129432+0000","last_became_peered":"2024-09-12T00:30:13.129432+0000","last_unstale":"2024-09-12T01:11:41.371298+0000","last_undegraded":"2024-09-12T01:11:41.371298+0000","last_fullsized":"2024-09-12T01:11:41.371298+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T01:11:41.371181+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T01:11:41.371181+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.371181+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:10.754863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":694,"num_write":316,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'364","reported_seq":1080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.098210+0000","last_change":"2024-09-12T01:11:36.098210+0000","last_active":"2024-09-12T01:11:36.098210+0000","last_peered":"2024-09-12T01:11:36.098210+0000","last_clean":"2024-09-12T01:11:36.098210+0000","last_became_active":"2024-09-12T00:30:11.108351+0000","last_became_peered":"2024-09-12T00:30:11.108351+0000","last_unstale":"2024-09-12T01:11:36.098210+0000","last_undegraded":"2024-09-12T01:11:36.098210+0000","last_fullsized":"2024-09-12T01:11:36.098210+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-12T01:11:36.098005+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-12T01:11:36.098005+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.098005+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:33.871781+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648362,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":667,"num_read_kb":30774,"num_write":1247,"num_write_kb":36026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'164","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.102484+0000","last_change":"2024-09-12T01:11:47.102484+0000","last_active":"2024-09-12T01:11:47.102484+0000","last_peered":"2024-09-12T01:11:47.102484+0000","last_clean":"2024-09-12T01:11:47.102484+0000","last_became_active":"2024-09-12T00:30:13.124637+0000","last_became_peered":"2024-09-12T00:30:13.124637+0000","last_unstale":"2024-09-12T01:11:47.102484+0000","last_undegraded":"2024-09-12T01:11:47.102484+0000","last_fullsized":"2024-09-12T01:11:47.102484+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-12T01:11:47.102372+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-12T01:11:47.102372+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.102372+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:35.485046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":588,"num_write":241,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'372","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.386029+0000","last_change":"2024-09-12T01:11:38.386029+0000","last_active":"2024-09-12T01:11:38.386029+0000","last_peered":"2024-09-12T01:11:38.386029+0000","last_clean":"2024-09-12T01:11:38.386029+0000","last_became_active":"2024-09-12T00:30:11.108084+0000","last_became_peered":"2024-09-12T00:30:11.108084+0000","last_unstale":"2024-09-12T01:11:38.386029+0000","last_undegraded":"2024-09-12T01:11:38.386029+0000","last_fullsized":"2024-09-12T01:11:38.386029+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T01:11:38.385902+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T01:11:38.385902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.385902+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:00.631378+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5025600,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":616,"num_read_kb":11433,"num_write":1237,"num_write_kb":28830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'237","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.845384+0000","last_change":"2024-09-12T01:11:36.845384+0000","last_active":"2024-09-12T01:11:36.845384+0000","last_peered":"2024-09-12T01:11:36.845384+0000","last_clean":"2024-09-12T01:11:36.845384+0000","last_became_active":"2024-09-12T00:30:13.128799+0000","last_became_peered":"2024-09-12T00:30:13.128799+0000","last_unstale":"2024-09-12T01:11:36.845384+0000","last_undegraded":"2024-09-12T01:11:36.845384+0000","last_fullsized":"2024-09-12T01:11:36.845384+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-09-12T01:11:36.845275+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-09-12T01:11:36.845275+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.845275+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.874151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":871,"num_write":360,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'352","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.309076+0000","last_change":"2024-09-12T01:11:39.309076+0000","last_active":"2024-09-12T01:11:39.309076+0000","last_peered":"2024-09-12T01:11:39.309076+0000","last_clean":"2024-09-12T01:11:39.309076+0000","last_became_active":"2024-09-12T00:30:11.102617+0000","last_became_peered":"2024-09-12T00:30:11.102617+0000","last_unstale":"2024-09-12T01:11:39.309076+0000","last_undegraded":"2024-09-12T01:11:39.309076+0000","last_fullsized":"2024-09-12T01:11:39.309076+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-12T01:11:39.308936+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-12T01:11:39.308936+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.308936+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:27.572801+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364846,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":18671,"num_write":1023,"num_write_kb":28835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'52","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.555361+0000","last_change":"2024-09-12T01:11:41.555361+0000","last_active":"2024-09-12T01:11:41.555361+0000","last_peered":"2024-09-12T01:11:41.555361+0000","last_clean":"2024-09-12T01:11:41.555361+0000","last_became_active":"2024-09-12T00:30:13.123035+0000","last_became_peered":"2024-09-12T00:30:13.123035+0000","last_unstale":"2024-09-12T01:11:41.555361+0000","last_undegraded":"2024-09-12T01:11:41.555361+0000","last_fullsized":"2024-09-12T01:11:41.555361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T01:11:41.555280+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T01:11:41.555280+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.555280+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:57.286919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":222,"num_write":77,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'336","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.894219+0000","last_change":"2024-09-12T01:11:43.894219+0000","last_active":"2024-09-12T01:11:43.894219+0000","last_peered":"2024-09-12T01:11:43.894219+0000","last_clean":"2024-09-12T01:11:43.894219+0000","last_became_active":"2024-09-12T00:30:11.110299+0000","last_became_peered":"2024-09-12T00:30:11.110299+0000","last_unstale":"2024-09-12T01:11:43.894219+0000","last_undegraded":"2024-09-12T01:11:43.894219+0000","last_fullsized":"2024-09-12T01:11:43.894219+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-12T01:11:43.894098+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-12T01:11:43.894098+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.894098+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:37.338640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":443,"num_read_kb":30015,"num_write":1046,"num_write_kb":30187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'180","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.406375+0000","last_change":"2024-09-12T01:11:39.406375+0000","last_active":"2024-09-12T01:11:39.406375+0000","last_peered":"2024-09-12T01:11:39.406375+0000","last_clean":"2024-09-12T01:11:39.406375+0000","last_became_active":"2024-09-12T00:30:13.123217+0000","last_became_peered":"2024-09-12T00:30:13.123217+0000","last_unstale":"2024-09-12T01:11:39.406375+0000","last_undegraded":"2024-09-12T01:11:39.406375+0000","last_fullsized":"2024-09-12T01:11:39.406375+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T01:11:39.406291+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T01:11:39.406291+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.406291+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.832105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":608,"num_write":257,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'316","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.267042+0000","last_change":"2024-09-12T01:11:40.267042+0000","last_active":"2024-09-12T01:11:40.267042+0000","last_peered":"2024-09-12T01:11:40.267042+0000","last_clean":"2024-09-12T01:11:40.267042+0000","last_became_active":"2024-09-12T00:30:11.102436+0000","last_became_peered":"2024-09-12T00:30:11.102436+0000","last_unstale":"2024-09-12T01:11:40.267042+0000","last_undegraded":"2024-09-12T01:11:40.267042+0000","last_fullsized":"2024-09-12T01:11:40.267042+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T01:11:40.266922+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T01:11:40.266922+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.266922+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:22.297560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315002,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":79108,"num_write":1106,"num_write_kb":40469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'217","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:32.852926+0000","last_change":"2024-09-12T00:30:13.130944+0000","last_active":"2024-09-12T01:09:32.852926+0000","last_peered":"2024-09-12T01:09:32.852926+0000","last_clean":"2024-09-12T01:09:32.852926+0000","last_became_active":"2024-09-12T00:30:13.129733+0000","last_became_peered":"2024-09-12T00:30:13.129733+0000","last_unstale":"2024-09-12T01:09:32.852926+0000","last_undegraded":"2024-09-12T01:09:32.852926+0000","last_fullsized":"2024-09-12T01:09:32.852926+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:12.088810+0000","last_clean_scrub_stamp":"2024-09-12T00:30:12.088810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.671267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":953,"num_read_kb":786,"num_write":335,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'382","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.875020+0000","last_change":"2024-09-12T01:11:35.875020+0000","last_active":"2024-09-12T01:11:35.875020+0000","last_peered":"2024-09-12T01:11:35.875020+0000","last_clean":"2024-09-12T01:11:35.875020+0000","last_became_active":"2024-09-12T00:30:11.105950+0000","last_became_peered":"2024-09-12T00:30:11.105950+0000","last_unstale":"2024-09-12T01:11:35.875020+0000","last_undegraded":"2024-09-12T01:11:35.875020+0000","last_fullsized":"2024-09-12T01:11:35.875020+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-12T01:11:35.874867+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-12T01:11:35.874867+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.874867+0000","objects_scrubbed":12,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:15.332168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4299828,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":589,"num_read_kb":20762,"num_write":1342,"num_write_kb":32414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'173","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.878947+0000","last_change":"2024-09-12T01:11:40.878947+0000","last_active":"2024-09-12T01:11:40.878947+0000","last_peered":"2024-09-12T01:11:40.878947+0000","last_clean":"2024-09-12T01:11:40.878947+0000","last_became_active":"2024-09-12T00:30:13.128009+0000","last_became_peered":"2024-09-12T00:30:13.128009+0000","last_unstale":"2024-09-12T01:11:40.878947+0000","last_undegraded":"2024-09-12T01:11:40.878947+0000","last_fullsized":"2024-09-12T01:11:40.878947+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-12T01:11:40.878859+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-12T01:11:40.878859+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.878859+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:39.949418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":738,"num_read_kb":604,"num_write":258,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'395","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.263014+0000","last_change":"2024-09-12T01:11:38.263014+0000","last_active":"2024-09-12T01:11:38.263014+0000","last_peered":"2024-09-12T01:11:38.263014+0000","last_clean":"2024-09-12T01:11:38.263014+0000","last_became_active":"2024-09-12T00:30:11.096908+0000","last_became_peered":"2024-09-12T00:30:11.096908+0000","last_unstale":"2024-09-12T01:11:38.263014+0000","last_undegraded":"2024-09-12T01:11:38.263014+0000","last_fullsized":"2024-09-12T01:11:38.263014+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-12T01:11:38.262881+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-12T01:11:38.262881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.262881+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:54.179820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":27824,"num_write":1325,"num_write_kb":35997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'130","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.865328+0000","last_change":"2024-09-12T01:11:38.865328+0000","last_active":"2024-09-12T01:11:38.865328+0000","last_peered":"2024-09-12T01:11:38.865328+0000","last_clean":"2024-09-12T01:11:38.865328+0000","last_became_active":"2024-09-12T00:30:13.126817+0000","last_became_peered":"2024-09-12T00:30:13.126817+0000","last_unstale":"2024-09-12T01:11:38.865328+0000","last_undegraded":"2024-09-12T01:11:38.865328+0000","last_fullsized":"2024-09-12T01:11:38.865328+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T01:11:38.865238+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T01:11:38.865238+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.865238+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:46.059324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":588,"num_read_kb":486,"num_write":195,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'337","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.427130+0000","last_change":"2024-09-12T01:11:30.427130+0000","last_active":"2024-09-12T01:11:30.427130+0000","last_peered":"2024-09-12T01:11:30.427130+0000","last_clean":"2024-09-12T01:11:30.427130+0000","last_became_active":"2024-09-12T00:30:11.105575+0000","last_became_peered":"2024-09-12T00:30:11.105575+0000","last_unstale":"2024-09-12T01:11:30.427130+0000","last_undegraded":"2024-09-12T01:11:30.427130+0000","last_fullsized":"2024-09-12T01:11:30.427130+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T01:11:30.427034+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T01:11:30.427034+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.427034+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:04.883192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":45130,"num_write":1156,"num_write_kb":46621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'202","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.577784+0000","last_change":"2024-09-12T01:11:42.577784+0000","last_active":"2024-09-12T01:11:42.577784+0000","last_peered":"2024-09-12T01:11:42.577784+0000","last_clean":"2024-09-12T01:11:42.577784+0000","last_became_active":"2024-09-12T00:30:13.129092+0000","last_became_peered":"2024-09-12T00:30:13.129092+0000","last_unstale":"2024-09-12T01:11:42.577784+0000","last_undegraded":"2024-09-12T01:11:42.577784+0000","last_fullsized":"2024-09-12T01:11:42.577784+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T01:11:42.577693+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T01:11:42.577693+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.577693+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:29.344845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":854,"num_read_kb":707,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'347","reported_seq":1195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.846455+0000","last_change":"2024-09-12T01:11:44.846455+0000","last_active":"2024-09-12T01:11:44.846455+0000","last_peered":"2024-09-12T01:11:44.846455+0000","last_clean":"2024-09-12T01:11:44.846455+0000","last_became_active":"2024-09-12T00:30:11.108616+0000","last_became_peered":"2024-09-12T00:30:11.108616+0000","last_unstale":"2024-09-12T01:11:44.846455+0000","last_undegraded":"2024-09-12T01:11:44.846455+0000","last_fullsized":"2024-09-12T01:11:44.846455+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:44.846295+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:44.846295+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.846295+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:52.600725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":955,"num_read_kb":21858,"num_write":1152,"num_write_kb":27958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'147","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.265816+0000","last_change":"2024-09-12T01:11:44.265816+0000","last_active":"2024-09-12T01:11:44.265816+0000","last_peered":"2024-09-12T01:11:44.265816+0000","last_clean":"2024-09-12T01:11:44.265816+0000","last_became_active":"2024-09-12T00:30:13.125887+0000","last_became_peered":"2024-09-12T00:30:13.125887+0000","last_unstale":"2024-09-12T01:11:44.265816+0000","last_undegraded":"2024-09-12T01:11:44.265816+0000","last_fullsized":"2024-09-12T01:11:44.265816+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T01:11:44.265735+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T01:11:44.265735+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.265735+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:34.728050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":559,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'335","reported_seq":1012,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.555016+0000","last_change":"2024-09-12T01:11:36.555016+0000","last_active":"2024-09-12T01:11:36.555016+0000","last_peered":"2024-09-12T01:11:36.555016+0000","last_clean":"2024-09-12T01:11:36.555016+0000","last_became_active":"2024-09-12T00:30:46.396288+0000","last_became_peered":"2024-09-12T00:30:46.396288+0000","last_unstale":"2024-09-12T01:11:36.555016+0000","last_undegraded":"2024-09-12T01:11:36.555016+0000","last_fullsized":"2024-09-12T01:11:36.555016+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T01:11:36.554891+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T01:11:36.554891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.554891+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:31.851264+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8687076,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":21015,"num_write":1060,"num_write_kb":30668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'251","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.851278+0000","last_change":"2024-09-12T01:11:37.851278+0000","last_active":"2024-09-12T01:11:37.851278+0000","last_peered":"2024-09-12T01:11:37.851278+0000","last_clean":"2024-09-12T01:11:37.851278+0000","last_became_active":"2024-09-12T00:30:13.127513+0000","last_became_peered":"2024-09-12T00:30:13.127513+0000","last_unstale":"2024-09-12T01:11:37.851278+0000","last_undegraded":"2024-09-12T01:11:37.851278+0000","last_fullsized":"2024-09-12T01:11:37.851278+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T01:11:37.851124+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T01:11:37.851124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.851124+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:02.058983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":791,"num_write":358,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8300,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'328","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.688230+0000","last_change":"2024-09-12T00:30:11.110035+0000","last_active":"2024-09-12T01:11:24.688230+0000","last_peered":"2024-09-12T01:11:24.688230+0000","last_clean":"2024-09-12T01:11:24.688230+0000","last_became_active":"2024-09-12T00:30:11.109661+0000","last_became_peered":"2024-09-12T00:30:11.109661+0000","last_unstale":"2024-09-12T01:11:24.688230+0000","last_undegraded":"2024-09-12T01:11:24.688230+0000","last_fullsized":"2024-09-12T01:11:24.688230+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:10.061545+0000","last_clean_scrub_stamp":"2024-09-12T00:30:10.061545+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:51.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":8210,"num_write":1080,"num_write_kb":36173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'315","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.811270+0000","last_change":"2024-09-12T01:11:45.811270+0000","last_active":"2024-09-12T01:11:45.811270+0000","last_peered":"2024-09-12T01:11:45.811270+0000","last_clean":"2024-09-12T01:11:45.811270+0000","last_became_active":"2024-09-12T00:30:11.113173+0000","last_became_peered":"2024-09-12T00:30:11.113173+0000","last_unstale":"2024-09-12T01:11:45.811270+0000","last_undegraded":"2024-09-12T01:11:45.811270+0000","last_fullsized":"2024-09-12T01:11:45.811270+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T01:11:45.811155+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T01:11:45.811155+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.811155+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:57.504861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":50214,"num_write":1057,"num_write_kb":47204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'24","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.282085+0000","last_change":"2024-09-12T01:11:45.282085+0000","last_active":"2024-09-12T01:11:45.282085+0000","last_peered":"2024-09-12T01:11:45.282085+0000","last_clean":"2024-09-12T01:11:45.282085+0000","last_became_active":"2024-09-12T00:30:13.126264+0000","last_became_peered":"2024-09-12T00:30:13.126264+0000","last_unstale":"2024-09-12T01:11:45.282085+0000","last_undegraded":"2024-09-12T01:11:45.282085+0000","last_fullsized":"2024-09-12T01:11:45.282085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T01:11:45.281991+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T01:11:45.281991+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.281991+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:59.791991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":113,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'377","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.282638+0000","last_change":"2024-09-12T01:11:41.282638+0000","last_active":"2024-09-12T01:11:41.282638+0000","last_peered":"2024-09-12T01:11:41.282638+0000","last_clean":"2024-09-12T01:11:41.282638+0000","last_became_active":"2024-09-12T00:30:11.102026+0000","last_became_peered":"2024-09-12T00:30:11.102026+0000","last_unstale":"2024-09-12T01:11:41.282638+0000","last_undegraded":"2024-09-12T01:11:41.282638+0000","last_fullsized":"2024-09-12T01:11:41.282638+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-12T01:11:41.282464+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-12T01:11:41.282464+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.282464+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:04.065353+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4360630,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":672,"num_read_kb":9482,"num_write":1213,"num_write_kb":28977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'250","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.895038+0000","last_change":"2024-09-12T01:11:42.895038+0000","last_active":"2024-09-12T01:11:42.895038+0000","last_peered":"2024-09-12T01:11:42.895038+0000","last_clean":"2024-09-12T01:11:42.895038+0000","last_became_active":"2024-09-12T00:30:13.119872+0000","last_became_peered":"2024-09-12T00:30:13.119872+0000","last_unstale":"2024-09-12T01:11:42.895038+0000","last_undegraded":"2024-09-12T01:11:42.895038+0000","last_fullsized":"2024-09-12T01:11:42.895038+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-12T01:11:42.894943+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-12T01:11:42.894943+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.894943+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.400595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":987,"num_write":428,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5946,"num_read_kb":4236,"num_write":1962,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1033,"ondisk_log_size":1033,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15005,"num_read_kb":14670,"num_write":16786,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1559,"ondisk_log_size":1559,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548725,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17648,"num_read_kb":36949,"num_write":14701,"num_write_kb":11551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":519878,"num_omap_keys":1184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1969,"ondisk_log_size":1969,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102018,"num_read_kb":85254,"num_write":36979,"num_write_kb":18604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43809,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4243,"ondisk_log_size":4243,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":166688013,"num_objects":400,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":400,"num_whiteouts":0,"num_read":36140,"num_read_kb":1917452,"num_write":72064,"num_write_kb":2191736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":224706560,"data_stored":224706560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3667,"ondisk_log_size":3667,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170064,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168795,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509951,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264752,"kb_used_data":35040,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94107088,"statfs":{"total":96636764160,"available":96365658112,"internally_reserved":0,"allocated":35880960,"data_stored":33872164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509948,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337592,"kb_used_data":31528,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94034248,"statfs":{"total":96636764160,"available":96291069952,"internally_reserved":0,"allocated":32284672,"data_stored":30297333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509948,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156088,"kb_used_data":34728,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94215752,"statfs":{"total":96636764160,"available":96476930048,"internally_reserved":0,"allocated":35561472,"data_stored":33552270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542653,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252368,"kb_used_data":32448,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94119472,"statfs":{"total":96636764160,"available":96378339328,"internally_reserved":0,"allocated":33226752,"data_stored":31260225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542652,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151548,"kb_used_data":21868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94220292,"statfs":{"total":96636764160,"available":96481579008,"internally_reserved":0,"allocated":22392832,"data_stored":20398857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542650,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289684,"kb_used_data":33604,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94082156,"statfs":{"total":96636764160,"available":96340127744,"internally_reserved":0,"allocated":34410496,"data_stored":32405240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262207941},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542653,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251100,"kb_used_data":31180,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94120740,"statfs":{"total":96636764160,"available":96379637760,"internally_reserved":0,"allocated":31928320,"data_stored":29931227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225180101},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575357,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172604,"kb_used_data":33132,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94199236,"statfs":{"total":96636764160,"available":96460017664,"internally_reserved":0,"allocated":33927168,"data_stored":31936990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31330304,"data_stored":31330304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27488256,"data_stored":27488256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29716480,"data_stored":29716480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31649792,"data_stored":31649792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":27709440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29593600,"data_stored":29593600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18178048,"data_stored":18178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29040640,"data_stored":29040640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:53.236 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.236 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.236 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.237 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.238 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.238 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.238 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.238 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.238 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.238 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.238 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.238 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.239 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.239 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.239 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.239 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.239 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.239 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.239 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.239 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.239 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.240 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.241 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.241 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.241 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.241 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.241 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.241 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.241 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.241 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.241 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.242 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.243 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.243 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.243 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.243 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.243 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.243 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.243 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.243 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.243 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.244 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.245 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.245 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.245 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.245 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.245 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.245 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.245 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.245 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.246 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.247 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.248 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.248 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.248 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.248 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.248 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.248 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.248 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.248 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.248 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.249 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.250 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.250 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.250 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.250 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.250 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.250 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.250 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.250 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.251 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.251 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.251 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.251 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.251 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.251 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.251 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.251 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.252 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.253 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.253 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.253 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.253 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.253 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.253 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.253 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.254 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.254 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.254 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.254 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.254 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.254 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.254 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.254 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.254 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.255 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.255 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.255 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.255 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.255 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.255 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.255 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.255 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.256 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.256 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.256 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.256 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.256 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.256 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.256 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.256 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.257 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.257 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.257 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.257 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.257 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.257 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.257 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.258 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.258 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.258 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.258 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.258 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.258 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.258 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.258 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.259 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.259 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.259 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.259 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.259 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.259 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.259 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.259 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.259 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.260 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.260 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.260 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.260 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.260 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.260 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.260 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.260 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.260 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.261 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.261 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.261 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.261 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.261 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.261 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.261 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.261 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.262 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.262 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.262 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.262 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.262 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.262 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.262 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.262 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.262 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.263 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.263 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.263 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.263 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.263 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.263 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.263 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.263 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:30:14.104786+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.264 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:30:16.119185+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.264 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.264 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.264 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.264 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.264 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.264 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:30:12.088810+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.265 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:30:10.061545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=10, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:53.265 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:12:13.266 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:12:13.601 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:12:13.612 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T01:12:13.615 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":1527,"stamp":"2024-09-12T01:12:12.253302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":168845237,"num_objects":756,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":179589,"num_read_kb":2400386,"num_write":143007,"num_write_kb":2482898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":737676,"num_omap_keys":1776,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13342,"ondisk_log_size":13342,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1879896,"kb_used_data":253528,"kb_used_omap":12,"kb_used_meta":1626227,"kb_avail":753094824,"statfs":{"total":773094113280,"available":771169099776,"internally_reserved":0,"allocated":259612672,"data_stored":243654306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1665257010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":126432,"num_omap_keys":309,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005845"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.170470+0000","last_change":"2024-09-12T01:12:06.170470+0000","last_active":"2024-09-12T01:12:06.170470+0000","last_peered":"2024-09-12T01:12:06.170470+0000","last_clean":"2024-09-12T01:12:06.170470+0000","last_became_active":"2024-09-12T00:56:52.990975+0000","last_became_peered":"2024-09-12T00:56:52.990975+0000","last_unstale":"2024-09-12T01:12:06.170470+0000","last_undegraded":"2024-09-12T01:12:06.170470+0000","last_fullsized":"2024-09-12T01:12:06.170470+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:06.170381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:06.170381+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.170381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:41.174560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.769515+0000","last_change":"2024-09-12T01:12:05.769515+0000","last_active":"2024-09-12T01:12:05.769515+0000","last_peered":"2024-09-12T01:12:05.769515+0000","last_clean":"2024-09-12T01:12:05.769515+0000","last_became_active":"2024-09-12T00:46:19.284774+0000","last_became_peered":"2024-09-12T00:46:19.284774+0000","last_unstale":"2024-09-12T01:12:05.769515+0000","last_undegraded":"2024-09-12T01:12:05.769515+0000","last_fullsized":"2024-09-12T01:12:05.769515+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:05.769422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:05.769422+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.769422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.065734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.410391+0000","last_change":"2024-09-12T00:46:16.275794+0000","last_active":"2024-09-12T01:11:18.410391+0000","last_peered":"2024-09-12T01:11:18.410391+0000","last_clean":"2024-09-12T01:11:18.410391+0000","last_became_active":"2024-09-12T00:46:16.275529+0000","last_became_peered":"2024-09-12T00:46:16.275529+0000","last_unstale":"2024-09-12T01:11:18.410391+0000","last_undegraded":"2024-09-12T01:11:18.410391+0000","last_fullsized":"2024-09-12T01:11:18.410391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:10.602032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'24","reported_seq":105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:37.526703+0000","last_change":"2024-09-12T00:44:37.816651+0000","last_active":"2024-09-12T01:09:37.526703+0000","last_peered":"2024-09-12T01:09:37.526703+0000","last_clean":"2024-09-12T01:09:37.526703+0000","last_became_active":"2024-09-12T00:44:37.816192+0000","last_became_peered":"2024-09-12T00:44:37.816192+0000","last_unstale":"2024-09-12T01:09:37.526703+0000","last_undegraded":"2024-09-12T01:09:37.526703+0000","last_fullsized":"2024-09-12T01:09:37.526703+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.394310+0000","last_change":"2024-09-12T00:56:52.996167+0000","last_active":"2024-09-12T01:09:22.394310+0000","last_peered":"2024-09-12T01:09:22.394310+0000","last_clean":"2024-09-12T01:09:22.394310+0000","last_became_active":"2024-09-12T00:56:52.995871+0000","last_became_peered":"2024-09-12T00:56:52.995871+0000","last_unstale":"2024-09-12T01:09:22.394310+0000","last_undegraded":"2024-09-12T01:09:22.394310+0000","last_fullsized":"2024-09-12T01:09:22.394310+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.308551+0000","last_change":"2024-09-12T01:12:11.308551+0000","last_active":"2024-09-12T01:12:11.308551+0000","last_peered":"2024-09-12T01:12:11.308551+0000","last_clean":"2024-09-12T01:12:11.308551+0000","last_became_active":"2024-09-12T00:46:19.284875+0000","last_became_peered":"2024-09-12T00:46:19.284875+0000","last_unstale":"2024-09-12T01:12:11.308551+0000","last_undegraded":"2024-09-12T01:12:11.308551+0000","last_fullsized":"2024-09-12T01:12:11.308551+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:11.308438+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:11.308438+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.308438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:14.759811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.478299+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:08:47.478299+0000","last_peered":"2024-09-12T01:08:47.478299+0000","last_clean":"2024-09-12T01:08:47.478299+0000","last_became_active":"2024-09-12T00:46:16.275381+0000","last_became_peered":"2024-09-12T00:46:16.275381+0000","last_unstale":"2024-09-12T01:08:47.478299+0000","last_undegraded":"2024-09-12T01:08:47.478299+0000","last_fullsized":"2024-09-12T01:08:47.478299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.675654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'45","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:56.444239+0000","last_change":"2024-09-12T00:44:37.819913+0000","last_active":"2024-09-12T01:08:56.444239+0000","last_peered":"2024-09-12T01:08:56.444239+0000","last_clean":"2024-09-12T01:08:56.444239+0000","last_became_active":"2024-09-12T00:44:37.819561+0000","last_became_peered":"2024-09-12T00:44:37.819561+0000","last_unstale":"2024-09-12T01:08:56.444239+0000","last_undegraded":"2024-09-12T01:08:56.444239+0000","last_fullsized":"2024-09-12T01:08:56.444239+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:18.208589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":164,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.409863+0000","last_change":"2024-09-12T00:56:52.990647+0000","last_active":"2024-09-12T01:08:58.409863+0000","last_peered":"2024-09-12T01:08:58.409863+0000","last_clean":"2024-09-12T01:08:58.409863+0000","last_became_active":"2024-09-12T00:56:52.990364+0000","last_became_peered":"2024-09-12T00:56:52.990364+0000","last_unstale":"2024-09-12T01:08:58.409863+0000","last_undegraded":"2024-09-12T01:08:58.409863+0000","last_fullsized":"2024-09-12T01:08:58.409863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:34.228970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.557370+0000","last_change":"2024-09-12T00:46:19.285614+0000","last_active":"2024-09-12T01:11:22.557370+0000","last_peered":"2024-09-12T01:11:22.557370+0000","last_clean":"2024-09-12T01:11:22.557370+0000","last_became_active":"2024-09-12T00:46:19.285357+0000","last_became_peered":"2024-09-12T00:46:19.285357+0000","last_unstale":"2024-09-12T01:11:22.557370+0000","last_undegraded":"2024-09-12T01:11:22.557370+0000","last_fullsized":"2024-09-12T01:11:22.557370+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:02.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.384512+0000","last_change":"2024-09-12T00:46:16.278495+0000","last_active":"2024-09-12T01:08:18.384512+0000","last_peered":"2024-09-12T01:08:18.384512+0000","last_clean":"2024-09-12T01:08:18.384512+0000","last_became_active":"2024-09-12T00:46:16.278221+0000","last_became_peered":"2024-09-12T00:46:16.278221+0000","last_unstale":"2024-09-12T01:08:18.384512+0000","last_undegraded":"2024-09-12T01:08:18.384512+0000","last_fullsized":"2024-09-12T01:08:18.384512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:42.560119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5130,"num_write":12,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'37","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.289433+0000","last_change":"2024-09-12T01:12:07.289367+0000","last_active":"2024-09-12T01:12:07.289433+0000","last_peered":"2024-09-12T01:12:07.289433+0000","last_clean":"2024-09-12T01:12:07.289433+0000","last_became_active":"2024-09-12T00:44:37.818239+0000","last_became_peered":"2024-09-12T00:44:37.818239+0000","last_unstale":"2024-09-12T01:12:07.289433+0000","last_undegraded":"2024-09-12T01:12:07.289433+0000","last_fullsized":"2024-09-12T01:12:07.289433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-12T01:12:07.289241+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-12T01:12:07.289241+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.289241+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.374834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":144,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.480542+0000","last_change":"2024-09-12T00:56:52.995412+0000","last_active":"2024-09-12T01:09:02.480542+0000","last_peered":"2024-09-12T01:09:02.480542+0000","last_clean":"2024-09-12T01:09:02.480542+0000","last_became_active":"2024-09-12T00:56:52.995062+0000","last_became_peered":"2024-09-12T00:56:52.995062+0000","last_unstale":"2024-09-12T01:09:02.480542+0000","last_undegraded":"2024-09-12T01:09:02.480542+0000","last_fullsized":"2024-09-12T01:09:02.480542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.136639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475349+0000","last_change":"2024-09-12T00:46:19.285095+0000","last_active":"2024-09-12T01:08:27.475349+0000","last_peered":"2024-09-12T01:08:27.475349+0000","last_clean":"2024-09-12T01:08:27.475349+0000","last_became_active":"2024-09-12T00:46:19.284822+0000","last_became_peered":"2024-09-12T00:46:19.284822+0000","last_unstale":"2024-09-12T01:08:27.475349+0000","last_undegraded":"2024-09-12T01:08:27.475349+0000","last_fullsized":"2024-09-12T01:08:27.475349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:42.407553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.723081+0000","last_change":"2024-09-12T01:12:03.723081+0000","last_active":"2024-09-12T01:12:03.723081+0000","last_peered":"2024-09-12T01:12:03.723081+0000","last_clean":"2024-09-12T01:12:03.723081+0000","last_became_active":"2024-09-12T00:46:16.261617+0000","last_became_peered":"2024-09-12T00:46:16.261617+0000","last_unstale":"2024-09-12T01:12:03.723081+0000","last_undegraded":"2024-09-12T01:12:03.723081+0000","last_fullsized":"2024-09-12T01:12:03.723081+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.722994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.722994+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.722994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:14.319282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.282013+0000","last_change":"2024-09-12T01:12:05.281948+0000","last_active":"2024-09-12T01:12:05.282013+0000","last_peered":"2024-09-12T01:12:05.282013+0000","last_clean":"2024-09-12T01:12:05.282013+0000","last_became_active":"2024-09-12T00:44:37.815325+0000","last_became_peered":"2024-09-12T00:44:37.815325+0000","last_unstale":"2024-09-12T01:12:05.282013+0000","last_undegraded":"2024-09-12T01:12:05.282013+0000","last_fullsized":"2024-09-12T01:12:05.282013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-09-12T01:12:05.281862+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-09-12T01:12:05.281862+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.281862+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:45.941101+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":218,"num_write":105,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.389388+0000","last_change":"2024-09-12T00:56:52.991644+0000","last_active":"2024-09-12T01:08:53.389388+0000","last_peered":"2024-09-12T01:08:53.389388+0000","last_clean":"2024-09-12T01:08:53.389388+0000","last_became_active":"2024-09-12T00:56:52.991358+0000","last_became_peered":"2024-09-12T00:56:52.991358+0000","last_unstale":"2024-09-12T01:08:53.389388+0000","last_undegraded":"2024-09-12T01:08:53.389388+0000","last_fullsized":"2024-09-12T01:08:53.389388+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:23.445118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.180629+0000","last_change":"2024-09-12T01:12:02.180629+0000","last_active":"2024-09-12T01:12:02.180629+0000","last_peered":"2024-09-12T01:12:02.180629+0000","last_clean":"2024-09-12T01:12:02.180629+0000","last_became_active":"2024-09-12T00:46:19.274024+0000","last_became_peered":"2024-09-12T00:46:19.274024+0000","last_unstale":"2024-09-12T01:12:02.180629+0000","last_undegraded":"2024-09-12T01:12:02.180629+0000","last_fullsized":"2024-09-12T01:12:02.180629+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T01:12:02.180532+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T01:12:02.180532+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.180532+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:47.568862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:02.471438+0000","last_change":"2024-09-12T00:46:16.272503+0000","last_active":"2024-09-12T01:08:02.471438+0000","last_peered":"2024-09-12T01:08:02.471438+0000","last_clean":"2024-09-12T01:08:02.471438+0000","last_became_active":"2024-09-12T00:46:16.272230+0000","last_became_peered":"2024-09-12T00:46:16.272230+0000","last_unstale":"2024-09-12T01:08:02.471438+0000","last_undegraded":"2024-09-12T01:08:02.471438+0000","last_fullsized":"2024-09-12T01:08:02.471438+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:22.621315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'26","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.249035+0000","last_change":"2024-09-12T01:12:04.248958+0000","last_active":"2024-09-12T01:12:04.249035+0000","last_peered":"2024-09-12T01:12:04.249035+0000","last_clean":"2024-09-12T01:12:04.249035+0000","last_became_active":"2024-09-12T00:44:37.821297+0000","last_became_peered":"2024-09-12T00:44:37.821297+0000","last_unstale":"2024-09-12T01:12:04.249035+0000","last_undegraded":"2024-09-12T01:12:04.249035+0000","last_fullsized":"2024-09-12T01:12:04.249035+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T01:12:04.248875+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T01:12:04.248875+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.248875+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:52.200263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.524444+0000","last_change":"2024-09-12T00:56:52.990792+0000","last_active":"2024-09-12T01:09:22.524444+0000","last_peered":"2024-09-12T01:09:22.524444+0000","last_clean":"2024-09-12T01:09:22.524444+0000","last_became_active":"2024-09-12T00:56:52.990528+0000","last_became_peered":"2024-09-12T00:56:52.990528+0000","last_unstale":"2024-09-12T01:09:22.524444+0000","last_undegraded":"2024-09-12T01:09:22.524444+0000","last_fullsized":"2024-09-12T01:09:22.524444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:30.175859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.597263+0000","last_change":"2024-09-12T00:46:19.281162+0000","last_active":"2024-09-12T01:11:23.597263+0000","last_peered":"2024-09-12T01:11:23.597263+0000","last_clean":"2024-09-12T01:11:23.597263+0000","last_became_active":"2024-09-12T00:46:19.280794+0000","last_became_peered":"2024-09-12T00:46:19.280794+0000","last_unstale":"2024-09-12T01:11:23.597263+0000","last_undegraded":"2024-09-12T01:11:23.597263+0000","last_fullsized":"2024-09-12T01:11:23.597263+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:50.182755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12296,"num_write":8,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.736721+0000","last_change":"2024-09-12T00:46:16.267841+0000","last_active":"2024-09-12T01:11:23.736721+0000","last_peered":"2024-09-12T01:11:23.736721+0000","last_clean":"2024-09-12T01:11:23.736721+0000","last_became_active":"2024-09-12T00:46:16.267528+0000","last_became_peered":"2024-09-12T00:46:16.267528+0000","last_unstale":"2024-09-12T01:11:23.736721+0000","last_undegraded":"2024-09-12T01:11:23.736721+0000","last_fullsized":"2024-09-12T01:11:23.736721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8204,"num_write":6,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'129","reported_seq":440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.333689+0000","last_change":"2024-09-12T01:12:05.333607+0000","last_active":"2024-09-12T01:12:05.333689+0000","last_peered":"2024-09-12T01:12:05.333689+0000","last_clean":"2024-09-12T01:12:05.333689+0000","last_became_active":"2024-09-12T00:44:37.819556+0000","last_became_peered":"2024-09-12T00:44:37.819556+0000","last_unstale":"2024-09-12T01:12:05.333689+0000","last_undegraded":"2024-09-12T01:12:05.333689+0000","last_fullsized":"2024-09-12T01:12:05.333689+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T01:12:05.333523+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T01:12:05.333523+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.333523+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:59.312207+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":767,"num_read_kb":571,"num_write":157,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3976,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:26.502411+0000","last_change":"2024-09-12T00:56:52.992341+0000","last_active":"2024-09-12T01:09:26.502411+0000","last_peered":"2024-09-12T01:09:26.502411+0000","last_clean":"2024-09-12T01:09:26.502411+0000","last_became_active":"2024-09-12T00:56:52.992081+0000","last_became_peered":"2024-09-12T00:56:52.992081+0000","last_unstale":"2024-09-12T01:09:26.502411+0000","last_undegraded":"2024-09-12T01:09:26.502411+0000","last_fullsized":"2024-09-12T01:09:26.502411+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'7","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.305081+0000","last_change":"2024-09-12T01:12:10.305081+0000","last_active":"2024-09-12T01:12:10.305081+0000","last_peered":"2024-09-12T01:12:10.305081+0000","last_clean":"2024-09-12T01:12:10.305081+0000","last_became_active":"2024-09-12T00:46:19.279811+0000","last_became_peered":"2024-09-12T00:46:19.279811+0000","last_unstale":"2024-09-12T01:12:10.305081+0000","last_undegraded":"2024-09-12T01:12:10.305081+0000","last_fullsized":"2024-09-12T01:12:10.305081+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T01:12:10.304983+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T01:12:10.304983+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.304983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:26.397813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13308,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'5","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.252593+0000","last_change":"2024-09-12T01:11:59.252593+0000","last_active":"2024-09-12T01:11:59.252593+0000","last_peered":"2024-09-12T01:11:59.252593+0000","last_clean":"2024-09-12T01:11:59.252593+0000","last_became_active":"2024-09-12T00:46:16.274541+0000","last_became_peered":"2024-09-12T00:46:16.274541+0000","last_unstale":"2024-09-12T01:11:59.252593+0000","last_undegraded":"2024-09-12T01:11:59.252593+0000","last_fullsized":"2024-09-12T01:11:59.252593+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:11:59.252508+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:11:59.252508+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.252508+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'13","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.644506+0000","last_change":"2024-09-12T01:12:03.644506+0000","last_active":"2024-09-12T01:12:03.644506+0000","last_peered":"2024-09-12T01:12:03.644506+0000","last_clean":"2024-09-12T01:12:03.644506+0000","last_became_active":"2024-09-12T00:44:37.817108+0000","last_became_peered":"2024-09-12T00:44:37.817108+0000","last_unstale":"2024-09-12T01:12:03.644506+0000","last_undegraded":"2024-09-12T01:12:03.644506+0000","last_fullsized":"2024-09-12T01:12:03.644506+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T01:12:03.644413+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T01:12:03.644413+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.644413+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:31.680128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.528736+0000","last_change":"2024-09-12T00:56:52.989648+0000","last_active":"2024-09-12T01:09:23.528736+0000","last_peered":"2024-09-12T01:09:23.528736+0000","last_clean":"2024-09-12T01:09:23.528736+0000","last_became_active":"2024-09-12T00:56:52.989394+0000","last_became_peered":"2024-09-12T00:56:52.989394+0000","last_unstale":"2024-09-12T01:09:23.528736+0000","last_undegraded":"2024-09-12T01:09:23.528736+0000","last_fullsized":"2024-09-12T01:09:23.528736+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"264'7","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.458831+0000","last_change":"2024-09-12T00:46:19.282381+0000","last_active":"2024-09-12T01:11:23.458831+0000","last_peered":"2024-09-12T01:11:23.458831+0000","last_clean":"2024-09-12T01:11:23.458831+0000","last_became_active":"2024-09-12T00:46:19.280878+0000","last_became_peered":"2024-09-12T00:46:19.280878+0000","last_unstale":"2024-09-12T01:11:23.458831+0000","last_undegraded":"2024-09-12T01:11:23.458831+0000","last_fullsized":"2024-09-12T01:11:23.458831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:37.733061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.411092+0000","last_change":"2024-09-12T00:46:16.278285+0000","last_active":"2024-09-12T01:11:17.411092+0000","last_peered":"2024-09-12T01:11:17.411092+0000","last_clean":"2024-09-12T01:11:17.411092+0000","last_became_active":"2024-09-12T00:46:16.277776+0000","last_became_peered":"2024-09-12T00:46:16.277776+0000","last_unstale":"2024-09-12T01:11:17.411092+0000","last_undegraded":"2024-09-12T01:11:17.411092+0000","last_fullsized":"2024-09-12T01:11:17.411092+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:47.993297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'18","reported_seq":95,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.213287+0000","last_change":"2024-09-12T01:12:03.213287+0000","last_active":"2024-09-12T01:12:03.213287+0000","last_peered":"2024-09-12T01:12:03.213287+0000","last_clean":"2024-09-12T01:12:03.213287+0000","last_became_active":"2024-09-12T00:44:37.815820+0000","last_became_peered":"2024-09-12T00:44:37.815820+0000","last_unstale":"2024-09-12T01:12:03.213287+0000","last_undegraded":"2024-09-12T01:12:03.213287+0000","last_fullsized":"2024-09-12T01:12:03.213287+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-12T01:12:03.213208+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-12T01:12:03.213208+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.213208+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:30.498570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.475979+0000","last_change":"2024-09-12T00:56:52.996102+0000","last_active":"2024-09-12T01:08:32.475979+0000","last_peered":"2024-09-12T01:08:32.475979+0000","last_clean":"2024-09-12T01:08:32.475979+0000","last_became_active":"2024-09-12T00:56:52.995696+0000","last_became_peered":"2024-09-12T00:56:52.995696+0000","last_unstale":"2024-09-12T01:08:32.475979+0000","last_undegraded":"2024-09-12T01:08:32.475979+0000","last_fullsized":"2024-09-12T01:08:32.475979+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:57.634150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.403783+0000","last_change":"2024-09-12T00:46:19.282715+0000","last_active":"2024-09-12T01:10:33.403783+0000","last_peered":"2024-09-12T01:10:33.403783+0000","last_clean":"2024-09-12T01:10:33.403783+0000","last_became_active":"2024-09-12T00:46:19.282466+0000","last_became_peered":"2024-09-12T00:46:19.282466+0000","last_unstale":"2024-09-12T01:10:33.403783+0000","last_undegraded":"2024-09-12T01:10:33.403783+0000","last_fullsized":"2024-09-12T01:10:33.403783+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:56.083481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.056509+0000","last_change":"2024-09-12T00:46:16.268948+0000","last_active":"2024-09-12T01:11:23.056509+0000","last_peered":"2024-09-12T01:11:23.056509+0000","last_clean":"2024-09-12T01:11:23.056509+0000","last_became_active":"2024-09-12T00:46:16.268479+0000","last_became_peered":"2024-09-12T00:46:16.268479+0000","last_unstale":"2024-09-12T01:11:23.056509+0000","last_undegraded":"2024-09-12T01:11:23.056509+0000","last_fullsized":"2024-09-12T01:11:23.056509+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519282+0000","last_change":"2024-09-12T00:44:37.811999+0000","last_active":"2024-09-12T01:08:47.519282+0000","last_peered":"2024-09-12T01:08:47.519282+0000","last_clean":"2024-09-12T01:08:47.519282+0000","last_became_active":"2024-09-12T00:44:37.811697+0000","last_became_peered":"2024-09-12T00:44:37.811697+0000","last_unstale":"2024-09-12T01:08:47.519282+0000","last_undegraded":"2024-09-12T01:08:47.519282+0000","last_fullsized":"2024-09-12T01:08:47.519282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:46.654992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":57,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.387544+0000","last_change":"2024-09-12T00:56:52.985166+0000","last_active":"2024-09-12T01:08:32.387544+0000","last_peered":"2024-09-12T01:08:32.387544+0000","last_clean":"2024-09-12T01:08:32.387544+0000","last_became_active":"2024-09-12T00:56:52.984878+0000","last_became_peered":"2024-09-12T00:56:52.984878+0000","last_unstale":"2024-09-12T01:08:32.387544+0000","last_undegraded":"2024-09-12T01:08:32.387544+0000","last_fullsized":"2024-09-12T01:08:32.387544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:15.409540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:47.487392+0000","last_change":"2024-09-12T00:46:19.276813+0000","last_active":"2024-09-12T01:09:47.487392+0000","last_peered":"2024-09-12T01:09:47.487392+0000","last_clean":"2024-09-12T01:09:47.487392+0000","last_became_active":"2024-09-12T00:46:19.276197+0000","last_became_peered":"2024-09-12T00:46:19.276197+0000","last_unstale":"2024-09-12T01:09:47.487392+0000","last_undegraded":"2024-09-12T01:09:47.487392+0000","last_fullsized":"2024-09-12T01:09:47.487392+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.268421+0000","last_change":"2024-09-12T01:11:58.268421+0000","last_active":"2024-09-12T01:11:58.268421+0000","last_peered":"2024-09-12T01:11:58.268421+0000","last_clean":"2024-09-12T01:11:58.268421+0000","last_became_active":"2024-09-12T00:46:16.263870+0000","last_became_peered":"2024-09-12T00:46:16.263870+0000","last_unstale":"2024-09-12T01:11:58.268421+0000","last_undegraded":"2024-09-12T01:11:58.268421+0000","last_fullsized":"2024-09-12T01:11:58.268421+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:11:58.268310+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:11:58.268310+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.268310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:14.647884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2048,"num_write":18,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'37","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:47.519258+0000","last_change":"2024-09-12T00:44:37.820673+0000","last_active":"2024-09-12T01:08:47.519258+0000","last_peered":"2024-09-12T01:08:47.519258+0000","last_clean":"2024-09-12T01:08:47.519258+0000","last_became_active":"2024-09-12T00:44:37.820232+0000","last_became_peered":"2024-09-12T00:44:37.820232+0000","last_unstale":"2024-09-12T01:08:47.519258+0000","last_undegraded":"2024-09-12T01:08:47.519258+0000","last_fullsized":"2024-09-12T01:08:47.519258+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:09.688623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.496180+0000","last_change":"2024-09-12T00:56:52.987731+0000","last_active":"2024-09-12T01:08:36.496180+0000","last_peered":"2024-09-12T01:08:36.496180+0000","last_clean":"2024-09-12T01:08:36.496180+0000","last_became_active":"2024-09-12T00:56:52.987492+0000","last_became_peered":"2024-09-12T00:56:52.987492+0000","last_unstale":"2024-09-12T01:08:36.496180+0000","last_undegraded":"2024-09-12T01:08:36.496180+0000","last_fullsized":"2024-09-12T01:08:36.496180+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.155360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'9","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383413+0000","last_change":"2024-09-12T00:46:19.287908+0000","last_active":"2024-09-12T01:08:08.383413+0000","last_peered":"2024-09-12T01:08:08.383413+0000","last_clean":"2024-09-12T01:08:08.383413+0000","last_became_active":"2024-09-12T00:46:19.286860+0000","last_became_peered":"2024-09-12T00:46:19.286860+0000","last_unstale":"2024-09-12T01:08:08.383413+0000","last_undegraded":"2024-09-12T01:08:08.383413+0000","last_fullsized":"2024-09-12T01:08:08.383413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:54.927557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13316,"num_write":14,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.735722+0000","last_change":"2024-09-12T00:46:16.279497+0000","last_active":"2024-09-12T01:11:23.735722+0000","last_peered":"2024-09-12T01:11:23.735722+0000","last_clean":"2024-09-12T01:11:23.735722+0000","last_became_active":"2024-09-12T00:46:16.279114+0000","last_became_peered":"2024-09-12T00:46:16.279114+0000","last_unstale":"2024-09-12T01:11:23.735722+0000","last_undegraded":"2024-09-12T01:11:23.735722+0000","last_fullsized":"2024-09-12T01:11:23.735722+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:42.826584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'25","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.649528+0000","last_change":"2024-09-12T01:12:02.649528+0000","last_active":"2024-09-12T01:12:02.649528+0000","last_peered":"2024-09-12T01:12:02.649528+0000","last_clean":"2024-09-12T01:12:02.649528+0000","last_became_active":"2024-09-12T00:44:37.819153+0000","last_became_peered":"2024-09-12T00:44:37.819153+0000","last_unstale":"2024-09-12T01:12:02.649528+0000","last_undegraded":"2024-09-12T01:12:02.649528+0000","last_fullsized":"2024-09-12T01:12:02.649528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-12T01:12:02.649425+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-12T01:12:02.649425+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.649425+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:22.865583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":89,"num_write":41,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.151506+0000","last_change":"2024-09-12T01:12:07.151506+0000","last_active":"2024-09-12T01:12:07.151506+0000","last_peered":"2024-09-12T01:12:07.151506+0000","last_clean":"2024-09-12T01:12:07.151506+0000","last_became_active":"2024-09-12T00:56:52.990265+0000","last_became_peered":"2024-09-12T00:56:52.990265+0000","last_unstale":"2024-09-12T01:12:07.151506+0000","last_undegraded":"2024-09-12T01:12:07.151506+0000","last_fullsized":"2024-09-12T01:12:07.151506+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:07.151401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:07.151401+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.151401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:30.414409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.165637+0000","last_change":"2024-09-12T01:12:01.165637+0000","last_active":"2024-09-12T01:12:01.165637+0000","last_peered":"2024-09-12T01:12:01.165637+0000","last_clean":"2024-09-12T01:12:01.165637+0000","last_became_active":"2024-09-12T00:46:19.277011+0000","last_became_peered":"2024-09-12T00:46:19.277011+0000","last_unstale":"2024-09-12T01:12:01.165637+0000","last_undegraded":"2024-09-12T01:12:01.165637+0000","last_fullsized":"2024-09-12T01:12:01.165637+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.165547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.165547+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.165547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:08.466888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694341+0000","last_change":"2024-09-12T00:46:16.275678+0000","last_active":"2024-09-12T01:11:22.694341+0000","last_peered":"2024-09-12T01:11:22.694341+0000","last_clean":"2024-09-12T01:11:22.694341+0000","last_became_active":"2024-09-12T00:46:16.275403+0000","last_became_peered":"2024-09-12T00:46:16.275403+0000","last_unstale":"2024-09-12T01:11:22.694341+0000","last_undegraded":"2024-09-12T01:11:22.694341+0000","last_fullsized":"2024-09-12T01:11:22.694341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.331770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"264'68","reported_seq":266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:03.598342+0000","last_change":"2024-09-12T00:44:37.821656+0000","last_active":"2024-09-12T01:08:03.598342+0000","last_peered":"2024-09-12T01:08:03.598342+0000","last_clean":"2024-09-12T01:08:03.598342+0000","last_became_active":"2024-09-12T00:44:37.821192+0000","last_became_peered":"2024-09-12T00:44:37.821192+0000","last_unstale":"2024-09-12T01:08:03.598342+0000","last_undegraded":"2024-09-12T01:08:03.598342+0000","last_fullsized":"2024-09-12T01:08:03.598342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:14.342220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":323,"num_write":87,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479794+0000","last_change":"2024-09-12T00:56:52.995841+0000","last_active":"2024-09-12T01:08:57.479794+0000","last_peered":"2024-09-12T01:08:57.479794+0000","last_clean":"2024-09-12T01:08:57.479794+0000","last_became_active":"2024-09-12T00:56:52.995495+0000","last_became_peered":"2024-09-12T00:56:52.995495+0000","last_unstale":"2024-09-12T01:08:57.479794+0000","last_undegraded":"2024-09-12T01:08:57.479794+0000","last_fullsized":"2024-09-12T01:08:57.479794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:07.859390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.644620+0000","last_change":"2024-09-12T00:46:19.280925+0000","last_active":"2024-09-12T01:11:24.644620+0000","last_peered":"2024-09-12T01:11:24.644620+0000","last_clean":"2024-09-12T01:11:24.644620+0000","last_became_active":"2024-09-12T00:46:19.280653+0000","last_became_peered":"2024-09-12T00:46:19.280653+0000","last_unstale":"2024-09-12T01:11:24.644620+0000","last_undegraded":"2024-09-12T01:11:24.644620+0000","last_fullsized":"2024-09-12T01:11:24.644620+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10256,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.778408+0000","last_change":"2024-09-12T01:12:01.778408+0000","last_active":"2024-09-12T01:12:01.778408+0000","last_peered":"2024-09-12T01:12:01.778408+0000","last_clean":"2024-09-12T01:12:01.778408+0000","last_became_active":"2024-09-12T00:46:16.270004+0000","last_became_peered":"2024-09-12T00:46:16.270004+0000","last_unstale":"2024-09-12T01:12:01.778408+0000","last_undegraded":"2024-09-12T01:12:01.778408+0000","last_fullsized":"2024-09-12T01:12:01.778408+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T01:12:01.778304+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T01:12:01.778304+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.778304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:34.611521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'15","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.597733+0000","last_change":"2024-09-12T00:44:37.820954+0000","last_active":"2024-09-12T01:07:58.597733+0000","last_peered":"2024-09-12T01:07:58.597733+0000","last_clean":"2024-09-12T01:07:58.597733+0000","last_became_active":"2024-09-12T00:44:37.820639+0000","last_became_peered":"2024-09-12T00:44:37.820639+0000","last_unstale":"2024-09-12T01:07:58.597733+0000","last_undegraded":"2024-09-12T01:07:58.597733+0000","last_fullsized":"2024-09-12T01:07:58.597733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:51.129610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391071+0000","last_change":"2024-09-12T00:56:52.991542+0000","last_active":"2024-09-12T01:08:57.391071+0000","last_peered":"2024-09-12T01:08:57.391071+0000","last_clean":"2024-09-12T01:08:57.391071+0000","last_became_active":"2024-09-12T00:56:52.991261+0000","last_became_peered":"2024-09-12T00:56:52.991261+0000","last_unstale":"2024-09-12T01:08:57.391071+0000","last_undegraded":"2024-09-12T01:08:57.391071+0000","last_fullsized":"2024-09-12T01:08:57.391071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:08.574079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.598676+0000","last_change":"2024-09-12T00:46:19.282895+0000","last_active":"2024-09-12T01:11:23.598676+0000","last_peered":"2024-09-12T01:11:23.598676+0000","last_clean":"2024-09-12T01:11:23.598676+0000","last_became_active":"2024-09-12T00:46:19.281676+0000","last_became_peered":"2024-09-12T00:46:19.281676+0000","last_unstale":"2024-09-12T01:11:23.598676+0000","last_undegraded":"2024-09-12T01:11:23.598676+0000","last_fullsized":"2024-09-12T01:11:23.598676+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:37.485933+0000","last_change":"2024-09-12T00:46:16.276429+0000","last_active":"2024-09-12T01:09:37.485933+0000","last_peered":"2024-09-12T01:09:37.485933+0000","last_clean":"2024-09-12T01:09:37.485933+0000","last_became_active":"2024-09-12T00:46:16.276180+0000","last_became_peered":"2024-09-12T00:46:16.276180+0000","last_unstale":"2024-09-12T01:09:37.485933+0000","last_undegraded":"2024-09-12T01:09:37.485933+0000","last_fullsized":"2024-09-12T01:09:37.485933+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.681342+0000","last_change":"2024-09-12T01:12:01.681342+0000","last_active":"2024-09-12T01:12:01.681342+0000","last_peered":"2024-09-12T01:12:01.681342+0000","last_clean":"2024-09-12T01:12:01.681342+0000","last_became_active":"2024-09-12T00:44:37.820217+0000","last_became_peered":"2024-09-12T00:44:37.820217+0000","last_unstale":"2024-09-12T01:12:01.681342+0000","last_undegraded":"2024-09-12T01:12:01.681342+0000","last_fullsized":"2024-09-12T01:12:01.681342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-12T01:12:01.681254+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-12T01:12:01.681254+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.681254+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:39.318596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":127,"num_write":61,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.517081+0000","last_change":"2024-09-12T00:56:52.989385+0000","last_active":"2024-09-12T01:08:32.517081+0000","last_peered":"2024-09-12T01:08:32.517081+0000","last_clean":"2024-09-12T01:08:32.517081+0000","last_became_active":"2024-09-12T00:56:52.988302+0000","last_became_peered":"2024-09-12T00:56:52.988302+0000","last_unstale":"2024-09-12T01:08:32.517081+0000","last_undegraded":"2024-09-12T01:08:32.517081+0000","last_fullsized":"2024-09-12T01:08:32.517081+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:40.813037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'7","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:43.396477+0000","last_change":"2024-09-12T00:46:19.285378+0000","last_active":"2024-09-12T01:09:43.396477+0000","last_peered":"2024-09-12T01:09:43.396477+0000","last_clean":"2024-09-12T01:09:43.396477+0000","last_became_active":"2024-09-12T00:46:19.280889+0000","last_became_peered":"2024-09-12T00:46:19.280889+0000","last_unstale":"2024-09-12T01:09:43.396477+0000","last_undegraded":"2024-09-12T01:09:43.396477+0000","last_fullsized":"2024-09-12T01:09:43.396477+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7182,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.809016+0000","last_change":"2024-09-12T01:12:06.809016+0000","last_active":"2024-09-12T01:12:06.809016+0000","last_peered":"2024-09-12T01:12:06.809016+0000","last_clean":"2024-09-12T01:12:06.809016+0000","last_became_active":"2024-09-12T00:46:16.263065+0000","last_became_peered":"2024-09-12T00:46:16.263065+0000","last_unstale":"2024-09-12T01:12:06.809016+0000","last_undegraded":"2024-09-12T01:12:06.809016+0000","last_fullsized":"2024-09-12T01:12:06.809016+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:12:06.808921+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:12:06.808921+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.808921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:45.527274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.391774+0000","last_change":"2024-09-12T01:12:00.391774+0000","last_active":"2024-09-12T01:12:00.391774+0000","last_peered":"2024-09-12T01:12:00.391774+0000","last_clean":"2024-09-12T01:12:00.391774+0000","last_became_active":"2024-09-12T00:44:37.814584+0000","last_became_peered":"2024-09-12T00:44:37.814584+0000","last_unstale":"2024-09-12T01:12:00.391774+0000","last_undegraded":"2024-09-12T01:12:00.391774+0000","last_fullsized":"2024-09-12T01:12:00.391774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-12T01:12:00.391675+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-12T01:12:00.391675+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.391675+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:27.708969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.391027+0000","last_change":"2024-09-12T00:56:52.991853+0000","last_active":"2024-09-12T01:08:57.391027+0000","last_peered":"2024-09-12T01:08:57.391027+0000","last_clean":"2024-09-12T01:08:57.391027+0000","last_became_active":"2024-09-12T00:56:52.990830+0000","last_became_peered":"2024-09-12T00:56:52.990830+0000","last_unstale":"2024-09-12T01:08:57.391027+0000","last_undegraded":"2024-09-12T01:08:57.391027+0000","last_fullsized":"2024-09-12T01:08:57.391027+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:49.621390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'11","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.355255+0000","last_change":"2024-09-12T00:46:19.285059+0000","last_active":"2024-09-12T01:11:24.355255+0000","last_peered":"2024-09-12T01:11:24.355255+0000","last_clean":"2024-09-12T01:11:24.355255+0000","last_became_active":"2024-09-12T00:46:19.284748+0000","last_became_peered":"2024-09-12T00:46:19.284748+0000","last_unstale":"2024-09-12T01:11:24.355255+0000","last_undegraded":"2024-09-12T01:11:24.355255+0000","last_fullsized":"2024-09-12T01:11:24.355255+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"261'5","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.771536+0000","last_change":"2024-09-12T01:12:02.771536+0000","last_active":"2024-09-12T01:12:02.771536+0000","last_peered":"2024-09-12T01:12:02.771536+0000","last_clean":"2024-09-12T01:12:02.771536+0000","last_became_active":"2024-09-12T00:46:16.274209+0000","last_became_peered":"2024-09-12T00:46:16.274209+0000","last_unstale":"2024-09-12T01:12:02.771536+0000","last_undegraded":"2024-09-12T01:12:02.771536+0000","last_fullsized":"2024-09-12T01:12:02.771536+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T01:12:02.771444+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T01:12:02.771444+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.771444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:59.663528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":10,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.640620+0000","last_change":"2024-09-12T01:12:00.640620+0000","last_active":"2024-09-12T01:12:00.640620+0000","last_peered":"2024-09-12T01:12:00.640620+0000","last_clean":"2024-09-12T01:12:00.640620+0000","last_became_active":"2024-09-12T00:44:37.819298+0000","last_became_peered":"2024-09-12T00:44:37.819298+0000","last_unstale":"2024-09-12T01:12:00.640620+0000","last_undegraded":"2024-09-12T01:12:00.640620+0000","last_fullsized":"2024-09-12T01:12:00.640620+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T01:12:00.640490+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T01:12:00.640490+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.640490+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:43.774391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:57.489064+0000","last_change":"2024-09-12T00:56:52.996314+0000","last_active":"2024-09-12T01:09:57.489064+0000","last_peered":"2024-09-12T01:09:57.489064+0000","last_clean":"2024-09-12T01:09:57.489064+0000","last_became_active":"2024-09-12T00:56:52.996048+0000","last_became_peered":"2024-09-12T00:56:52.996048+0000","last_unstale":"2024-09-12T01:09:57.489064+0000","last_undegraded":"2024-09-12T01:09:57.489064+0000","last_fullsized":"2024-09-12T01:09:57.489064+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.222509+0000","last_change":"2024-09-12T00:46:19.286025+0000","last_active":"2024-09-12T01:11:23.222509+0000","last_peered":"2024-09-12T01:11:23.222509+0000","last_clean":"2024-09-12T01:11:23.222509+0000","last_became_active":"2024-09-12T00:46:19.285304+0000","last_became_peered":"2024-09-12T00:46:19.285304+0000","last_unstale":"2024-09-12T01:11:23.222509+0000","last_undegraded":"2024-09-12T01:11:23.222509+0000","last_fullsized":"2024-09-12T01:11:23.222509+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:59.248323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2428,"num_write":4,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.352766+0000","last_change":"2024-09-12T01:12:06.352766+0000","last_active":"2024-09-12T01:12:06.352766+0000","last_peered":"2024-09-12T01:12:06.352766+0000","last_clean":"2024-09-12T01:12:06.352766+0000","last_became_active":"2024-09-12T00:46:16.271839+0000","last_became_peered":"2024-09-12T00:46:16.271839+0000","last_unstale":"2024-09-12T01:12:06.352766+0000","last_undegraded":"2024-09-12T01:12:06.352766+0000","last_fullsized":"2024-09-12T01:12:06.352766+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:06.352670+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:06.352670+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.352670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:22.443702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"264'41","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.688231+0000","last_change":"2024-09-12T01:11:59.688231+0000","last_active":"2024-09-12T01:11:59.688231+0000","last_peered":"2024-09-12T01:11:59.688231+0000","last_clean":"2024-09-12T01:11:59.688231+0000","last_became_active":"2024-09-12T00:44:37.821837+0000","last_became_peered":"2024-09-12T00:44:37.821837+0000","last_unstale":"2024-09-12T01:11:59.688231+0000","last_undegraded":"2024-09-12T01:11:59.688231+0000","last_fullsized":"2024-09-12T01:11:59.688231+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T01:11:59.688148+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T01:11:59.688148+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.688148+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:43.832110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":140,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.403198+0000","last_change":"2024-09-12T00:56:52.996477+0000","last_active":"2024-09-12T01:08:08.403198+0000","last_peered":"2024-09-12T01:08:08.403198+0000","last_clean":"2024-09-12T01:08:08.403198+0000","last_became_active":"2024-09-12T00:56:52.996287+0000","last_became_peered":"2024-09-12T00:56:52.996287+0000","last_unstale":"2024-09-12T01:08:08.403198+0000","last_undegraded":"2024-09-12T01:08:08.403198+0000","last_fullsized":"2024-09-12T01:08:08.403198+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:34.040673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.408768+0000","last_change":"2024-09-12T00:46:19.284780+0000","last_active":"2024-09-12T01:11:08.408768+0000","last_peered":"2024-09-12T01:11:08.408768+0000","last_clean":"2024-09-12T01:11:08.408768+0000","last_became_active":"2024-09-12T00:46:19.284490+0000","last_became_peered":"2024-09-12T00:46:19.284490+0000","last_unstale":"2024-09-12T01:11:08.408768+0000","last_undegraded":"2024-09-12T01:11:08.408768+0000","last_fullsized":"2024-09-12T01:11:08.408768+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.303903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"264'10","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:02.408785+0000","last_change":"2024-09-12T00:46:16.275634+0000","last_active":"2024-09-12T01:11:02.408785+0000","last_peered":"2024-09-12T01:11:02.408785+0000","last_clean":"2024-09-12T01:11:02.408785+0000","last_became_active":"2024-09-12T00:46:16.275312+0000","last_became_peered":"2024-09-12T00:46:16.275312+0000","last_unstale":"2024-09-12T01:11:02.408785+0000","last_undegraded":"2024-09-12T01:11:02.408785+0000","last_fullsized":"2024-09-12T01:11:02.408785+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.528193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20478,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'42","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.609631+0000","last_change":"2024-09-12T00:44:37.819546+0000","last_active":"2024-09-12T01:09:23.609631+0000","last_peered":"2024-09-12T01:09:23.609631+0000","last_clean":"2024-09-12T01:09:23.609631+0000","last_became_active":"2024-09-12T00:44:37.819289+0000","last_became_peered":"2024-09-12T00:44:37.819289+0000","last_unstale":"2024-09-12T01:09:23.609631+0000","last_undegraded":"2024-09-12T01:09:23.609631+0000","last_fullsized":"2024-09-12T01:09:23.609631+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":167,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:53.613300+0000","last_change":"2024-09-12T00:56:52.987494+0000","last_active":"2024-09-12T01:09:53.613300+0000","last_peered":"2024-09-12T01:09:53.613300+0000","last_clean":"2024-09-12T01:09:53.613300+0000","last_became_active":"2024-09-12T00:56:52.987226+0000","last_became_peered":"2024-09-12T00:56:52.987226+0000","last_unstale":"2024-09-12T01:09:53.613300+0000","last_undegraded":"2024-09-12T01:09:53.613300+0000","last_fullsized":"2024-09-12T01:09:53.613300+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.458461+0000","last_change":"2024-09-12T00:46:19.287340+0000","last_active":"2024-09-12T01:11:23.458461+0000","last_peered":"2024-09-12T01:11:23.458461+0000","last_clean":"2024-09-12T01:11:23.458461+0000","last_became_active":"2024-09-12T00:46:19.287067+0000","last_became_peered":"2024-09-12T00:46:19.287067+0000","last_unstale":"2024-09-12T01:11:23.458461+0000","last_undegraded":"2024-09-12T01:11:23.458461+0000","last_fullsized":"2024-09-12T01:11:23.458461+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.086451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2174,"num_write":4,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.693299+0000","last_change":"2024-09-12T01:12:07.693299+0000","last_active":"2024-09-12T01:12:07.693299+0000","last_peered":"2024-09-12T01:12:07.693299+0000","last_clean":"2024-09-12T01:12:07.693299+0000","last_became_active":"2024-09-12T00:46:16.278205+0000","last_became_peered":"2024-09-12T00:46:16.278205+0000","last_unstale":"2024-09-12T01:12:07.693299+0000","last_undegraded":"2024-09-12T01:12:07.693299+0000","last_fullsized":"2024-09-12T01:12:07.693299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:07.693189+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:07.693189+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.693189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:12.595955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'62","reported_seq":220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.759000+0000","last_change":"2024-09-12T01:12:04.759000+0000","last_active":"2024-09-12T01:12:04.759000+0000","last_peered":"2024-09-12T01:12:04.759000+0000","last_clean":"2024-09-12T01:12:04.759000+0000","last_became_active":"2024-09-12T00:44:37.811544+0000","last_became_peered":"2024-09-12T00:44:37.811544+0000","last_unstale":"2024-09-12T01:12:04.759000+0000","last_undegraded":"2024-09-12T01:12:04.759000+0000","last_fullsized":"2024-09-12T01:12:04.759000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'62","last_scrub_stamp":"2024-09-12T01:12:04.758917+0000","last_deep_scrub":"264'62","last_deep_scrub_stamp":"2024-09-12T01:12:04.758917+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.758917+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:10.647898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":232,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.780609+0000","last_change":"2024-09-12T01:12:07.780609+0000","last_active":"2024-09-12T01:12:07.780609+0000","last_peered":"2024-09-12T01:12:07.780609+0000","last_clean":"2024-09-12T01:12:07.780609+0000","last_became_active":"2024-09-12T00:56:52.988985+0000","last_became_peered":"2024-09-12T00:56:52.988985+0000","last_unstale":"2024-09-12T01:12:07.780609+0000","last_undegraded":"2024-09-12T01:12:07.780609+0000","last_fullsized":"2024-09-12T01:12:07.780609+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:07.780496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:07.780496+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.780496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:42.826635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'10","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.479160+0000","last_change":"2024-09-12T00:46:19.279808+0000","last_active":"2024-09-12T01:08:52.479160+0000","last_peered":"2024-09-12T01:08:52.479160+0000","last_clean":"2024-09-12T01:08:52.479160+0000","last_became_active":"2024-09-12T00:46:19.279527+0000","last_became_peered":"2024-09-12T00:46:19.279527+0000","last_unstale":"2024-09-12T01:08:52.479160+0000","last_undegraded":"2024-09-12T01:08:52.479160+0000","last_fullsized":"2024-09-12T01:08:52.479160+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:07.362005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8190,"num_write":20,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.726093+0000","last_change":"2024-09-12T01:12:06.726093+0000","last_active":"2024-09-12T01:12:06.726093+0000","last_peered":"2024-09-12T01:12:06.726093+0000","last_clean":"2024-09-12T01:12:06.726093+0000","last_became_active":"2024-09-12T00:46:16.273598+0000","last_became_peered":"2024-09-12T00:46:16.273598+0000","last_unstale":"2024-09-12T01:12:06.726093+0000","last_undegraded":"2024-09-12T01:12:06.726093+0000","last_fullsized":"2024-09-12T01:12:06.726093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:06.726000+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:06.726000+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.726000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:37.079282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'41","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.182830+0000","last_change":"2024-09-12T01:12:02.182830+0000","last_active":"2024-09-12T01:12:02.182830+0000","last_peered":"2024-09-12T01:12:02.182830+0000","last_clean":"2024-09-12T01:12:02.182830+0000","last_became_active":"2024-09-12T00:44:37.813081+0000","last_became_peered":"2024-09-12T00:44:37.813081+0000","last_unstale":"2024-09-12T01:12:02.182830+0000","last_undegraded":"2024-09-12T01:12:02.182830+0000","last_fullsized":"2024-09-12T01:12:02.182830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T01:12:02.182750+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T01:12:02.182750+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.182750+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:31.355347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":146,"num_write":78,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:07.472330+0000","last_change":"2024-09-12T00:56:52.995736+0000","last_active":"2024-09-12T01:08:07.472330+0000","last_peered":"2024-09-12T01:08:07.472330+0000","last_clean":"2024-09-12T01:08:07.472330+0000","last_became_active":"2024-09-12T00:56:52.995412+0000","last_became_peered":"2024-09-12T00:56:52.995412+0000","last_unstale":"2024-09-12T01:08:07.472330+0000","last_undegraded":"2024-09-12T01:08:07.472330+0000","last_fullsized":"2024-09-12T01:08:07.472330+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:15.173930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615387+0000","last_change":"2024-09-12T00:46:19.283005+0000","last_active":"2024-09-12T01:10:08.615387+0000","last_peered":"2024-09-12T01:10:08.615387+0000","last_clean":"2024-09-12T01:10:08.615387+0000","last_became_active":"2024-09-12T00:46:19.282672+0000","last_became_peered":"2024-09-12T00:46:19.282672+0000","last_unstale":"2024-09-12T01:10:08.615387+0000","last_undegraded":"2024-09-12T01:10:08.615387+0000","last_fullsized":"2024-09-12T01:10:08.615387+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:25.629238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'9","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.689190+0000","last_change":"2024-09-12T01:12:04.689190+0000","last_active":"2024-09-12T01:12:04.689190+0000","last_peered":"2024-09-12T01:12:04.689190+0000","last_clean":"2024-09-12T01:12:04.689190+0000","last_became_active":"2024-09-12T00:46:16.265927+0000","last_became_peered":"2024-09-12T00:46:16.265927+0000","last_unstale":"2024-09-12T01:12:04.689190+0000","last_undegraded":"2024-09-12T01:12:04.689190+0000","last_fullsized":"2024-09-12T01:12:04.689190+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T01:12:04.689067+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T01:12:04.689067+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.689067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:48.646995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'26","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.177653+0000","last_change":"2024-09-12T01:12:01.177653+0000","last_active":"2024-09-12T01:12:01.177653+0000","last_peered":"2024-09-12T01:12:01.177653+0000","last_clean":"2024-09-12T01:12:01.177653+0000","last_became_active":"2024-09-12T00:44:37.820584+0000","last_became_peered":"2024-09-12T00:44:37.820584+0000","last_unstale":"2024-09-12T01:12:01.177653+0000","last_undegraded":"2024-09-12T01:12:01.177653+0000","last_fullsized":"2024-09-12T01:12:01.177653+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T01:12:01.177520+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T01:12:01.177520+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.177520+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:02.561584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.493580+0000","last_change":"2024-09-12T00:56:52.994371+0000","last_active":"2024-09-12T01:08:16.493580+0000","last_peered":"2024-09-12T01:08:16.493580+0000","last_clean":"2024-09-12T01:08:16.493580+0000","last_became_active":"2024-09-12T00:56:52.994132+0000","last_became_peered":"2024-09-12T00:56:52.994132+0000","last_unstale":"2024-09-12T01:08:16.493580+0000","last_undegraded":"2024-09-12T01:08:16.493580+0000","last_fullsized":"2024-09-12T01:08:16.493580+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:57.349446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.301520+0000","last_change":"2024-09-12T01:12:09.301520+0000","last_active":"2024-09-12T01:12:09.301520+0000","last_peered":"2024-09-12T01:12:09.301520+0000","last_clean":"2024-09-12T01:12:09.301520+0000","last_became_active":"2024-09-12T00:46:19.280726+0000","last_became_peered":"2024-09-12T00:46:19.280726+0000","last_unstale":"2024-09-12T01:12:09.301520+0000","last_undegraded":"2024-09-12T01:12:09.301520+0000","last_fullsized":"2024-09-12T01:12:09.301520+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:12:09.301424+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:12:09.301424+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.301424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:12.439753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:07.490813+0000","last_change":"2024-09-12T00:46:16.276183+0000","last_active":"2024-09-12T01:10:07.490813+0000","last_peered":"2024-09-12T01:10:07.490813+0000","last_clean":"2024-09-12T01:10:07.490813+0000","last_became_active":"2024-09-12T00:46:16.275908+0000","last_became_peered":"2024-09-12T00:46:16.275908+0000","last_unstale":"2024-09-12T01:10:07.490813+0000","last_undegraded":"2024-09-12T01:10:07.490813+0000","last_fullsized":"2024-09-12T01:10:07.490813+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:52.232454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.352700+0000","last_change":"2024-09-12T01:12:03.352700+0000","last_active":"2024-09-12T01:12:03.352700+0000","last_peered":"2024-09-12T01:12:03.352700+0000","last_clean":"2024-09-12T01:12:03.352700+0000","last_became_active":"2024-09-12T00:44:37.811613+0000","last_became_peered":"2024-09-12T00:44:37.811613+0000","last_unstale":"2024-09-12T01:12:03.352700+0000","last_undegraded":"2024-09-12T01:12:03.352700+0000","last_fullsized":"2024-09-12T01:12:03.352700+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T01:12:03.352619+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T01:12:03.352619+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.352619+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:42.794372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.142201+0000","last_change":"2024-09-12T01:12:08.142201+0000","last_active":"2024-09-12T01:12:08.142201+0000","last_peered":"2024-09-12T01:12:08.142201+0000","last_clean":"2024-09-12T01:12:08.142201+0000","last_became_active":"2024-09-12T00:56:52.989552+0000","last_became_peered":"2024-09-12T00:56:52.989552+0000","last_unstale":"2024-09-12T01:12:08.142201+0000","last_undegraded":"2024-09-12T01:12:08.142201+0000","last_fullsized":"2024-09-12T01:12:08.142201+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:08.142119+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:08.142119+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.142119+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:11.740822+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:52.390164+0000","last_change":"2024-09-12T00:46:19.282416+0000","last_active":"2024-09-12T01:08:52.390164+0000","last_peered":"2024-09-12T01:08:52.390164+0000","last_clean":"2024-09-12T01:08:52.390164+0000","last_became_active":"2024-09-12T00:46:19.282137+0000","last_became_peered":"2024-09-12T00:46:19.282137+0000","last_unstale":"2024-09-12T01:08:52.390164+0000","last_undegraded":"2024-09-12T01:08:52.390164+0000","last_fullsized":"2024-09-12T01:08:52.390164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:16.519283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.682676+0000","last_change":"2024-09-12T01:12:05.682676+0000","last_active":"2024-09-12T01:12:05.682676+0000","last_peered":"2024-09-12T01:12:05.682676+0000","last_clean":"2024-09-12T01:12:05.682676+0000","last_became_active":"2024-09-12T00:46:16.274198+0000","last_became_peered":"2024-09-12T00:46:16.274198+0000","last_unstale":"2024-09-12T01:12:05.682676+0000","last_undegraded":"2024-09-12T01:12:05.682676+0000","last_fullsized":"2024-09-12T01:12:05.682676+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:05.682595+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:05.682595+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.682595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:53.155169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2619,"num_write":4,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.475262+0000","last_change":"2024-09-12T00:44:37.814764+0000","last_active":"2024-09-12T01:08:27.475262+0000","last_peered":"2024-09-12T01:08:27.475262+0000","last_clean":"2024-09-12T01:08:27.475262+0000","last_became_active":"2024-09-12T00:44:37.814480+0000","last_became_peered":"2024-09-12T00:44:37.814480+0000","last_unstale":"2024-09-12T01:08:27.475262+0000","last_undegraded":"2024-09-12T01:08:27.475262+0000","last_fullsized":"2024-09-12T01:08:27.475262+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:18.473305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.383351+0000","last_change":"2024-09-12T00:56:52.997107+0000","last_active":"2024-09-12T01:08:08.383351+0000","last_peered":"2024-09-12T01:08:08.383351+0000","last_clean":"2024-09-12T01:08:08.383351+0000","last_became_active":"2024-09-12T00:56:52.996816+0000","last_became_peered":"2024-09-12T00:56:52.996816+0000","last_unstale":"2024-09-12T01:08:08.383351+0000","last_undegraded":"2024-09-12T01:08:08.383351+0000","last_fullsized":"2024-09-12T01:08:08.383351+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:21.071571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.203382+0000","last_change":"2024-09-12T01:12:03.203382+0000","last_active":"2024-09-12T01:12:03.203382+0000","last_peered":"2024-09-12T01:12:03.203382+0000","last_clean":"2024-09-12T01:12:03.203382+0000","last_became_active":"2024-09-12T00:46:19.276366+0000","last_became_peered":"2024-09-12T00:46:19.276366+0000","last_unstale":"2024-09-12T01:12:03.203382+0000","last_undegraded":"2024-09-12T01:12:03.203382+0000","last_fullsized":"2024-09-12T01:12:03.203382+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:12:03.203275+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:12:03.203275+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.203275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:54.836932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.604649+0000","last_change":"2024-09-12T00:46:16.274311+0000","last_active":"2024-09-12T01:08:48.604649+0000","last_peered":"2024-09-12T01:08:48.604649+0000","last_clean":"2024-09-12T01:08:48.604649+0000","last_became_active":"2024-09-12T00:46:16.273821+0000","last_became_peered":"2024-09-12T00:46:16.273821+0000","last_unstale":"2024-09-12T01:08:48.604649+0000","last_undegraded":"2024-09-12T01:08:48.604649+0000","last_fullsized":"2024-09-12T01:08:48.604649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:14.476953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.247998+0000","last_change":"2024-09-12T01:11:57.247998+0000","last_active":"2024-09-12T01:11:57.247998+0000","last_peered":"2024-09-12T01:11:57.247998+0000","last_clean":"2024-09-12T01:11:57.247998+0000","last_became_active":"2024-09-12T00:44:37.817357+0000","last_became_peered":"2024-09-12T00:44:37.817357+0000","last_unstale":"2024-09-12T01:11:57.247998+0000","last_undegraded":"2024-09-12T01:11:57.247998+0000","last_fullsized":"2024-09-12T01:11:57.247998+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T01:11:57.247891+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T01:11:57.247891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.247891+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:57.564026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.235206+0000","last_change":"2024-09-12T01:12:04.235206+0000","last_active":"2024-09-12T01:12:04.235206+0000","last_peered":"2024-09-12T01:12:04.235206+0000","last_clean":"2024-09-12T01:12:04.235206+0000","last_became_active":"2024-09-12T00:56:52.990450+0000","last_became_peered":"2024-09-12T00:56:52.990450+0000","last_unstale":"2024-09-12T01:12:04.235206+0000","last_undegraded":"2024-09-12T01:12:04.235206+0000","last_fullsized":"2024-09-12T01:12:04.235206+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:04.235092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:04.235092+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.235092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:29.130516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.218151+0000","last_change":"2024-09-12T00:46:19.281700+0000","last_active":"2024-09-12T01:11:24.218151+0000","last_peered":"2024-09-12T01:11:24.218151+0000","last_clean":"2024-09-12T01:11:24.218151+0000","last_became_active":"2024-09-12T00:46:19.281413+0000","last_became_peered":"2024-09-12T00:46:19.281413+0000","last_unstale":"2024-09-12T01:11:24.218151+0000","last_undegraded":"2024-09-12T01:11:24.218151+0000","last_fullsized":"2024-09-12T01:11:24.218151+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:32.000629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16941,"num_write":8,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"264'8","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.055888+0000","last_change":"2024-09-12T00:46:16.272138+0000","last_active":"2024-09-12T01:11:23.055888+0000","last_peered":"2024-09-12T01:11:23.055888+0000","last_clean":"2024-09-12T01:11:23.055888+0000","last_became_active":"2024-09-12T00:46:16.271730+0000","last_became_peered":"2024-09-12T00:46:16.271730+0000","last_unstale":"2024-09-12T01:11:23.055888+0000","last_undegraded":"2024-09-12T01:11:23.055888+0000","last_fullsized":"2024-09-12T01:11:23.055888+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:24.991885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11841,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.516358+0000","last_change":"2024-09-12T00:44:37.815831+0000","last_active":"2024-09-12T01:08:27.516358+0000","last_peered":"2024-09-12T01:08:27.516358+0000","last_clean":"2024-09-12T01:08:27.516358+0000","last_became_active":"2024-09-12T00:44:37.815542+0000","last_became_peered":"2024-09-12T00:44:37.815542+0000","last_unstale":"2024-09-12T01:08:27.516358+0000","last_undegraded":"2024-09-12T01:08:27.516358+0000","last_fullsized":"2024-09-12T01:08:27.516358+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.238225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":55,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.198009+0000","last_change":"2024-09-12T01:12:05.198009+0000","last_active":"2024-09-12T01:12:05.198009+0000","last_peered":"2024-09-12T01:12:05.198009+0000","last_clean":"2024-09-12T01:12:05.198009+0000","last_became_active":"2024-09-12T00:56:52.988702+0000","last_became_peered":"2024-09-12T00:56:52.988702+0000","last_unstale":"2024-09-12T01:12:05.198009+0000","last_undegraded":"2024-09-12T01:12:05.198009+0000","last_fullsized":"2024-09-12T01:12:05.198009+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:05.197913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:05.197913+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.197913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:01.406564+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.501938+0000","last_change":"2024-09-12T00:46:19.277090+0000","last_active":"2024-09-12T01:11:22.501938+0000","last_peered":"2024-09-12T01:11:22.501938+0000","last_clean":"2024-09-12T01:11:22.501938+0000","last_became_active":"2024-09-12T00:46:19.276538+0000","last_became_peered":"2024-09-12T00:46:19.276538+0000","last_unstale":"2024-09-12T01:11:22.501938+0000","last_undegraded":"2024-09-12T01:11:22.501938+0000","last_fullsized":"2024-09-12T01:11:22.501938+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.608027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.542531+0000","last_change":"2024-09-12T00:46:16.273158+0000","last_active":"2024-09-12T01:11:22.542531+0000","last_peered":"2024-09-12T01:11:22.542531+0000","last_clean":"2024-09-12T01:11:22.542531+0000","last_became_active":"2024-09-12T00:46:16.272892+0000","last_became_peered":"2024-09-12T00:46:16.272892+0000","last_unstale":"2024-09-12T01:11:22.542531+0000","last_undegraded":"2024-09-12T01:11:22.542531+0000","last_fullsized":"2024-09-12T01:11:22.542531+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:29.867186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"264'6","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.601661+0000","last_change":"2024-09-12T00:44:37.820513+0000","last_active":"2024-09-12T01:08:28.601661+0000","last_peered":"2024-09-12T01:08:28.601661+0000","last_clean":"2024-09-12T01:08:28.601661+0000","last_became_active":"2024-09-12T00:44:37.819232+0000","last_became_peered":"2024-09-12T00:44:37.819232+0000","last_unstale":"2024-09-12T01:08:28.601661+0000","last_undegraded":"2024-09-12T01:08:28.601661+0000","last_fullsized":"2024-09-12T01:08:28.601661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:53.201088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479701+0000","last_change":"2024-09-12T00:56:52.994822+0000","last_active":"2024-09-12T01:08:57.479701+0000","last_peered":"2024-09-12T01:08:57.479701+0000","last_clean":"2024-09-12T01:08:57.479701+0000","last_became_active":"2024-09-12T00:56:52.994128+0000","last_became_peered":"2024-09-12T00:56:52.994128+0000","last_unstale":"2024-09-12T01:08:57.479701+0000","last_undegraded":"2024-09-12T01:08:57.479701+0000","last_fullsized":"2024-09-12T01:08:57.479701+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:23.628943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.215225+0000","last_change":"2024-09-12T01:12:00.215225+0000","last_active":"2024-09-12T01:12:00.215225+0000","last_peered":"2024-09-12T01:12:00.215225+0000","last_clean":"2024-09-12T01:12:00.215225+0000","last_became_active":"2024-09-12T00:46:19.281782+0000","last_became_peered":"2024-09-12T00:46:19.281782+0000","last_unstale":"2024-09-12T01:12:00.215225+0000","last_undegraded":"2024-09-12T01:12:00.215225+0000","last_fullsized":"2024-09-12T01:12:00.215225+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:00.215119+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:00.215119+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.215119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:03.911763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.303643+0000","last_change":"2024-09-12T01:12:04.303643+0000","last_active":"2024-09-12T01:12:04.303643+0000","last_peered":"2024-09-12T01:12:04.303643+0000","last_clean":"2024-09-12T01:12:04.303643+0000","last_became_active":"2024-09-12T00:46:16.273356+0000","last_became_peered":"2024-09-12T00:46:16.273356+0000","last_unstale":"2024-09-12T01:12:04.303643+0000","last_undegraded":"2024-09-12T01:12:04.303643+0000","last_fullsized":"2024-09-12T01:12:04.303643+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:04.303551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:04.303551+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.303551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:42.894837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'16","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.405292+0000","last_change":"2024-09-12T01:11:59.405292+0000","last_active":"2024-09-12T01:11:59.405292+0000","last_peered":"2024-09-12T01:11:59.405292+0000","last_clean":"2024-09-12T01:11:59.405292+0000","last_became_active":"2024-09-12T00:44:37.818054+0000","last_became_peered":"2024-09-12T00:44:37.818054+0000","last_unstale":"2024-09-12T01:11:59.405292+0000","last_undegraded":"2024-09-12T01:11:59.405292+0000","last_fullsized":"2024-09-12T01:11:59.405292+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T01:11:59.405209+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T01:11:59.405209+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.405209+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.070533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.609549+0000","last_change":"2024-09-12T00:56:52.991268+0000","last_active":"2024-09-12T01:09:23.609549+0000","last_peered":"2024-09-12T01:09:23.609549+0000","last_clean":"2024-09-12T01:09:23.609549+0000","last_became_active":"2024-09-12T00:56:52.990601+0000","last_became_peered":"2024-09-12T00:56:52.990601+0000","last_unstale":"2024-09-12T01:09:23.609549+0000","last_undegraded":"2024-09-12T01:09:23.609549+0000","last_fullsized":"2024-09-12T01:09:23.609549+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:14.400256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.615507+0000","last_change":"2024-09-12T00:46:19.282146+0000","last_active":"2024-09-12T01:10:08.615507+0000","last_peered":"2024-09-12T01:10:08.615507+0000","last_clean":"2024-09-12T01:10:08.615507+0000","last_became_active":"2024-09-12T00:46:19.281732+0000","last_became_peered":"2024-09-12T00:46:19.281732+0000","last_unstale":"2024-09-12T01:10:08.615507+0000","last_undegraded":"2024-09-12T01:10:08.615507+0000","last_fullsized":"2024-09-12T01:10:08.615507+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:55.852331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.694639+0000","last_change":"2024-09-12T00:46:16.277570+0000","last_active":"2024-09-12T01:11:22.694639+0000","last_peered":"2024-09-12T01:11:22.694639+0000","last_clean":"2024-09-12T01:11:22.694639+0000","last_became_active":"2024-09-12T00:46:16.277261+0000","last_became_peered":"2024-09-12T00:46:16.277261+0000","last_unstale":"2024-09-12T01:11:22.694639+0000","last_undegraded":"2024-09-12T01:11:22.694639+0000","last_fullsized":"2024-09-12T01:11:22.694639+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:00.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'33","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.699881+0000","last_change":"2024-09-12T01:11:58.699881+0000","last_active":"2024-09-12T01:11:58.699881+0000","last_peered":"2024-09-12T01:11:58.699881+0000","last_clean":"2024-09-12T01:11:58.699881+0000","last_became_active":"2024-09-12T00:44:37.818055+0000","last_became_peered":"2024-09-12T00:44:37.818055+0000","last_unstale":"2024-09-12T01:11:58.699881+0000","last_undegraded":"2024-09-12T01:11:58.699881+0000","last_fullsized":"2024-09-12T01:11:58.699881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T01:11:58.699796+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T01:11:58.699796+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.699796+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:03.097781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":106,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:53.398027+0000","last_change":"2024-09-12T00:56:52.989699+0000","last_active":"2024-09-12T01:09:53.398027+0000","last_peered":"2024-09-12T01:09:53.398027+0000","last_clean":"2024-09-12T01:09:53.398027+0000","last_became_active":"2024-09-12T00:56:52.989396+0000","last_became_peered":"2024-09-12T00:56:52.989396+0000","last_unstale":"2024-09-12T01:09:53.398027+0000","last_undegraded":"2024-09-12T01:09:53.398027+0000","last_fullsized":"2024-09-12T01:09:53.398027+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:17.523445+0000","last_change":"2024-09-12T00:46:19.281553+0000","last_active":"2024-09-12T01:09:17.523445+0000","last_peered":"2024-09-12T01:09:17.523445+0000","last_clean":"2024-09-12T01:09:17.523445+0000","last_became_active":"2024-09-12T00:46:19.281231+0000","last_became_peered":"2024-09-12T00:46:19.281231+0000","last_unstale":"2024-09-12T01:09:17.523445+0000","last_undegraded":"2024-09-12T01:09:17.523445+0000","last_fullsized":"2024-09-12T01:09:17.523445+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:58.529910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.387557+0000","last_change":"2024-09-12T01:12:02.387557+0000","last_active":"2024-09-12T01:12:02.387557+0000","last_peered":"2024-09-12T01:12:02.387557+0000","last_clean":"2024-09-12T01:12:02.387557+0000","last_became_active":"2024-09-12T00:46:16.276730+0000","last_became_peered":"2024-09-12T00:46:16.276730+0000","last_unstale":"2024-09-12T01:12:02.387557+0000","last_undegraded":"2024-09-12T01:12:02.387557+0000","last_fullsized":"2024-09-12T01:12:02.387557+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T01:12:02.387460+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T01:12:02.387460+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.387460+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:57.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7172,"num_write":12,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'54","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.427056+0000","last_change":"2024-09-12T01:12:01.427056+0000","last_active":"2024-09-12T01:12:01.427056+0000","last_peered":"2024-09-12T01:12:01.427056+0000","last_clean":"2024-09-12T01:12:01.427056+0000","last_became_active":"2024-09-12T00:44:37.817249+0000","last_became_peered":"2024-09-12T00:44:37.817249+0000","last_unstale":"2024-09-12T01:12:01.427056+0000","last_undegraded":"2024-09-12T01:12:01.427056+0000","last_fullsized":"2024-09-12T01:12:01.427056+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'54","last_scrub_stamp":"2024-09-12T01:12:01.426966+0000","last_deep_scrub":"261'54","last_deep_scrub_stamp":"2024-09-12T01:12:01.426966+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.426966+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:42.391302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":217,"num_write":83,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:52.528987+0000","last_change":"2024-09-12T00:56:52.993381+0000","last_active":"2024-09-12T01:09:52.528987+0000","last_peered":"2024-09-12T01:09:52.528987+0000","last_clean":"2024-09-12T01:09:52.528987+0000","last_became_active":"2024-09-12T00:56:52.992289+0000","last_became_peered":"2024-09-12T00:56:52.992289+0000","last_unstale":"2024-09-12T01:09:52.528987+0000","last_undegraded":"2024-09-12T01:09:52.528987+0000","last_fullsized":"2024-09-12T01:09:52.528987+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.600810+0000","last_change":"2024-09-12T00:46:19.281027+0000","last_active":"2024-09-12T01:08:23.600810+0000","last_peered":"2024-09-12T01:08:23.600810+0000","last_clean":"2024-09-12T01:08:23.600810+0000","last_became_active":"2024-09-12T00:46:19.280725+0000","last_became_peered":"2024-09-12T00:46:19.280725+0000","last_unstale":"2024-09-12T01:08:23.600810+0000","last_undegraded":"2024-09-12T01:08:23.600810+0000","last_fullsized":"2024-09-12T01:08:23.600810+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:05.148455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:13.608121+0000","last_change":"2024-09-12T00:46:16.272821+0000","last_active":"2024-09-12T01:09:13.608121+0000","last_peered":"2024-09-12T01:09:13.608121+0000","last_clean":"2024-09-12T01:09:13.608121+0000","last_became_active":"2024-09-12T00:46:16.272417+0000","last_became_peered":"2024-09-12T00:46:16.272417+0000","last_unstale":"2024-09-12T01:09:13.608121+0000","last_undegraded":"2024-09-12T01:09:13.608121+0000","last_fullsized":"2024-09-12T01:09:13.608121+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:30.234992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2052,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'44","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.611486+0000","last_change":"2024-09-12T00:44:37.818360+0000","last_active":"2024-09-12T01:09:38.611486+0000","last_peered":"2024-09-12T01:09:38.611486+0000","last_clean":"2024-09-12T01:09:38.611486+0000","last_became_active":"2024-09-12T00:44:37.815722+0000","last_became_peered":"2024-09-12T00:44:37.815722+0000","last_unstale":"2024-09-12T01:09:38.611486+0000","last_undegraded":"2024-09-12T01:09:38.611486+0000","last_fullsized":"2024-09-12T01:09:38.611486+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":150,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.483749+0000","last_change":"2024-09-12T00:56:52.993069+0000","last_active":"2024-09-12T01:09:22.483749+0000","last_peered":"2024-09-12T01:09:22.483749+0000","last_clean":"2024-09-12T01:09:22.483749+0000","last_became_active":"2024-09-12T00:56:52.989218+0000","last_became_peered":"2024-09-12T00:56:52.989218+0000","last_unstale":"2024-09-12T01:09:22.483749+0000","last_undegraded":"2024-09-12T01:09:22.483749+0000","last_fullsized":"2024-09-12T01:09:22.483749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:51.764331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.342931+0000","last_change":"2024-09-12T01:12:08.342931+0000","last_active":"2024-09-12T01:12:08.342931+0000","last_peered":"2024-09-12T01:12:08.342931+0000","last_clean":"2024-09-12T01:12:08.342931+0000","last_became_active":"2024-09-12T00:46:19.282270+0000","last_became_peered":"2024-09-12T00:46:19.282270+0000","last_unstale":"2024-09-12T01:12:08.342931+0000","last_undegraded":"2024-09-12T01:12:08.342931+0000","last_fullsized":"2024-09-12T01:12:08.342931+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:08.342829+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:08.342829+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.342829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:40.735440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.276560+0000","last_change":"2024-09-12T01:12:06.276560+0000","last_active":"2024-09-12T01:12:06.276560+0000","last_peered":"2024-09-12T01:12:06.276560+0000","last_clean":"2024-09-12T01:12:06.276560+0000","last_became_active":"2024-09-12T00:46:16.276368+0000","last_became_peered":"2024-09-12T00:46:16.276368+0000","last_unstale":"2024-09-12T01:12:06.276560+0000","last_undegraded":"2024-09-12T01:12:06.276560+0000","last_fullsized":"2024-09-12T01:12:06.276560+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:06.276465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:06.276465+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.276465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:41.953408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:38.611417+0000","last_change":"2024-09-12T00:44:37.821471+0000","last_active":"2024-09-12T01:09:38.611417+0000","last_peered":"2024-09-12T01:09:38.611417+0000","last_clean":"2024-09-12T01:09:38.611417+0000","last_became_active":"2024-09-12T00:44:37.821172+0000","last_became_peered":"2024-09-12T00:44:37.821172+0000","last_unstale":"2024-09-12T01:09:38.611417+0000","last_undegraded":"2024-09-12T01:09:38.611417+0000","last_fullsized":"2024-09-12T01:09:38.611417+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:44:36.788585+0000","last_clean_scrub_stamp":"2024-09-12T00:44:36.788585+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":156,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.610223+0000","last_change":"2024-09-12T00:56:52.993348+0000","last_active":"2024-09-12T01:09:28.610223+0000","last_peered":"2024-09-12T01:09:28.610223+0000","last_clean":"2024-09-12T01:09:28.610223+0000","last_became_active":"2024-09-12T00:56:52.993079+0000","last_became_peered":"2024-09-12T00:56:52.993079+0000","last_unstale":"2024-09-12T01:09:28.610223+0000","last_undegraded":"2024-09-12T01:09:28.610223+0000","last_fullsized":"2024-09-12T01:09:28.610223+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.338219+0000","last_change":"2024-09-12T01:12:07.338219+0000","last_active":"2024-09-12T01:12:07.338219+0000","last_peered":"2024-09-12T01:12:07.338219+0000","last_clean":"2024-09-12T01:12:07.338219+0000","last_became_active":"2024-09-12T00:46:19.279630+0000","last_became_peered":"2024-09-12T00:46:19.279630+0000","last_unstale":"2024-09-12T01:12:07.338219+0000","last_undegraded":"2024-09-12T01:12:07.338219+0000","last_fullsized":"2024-09-12T01:12:07.338219+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:07.338132+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:07.338132+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.338132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.231901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.740030+0000","last_change":"2024-09-12T01:12:00.740030+0000","last_active":"2024-09-12T01:12:00.740030+0000","last_peered":"2024-09-12T01:12:00.740030+0000","last_clean":"2024-09-12T01:12:00.740030+0000","last_became_active":"2024-09-12T00:46:16.266854+0000","last_became_peered":"2024-09-12T00:46:16.266854+0000","last_unstale":"2024-09-12T01:12:00.740030+0000","last_undegraded":"2024-09-12T01:12:00.740030+0000","last_fullsized":"2024-09-12T01:12:00.740030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:00.739896+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:00.739896+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.739896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:37.172009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'16","reported_seq":91,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.436389+0000","last_change":"2024-09-12T01:11:58.436389+0000","last_active":"2024-09-12T01:11:58.436389+0000","last_peered":"2024-09-12T01:11:58.436389+0000","last_clean":"2024-09-12T01:11:58.436389+0000","last_became_active":"2024-09-12T00:44:37.822277+0000","last_became_peered":"2024-09-12T00:44:37.822277+0000","last_unstale":"2024-09-12T01:11:58.436389+0000","last_undegraded":"2024-09-12T01:11:58.436389+0000","last_fullsized":"2024-09-12T01:11:58.436389+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T01:11:58.436300+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T01:11:58.436300+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.436300+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:53.723745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'407","reported_seq":1187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.407182+0000","last_change":"2024-09-12T01:11:48.407090+0000","last_active":"2024-09-12T01:11:48.407182+0000","last_peered":"2024-09-12T01:11:48.407182+0000","last_clean":"2024-09-12T01:11:48.407182+0000","last_became_active":"2024-09-12T00:30:11.107706+0000","last_became_peered":"2024-09-12T00:30:11.107706+0000","last_unstale":"2024-09-12T01:11:48.407182+0000","last_undegraded":"2024-09-12T01:11:48.407182+0000","last_fullsized":"2024-09-12T01:11:48.407182+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T01:11:48.406922+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T01:11:48.406922+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.406922+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:05.383919+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436870,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":772,"num_read_kb":12989,"num_write":1306,"num_write_kb":41879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'141","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.834184+0000","last_change":"2024-09-12T01:11:47.834184+0000","last_active":"2024-09-12T01:11:47.834184+0000","last_peered":"2024-09-12T01:11:47.834184+0000","last_clean":"2024-09-12T01:11:47.834184+0000","last_became_active":"2024-09-12T00:30:13.126147+0000","last_became_peered":"2024-09-12T00:30:13.126147+0000","last_unstale":"2024-09-12T01:11:47.834184+0000","last_undegraded":"2024-09-12T01:11:47.834184+0000","last_fullsized":"2024-09-12T01:11:47.834184+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T01:11:47.834094+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T01:11:47.834094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.834094+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:12.812212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":527,"num_write":201,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'354","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.354790+0000","last_change":"2024-09-12T01:11:44.354725+0000","last_active":"2024-09-12T01:11:44.354790+0000","last_peered":"2024-09-12T01:11:44.354790+0000","last_clean":"2024-09-12T01:11:44.354790+0000","last_became_active":"2024-09-12T00:30:11.101252+0000","last_became_peered":"2024-09-12T00:30:11.101252+0000","last_unstale":"2024-09-12T01:11:44.354790+0000","last_undegraded":"2024-09-12T01:11:44.354790+0000","last_fullsized":"2024-09-12T01:11:44.354790+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-12T01:11:44.354589+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-12T01:11:44.354589+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.354589+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:43.412106+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":19965,"num_write":1084,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'209","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.857299+0000","last_change":"2024-09-12T01:11:55.857299+0000","last_active":"2024-09-12T01:11:55.857299+0000","last_peered":"2024-09-12T01:11:55.857299+0000","last_clean":"2024-09-12T01:11:55.857299+0000","last_became_active":"2024-09-12T00:30:13.123880+0000","last_became_peered":"2024-09-12T00:30:13.123880+0000","last_unstale":"2024-09-12T01:11:55.857299+0000","last_undegraded":"2024-09-12T01:11:55.857299+0000","last_fullsized":"2024-09-12T01:11:55.857299+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-12T01:11:55.857208+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-12T01:11:55.857208+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.857208+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:36.363370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":720,"num_write":314,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'300","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.325606+0000","last_change":"2024-09-12T01:11:43.325526+0000","last_active":"2024-09-12T01:11:43.325606+0000","last_peered":"2024-09-12T01:11:43.325606+0000","last_clean":"2024-09-12T01:11:43.325606+0000","last_became_active":"2024-09-12T00:30:11.096381+0000","last_became_peered":"2024-09-12T00:30:11.096381+0000","last_unstale":"2024-09-12T01:11:43.325606+0000","last_undegraded":"2024-09-12T01:11:43.325606+0000","last_fullsized":"2024-09-12T01:11:43.325606+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'300","last_scrub_stamp":"2024-09-12T01:11:43.325415+0000","last_deep_scrub":"264'300","last_deep_scrub_stamp":"2024-09-12T01:11:43.325415+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.325415+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:58.190997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155766,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":52760,"num_write":991,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'151","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.850009+0000","last_change":"2024-09-12T01:11:58.850009+0000","last_active":"2024-09-12T01:11:58.850009+0000","last_peered":"2024-09-12T01:11:58.850009+0000","last_clean":"2024-09-12T01:11:58.850009+0000","last_became_active":"2024-09-12T00:30:13.120834+0000","last_became_peered":"2024-09-12T00:30:13.120834+0000","last_unstale":"2024-09-12T01:11:58.850009+0000","last_undegraded":"2024-09-12T01:11:58.850009+0000","last_fullsized":"2024-09-12T01:11:58.850009+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T01:11:58.849919+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T01:11:58.849919+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.849919+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:44.007174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":556,"num_write":237,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'320","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.443053+0000","last_change":"2024-09-12T01:11:35.443053+0000","last_active":"2024-09-12T01:11:35.443053+0000","last_peered":"2024-09-12T01:11:35.443053+0000","last_clean":"2024-09-12T01:11:35.443053+0000","last_became_active":"2024-09-12T00:30:11.101773+0000","last_became_peered":"2024-09-12T00:30:11.101773+0000","last_unstale":"2024-09-12T01:11:35.443053+0000","last_undegraded":"2024-09-12T01:11:35.443053+0000","last_fullsized":"2024-09-12T01:11:35.443053+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'320","last_scrub_stamp":"2024-09-12T01:11:35.442897+0000","last_deep_scrub":"264'320","last_deep_scrub_stamp":"2024-09-12T01:11:35.442897+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.442897+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:33.195530+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262280,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":453,"num_read_kb":6783,"num_write":940,"num_write_kb":20709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4368","reported_seq":4975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.323139+0000","last_change":"2024-09-12T01:11:46.323139+0000","last_active":"2024-09-12T01:11:46.323139+0000","last_peered":"2024-09-12T01:11:46.323139+0000","last_clean":"2024-09-12T01:11:46.323139+0000","last_became_active":"2024-09-12T00:30:13.113812+0000","last_became_peered":"2024-09-12T00:30:13.113812+0000","last_unstale":"2024-09-12T01:11:46.323139+0000","last_undegraded":"2024-09-12T01:11:46.323139+0000","last_fullsized":"2024-09-12T01:11:46.323139+0000","mapping_epoch":28,"log_start":"264'4300","ondisk_log_start":"264'4300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4368","last_scrub_stamp":"2024-09-12T01:11:46.323056+0000","last_deep_scrub":"264'4368","last_deep_scrub_stamp":"2024-09-12T01:11:46.323056+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.323056+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:31.432326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17553,"num_read_kb":14742,"num_write":6586,"num_write_kb":3311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'326","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.473231+0000","last_change":"2024-09-12T01:11:37.473231+0000","last_active":"2024-09-12T01:11:37.473231+0000","last_peered":"2024-09-12T01:11:37.473231+0000","last_clean":"2024-09-12T01:11:37.473231+0000","last_became_active":"2024-09-12T00:30:11.097339+0000","last_became_peered":"2024-09-12T00:30:11.097339+0000","last_unstale":"2024-09-12T01:11:37.473231+0000","last_undegraded":"2024-09-12T01:11:37.473231+0000","last_fullsized":"2024-09-12T01:11:37.473231+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T01:11:37.473039+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T01:11:37.473039+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.473039+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:13.523857+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":4533,"num_write":1139,"num_write_kb":19662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"264'202","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.333000+0000","last_change":"2024-09-12T01:11:51.333000+0000","last_active":"2024-09-12T01:11:51.333000+0000","last_peered":"2024-09-12T01:11:51.333000+0000","last_clean":"2024-09-12T01:11:51.333000+0000","last_became_active":"2024-09-12T00:30:13.125363+0000","last_became_peered":"2024-09-12T00:30:13.125363+0000","last_unstale":"2024-09-12T01:11:51.333000+0000","last_undegraded":"2024-09-12T01:11:51.333000+0000","last_fullsized":"2024-09-12T01:11:51.333000+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T01:11:51.332895+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T01:11:51.332895+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.332895+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:19.094184+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":845,"num_read_kb":691,"num_write":311,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'352","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.393821+0000","last_change":"2024-09-12T01:11:34.393821+0000","last_active":"2024-09-12T01:11:34.393821+0000","last_peered":"2024-09-12T01:11:34.393821+0000","last_clean":"2024-09-12T01:11:34.393821+0000","last_became_active":"2024-09-12T00:30:11.104535+0000","last_became_peered":"2024-09-12T00:30:11.104535+0000","last_unstale":"2024-09-12T01:11:34.393821+0000","last_undegraded":"2024-09-12T01:11:34.393821+0000","last_fullsized":"2024-09-12T01:11:34.393821+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-12T01:11:34.393680+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-12T01:11:34.393680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.393680+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:03.783815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174750,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":66788,"num_write":989,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'115","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.451792+0000","last_change":"2024-09-12T01:11:44.451717+0000","last_active":"2024-09-12T01:11:44.451792+0000","last_peered":"2024-09-12T01:11:44.451792+0000","last_clean":"2024-09-12T01:11:44.451792+0000","last_became_active":"2024-09-12T00:30:13.124774+0000","last_became_peered":"2024-09-12T00:30:13.124774+0000","last_unstale":"2024-09-12T01:11:44.451792+0000","last_undegraded":"2024-09-12T01:11:44.451792+0000","last_fullsized":"2024-09-12T01:11:44.451792+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T01:11:44.451630+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T01:11:44.451630+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.451630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.872379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":451,"num_write":180,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'309","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.403865+0000","last_change":"2024-09-12T01:11:40.403865+0000","last_active":"2024-09-12T01:11:40.403865+0000","last_peered":"2024-09-12T01:11:40.403865+0000","last_clean":"2024-09-12T01:11:40.403865+0000","last_became_active":"2024-09-12T00:30:11.102281+0000","last_became_peered":"2024-09-12T00:30:11.102281+0000","last_unstale":"2024-09-12T01:11:40.403865+0000","last_undegraded":"2024-09-12T01:11:40.403865+0000","last_fullsized":"2024-09-12T01:11:40.403865+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T01:11:40.403724+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T01:11:40.403724+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.403724+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:13.642901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3622998,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":454,"num_read_kb":13880,"num_write":954,"num_write_kb":40348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'545","reported_seq":1250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.361177+0000","last_change":"2024-09-12T01:11:45.361112+0000","last_active":"2024-09-12T01:11:45.361177+0000","last_peered":"2024-09-12T01:11:45.361177+0000","last_clean":"2024-09-12T01:11:45.361177+0000","last_became_active":"2024-09-12T00:30:13.126123+0000","last_became_peered":"2024-09-12T00:30:13.126123+0000","last_unstale":"2024-09-12T01:11:45.361177+0000","last_undegraded":"2024-09-12T01:11:45.361177+0000","last_fullsized":"2024-09-12T01:11:45.361177+0000","mapping_epoch":28,"log_start":"264'500","ondisk_log_start":"264'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'545","last_scrub_stamp":"2024-09-12T01:11:45.361027+0000","last_deep_scrub":"264'545","last_deep_scrub_stamp":"2024-09-12T01:11:45.361027+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.361027+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:32.122143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2509,"num_read_kb":2200,"num_write":899,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25757,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'299","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.286745+0000","last_change":"2024-09-12T01:11:42.286745+0000","last_active":"2024-09-12T01:11:42.286745+0000","last_peered":"2024-09-12T01:11:42.286745+0000","last_clean":"2024-09-12T01:11:42.286745+0000","last_became_active":"2024-09-12T00:30:11.104084+0000","last_became_peered":"2024-09-12T00:30:11.104084+0000","last_unstale":"2024-09-12T01:11:42.286745+0000","last_undegraded":"2024-09-12T01:11:42.286745+0000","last_fullsized":"2024-09-12T01:11:42.286745+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T01:11:42.286619+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T01:11:42.286619+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.286619+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:50.160187+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":483,"num_read_kb":14633,"num_write":970,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'231","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.388819+0000","last_change":"2024-09-12T01:11:53.388819+0000","last_active":"2024-09-12T01:11:53.388819+0000","last_peered":"2024-09-12T01:11:53.388819+0000","last_clean":"2024-09-12T01:11:53.388819+0000","last_became_active":"2024-09-12T00:30:13.127581+0000","last_became_peered":"2024-09-12T00:30:13.127581+0000","last_unstale":"2024-09-12T01:11:53.388819+0000","last_undegraded":"2024-09-12T01:11:53.388819+0000","last_fullsized":"2024-09-12T01:11:53.388819+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T01:11:53.388734+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T01:11:53.388734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.388734+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:24.192130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1008,"num_read_kb":834,"num_write":338,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'462","reported_seq":1246,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.803359+0000","last_change":"2024-09-12T01:11:49.803359+0000","last_active":"2024-09-12T01:11:49.803359+0000","last_peered":"2024-09-12T01:11:49.803359+0000","last_clean":"2024-09-12T01:11:49.803359+0000","last_became_active":"2024-09-12T00:30:13.121154+0000","last_became_peered":"2024-09-12T00:30:13.121154+0000","last_unstale":"2024-09-12T01:11:49.803359+0000","last_undegraded":"2024-09-12T01:11:49.803359+0000","last_fullsized":"2024-09-12T01:11:49.803359+0000","mapping_epoch":28,"log_start":"264'400","ondisk_log_start":"264'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'462","last_scrub_stamp":"2024-09-12T01:11:49.803243+0000","last_deep_scrub":"264'462","last_deep_scrub_stamp":"2024-09-12T01:11:49.803243+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.803243+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:20.220457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2284,"num_read_kb":1967,"num_write":806,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'287","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.803024+0000","last_change":"2024-09-12T01:11:31.803024+0000","last_active":"2024-09-12T01:11:31.803024+0000","last_peered":"2024-09-12T01:11:31.803024+0000","last_clean":"2024-09-12T01:11:31.803024+0000","last_became_active":"2024-09-12T00:30:11.103437+0000","last_became_peered":"2024-09-12T00:30:11.103437+0000","last_unstale":"2024-09-12T01:11:31.803024+0000","last_undegraded":"2024-09-12T01:11:31.803024+0000","last_fullsized":"2024-09-12T01:11:31.803024+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'287","last_scrub_stamp":"2024-09-12T01:11:31.802921+0000","last_deep_scrub":"264'287","last_deep_scrub_stamp":"2024-09-12T01:11:31.802921+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.802921+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:24.521722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767235,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":430,"num_read_kb":35388,"num_write":888,"num_write_kb":32368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'227","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.432953+0000","last_change":"2024-09-12T01:11:45.432953+0000","last_active":"2024-09-12T01:11:45.432953+0000","last_peered":"2024-09-12T01:11:45.432953+0000","last_clean":"2024-09-12T01:11:45.432953+0000","last_became_active":"2024-09-12T00:30:13.128977+0000","last_became_peered":"2024-09-12T00:30:13.128977+0000","last_unstale":"2024-09-12T01:11:45.432953+0000","last_undegraded":"2024-09-12T01:11:45.432953+0000","last_fullsized":"2024-09-12T01:11:45.432953+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-12T01:11:45.432855+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-12T01:11:45.432855+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.432855+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.213964+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1058,"num_read_kb":878,"num_write":388,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'310","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.446257+0000","last_change":"2024-09-12T01:11:36.446257+0000","last_active":"2024-09-12T01:11:36.446257+0000","last_peered":"2024-09-12T01:11:36.446257+0000","last_clean":"2024-09-12T01:11:36.446257+0000","last_became_active":"2024-09-12T00:30:11.114961+0000","last_became_peered":"2024-09-12T00:30:11.114961+0000","last_unstale":"2024-09-12T01:11:36.446257+0000","last_undegraded":"2024-09-12T01:11:36.446257+0000","last_fullsized":"2024-09-12T01:11:36.446257+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T01:11:36.446124+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T01:11:36.446124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.446124+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.906220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":433,"num_read_kb":13562,"num_write":946,"num_write_kb":25787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'212","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.855585+0000","last_change":"2024-09-12T01:11:39.855585+0000","last_active":"2024-09-12T01:11:39.855585+0000","last_peered":"2024-09-12T01:11:39.855585+0000","last_clean":"2024-09-12T01:11:39.855585+0000","last_became_active":"2024-09-12T00:30:13.127190+0000","last_became_peered":"2024-09-12T00:30:13.127190+0000","last_unstale":"2024-09-12T01:11:39.855585+0000","last_undegraded":"2024-09-12T01:11:39.855585+0000","last_fullsized":"2024-09-12T01:11:39.855585+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T01:11:39.855488+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T01:11:39.855488+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.855488+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:33.985807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":739,"num_write":341,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'368","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.424540+0000","last_change":"2024-09-12T01:11:35.424540+0000","last_active":"2024-09-12T01:11:35.424540+0000","last_peered":"2024-09-12T01:11:35.424540+0000","last_clean":"2024-09-12T01:11:35.424540+0000","last_became_active":"2024-09-12T00:30:11.105844+0000","last_became_peered":"2024-09-12T00:30:11.105844+0000","last_unstale":"2024-09-12T01:11:35.424540+0000","last_undegraded":"2024-09-12T01:11:35.424540+0000","last_fullsized":"2024-09-12T01:11:35.424540+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-12T01:11:35.424385+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-12T01:11:35.424385+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.424385+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:55.565109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242896,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":46849,"num_write":1178,"num_write_kb":40470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'183","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.095594+0000","last_change":"2024-09-12T01:11:44.095594+0000","last_active":"2024-09-12T01:11:44.095594+0000","last_peered":"2024-09-12T01:11:44.095594+0000","last_clean":"2024-09-12T01:11:44.095594+0000","last_became_active":"2024-09-12T00:30:13.124627+0000","last_became_peered":"2024-09-12T00:30:13.124627+0000","last_unstale":"2024-09-12T01:11:44.095594+0000","last_undegraded":"2024-09-12T01:11:44.095594+0000","last_fullsized":"2024-09-12T01:11:44.095594+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-09-12T01:11:44.095499+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-09-12T01:11:44.095499+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.095499+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:48.009771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":804,"num_read_kb":662,"num_write":262,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'315","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.375607+0000","last_change":"2024-09-12T01:11:34.375607+0000","last_active":"2024-09-12T01:11:34.375607+0000","last_peered":"2024-09-12T01:11:34.375607+0000","last_clean":"2024-09-12T01:11:34.375607+0000","last_became_active":"2024-09-12T00:30:11.114309+0000","last_became_peered":"2024-09-12T00:30:11.114309+0000","last_unstale":"2024-09-12T01:11:34.375607+0000","last_undegraded":"2024-09-12T01:11:34.375607+0000","last_fullsized":"2024-09-12T01:11:34.375607+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T01:11:34.375465+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T01:11:34.375465+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.375465+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.864011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052685,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":64152,"num_write":970,"num_write_kb":27626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'205","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.391069+0000","last_change":"2024-09-12T01:11:52.391069+0000","last_active":"2024-09-12T01:11:52.391069+0000","last_peered":"2024-09-12T01:11:52.391069+0000","last_clean":"2024-09-12T01:11:52.391069+0000","last_became_active":"2024-09-12T00:30:13.129718+0000","last_became_peered":"2024-09-12T00:30:13.129718+0000","last_unstale":"2024-09-12T01:11:52.391069+0000","last_undegraded":"2024-09-12T01:11:52.391069+0000","last_fullsized":"2024-09-12T01:11:52.391069+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'205","last_scrub_stamp":"2024-09-12T01:11:52.390951+0000","last_deep_scrub":"264'205","last_deep_scrub_stamp":"2024-09-12T01:11:52.390951+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.390951+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:25.975769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":749,"num_write":336,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'388","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.074143+0000","last_change":"2024-09-12T01:11:37.074143+0000","last_active":"2024-09-12T01:11:37.074143+0000","last_peered":"2024-09-12T01:11:37.074143+0000","last_clean":"2024-09-12T01:11:37.074143+0000","last_became_active":"2024-09-12T00:30:11.108958+0000","last_became_peered":"2024-09-12T00:30:11.108958+0000","last_unstale":"2024-09-12T01:11:37.074143+0000","last_undegraded":"2024-09-12T01:11:37.074143+0000","last_fullsized":"2024-09-12T01:11:37.074143+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'388","last_scrub_stamp":"2024-09-12T01:11:37.074011+0000","last_deep_scrub":"264'388","last_deep_scrub_stamp":"2024-09-12T01:11:37.074011+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.074011+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:15.101690+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1489630,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":577,"num_read_kb":32016,"num_write":1378,"num_write_kb":50601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'152","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.881871+0000","last_change":"2024-09-12T01:11:41.881871+0000","last_active":"2024-09-12T01:11:41.881871+0000","last_peered":"2024-09-12T01:11:41.881871+0000","last_clean":"2024-09-12T01:11:41.881871+0000","last_became_active":"2024-09-12T00:30:13.126143+0000","last_became_peered":"2024-09-12T00:30:13.126143+0000","last_unstale":"2024-09-12T01:11:41.881871+0000","last_undegraded":"2024-09-12T01:11:41.881871+0000","last_fullsized":"2024-09-12T01:11:41.881871+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T01:11:41.881760+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T01:11:41.881760+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.881760+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:50.664271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":565,"num_write":225,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'347","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.071064+0000","last_change":"2024-09-12T01:11:38.071064+0000","last_active":"2024-09-12T01:11:38.071064+0000","last_peered":"2024-09-12T01:11:38.071064+0000","last_clean":"2024-09-12T01:11:38.071064+0000","last_became_active":"2024-09-12T00:30:11.096162+0000","last_became_peered":"2024-09-12T00:30:11.096162+0000","last_unstale":"2024-09-12T01:11:38.071064+0000","last_undegraded":"2024-09-12T01:11:38.071064+0000","last_fullsized":"2024-09-12T01:11:38.071064+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:38.070939+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:38.070939+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.070939+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.813945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340490,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":7249,"num_write":983,"num_write_kb":14577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'151","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.327934+0000","last_change":"2024-09-12T01:11:55.327934+0000","last_active":"2024-09-12T01:11:55.327934+0000","last_peered":"2024-09-12T01:11:55.327934+0000","last_clean":"2024-09-12T01:11:55.327934+0000","last_became_active":"2024-09-12T00:30:21.192654+0000","last_became_peered":"2024-09-12T00:30:21.192654+0000","last_unstale":"2024-09-12T01:11:55.327934+0000","last_undegraded":"2024-09-12T01:11:55.327934+0000","last_fullsized":"2024-09-12T01:11:55.327934+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T01:11:55.327843+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T01:11:55.327843+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.327843+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:24.249456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":350,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'101","reported_seq":713,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.031586+0000","last_change":"2024-09-12T01:11:42.031586+0000","last_active":"2024-09-12T01:11:42.031586+0000","last_peered":"2024-09-12T01:11:42.031586+0000","last_clean":"2024-09-12T01:11:42.031586+0000","last_became_active":"2024-09-12T00:30:13.130030+0000","last_became_peered":"2024-09-12T00:30:13.130030+0000","last_unstale":"2024-09-12T01:11:42.031586+0000","last_undegraded":"2024-09-12T01:11:42.031586+0000","last_fullsized":"2024-09-12T01:11:42.031586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T01:11:42.031492+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T01:11:42.031492+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.031492+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:53.639664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":143,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'440","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.883016+0000","last_change":"2024-09-12T01:11:38.883016+0000","last_active":"2024-09-12T01:11:38.883016+0000","last_peered":"2024-09-12T01:11:38.883016+0000","last_clean":"2024-09-12T01:11:38.883016+0000","last_became_active":"2024-09-12T00:30:46.767516+0000","last_became_peered":"2024-09-12T00:30:46.767516+0000","last_unstale":"2024-09-12T01:11:38.883016+0000","last_undegraded":"2024-09-12T01:11:38.883016+0000","last_fullsized":"2024-09-12T01:11:38.883016+0000","mapping_epoch":39,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'440","last_scrub_stamp":"2024-09-12T01:11:38.882878+0000","last_deep_scrub":"264'440","last_deep_scrub_stamp":"2024-09-12T01:11:38.882878+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.882878+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:35.403537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1451987,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38823,"num_write":1374,"num_write_kb":62705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,4],"acting":[3,5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.822489+0000","last_change":"2024-09-12T01:12:00.822489+0000","last_active":"2024-09-12T01:12:00.822489+0000","last_peered":"2024-09-12T01:12:00.822489+0000","last_clean":"2024-09-12T01:12:00.822489+0000","last_became_active":"2024-09-12T00:30:15.127067+0000","last_became_peered":"2024-09-12T00:30:15.127067+0000","last_unstale":"2024-09-12T01:12:00.822489+0000","last_undegraded":"2024-09-12T01:12:00.822489+0000","last_fullsized":"2024-09-12T01:12:00.822489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:00.822404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:00.822404+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.822404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:28.679018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'330","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.356814+0000","last_change":"2024-09-12T01:11:59.356814+0000","last_active":"2024-09-12T01:11:59.356814+0000","last_peered":"2024-09-12T01:11:59.356814+0000","last_clean":"2024-09-12T01:11:59.356814+0000","last_became_active":"2024-09-12T00:30:17.145455+0000","last_became_peered":"2024-09-12T00:30:17.145455+0000","last_unstale":"2024-09-12T01:11:59.356814+0000","last_undegraded":"2024-09-12T01:11:59.356814+0000","last_fullsized":"2024-09-12T01:11:59.356814+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-09-12T01:11:59.356704+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-09-12T01:11:59.356704+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.356704+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:54.248777+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45268,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":1055,"num_write":410,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.794369+0000","last_change":"2024-09-12T01:11:54.794369+0000","last_active":"2024-09-12T01:11:54.794369+0000","last_peered":"2024-09-12T01:11:54.794369+0000","last_clean":"2024-09-12T01:11:54.794369+0000","last_became_active":"2024-09-12T00:30:19.168192+0000","last_became_peered":"2024-09-12T00:30:19.168192+0000","last_unstale":"2024-09-12T01:11:54.794369+0000","last_undegraded":"2024-09-12T01:11:54.794369+0000","last_fullsized":"2024-09-12T01:11:54.794369+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.794275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.794275+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.794275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:44.014529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'149","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.784697+0000","last_change":"2024-09-12T01:11:59.784697+0000","last_active":"2024-09-12T01:11:59.784697+0000","last_peered":"2024-09-12T01:11:59.784697+0000","last_clean":"2024-09-12T01:11:59.784697+0000","last_became_active":"2024-09-12T00:30:21.189141+0000","last_became_peered":"2024-09-12T00:30:21.189141+0000","last_unstale":"2024-09-12T01:11:59.784697+0000","last_undegraded":"2024-09-12T01:11:59.784697+0000","last_fullsized":"2024-09-12T01:11:59.784697+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T01:11:59.784580+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T01:11:59.784580+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.784580+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:54.478034+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":204,"num_write":274,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'90","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.830989+0000","last_change":"2024-09-12T01:11:51.830989+0000","last_active":"2024-09-12T01:11:51.830989+0000","last_peered":"2024-09-12T01:11:51.830989+0000","last_clean":"2024-09-12T01:11:51.830989+0000","last_became_active":"2024-09-12T00:30:13.127577+0000","last_became_peered":"2024-09-12T00:30:13.127577+0000","last_unstale":"2024-09-12T01:11:51.830989+0000","last_undegraded":"2024-09-12T01:11:51.830989+0000","last_fullsized":"2024-09-12T01:11:51.830989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-09-12T01:11:51.830881+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-09-12T01:11:51.830881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.830881+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:18.867029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":367,"num_write":144,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'311","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.095067+0000","last_change":"2024-09-12T01:11:35.095067+0000","last_active":"2024-09-12T01:11:35.095067+0000","last_peered":"2024-09-12T01:11:35.095067+0000","last_clean":"2024-09-12T01:11:35.095067+0000","last_became_active":"2024-09-12T00:30:11.091860+0000","last_became_peered":"2024-09-12T00:30:11.091860+0000","last_unstale":"2024-09-12T01:11:35.095067+0000","last_undegraded":"2024-09-12T01:11:35.095067+0000","last_fullsized":"2024-09-12T01:11:35.095067+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T01:11:35.094942+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T01:11:35.094942+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.094942+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:31.385294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":88630,"num_write":981,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.307817+0000","last_change":"2024-09-12T01:11:51.307817+0000","last_active":"2024-09-12T01:11:51.307817+0000","last_peered":"2024-09-12T01:11:51.307817+0000","last_clean":"2024-09-12T01:11:51.307817+0000","last_became_active":"2024-09-12T00:30:15.130254+0000","last_became_peered":"2024-09-12T00:30:15.130254+0000","last_unstale":"2024-09-12T01:11:51.307817+0000","last_undegraded":"2024-09-12T01:11:51.307817+0000","last_fullsized":"2024-09-12T01:11:51.307817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.307722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.307722+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.307722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:56.894557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'112","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.814903+0000","last_change":"2024-09-12T01:11:49.814903+0000","last_active":"2024-09-12T01:11:49.814903+0000","last_peered":"2024-09-12T01:11:49.814903+0000","last_clean":"2024-09-12T01:11:49.814903+0000","last_became_active":"2024-09-12T00:30:17.148422+0000","last_became_peered":"2024-09-12T00:30:17.148422+0000","last_unstale":"2024-09-12T01:11:49.814903+0000","last_undegraded":"2024-09-12T01:11:49.814903+0000","last_fullsized":"2024-09-12T01:11:49.814903+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T01:11:49.814806+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T01:11:49.814806+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.814806+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:36.594354+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":99,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.784192+0000","last_change":"2024-09-12T01:11:53.784192+0000","last_active":"2024-09-12T01:11:53.784192+0000","last_peered":"2024-09-12T01:11:53.784192+0000","last_clean":"2024-09-12T01:11:53.784192+0000","last_became_active":"2024-09-12T00:30:19.163363+0000","last_became_peered":"2024-09-12T00:30:19.163363+0000","last_unstale":"2024-09-12T01:11:53.784192+0000","last_undegraded":"2024-09-12T01:11:53.784192+0000","last_fullsized":"2024-09-12T01:11:53.784192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.784070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.784070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.784070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:27.826504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'138","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.243432+0000","last_change":"2024-09-12T01:11:59.243432+0000","last_active":"2024-09-12T01:11:59.243432+0000","last_peered":"2024-09-12T01:11:59.243432+0000","last_clean":"2024-09-12T01:11:59.243432+0000","last_became_active":"2024-09-12T00:30:21.180419+0000","last_became_peered":"2024-09-12T00:30:21.180419+0000","last_unstale":"2024-09-12T01:11:59.243432+0000","last_undegraded":"2024-09-12T01:11:59.243432+0000","last_fullsized":"2024-09-12T01:11:59.243432+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-12T01:11:59.243350+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-12T01:11:59.243350+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.243350+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:06.416764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":136,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'120","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.315178+0000","last_change":"2024-09-12T01:11:47.315178+0000","last_active":"2024-09-12T01:11:47.315178+0000","last_peered":"2024-09-12T01:11:47.315178+0000","last_clean":"2024-09-12T01:11:47.315178+0000","last_became_active":"2024-09-12T00:30:13.126531+0000","last_became_peered":"2024-09-12T00:30:13.126531+0000","last_unstale":"2024-09-12T01:11:47.315178+0000","last_undegraded":"2024-09-12T01:11:47.315178+0000","last_fullsized":"2024-09-12T01:11:47.315178+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T01:11:47.315083+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T01:11:47.315083+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.315083+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:02.492593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":438,"num_write":171,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'350","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.902895+0000","last_change":"2024-09-12T01:11:40.902895+0000","last_active":"2024-09-12T01:11:40.902895+0000","last_peered":"2024-09-12T01:11:40.902895+0000","last_clean":"2024-09-12T01:11:40.902895+0000","last_became_active":"2024-09-12T00:30:11.110001+0000","last_became_peered":"2024-09-12T00:30:11.110001+0000","last_unstale":"2024-09-12T01:11:40.902895+0000","last_undegraded":"2024-09-12T01:11:40.902895+0000","last_fullsized":"2024-09-12T01:11:40.902895+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T01:11:40.902786+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T01:11:40.902786+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.902786+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:44.491567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371860,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":4100,"num_write":1032,"num_write_kb":26242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.272198+0000","last_change":"2024-09-12T01:11:52.272198+0000","last_active":"2024-09-12T01:11:52.272198+0000","last_peered":"2024-09-12T01:11:52.272198+0000","last_clean":"2024-09-12T01:11:52.272198+0000","last_became_active":"2024-09-12T00:30:15.125728+0000","last_became_peered":"2024-09-12T00:30:15.125728+0000","last_unstale":"2024-09-12T01:11:52.272198+0000","last_undegraded":"2024-09-12T01:11:52.272198+0000","last_fullsized":"2024-09-12T01:11:52.272198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.272102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.272102+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.272102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:19.840928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'152","reported_seq":696,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.325286+0000","last_change":"2024-09-12T01:11:58.325286+0000","last_active":"2024-09-12T01:11:58.325286+0000","last_peered":"2024-09-12T01:11:58.325286+0000","last_clean":"2024-09-12T01:11:58.325286+0000","last_became_active":"2024-09-12T00:30:17.144701+0000","last_became_peered":"2024-09-12T00:30:17.144701+0000","last_unstale":"2024-09-12T01:11:58.325286+0000","last_undegraded":"2024-09-12T01:11:58.325286+0000","last_fullsized":"2024-09-12T01:11:58.325286+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T01:11:58.325196+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T01:11:58.325196+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.325196+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:25.004989+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":141,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'777","reported_seq":2316,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.343925+0000","last_change":"2024-09-12T00:30:19.170912+0000","last_active":"2024-09-12T01:11:24.343925+0000","last_peered":"2024-09-12T01:11:24.343925+0000","last_clean":"2024-09-12T01:11:24.343925+0000","last_became_active":"2024-09-12T00:30:19.170568+0000","last_became_peered":"2024-09-12T00:30:19.170568+0000","last_unstale":"2024-09-12T01:11:24.343925+0000","last_undegraded":"2024-09-12T01:11:24.343925+0000","last_fullsized":"2024-09-12T01:11:24.343925+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:09.164786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'215","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.422104+0000","last_change":"2024-09-12T01:11:57.422104+0000","last_active":"2024-09-12T01:11:57.422104+0000","last_peered":"2024-09-12T01:11:57.422104+0000","last_clean":"2024-09-12T01:11:57.422104+0000","last_became_active":"2024-09-12T00:30:21.188312+0000","last_became_peered":"2024-09-12T00:30:21.188312+0000","last_unstale":"2024-09-12T01:11:57.422104+0000","last_undegraded":"2024-09-12T01:11:57.422104+0000","last_fullsized":"2024-09-12T01:11:57.422104+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-09-12T01:11:57.422016+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-09-12T01:11:57.422016+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.422016+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:22.406098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":596,"num_write":468,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'84","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.309383+0000","last_change":"2024-09-12T01:11:49.309383+0000","last_active":"2024-09-12T01:11:49.309383+0000","last_peered":"2024-09-12T01:11:49.309383+0000","last_clean":"2024-09-12T01:11:49.309383+0000","last_became_active":"2024-09-12T00:30:13.125323+0000","last_became_peered":"2024-09-12T00:30:13.125323+0000","last_unstale":"2024-09-12T01:11:49.309383+0000","last_undegraded":"2024-09-12T01:11:49.309383+0000","last_fullsized":"2024-09-12T01:11:49.309383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T01:11:49.309301+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T01:11:49.309301+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.309301+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:50.800564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":383,"num_read_kb":333,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'407","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.820266+0000","last_change":"2024-09-12T01:11:30.820266+0000","last_active":"2024-09-12T01:11:30.820266+0000","last_peered":"2024-09-12T01:11:30.820266+0000","last_clean":"2024-09-12T01:11:30.820266+0000","last_became_active":"2024-09-12T00:30:11.101745+0000","last_became_peered":"2024-09-12T00:30:11.101745+0000","last_unstale":"2024-09-12T01:11:30.820266+0000","last_undegraded":"2024-09-12T01:11:30.820266+0000","last_fullsized":"2024-09-12T01:11:30.820266+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T01:11:30.820135+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T01:11:30.820135+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.820135+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:48.119318+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":23420,"num_write":1255,"num_write_kb":19418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.819892+0000","last_change":"2024-09-12T01:12:01.819892+0000","last_active":"2024-09-12T01:12:01.819892+0000","last_peered":"2024-09-12T01:12:01.819892+0000","last_clean":"2024-09-12T01:12:01.819892+0000","last_became_active":"2024-09-12T00:30:15.124597+0000","last_became_peered":"2024-09-12T00:30:15.124597+0000","last_unstale":"2024-09-12T01:12:01.819892+0000","last_undegraded":"2024-09-12T01:12:01.819892+0000","last_fullsized":"2024-09-12T01:12:01.819892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.819785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.819785+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.819785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:51.290859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'266","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.322995+0000","last_change":"2024-09-12T01:11:48.322995+0000","last_active":"2024-09-12T01:11:48.322995+0000","last_peered":"2024-09-12T01:11:48.322995+0000","last_clean":"2024-09-12T01:11:48.322995+0000","last_became_active":"2024-09-12T00:30:17.145866+0000","last_became_peered":"2024-09-12T00:30:17.145866+0000","last_unstale":"2024-09-12T01:11:48.322995+0000","last_undegraded":"2024-09-12T01:11:48.322995+0000","last_fullsized":"2024-09-12T01:11:48.322995+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T01:11:48.322893+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T01:11:48.322893+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.322893+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:17.414187+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47562,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":1006,"num_write":354,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'803","reported_seq":2269,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.429714+0000","last_change":"2024-09-12T01:12:01.429714+0000","last_active":"2024-09-12T01:12:01.429714+0000","last_peered":"2024-09-12T01:12:01.429714+0000","last_clean":"2024-09-12T01:12:01.429714+0000","last_became_active":"2024-09-12T00:30:19.172403+0000","last_became_peered":"2024-09-12T00:30:19.172403+0000","last_unstale":"2024-09-12T01:12:01.429714+0000","last_undegraded":"2024-09-12T01:12:01.429714+0000","last_fullsized":"2024-09-12T01:12:01.429714+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-12T01:12:01.429628+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-12T01:12:01.429628+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.429628+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:59.201995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'133","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.840668+0000","last_change":"2024-09-12T01:11:46.840668+0000","last_active":"2024-09-12T01:11:46.840668+0000","last_peered":"2024-09-12T01:11:46.840668+0000","last_clean":"2024-09-12T01:11:46.840668+0000","last_became_active":"2024-09-12T00:30:13.120524+0000","last_became_peered":"2024-09-12T00:30:13.120524+0000","last_unstale":"2024-09-12T01:11:46.840668+0000","last_undegraded":"2024-09-12T01:11:46.840668+0000","last_fullsized":"2024-09-12T01:11:46.840668+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-09-12T01:11:46.840552+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-09-12T01:11:46.840552+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.840552+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:14.214542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":538,"num_write":190,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3594,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'385","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.397564+0000","last_change":"2024-09-12T01:11:31.397564+0000","last_active":"2024-09-12T01:11:31.397564+0000","last_peered":"2024-09-12T01:11:31.397564+0000","last_clean":"2024-09-12T01:11:31.397564+0000","last_became_active":"2024-09-12T00:30:11.105769+0000","last_became_peered":"2024-09-12T00:30:11.105769+0000","last_unstale":"2024-09-12T01:11:31.397564+0000","last_undegraded":"2024-09-12T01:11:31.397564+0000","last_fullsized":"2024-09-12T01:11:31.397564+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T01:11:31.397440+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T01:11:31.397440+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.397440+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:46.946497+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8955677,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":22715,"num_write":1115,"num_write_kb":62157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.860393+0000","last_change":"2024-09-12T01:11:43.860393+0000","last_active":"2024-09-12T01:11:43.860393+0000","last_peered":"2024-09-12T01:11:43.860393+0000","last_clean":"2024-09-12T01:11:43.860393+0000","last_became_active":"2024-09-12T00:30:15.132719+0000","last_became_peered":"2024-09-12T00:30:15.132719+0000","last_unstale":"2024-09-12T01:11:43.860393+0000","last_undegraded":"2024-09-12T01:11:43.860393+0000","last_fullsized":"2024-09-12T01:11:43.860393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:43.860305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:43.860305+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.860305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:54.848289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'368","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.381765+0000","last_change":"2024-09-12T01:11:49.381765+0000","last_active":"2024-09-12T01:11:49.381765+0000","last_peered":"2024-09-12T01:11:49.381765+0000","last_clean":"2024-09-12T01:11:49.381765+0000","last_became_active":"2024-09-12T00:30:17.146465+0000","last_became_peered":"2024-09-12T00:30:17.146465+0000","last_unstale":"2024-09-12T01:11:49.381765+0000","last_undegraded":"2024-09-12T01:11:49.381765+0000","last_fullsized":"2024-09-12T01:11:49.381765+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-12T01:11:49.381635+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-12T01:11:49.381635+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.381635+0000","objects_scrubbed":10,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:35.562295+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45471,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":600,"num_read_kb":1250,"num_write":474,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.207983+0000","last_change":"2024-09-12T01:11:55.207983+0000","last_active":"2024-09-12T01:11:55.207983+0000","last_peered":"2024-09-12T01:11:55.207983+0000","last_clean":"2024-09-12T01:11:55.207983+0000","last_became_active":"2024-09-12T00:30:19.164249+0000","last_became_peered":"2024-09-12T00:30:19.164249+0000","last_unstale":"2024-09-12T01:11:55.207983+0000","last_undegraded":"2024-09-12T01:11:55.207983+0000","last_fullsized":"2024-09-12T01:11:55.207983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:55.207885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:55.207885+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.207885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:20.018136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'548","reported_seq":1365,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.374746+0000","last_change":"2024-09-12T01:11:55.374641+0000","last_active":"2024-09-12T01:11:55.374746+0000","last_peered":"2024-09-12T01:11:55.374746+0000","last_clean":"2024-09-12T01:11:55.374746+0000","last_became_active":"2024-09-12T00:30:21.189156+0000","last_became_peered":"2024-09-12T00:30:21.189156+0000","last_unstale":"2024-09-12T01:11:55.374746+0000","last_undegraded":"2024-09-12T01:11:55.374746+0000","last_fullsized":"2024-09-12T01:11:55.374746+0000","mapping_epoch":36,"log_start":"264'500","ondisk_log_start":"264'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'548","last_scrub_stamp":"2024-09-12T01:11:55.374537+0000","last_deep_scrub":"264'548","last_deep_scrub_stamp":"2024-09-12T01:11:55.374537+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.374537+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:47.353067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1309,"num_read_kb":1298,"num_write":1161,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'143","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.841516+0000","last_change":"2024-09-12T01:11:34.841516+0000","last_active":"2024-09-12T01:11:34.841516+0000","last_peered":"2024-09-12T01:11:34.841516+0000","last_clean":"2024-09-12T01:11:34.841516+0000","last_became_active":"2024-09-12T00:30:13.124006+0000","last_became_peered":"2024-09-12T00:30:13.124006+0000","last_unstale":"2024-09-12T01:11:34.841516+0000","last_undegraded":"2024-09-12T01:11:34.841516+0000","last_fullsized":"2024-09-12T01:11:34.841516+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-09-12T01:11:34.841433+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-09-12T01:11:34.841433+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.841433+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:22.429642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":534,"num_write":203,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'416","reported_seq":1230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.346226+0000","last_change":"2024-09-12T01:11:30.346226+0000","last_active":"2024-09-12T01:11:30.346226+0000","last_peered":"2024-09-12T01:11:30.346226+0000","last_clean":"2024-09-12T01:11:30.346226+0000","last_became_active":"2024-09-12T00:30:11.104314+0000","last_became_peered":"2024-09-12T00:30:11.104314+0000","last_unstale":"2024-09-12T01:11:30.346226+0000","last_undegraded":"2024-09-12T01:11:30.346226+0000","last_fullsized":"2024-09-12T01:11:30.346226+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.346090+0000","objects_scrubbed":12,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:23.118149+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496547,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":809,"num_read_kb":45639,"num_write":1542,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.086776+0000","last_change":"2024-09-12T01:11:45.086776+0000","last_active":"2024-09-12T01:11:45.086776+0000","last_peered":"2024-09-12T01:11:45.086776+0000","last_clean":"2024-09-12T01:11:45.086776+0000","last_became_active":"2024-09-12T00:30:15.125380+0000","last_became_peered":"2024-09-12T00:30:15.125380+0000","last_unstale":"2024-09-12T01:11:45.086776+0000","last_undegraded":"2024-09-12T01:11:45.086776+0000","last_fullsized":"2024-09-12T01:11:45.086776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.086679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.086679+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.086679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.313099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'258","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.321356+0000","last_change":"2024-09-12T01:11:57.321356+0000","last_active":"2024-09-12T01:11:57.321356+0000","last_peered":"2024-09-12T01:11:57.321356+0000","last_clean":"2024-09-12T01:11:57.321356+0000","last_became_active":"2024-09-12T00:30:17.145155+0000","last_became_peered":"2024-09-12T00:30:17.145155+0000","last_unstale":"2024-09-12T01:11:57.321356+0000","last_undegraded":"2024-09-12T01:11:57.321356+0000","last_fullsized":"2024-09-12T01:11:57.321356+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'258","last_scrub_stamp":"2024-09-12T01:11:57.321246+0000","last_deep_scrub":"264'258","last_deep_scrub_stamp":"2024-09-12T01:11:57.321246+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.321246+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:25.723354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53484,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":958,"num_write":338,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.374218+0000","last_change":"2024-09-12T01:12:04.374218+0000","last_active":"2024-09-12T01:12:04.374218+0000","last_peered":"2024-09-12T01:12:04.374218+0000","last_clean":"2024-09-12T01:12:04.374218+0000","last_became_active":"2024-09-12T00:30:19.171189+0000","last_became_peered":"2024-09-12T00:30:19.171189+0000","last_unstale":"2024-09-12T01:12:04.374218+0000","last_undegraded":"2024-09-12T01:12:04.374218+0000","last_fullsized":"2024-09-12T01:12:04.374218+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:04.374135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:04.374135+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.374135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:31.656837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2418","reported_seq":4290,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.824210+0000","last_change":"2024-09-12T01:11:56.824210+0000","last_active":"2024-09-12T01:11:56.824210+0000","last_peered":"2024-09-12T01:11:56.824210+0000","last_clean":"2024-09-12T01:11:56.824210+0000","last_became_active":"2024-09-12T00:30:21.183561+0000","last_became_peered":"2024-09-12T00:30:21.183561+0000","last_unstale":"2024-09-12T01:11:56.824210+0000","last_undegraded":"2024-09-12T01:11:56.824210+0000","last_fullsized":"2024-09-12T01:11:56.824210+0000","mapping_epoch":36,"log_start":"264'2400","ondisk_log_start":"264'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2418","last_scrub_stamp":"2024-09-12T01:11:56.824111+0000","last_deep_scrub":"264'2418","last_deep_scrub_stamp":"2024-09-12T01:11:56.824111+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.824111+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":2400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.381858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6196,"num_read_kb":6147,"num_write":4885,"num_write_kb":1795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'180","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.419931+0000","last_change":"2024-09-12T01:11:37.419931+0000","last_active":"2024-09-12T01:11:37.419931+0000","last_peered":"2024-09-12T01:11:37.419931+0000","last_clean":"2024-09-12T01:11:37.419931+0000","last_became_active":"2024-09-12T00:30:13.122098+0000","last_became_peered":"2024-09-12T00:30:13.122098+0000","last_unstale":"2024-09-12T01:11:37.419931+0000","last_undegraded":"2024-09-12T01:11:37.419931+0000","last_fullsized":"2024-09-12T01:11:37.419931+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T01:11:37.419846+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T01:11:37.419846+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.419846+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:33.172289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":634,"num_write":261,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'304","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.852338+0000","last_change":"2024-09-12T01:11:35.852338+0000","last_active":"2024-09-12T01:11:35.852338+0000","last_peered":"2024-09-12T01:11:35.852338+0000","last_clean":"2024-09-12T01:11:35.852338+0000","last_became_active":"2024-09-12T00:30:11.112302+0000","last_became_peered":"2024-09-12T00:30:11.112302+0000","last_unstale":"2024-09-12T01:11:35.852338+0000","last_undegraded":"2024-09-12T01:11:35.852338+0000","last_fullsized":"2024-09-12T01:11:35.852338+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-12T01:11:35.852227+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-12T01:11:35.852227+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.852227+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:03.092960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":10144,"num_write":972,"num_write_kb":18823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.407080+0000","last_change":"2024-09-12T01:11:55.407080+0000","last_active":"2024-09-12T01:11:55.407080+0000","last_peered":"2024-09-12T01:11:55.407080+0000","last_clean":"2024-09-12T01:11:55.407080+0000","last_became_active":"2024-09-12T00:30:15.129311+0000","last_became_peered":"2024-09-12T00:30:15.129311+0000","last_unstale":"2024-09-12T01:11:55.407080+0000","last_undegraded":"2024-09-12T01:11:55.407080+0000","last_fullsized":"2024-09-12T01:11:55.407080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:55.407003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:55.407003+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.407003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:30.044743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'314","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.940525+0000","last_change":"2024-09-12T01:12:04.940525+0000","last_active":"2024-09-12T01:12:04.940525+0000","last_peered":"2024-09-12T01:12:04.940525+0000","last_clean":"2024-09-12T01:12:04.940525+0000","last_became_active":"2024-09-12T00:30:17.147148+0000","last_became_peered":"2024-09-12T00:30:17.147148+0000","last_unstale":"2024-09-12T01:12:04.940525+0000","last_undegraded":"2024-09-12T01:12:04.940525+0000","last_fullsized":"2024-09-12T01:12:04.940525+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T01:12:04.940404+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T01:12:04.940404+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.940404+0000","objects_scrubbed":9,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:38.290878+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47594,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":517,"num_read_kb":1147,"num_write":414,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2339,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.420965+0000","last_change":"2024-09-12T01:12:00.420965+0000","last_active":"2024-09-12T01:12:00.420965+0000","last_peered":"2024-09-12T01:12:00.420965+0000","last_clean":"2024-09-12T01:12:00.420965+0000","last_became_active":"2024-09-12T00:30:19.168419+0000","last_became_peered":"2024-09-12T00:30:19.168419+0000","last_unstale":"2024-09-12T01:12:00.420965+0000","last_undegraded":"2024-09-12T01:12:00.420965+0000","last_fullsized":"2024-09-12T01:12:00.420965+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-12T01:12:00.420887+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-12T01:12:00.420887+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.420887+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:46.132374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'163","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.227428+0000","last_change":"2024-09-12T01:11:58.227428+0000","last_active":"2024-09-12T01:11:58.227428+0000","last_peered":"2024-09-12T01:11:58.227428+0000","last_clean":"2024-09-12T01:11:58.227428+0000","last_became_active":"2024-09-12T00:30:21.179533+0000","last_became_peered":"2024-09-12T00:30:21.179533+0000","last_unstale":"2024-09-12T01:11:58.227428+0000","last_undegraded":"2024-09-12T01:11:58.227428+0000","last_fullsized":"2024-09-12T01:11:58.227428+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T01:11:58.227343+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T01:11:58.227343+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.227343+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:34.643155+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":87,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'98","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.293986+0000","last_change":"2024-09-12T01:11:46.293986+0000","last_active":"2024-09-12T01:11:46.293986+0000","last_peered":"2024-09-12T01:11:46.293986+0000","last_clean":"2024-09-12T01:11:46.293986+0000","last_became_active":"2024-09-12T00:30:13.131423+0000","last_became_peered":"2024-09-12T00:30:13.131423+0000","last_unstale":"2024-09-12T01:11:46.293986+0000","last_undegraded":"2024-09-12T01:11:46.293986+0000","last_fullsized":"2024-09-12T01:11:46.293986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'98","last_scrub_stamp":"2024-09-12T01:11:46.293901+0000","last_deep_scrub":"264'98","last_deep_scrub_stamp":"2024-09-12T01:11:46.293901+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.293901+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:41.760950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":366,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'380","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.402539+0000","last_change":"2024-09-12T01:11:33.402539+0000","last_active":"2024-09-12T01:11:33.402539+0000","last_peered":"2024-09-12T01:11:33.402539+0000","last_clean":"2024-09-12T01:11:33.402539+0000","last_became_active":"2024-09-12T00:30:11.103285+0000","last_became_peered":"2024-09-12T00:30:11.103285+0000","last_unstale":"2024-09-12T01:11:33.402539+0000","last_undegraded":"2024-09-12T01:11:33.402539+0000","last_fullsized":"2024-09-12T01:11:33.402539+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-12T01:11:33.402382+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-12T01:11:33.402382+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.402382+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:57.850138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":3264,"num_write":1093,"num_write_kb":35970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.102852+0000","last_change":"2024-09-12T01:11:46.102852+0000","last_active":"2024-09-12T01:11:46.102852+0000","last_peered":"2024-09-12T01:11:46.102852+0000","last_clean":"2024-09-12T01:11:46.102852+0000","last_became_active":"2024-09-12T00:30:15.132695+0000","last_became_peered":"2024-09-12T00:30:15.132695+0000","last_unstale":"2024-09-12T01:11:46.102852+0000","last_undegraded":"2024-09-12T01:11:46.102852+0000","last_fullsized":"2024-09-12T01:11:46.102852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.102769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.102769+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.102769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:16.249060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'464","reported_seq":1105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.334024+0000","last_change":"2024-09-12T01:11:55.334024+0000","last_active":"2024-09-12T01:11:55.334024+0000","last_peered":"2024-09-12T01:11:55.334024+0000","last_clean":"2024-09-12T01:11:55.334024+0000","last_became_active":"2024-09-12T00:30:17.147015+0000","last_became_peered":"2024-09-12T00:30:17.147015+0000","last_unstale":"2024-09-12T01:11:55.334024+0000","last_undegraded":"2024-09-12T01:11:55.334024+0000","last_fullsized":"2024-09-12T01:11:55.334024+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'464","last_scrub_stamp":"2024-09-12T01:11:55.333937+0000","last_deep_scrub":"264'464","last_deep_scrub_stamp":"2024-09-12T01:11:55.333937+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.333937+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:17.007555+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69788,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":1853,"num_write":630,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.438295+0000","last_change":"2024-09-12T01:11:59.438295+0000","last_active":"2024-09-12T01:11:59.438295+0000","last_peered":"2024-09-12T01:11:59.438295+0000","last_clean":"2024-09-12T01:11:59.438295+0000","last_became_active":"2024-09-12T00:30:19.167503+0000","last_became_peered":"2024-09-12T00:30:19.167503+0000","last_unstale":"2024-09-12T01:11:59.438295+0000","last_undegraded":"2024-09-12T01:11:59.438295+0000","last_fullsized":"2024-09-12T01:11:59.438295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:59.438199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:59.438199+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.438199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:02.777851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'97","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.685630+0000","last_change":"2024-09-12T01:11:55.685630+0000","last_active":"2024-09-12T01:11:55.685630+0000","last_peered":"2024-09-12T01:11:55.685630+0000","last_clean":"2024-09-12T01:11:55.685630+0000","last_became_active":"2024-09-12T00:30:21.192700+0000","last_became_peered":"2024-09-12T00:30:21.192700+0000","last_unstale":"2024-09-12T01:11:55.685630+0000","last_undegraded":"2024-09-12T01:11:55.685630+0000","last_fullsized":"2024-09-12T01:11:55.685630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-12T01:11:55.685541+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-12T01:11:55.685541+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.685541+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:52.590816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":205,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'119","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.435937+0000","last_change":"2024-09-12T01:11:38.435937+0000","last_active":"2024-09-12T01:11:38.435937+0000","last_peered":"2024-09-12T01:11:38.435937+0000","last_clean":"2024-09-12T01:11:38.435937+0000","last_became_active":"2024-09-12T00:30:13.128253+0000","last_became_peered":"2024-09-12T00:30:13.128253+0000","last_unstale":"2024-09-12T01:11:38.435937+0000","last_undegraded":"2024-09-12T01:11:38.435937+0000","last_fullsized":"2024-09-12T01:11:38.435937+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T01:11:38.435862+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T01:11:38.435862+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.435862+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.099253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":431,"num_write":189,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'311","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.492446+0000","last_change":"2024-09-12T01:11:33.492446+0000","last_active":"2024-09-12T01:11:33.492446+0000","last_peered":"2024-09-12T01:11:33.492446+0000","last_clean":"2024-09-12T01:11:33.492446+0000","last_became_active":"2024-09-12T00:30:11.100056+0000","last_became_peered":"2024-09-12T00:30:11.100056+0000","last_unstale":"2024-09-12T01:11:33.492446+0000","last_undegraded":"2024-09-12T01:11:33.492446+0000","last_fullsized":"2024-09-12T01:11:33.492446+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T01:11:33.492354+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T01:11:33.492354+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.492354+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:25.053401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":62849,"num_write":1084,"num_write_kb":31335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.557200+0000","last_change":"2024-09-12T01:11:47.557200+0000","last_active":"2024-09-12T01:11:47.557200+0000","last_peered":"2024-09-12T01:11:47.557200+0000","last_clean":"2024-09-12T01:11:47.557200+0000","last_became_active":"2024-09-12T00:30:15.132801+0000","last_became_peered":"2024-09-12T00:30:15.132801+0000","last_unstale":"2024-09-12T01:11:47.557200+0000","last_undegraded":"2024-09-12T01:11:47.557200+0000","last_fullsized":"2024-09-12T01:11:47.557200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.557077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.557077+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.557077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:33.239839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'299","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.864074+0000","last_change":"2024-09-12T01:11:48.864074+0000","last_active":"2024-09-12T01:11:48.864074+0000","last_peered":"2024-09-12T01:11:48.864074+0000","last_clean":"2024-09-12T01:11:48.864074+0000","last_became_active":"2024-09-12T00:30:17.149603+0000","last_became_peered":"2024-09-12T00:30:17.149603+0000","last_unstale":"2024-09-12T01:11:48.864074+0000","last_undegraded":"2024-09-12T01:11:48.864074+0000","last_fullsized":"2024-09-12T01:11:48.864074+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T01:11:48.863986+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T01:11:48.863986+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.863986+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:22.417240+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57292,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":510,"num_read_kb":1117,"num_write":456,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.581178+0000","last_change":"2024-09-12T01:11:50.581178+0000","last_active":"2024-09-12T01:11:50.581178+0000","last_peered":"2024-09-12T01:11:50.581178+0000","last_clean":"2024-09-12T01:11:50.581178+0000","last_became_active":"2024-09-12T00:30:19.168223+0000","last_became_peered":"2024-09-12T00:30:19.168223+0000","last_unstale":"2024-09-12T01:11:50.581178+0000","last_undegraded":"2024-09-12T01:11:50.581178+0000","last_fullsized":"2024-09-12T01:11:50.581178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.581086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.581086+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.581086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:20.933529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'127","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.452004+0000","last_change":"2024-09-12T01:12:04.452004+0000","last_active":"2024-09-12T01:12:04.452004+0000","last_peered":"2024-09-12T01:12:04.452004+0000","last_clean":"2024-09-12T01:12:04.452004+0000","last_became_active":"2024-09-12T00:30:21.192509+0000","last_became_peered":"2024-09-12T00:30:21.192509+0000","last_unstale":"2024-09-12T01:12:04.452004+0000","last_undegraded":"2024-09-12T01:12:04.452004+0000","last_fullsized":"2024-09-12T01:12:04.452004+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-12T01:12:04.451918+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-12T01:12:04.451918+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.451918+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:01.817710+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'134","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.852081+0000","last_change":"2024-09-12T01:11:50.852081+0000","last_active":"2024-09-12T01:11:50.852081+0000","last_peered":"2024-09-12T01:11:50.852081+0000","last_clean":"2024-09-12T01:11:50.852081+0000","last_became_active":"2024-09-12T00:30:13.123412+0000","last_became_peered":"2024-09-12T00:30:13.123412+0000","last_unstale":"2024-09-12T01:11:50.852081+0000","last_undegraded":"2024-09-12T01:11:50.852081+0000","last_fullsized":"2024-09-12T01:11:50.852081+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-12T01:11:50.851995+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-12T01:11:50.851995+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.851995+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:08.959022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":514,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'283","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.891985+0000","last_change":"2024-09-12T01:11:37.891985+0000","last_active":"2024-09-12T01:11:37.891985+0000","last_peered":"2024-09-12T01:11:37.891985+0000","last_clean":"2024-09-12T01:11:37.891985+0000","last_became_active":"2024-09-12T00:30:11.097902+0000","last_became_peered":"2024-09-12T00:30:11.097902+0000","last_unstale":"2024-09-12T01:11:37.891985+0000","last_undegraded":"2024-09-12T01:11:37.891985+0000","last_fullsized":"2024-09-12T01:11:37.891985+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T01:11:37.891780+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T01:11:37.891780+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.891780+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:26.776654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170421,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":17154,"num_write":985,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.417233+0000","last_change":"2024-09-12T01:11:54.417233+0000","last_active":"2024-09-12T01:11:54.417233+0000","last_peered":"2024-09-12T01:11:54.417233+0000","last_clean":"2024-09-12T01:11:54.417233+0000","last_became_active":"2024-09-12T00:30:15.125629+0000","last_became_peered":"2024-09-12T00:30:15.125629+0000","last_unstale":"2024-09-12T01:11:54.417233+0000","last_undegraded":"2024-09-12T01:11:54.417233+0000","last_fullsized":"2024-09-12T01:11:54.417233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.417146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.417146+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.417146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:07.825711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'290","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.462086+0000","last_change":"2024-09-12T01:11:58.462086+0000","last_active":"2024-09-12T01:11:58.462086+0000","last_peered":"2024-09-12T01:11:58.462086+0000","last_clean":"2024-09-12T01:11:58.462086+0000","last_became_active":"2024-09-12T00:30:17.149661+0000","last_became_peered":"2024-09-12T00:30:17.149661+0000","last_unstale":"2024-09-12T01:11:58.462086+0000","last_undegraded":"2024-09-12T01:11:58.462086+0000","last_fullsized":"2024-09-12T01:11:58.462086+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'290","last_scrub_stamp":"2024-09-12T01:11:58.461988+0000","last_deep_scrub":"264'290","last_deep_scrub_stamp":"2024-09-12T01:11:58.461988+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.461988+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:56.514745+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59535,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":1016,"num_write":372,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'762","reported_seq":2265,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.569125+0000","last_change":"2024-09-12T01:11:49.569125+0000","last_active":"2024-09-12T01:11:49.569125+0000","last_peered":"2024-09-12T01:11:49.569125+0000","last_clean":"2024-09-12T01:11:49.569125+0000","last_became_active":"2024-09-12T00:30:19.167476+0000","last_became_peered":"2024-09-12T00:30:19.167476+0000","last_unstale":"2024-09-12T01:11:49.569125+0000","last_undegraded":"2024-09-12T01:11:49.569125+0000","last_fullsized":"2024-09-12T01:11:49.569125+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'762","last_scrub_stamp":"2024-09-12T01:11:49.569037+0000","last_deep_scrub":"264'762","last_deep_scrub_stamp":"2024-09-12T01:11:49.569037+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.569037+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:56.774664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'163","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.191869+0000","last_change":"2024-09-12T01:11:57.191808+0000","last_active":"2024-09-12T01:11:57.191869+0000","last_peered":"2024-09-12T01:11:57.191869+0000","last_clean":"2024-09-12T01:11:57.191869+0000","last_became_active":"2024-09-12T00:30:21.185553+0000","last_became_peered":"2024-09-12T00:30:21.185553+0000","last_unstale":"2024-09-12T01:11:57.191869+0000","last_undegraded":"2024-09-12T01:11:57.191869+0000","last_fullsized":"2024-09-12T01:11:57.191869+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T01:11:57.191712+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T01:11:57.191712+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.191712+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:35.496120+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":222,"num_write":391,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'167","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.347977+0000","last_change":"2024-09-12T01:11:40.347977+0000","last_active":"2024-09-12T01:11:40.347977+0000","last_peered":"2024-09-12T01:11:40.347977+0000","last_clean":"2024-09-12T01:11:40.347977+0000","last_became_active":"2024-09-12T00:30:13.121664+0000","last_became_peered":"2024-09-12T00:30:13.121664+0000","last_unstale":"2024-09-12T01:11:40.347977+0000","last_undegraded":"2024-09-12T01:11:40.347977+0000","last_fullsized":"2024-09-12T01:11:40.347977+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-09-12T01:11:40.347879+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-09-12T01:11:40.347879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.347879+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:35.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":568,"num_write":259,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'538","reported_seq":1360,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.895438+0000","last_change":"2024-09-12T01:11:34.895438+0000","last_active":"2024-09-12T01:11:34.895438+0000","last_peered":"2024-09-12T01:11:34.895438+0000","last_clean":"2024-09-12T01:11:34.895438+0000","last_became_active":"2024-09-12T00:30:11.110370+0000","last_became_peered":"2024-09-12T00:30:11.110370+0000","last_unstale":"2024-09-12T01:11:34.895438+0000","last_undegraded":"2024-09-12T01:11:34.895438+0000","last_fullsized":"2024-09-12T01:11:34.895438+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'538","last_scrub_stamp":"2024-09-12T01:11:34.895276+0000","last_deep_scrub":"264'538","last_deep_scrub_stamp":"2024-09-12T01:11:34.895276+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.895276+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:45.682560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174759,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1243,"num_read_kb":75461,"num_write":1612,"num_write_kb":22075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1463,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.870320+0000","last_change":"2024-09-12T01:11:44.870320+0000","last_active":"2024-09-12T01:11:44.870320+0000","last_peered":"2024-09-12T01:11:44.870320+0000","last_clean":"2024-09-12T01:11:44.870320+0000","last_became_active":"2024-09-12T00:30:15.132802+0000","last_became_peered":"2024-09-12T00:30:15.132802+0000","last_unstale":"2024-09-12T01:11:44.870320+0000","last_undegraded":"2024-09-12T01:11:44.870320+0000","last_fullsized":"2024-09-12T01:11:44.870320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:11:44.870207+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:11:44.870207+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.870207+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:45.970093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'79","reported_seq":596,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.170222+0000","last_change":"2024-09-12T01:11:51.170222+0000","last_active":"2024-09-12T01:11:51.170222+0000","last_peered":"2024-09-12T01:11:51.170222+0000","last_clean":"2024-09-12T01:11:51.170222+0000","last_became_active":"2024-09-12T00:30:17.147864+0000","last_became_peered":"2024-09-12T00:30:17.147864+0000","last_unstale":"2024-09-12T01:11:51.170222+0000","last_undegraded":"2024-09-12T01:11:51.170222+0000","last_fullsized":"2024-09-12T01:11:51.170222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-09-12T01:11:51.170119+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-09-12T01:11:51.170119+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.170119+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:54.031616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'783","reported_seq":2342,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.760830+0000","last_change":"2024-09-12T01:11:51.760830+0000","last_active":"2024-09-12T01:11:51.760830+0000","last_peered":"2024-09-12T01:11:51.760830+0000","last_clean":"2024-09-12T01:11:51.760830+0000","last_became_active":"2024-09-12T00:30:19.168960+0000","last_became_peered":"2024-09-12T00:30:19.168960+0000","last_unstale":"2024-09-12T01:11:51.760830+0000","last_undegraded":"2024-09-12T01:11:51.760830+0000","last_fullsized":"2024-09-12T01:11:51.760830+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'783","last_scrub_stamp":"2024-09-12T01:11:51.760734+0000","last_deep_scrub":"264'783","last_deep_scrub_stamp":"2024-09-12T01:11:51.760734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.760734+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:25.225611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'119","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.324365+0000","last_change":"2024-09-12T01:11:54.324300+0000","last_active":"2024-09-12T01:11:54.324365+0000","last_peered":"2024-09-12T01:11:54.324365+0000","last_clean":"2024-09-12T01:11:54.324365+0000","last_became_active":"2024-09-12T00:30:21.185618+0000","last_became_peered":"2024-09-12T00:30:21.185618+0000","last_unstale":"2024-09-12T01:11:54.324365+0000","last_undegraded":"2024-09-12T01:11:54.324365+0000","last_fullsized":"2024-09-12T01:11:54.324365+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T01:11:54.324212+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T01:11:54.324212+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.324212+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:45.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":151,"num_write":299,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":906,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.526779+0000","last_change":"2024-09-12T01:11:35.526779+0000","last_active":"2024-09-12T01:11:35.526779+0000","last_peered":"2024-09-12T01:11:35.526779+0000","last_clean":"2024-09-12T01:11:35.526779+0000","last_became_active":"2024-09-12T00:30:13.129892+0000","last_became_peered":"2024-09-12T00:30:13.129892+0000","last_unstale":"2024-09-12T01:11:35.526779+0000","last_undegraded":"2024-09-12T01:11:35.526779+0000","last_fullsized":"2024-09-12T01:11:35.526779+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T01:11:35.526685+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T01:11:35.526685+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.526685+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:59.274285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":984,"num_read_kb":836,"num_write":303,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'321","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.382246+0000","last_change":"2024-09-12T01:11:34.382246+0000","last_active":"2024-09-12T01:11:34.382246+0000","last_peered":"2024-09-12T01:11:34.382246+0000","last_clean":"2024-09-12T01:11:34.382246+0000","last_became_active":"2024-09-12T00:30:11.103195+0000","last_became_peered":"2024-09-12T00:30:11.103195+0000","last_unstale":"2024-09-12T01:11:34.382246+0000","last_undegraded":"2024-09-12T01:11:34.382246+0000","last_fullsized":"2024-09-12T01:11:34.382246+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T01:11:34.382128+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T01:11:34.382128+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.382128+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:39.745506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254394,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":8246,"num_write":945,"num_write_kb":41947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.905296+0000","last_change":"2024-09-12T01:11:56.905296+0000","last_active":"2024-09-12T01:11:56.905296+0000","last_peered":"2024-09-12T01:11:56.905296+0000","last_clean":"2024-09-12T01:11:56.905296+0000","last_became_active":"2024-09-12T00:30:15.127047+0000","last_became_peered":"2024-09-12T00:30:15.127047+0000","last_unstale":"2024-09-12T01:11:56.905296+0000","last_undegraded":"2024-09-12T01:11:56.905296+0000","last_fullsized":"2024-09-12T01:11:56.905296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:56.905201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:56.905201+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.905201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.672497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'316","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.848686+0000","last_change":"2024-09-12T01:11:46.848686+0000","last_active":"2024-09-12T01:11:46.848686+0000","last_peered":"2024-09-12T01:11:46.848686+0000","last_clean":"2024-09-12T01:11:46.848686+0000","last_became_active":"2024-09-12T00:30:17.149579+0000","last_became_peered":"2024-09-12T00:30:17.149579+0000","last_unstale":"2024-09-12T01:11:46.848686+0000","last_undegraded":"2024-09-12T01:11:46.848686+0000","last_fullsized":"2024-09-12T01:11:46.848686+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T01:11:46.848586+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T01:11:46.848586+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.848586+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:28.252461+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":993,"num_write":388,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.363086+0000","last_change":"2024-09-12T01:11:51.363086+0000","last_active":"2024-09-12T01:11:51.363086+0000","last_peered":"2024-09-12T01:11:51.363086+0000","last_clean":"2024-09-12T01:11:51.363086+0000","last_became_active":"2024-09-12T00:30:19.169468+0000","last_became_peered":"2024-09-12T00:30:19.169468+0000","last_unstale":"2024-09-12T01:11:51.363086+0000","last_undegraded":"2024-09-12T01:11:51.363086+0000","last_fullsized":"2024-09-12T01:11:51.363086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.362984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.362984+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.362984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:04.867972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'113","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.640181+0000","last_change":"2024-09-12T01:11:54.640109+0000","last_active":"2024-09-12T01:11:54.640181+0000","last_peered":"2024-09-12T01:11:54.640181+0000","last_clean":"2024-09-12T01:11:54.640181+0000","last_became_active":"2024-09-12T00:30:21.184033+0000","last_became_peered":"2024-09-12T00:30:21.184033+0000","last_unstale":"2024-09-12T01:11:54.640181+0000","last_undegraded":"2024-09-12T01:11:54.640181+0000","last_fullsized":"2024-09-12T01:11:54.640181+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-12T01:11:54.640026+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-12T01:11:54.640026+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.640026+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:34.375790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":266,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'245","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.861331+0000","last_change":"2024-09-12T01:11:47.861264+0000","last_active":"2024-09-12T01:11:47.861331+0000","last_peered":"2024-09-12T01:11:47.861331+0000","last_clean":"2024-09-12T01:11:47.861331+0000","last_became_active":"2024-09-12T00:30:13.120962+0000","last_became_peered":"2024-09-12T00:30:13.120962+0000","last_unstale":"2024-09-12T01:11:47.861331+0000","last_undegraded":"2024-09-12T01:11:47.861331+0000","last_fullsized":"2024-09-12T01:11:47.861331+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T01:11:47.861179+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T01:11:47.861179+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.861179+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:22.003599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":839,"num_write":403,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.846255+0000","last_change":"2024-09-12T01:11:29.846210+0000","last_active":"2024-09-12T01:11:29.846255+0000","last_peered":"2024-09-12T01:11:29.846255+0000","last_clean":"2024-09-12T01:11:29.846255+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T01:11:29.846255+0000","last_undegraded":"2024-09-12T01:11:29.846255+0000","last_fullsized":"2024-09-12T01:11:29.846255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T01:11:29.846146+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T01:11:29.846146+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.846146+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:43.920303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.905025+0000","last_change":"2024-09-12T01:11:30.904927+0000","last_active":"2024-09-12T01:11:30.905025+0000","last_peered":"2024-09-12T01:11:30.905025+0000","last_clean":"2024-09-12T01:11:30.905025+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T01:11:30.905025+0000","last_undegraded":"2024-09-12T01:11:30.905025+0000","last_fullsized":"2024-09-12T01:11:30.905025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:30.904805+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:30.904805+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.904805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:38.997041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'317","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.380787+0000","last_change":"2024-09-12T01:11:32.380726+0000","last_active":"2024-09-12T01:11:32.380787+0000","last_peered":"2024-09-12T01:11:32.380787+0000","last_clean":"2024-09-12T01:11:32.380787+0000","last_became_active":"2024-09-12T00:30:11.102144+0000","last_became_peered":"2024-09-12T00:30:11.102144+0000","last_unstale":"2024-09-12T01:11:32.380787+0000","last_undegraded":"2024-09-12T01:11:32.380787+0000","last_fullsized":"2024-09-12T01:11:32.380787+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T01:11:32.380545+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T01:11:32.380545+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.380545+0000","objects_scrubbed":12,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:59.777398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505108,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":430,"num_read_kb":17991,"num_write":985,"num_write_kb":40410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"264'4","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.366291+0000","last_change":"2024-09-12T01:11:42.366234+0000","last_active":"2024-09-12T01:11:42.366291+0000","last_peered":"2024-09-12T01:11:42.366291+0000","last_clean":"2024-09-12T01:11:42.366291+0000","last_became_active":"2024-09-12T00:30:15.132332+0000","last_became_peered":"2024-09-12T00:30:15.132332+0000","last_unstale":"2024-09-12T01:11:42.366291+0000","last_undegraded":"2024-09-12T01:11:42.366291+0000","last_fullsized":"2024-09-12T01:11:42.366291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:11:42.366139+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:11:42.366139+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.366139+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:39.262944+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'719","reported_seq":1422,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.899520+0000","last_change":"2024-09-12T01:12:03.899520+0000","last_active":"2024-09-12T01:12:03.899520+0000","last_peered":"2024-09-12T01:12:03.899520+0000","last_clean":"2024-09-12T01:12:03.899520+0000","last_became_active":"2024-09-12T00:30:17.149842+0000","last_became_peered":"2024-09-12T00:30:17.149842+0000","last_unstale":"2024-09-12T01:12:03.899520+0000","last_undegraded":"2024-09-12T01:12:03.899520+0000","last_fullsized":"2024-09-12T01:12:03.899520+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'719","last_scrub_stamp":"2024-09-12T01:12:03.899420+0000","last_deep_scrub":"264'719","last_deep_scrub_stamp":"2024-09-12T01:12:03.899420+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.899420+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:24.007354+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1403,"num_read_kb":3182,"num_write":1320,"num_write_kb":1183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106952,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.424273+0000","last_change":"2024-09-12T01:12:03.424273+0000","last_active":"2024-09-12T01:12:03.424273+0000","last_peered":"2024-09-12T01:12:03.424273+0000","last_clean":"2024-09-12T01:12:03.424273+0000","last_became_active":"2024-09-12T00:30:19.168219+0000","last_became_peered":"2024-09-12T00:30:19.168219+0000","last_unstale":"2024-09-12T01:12:03.424273+0000","last_undegraded":"2024-09-12T01:12:03.424273+0000","last_fullsized":"2024-09-12T01:12:03.424273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.424188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.424188+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.424188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:54.976112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'217","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.356378+0000","last_change":"2024-09-12T01:11:54.356378+0000","last_active":"2024-09-12T01:11:54.356378+0000","last_peered":"2024-09-12T01:11:54.356378+0000","last_clean":"2024-09-12T01:11:54.356378+0000","last_became_active":"2024-09-12T00:30:21.191389+0000","last_became_peered":"2024-09-12T00:30:21.191389+0000","last_unstale":"2024-09-12T01:11:54.356378+0000","last_undegraded":"2024-09-12T01:11:54.356378+0000","last_fullsized":"2024-09-12T01:11:54.356378+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'217","last_scrub_stamp":"2024-09-12T01:11:54.356283+0000","last_deep_scrub":"264'217","last_deep_scrub_stamp":"2024-09-12T01:11:54.356283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.356283+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:00.464287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":544,"num_write":463,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'84","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.322102+0000","last_change":"2024-09-12T01:11:45.322102+0000","last_active":"2024-09-12T01:11:45.322102+0000","last_peered":"2024-09-12T01:11:45.322102+0000","last_clean":"2024-09-12T01:11:45.322102+0000","last_became_active":"2024-09-12T00:30:13.124407+0000","last_became_peered":"2024-09-12T00:30:13.124407+0000","last_unstale":"2024-09-12T01:11:45.322102+0000","last_undegraded":"2024-09-12T01:11:45.322102+0000","last_fullsized":"2024-09-12T01:11:45.322102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T01:11:45.322015+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T01:11:45.322015+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.322015+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:57.115441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":258,"num_write":150,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.850992+0000","last_change":"2024-09-12T01:11:36.850934+0000","last_active":"2024-09-12T01:11:36.850992+0000","last_peered":"2024-09-12T01:11:36.850992+0000","last_clean":"2024-09-12T01:11:36.850992+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T01:11:36.850992+0000","last_undegraded":"2024-09-12T01:11:36.850992+0000","last_fullsized":"2024-09-12T01:11:36.850992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.850849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.850849+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.850849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:50.093006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'385","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.093336+0000","last_change":"2024-09-12T01:11:32.093255+0000","last_active":"2024-09-12T01:11:32.093336+0000","last_peered":"2024-09-12T01:11:32.093336+0000","last_clean":"2024-09-12T01:11:32.093336+0000","last_became_active":"2024-09-12T00:30:11.099065+0000","last_became_peered":"2024-09-12T00:30:11.099065+0000","last_unstale":"2024-09-12T01:11:32.093336+0000","last_undegraded":"2024-09-12T01:11:32.093336+0000","last_fullsized":"2024-09-12T01:11:32.093336+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T01:11:32.093094+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T01:11:32.093094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.093094+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:51.292680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":8968,"num_write":1169,"num_write_kb":21800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.799649+0000","last_change":"2024-09-12T01:11:53.799649+0000","last_active":"2024-09-12T01:11:53.799649+0000","last_peered":"2024-09-12T01:11:53.799649+0000","last_clean":"2024-09-12T01:11:53.799649+0000","last_became_active":"2024-09-12T00:30:15.130490+0000","last_became_peered":"2024-09-12T00:30:15.130490+0000","last_unstale":"2024-09-12T01:11:53.799649+0000","last_undegraded":"2024-09-12T01:11:53.799649+0000","last_fullsized":"2024-09-12T01:11:53.799649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.799585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.799585+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.799585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:42.700401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'1365","reported_seq":2802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.529334+0000","last_change":"2024-09-12T01:11:46.529275+0000","last_active":"2024-09-12T01:11:46.529334+0000","last_peered":"2024-09-12T01:11:46.529334+0000","last_clean":"2024-09-12T01:11:46.529334+0000","last_became_active":"2024-09-12T00:30:17.146374+0000","last_became_peered":"2024-09-12T00:30:17.146374+0000","last_unstale":"2024-09-12T01:11:46.529334+0000","last_undegraded":"2024-09-12T01:11:46.529334+0000","last_fullsized":"2024-09-12T01:11:46.529334+0000","mapping_epoch":32,"log_start":"264'1300","ondisk_log_start":"264'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1365","last_scrub_stamp":"2024-09-12T01:11:46.529145+0000","last_deep_scrub":"264'1365","last_deep_scrub_stamp":"2024-09-12T01:11:46.529145+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.529145+0000","objects_scrubbed":12,"log_size":65,"log_dups_size":1300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:23.834431+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162102,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2173,"num_read_kb":4252,"num_write":1262,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:58.614100+0000","last_change":"2024-09-12T00:30:19.169975+0000","last_active":"2024-09-12T01:09:58.614100+0000","last_peered":"2024-09-12T01:09:58.614100+0000","last_clean":"2024-09-12T01:09:58.614100+0000","last_became_active":"2024-09-12T00:30:19.169700+0000","last_became_peered":"2024-09-12T00:30:19.169700+0000","last_unstale":"2024-09-12T01:09:58.614100+0000","last_undegraded":"2024-09-12T01:09:58.614100+0000","last_fullsized":"2024-09-12T01:09:58.614100+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'97","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.489162+0000","last_change":"2024-09-12T01:12:05.489162+0000","last_active":"2024-09-12T01:12:05.489162+0000","last_peered":"2024-09-12T01:12:05.489162+0000","last_clean":"2024-09-12T01:12:05.489162+0000","last_became_active":"2024-09-12T00:30:21.193491+0000","last_became_peered":"2024-09-12T00:30:21.193491+0000","last_unstale":"2024-09-12T01:12:05.489162+0000","last_undegraded":"2024-09-12T01:12:05.489162+0000","last_fullsized":"2024-09-12T01:12:05.489162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-12T01:12:05.489054+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-12T01:12:05.489054+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.489054+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.438964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":108,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'102","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.003162+0000","last_change":"2024-09-12T01:11:41.003162+0000","last_active":"2024-09-12T01:11:41.003162+0000","last_peered":"2024-09-12T01:11:41.003162+0000","last_clean":"2024-09-12T01:11:41.003162+0000","last_became_active":"2024-09-12T00:30:13.124085+0000","last_became_peered":"2024-09-12T00:30:13.124085+0000","last_unstale":"2024-09-12T01:11:41.003162+0000","last_undegraded":"2024-09-12T01:11:41.003162+0000","last_fullsized":"2024-09-12T01:11:41.003162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-12T01:11:41.003082+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-12T01:11:41.003082+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.003082+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:30.129863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":146,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.502852+0000","last_change":"2024-09-12T01:11:32.502795+0000","last_active":"2024-09-12T01:11:32.502852+0000","last_peered":"2024-09-12T01:11:32.502852+0000","last_clean":"2024-09-12T01:11:32.502852+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T01:11:32.502852+0000","last_undegraded":"2024-09-12T01:11:32.502852+0000","last_fullsized":"2024-09-12T01:11:32.502852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.502719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.502719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.502719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:31.918266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'337","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.312196+0000","last_change":"2024-09-12T01:11:34.312196+0000","last_active":"2024-09-12T01:11:34.312196+0000","last_peered":"2024-09-12T01:11:34.312196+0000","last_clean":"2024-09-12T01:11:34.312196+0000","last_became_active":"2024-09-12T00:30:46.766731+0000","last_became_peered":"2024-09-12T00:30:46.766731+0000","last_unstale":"2024-09-12T01:11:34.312196+0000","last_undegraded":"2024-09-12T01:11:34.312196+0000","last_fullsized":"2024-09-12T01:11:34.312196+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T01:11:34.311972+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T01:11:34.311972+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.311972+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:31.110464+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7776863,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":511,"num_read_kb":16356,"num_write":1167,"num_write_kb":34470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,4],"acting":[5,7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.573198+0000","last_change":"2024-09-12T01:11:45.573198+0000","last_active":"2024-09-12T01:11:45.573198+0000","last_peered":"2024-09-12T01:11:45.573198+0000","last_clean":"2024-09-12T01:11:45.573198+0000","last_became_active":"2024-09-12T00:30:15.132744+0000","last_became_peered":"2024-09-12T00:30:15.132744+0000","last_unstale":"2024-09-12T01:11:45.573198+0000","last_undegraded":"2024-09-12T01:11:45.573198+0000","last_fullsized":"2024-09-12T01:11:45.573198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:45.573109+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:45.573109+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.573109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:55.353583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'226","reported_seq":1271,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.460893+0000","last_change":"2024-09-12T01:11:46.460831+0000","last_active":"2024-09-12T01:11:46.460893+0000","last_peered":"2024-09-12T01:11:46.460893+0000","last_clean":"2024-09-12T01:11:46.460893+0000","last_became_active":"2024-09-12T00:30:17.145284+0000","last_became_peered":"2024-09-12T00:30:17.145284+0000","last_unstale":"2024-09-12T01:11:46.460893+0000","last_undegraded":"2024-09-12T01:11:46.460893+0000","last_fullsized":"2024-09-12T01:11:46.460893+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-09-12T01:11:46.460719+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-09-12T01:11:46.460719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.460719+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:56.553885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":145,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.351194+0000","last_change":"2024-09-12T01:12:02.351133+0000","last_active":"2024-09-12T01:12:02.351194+0000","last_peered":"2024-09-12T01:12:02.351194+0000","last_clean":"2024-09-12T01:12:02.351194+0000","last_became_active":"2024-09-12T00:30:19.169439+0000","last_became_peered":"2024-09-12T00:30:19.169439+0000","last_unstale":"2024-09-12T01:12:02.351194+0000","last_undegraded":"2024-09-12T01:12:02.351194+0000","last_fullsized":"2024-09-12T01:12:02.351194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:02.351050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:02.351050+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.351050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:26.348607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'344","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.409194+0000","last_change":"2024-09-12T01:12:06.409194+0000","last_active":"2024-09-12T01:12:06.409194+0000","last_peered":"2024-09-12T01:12:06.409194+0000","last_clean":"2024-09-12T01:12:06.409194+0000","last_became_active":"2024-09-12T00:30:21.187616+0000","last_became_peered":"2024-09-12T00:30:21.187616+0000","last_unstale":"2024-09-12T01:12:06.409194+0000","last_undegraded":"2024-09-12T01:12:06.409194+0000","last_fullsized":"2024-09-12T01:12:06.409194+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T01:12:06.409109+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T01:12:06.409109+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.409109+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:35.067425+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":676,"num_read_kb":665,"num_write":755,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'375","reported_seq":1092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.030374+0000","last_change":"2024-09-12T01:11:40.030234+0000","last_active":"2024-09-12T01:11:40.030374+0000","last_peered":"2024-09-12T01:11:40.030374+0000","last_clean":"2024-09-12T01:11:40.030374+0000","last_became_active":"2024-09-12T00:30:13.122751+0000","last_became_peered":"2024-09-12T00:30:13.122751+0000","last_unstale":"2024-09-12T01:11:40.030374+0000","last_undegraded":"2024-09-12T01:11:40.030374+0000","last_fullsized":"2024-09-12T01:11:40.030374+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:40.030125+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:40.030125+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.030125+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:16.425527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1941,"num_read_kb":1679,"num_write":648,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.926825+0000","last_change":"2024-09-12T01:11:32.926782+0000","last_active":"2024-09-12T01:11:32.926825+0000","last_peered":"2024-09-12T01:11:32.926825+0000","last_clean":"2024-09-12T01:11:32.926825+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T01:11:32.926825+0000","last_undegraded":"2024-09-12T01:11:32.926825+0000","last_fullsized":"2024-09-12T01:11:32.926825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:11:32.926707+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:11:32.926707+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.926707+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:26.696475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'399","reported_seq":1141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.438450+0000","last_change":"2024-09-12T01:11:32.438397+0000","last_active":"2024-09-12T01:11:32.438450+0000","last_peered":"2024-09-12T01:11:32.438450+0000","last_clean":"2024-09-12T01:11:32.438450+0000","last_became_active":"2024-09-12T00:30:11.100253+0000","last_became_peered":"2024-09-12T00:30:11.100253+0000","last_unstale":"2024-09-12T01:11:32.438450+0000","last_undegraded":"2024-09-12T01:11:32.438450+0000","last_fullsized":"2024-09-12T01:11:32.438450+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'399","last_scrub_stamp":"2024-09-12T01:11:32.438283+0000","last_deep_scrub":"264'399","last_deep_scrub_stamp":"2024-09-12T01:11:32.438283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.438283+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:47.427418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7586776,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":852,"num_read_kb":32409,"num_write":1258,"num_write_kb":44212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.603613+0000","last_change":"2024-09-12T01:11:44.603535+0000","last_active":"2024-09-12T01:11:44.603613+0000","last_peered":"2024-09-12T01:11:44.603613+0000","last_clean":"2024-09-12T01:11:44.603613+0000","last_became_active":"2024-09-12T00:30:15.127835+0000","last_became_peered":"2024-09-12T00:30:15.127835+0000","last_unstale":"2024-09-12T01:11:44.603613+0000","last_undegraded":"2024-09-12T01:11:44.603613+0000","last_fullsized":"2024-09-12T01:11:44.603613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.603445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.603445+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.603445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:54.508744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'130","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.460639+0000","last_change":"2024-09-12T01:11:56.460639+0000","last_active":"2024-09-12T01:11:56.460639+0000","last_peered":"2024-09-12T01:11:56.460639+0000","last_clean":"2024-09-12T01:11:56.460639+0000","last_became_active":"2024-09-12T00:30:17.148548+0000","last_became_peered":"2024-09-12T00:30:17.148548+0000","last_unstale":"2024-09-12T01:11:56.460639+0000","last_undegraded":"2024-09-12T01:11:56.460639+0000","last_fullsized":"2024-09-12T01:11:56.460639+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T01:11:56.460539+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T01:11:56.460539+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.460539+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:22.881152+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:18.608977+0000","last_change":"2024-09-12T00:30:19.165383+0000","last_active":"2024-09-12T01:09:18.608977+0000","last_peered":"2024-09-12T01:09:18.608977+0000","last_clean":"2024-09-12T01:09:18.608977+0000","last_became_active":"2024-09-12T00:30:19.165120+0000","last_became_peered":"2024-09-12T00:30:19.165120+0000","last_unstale":"2024-09-12T01:09:18.608977+0000","last_undegraded":"2024-09-12T01:09:18.608977+0000","last_fullsized":"2024-09-12T01:09:18.608977+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:24.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'134","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.773246+0000","last_change":"2024-09-12T01:11:57.773246+0000","last_active":"2024-09-12T01:11:57.773246+0000","last_peered":"2024-09-12T01:11:57.773246+0000","last_clean":"2024-09-12T01:11:57.773246+0000","last_became_active":"2024-09-12T00:30:21.180708+0000","last_became_peered":"2024-09-12T00:30:21.180708+0000","last_unstale":"2024-09-12T01:11:57.773246+0000","last_undegraded":"2024-09-12T01:11:57.773246+0000","last_fullsized":"2024-09-12T01:11:57.773246+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-12T01:11:57.773164+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-12T01:11:57.773164+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.773164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:52.985256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":239,"num_write":325,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'171","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.027208+0000","last_change":"2024-09-12T01:11:39.027134+0000","last_active":"2024-09-12T01:11:39.027208+0000","last_peered":"2024-09-12T01:11:39.027208+0000","last_clean":"2024-09-12T01:11:39.027208+0000","last_became_active":"2024-09-12T00:30:13.130610+0000","last_became_peered":"2024-09-12T00:30:13.130610+0000","last_unstale":"2024-09-12T01:11:39.027208+0000","last_undegraded":"2024-09-12T01:11:39.027208+0000","last_fullsized":"2024-09-12T01:11:39.027208+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T01:11:39.027047+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T01:11:39.027047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.027047+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:23.518560+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":757,"num_read_kb":608,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'326","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.394914+0000","last_change":"2024-09-12T01:11:31.394860+0000","last_active":"2024-09-12T01:11:31.394914+0000","last_peered":"2024-09-12T01:11:31.394914+0000","last_clean":"2024-09-12T01:11:31.394914+0000","last_became_active":"2024-09-12T00:30:11.104002+0000","last_became_peered":"2024-09-12T00:30:11.104002+0000","last_unstale":"2024-09-12T01:11:31.394914+0000","last_undegraded":"2024-09-12T01:11:31.394914+0000","last_fullsized":"2024-09-12T01:11:31.394914+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.394736+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:03.175443+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452439,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":13269,"num_write":941,"num_write_kb":33802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.213348+0000","last_change":"2024-09-12T01:11:32.213270+0000","last_active":"2024-09-12T01:11:32.213348+0000","last_peered":"2024-09-12T01:11:32.213348+0000","last_clean":"2024-09-12T01:11:32.213348+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T01:11:32.213348+0000","last_undegraded":"2024-09-12T01:11:32.213348+0000","last_fullsized":"2024-09-12T01:11:32.213348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.213181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.213181+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.213181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:55.736193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.282338+0000","last_change":"2024-09-12T01:11:50.282272+0000","last_active":"2024-09-12T01:11:50.282338+0000","last_peered":"2024-09-12T01:11:50.282338+0000","last_clean":"2024-09-12T01:11:50.282338+0000","last_became_active":"2024-09-12T00:30:15.127513+0000","last_became_peered":"2024-09-12T00:30:15.127513+0000","last_unstale":"2024-09-12T01:11:50.282338+0000","last_undegraded":"2024-09-12T01:11:50.282338+0000","last_fullsized":"2024-09-12T01:11:50.282338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.282187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.282187+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.282187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:50.522854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'574","reported_seq":1250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.625759+0000","last_change":"2024-09-12T01:11:43.625759+0000","last_active":"2024-09-12T01:11:43.625759+0000","last_peered":"2024-09-12T01:11:43.625759+0000","last_clean":"2024-09-12T01:11:43.625759+0000","last_became_active":"2024-09-12T00:30:17.146141+0000","last_became_peered":"2024-09-12T00:30:17.146141+0000","last_unstale":"2024-09-12T01:11:43.625759+0000","last_undegraded":"2024-09-12T01:11:43.625759+0000","last_fullsized":"2024-09-12T01:11:43.625759+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'574","last_scrub_stamp":"2024-09-12T01:11:43.625634+0000","last_deep_scrub":"264'574","last_deep_scrub_stamp":"2024-09-12T01:11:43.625634+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.625634+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:48.119734+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1559,"num_read_kb":2701,"num_write":2018,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":507816,"num_omap_keys":1152,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.331589+0000","last_change":"2024-09-12T01:11:50.331499+0000","last_active":"2024-09-12T01:11:50.331589+0000","last_peered":"2024-09-12T01:11:50.331589+0000","last_clean":"2024-09-12T01:11:50.331589+0000","last_became_active":"2024-09-12T00:30:19.167819+0000","last_became_peered":"2024-09-12T00:30:19.167819+0000","last_unstale":"2024-09-12T01:11:50.331589+0000","last_undegraded":"2024-09-12T01:11:50.331589+0000","last_fullsized":"2024-09-12T01:11:50.331589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.331408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.331408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.331408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:26.591133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'181","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.478435+0000","last_change":"2024-09-12T01:12:07.478435+0000","last_active":"2024-09-12T01:12:07.478435+0000","last_peered":"2024-09-12T01:12:07.478435+0000","last_clean":"2024-09-12T01:12:07.478435+0000","last_became_active":"2024-09-12T00:30:21.192893+0000","last_became_peered":"2024-09-12T00:30:21.192893+0000","last_unstale":"2024-09-12T01:12:07.478435+0000","last_undegraded":"2024-09-12T01:12:07.478435+0000","last_fullsized":"2024-09-12T01:12:07.478435+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-12T01:12:07.478345+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-12T01:12:07.478345+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.478345+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:40.582868+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":195,"num_read_kb":181,"num_write":424,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'295","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.072383+0000","last_change":"2024-09-12T01:11:43.072329+0000","last_active":"2024-09-12T01:11:43.072383+0000","last_peered":"2024-09-12T01:11:43.072383+0000","last_clean":"2024-09-12T01:11:43.072383+0000","last_became_active":"2024-09-12T00:30:13.125487+0000","last_became_peered":"2024-09-12T00:30:13.125487+0000","last_unstale":"2024-09-12T01:11:43.072383+0000","last_undegraded":"2024-09-12T01:11:43.072383+0000","last_fullsized":"2024-09-12T01:11:43.072383+0000","mapping_epoch":28,"log_start":"261'200","ondisk_log_start":"261'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'295","last_scrub_stamp":"2024-09-12T01:11:43.072246+0000","last_deep_scrub":"264'295","last_deep_scrub_stamp":"2024-09-12T01:11:43.072246+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.072246+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:38.938472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1016,"num_write":432,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'308","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.079678+0000","last_change":"2024-09-12T01:11:33.079611+0000","last_active":"2024-09-12T01:11:33.079678+0000","last_peered":"2024-09-12T01:11:33.079678+0000","last_clean":"2024-09-12T01:11:33.079678+0000","last_became_active":"2024-09-12T00:30:11.108257+0000","last_became_peered":"2024-09-12T00:30:11.108257+0000","last_unstale":"2024-09-12T01:11:33.079678+0000","last_undegraded":"2024-09-12T01:11:33.079678+0000","last_fullsized":"2024-09-12T01:11:33.079678+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-12T01:11:33.079481+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-12T01:11:33.079481+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.079481+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:37.289345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":29050,"num_write":952,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.924888+0000","last_change":"2024-09-12T01:11:31.924834+0000","last_active":"2024-09-12T01:11:31.924888+0000","last_peered":"2024-09-12T01:11:31.924888+0000","last_clean":"2024-09-12T01:11:31.924888+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T01:11:31.924888+0000","last_undegraded":"2024-09-12T01:11:31.924888+0000","last_fullsized":"2024-09-12T01:11:31.924888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.924761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.924761+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.924761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.589363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.448214+0000","last_change":"2024-09-12T01:11:47.448139+0000","last_active":"2024-09-12T01:11:47.448214+0000","last_peered":"2024-09-12T01:11:47.448214+0000","last_clean":"2024-09-12T01:11:47.448214+0000","last_became_active":"2024-09-12T00:30:15.124765+0000","last_became_peered":"2024-09-12T00:30:15.124765+0000","last_unstale":"2024-09-12T01:11:47.448214+0000","last_undegraded":"2024-09-12T01:11:47.448214+0000","last_fullsized":"2024-09-12T01:11:47.448214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.448047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.448047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.448047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:26.268517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'170","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.208398+0000","last_change":"2024-09-12T01:11:50.208331+0000","last_active":"2024-09-12T01:11:50.208398+0000","last_peered":"2024-09-12T01:11:50.208398+0000","last_clean":"2024-09-12T01:11:50.208398+0000","last_became_active":"2024-09-12T00:30:17.147297+0000","last_became_peered":"2024-09-12T00:30:17.147297+0000","last_unstale":"2024-09-12T01:11:50.208398+0000","last_undegraded":"2024-09-12T01:11:50.208398+0000","last_fullsized":"2024-09-12T01:11:50.208398+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T01:11:50.208237+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T01:11:50.208237+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.208237+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:31.146209+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":197,"num_write":138,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'783","reported_seq":4285,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.782247+0000","last_change":"2024-09-12T01:11:55.782247+0000","last_active":"2024-09-12T01:11:55.782247+0000","last_peered":"2024-09-12T01:11:55.782247+0000","last_clean":"2024-09-12T01:11:55.782247+0000","last_became_active":"2024-09-12T00:30:19.169689+0000","last_became_peered":"2024-09-12T00:30:19.169689+0000","last_unstale":"2024-09-12T01:11:55.782247+0000","last_undegraded":"2024-09-12T01:11:55.782247+0000","last_fullsized":"2024-09-12T01:11:55.782247+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'783","last_scrub_stamp":"2024-09-12T01:11:55.782161+0000","last_deep_scrub":"264'783","last_deep_scrub_stamp":"2024-09-12T01:11:55.782161+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.782161+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:52.245663+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'139","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.665326+0000","last_change":"2024-09-12T01:11:56.665326+0000","last_active":"2024-09-12T01:11:56.665326+0000","last_peered":"2024-09-12T01:11:56.665326+0000","last_clean":"2024-09-12T01:11:56.665326+0000","last_became_active":"2024-09-12T00:30:21.189546+0000","last_became_peered":"2024-09-12T00:30:21.189546+0000","last_unstale":"2024-09-12T01:11:56.665326+0000","last_undegraded":"2024-09-12T01:11:56.665326+0000","last_fullsized":"2024-09-12T01:11:56.665326+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'139","last_scrub_stamp":"2024-09-12T01:11:56.665223+0000","last_deep_scrub":"264'139","last_deep_scrub_stamp":"2024-09-12T01:11:56.665223+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.665223+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:06.441855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":147,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'196","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.285722+0000","last_change":"2024-09-12T01:11:37.285722+0000","last_active":"2024-09-12T01:11:37.285722+0000","last_peered":"2024-09-12T01:11:37.285722+0000","last_clean":"2024-09-12T01:11:37.285722+0000","last_became_active":"2024-09-12T00:30:13.118656+0000","last_became_peered":"2024-09-12T00:30:13.118656+0000","last_unstale":"2024-09-12T01:11:37.285722+0000","last_undegraded":"2024-09-12T01:11:37.285722+0000","last_fullsized":"2024-09-12T01:11:37.285722+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T01:11:37.285627+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T01:11:37.285627+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.285627+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:30.901502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":942,"num_read_kb":795,"num_write":340,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'370","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.361161+0000","last_change":"2024-09-12T01:11:35.361161+0000","last_active":"2024-09-12T01:11:35.361161+0000","last_peered":"2024-09-12T01:11:35.361161+0000","last_clean":"2024-09-12T01:11:35.361161+0000","last_became_active":"2024-09-12T00:30:11.090114+0000","last_became_peered":"2024-09-12T00:30:11.090114+0000","last_unstale":"2024-09-12T01:11:35.361161+0000","last_undegraded":"2024-09-12T01:11:35.361161+0000","last_fullsized":"2024-09-12T01:11:35.361161+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'370","last_scrub_stamp":"2024-09-12T01:11:35.360991+0000","last_deep_scrub":"264'370","last_deep_scrub_stamp":"2024-09-12T01:11:35.360991+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.360991+0000","objects_scrubbed":10,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.207634+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9433118,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":605,"num_read_kb":27258,"num_write":1271,"num_write_kb":43330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.405044+0000","last_change":"2024-09-12T01:11:31.405044+0000","last_active":"2024-09-12T01:11:31.405044+0000","last_peered":"2024-09-12T01:11:31.405044+0000","last_clean":"2024-09-12T01:11:31.405044+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T01:11:31.405044+0000","last_undegraded":"2024-09-12T01:11:31.405044+0000","last_fullsized":"2024-09-12T01:11:31.405044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.404954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.404954+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.404954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:13.972945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.873795+0000","last_change":"2024-09-12T01:11:57.873711+0000","last_active":"2024-09-12T01:11:57.873795+0000","last_peered":"2024-09-12T01:11:57.873795+0000","last_clean":"2024-09-12T01:11:57.873795+0000","last_became_active":"2024-09-12T00:30:15.126949+0000","last_became_peered":"2024-09-12T00:30:15.126949+0000","last_unstale":"2024-09-12T01:11:57.873795+0000","last_undegraded":"2024-09-12T01:11:57.873795+0000","last_fullsized":"2024-09-12T01:11:57.873795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:57.873617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:57.873617+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.873617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:08.766588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'113","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.856158+0000","last_change":"2024-09-12T01:12:02.856158+0000","last_active":"2024-09-12T01:12:02.856158+0000","last_peered":"2024-09-12T01:12:02.856158+0000","last_clean":"2024-09-12T01:12:02.856158+0000","last_became_active":"2024-09-12T00:30:17.149791+0000","last_became_peered":"2024-09-12T00:30:17.149791+0000","last_unstale":"2024-09-12T01:12:02.856158+0000","last_undegraded":"2024-09-12T01:12:02.856158+0000","last_fullsized":"2024-09-12T01:12:02.856158+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-12T01:12:02.855997+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-12T01:12:02.855997+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.855997+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:14.157955+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'803","reported_seq":4550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.506714+0000","last_change":"2024-09-12T01:11:57.506616+0000","last_active":"2024-09-12T01:11:57.506714+0000","last_peered":"2024-09-12T01:11:57.506714+0000","last_clean":"2024-09-12T01:11:57.506714+0000","last_became_active":"2024-09-12T00:30:19.166687+0000","last_became_peered":"2024-09-12T00:30:19.166687+0000","last_unstale":"2024-09-12T01:11:57.506714+0000","last_undegraded":"2024-09-12T01:11:57.506714+0000","last_fullsized":"2024-09-12T01:11:57.506714+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-12T01:11:57.506505+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-12T01:11:57.506505+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.506505+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:55.538085+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'273","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.524299+0000","last_change":"2024-09-12T01:12:06.524299+0000","last_active":"2024-09-12T01:12:06.524299+0000","last_peered":"2024-09-12T01:12:06.524299+0000","last_clean":"2024-09-12T01:12:06.524299+0000","last_became_active":"2024-09-12T00:30:21.192189+0000","last_became_peered":"2024-09-12T00:30:21.192189+0000","last_unstale":"2024-09-12T01:12:06.524299+0000","last_undegraded":"2024-09-12T01:12:06.524299+0000","last_fullsized":"2024-09-12T01:12:06.524299+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-12T01:12:06.524198+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-12T01:12:06.524198+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.524198+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.096400+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":326,"num_read_kb":325,"num_write":560,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'395","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.432082+0000","last_change":"2024-09-12T01:11:36.432024+0000","last_active":"2024-09-12T01:11:36.432082+0000","last_peered":"2024-09-12T01:11:36.432082+0000","last_clean":"2024-09-12T01:11:36.432082+0000","last_became_active":"2024-09-12T00:30:13.120906+0000","last_became_peered":"2024-09-12T00:30:13.120906+0000","last_unstale":"2024-09-12T01:11:36.432082+0000","last_undegraded":"2024-09-12T01:11:36.432082+0000","last_fullsized":"2024-09-12T01:11:36.432082+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-12T01:11:36.431932+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-12T01:11:36.431932+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.431932+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:46.567143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1876,"num_read_kb":1541,"num_write":715,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'329","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.404850+0000","last_change":"2024-09-12T01:11:33.404850+0000","last_active":"2024-09-12T01:11:33.404850+0000","last_peered":"2024-09-12T01:11:33.404850+0000","last_clean":"2024-09-12T01:11:33.404850+0000","last_became_active":"2024-09-12T00:30:11.101931+0000","last_became_peered":"2024-09-12T00:30:11.101931+0000","last_unstale":"2024-09-12T01:11:33.404850+0000","last_undegraded":"2024-09-12T01:11:33.404850+0000","last_fullsized":"2024-09-12T01:11:33.404850+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T01:11:33.404737+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T01:11:33.404737+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.404737+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:04.479639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359495,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":501,"num_read_kb":50204,"num_write":1062,"num_write_kb":37284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.877931+0000","last_change":"2024-09-12T01:11:33.877931+0000","last_active":"2024-09-12T01:11:33.877931+0000","last_peered":"2024-09-12T01:11:33.877931+0000","last_clean":"2024-09-12T01:11:33.877931+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T01:11:33.877931+0000","last_undegraded":"2024-09-12T01:11:33.877931+0000","last_fullsized":"2024-09-12T01:11:33.877931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.877841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.877841+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.877841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:36.694365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.323292+0000","last_change":"2024-09-12T01:11:48.323292+0000","last_active":"2024-09-12T01:11:48.323292+0000","last_peered":"2024-09-12T01:11:48.323292+0000","last_clean":"2024-09-12T01:11:48.323292+0000","last_became_active":"2024-09-12T00:30:15.126041+0000","last_became_peered":"2024-09-12T00:30:15.126041+0000","last_unstale":"2024-09-12T01:11:48.323292+0000","last_undegraded":"2024-09-12T01:11:48.323292+0000","last_fullsized":"2024-09-12T01:11:48.323292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.323209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.323209+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.323209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:59.170409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'771","reported_seq":1502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.419306+0000","last_change":"2024-09-12T01:11:43.419218+0000","last_active":"2024-09-12T01:11:43.419306+0000","last_peered":"2024-09-12T01:11:43.419306+0000","last_clean":"2024-09-12T01:11:43.419306+0000","last_became_active":"2024-09-12T00:30:17.148954+0000","last_became_peered":"2024-09-12T00:30:17.148954+0000","last_unstale":"2024-09-12T01:11:43.419306+0000","last_undegraded":"2024-09-12T01:11:43.419306+0000","last_fullsized":"2024-09-12T01:11:43.419306+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-12T01:11:43.419108+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-12T01:11:43.419108+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.419108+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:57.967218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141519,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1386,"num_read_kb":3323,"num_write":1142,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.386244+0000","last_change":"2024-09-12T01:12:00.386123+0000","last_active":"2024-09-12T01:12:00.386244+0000","last_peered":"2024-09-12T01:12:00.386244+0000","last_clean":"2024-09-12T01:12:00.386244+0000","last_became_active":"2024-09-12T00:30:19.168965+0000","last_became_peered":"2024-09-12T00:30:19.168965+0000","last_unstale":"2024-09-12T01:12:00.386244+0000","last_undegraded":"2024-09-12T01:12:00.386244+0000","last_fullsized":"2024-09-12T01:12:00.386244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:00.386023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:00.386023+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.386023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:29.239817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'136","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.413699+0000","last_change":"2024-09-12T01:11:56.413699+0000","last_active":"2024-09-12T01:11:56.413699+0000","last_peered":"2024-09-12T01:11:56.413699+0000","last_clean":"2024-09-12T01:11:56.413699+0000","last_became_active":"2024-09-12T00:30:21.186262+0000","last_became_peered":"2024-09-12T00:30:21.186262+0000","last_unstale":"2024-09-12T01:11:56.413699+0000","last_undegraded":"2024-09-12T01:11:56.413699+0000","last_fullsized":"2024-09-12T01:11:56.413699+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-12T01:11:56.413596+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-12T01:11:56.413596+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.413596+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:03.823692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":332,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'145","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.367269+0000","last_change":"2024-09-12T01:12:07.367269+0000","last_active":"2024-09-12T01:12:07.367269+0000","last_peered":"2024-09-12T01:12:07.367269+0000","last_clean":"2024-09-12T01:12:07.367269+0000","last_became_active":"2024-09-12T00:30:21.193010+0000","last_became_peered":"2024-09-12T00:30:21.193010+0000","last_unstale":"2024-09-12T01:12:07.367269+0000","last_undegraded":"2024-09-12T01:12:07.367269+0000","last_fullsized":"2024-09-12T01:12:07.367269+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T01:12:07.367145+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T01:12:07.367145+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.367145+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:25.231816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'64","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.347695+0000","last_change":"2024-09-12T01:11:39.347695+0000","last_active":"2024-09-12T01:11:39.347695+0000","last_peered":"2024-09-12T01:11:39.347695+0000","last_clean":"2024-09-12T01:11:39.347695+0000","last_became_active":"2024-09-12T00:30:13.121613+0000","last_became_peered":"2024-09-12T00:30:13.121613+0000","last_unstale":"2024-09-12T01:11:39.347695+0000","last_undegraded":"2024-09-12T01:11:39.347695+0000","last_fullsized":"2024-09-12T01:11:39.347695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-12T01:11:39.347611+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-12T01:11:39.347611+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.347611+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:04.410478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":107,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'377","reported_seq":1094,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.884100+0000","last_change":"2024-09-12T01:11:41.884100+0000","last_active":"2024-09-12T01:11:41.884100+0000","last_peered":"2024-09-12T01:11:41.884100+0000","last_clean":"2024-09-12T01:11:41.884100+0000","last_became_active":"2024-09-12T00:30:11.109653+0000","last_became_peered":"2024-09-12T00:30:11.109653+0000","last_unstale":"2024-09-12T01:11:41.884100+0000","last_undegraded":"2024-09-12T01:11:41.884100+0000","last_fullsized":"2024-09-12T01:11:41.884100+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-12T01:11:41.883946+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-12T01:11:41.883946+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.883946+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:36.450437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105416,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":3254,"num_write":1234,"num_write_kb":30224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.144738+0000","last_change":"2024-09-12T01:11:48.144738+0000","last_active":"2024-09-12T01:11:48.144738+0000","last_peered":"2024-09-12T01:11:48.144738+0000","last_clean":"2024-09-12T01:11:48.144738+0000","last_became_active":"2024-09-12T00:30:15.132784+0000","last_became_peered":"2024-09-12T00:30:15.132784+0000","last_unstale":"2024-09-12T01:11:48.144738+0000","last_undegraded":"2024-09-12T01:11:48.144738+0000","last_fullsized":"2024-09-12T01:11:48.144738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.144638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.144638+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.144638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:44.115258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'265","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.162751+0000","last_change":"2024-09-12T01:11:52.162751+0000","last_active":"2024-09-12T01:11:52.162751+0000","last_peered":"2024-09-12T01:11:52.162751+0000","last_clean":"2024-09-12T01:11:52.162751+0000","last_became_active":"2024-09-12T00:30:17.146483+0000","last_became_peered":"2024-09-12T00:30:17.146483+0000","last_unstale":"2024-09-12T01:11:52.162751+0000","last_undegraded":"2024-09-12T01:11:52.162751+0000","last_fullsized":"2024-09-12T01:11:52.162751+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-09-12T01:11:52.162658+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-09-12T01:11:52.162658+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.162658+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.289153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51465,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":944,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.583814+0000","last_change":"2024-09-12T01:11:51.583814+0000","last_active":"2024-09-12T01:11:51.583814+0000","last_peered":"2024-09-12T01:11:51.583814+0000","last_clean":"2024-09-12T01:11:51.583814+0000","last_became_active":"2024-09-12T00:30:19.168980+0000","last_became_peered":"2024-09-12T00:30:19.168980+0000","last_unstale":"2024-09-12T01:11:51.583814+0000","last_undegraded":"2024-09-12T01:11:51.583814+0000","last_fullsized":"2024-09-12T01:11:51.583814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.583717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.583717+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.583717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:33.975499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'109","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.681342+0000","last_change":"2024-09-12T01:11:57.681342+0000","last_active":"2024-09-12T01:11:57.681342+0000","last_peered":"2024-09-12T01:11:57.681342+0000","last_clean":"2024-09-12T01:11:57.681342+0000","last_became_active":"2024-09-12T00:30:21.187742+0000","last_became_peered":"2024-09-12T00:30:21.187742+0000","last_unstale":"2024-09-12T01:11:57.681342+0000","last_undegraded":"2024-09-12T01:11:57.681342+0000","last_fullsized":"2024-09-12T01:11:57.681342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T01:11:57.681228+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T01:11:57.681228+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.681228+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:55.746205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'264","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.224777+0000","last_change":"2024-09-12T01:11:40.224777+0000","last_active":"2024-09-12T01:11:40.224777+0000","last_peered":"2024-09-12T01:11:40.224777+0000","last_clean":"2024-09-12T01:11:40.224777+0000","last_became_active":"2024-09-12T00:30:13.131204+0000","last_became_peered":"2024-09-12T00:30:13.131204+0000","last_unstale":"2024-09-12T01:11:40.224777+0000","last_undegraded":"2024-09-12T01:11:40.224777+0000","last_fullsized":"2024-09-12T01:11:40.224777+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-12T01:11:40.224678+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-12T01:11:40.224678+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.224678+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:44.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":908,"num_write":395,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'365","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.378631+0000","last_change":"2024-09-12T01:11:29.378631+0000","last_active":"2024-09-12T01:11:29.378631+0000","last_peered":"2024-09-12T01:11:29.378631+0000","last_clean":"2024-09-12T01:11:29.378631+0000","last_became_active":"2024-09-12T00:30:11.104403+0000","last_became_peered":"2024-09-12T00:30:11.104403+0000","last_unstale":"2024-09-12T01:11:29.378631+0000","last_undegraded":"2024-09-12T01:11:29.378631+0000","last_fullsized":"2024-09-12T01:11:29.378631+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'365","last_scrub_stamp":"2024-09-12T01:11:29.378485+0000","last_deep_scrub":"264'365","last_deep_scrub_stamp":"2024-09-12T01:11:29.378485+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.378485+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.993161+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190266,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":58051,"num_write":1218,"num_write_kb":38205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.317361+0000","last_change":"2024-09-12T01:11:49.317361+0000","last_active":"2024-09-12T01:11:49.317361+0000","last_peered":"2024-09-12T01:11:49.317361+0000","last_clean":"2024-09-12T01:11:49.317361+0000","last_became_active":"2024-09-12T00:30:15.128366+0000","last_became_peered":"2024-09-12T00:30:15.128366+0000","last_unstale":"2024-09-12T01:11:49.317361+0000","last_undegraded":"2024-09-12T01:11:49.317361+0000","last_fullsized":"2024-09-12T01:11:49.317361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.317271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.317271+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.317271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:12.699314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'48","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.311815+0000","last_change":"2024-09-12T01:11:56.311815+0000","last_active":"2024-09-12T01:11:56.311815+0000","last_peered":"2024-09-12T01:11:56.311815+0000","last_clean":"2024-09-12T01:11:56.311815+0000","last_became_active":"2024-09-12T00:30:17.138399+0000","last_became_peered":"2024-09-12T00:30:17.138399+0000","last_unstale":"2024-09-12T01:11:56.311815+0000","last_undegraded":"2024-09-12T01:11:56.311815+0000","last_fullsized":"2024-09-12T01:11:56.311815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-12T01:11:56.311717+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-12T01:11:56.311717+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.311717+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:01.521119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":31,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.346265+0000","last_change":"2024-09-12T01:11:53.346265+0000","last_active":"2024-09-12T01:11:53.346265+0000","last_peered":"2024-09-12T01:11:53.346265+0000","last_clean":"2024-09-12T01:11:53.346265+0000","last_became_active":"2024-09-12T00:30:19.167213+0000","last_became_peered":"2024-09-12T00:30:19.167213+0000","last_unstale":"2024-09-12T01:11:53.346265+0000","last_undegraded":"2024-09-12T01:11:53.346265+0000","last_fullsized":"2024-09-12T01:11:53.346265+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.346201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.346201+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.346201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:08.482365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'203","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.215718+0000","last_change":"2024-09-12T01:12:00.215718+0000","last_active":"2024-09-12T01:12:00.215718+0000","last_peered":"2024-09-12T01:12:00.215718+0000","last_clean":"2024-09-12T01:12:00.215718+0000","last_became_active":"2024-09-12T00:30:21.185636+0000","last_became_peered":"2024-09-12T00:30:21.185636+0000","last_unstale":"2024-09-12T01:12:00.215718+0000","last_undegraded":"2024-09-12T01:12:00.215718+0000","last_fullsized":"2024-09-12T01:12:00.215718+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T01:12:00.215608+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T01:12:00.215608+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.215608+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:45.482051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":299,"num_write":483,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'101","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.369628+0000","last_change":"2024-09-12T01:11:47.369628+0000","last_active":"2024-09-12T01:11:47.369628+0000","last_peered":"2024-09-12T01:11:47.369628+0000","last_clean":"2024-09-12T01:11:47.369628+0000","last_became_active":"2024-09-12T00:30:13.124163+0000","last_became_peered":"2024-09-12T00:30:13.124163+0000","last_unstale":"2024-09-12T01:11:47.369628+0000","last_undegraded":"2024-09-12T01:11:47.369628+0000","last_fullsized":"2024-09-12T01:11:47.369628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T01:11:47.369535+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T01:11:47.369535+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.369535+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:17.905362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":380,"num_write":155,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'347","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.398998+0000","last_change":"2024-09-12T01:11:32.398998+0000","last_active":"2024-09-12T01:11:32.398998+0000","last_peered":"2024-09-12T01:11:32.398998+0000","last_clean":"2024-09-12T01:11:32.398998+0000","last_became_active":"2024-09-12T00:30:11.110736+0000","last_became_peered":"2024-09-12T00:30:11.110736+0000","last_unstale":"2024-09-12T01:11:32.398998+0000","last_undegraded":"2024-09-12T01:11:32.398998+0000","last_fullsized":"2024-09-12T01:11:32.398998+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:32.398902+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:32.398902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.398902+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:00.088675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380458,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":820,"num_read_kb":34556,"num_write":1163,"num_write_kb":41998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.333925+0000","last_change":"2024-09-12T01:11:44.333925+0000","last_active":"2024-09-12T01:11:44.333925+0000","last_peered":"2024-09-12T01:11:44.333925+0000","last_clean":"2024-09-12T01:11:44.333925+0000","last_became_active":"2024-09-12T00:30:15.121068+0000","last_became_peered":"2024-09-12T00:30:15.121068+0000","last_unstale":"2024-09-12T01:11:44.333925+0000","last_undegraded":"2024-09-12T01:11:44.333925+0000","last_fullsized":"2024-09-12T01:11:44.333925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.333836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.333836+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.333836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:08.954732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'318","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.543166+0000","last_change":"2024-09-12T01:11:48.543166+0000","last_active":"2024-09-12T01:11:48.543166+0000","last_peered":"2024-09-12T01:11:48.543166+0000","last_clean":"2024-09-12T01:11:48.543166+0000","last_became_active":"2024-09-12T00:30:17.147946+0000","last_became_peered":"2024-09-12T00:30:17.147946+0000","last_unstale":"2024-09-12T01:11:48.543166+0000","last_undegraded":"2024-09-12T01:11:48.543166+0000","last_fullsized":"2024-09-12T01:11:48.543166+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T01:11:48.543075+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T01:11:48.543075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.543075+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:23.858040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":1151,"num_write":414,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.777973+0000","last_change":"2024-09-12T01:11:50.777973+0000","last_active":"2024-09-12T01:11:50.777973+0000","last_peered":"2024-09-12T01:11:50.777973+0000","last_clean":"2024-09-12T01:11:50.777973+0000","last_became_active":"2024-09-12T00:30:19.167407+0000","last_became_peered":"2024-09-12T00:30:19.167407+0000","last_unstale":"2024-09-12T01:11:50.777973+0000","last_undegraded":"2024-09-12T01:11:50.777973+0000","last_fullsized":"2024-09-12T01:11:50.777973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.777878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.777878+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.777878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:52.228704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.270721+0000","last_change":"2024-09-12T00:30:21.189080+0000","last_active":"2024-09-12T01:09:23.270721+0000","last_peered":"2024-09-12T01:09:23.270721+0000","last_clean":"2024-09-12T01:09:23.270721+0000","last_became_active":"2024-09-12T00:30:21.188801+0000","last_became_peered":"2024-09-12T00:30:21.188801+0000","last_unstale":"2024-09-12T01:09:23.270721+0000","last_undegraded":"2024-09-12T01:09:23.270721+0000","last_fullsized":"2024-09-12T01:09:23.270721+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:52.941694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":174,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'271","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.567103+0000","last_change":"2024-09-12T01:11:38.567103+0000","last_active":"2024-09-12T01:11:38.567103+0000","last_peered":"2024-09-12T01:11:38.567103+0000","last_clean":"2024-09-12T01:11:38.567103+0000","last_became_active":"2024-09-12T00:30:13.121687+0000","last_became_peered":"2024-09-12T00:30:13.121687+0000","last_unstale":"2024-09-12T01:11:38.567103+0000","last_undegraded":"2024-09-12T01:11:38.567103+0000","last_fullsized":"2024-09-12T01:11:38.567103+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T01:11:38.566980+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T01:11:38.566980+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.566980+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:30.059821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1180,"num_read_kb":936,"num_write":465,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'332","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.265680+0000","last_change":"2024-09-12T01:11:33.265680+0000","last_active":"2024-09-12T01:11:33.265680+0000","last_peered":"2024-09-12T01:11:33.265680+0000","last_clean":"2024-09-12T01:11:33.265680+0000","last_became_active":"2024-09-12T00:30:11.097863+0000","last_became_peered":"2024-09-12T00:30:11.097863+0000","last_unstale":"2024-09-12T01:11:33.265680+0000","last_undegraded":"2024-09-12T01:11:33.265680+0000","last_fullsized":"2024-09-12T01:11:33.265680+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T01:11:33.265543+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T01:11:33.265543+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.265543+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:12.068841+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4714622,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":74376,"num_write":1103,"num_write_kb":34671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.848163+0000","last_change":"2024-09-12T01:11:59.848163+0000","last_active":"2024-09-12T01:11:59.848163+0000","last_peered":"2024-09-12T01:11:59.848163+0000","last_clean":"2024-09-12T01:11:59.848163+0000","last_became_active":"2024-09-12T00:30:15.125505+0000","last_became_peered":"2024-09-12T00:30:15.125505+0000","last_unstale":"2024-09-12T01:11:59.848163+0000","last_undegraded":"2024-09-12T01:11:59.848163+0000","last_fullsized":"2024-09-12T01:11:59.848163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:59.848070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:59.848070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.848070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:45.445978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'281","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.298221+0000","last_change":"2024-09-12T01:11:52.298221+0000","last_active":"2024-09-12T01:11:52.298221+0000","last_peered":"2024-09-12T01:11:52.298221+0000","last_clean":"2024-09-12T01:11:52.298221+0000","last_became_active":"2024-09-12T00:30:17.146112+0000","last_became_peered":"2024-09-12T00:30:17.146112+0000","last_unstale":"2024-09-12T01:11:52.298221+0000","last_undegraded":"2024-09-12T01:11:52.298221+0000","last_fullsized":"2024-09-12T01:11:52.298221+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'281","last_scrub_stamp":"2024-09-12T01:11:52.298124+0000","last_deep_scrub":"264'281","last_deep_scrub_stamp":"2024-09-12T01:11:52.298124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.298124+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:45.416273+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56907,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":1155,"num_write":390,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.623510+0000","last_change":"2024-09-12T01:11:52.623510+0000","last_active":"2024-09-12T01:11:52.623510+0000","last_peered":"2024-09-12T01:11:52.623510+0000","last_clean":"2024-09-12T01:11:52.623510+0000","last_became_active":"2024-09-12T00:30:19.164820+0000","last_became_peered":"2024-09-12T00:30:19.164820+0000","last_unstale":"2024-09-12T01:11:52.623510+0000","last_undegraded":"2024-09-12T01:11:52.623510+0000","last_fullsized":"2024-09-12T01:11:52.623510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.623414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.623414+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.623414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:15.344847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'177","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.799130+0000","last_change":"2024-09-12T01:11:52.799021+0000","last_active":"2024-09-12T01:11:52.799130+0000","last_peered":"2024-09-12T01:11:52.799130+0000","last_clean":"2024-09-12T01:11:52.799130+0000","last_became_active":"2024-09-12T00:30:13.124584+0000","last_became_peered":"2024-09-12T00:30:13.124584+0000","last_unstale":"2024-09-12T01:11:52.799130+0000","last_undegraded":"2024-09-12T01:11:52.799130+0000","last_fullsized":"2024-09-12T01:11:52.799130+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T01:11:52.798926+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T01:11:52.798926+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.798926+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:57.986585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":813,"num_read_kb":670,"num_write":272,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'359","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.309657+0000","last_change":"2024-09-12T01:11:36.309657+0000","last_active":"2024-09-12T01:11:36.309657+0000","last_peered":"2024-09-12T01:11:36.309657+0000","last_clean":"2024-09-12T01:11:36.309657+0000","last_became_active":"2024-09-12T00:30:11.097890+0000","last_became_peered":"2024-09-12T00:30:11.097890+0000","last_unstale":"2024-09-12T01:11:36.309657+0000","last_undegraded":"2024-09-12T01:11:36.309657+0000","last_fullsized":"2024-09-12T01:11:36.309657+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-12T01:11:36.309476+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-12T01:11:36.309476+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.309476+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:38.549094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":38574,"num_write":1151,"num_write_kb":31383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"264'6","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.176935+0000","last_change":"2024-09-12T01:11:49.176935+0000","last_active":"2024-09-12T01:11:49.176935+0000","last_peered":"2024-09-12T01:11:49.176935+0000","last_clean":"2024-09-12T01:11:49.176935+0000","last_became_active":"2024-09-12T00:30:15.122172+0000","last_became_peered":"2024-09-12T00:30:15.122172+0000","last_unstale":"2024-09-12T01:11:49.176935+0000","last_undegraded":"2024-09-12T01:11:49.176935+0000","last_fullsized":"2024-09-12T01:11:49.176935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:11:49.176853+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:11:49.176853+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.176853+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:08.193883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'518","reported_seq":1151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.213229+0000","last_change":"2024-09-12T01:11:53.213229+0000","last_active":"2024-09-12T01:11:53.213229+0000","last_peered":"2024-09-12T01:11:53.213229+0000","last_clean":"2024-09-12T01:11:53.213229+0000","last_became_active":"2024-09-12T00:30:17.145882+0000","last_became_peered":"2024-09-12T00:30:17.145882+0000","last_unstale":"2024-09-12T01:11:53.213229+0000","last_undegraded":"2024-09-12T01:11:53.213229+0000","last_fullsized":"2024-09-12T01:11:53.213229+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'518","last_scrub_stamp":"2024-09-12T01:11:53.213086+0000","last_deep_scrub":"264'518","last_deep_scrub_stamp":"2024-09-12T01:11:53.213086+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.213086+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:22.122443+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96845,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":949,"num_read_kb":2301,"num_write":828,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26648,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.367040+0000","last_change":"2024-09-12T01:11:52.367040+0000","last_active":"2024-09-12T01:11:52.367040+0000","last_peered":"2024-09-12T01:11:52.367040+0000","last_clean":"2024-09-12T01:11:52.367040+0000","last_became_active":"2024-09-12T00:30:19.170776+0000","last_became_peered":"2024-09-12T00:30:19.170776+0000","last_unstale":"2024-09-12T01:11:52.367040+0000","last_undegraded":"2024-09-12T01:11:52.367040+0000","last_fullsized":"2024-09-12T01:11:52.367040+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.366946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.366946+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.366946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:36.669146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'142","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:12.220138+0000","last_change":"2024-09-12T00:30:21.188712+0000","last_active":"2024-09-12T01:09:12.220138+0000","last_peered":"2024-09-12T01:09:12.220138+0000","last_clean":"2024-09-12T01:09:12.220138+0000","last_became_active":"2024-09-12T00:30:21.188376+0000","last_became_peered":"2024-09-12T00:30:21.188376+0000","last_unstale":"2024-09-12T01:09:12.220138+0000","last_undegraded":"2024-09-12T01:09:12.220138+0000","last_fullsized":"2024-09-12T01:09:12.220138+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:33.881129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":168,"num_write":312,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'188","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.280000+0000","last_change":"2024-09-12T01:11:42.280000+0000","last_active":"2024-09-12T01:11:42.280000+0000","last_peered":"2024-09-12T01:11:42.280000+0000","last_clean":"2024-09-12T01:11:42.280000+0000","last_became_active":"2024-09-12T00:30:13.118251+0000","last_became_peered":"2024-09-12T00:30:13.118251+0000","last_unstale":"2024-09-12T01:11:42.280000+0000","last_undegraded":"2024-09-12T01:11:42.280000+0000","last_fullsized":"2024-09-12T01:11:42.280000+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-09-12T01:11:42.279891+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-09-12T01:11:42.279891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.279891+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:04.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":709,"num_write":308,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'375","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.312581+0000","last_change":"2024-09-12T01:11:36.312581+0000","last_active":"2024-09-12T01:11:36.312581+0000","last_peered":"2024-09-12T01:11:36.312581+0000","last_clean":"2024-09-12T01:11:36.312581+0000","last_became_active":"2024-09-12T00:30:11.102929+0000","last_became_peered":"2024-09-12T00:30:11.102929+0000","last_unstale":"2024-09-12T01:11:36.312581+0000","last_undegraded":"2024-09-12T01:11:36.312581+0000","last_fullsized":"2024-09-12T01:11:36.312581+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:36.312446+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:36.312446+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.312446+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:28.083174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":62693,"num_write":1091,"num_write_kb":37872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.271695+0000","last_change":"2024-09-12T01:11:47.271635+0000","last_active":"2024-09-12T01:11:47.271695+0000","last_peered":"2024-09-12T01:11:47.271695+0000","last_clean":"2024-09-12T01:11:47.271695+0000","last_became_active":"2024-09-12T00:30:15.127268+0000","last_became_peered":"2024-09-12T00:30:15.127268+0000","last_unstale":"2024-09-12T01:11:47.271695+0000","last_undegraded":"2024-09-12T01:11:47.271695+0000","last_fullsized":"2024-09-12T01:11:47.271695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.271530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.271530+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.271530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.919338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'314","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.020906+0000","last_change":"2024-09-12T01:12:07.020906+0000","last_active":"2024-09-12T01:12:07.020906+0000","last_peered":"2024-09-12T01:12:07.020906+0000","last_clean":"2024-09-12T01:12:07.020906+0000","last_became_active":"2024-09-12T00:30:17.145504+0000","last_became_peered":"2024-09-12T00:30:17.145504+0000","last_unstale":"2024-09-12T01:12:07.020906+0000","last_undegraded":"2024-09-12T01:12:07.020906+0000","last_fullsized":"2024-09-12T01:12:07.020906+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T01:12:07.020794+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T01:12:07.020794+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.020794+0000","objects_scrubbed":8,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:30.811955+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1192,"num_write":444,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.468435+0000","last_change":"2024-09-12T01:12:02.468435+0000","last_active":"2024-09-12T01:12:02.468435+0000","last_peered":"2024-09-12T01:12:02.468435+0000","last_clean":"2024-09-12T01:12:02.468435+0000","last_became_active":"2024-09-12T00:30:19.169558+0000","last_became_peered":"2024-09-12T00:30:19.169558+0000","last_unstale":"2024-09-12T01:12:02.468435+0000","last_undegraded":"2024-09-12T01:12:02.468435+0000","last_fullsized":"2024-09-12T01:12:02.468435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:02.468352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:02.468352+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.468352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:10.180957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'175","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:16.845489+0000","last_change":"2024-09-12T00:30:21.188671+0000","last_active":"2024-09-12T01:09:16.845489+0000","last_peered":"2024-09-12T01:09:16.845489+0000","last_clean":"2024-09-12T01:09:16.845489+0000","last_became_active":"2024-09-12T00:30:21.188350+0000","last_became_peered":"2024-09-12T00:30:21.188350+0000","last_unstale":"2024-09-12T01:09:16.845489+0000","last_undegraded":"2024-09-12T01:09:16.845489+0000","last_fullsized":"2024-09-12T01:09:16.845489+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.291083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2246,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":214,"num_write":509,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'191","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.526183+0000","last_change":"2024-09-12T01:11:39.526183+0000","last_active":"2024-09-12T01:11:39.526183+0000","last_peered":"2024-09-12T01:11:39.526183+0000","last_clean":"2024-09-12T01:11:39.526183+0000","last_became_active":"2024-09-12T00:30:13.127294+0000","last_became_peered":"2024-09-12T00:30:13.127294+0000","last_unstale":"2024-09-12T01:11:39.526183+0000","last_undegraded":"2024-09-12T01:11:39.526183+0000","last_fullsized":"2024-09-12T01:11:39.526183+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'191","last_scrub_stamp":"2024-09-12T01:11:39.526081+0000","last_deep_scrub":"264'191","last_deep_scrub_stamp":"2024-09-12T01:11:39.526081+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.526081+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.075674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":881,"num_read_kb":750,"num_write":313,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'341","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.807113+0000","last_change":"2024-09-12T01:11:32.807113+0000","last_active":"2024-09-12T01:11:32.807113+0000","last_peered":"2024-09-12T01:11:32.807113+0000","last_clean":"2024-09-12T01:11:32.807113+0000","last_became_active":"2024-09-12T00:30:11.091027+0000","last_became_peered":"2024-09-12T00:30:11.091027+0000","last_unstale":"2024-09-12T01:11:32.807113+0000","last_undegraded":"2024-09-12T01:11:32.807113+0000","last_fullsized":"2024-09-12T01:11:32.807113+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T01:11:32.806954+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T01:11:32.806954+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.806954+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:48.132495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4477982,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":8604,"num_write":1162,"num_write_kb":27793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.318124+0000","last_change":"2024-09-12T01:11:49.318124+0000","last_active":"2024-09-12T01:11:49.318124+0000","last_peered":"2024-09-12T01:11:49.318124+0000","last_clean":"2024-09-12T01:11:49.318124+0000","last_became_active":"2024-09-12T00:30:15.126254+0000","last_became_peered":"2024-09-12T00:30:15.126254+0000","last_unstale":"2024-09-12T01:11:49.318124+0000","last_undegraded":"2024-09-12T01:11:49.318124+0000","last_fullsized":"2024-09-12T01:11:49.318124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.318016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.318016+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.318016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:56.146698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'290","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.182145+0000","last_change":"2024-09-12T01:11:56.182081+0000","last_active":"2024-09-12T01:11:56.182145+0000","last_peered":"2024-09-12T01:11:56.182145+0000","last_clean":"2024-09-12T01:11:56.182145+0000","last_became_active":"2024-09-12T00:30:17.146106+0000","last_became_peered":"2024-09-12T00:30:17.146106+0000","last_unstale":"2024-09-12T01:11:56.182145+0000","last_undegraded":"2024-09-12T01:11:56.182145+0000","last_fullsized":"2024-09-12T01:11:56.182145+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'290","last_scrub_stamp":"2024-09-12T01:11:56.181993+0000","last_deep_scrub":"264'290","last_deep_scrub_stamp":"2024-09-12T01:11:56.181993+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.181993+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:08.113456+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1084,"num_write":388,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.626813+0000","last_change":"2024-09-12T01:11:53.626813+0000","last_active":"2024-09-12T01:11:53.626813+0000","last_peered":"2024-09-12T01:11:53.626813+0000","last_clean":"2024-09-12T01:11:53.626813+0000","last_became_active":"2024-09-12T00:30:19.167119+0000","last_became_peered":"2024-09-12T00:30:19.167119+0000","last_unstale":"2024-09-12T01:11:53.626813+0000","last_undegraded":"2024-09-12T01:11:53.626813+0000","last_fullsized":"2024-09-12T01:11:53.626813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.626713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.626713+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.626713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:07.308732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'97","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:51.490235+0000","last_change":"2024-09-12T00:30:21.191304+0000","last_active":"2024-09-12T01:10:51.490235+0000","last_peered":"2024-09-12T01:10:51.490235+0000","last_clean":"2024-09-12T01:10:51.490235+0000","last_became_active":"2024-09-12T00:30:21.190937+0000","last_became_peered":"2024-09-12T00:30:21.190937+0000","last_unstale":"2024-09-12T01:10:51.490235+0000","last_undegraded":"2024-09-12T01:10:51.490235+0000","last_fullsized":"2024-09-12T01:10:51.490235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:04.164418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":102,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'208","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.235533+0000","last_change":"2024-09-12T01:11:41.235533+0000","last_active":"2024-09-12T01:11:41.235533+0000","last_peered":"2024-09-12T01:11:41.235533+0000","last_clean":"2024-09-12T01:11:41.235533+0000","last_became_active":"2024-09-12T00:30:13.119843+0000","last_became_peered":"2024-09-12T00:30:13.119843+0000","last_unstale":"2024-09-12T01:11:41.235533+0000","last_undegraded":"2024-09-12T01:11:41.235533+0000","last_fullsized":"2024-09-12T01:11:41.235533+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T01:11:41.235444+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T01:11:41.235444+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.235444+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:10.729092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":901,"num_read_kb":747,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'375","reported_seq":1048,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.260021+0000","last_change":"2024-09-12T01:11:39.260021+0000","last_active":"2024-09-12T01:11:39.260021+0000","last_peered":"2024-09-12T01:11:39.260021+0000","last_clean":"2024-09-12T01:11:39.260021+0000","last_became_active":"2024-09-12T00:30:11.100750+0000","last_became_peered":"2024-09-12T00:30:11.100750+0000","last_unstale":"2024-09-12T01:11:39.260021+0000","last_undegraded":"2024-09-12T01:11:39.260021+0000","last_fullsized":"2024-09-12T01:11:39.260021+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:39.259889+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:39.259889+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.259889+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:23.779675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1340812,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":582,"num_read_kb":31919,"num_write":1306,"num_write_kb":26213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.306420+0000","last_change":"2024-09-12T01:11:54.306420+0000","last_active":"2024-09-12T01:11:54.306420+0000","last_peered":"2024-09-12T01:11:54.306420+0000","last_clean":"2024-09-12T01:11:54.306420+0000","last_became_active":"2024-09-12T00:30:15.127444+0000","last_became_peered":"2024-09-12T00:30:15.127444+0000","last_unstale":"2024-09-12T01:11:54.306420+0000","last_undegraded":"2024-09-12T01:11:54.306420+0000","last_fullsized":"2024-09-12T01:11:54.306420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.306326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.306326+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.306326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:36.609522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'91","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.037782+0000","last_change":"2024-09-12T01:12:08.037782+0000","last_active":"2024-09-12T01:12:08.037782+0000","last_peered":"2024-09-12T01:12:08.037782+0000","last_clean":"2024-09-12T01:12:08.037782+0000","last_became_active":"2024-09-12T00:30:17.144283+0000","last_became_peered":"2024-09-12T00:30:17.144283+0000","last_unstale":"2024-09-12T01:12:08.037782+0000","last_undegraded":"2024-09-12T01:12:08.037782+0000","last_fullsized":"2024-09-12T01:12:08.037782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'91","last_scrub_stamp":"2024-09-12T01:12:08.037667+0000","last_deep_scrub":"264'91","last_deep_scrub_stamp":"2024-09-12T01:12:08.037667+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.037667+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:49.830373+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":66,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'770","reported_seq":2407,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.338723+0000","last_change":"2024-09-12T01:11:53.338662+0000","last_active":"2024-09-12T01:11:53.338723+0000","last_peered":"2024-09-12T01:11:53.338723+0000","last_clean":"2024-09-12T01:11:53.338723+0000","last_became_active":"2024-09-12T00:30:19.166851+0000","last_became_peered":"2024-09-12T00:30:19.166851+0000","last_unstale":"2024-09-12T01:11:53.338723+0000","last_undegraded":"2024-09-12T01:11:53.338723+0000","last_fullsized":"2024-09-12T01:11:53.338723+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'770","last_scrub_stamp":"2024-09-12T01:11:53.338595+0000","last_deep_scrub":"264'770","last_deep_scrub_stamp":"2024-09-12T01:11:53.338595+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.338595+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:50.559711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'131","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:31.215109+0000","last_change":"2024-09-12T00:30:21.190459+0000","last_active":"2024-09-12T01:09:31.215109+0000","last_peered":"2024-09-12T01:09:31.215109+0000","last_clean":"2024-09-12T01:09:31.215109+0000","last_became_active":"2024-09-12T00:30:21.190151+0000","last_became_peered":"2024-09-12T00:30:21.190151+0000","last_unstale":"2024-09-12T01:09:31.215109+0000","last_undegraded":"2024-09-12T01:09:31.215109+0000","last_fullsized":"2024-09-12T01:09:31.215109+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:54.921241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'111","reported_seq":715,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.353880+0000","last_change":"2024-09-12T01:11:43.353880+0000","last_active":"2024-09-12T01:11:43.353880+0000","last_peered":"2024-09-12T01:11:43.353880+0000","last_clean":"2024-09-12T01:11:43.353880+0000","last_became_active":"2024-09-12T00:30:13.124167+0000","last_became_peered":"2024-09-12T00:30:13.124167+0000","last_unstale":"2024-09-12T01:11:43.353880+0000","last_undegraded":"2024-09-12T01:11:43.353880+0000","last_fullsized":"2024-09-12T01:11:43.353880+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-12T01:11:43.353764+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-12T01:11:43.353764+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.353764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:12.072323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":425,"num_write":152,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'457","reported_seq":1161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.807625+0000","last_change":"2024-09-12T01:11:33.807625+0000","last_active":"2024-09-12T01:11:33.807625+0000","last_peered":"2024-09-12T01:11:33.807625+0000","last_clean":"2024-09-12T01:11:33.807625+0000","last_became_active":"2024-09-12T00:30:11.108422+0000","last_became_peered":"2024-09-12T00:30:11.108422+0000","last_unstale":"2024-09-12T01:11:33.807625+0000","last_undegraded":"2024-09-12T01:11:33.807625+0000","last_fullsized":"2024-09-12T01:11:33.807625+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'457","last_scrub_stamp":"2024-09-12T01:11:33.807436+0000","last_deep_scrub":"264'457","last_deep_scrub_stamp":"2024-09-12T01:11:33.807436+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.807436+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:14.406328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314887,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":867,"num_read_kb":2765,"num_write":1329,"num_write_kb":29562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.823293+0000","last_change":"2024-09-12T01:11:45.823293+0000","last_active":"2024-09-12T01:11:45.823293+0000","last_peered":"2024-09-12T01:11:45.823293+0000","last_clean":"2024-09-12T01:11:45.823293+0000","last_became_active":"2024-09-12T00:30:15.124922+0000","last_became_peered":"2024-09-12T00:30:15.124922+0000","last_unstale":"2024-09-12T01:11:45.823293+0000","last_undegraded":"2024-09-12T01:11:45.823293+0000","last_fullsized":"2024-09-12T01:11:45.823293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.823172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.823172+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.823172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:20.010059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'360","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.339930+0000","last_change":"2024-09-12T01:11:50.339930+0000","last_active":"2024-09-12T01:11:50.339930+0000","last_peered":"2024-09-12T01:11:50.339930+0000","last_clean":"2024-09-12T01:11:50.339930+0000","last_became_active":"2024-09-12T00:30:17.148793+0000","last_became_peered":"2024-09-12T00:30:17.148793+0000","last_unstale":"2024-09-12T01:11:50.339930+0000","last_undegraded":"2024-09-12T01:11:50.339930+0000","last_fullsized":"2024-09-12T01:11:50.339930+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-12T01:11:50.339839+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-12T01:11:50.339839+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.339839+0000","objects_scrubbed":11,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.251001+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62476,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1247,"num_write":454,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.346416+0000","last_change":"2024-09-12T01:12:03.346416+0000","last_active":"2024-09-12T01:12:03.346416+0000","last_peered":"2024-09-12T01:12:03.346416+0000","last_clean":"2024-09-12T01:12:03.346416+0000","last_became_active":"2024-09-12T00:30:19.169982+0000","last_became_peered":"2024-09-12T00:30:19.169982+0000","last_unstale":"2024-09-12T01:12:03.346416+0000","last_undegraded":"2024-09-12T01:12:03.346416+0000","last_fullsized":"2024-09-12T01:12:03.346416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.346310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.346310+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.346310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:19.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'147","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.736398+0000","last_change":"2024-09-12T01:11:58.736398+0000","last_active":"2024-09-12T01:11:58.736398+0000","last_peered":"2024-09-12T01:11:58.736398+0000","last_clean":"2024-09-12T01:11:58.736398+0000","last_became_active":"2024-09-12T00:30:21.187641+0000","last_became_peered":"2024-09-12T00:30:21.187641+0000","last_unstale":"2024-09-12T01:11:58.736398+0000","last_undegraded":"2024-09-12T01:11:58.736398+0000","last_fullsized":"2024-09-12T01:11:58.736398+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T01:11:58.736290+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T01:11:58.736290+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.736290+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:18.096544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":136,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'195","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.316905+0000","last_change":"2024-09-12T01:11:42.316905+0000","last_active":"2024-09-12T01:11:42.316905+0000","last_peered":"2024-09-12T01:11:42.316905+0000","last_clean":"2024-09-12T01:11:42.316905+0000","last_became_active":"2024-09-12T00:30:13.122622+0000","last_became_peered":"2024-09-12T00:30:13.122622+0000","last_unstale":"2024-09-12T01:11:42.316905+0000","last_undegraded":"2024-09-12T01:11:42.316905+0000","last_fullsized":"2024-09-12T01:11:42.316905+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T01:11:42.316822+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T01:11:42.316822+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.316822+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:34.809995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":295,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'335","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.919664+0000","last_change":"2024-09-12T01:11:39.919664+0000","last_active":"2024-09-12T01:11:39.919664+0000","last_peered":"2024-09-12T01:11:39.919664+0000","last_clean":"2024-09-12T01:11:39.919664+0000","last_became_active":"2024-09-12T00:30:11.109855+0000","last_became_peered":"2024-09-12T00:30:11.109855+0000","last_unstale":"2024-09-12T01:11:39.919664+0000","last_undegraded":"2024-09-12T01:11:39.919664+0000","last_fullsized":"2024-09-12T01:11:39.919664+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T01:11:39.919561+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T01:11:39.919561+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.919561+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:13.840279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314923,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":64470,"num_write":1037,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.316987+0000","last_change":"2024-09-12T01:11:46.316987+0000","last_active":"2024-09-12T01:11:46.316987+0000","last_peered":"2024-09-12T01:11:46.316987+0000","last_clean":"2024-09-12T01:11:46.316987+0000","last_became_active":"2024-09-12T00:30:15.125870+0000","last_became_peered":"2024-09-12T00:30:15.125870+0000","last_unstale":"2024-09-12T01:11:46.316987+0000","last_undegraded":"2024-09-12T01:11:46.316987+0000","last_fullsized":"2024-09-12T01:11:46.316987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.316891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.316891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.316891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:19.260779+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'282","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.375619+0000","last_change":"2024-09-12T01:12:01.375619+0000","last_active":"2024-09-12T01:12:01.375619+0000","last_peered":"2024-09-12T01:12:01.375619+0000","last_clean":"2024-09-12T01:12:01.375619+0000","last_became_active":"2024-09-12T00:30:17.149226+0000","last_became_peered":"2024-09-12T00:30:17.149226+0000","last_unstale":"2024-09-12T01:12:01.375619+0000","last_undegraded":"2024-09-12T01:12:01.375619+0000","last_fullsized":"2024-09-12T01:12:01.375619+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'282","last_scrub_stamp":"2024-09-12T01:12:01.375500+0000","last_deep_scrub":"264'282","last_deep_scrub_stamp":"2024-09-12T01:12:01.375500+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.375500+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:24.160627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":1045,"num_write":368,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.606510+0000","last_change":"2024-09-12T00:30:19.164875+0000","last_active":"2024-09-12T01:09:03.606510+0000","last_peered":"2024-09-12T01:09:03.606510+0000","last_clean":"2024-09-12T01:09:03.606510+0000","last_became_active":"2024-09-12T00:30:19.164556+0000","last_became_peered":"2024-09-12T00:30:19.164556+0000","last_unstale":"2024-09-12T01:09:03.606510+0000","last_undegraded":"2024-09-12T01:09:03.606510+0000","last_fullsized":"2024-09-12T01:09:03.606510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:05.138428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'135","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:09.068765+0000","last_change":"2024-09-12T00:30:21.193857+0000","last_active":"2024-09-12T01:09:09.068765+0000","last_peered":"2024-09-12T01:09:09.068765+0000","last_clean":"2024-09-12T01:09:09.068765+0000","last_became_active":"2024-09-12T00:30:21.193606+0000","last_became_peered":"2024-09-12T00:30:21.193606+0000","last_unstale":"2024-09-12T01:09:09.068765+0000","last_undegraded":"2024-09-12T01:09:09.068765+0000","last_fullsized":"2024-09-12T01:09:09.068765+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:56.806530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":946,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":239,"num_write":347,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'4096","reported_seq":4679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.542179+0000","last_change":"2024-09-12T01:11:37.542179+0000","last_active":"2024-09-12T01:11:37.542179+0000","last_peered":"2024-09-12T01:11:37.542179+0000","last_clean":"2024-09-12T01:11:37.542179+0000","last_became_active":"2024-09-12T00:30:13.120940+0000","last_became_peered":"2024-09-12T00:30:13.120940+0000","last_unstale":"2024-09-12T01:11:37.542179+0000","last_undegraded":"2024-09-12T01:11:37.542179+0000","last_fullsized":"2024-09-12T01:11:37.542179+0000","mapping_epoch":28,"log_start":"264'4000","ondisk_log_start":"264'4000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4096","last_scrub_stamp":"2024-09-12T01:11:37.542072+0000","last_deep_scrub":"264'4096","last_deep_scrub_stamp":"2024-09-12T01:11:37.542072+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.542072+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:02.815247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16459,"num_read_kb":13812,"num_write":6134,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'369","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.291283+0000","last_change":"2024-09-12T01:11:35.291283+0000","last_active":"2024-09-12T01:11:35.291283+0000","last_peered":"2024-09-12T01:11:35.291283+0000","last_clean":"2024-09-12T01:11:35.291283+0000","last_became_active":"2024-09-12T00:30:11.098879+0000","last_became_peered":"2024-09-12T00:30:11.098879+0000","last_unstale":"2024-09-12T01:11:35.291283+0000","last_undegraded":"2024-09-12T01:11:35.291283+0000","last_fullsized":"2024-09-12T01:11:35.291283+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T01:11:35.291178+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T01:11:35.291178+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.291178+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.339007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4317103,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":44113,"num_write":1057,"num_write_kb":43739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.735465+0000","last_change":"2024-09-12T01:11:52.735465+0000","last_active":"2024-09-12T01:11:52.735465+0000","last_peered":"2024-09-12T01:11:52.735465+0000","last_clean":"2024-09-12T01:11:52.735465+0000","last_became_active":"2024-09-12T00:30:15.125452+0000","last_became_peered":"2024-09-12T00:30:15.125452+0000","last_unstale":"2024-09-12T01:11:52.735465+0000","last_undegraded":"2024-09-12T01:11:52.735465+0000","last_fullsized":"2024-09-12T01:11:52.735465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.735325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.735325+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.735325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:19.511992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'236","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.224588+0000","last_change":"2024-09-12T01:11:54.224588+0000","last_active":"2024-09-12T01:11:54.224588+0000","last_peered":"2024-09-12T01:11:54.224588+0000","last_clean":"2024-09-12T01:11:54.224588+0000","last_became_active":"2024-09-12T00:30:17.145961+0000","last_became_peered":"2024-09-12T00:30:17.145961+0000","last_unstale":"2024-09-12T01:11:54.224588+0000","last_undegraded":"2024-09-12T01:11:54.224588+0000","last_fullsized":"2024-09-12T01:11:54.224588+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-12T01:11:54.224485+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-12T01:11:54.224485+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.224485+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:36.818548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":376,"num_read_kb":862,"num_write":304,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.596405+0000","last_change":"2024-09-12T00:30:19.168010+0000","last_active":"2024-09-12T01:07:48.596405+0000","last_peered":"2024-09-12T01:07:48.596405+0000","last_clean":"2024-09-12T01:07:48.596405+0000","last_became_active":"2024-09-12T00:30:19.167723+0000","last_became_peered":"2024-09-12T00:30:19.167723+0000","last_unstale":"2024-09-12T01:07:48.596405+0000","last_undegraded":"2024-09-12T01:07:48.596405+0000","last_fullsized":"2024-09-12T01:07:48.596405+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:18.137404+0000","last_clean_scrub_stamp":"2024-09-12T00:30:18.137404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:31.864085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'170","reported_seq":1614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:44.781840+0000","last_change":"2024-09-12T00:30:21.188654+0000","last_active":"2024-09-12T01:09:44.781840+0000","last_peered":"2024-09-12T01:09:44.781840+0000","last_clean":"2024-09-12T01:09:44.781840+0000","last_became_active":"2024-09-12T00:30:21.188363+0000","last_became_peered":"2024-09-12T00:30:21.188363+0000","last_unstale":"2024-09-12T01:09:44.781840+0000","last_undegraded":"2024-09-12T01:09:44.781840+0000","last_fullsized":"2024-09-12T01:09:44.781840+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:20.159134+0000","last_clean_scrub_stamp":"2024-09-12T00:30:20.159134+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:40.099921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1158,"num_read_kb":1157,"num_write":386,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'184","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.326891+0000","last_change":"2024-09-12T01:11:41.326891+0000","last_active":"2024-09-12T01:11:41.326891+0000","last_peered":"2024-09-12T01:11:41.326891+0000","last_clean":"2024-09-12T01:11:41.326891+0000","last_became_active":"2024-09-12T00:30:13.125727+0000","last_became_peered":"2024-09-12T00:30:13.125727+0000","last_unstale":"2024-09-12T01:11:41.326891+0000","last_undegraded":"2024-09-12T01:11:41.326891+0000","last_fullsized":"2024-09-12T01:11:41.326891+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-12T01:11:41.326789+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-12T01:11:41.326789+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.326789+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:11.817358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":704,"num_write":275,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'321","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.361618+0000","last_change":"2024-09-12T01:11:37.361524+0000","last_active":"2024-09-12T01:11:37.361618+0000","last_peered":"2024-09-12T01:11:37.361618+0000","last_clean":"2024-09-12T01:11:37.361618+0000","last_became_active":"2024-09-12T00:30:11.091808+0000","last_became_peered":"2024-09-12T00:30:11.091808+0000","last_unstale":"2024-09-12T01:11:37.361618+0000","last_undegraded":"2024-09-12T01:11:37.361618+0000","last_fullsized":"2024-09-12T01:11:37.361618+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T01:11:37.361380+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T01:11:37.361380+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.361380+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:30.917946+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380471,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":432,"num_read_kb":10679,"num_write":986,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.289347+0000","last_change":"2024-09-12T01:11:53.289347+0000","last_active":"2024-09-12T01:11:53.289347+0000","last_peered":"2024-09-12T01:11:53.289347+0000","last_clean":"2024-09-12T01:11:53.289347+0000","last_became_active":"2024-09-12T00:30:15.126206+0000","last_became_peered":"2024-09-12T00:30:15.126206+0000","last_unstale":"2024-09-12T01:11:53.289347+0000","last_undegraded":"2024-09-12T01:11:53.289347+0000","last_fullsized":"2024-09-12T01:11:53.289347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:53.289269+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:53.289269+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.289269+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:30.334875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'308","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.969287+0000","last_change":"2024-09-12T01:12:05.969287+0000","last_active":"2024-09-12T01:12:05.969287+0000","last_peered":"2024-09-12T01:12:05.969287+0000","last_clean":"2024-09-12T01:12:05.969287+0000","last_became_active":"2024-09-12T00:30:17.144724+0000","last_became_peered":"2024-09-12T00:30:17.144724+0000","last_unstale":"2024-09-12T01:12:05.969287+0000","last_undegraded":"2024-09-12T01:12:05.969287+0000","last_fullsized":"2024-09-12T01:12:05.969287+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-12T01:12:05.969160+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-12T01:12:05.969160+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.969160+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:15.801949+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48397,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":1068,"num_write":398,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.356472+0000","last_change":"2024-09-12T01:12:05.356472+0000","last_active":"2024-09-12T01:12:05.356472+0000","last_peered":"2024-09-12T01:12:05.356472+0000","last_clean":"2024-09-12T01:12:05.356472+0000","last_became_active":"2024-09-12T00:30:19.172265+0000","last_became_peered":"2024-09-12T00:30:19.172265+0000","last_unstale":"2024-09-12T01:12:05.356472+0000","last_undegraded":"2024-09-12T01:12:05.356472+0000","last_fullsized":"2024-09-12T01:12:05.356472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:05.356389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:05.356389+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.356389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:02.127439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'132","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.288779+0000","last_change":"2024-09-12T01:11:56.288779+0000","last_active":"2024-09-12T01:11:56.288779+0000","last_peered":"2024-09-12T01:11:56.288779+0000","last_clean":"2024-09-12T01:11:56.288779+0000","last_became_active":"2024-09-12T00:30:21.191837+0000","last_became_peered":"2024-09-12T00:30:21.191837+0000","last_unstale":"2024-09-12T01:11:56.288779+0000","last_undegraded":"2024-09-12T01:11:56.288779+0000","last_fullsized":"2024-09-12T01:11:56.288779+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T01:11:56.288686+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T01:11:56.288686+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.288686+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:05.149635+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":99,"num_write":307,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'142","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.285051+0000","last_change":"2024-09-12T01:11:43.285051+0000","last_active":"2024-09-12T01:11:43.285051+0000","last_peered":"2024-09-12T01:11:43.285051+0000","last_clean":"2024-09-12T01:11:43.285051+0000","last_became_active":"2024-09-12T00:30:13.121828+0000","last_became_peered":"2024-09-12T00:30:13.121828+0000","last_unstale":"2024-09-12T01:11:43.285051+0000","last_undegraded":"2024-09-12T01:11:43.285051+0000","last_fullsized":"2024-09-12T01:11:43.285051+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T01:11:43.284952+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T01:11:43.284952+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.284952+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:06.141716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":656,"num_read_kb":543,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'369","reported_seq":1110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.422327+0000","last_change":"2024-09-12T01:11:33.422242+0000","last_active":"2024-09-12T01:11:33.422327+0000","last_peered":"2024-09-12T01:11:33.422327+0000","last_clean":"2024-09-12T01:11:33.422327+0000","last_became_active":"2024-09-12T00:30:11.105480+0000","last_became_peered":"2024-09-12T00:30:11.105480+0000","last_unstale":"2024-09-12T01:11:33.422327+0000","last_undegraded":"2024-09-12T01:11:33.422327+0000","last_fullsized":"2024-09-12T01:11:33.422327+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T01:11:33.422113+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T01:11:33.422113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.422113+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:29.910170+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029011,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":778,"num_read_kb":27112,"num_write":1220,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'88","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.550819+0000","last_change":"2024-09-12T01:11:40.550819+0000","last_active":"2024-09-12T01:11:40.550819+0000","last_peered":"2024-09-12T01:11:40.550819+0000","last_clean":"2024-09-12T01:11:40.550819+0000","last_became_active":"2024-09-12T00:30:13.130421+0000","last_became_peered":"2024-09-12T00:30:13.130421+0000","last_unstale":"2024-09-12T01:11:40.550819+0000","last_undegraded":"2024-09-12T01:11:40.550819+0000","last_fullsized":"2024-09-12T01:11:40.550819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'88","last_scrub_stamp":"2024-09-12T01:11:40.550737+0000","last_deep_scrub":"264'88","last_deep_scrub_stamp":"2024-09-12T01:11:40.550737+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.550737+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:24.149286+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":312,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'345","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.529883+0000","last_change":"2024-09-12T01:11:34.529826+0000","last_active":"2024-09-12T01:11:34.529883+0000","last_peered":"2024-09-12T01:11:34.529883+0000","last_clean":"2024-09-12T01:11:34.529883+0000","last_became_active":"2024-09-12T00:30:11.092318+0000","last_became_peered":"2024-09-12T00:30:11.092318+0000","last_unstale":"2024-09-12T01:11:34.529883+0000","last_undegraded":"2024-09-12T01:11:34.529883+0000","last_fullsized":"2024-09-12T01:11:34.529883+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T01:11:34.529704+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T01:11:34.529704+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.529704+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:03.024603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287236,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":12148,"num_write":1066,"num_write_kb":57585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'404","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.812921+0000","last_change":"2024-09-12T01:11:54.812921+0000","last_active":"2024-09-12T01:11:54.812921+0000","last_peered":"2024-09-12T01:11:54.812921+0000","last_clean":"2024-09-12T01:11:54.812921+0000","last_became_active":"2024-09-12T00:30:13.126912+0000","last_became_peered":"2024-09-12T00:30:13.126912+0000","last_unstale":"2024-09-12T01:11:54.812921+0000","last_undegraded":"2024-09-12T01:11:54.812921+0000","last_fullsized":"2024-09-12T01:11:54.812921+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'404","last_scrub_stamp":"2024-09-12T01:11:54.812831+0000","last_deep_scrub":"264'404","last_deep_scrub_stamp":"2024-09-12T01:11:54.812831+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.812831+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:55.192863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1731,"num_read_kb":1377,"num_write":679,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'430","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.905125+0000","last_change":"2024-09-12T01:11:42.905031+0000","last_active":"2024-09-12T01:11:42.905125+0000","last_peered":"2024-09-12T01:11:42.905125+0000","last_clean":"2024-09-12T01:11:42.905125+0000","last_became_active":"2024-09-12T00:30:11.099069+0000","last_became_peered":"2024-09-12T00:30:11.099069+0000","last_unstale":"2024-09-12T01:11:42.905125+0000","last_undegraded":"2024-09-12T01:11:42.905125+0000","last_fullsized":"2024-09-12T01:11:42.905125+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-09-12T01:11:42.904875+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-09-12T01:11:42.904875+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.904875+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:17.846461+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380696,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":691,"num_read_kb":70901,"num_write":1282,"num_write_kb":51705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'117","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.327787+0000","last_change":"2024-09-12T01:11:50.327787+0000","last_active":"2024-09-12T01:11:50.327787+0000","last_peered":"2024-09-12T01:11:50.327787+0000","last_clean":"2024-09-12T01:11:50.327787+0000","last_became_active":"2024-09-12T00:30:13.126860+0000","last_became_peered":"2024-09-12T00:30:13.126860+0000","last_unstale":"2024-09-12T01:11:50.327787+0000","last_undegraded":"2024-09-12T01:11:50.327787+0000","last_fullsized":"2024-09-12T01:11:50.327787+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T01:11:50.327702+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T01:11:50.327702+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.327702+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:21.477416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":463,"num_write":200,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'328","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.324364+0000","last_change":"2024-09-12T01:11:38.324299+0000","last_active":"2024-09-12T01:11:38.324364+0000","last_peered":"2024-09-12T01:11:38.324364+0000","last_clean":"2024-09-12T01:11:38.324364+0000","last_became_active":"2024-09-12T00:30:11.105196+0000","last_became_peered":"2024-09-12T00:30:11.105196+0000","last_unstale":"2024-09-12T01:11:38.324364+0000","last_undegraded":"2024-09-12T01:11:38.324364+0000","last_fullsized":"2024-09-12T01:11:38.324364+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'328","last_scrub_stamp":"2024-09-12T01:11:38.324193+0000","last_deep_scrub":"264'328","last_deep_scrub_stamp":"2024-09-12T01:11:38.324193+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.324193+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.266767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":8473,"num_write":1002,"num_write_kb":46203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'4191","reported_seq":4841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.275565+0000","last_change":"2024-09-12T01:11:48.275510+0000","last_active":"2024-09-12T01:11:48.275565+0000","last_peered":"2024-09-12T01:11:48.275565+0000","last_clean":"2024-09-12T01:11:48.275565+0000","last_became_active":"2024-09-12T00:30:13.125353+0000","last_became_peered":"2024-09-12T00:30:13.125353+0000","last_unstale":"2024-09-12T01:11:48.275565+0000","last_undegraded":"2024-09-12T01:11:48.275565+0000","last_fullsized":"2024-09-12T01:11:48.275565+0000","mapping_epoch":28,"log_start":"264'4100","ondisk_log_start":"264'4100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4191","last_scrub_stamp":"2024-09-12T01:11:48.275422+0000","last_deep_scrub":"264'4191","last_deep_scrub_stamp":"2024-09-12T01:11:48.275422+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.275422+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":3000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:02.155433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16885,"num_read_kb":14166,"num_write":6282,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'387","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.090306+0000","last_change":"2024-09-12T01:11:34.090306+0000","last_active":"2024-09-12T01:11:34.090306+0000","last_peered":"2024-09-12T01:11:34.090306+0000","last_clean":"2024-09-12T01:11:34.090306+0000","last_became_active":"2024-09-12T00:30:11.108127+0000","last_became_peered":"2024-09-12T00:30:11.108127+0000","last_unstale":"2024-09-12T01:11:34.090306+0000","last_undegraded":"2024-09-12T01:11:34.090306+0000","last_fullsized":"2024-09-12T01:11:34.090306+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'387","last_scrub_stamp":"2024-09-12T01:11:34.090152+0000","last_deep_scrub":"264'387","last_deep_scrub_stamp":"2024-09-12T01:11:34.090152+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.090152+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.953945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105411,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":473,"num_read_kb":2771,"num_write":1102,"num_write_kb":29841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'185","reported_seq":785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.371411+0000","last_change":"2024-09-12T01:11:41.371298+0000","last_active":"2024-09-12T01:11:41.371411+0000","last_peered":"2024-09-12T01:11:41.371411+0000","last_clean":"2024-09-12T01:11:41.371411+0000","last_became_active":"2024-09-12T00:30:13.129432+0000","last_became_peered":"2024-09-12T00:30:13.129432+0000","last_unstale":"2024-09-12T01:11:41.371411+0000","last_undegraded":"2024-09-12T01:11:41.371411+0000","last_fullsized":"2024-09-12T01:11:41.371411+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T01:11:41.371181+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T01:11:41.371181+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.371181+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:10.754863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":694,"num_write":316,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'364","reported_seq":1080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.098210+0000","last_change":"2024-09-12T01:11:36.098210+0000","last_active":"2024-09-12T01:11:36.098210+0000","last_peered":"2024-09-12T01:11:36.098210+0000","last_clean":"2024-09-12T01:11:36.098210+0000","last_became_active":"2024-09-12T00:30:11.108351+0000","last_became_peered":"2024-09-12T00:30:11.108351+0000","last_unstale":"2024-09-12T01:11:36.098210+0000","last_undegraded":"2024-09-12T01:11:36.098210+0000","last_fullsized":"2024-09-12T01:11:36.098210+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-12T01:11:36.098005+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-12T01:11:36.098005+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.098005+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:33.871781+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648362,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":667,"num_read_kb":30774,"num_write":1247,"num_write_kb":36026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'164","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.102572+0000","last_change":"2024-09-12T01:11:47.102484+0000","last_active":"2024-09-12T01:11:47.102572+0000","last_peered":"2024-09-12T01:11:47.102572+0000","last_clean":"2024-09-12T01:11:47.102572+0000","last_became_active":"2024-09-12T00:30:13.124637+0000","last_became_peered":"2024-09-12T00:30:13.124637+0000","last_unstale":"2024-09-12T01:11:47.102572+0000","last_undegraded":"2024-09-12T01:11:47.102572+0000","last_fullsized":"2024-09-12T01:11:47.102572+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-12T01:11:47.102372+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-12T01:11:47.102372+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.102372+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:35.485046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":588,"num_write":241,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'372","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.386029+0000","last_change":"2024-09-12T01:11:38.386029+0000","last_active":"2024-09-12T01:11:38.386029+0000","last_peered":"2024-09-12T01:11:38.386029+0000","last_clean":"2024-09-12T01:11:38.386029+0000","last_became_active":"2024-09-12T00:30:11.108084+0000","last_became_peered":"2024-09-12T00:30:11.108084+0000","last_unstale":"2024-09-12T01:11:38.386029+0000","last_undegraded":"2024-09-12T01:11:38.386029+0000","last_fullsized":"2024-09-12T01:11:38.386029+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T01:11:38.385902+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T01:11:38.385902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.385902+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:00.631378+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5025600,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":616,"num_read_kb":11433,"num_write":1237,"num_write_kb":28830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'237","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.845480+0000","last_change":"2024-09-12T01:11:36.845384+0000","last_active":"2024-09-12T01:11:36.845480+0000","last_peered":"2024-09-12T01:11:36.845480+0000","last_clean":"2024-09-12T01:11:36.845480+0000","last_became_active":"2024-09-12T00:30:13.128799+0000","last_became_peered":"2024-09-12T00:30:13.128799+0000","last_unstale":"2024-09-12T01:11:36.845480+0000","last_undegraded":"2024-09-12T01:11:36.845480+0000","last_fullsized":"2024-09-12T01:11:36.845480+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-09-12T01:11:36.845275+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-09-12T01:11:36.845275+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.845275+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.874151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":871,"num_write":360,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'352","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.309076+0000","last_change":"2024-09-12T01:11:39.309076+0000","last_active":"2024-09-12T01:11:39.309076+0000","last_peered":"2024-09-12T01:11:39.309076+0000","last_clean":"2024-09-12T01:11:39.309076+0000","last_became_active":"2024-09-12T00:30:11.102617+0000","last_became_peered":"2024-09-12T00:30:11.102617+0000","last_unstale":"2024-09-12T01:11:39.309076+0000","last_undegraded":"2024-09-12T01:11:39.309076+0000","last_fullsized":"2024-09-12T01:11:39.309076+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-12T01:11:39.308936+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-12T01:11:39.308936+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.308936+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:27.572801+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364846,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":18671,"num_write":1023,"num_write_kb":28835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'52","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.555361+0000","last_change":"2024-09-12T01:11:41.555361+0000","last_active":"2024-09-12T01:11:41.555361+0000","last_peered":"2024-09-12T01:11:41.555361+0000","last_clean":"2024-09-12T01:11:41.555361+0000","last_became_active":"2024-09-12T00:30:13.123035+0000","last_became_peered":"2024-09-12T00:30:13.123035+0000","last_unstale":"2024-09-12T01:11:41.555361+0000","last_undegraded":"2024-09-12T01:11:41.555361+0000","last_fullsized":"2024-09-12T01:11:41.555361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T01:11:41.555280+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T01:11:41.555280+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.555280+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:57.286919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":222,"num_write":77,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'336","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.894219+0000","last_change":"2024-09-12T01:11:43.894219+0000","last_active":"2024-09-12T01:11:43.894219+0000","last_peered":"2024-09-12T01:11:43.894219+0000","last_clean":"2024-09-12T01:11:43.894219+0000","last_became_active":"2024-09-12T00:30:11.110299+0000","last_became_peered":"2024-09-12T00:30:11.110299+0000","last_unstale":"2024-09-12T01:11:43.894219+0000","last_undegraded":"2024-09-12T01:11:43.894219+0000","last_fullsized":"2024-09-12T01:11:43.894219+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-12T01:11:43.894098+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-12T01:11:43.894098+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.894098+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:37.338640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":443,"num_read_kb":30015,"num_write":1046,"num_write_kb":30187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'180","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.406375+0000","last_change":"2024-09-12T01:11:39.406375+0000","last_active":"2024-09-12T01:11:39.406375+0000","last_peered":"2024-09-12T01:11:39.406375+0000","last_clean":"2024-09-12T01:11:39.406375+0000","last_became_active":"2024-09-12T00:30:13.123217+0000","last_became_peered":"2024-09-12T00:30:13.123217+0000","last_unstale":"2024-09-12T01:11:39.406375+0000","last_undegraded":"2024-09-12T01:11:39.406375+0000","last_fullsized":"2024-09-12T01:11:39.406375+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T01:11:39.406291+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T01:11:39.406291+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.406291+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.832105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":608,"num_write":257,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'316","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.267042+0000","last_change":"2024-09-12T01:11:40.267042+0000","last_active":"2024-09-12T01:11:40.267042+0000","last_peered":"2024-09-12T01:11:40.267042+0000","last_clean":"2024-09-12T01:11:40.267042+0000","last_became_active":"2024-09-12T00:30:11.102436+0000","last_became_peered":"2024-09-12T00:30:11.102436+0000","last_unstale":"2024-09-12T01:11:40.267042+0000","last_undegraded":"2024-09-12T01:11:40.267042+0000","last_fullsized":"2024-09-12T01:11:40.267042+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T01:11:40.266922+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T01:11:40.266922+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.266922+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:22.297560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315002,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":79108,"num_write":1106,"num_write_kb":40469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'217","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.366851+0000","last_change":"2024-09-12T01:11:51.366851+0000","last_active":"2024-09-12T01:11:51.366851+0000","last_peered":"2024-09-12T01:11:51.366851+0000","last_clean":"2024-09-12T01:11:51.366851+0000","last_became_active":"2024-09-12T00:30:13.129733+0000","last_became_peered":"2024-09-12T00:30:13.129733+0000","last_unstale":"2024-09-12T01:11:51.366851+0000","last_undegraded":"2024-09-12T01:11:51.366851+0000","last_fullsized":"2024-09-12T01:11:51.366851+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'217","last_scrub_stamp":"2024-09-12T01:11:51.366771+0000","last_deep_scrub":"264'217","last_deep_scrub_stamp":"2024-09-12T01:11:51.366771+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.366771+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:43.523061+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":953,"num_read_kb":786,"num_write":335,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'382","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.875020+0000","last_change":"2024-09-12T01:11:35.875020+0000","last_active":"2024-09-12T01:11:35.875020+0000","last_peered":"2024-09-12T01:11:35.875020+0000","last_clean":"2024-09-12T01:11:35.875020+0000","last_became_active":"2024-09-12T00:30:11.105950+0000","last_became_peered":"2024-09-12T00:30:11.105950+0000","last_unstale":"2024-09-12T01:11:35.875020+0000","last_undegraded":"2024-09-12T01:11:35.875020+0000","last_fullsized":"2024-09-12T01:11:35.875020+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-12T01:11:35.874867+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-12T01:11:35.874867+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.874867+0000","objects_scrubbed":12,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:15.332168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4299828,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":589,"num_read_kb":20762,"num_write":1342,"num_write_kb":32414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'173","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.878947+0000","last_change":"2024-09-12T01:11:40.878947+0000","last_active":"2024-09-12T01:11:40.878947+0000","last_peered":"2024-09-12T01:11:40.878947+0000","last_clean":"2024-09-12T01:11:40.878947+0000","last_became_active":"2024-09-12T00:30:13.128009+0000","last_became_peered":"2024-09-12T00:30:13.128009+0000","last_unstale":"2024-09-12T01:11:40.878947+0000","last_undegraded":"2024-09-12T01:11:40.878947+0000","last_fullsized":"2024-09-12T01:11:40.878947+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-12T01:11:40.878859+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-12T01:11:40.878859+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.878859+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:39.949418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":738,"num_read_kb":604,"num_write":258,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'395","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.263014+0000","last_change":"2024-09-12T01:11:38.263014+0000","last_active":"2024-09-12T01:11:38.263014+0000","last_peered":"2024-09-12T01:11:38.263014+0000","last_clean":"2024-09-12T01:11:38.263014+0000","last_became_active":"2024-09-12T00:30:11.096908+0000","last_became_peered":"2024-09-12T00:30:11.096908+0000","last_unstale":"2024-09-12T01:11:38.263014+0000","last_undegraded":"2024-09-12T01:11:38.263014+0000","last_fullsized":"2024-09-12T01:11:38.263014+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-12T01:11:38.262881+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-12T01:11:38.262881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.262881+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:54.179820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":27824,"num_write":1325,"num_write_kb":35997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'130","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.865328+0000","last_change":"2024-09-12T01:11:38.865328+0000","last_active":"2024-09-12T01:11:38.865328+0000","last_peered":"2024-09-12T01:11:38.865328+0000","last_clean":"2024-09-12T01:11:38.865328+0000","last_became_active":"2024-09-12T00:30:13.126817+0000","last_became_peered":"2024-09-12T00:30:13.126817+0000","last_unstale":"2024-09-12T01:11:38.865328+0000","last_undegraded":"2024-09-12T01:11:38.865328+0000","last_fullsized":"2024-09-12T01:11:38.865328+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T01:11:38.865238+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T01:11:38.865238+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.865238+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:46.059324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":588,"num_read_kb":486,"num_write":195,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'337","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.427130+0000","last_change":"2024-09-12T01:11:30.427130+0000","last_active":"2024-09-12T01:11:30.427130+0000","last_peered":"2024-09-12T01:11:30.427130+0000","last_clean":"2024-09-12T01:11:30.427130+0000","last_became_active":"2024-09-12T00:30:11.105575+0000","last_became_peered":"2024-09-12T00:30:11.105575+0000","last_unstale":"2024-09-12T01:11:30.427130+0000","last_undegraded":"2024-09-12T01:11:30.427130+0000","last_fullsized":"2024-09-12T01:11:30.427130+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T01:11:30.427034+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T01:11:30.427034+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.427034+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:04.883192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":45130,"num_write":1156,"num_write_kb":46621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'202","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.577784+0000","last_change":"2024-09-12T01:11:42.577784+0000","last_active":"2024-09-12T01:11:42.577784+0000","last_peered":"2024-09-12T01:11:42.577784+0000","last_clean":"2024-09-12T01:11:42.577784+0000","last_became_active":"2024-09-12T00:30:13.129092+0000","last_became_peered":"2024-09-12T00:30:13.129092+0000","last_unstale":"2024-09-12T01:11:42.577784+0000","last_undegraded":"2024-09-12T01:11:42.577784+0000","last_fullsized":"2024-09-12T01:11:42.577784+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T01:11:42.577693+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T01:11:42.577693+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.577693+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:29.344845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":854,"num_read_kb":707,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'347","reported_seq":1195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.846455+0000","last_change":"2024-09-12T01:11:44.846455+0000","last_active":"2024-09-12T01:11:44.846455+0000","last_peered":"2024-09-12T01:11:44.846455+0000","last_clean":"2024-09-12T01:11:44.846455+0000","last_became_active":"2024-09-12T00:30:11.108616+0000","last_became_peered":"2024-09-12T00:30:11.108616+0000","last_unstale":"2024-09-12T01:11:44.846455+0000","last_undegraded":"2024-09-12T01:11:44.846455+0000","last_fullsized":"2024-09-12T01:11:44.846455+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:44.846295+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:44.846295+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.846295+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:52.600725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":955,"num_read_kb":21858,"num_write":1152,"num_write_kb":27958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'147","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.265816+0000","last_change":"2024-09-12T01:11:44.265816+0000","last_active":"2024-09-12T01:11:44.265816+0000","last_peered":"2024-09-12T01:11:44.265816+0000","last_clean":"2024-09-12T01:11:44.265816+0000","last_became_active":"2024-09-12T00:30:13.125887+0000","last_became_peered":"2024-09-12T00:30:13.125887+0000","last_unstale":"2024-09-12T01:11:44.265816+0000","last_undegraded":"2024-09-12T01:11:44.265816+0000","last_fullsized":"2024-09-12T01:11:44.265816+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T01:11:44.265735+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T01:11:44.265735+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.265735+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:34.728050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":559,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'335","reported_seq":1012,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.555016+0000","last_change":"2024-09-12T01:11:36.555016+0000","last_active":"2024-09-12T01:11:36.555016+0000","last_peered":"2024-09-12T01:11:36.555016+0000","last_clean":"2024-09-12T01:11:36.555016+0000","last_became_active":"2024-09-12T00:30:46.396288+0000","last_became_peered":"2024-09-12T00:30:46.396288+0000","last_unstale":"2024-09-12T01:11:36.555016+0000","last_undegraded":"2024-09-12T01:11:36.555016+0000","last_fullsized":"2024-09-12T01:11:36.555016+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T01:11:36.554891+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T01:11:36.554891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.554891+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:31.851264+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8687076,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":21015,"num_write":1060,"num_write_kb":30668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'251","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.851278+0000","last_change":"2024-09-12T01:11:37.851278+0000","last_active":"2024-09-12T01:11:37.851278+0000","last_peered":"2024-09-12T01:11:37.851278+0000","last_clean":"2024-09-12T01:11:37.851278+0000","last_became_active":"2024-09-12T00:30:13.127513+0000","last_became_peered":"2024-09-12T00:30:13.127513+0000","last_unstale":"2024-09-12T01:11:37.851278+0000","last_undegraded":"2024-09-12T01:11:37.851278+0000","last_fullsized":"2024-09-12T01:11:37.851278+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T01:11:37.851124+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T01:11:37.851124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.851124+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:02.058983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":791,"num_write":358,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8300,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'328","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.825992+0000","last_change":"2024-09-12T01:11:48.825992+0000","last_active":"2024-09-12T01:11:48.825992+0000","last_peered":"2024-09-12T01:11:48.825992+0000","last_clean":"2024-09-12T01:11:48.825992+0000","last_became_active":"2024-09-12T00:30:11.109661+0000","last_became_peered":"2024-09-12T00:30:11.109661+0000","last_unstale":"2024-09-12T01:11:48.825992+0000","last_undegraded":"2024-09-12T01:11:48.825992+0000","last_fullsized":"2024-09-12T01:11:48.825992+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'328","last_scrub_stamp":"2024-09-12T01:11:48.825791+0000","last_deep_scrub":"264'328","last_deep_scrub_stamp":"2024-09-12T01:11:48.825791+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.825791+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:02.017430+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":8210,"num_write":1080,"num_write_kb":36173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'315","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.811270+0000","last_change":"2024-09-12T01:11:45.811270+0000","last_active":"2024-09-12T01:11:45.811270+0000","last_peered":"2024-09-12T01:11:45.811270+0000","last_clean":"2024-09-12T01:11:45.811270+0000","last_became_active":"2024-09-12T00:30:11.113173+0000","last_became_peered":"2024-09-12T00:30:11.113173+0000","last_unstale":"2024-09-12T01:11:45.811270+0000","last_undegraded":"2024-09-12T01:11:45.811270+0000","last_fullsized":"2024-09-12T01:11:45.811270+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T01:11:45.811155+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T01:11:45.811155+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.811155+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:57.504861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":50214,"num_write":1057,"num_write_kb":47204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'24","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.282085+0000","last_change":"2024-09-12T01:11:45.282085+0000","last_active":"2024-09-12T01:11:45.282085+0000","last_peered":"2024-09-12T01:11:45.282085+0000","last_clean":"2024-09-12T01:11:45.282085+0000","last_became_active":"2024-09-12T00:30:13.126264+0000","last_became_peered":"2024-09-12T00:30:13.126264+0000","last_unstale":"2024-09-12T01:11:45.282085+0000","last_undegraded":"2024-09-12T01:11:45.282085+0000","last_fullsized":"2024-09-12T01:11:45.282085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T01:11:45.281991+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T01:11:45.281991+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.281991+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:59.791991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":113,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'377","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.282638+0000","last_change":"2024-09-12T01:11:41.282638+0000","last_active":"2024-09-12T01:11:41.282638+0000","last_peered":"2024-09-12T01:11:41.282638+0000","last_clean":"2024-09-12T01:11:41.282638+0000","last_became_active":"2024-09-12T00:30:11.102026+0000","last_became_peered":"2024-09-12T00:30:11.102026+0000","last_unstale":"2024-09-12T01:11:41.282638+0000","last_undegraded":"2024-09-12T01:11:41.282638+0000","last_fullsized":"2024-09-12T01:11:41.282638+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-12T01:11:41.282464+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-12T01:11:41.282464+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.282464+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:04.065353+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4360630,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":672,"num_read_kb":9482,"num_write":1213,"num_write_kb":28977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'250","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.895038+0000","last_change":"2024-09-12T01:11:42.895038+0000","last_active":"2024-09-12T01:11:42.895038+0000","last_peered":"2024-09-12T01:11:42.895038+0000","last_clean":"2024-09-12T01:11:42.895038+0000","last_became_active":"2024-09-12T00:30:13.119872+0000","last_became_peered":"2024-09-12T00:30:13.119872+0000","last_unstale":"2024-09-12T01:11:42.895038+0000","last_undegraded":"2024-09-12T01:11:42.895038+0000","last_fullsized":"2024-09-12T01:11:42.895038+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-12T01:11:42.894943+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-12T01:11:42.894943+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.894943+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.400595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":987,"num_write":428,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5946,"num_read_kb":4236,"num_write":1962,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3976,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1034,"ondisk_log_size":1034,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15005,"num_read_kb":14670,"num_write":16786,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1629,"ondisk_log_size":1629,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":684,"ondisk_log_size":684,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548725,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17648,"num_read_kb":36949,"num_write":14701,"num_write_kb":11551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686502,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1727,"ondisk_log_size":1727,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102018,"num_read_kb":85254,"num_write":36979,"num_write_kb":18604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44076,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4245,"ondisk_log_size":4245,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":166688013,"num_objects":400,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":400,"num_whiteouts":0,"num_read":36140,"num_read_kb":1917452,"num_write":72064,"num_write_kb":2191736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":224706560,"data_stored":224706560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3667,"ondisk_log_size":3667,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170064,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168795,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509955,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264752,"kb_used_data":35040,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94107088,"statfs":{"total":96636764160,"available":96365658112,"internally_reserved":0,"allocated":35880960,"data_stored":33872164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509952,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341752,"kb_used_data":31528,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94030088,"statfs":{"total":96636764160,"available":96286810112,"internally_reserved":0,"allocated":32284672,"data_stored":30297333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509952,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156088,"kb_used_data":34728,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94215752,"statfs":{"total":96636764160,"available":96476930048,"internally_reserved":0,"allocated":35561472,"data_stored":33552270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542657,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252368,"kb_used_data":32448,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94119472,"statfs":{"total":96636764160,"available":96378339328,"internally_reserved":0,"allocated":33226752,"data_stored":31260225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542656,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151548,"kb_used_data":21868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94220292,"statfs":{"total":96636764160,"available":96481579008,"internally_reserved":0,"allocated":22392832,"data_stored":20398857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542654,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289684,"kb_used_data":33604,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94082156,"statfs":{"total":96636764160,"available":96340127744,"internally_reserved":0,"allocated":34410496,"data_stored":32405240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262207941},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542657,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251100,"kb_used_data":31180,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94120740,"statfs":{"total":96636764160,"available":96379637760,"internally_reserved":0,"allocated":31928320,"data_stored":29931227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225180101},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575361,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172604,"kb_used_data":33132,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94199236,"statfs":{"total":96636764160,"available":96460017664,"internally_reserved":0,"allocated":33927168,"data_stored":31936990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31330304,"data_stored":31330304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27488256,"data_stored":27488256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29716480,"data_stored":29716480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31649792,"data_stored":31649792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":27709440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29593600,"data_stored":29593600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18178048,"data_stored":18178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29040640,"data_stored":29040640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:12:13.635 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.636 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.636 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.636 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.636 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.636 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.636 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.636 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.636 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.637 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.637 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.637 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.637 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.637 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.637 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.637 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.637 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.638 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.638 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.638 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.638 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.638 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.638 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.638 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.638 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.639 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.639 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.639 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.639 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.639 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.639 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.639 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.639 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.640 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.640 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.640 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.640 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.640 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.640 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.640 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.640 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.641 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.641 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.641 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.641 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.641 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.641 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.641 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.641 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.642 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.642 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.642 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.642 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.642 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.642 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.642 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.642 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.643 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.643 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.643 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.643 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.643 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.643 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.643 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.643 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.644 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.644 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.644 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.644 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.644 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.644 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.644 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.644 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.644 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.645 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.645 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:44:36.788585+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=44, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.645 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.645 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.646 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.647 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.647 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.647 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.648 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.648 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.648 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.648 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.648 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.648 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:30:18.137404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.649 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:30:20.159134+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:13.649 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:12:33.650 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:12:33.985 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:12:33.998 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T01:12:34.001 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":1537,"stamp":"2024-09-12T01:12:32.262489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":168845237,"num_objects":756,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":179589,"num_read_kb":2400386,"num_write":143007,"num_write_kb":2482898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740116,"num_omap_keys":1789,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13374,"ondisk_log_size":13374,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1879896,"kb_used_data":253528,"kb_used_omap":12,"kb_used_meta":1626227,"kb_avail":753094824,"statfs":{"total":773094113280,"available":771169099776,"internally_reserved":0,"allocated":259612672,"data_stored":243654306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1665257010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":5,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005612"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.170470+0000","last_change":"2024-09-12T01:12:06.170470+0000","last_active":"2024-09-12T01:12:06.170470+0000","last_peered":"2024-09-12T01:12:06.170470+0000","last_clean":"2024-09-12T01:12:06.170470+0000","last_became_active":"2024-09-12T00:56:52.990975+0000","last_became_peered":"2024-09-12T00:56:52.990975+0000","last_unstale":"2024-09-12T01:12:06.170470+0000","last_undegraded":"2024-09-12T01:12:06.170470+0000","last_fullsized":"2024-09-12T01:12:06.170470+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:06.170381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:06.170381+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.170381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:41.174560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.769515+0000","last_change":"2024-09-12T01:12:05.769515+0000","last_active":"2024-09-12T01:12:05.769515+0000","last_peered":"2024-09-12T01:12:05.769515+0000","last_clean":"2024-09-12T01:12:05.769515+0000","last_became_active":"2024-09-12T00:46:19.284774+0000","last_became_peered":"2024-09-12T00:46:19.284774+0000","last_unstale":"2024-09-12T01:12:05.769515+0000","last_undegraded":"2024-09-12T01:12:05.769515+0000","last_fullsized":"2024-09-12T01:12:05.769515+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:05.769422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:05.769422+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.769422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.065734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.701914+0000","last_change":"2024-09-12T01:12:09.701914+0000","last_active":"2024-09-12T01:12:09.701914+0000","last_peered":"2024-09-12T01:12:09.701914+0000","last_clean":"2024-09-12T01:12:09.701914+0000","last_became_active":"2024-09-12T00:46:16.275529+0000","last_became_peered":"2024-09-12T00:46:16.275529+0000","last_unstale":"2024-09-12T01:12:09.701914+0000","last_undegraded":"2024-09-12T01:12:09.701914+0000","last_fullsized":"2024-09-12T01:12:09.701914+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:09.701827+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:09.701827+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.701827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:25.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'24","reported_seq":113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.374392+0000","last_change":"2024-09-12T01:12:12.374392+0000","last_active":"2024-09-12T01:12:12.374392+0000","last_peered":"2024-09-12T01:12:12.374392+0000","last_clean":"2024-09-12T01:12:12.374392+0000","last_became_active":"2024-09-12T00:44:37.816192+0000","last_became_peered":"2024-09-12T00:44:37.816192+0000","last_unstale":"2024-09-12T01:12:12.374392+0000","last_undegraded":"2024-09-12T01:12:12.374392+0000","last_fullsized":"2024-09-12T01:12:12.374392+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T01:12:12.374286+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T01:12:12.374286+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.374286+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:01.125236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.181807+0000","last_change":"2024-09-12T01:12:13.181807+0000","last_active":"2024-09-12T01:12:13.181807+0000","last_peered":"2024-09-12T01:12:13.181807+0000","last_clean":"2024-09-12T01:12:13.181807+0000","last_became_active":"2024-09-12T00:56:52.995871+0000","last_became_peered":"2024-09-12T00:56:52.995871+0000","last_unstale":"2024-09-12T01:12:13.181807+0000","last_undegraded":"2024-09-12T01:12:13.181807+0000","last_fullsized":"2024-09-12T01:12:13.181807+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:13.181727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:13.181727+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.181727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:06.840656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.308551+0000","last_change":"2024-09-12T01:12:11.308551+0000","last_active":"2024-09-12T01:12:11.308551+0000","last_peered":"2024-09-12T01:12:11.308551+0000","last_clean":"2024-09-12T01:12:11.308551+0000","last_became_active":"2024-09-12T00:46:19.284875+0000","last_became_peered":"2024-09-12T00:46:19.284875+0000","last_unstale":"2024-09-12T01:12:11.308551+0000","last_undegraded":"2024-09-12T01:12:11.308551+0000","last_fullsized":"2024-09-12T01:12:11.308551+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:11.308438+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:11.308438+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.308438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:14.759811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.329419+0000","last_change":"2024-09-12T01:12:16.329419+0000","last_active":"2024-09-12T01:12:16.329419+0000","last_peered":"2024-09-12T01:12:16.329419+0000","last_clean":"2024-09-12T01:12:16.329419+0000","last_became_active":"2024-09-12T00:46:16.275381+0000","last_became_peered":"2024-09-12T00:46:16.275381+0000","last_unstale":"2024-09-12T01:12:16.329419+0000","last_undegraded":"2024-09-12T01:12:16.329419+0000","last_fullsized":"2024-09-12T01:12:16.329419+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:16.329306+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:16.329306+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.329306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:09.457138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'45","reported_seq":174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.403911+0000","last_change":"2024-09-12T01:12:11.403911+0000","last_active":"2024-09-12T01:12:11.403911+0000","last_peered":"2024-09-12T01:12:11.403911+0000","last_clean":"2024-09-12T01:12:11.403911+0000","last_became_active":"2024-09-12T00:44:37.819561+0000","last_became_peered":"2024-09-12T00:44:37.819561+0000","last_unstale":"2024-09-12T01:12:11.403911+0000","last_undegraded":"2024-09-12T01:12:11.403911+0000","last_fullsized":"2024-09-12T01:12:11.403911+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-12T01:12:11.403816+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-12T01:12:11.403816+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.403816+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:43.010940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":164,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.722507+0000","last_change":"2024-09-12T01:12:09.722507+0000","last_active":"2024-09-12T01:12:09.722507+0000","last_peered":"2024-09-12T01:12:09.722507+0000","last_clean":"2024-09-12T01:12:09.722507+0000","last_became_active":"2024-09-12T00:56:52.990364+0000","last_became_peered":"2024-09-12T00:56:52.990364+0000","last_unstale":"2024-09-12T01:12:09.722507+0000","last_undegraded":"2024-09-12T01:12:09.722507+0000","last_fullsized":"2024-09-12T01:12:09.722507+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:09.722421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:09.722421+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.722421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:36.374184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:23.317087+0000","last_change":"2024-09-12T01:12:23.317087+0000","last_active":"2024-09-12T01:12:23.317087+0000","last_peered":"2024-09-12T01:12:23.317087+0000","last_clean":"2024-09-12T01:12:23.317087+0000","last_became_active":"2024-09-12T00:46:19.285357+0000","last_became_peered":"2024-09-12T00:46:19.285357+0000","last_unstale":"2024-09-12T01:12:23.317087+0000","last_undegraded":"2024-09-12T01:12:23.317087+0000","last_fullsized":"2024-09-12T01:12:23.317087+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:23.316988+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:23.316988+0000","last_clean_scrub_stamp":"2024-09-12T01:12:23.316988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:48.416105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'7","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.684480+0000","last_change":"2024-09-12T01:12:11.684417+0000","last_active":"2024-09-12T01:12:11.684480+0000","last_peered":"2024-09-12T01:12:11.684480+0000","last_clean":"2024-09-12T01:12:11.684480+0000","last_became_active":"2024-09-12T00:46:16.278221+0000","last_became_peered":"2024-09-12T00:46:16.278221+0000","last_unstale":"2024-09-12T01:12:11.684480+0000","last_undegraded":"2024-09-12T01:12:11.684480+0000","last_fullsized":"2024-09-12T01:12:11.684480+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T01:12:11.684324+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T01:12:11.684324+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.684324+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:38.819437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5130,"num_write":12,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'37","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.289433+0000","last_change":"2024-09-12T01:12:07.289367+0000","last_active":"2024-09-12T01:12:07.289433+0000","last_peered":"2024-09-12T01:12:07.289433+0000","last_clean":"2024-09-12T01:12:07.289433+0000","last_became_active":"2024-09-12T00:44:37.818239+0000","last_became_peered":"2024-09-12T00:44:37.818239+0000","last_unstale":"2024-09-12T01:12:07.289433+0000","last_undegraded":"2024-09-12T01:12:07.289433+0000","last_fullsized":"2024-09-12T01:12:07.289433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-12T01:12:07.289241+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-12T01:12:07.289241+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.289241+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.374834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":144,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:02.480542+0000","last_change":"2024-09-12T00:56:52.995412+0000","last_active":"2024-09-12T01:09:02.480542+0000","last_peered":"2024-09-12T01:09:02.480542+0000","last_clean":"2024-09-12T01:09:02.480542+0000","last_became_active":"2024-09-12T00:56:52.995062+0000","last_became_peered":"2024-09-12T00:56:52.995062+0000","last_unstale":"2024-09-12T01:09:02.480542+0000","last_undegraded":"2024-09-12T01:09:02.480542+0000","last_fullsized":"2024-09-12T01:09:02.480542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.136639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:21.320448+0000","last_change":"2024-09-12T01:12:21.320393+0000","last_active":"2024-09-12T01:12:21.320448+0000","last_peered":"2024-09-12T01:12:21.320448+0000","last_clean":"2024-09-12T01:12:21.320448+0000","last_became_active":"2024-09-12T00:46:19.284822+0000","last_became_peered":"2024-09-12T00:46:19.284822+0000","last_unstale":"2024-09-12T01:12:21.320448+0000","last_undegraded":"2024-09-12T01:12:21.320448+0000","last_fullsized":"2024-09-12T01:12:21.320448+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:21.320302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:21.320302+0000","last_clean_scrub_stamp":"2024-09-12T01:12:21.320302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:15.381180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.723081+0000","last_change":"2024-09-12T01:12:03.723081+0000","last_active":"2024-09-12T01:12:03.723081+0000","last_peered":"2024-09-12T01:12:03.723081+0000","last_clean":"2024-09-12T01:12:03.723081+0000","last_became_active":"2024-09-12T00:46:16.261617+0000","last_became_peered":"2024-09-12T00:46:16.261617+0000","last_unstale":"2024-09-12T01:12:03.723081+0000","last_undegraded":"2024-09-12T01:12:03.723081+0000","last_fullsized":"2024-09-12T01:12:03.723081+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.722994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.722994+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.722994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:14.319282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.282013+0000","last_change":"2024-09-12T01:12:05.281948+0000","last_active":"2024-09-12T01:12:05.282013+0000","last_peered":"2024-09-12T01:12:05.282013+0000","last_clean":"2024-09-12T01:12:05.282013+0000","last_became_active":"2024-09-12T00:44:37.815325+0000","last_became_peered":"2024-09-12T00:44:37.815325+0000","last_unstale":"2024-09-12T01:12:05.282013+0000","last_undegraded":"2024-09-12T01:12:05.282013+0000","last_fullsized":"2024-09-12T01:12:05.282013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-09-12T01:12:05.281862+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-09-12T01:12:05.281862+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.281862+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:45.941101+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":218,"num_write":105,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.906169+0000","last_change":"2024-09-12T01:12:20.906169+0000","last_active":"2024-09-12T01:12:20.906169+0000","last_peered":"2024-09-12T01:12:20.906169+0000","last_clean":"2024-09-12T01:12:20.906169+0000","last_became_active":"2024-09-12T00:56:52.991358+0000","last_became_peered":"2024-09-12T00:56:52.991358+0000","last_unstale":"2024-09-12T01:12:20.906169+0000","last_undegraded":"2024-09-12T01:12:20.906169+0000","last_fullsized":"2024-09-12T01:12:20.906169+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:20.906083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:20.906083+0000","last_clean_scrub_stamp":"2024-09-12T01:12:20.906083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:27.465640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.180629+0000","last_change":"2024-09-12T01:12:02.180629+0000","last_active":"2024-09-12T01:12:02.180629+0000","last_peered":"2024-09-12T01:12:02.180629+0000","last_clean":"2024-09-12T01:12:02.180629+0000","last_became_active":"2024-09-12T00:46:19.274024+0000","last_became_peered":"2024-09-12T00:46:19.274024+0000","last_unstale":"2024-09-12T01:12:02.180629+0000","last_undegraded":"2024-09-12T01:12:02.180629+0000","last_fullsized":"2024-09-12T01:12:02.180629+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T01:12:02.180532+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T01:12:02.180532+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.180532+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:47.568862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.412294+0000","last_change":"2024-09-12T01:12:13.412294+0000","last_active":"2024-09-12T01:12:13.412294+0000","last_peered":"2024-09-12T01:12:13.412294+0000","last_clean":"2024-09-12T01:12:13.412294+0000","last_became_active":"2024-09-12T00:46:16.272230+0000","last_became_peered":"2024-09-12T00:46:16.272230+0000","last_unstale":"2024-09-12T01:12:13.412294+0000","last_undegraded":"2024-09-12T01:12:13.412294+0000","last_fullsized":"2024-09-12T01:12:13.412294+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:13.412197+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:13.412197+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.412197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:24.318645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'26","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.249035+0000","last_change":"2024-09-12T01:12:04.248958+0000","last_active":"2024-09-12T01:12:04.249035+0000","last_peered":"2024-09-12T01:12:04.249035+0000","last_clean":"2024-09-12T01:12:04.249035+0000","last_became_active":"2024-09-12T00:44:37.821297+0000","last_became_peered":"2024-09-12T00:44:37.821297+0000","last_unstale":"2024-09-12T01:12:04.249035+0000","last_undegraded":"2024-09-12T01:12:04.249035+0000","last_fullsized":"2024-09-12T01:12:04.249035+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T01:12:04.248875+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T01:12:04.248875+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.248875+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:52.200263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:17.340421+0000","last_change":"2024-09-12T01:12:17.340421+0000","last_active":"2024-09-12T01:12:17.340421+0000","last_peered":"2024-09-12T01:12:17.340421+0000","last_clean":"2024-09-12T01:12:17.340421+0000","last_became_active":"2024-09-12T00:56:52.990528+0000","last_became_peered":"2024-09-12T00:56:52.990528+0000","last_unstale":"2024-09-12T01:12:17.340421+0000","last_undegraded":"2024-09-12T01:12:17.340421+0000","last_fullsized":"2024-09-12T01:12:17.340421+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:17.340334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:17.340334+0000","last_clean_scrub_stamp":"2024-09-12T01:12:17.340334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:02.095576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.597263+0000","last_change":"2024-09-12T00:46:19.281162+0000","last_active":"2024-09-12T01:11:23.597263+0000","last_peered":"2024-09-12T01:11:23.597263+0000","last_clean":"2024-09-12T01:11:23.597263+0000","last_became_active":"2024-09-12T00:46:19.280794+0000","last_became_peered":"2024-09-12T00:46:19.280794+0000","last_unstale":"2024-09-12T01:11:23.597263+0000","last_undegraded":"2024-09-12T01:11:23.597263+0000","last_fullsized":"2024-09-12T01:11:23.597263+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:50.182755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12296,"num_write":8,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.736721+0000","last_change":"2024-09-12T00:46:16.267841+0000","last_active":"2024-09-12T01:11:23.736721+0000","last_peered":"2024-09-12T01:11:23.736721+0000","last_clean":"2024-09-12T01:11:23.736721+0000","last_became_active":"2024-09-12T00:46:16.267528+0000","last_became_peered":"2024-09-12T00:46:16.267528+0000","last_unstale":"2024-09-12T01:11:23.736721+0000","last_undegraded":"2024-09-12T01:11:23.736721+0000","last_fullsized":"2024-09-12T01:11:23.736721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.756924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8204,"num_write":6,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'129","reported_seq":440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.333689+0000","last_change":"2024-09-12T01:12:05.333607+0000","last_active":"2024-09-12T01:12:05.333689+0000","last_peered":"2024-09-12T01:12:05.333689+0000","last_clean":"2024-09-12T01:12:05.333689+0000","last_became_active":"2024-09-12T00:44:37.819556+0000","last_became_peered":"2024-09-12T00:44:37.819556+0000","last_unstale":"2024-09-12T01:12:05.333689+0000","last_undegraded":"2024-09-12T01:12:05.333689+0000","last_fullsized":"2024-09-12T01:12:05.333689+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T01:12:05.333523+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T01:12:05.333523+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.333523+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:59.312207+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":767,"num_read_kb":571,"num_write":157,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3976,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.209667+0000","last_change":"2024-09-12T01:12:14.209667+0000","last_active":"2024-09-12T01:12:14.209667+0000","last_peered":"2024-09-12T01:12:14.209667+0000","last_clean":"2024-09-12T01:12:14.209667+0000","last_became_active":"2024-09-12T00:56:52.992081+0000","last_became_peered":"2024-09-12T00:56:52.992081+0000","last_unstale":"2024-09-12T01:12:14.209667+0000","last_undegraded":"2024-09-12T01:12:14.209667+0000","last_fullsized":"2024-09-12T01:12:14.209667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:14.209594+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:14.209594+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.209594+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:47.869607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'7","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.305081+0000","last_change":"2024-09-12T01:12:10.305081+0000","last_active":"2024-09-12T01:12:10.305081+0000","last_peered":"2024-09-12T01:12:10.305081+0000","last_clean":"2024-09-12T01:12:10.305081+0000","last_became_active":"2024-09-12T00:46:19.279811+0000","last_became_peered":"2024-09-12T00:46:19.279811+0000","last_unstale":"2024-09-12T01:12:10.305081+0000","last_undegraded":"2024-09-12T01:12:10.305081+0000","last_fullsized":"2024-09-12T01:12:10.305081+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T01:12:10.304983+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T01:12:10.304983+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.304983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:26.397813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13308,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'5","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.252593+0000","last_change":"2024-09-12T01:11:59.252593+0000","last_active":"2024-09-12T01:11:59.252593+0000","last_peered":"2024-09-12T01:11:59.252593+0000","last_clean":"2024-09-12T01:11:59.252593+0000","last_became_active":"2024-09-12T00:46:16.274541+0000","last_became_peered":"2024-09-12T00:46:16.274541+0000","last_unstale":"2024-09-12T01:11:59.252593+0000","last_undegraded":"2024-09-12T01:11:59.252593+0000","last_fullsized":"2024-09-12T01:11:59.252593+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:11:59.252508+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:11:59.252508+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.252508+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'13","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.644506+0000","last_change":"2024-09-12T01:12:03.644506+0000","last_active":"2024-09-12T01:12:03.644506+0000","last_peered":"2024-09-12T01:12:03.644506+0000","last_clean":"2024-09-12T01:12:03.644506+0000","last_became_active":"2024-09-12T00:44:37.817108+0000","last_became_peered":"2024-09-12T00:44:37.817108+0000","last_unstale":"2024-09-12T01:12:03.644506+0000","last_undegraded":"2024-09-12T01:12:03.644506+0000","last_fullsized":"2024-09-12T01:12:03.644506+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T01:12:03.644413+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T01:12:03.644413+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.644413+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:31.680128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.177483+0000","last_change":"2024-09-12T01:12:09.177483+0000","last_active":"2024-09-12T01:12:09.177483+0000","last_peered":"2024-09-12T01:12:09.177483+0000","last_clean":"2024-09-12T01:12:09.177483+0000","last_became_active":"2024-09-12T00:56:52.989394+0000","last_became_peered":"2024-09-12T00:56:52.989394+0000","last_unstale":"2024-09-12T01:12:09.177483+0000","last_undegraded":"2024-09-12T01:12:09.177483+0000","last_fullsized":"2024-09-12T01:12:09.177483+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:09.177399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:09.177399+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.177399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:50.094753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"264'7","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.820474+0000","last_change":"2024-09-12T01:12:15.820474+0000","last_active":"2024-09-12T01:12:15.820474+0000","last_peered":"2024-09-12T01:12:15.820474+0000","last_clean":"2024-09-12T01:12:15.820474+0000","last_became_active":"2024-09-12T00:46:19.280878+0000","last_became_peered":"2024-09-12T00:46:19.280878+0000","last_unstale":"2024-09-12T01:12:15.820474+0000","last_undegraded":"2024-09-12T01:12:15.820474+0000","last_fullsized":"2024-09-12T01:12:15.820474+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T01:12:15.820387+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T01:12:15.820387+0000","last_clean_scrub_stamp":"2024-09-12T01:12:15.820387+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:04.395673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.223001+0000","last_change":"2024-09-12T01:12:09.223001+0000","last_active":"2024-09-12T01:12:09.223001+0000","last_peered":"2024-09-12T01:12:09.223001+0000","last_clean":"2024-09-12T01:12:09.223001+0000","last_became_active":"2024-09-12T00:46:16.277776+0000","last_became_peered":"2024-09-12T00:46:16.277776+0000","last_unstale":"2024-09-12T01:12:09.223001+0000","last_undegraded":"2024-09-12T01:12:09.223001+0000","last_fullsized":"2024-09-12T01:12:09.223001+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:09.222892+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:09.222892+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.222892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:06.374785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'18","reported_seq":95,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.213287+0000","last_change":"2024-09-12T01:12:03.213287+0000","last_active":"2024-09-12T01:12:03.213287+0000","last_peered":"2024-09-12T01:12:03.213287+0000","last_clean":"2024-09-12T01:12:03.213287+0000","last_became_active":"2024-09-12T00:44:37.815820+0000","last_became_peered":"2024-09-12T00:44:37.815820+0000","last_unstale":"2024-09-12T01:12:03.213287+0000","last_undegraded":"2024-09-12T01:12:03.213287+0000","last_fullsized":"2024-09-12T01:12:03.213287+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-12T01:12:03.213208+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-12T01:12:03.213208+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.213208+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:30.498570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.475979+0000","last_change":"2024-09-12T00:56:52.996102+0000","last_active":"2024-09-12T01:08:32.475979+0000","last_peered":"2024-09-12T01:08:32.475979+0000","last_clean":"2024-09-12T01:08:32.475979+0000","last_became_active":"2024-09-12T00:56:52.995696+0000","last_became_peered":"2024-09-12T00:56:52.995696+0000","last_unstale":"2024-09-12T01:08:32.475979+0000","last_undegraded":"2024-09-12T01:08:32.475979+0000","last_fullsized":"2024-09-12T01:08:32.475979+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:57.634150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.847582+0000","last_change":"2024-09-12T01:12:16.847582+0000","last_active":"2024-09-12T01:12:16.847582+0000","last_peered":"2024-09-12T01:12:16.847582+0000","last_clean":"2024-09-12T01:12:16.847582+0000","last_became_active":"2024-09-12T00:46:19.282466+0000","last_became_peered":"2024-09-12T00:46:19.282466+0000","last_unstale":"2024-09-12T01:12:16.847582+0000","last_undegraded":"2024-09-12T01:12:16.847582+0000","last_fullsized":"2024-09-12T01:12:16.847582+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:16.847485+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:16.847485+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.847485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:37.141238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.056509+0000","last_change":"2024-09-12T00:46:16.268948+0000","last_active":"2024-09-12T01:11:23.056509+0000","last_peered":"2024-09-12T01:11:23.056509+0000","last_clean":"2024-09-12T01:11:23.056509+0000","last_became_active":"2024-09-12T00:46:16.268479+0000","last_became_peered":"2024-09-12T00:46:16.268479+0000","last_unstale":"2024-09-12T01:11:23.056509+0000","last_undegraded":"2024-09-12T01:11:23.056509+0000","last_fullsized":"2024-09-12T01:11:23.056509+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:15.238906+0000","last_clean_scrub_stamp":"2024-09-12T00:46:15.238906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'15","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.394090+0000","last_change":"2024-09-12T01:12:10.394090+0000","last_active":"2024-09-12T01:12:10.394090+0000","last_peered":"2024-09-12T01:12:10.394090+0000","last_clean":"2024-09-12T01:12:10.394090+0000","last_became_active":"2024-09-12T00:44:37.811697+0000","last_became_peered":"2024-09-12T00:44:37.811697+0000","last_unstale":"2024-09-12T01:12:10.394090+0000","last_undegraded":"2024-09-12T01:12:10.394090+0000","last_fullsized":"2024-09-12T01:12:10.394090+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-09-12T01:12:10.394004+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-09-12T01:12:10.394004+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.394004+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":57,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.229140+0000","last_change":"2024-09-12T01:12:11.229140+0000","last_active":"2024-09-12T01:12:11.229140+0000","last_peered":"2024-09-12T01:12:11.229140+0000","last_clean":"2024-09-12T01:12:11.229140+0000","last_became_active":"2024-09-12T00:56:52.984878+0000","last_became_peered":"2024-09-12T00:56:52.984878+0000","last_unstale":"2024-09-12T01:12:11.229140+0000","last_undegraded":"2024-09-12T01:12:11.229140+0000","last_fullsized":"2024-09-12T01:12:11.229140+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:11.229052+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:11.229052+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.229052+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.412445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.314528+0000","last_change":"2024-09-12T01:12:20.314528+0000","last_active":"2024-09-12T01:12:20.314528+0000","last_peered":"2024-09-12T01:12:20.314528+0000","last_clean":"2024-09-12T01:12:20.314528+0000","last_became_active":"2024-09-12T00:46:19.276197+0000","last_became_peered":"2024-09-12T00:46:19.276197+0000","last_unstale":"2024-09-12T01:12:20.314528+0000","last_undegraded":"2024-09-12T01:12:20.314528+0000","last_fullsized":"2024-09-12T01:12:20.314528+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:20.314428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:20.314428+0000","last_clean_scrub_stamp":"2024-09-12T01:12:20.314428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:17.280276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.268421+0000","last_change":"2024-09-12T01:11:58.268421+0000","last_active":"2024-09-12T01:11:58.268421+0000","last_peered":"2024-09-12T01:11:58.268421+0000","last_clean":"2024-09-12T01:11:58.268421+0000","last_became_active":"2024-09-12T00:46:16.263870+0000","last_became_peered":"2024-09-12T00:46:16.263870+0000","last_unstale":"2024-09-12T01:11:58.268421+0000","last_undegraded":"2024-09-12T01:11:58.268421+0000","last_fullsized":"2024-09-12T01:11:58.268421+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:11:58.268310+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:11:58.268310+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.268310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:14.647884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2048,"num_write":18,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'37","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.421520+0000","last_change":"2024-09-12T01:12:09.421520+0000","last_active":"2024-09-12T01:12:09.421520+0000","last_peered":"2024-09-12T01:12:09.421520+0000","last_clean":"2024-09-12T01:12:09.421520+0000","last_became_active":"2024-09-12T00:44:37.820232+0000","last_became_peered":"2024-09-12T00:44:37.820232+0000","last_unstale":"2024-09-12T01:12:09.421520+0000","last_undegraded":"2024-09-12T01:12:09.421520+0000","last_fullsized":"2024-09-12T01:12:09.421520+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-12T01:12:09.421430+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-12T01:12:09.421430+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.421430+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.135571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.254294+0000","last_change":"2024-09-12T01:12:13.254294+0000","last_active":"2024-09-12T01:12:13.254294+0000","last_peered":"2024-09-12T01:12:13.254294+0000","last_clean":"2024-09-12T01:12:13.254294+0000","last_became_active":"2024-09-12T00:56:52.987492+0000","last_became_peered":"2024-09-12T00:56:52.987492+0000","last_unstale":"2024-09-12T01:12:13.254294+0000","last_undegraded":"2024-09-12T01:12:13.254294+0000","last_fullsized":"2024-09-12T01:12:13.254294+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:13.254197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:13.254197+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.254197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:59.368060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'9","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:17.823666+0000","last_change":"2024-09-12T01:12:17.823666+0000","last_active":"2024-09-12T01:12:17.823666+0000","last_peered":"2024-09-12T01:12:17.823666+0000","last_clean":"2024-09-12T01:12:17.823666+0000","last_became_active":"2024-09-12T00:46:19.286860+0000","last_became_peered":"2024-09-12T00:46:19.286860+0000","last_unstale":"2024-09-12T01:12:17.823666+0000","last_undegraded":"2024-09-12T01:12:17.823666+0000","last_fullsized":"2024-09-12T01:12:17.823666+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'9","last_scrub_stamp":"2024-09-12T01:12:17.823561+0000","last_deep_scrub":"261'9","last_deep_scrub_stamp":"2024-09-12T01:12:17.823561+0000","last_clean_scrub_stamp":"2024-09-12T01:12:17.823561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:55.471643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13316,"num_write":14,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.697847+0000","last_change":"2024-09-12T01:12:08.697847+0000","last_active":"2024-09-12T01:12:08.697847+0000","last_peered":"2024-09-12T01:12:08.697847+0000","last_clean":"2024-09-12T01:12:08.697847+0000","last_became_active":"2024-09-12T00:46:16.279114+0000","last_became_peered":"2024-09-12T00:46:16.279114+0000","last_unstale":"2024-09-12T01:12:08.697847+0000","last_undegraded":"2024-09-12T01:12:08.697847+0000","last_fullsized":"2024-09-12T01:12:08.697847+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:08.697744+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:08.697744+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.697744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:12.893237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'25","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.649528+0000","last_change":"2024-09-12T01:12:02.649528+0000","last_active":"2024-09-12T01:12:02.649528+0000","last_peered":"2024-09-12T01:12:02.649528+0000","last_clean":"2024-09-12T01:12:02.649528+0000","last_became_active":"2024-09-12T00:44:37.819153+0000","last_became_peered":"2024-09-12T00:44:37.819153+0000","last_unstale":"2024-09-12T01:12:02.649528+0000","last_undegraded":"2024-09-12T01:12:02.649528+0000","last_fullsized":"2024-09-12T01:12:02.649528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-12T01:12:02.649425+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-12T01:12:02.649425+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.649425+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:22.865583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":89,"num_write":41,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.151506+0000","last_change":"2024-09-12T01:12:07.151506+0000","last_active":"2024-09-12T01:12:07.151506+0000","last_peered":"2024-09-12T01:12:07.151506+0000","last_clean":"2024-09-12T01:12:07.151506+0000","last_became_active":"2024-09-12T00:56:52.990265+0000","last_became_peered":"2024-09-12T00:56:52.990265+0000","last_unstale":"2024-09-12T01:12:07.151506+0000","last_undegraded":"2024-09-12T01:12:07.151506+0000","last_fullsized":"2024-09-12T01:12:07.151506+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:07.151401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:07.151401+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.151401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:30.414409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.165637+0000","last_change":"2024-09-12T01:12:01.165637+0000","last_active":"2024-09-12T01:12:01.165637+0000","last_peered":"2024-09-12T01:12:01.165637+0000","last_clean":"2024-09-12T01:12:01.165637+0000","last_became_active":"2024-09-12T00:46:19.277011+0000","last_became_peered":"2024-09-12T00:46:19.277011+0000","last_unstale":"2024-09-12T01:12:01.165637+0000","last_undegraded":"2024-09-12T01:12:01.165637+0000","last_fullsized":"2024-09-12T01:12:01.165637+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.165547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.165547+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.165547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:08.466888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.363230+0000","last_change":"2024-09-12T01:12:14.363230+0000","last_active":"2024-09-12T01:12:14.363230+0000","last_peered":"2024-09-12T01:12:14.363230+0000","last_clean":"2024-09-12T01:12:14.363230+0000","last_became_active":"2024-09-12T00:46:16.275403+0000","last_became_peered":"2024-09-12T00:46:16.275403+0000","last_unstale":"2024-09-12T01:12:14.363230+0000","last_undegraded":"2024-09-12T01:12:14.363230+0000","last_fullsized":"2024-09-12T01:12:14.363230+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:14.363149+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:14.363149+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.363149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:46.308375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"264'69","reported_seq":275,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:21.930866+0000","last_change":"2024-09-12T01:12:21.930866+0000","last_active":"2024-09-12T01:12:21.930866+0000","last_peered":"2024-09-12T01:12:21.930866+0000","last_clean":"2024-09-12T01:12:21.930866+0000","last_became_active":"2024-09-12T00:44:37.821192+0000","last_became_peered":"2024-09-12T00:44:37.821192+0000","last_unstale":"2024-09-12T01:12:21.930866+0000","last_undegraded":"2024-09-12T01:12:21.930866+0000","last_fullsized":"2024-09-12T01:12:21.930866+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-12T01:12:21.930741+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-12T01:12:21.930741+0000","last_clean_scrub_stamp":"2024-09-12T01:12:21.930741+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:34.398194+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":323,"num_write":87,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:08:57.479794+0000","last_change":"2024-09-12T00:56:52.995841+0000","last_active":"2024-09-12T01:08:57.479794+0000","last_peered":"2024-09-12T01:08:57.479794+0000","last_clean":"2024-09-12T01:08:57.479794+0000","last_became_active":"2024-09-12T00:56:52.995495+0000","last_became_peered":"2024-09-12T00:56:52.995495+0000","last_unstale":"2024-09-12T01:08:57.479794+0000","last_undegraded":"2024-09-12T01:08:57.479794+0000","last_fullsized":"2024-09-12T01:08:57.479794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:07.859390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:22.284814+0000","last_change":"2024-09-12T01:12:22.284814+0000","last_active":"2024-09-12T01:12:22.284814+0000","last_peered":"2024-09-12T01:12:22.284814+0000","last_clean":"2024-09-12T01:12:22.284814+0000","last_became_active":"2024-09-12T00:46:19.280653+0000","last_became_peered":"2024-09-12T00:46:19.280653+0000","last_unstale":"2024-09-12T01:12:22.284814+0000","last_undegraded":"2024-09-12T01:12:22.284814+0000","last_fullsized":"2024-09-12T01:12:22.284814+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:12:22.284725+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:12:22.284725+0000","last_clean_scrub_stamp":"2024-09-12T01:12:22.284725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:28.531796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10256,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.778408+0000","last_change":"2024-09-12T01:12:01.778408+0000","last_active":"2024-09-12T01:12:01.778408+0000","last_peered":"2024-09-12T01:12:01.778408+0000","last_clean":"2024-09-12T01:12:01.778408+0000","last_became_active":"2024-09-12T00:46:16.270004+0000","last_became_peered":"2024-09-12T00:46:16.270004+0000","last_unstale":"2024-09-12T01:12:01.778408+0000","last_undegraded":"2024-09-12T01:12:01.778408+0000","last_fullsized":"2024-09-12T01:12:01.778408+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T01:12:01.778304+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T01:12:01.778304+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.778304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:34.611521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'15","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:22.975865+0000","last_change":"2024-09-12T01:12:22.975865+0000","last_active":"2024-09-12T01:12:22.975865+0000","last_peered":"2024-09-12T01:12:22.975865+0000","last_clean":"2024-09-12T01:12:22.975865+0000","last_became_active":"2024-09-12T00:44:37.820639+0000","last_became_peered":"2024-09-12T00:44:37.820639+0000","last_unstale":"2024-09-12T01:12:22.975865+0000","last_undegraded":"2024-09-12T01:12:22.975865+0000","last_fullsized":"2024-09-12T01:12:22.975865+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-09-12T01:12:22.975765+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-09-12T01:12:22.975765+0000","last_clean_scrub_stamp":"2024-09-12T01:12:22.975765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.170592+0000","last_change":"2024-09-12T01:12:14.170592+0000","last_active":"2024-09-12T01:12:14.170592+0000","last_peered":"2024-09-12T01:12:14.170592+0000","last_clean":"2024-09-12T01:12:14.170592+0000","last_became_active":"2024-09-12T00:56:52.991261+0000","last_became_peered":"2024-09-12T00:56:52.991261+0000","last_unstale":"2024-09-12T01:12:14.170592+0000","last_undegraded":"2024-09-12T01:12:14.170592+0000","last_fullsized":"2024-09-12T01:12:14.170592+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:14.170500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:14.170500+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.170500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:33.394905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.275571+0000","last_change":"2024-09-12T01:12:18.275571+0000","last_active":"2024-09-12T01:12:18.275571+0000","last_peered":"2024-09-12T01:12:18.275571+0000","last_clean":"2024-09-12T01:12:18.275571+0000","last_became_active":"2024-09-12T00:46:19.281676+0000","last_became_peered":"2024-09-12T00:46:19.281676+0000","last_unstale":"2024-09-12T01:12:18.275571+0000","last_undegraded":"2024-09-12T01:12:18.275571+0000","last_fullsized":"2024-09-12T01:12:18.275571+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:18.275485+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:18.275485+0000","last_clean_scrub_stamp":"2024-09-12T01:12:18.275485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:46.131166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.458762+0000","last_change":"2024-09-12T01:12:12.458762+0000","last_active":"2024-09-12T01:12:12.458762+0000","last_peered":"2024-09-12T01:12:12.458762+0000","last_clean":"2024-09-12T01:12:12.458762+0000","last_became_active":"2024-09-12T00:46:16.276180+0000","last_became_peered":"2024-09-12T00:46:16.276180+0000","last_unstale":"2024-09-12T01:12:12.458762+0000","last_undegraded":"2024-09-12T01:12:12.458762+0000","last_fullsized":"2024-09-12T01:12:12.458762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T01:12:12.458676+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T01:12:12.458676+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.458676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:51.962632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.681342+0000","last_change":"2024-09-12T01:12:01.681342+0000","last_active":"2024-09-12T01:12:01.681342+0000","last_peered":"2024-09-12T01:12:01.681342+0000","last_clean":"2024-09-12T01:12:01.681342+0000","last_became_active":"2024-09-12T00:44:37.820217+0000","last_became_peered":"2024-09-12T00:44:37.820217+0000","last_unstale":"2024-09-12T01:12:01.681342+0000","last_undegraded":"2024-09-12T01:12:01.681342+0000","last_fullsized":"2024-09-12T01:12:01.681342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-12T01:12:01.681254+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-12T01:12:01.681254+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.681254+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:39.318596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":127,"num_write":61,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.367933+0000","last_change":"2024-09-12T01:12:16.367933+0000","last_active":"2024-09-12T01:12:16.367933+0000","last_peered":"2024-09-12T01:12:16.367933+0000","last_clean":"2024-09-12T01:12:16.367933+0000","last_became_active":"2024-09-12T00:56:52.988302+0000","last_became_peered":"2024-09-12T00:56:52.988302+0000","last_unstale":"2024-09-12T01:12:16.367933+0000","last_undegraded":"2024-09-12T01:12:16.367933+0000","last_fullsized":"2024-09-12T01:12:16.367933+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:16.367845+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:16.367845+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.367845+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.884784+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'7","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.773912+0000","last_change":"2024-09-12T01:12:14.773912+0000","last_active":"2024-09-12T01:12:14.773912+0000","last_peered":"2024-09-12T01:12:14.773912+0000","last_clean":"2024-09-12T01:12:14.773912+0000","last_became_active":"2024-09-12T00:46:19.280889+0000","last_became_peered":"2024-09-12T00:46:19.280889+0000","last_unstale":"2024-09-12T01:12:14.773912+0000","last_undegraded":"2024-09-12T01:12:14.773912+0000","last_fullsized":"2024-09-12T01:12:14.773912+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T01:12:14.773821+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T01:12:14.773821+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.773821+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.056474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7182,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.809016+0000","last_change":"2024-09-12T01:12:06.809016+0000","last_active":"2024-09-12T01:12:06.809016+0000","last_peered":"2024-09-12T01:12:06.809016+0000","last_clean":"2024-09-12T01:12:06.809016+0000","last_became_active":"2024-09-12T00:46:16.263065+0000","last_became_peered":"2024-09-12T00:46:16.263065+0000","last_unstale":"2024-09-12T01:12:06.809016+0000","last_undegraded":"2024-09-12T01:12:06.809016+0000","last_fullsized":"2024-09-12T01:12:06.809016+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:12:06.808921+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:12:06.808921+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.808921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:45.527274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.391774+0000","last_change":"2024-09-12T01:12:00.391774+0000","last_active":"2024-09-12T01:12:00.391774+0000","last_peered":"2024-09-12T01:12:00.391774+0000","last_clean":"2024-09-12T01:12:00.391774+0000","last_became_active":"2024-09-12T00:44:37.814584+0000","last_became_peered":"2024-09-12T00:44:37.814584+0000","last_unstale":"2024-09-12T01:12:00.391774+0000","last_undegraded":"2024-09-12T01:12:00.391774+0000","last_fullsized":"2024-09-12T01:12:00.391774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-12T01:12:00.391675+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-12T01:12:00.391675+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.391675+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:27.708969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.197338+0000","last_change":"2024-09-12T01:12:12.197338+0000","last_active":"2024-09-12T01:12:12.197338+0000","last_peered":"2024-09-12T01:12:12.197338+0000","last_clean":"2024-09-12T01:12:12.197338+0000","last_became_active":"2024-09-12T00:56:52.990830+0000","last_became_peered":"2024-09-12T00:56:52.990830+0000","last_unstale":"2024-09-12T01:12:12.197338+0000","last_undegraded":"2024-09-12T01:12:12.197338+0000","last_fullsized":"2024-09-12T01:12:12.197338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:12.197242+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:12.197242+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.197242+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:44.781930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'11","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.355255+0000","last_change":"2024-09-12T00:46:19.285059+0000","last_active":"2024-09-12T01:11:24.355255+0000","last_peered":"2024-09-12T01:11:24.355255+0000","last_clean":"2024-09-12T01:11:24.355255+0000","last_became_active":"2024-09-12T00:46:19.284748+0000","last_became_peered":"2024-09-12T00:46:19.284748+0000","last_unstale":"2024-09-12T01:11:24.355255+0000","last_undegraded":"2024-09-12T01:11:24.355255+0000","last_fullsized":"2024-09-12T01:11:24.355255+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"261'5","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.771536+0000","last_change":"2024-09-12T01:12:02.771536+0000","last_active":"2024-09-12T01:12:02.771536+0000","last_peered":"2024-09-12T01:12:02.771536+0000","last_clean":"2024-09-12T01:12:02.771536+0000","last_became_active":"2024-09-12T00:46:16.274209+0000","last_became_peered":"2024-09-12T00:46:16.274209+0000","last_unstale":"2024-09-12T01:12:02.771536+0000","last_undegraded":"2024-09-12T01:12:02.771536+0000","last_fullsized":"2024-09-12T01:12:02.771536+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T01:12:02.771444+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T01:12:02.771444+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.771444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:59.663528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":10,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.640620+0000","last_change":"2024-09-12T01:12:00.640620+0000","last_active":"2024-09-12T01:12:00.640620+0000","last_peered":"2024-09-12T01:12:00.640620+0000","last_clean":"2024-09-12T01:12:00.640620+0000","last_became_active":"2024-09-12T00:44:37.819298+0000","last_became_peered":"2024-09-12T00:44:37.819298+0000","last_unstale":"2024-09-12T01:12:00.640620+0000","last_undegraded":"2024-09-12T01:12:00.640620+0000","last_fullsized":"2024-09-12T01:12:00.640620+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T01:12:00.640490+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T01:12:00.640490+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.640490+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:43.774391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:26.398395+0000","last_change":"2024-09-12T01:12:26.398395+0000","last_active":"2024-09-12T01:12:26.398395+0000","last_peered":"2024-09-12T01:12:26.398395+0000","last_clean":"2024-09-12T01:12:26.398395+0000","last_became_active":"2024-09-12T00:56:52.996048+0000","last_became_peered":"2024-09-12T00:56:52.996048+0000","last_unstale":"2024-09-12T01:12:26.398395+0000","last_undegraded":"2024-09-12T01:12:26.398395+0000","last_fullsized":"2024-09-12T01:12:26.398395+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:26.398274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:26.398274+0000","last_clean_scrub_stamp":"2024-09-12T01:12:26.398274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:48.326529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.713784+0000","last_change":"2024-09-12T01:12:12.713784+0000","last_active":"2024-09-12T01:12:12.713784+0000","last_peered":"2024-09-12T01:12:12.713784+0000","last_clean":"2024-09-12T01:12:12.713784+0000","last_became_active":"2024-09-12T00:46:19.285304+0000","last_became_peered":"2024-09-12T00:46:19.285304+0000","last_unstale":"2024-09-12T01:12:12.713784+0000","last_undegraded":"2024-09-12T01:12:12.713784+0000","last_fullsized":"2024-09-12T01:12:12.713784+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:12.713692+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:12.713692+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.713692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:08.672773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2428,"num_write":4,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.352766+0000","last_change":"2024-09-12T01:12:06.352766+0000","last_active":"2024-09-12T01:12:06.352766+0000","last_peered":"2024-09-12T01:12:06.352766+0000","last_clean":"2024-09-12T01:12:06.352766+0000","last_became_active":"2024-09-12T00:46:16.271839+0000","last_became_peered":"2024-09-12T00:46:16.271839+0000","last_unstale":"2024-09-12T01:12:06.352766+0000","last_undegraded":"2024-09-12T01:12:06.352766+0000","last_fullsized":"2024-09-12T01:12:06.352766+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:06.352670+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:06.352670+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.352670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:22.443702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"264'41","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.688231+0000","last_change":"2024-09-12T01:11:59.688231+0000","last_active":"2024-09-12T01:11:59.688231+0000","last_peered":"2024-09-12T01:11:59.688231+0000","last_clean":"2024-09-12T01:11:59.688231+0000","last_became_active":"2024-09-12T00:44:37.821837+0000","last_became_peered":"2024-09-12T00:44:37.821837+0000","last_unstale":"2024-09-12T01:11:59.688231+0000","last_undegraded":"2024-09-12T01:11:59.688231+0000","last_fullsized":"2024-09-12T01:11:59.688231+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T01:11:59.688148+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T01:11:59.688148+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.688148+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:43.832110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":140,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.754361+0000","last_change":"2024-09-12T01:12:08.754361+0000","last_active":"2024-09-12T01:12:08.754361+0000","last_peered":"2024-09-12T01:12:08.754361+0000","last_clean":"2024-09-12T01:12:08.754361+0000","last_became_active":"2024-09-12T00:56:52.996287+0000","last_became_peered":"2024-09-12T00:56:52.996287+0000","last_unstale":"2024-09-12T01:12:08.754361+0000","last_undegraded":"2024-09-12T01:12:08.754361+0000","last_fullsized":"2024-09-12T01:12:08.754361+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:08.754270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:08.754270+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.754270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:09.635270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.701762+0000","last_change":"2024-09-12T01:12:10.701762+0000","last_active":"2024-09-12T01:12:10.701762+0000","last_peered":"2024-09-12T01:12:10.701762+0000","last_clean":"2024-09-12T01:12:10.701762+0000","last_became_active":"2024-09-12T00:46:19.284490+0000","last_became_peered":"2024-09-12T00:46:19.284490+0000","last_unstale":"2024-09-12T01:12:10.701762+0000","last_undegraded":"2024-09-12T01:12:10.701762+0000","last_fullsized":"2024-09-12T01:12:10.701762+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:12:10.701676+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:12:10.701676+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.701676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:21.297284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"264'10","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.247141+0000","last_change":"2024-09-12T01:12:08.247141+0000","last_active":"2024-09-12T01:12:08.247141+0000","last_peered":"2024-09-12T01:12:08.247141+0000","last_clean":"2024-09-12T01:12:08.247141+0000","last_became_active":"2024-09-12T00:46:16.275312+0000","last_became_peered":"2024-09-12T00:46:16.275312+0000","last_unstale":"2024-09-12T01:12:08.247141+0000","last_undegraded":"2024-09-12T01:12:08.247141+0000","last_fullsized":"2024-09-12T01:12:08.247141+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-12T01:12:08.247043+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-12T01:12:08.247043+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.247043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:20.366332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20478,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'42","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:24.983557+0000","last_change":"2024-09-12T01:12:24.983557+0000","last_active":"2024-09-12T01:12:24.983557+0000","last_peered":"2024-09-12T01:12:24.983557+0000","last_clean":"2024-09-12T01:12:24.983557+0000","last_became_active":"2024-09-12T00:44:37.819289+0000","last_became_peered":"2024-09-12T00:44:37.819289+0000","last_unstale":"2024-09-12T01:12:24.983557+0000","last_undegraded":"2024-09-12T01:12:24.983557+0000","last_fullsized":"2024-09-12T01:12:24.983557+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T01:12:24.983431+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T01:12:24.983431+0000","last_clean_scrub_stamp":"2024-09-12T01:12:24.983431+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:19.655251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":167,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:53.613300+0000","last_change":"2024-09-12T00:56:52.987494+0000","last_active":"2024-09-12T01:09:53.613300+0000","last_peered":"2024-09-12T01:09:53.613300+0000","last_clean":"2024-09-12T01:09:53.613300+0000","last_became_active":"2024-09-12T00:56:52.987226+0000","last_became_peered":"2024-09-12T00:56:52.987226+0000","last_unstale":"2024-09-12T01:09:53.613300+0000","last_undegraded":"2024-09-12T01:09:53.613300+0000","last_fullsized":"2024-09-12T01:09:53.613300+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.752229+0000","last_change":"2024-09-12T01:12:13.752229+0000","last_active":"2024-09-12T01:12:13.752229+0000","last_peered":"2024-09-12T01:12:13.752229+0000","last_clean":"2024-09-12T01:12:13.752229+0000","last_became_active":"2024-09-12T00:46:19.287067+0000","last_became_peered":"2024-09-12T00:46:19.287067+0000","last_unstale":"2024-09-12T01:12:13.752229+0000","last_undegraded":"2024-09-12T01:12:13.752229+0000","last_fullsized":"2024-09-12T01:12:13.752229+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:13.752138+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:13.752138+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.752138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:01.345829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2174,"num_write":4,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.693299+0000","last_change":"2024-09-12T01:12:07.693299+0000","last_active":"2024-09-12T01:12:07.693299+0000","last_peered":"2024-09-12T01:12:07.693299+0000","last_clean":"2024-09-12T01:12:07.693299+0000","last_became_active":"2024-09-12T00:46:16.278205+0000","last_became_peered":"2024-09-12T00:46:16.278205+0000","last_unstale":"2024-09-12T01:12:07.693299+0000","last_undegraded":"2024-09-12T01:12:07.693299+0000","last_fullsized":"2024-09-12T01:12:07.693299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:07.693189+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:07.693189+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.693189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:12.595955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'62","reported_seq":220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.759000+0000","last_change":"2024-09-12T01:12:04.759000+0000","last_active":"2024-09-12T01:12:04.759000+0000","last_peered":"2024-09-12T01:12:04.759000+0000","last_clean":"2024-09-12T01:12:04.759000+0000","last_became_active":"2024-09-12T00:44:37.811544+0000","last_became_peered":"2024-09-12T00:44:37.811544+0000","last_unstale":"2024-09-12T01:12:04.759000+0000","last_undegraded":"2024-09-12T01:12:04.759000+0000","last_fullsized":"2024-09-12T01:12:04.759000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'62","last_scrub_stamp":"2024-09-12T01:12:04.758917+0000","last_deep_scrub":"264'62","last_deep_scrub_stamp":"2024-09-12T01:12:04.758917+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.758917+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:10.647898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":232,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.780609+0000","last_change":"2024-09-12T01:12:07.780609+0000","last_active":"2024-09-12T01:12:07.780609+0000","last_peered":"2024-09-12T01:12:07.780609+0000","last_clean":"2024-09-12T01:12:07.780609+0000","last_became_active":"2024-09-12T00:56:52.988985+0000","last_became_peered":"2024-09-12T00:56:52.988985+0000","last_unstale":"2024-09-12T01:12:07.780609+0000","last_undegraded":"2024-09-12T01:12:07.780609+0000","last_fullsized":"2024-09-12T01:12:07.780609+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:07.780496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:07.780496+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.780496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:42.826635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'10","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:17.294016+0000","last_change":"2024-09-12T01:12:17.294016+0000","last_active":"2024-09-12T01:12:17.294016+0000","last_peered":"2024-09-12T01:12:17.294016+0000","last_clean":"2024-09-12T01:12:17.294016+0000","last_became_active":"2024-09-12T00:46:19.279527+0000","last_became_peered":"2024-09-12T00:46:19.279527+0000","last_unstale":"2024-09-12T01:12:17.294016+0000","last_undegraded":"2024-09-12T01:12:17.294016+0000","last_fullsized":"2024-09-12T01:12:17.294016+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T01:12:17.293917+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T01:12:17.293917+0000","last_clean_scrub_stamp":"2024-09-12T01:12:17.293917+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:48.254374+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8190,"num_write":20,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.726093+0000","last_change":"2024-09-12T01:12:06.726093+0000","last_active":"2024-09-12T01:12:06.726093+0000","last_peered":"2024-09-12T01:12:06.726093+0000","last_clean":"2024-09-12T01:12:06.726093+0000","last_became_active":"2024-09-12T00:46:16.273598+0000","last_became_peered":"2024-09-12T00:46:16.273598+0000","last_unstale":"2024-09-12T01:12:06.726093+0000","last_undegraded":"2024-09-12T01:12:06.726093+0000","last_fullsized":"2024-09-12T01:12:06.726093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:06.726000+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:06.726000+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.726000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:37.079282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'41","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.182830+0000","last_change":"2024-09-12T01:12:02.182830+0000","last_active":"2024-09-12T01:12:02.182830+0000","last_peered":"2024-09-12T01:12:02.182830+0000","last_clean":"2024-09-12T01:12:02.182830+0000","last_became_active":"2024-09-12T00:44:37.813081+0000","last_became_peered":"2024-09-12T00:44:37.813081+0000","last_unstale":"2024-09-12T01:12:02.182830+0000","last_undegraded":"2024-09-12T01:12:02.182830+0000","last_fullsized":"2024-09-12T01:12:02.182830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T01:12:02.182750+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T01:12:02.182750+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.182750+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:31.355347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":146,"num_write":78,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:27.403772+0000","last_change":"2024-09-12T01:12:27.403772+0000","last_active":"2024-09-12T01:12:27.403772+0000","last_peered":"2024-09-12T01:12:27.403772+0000","last_clean":"2024-09-12T01:12:27.403772+0000","last_became_active":"2024-09-12T00:56:52.995412+0000","last_became_peered":"2024-09-12T00:56:52.995412+0000","last_unstale":"2024-09-12T01:12:27.403772+0000","last_undegraded":"2024-09-12T01:12:27.403772+0000","last_fullsized":"2024-09-12T01:12:27.403772+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:27.403684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:27.403684+0000","last_clean_scrub_stamp":"2024-09-12T01:12:27.403684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:21.108089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.643604+0000","last_change":"2024-09-12T00:46:19.283005+0000","last_active":"2024-09-12T01:11:24.643604+0000","last_peered":"2024-09-12T01:11:24.643604+0000","last_clean":"2024-09-12T01:11:24.643604+0000","last_became_active":"2024-09-12T00:46:19.282672+0000","last_became_peered":"2024-09-12T00:46:19.282672+0000","last_unstale":"2024-09-12T01:11:24.643604+0000","last_undegraded":"2024-09-12T01:11:24.643604+0000","last_fullsized":"2024-09-12T01:11:24.643604+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'9","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.689295+0000","last_change":"2024-09-12T01:12:04.689190+0000","last_active":"2024-09-12T01:12:04.689295+0000","last_peered":"2024-09-12T01:12:04.689295+0000","last_clean":"2024-09-12T01:12:04.689295+0000","last_became_active":"2024-09-12T00:46:16.265927+0000","last_became_peered":"2024-09-12T00:46:16.265927+0000","last_unstale":"2024-09-12T01:12:04.689295+0000","last_undegraded":"2024-09-12T01:12:04.689295+0000","last_fullsized":"2024-09-12T01:12:04.689295+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T01:12:04.689067+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T01:12:04.689067+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.689067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:48.646995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'26","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.177653+0000","last_change":"2024-09-12T01:12:01.177653+0000","last_active":"2024-09-12T01:12:01.177653+0000","last_peered":"2024-09-12T01:12:01.177653+0000","last_clean":"2024-09-12T01:12:01.177653+0000","last_became_active":"2024-09-12T00:44:37.820584+0000","last_became_peered":"2024-09-12T00:44:37.820584+0000","last_unstale":"2024-09-12T01:12:01.177653+0000","last_undegraded":"2024-09-12T01:12:01.177653+0000","last_fullsized":"2024-09-12T01:12:01.177653+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T01:12:01.177520+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T01:12:01.177520+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.177520+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:02.561584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.284068+0000","last_change":"2024-09-12T01:12:12.284068+0000","last_active":"2024-09-12T01:12:12.284068+0000","last_peered":"2024-09-12T01:12:12.284068+0000","last_clean":"2024-09-12T01:12:12.284068+0000","last_became_active":"2024-09-12T00:56:52.994132+0000","last_became_peered":"2024-09-12T00:56:52.994132+0000","last_unstale":"2024-09-12T01:12:12.284068+0000","last_undegraded":"2024-09-12T01:12:12.284068+0000","last_fullsized":"2024-09-12T01:12:12.284068+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:12.283973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:12.283973+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.283973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:39.540264+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.301579+0000","last_change":"2024-09-12T01:12:09.301520+0000","last_active":"2024-09-12T01:12:09.301579+0000","last_peered":"2024-09-12T01:12:09.301579+0000","last_clean":"2024-09-12T01:12:09.301579+0000","last_became_active":"2024-09-12T00:46:19.280726+0000","last_became_peered":"2024-09-12T00:46:19.280726+0000","last_unstale":"2024-09-12T01:12:09.301579+0000","last_undegraded":"2024-09-12T01:12:09.301579+0000","last_fullsized":"2024-09-12T01:12:09.301579+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:12:09.301424+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:12:09.301424+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.301424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:12.439753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.466403+0000","last_change":"2024-09-12T01:12:11.466343+0000","last_active":"2024-09-12T01:12:11.466403+0000","last_peered":"2024-09-12T01:12:11.466403+0000","last_clean":"2024-09-12T01:12:11.466403+0000","last_became_active":"2024-09-12T00:46:16.275908+0000","last_became_peered":"2024-09-12T00:46:16.275908+0000","last_unstale":"2024-09-12T01:12:11.466403+0000","last_undegraded":"2024-09-12T01:12:11.466403+0000","last_fullsized":"2024-09-12T01:12:11.466403+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:11.466257+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:11.466257+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.466257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:36.822751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.352700+0000","last_change":"2024-09-12T01:12:03.352700+0000","last_active":"2024-09-12T01:12:03.352700+0000","last_peered":"2024-09-12T01:12:03.352700+0000","last_clean":"2024-09-12T01:12:03.352700+0000","last_became_active":"2024-09-12T00:44:37.811613+0000","last_became_peered":"2024-09-12T00:44:37.811613+0000","last_unstale":"2024-09-12T01:12:03.352700+0000","last_undegraded":"2024-09-12T01:12:03.352700+0000","last_fullsized":"2024-09-12T01:12:03.352700+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T01:12:03.352619+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T01:12:03.352619+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.352619+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:42.794372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.142201+0000","last_change":"2024-09-12T01:12:08.142201+0000","last_active":"2024-09-12T01:12:08.142201+0000","last_peered":"2024-09-12T01:12:08.142201+0000","last_clean":"2024-09-12T01:12:08.142201+0000","last_became_active":"2024-09-12T00:56:52.989552+0000","last_became_peered":"2024-09-12T00:56:52.989552+0000","last_unstale":"2024-09-12T01:12:08.142201+0000","last_undegraded":"2024-09-12T01:12:08.142201+0000","last_fullsized":"2024-09-12T01:12:08.142201+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:08.142119+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:08.142119+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.142119+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:11.740822+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'4","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.217411+0000","last_change":"2024-09-12T01:12:10.217411+0000","last_active":"2024-09-12T01:12:10.217411+0000","last_peered":"2024-09-12T01:12:10.217411+0000","last_clean":"2024-09-12T01:12:10.217411+0000","last_became_active":"2024-09-12T00:46:19.282137+0000","last_became_peered":"2024-09-12T00:46:19.282137+0000","last_unstale":"2024-09-12T01:12:10.217411+0000","last_undegraded":"2024-09-12T01:12:10.217411+0000","last_fullsized":"2024-09-12T01:12:10.217411+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T01:12:10.217309+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T01:12:10.217309+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.217309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:16.838211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.682734+0000","last_change":"2024-09-12T01:12:05.682676+0000","last_active":"2024-09-12T01:12:05.682734+0000","last_peered":"2024-09-12T01:12:05.682734+0000","last_clean":"2024-09-12T01:12:05.682734+0000","last_became_active":"2024-09-12T00:46:16.274198+0000","last_became_peered":"2024-09-12T00:46:16.274198+0000","last_unstale":"2024-09-12T01:12:05.682734+0000","last_undegraded":"2024-09-12T01:12:05.682734+0000","last_fullsized":"2024-09-12T01:12:05.682734+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:05.682595+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:05.682595+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.682595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:53.155169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2619,"num_write":4,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.495032+0000","last_change":"2024-09-12T01:12:10.495032+0000","last_active":"2024-09-12T01:12:10.495032+0000","last_peered":"2024-09-12T01:12:10.495032+0000","last_clean":"2024-09-12T01:12:10.495032+0000","last_became_active":"2024-09-12T00:44:37.814480+0000","last_became_peered":"2024-09-12T00:44:37.814480+0000","last_unstale":"2024-09-12T01:12:10.495032+0000","last_undegraded":"2024-09-12T01:12:10.495032+0000","last_fullsized":"2024-09-12T01:12:10.495032+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T01:12:10.494941+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T01:12:10.494941+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.494941+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:10.347907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:19.876866+0000","last_change":"2024-09-12T01:12:19.876866+0000","last_active":"2024-09-12T01:12:19.876866+0000","last_peered":"2024-09-12T01:12:19.876866+0000","last_clean":"2024-09-12T01:12:19.876866+0000","last_became_active":"2024-09-12T00:56:52.996816+0000","last_became_peered":"2024-09-12T00:56:52.996816+0000","last_unstale":"2024-09-12T01:12:19.876866+0000","last_undegraded":"2024-09-12T01:12:19.876866+0000","last_fullsized":"2024-09-12T01:12:19.876866+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:19.876778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:19.876778+0000","last_clean_scrub_stamp":"2024-09-12T01:12:19.876778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:20.313848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.203475+0000","last_change":"2024-09-12T01:12:03.203382+0000","last_active":"2024-09-12T01:12:03.203475+0000","last_peered":"2024-09-12T01:12:03.203475+0000","last_clean":"2024-09-12T01:12:03.203475+0000","last_became_active":"2024-09-12T00:46:19.276366+0000","last_became_peered":"2024-09-12T00:46:19.276366+0000","last_unstale":"2024-09-12T01:12:03.203475+0000","last_undegraded":"2024-09-12T01:12:03.203475+0000","last_fullsized":"2024-09-12T01:12:03.203475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:12:03.203275+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:12:03.203275+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.203275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:54.836932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:28.068278+0000","last_change":"2024-09-12T01:12:28.068278+0000","last_active":"2024-09-12T01:12:28.068278+0000","last_peered":"2024-09-12T01:12:28.068278+0000","last_clean":"2024-09-12T01:12:28.068278+0000","last_became_active":"2024-09-12T00:46:16.273821+0000","last_became_peered":"2024-09-12T00:46:16.273821+0000","last_unstale":"2024-09-12T01:12:28.068278+0000","last_undegraded":"2024-09-12T01:12:28.068278+0000","last_fullsized":"2024-09-12T01:12:28.068278+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T01:12:28.068175+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T01:12:28.068175+0000","last_clean_scrub_stamp":"2024-09-12T01:12:28.068175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:39.373982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.247998+0000","last_change":"2024-09-12T01:11:57.247998+0000","last_active":"2024-09-12T01:11:57.247998+0000","last_peered":"2024-09-12T01:11:57.247998+0000","last_clean":"2024-09-12T01:11:57.247998+0000","last_became_active":"2024-09-12T00:44:37.817357+0000","last_became_peered":"2024-09-12T00:44:37.817357+0000","last_unstale":"2024-09-12T01:11:57.247998+0000","last_undegraded":"2024-09-12T01:11:57.247998+0000","last_fullsized":"2024-09-12T01:11:57.247998+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T01:11:57.247891+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T01:11:57.247891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.247891+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:57.564026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.235206+0000","last_change":"2024-09-12T01:12:04.235206+0000","last_active":"2024-09-12T01:12:04.235206+0000","last_peered":"2024-09-12T01:12:04.235206+0000","last_clean":"2024-09-12T01:12:04.235206+0000","last_became_active":"2024-09-12T00:56:52.990450+0000","last_became_peered":"2024-09-12T00:56:52.990450+0000","last_unstale":"2024-09-12T01:12:04.235206+0000","last_undegraded":"2024-09-12T01:12:04.235206+0000","last_fullsized":"2024-09-12T01:12:04.235206+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:04.235092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:04.235092+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.235092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:29.130516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:19.283705+0000","last_change":"2024-09-12T01:12:19.283705+0000","last_active":"2024-09-12T01:12:19.283705+0000","last_peered":"2024-09-12T01:12:19.283705+0000","last_clean":"2024-09-12T01:12:19.283705+0000","last_became_active":"2024-09-12T00:46:19.281413+0000","last_became_peered":"2024-09-12T00:46:19.281413+0000","last_unstale":"2024-09-12T01:12:19.283705+0000","last_undegraded":"2024-09-12T01:12:19.283705+0000","last_fullsized":"2024-09-12T01:12:19.283705+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:12:19.283607+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:12:19.283607+0000","last_clean_scrub_stamp":"2024-09-12T01:12:19.283607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:27.211363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16941,"num_write":8,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"264'8","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:25.998362+0000","last_change":"2024-09-12T01:12:25.998362+0000","last_active":"2024-09-12T01:12:25.998362+0000","last_peered":"2024-09-12T01:12:25.998362+0000","last_clean":"2024-09-12T01:12:25.998362+0000","last_became_active":"2024-09-12T00:46:16.271730+0000","last_became_peered":"2024-09-12T00:46:16.271730+0000","last_unstale":"2024-09-12T01:12:25.998362+0000","last_undegraded":"2024-09-12T01:12:25.998362+0000","last_fullsized":"2024-09-12T01:12:25.998362+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:12:25.998257+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:12:25.998257+0000","last_clean_scrub_stamp":"2024-09-12T01:12:25.998257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:30.603361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11841,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'15","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.372324+0000","last_change":"2024-09-12T01:12:08.372324+0000","last_active":"2024-09-12T01:12:08.372324+0000","last_peered":"2024-09-12T01:12:08.372324+0000","last_clean":"2024-09-12T01:12:08.372324+0000","last_became_active":"2024-09-12T00:44:37.815542+0000","last_became_peered":"2024-09-12T00:44:37.815542+0000","last_unstale":"2024-09-12T01:12:08.372324+0000","last_undegraded":"2024-09-12T01:12:08.372324+0000","last_fullsized":"2024-09-12T01:12:08.372324+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'15","last_scrub_stamp":"2024-09-12T01:12:08.372224+0000","last_deep_scrub":"261'15","last_deep_scrub_stamp":"2024-09-12T01:12:08.372224+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.372224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:25.772193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":55,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.198009+0000","last_change":"2024-09-12T01:12:05.198009+0000","last_active":"2024-09-12T01:12:05.198009+0000","last_peered":"2024-09-12T01:12:05.198009+0000","last_clean":"2024-09-12T01:12:05.198009+0000","last_became_active":"2024-09-12T00:56:52.988702+0000","last_became_peered":"2024-09-12T00:56:52.988702+0000","last_unstale":"2024-09-12T01:12:05.198009+0000","last_undegraded":"2024-09-12T01:12:05.198009+0000","last_fullsized":"2024-09-12T01:12:05.198009+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:05.197913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:05.197913+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.197913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:01.406564+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.348618+0000","last_change":"2024-09-12T01:12:15.348618+0000","last_active":"2024-09-12T01:12:15.348618+0000","last_peered":"2024-09-12T01:12:15.348618+0000","last_clean":"2024-09-12T01:12:15.348618+0000","last_became_active":"2024-09-12T00:46:19.276538+0000","last_became_peered":"2024-09-12T00:46:19.276538+0000","last_unstale":"2024-09-12T01:12:15.348618+0000","last_undegraded":"2024-09-12T01:12:15.348618+0000","last_fullsized":"2024-09-12T01:12:15.348618+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:15.348516+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:15.348516+0000","last_clean_scrub_stamp":"2024-09-12T01:12:15.348516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:16.870479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.312512+0000","last_change":"2024-09-12T01:12:14.312512+0000","last_active":"2024-09-12T01:12:14.312512+0000","last_peered":"2024-09-12T01:12:14.312512+0000","last_clean":"2024-09-12T01:12:14.312512+0000","last_became_active":"2024-09-12T00:46:16.272892+0000","last_became_peered":"2024-09-12T00:46:16.272892+0000","last_unstale":"2024-09-12T01:12:14.312512+0000","last_undegraded":"2024-09-12T01:12:14.312512+0000","last_fullsized":"2024-09-12T01:12:14.312512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:14.312423+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:14.312423+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.312423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:14.807326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"264'6","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.976680+0000","last_change":"2024-09-12T01:12:20.976680+0000","last_active":"2024-09-12T01:12:20.976680+0000","last_peered":"2024-09-12T01:12:20.976680+0000","last_clean":"2024-09-12T01:12:20.976680+0000","last_became_active":"2024-09-12T00:44:37.819232+0000","last_became_peered":"2024-09-12T00:44:37.819232+0000","last_unstale":"2024-09-12T01:12:20.976680+0000","last_undegraded":"2024-09-12T01:12:20.976680+0000","last_fullsized":"2024-09-12T01:12:20.976680+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:12:20.976584+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:12:20.976584+0000","last_clean_scrub_stamp":"2024-09-12T01:12:20.976584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:31.363156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:24.347307+0000","last_change":"2024-09-12T01:12:24.347307+0000","last_active":"2024-09-12T01:12:24.347307+0000","last_peered":"2024-09-12T01:12:24.347307+0000","last_clean":"2024-09-12T01:12:24.347307+0000","last_became_active":"2024-09-12T00:56:52.994128+0000","last_became_peered":"2024-09-12T00:56:52.994128+0000","last_unstale":"2024-09-12T01:12:24.347307+0000","last_undegraded":"2024-09-12T01:12:24.347307+0000","last_fullsized":"2024-09-12T01:12:24.347307+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:24.347223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:24.347223+0000","last_clean_scrub_stamp":"2024-09-12T01:12:24.347223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:37.893640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.215323+0000","last_change":"2024-09-12T01:12:00.215225+0000","last_active":"2024-09-12T01:12:00.215323+0000","last_peered":"2024-09-12T01:12:00.215323+0000","last_clean":"2024-09-12T01:12:00.215323+0000","last_became_active":"2024-09-12T00:46:19.281782+0000","last_became_peered":"2024-09-12T00:46:19.281782+0000","last_unstale":"2024-09-12T01:12:00.215323+0000","last_undegraded":"2024-09-12T01:12:00.215323+0000","last_fullsized":"2024-09-12T01:12:00.215323+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:00.215119+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:00.215119+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.215119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:03.911763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.303732+0000","last_change":"2024-09-12T01:12:04.303643+0000","last_active":"2024-09-12T01:12:04.303732+0000","last_peered":"2024-09-12T01:12:04.303732+0000","last_clean":"2024-09-12T01:12:04.303732+0000","last_became_active":"2024-09-12T00:46:16.273356+0000","last_became_peered":"2024-09-12T00:46:16.273356+0000","last_unstale":"2024-09-12T01:12:04.303732+0000","last_undegraded":"2024-09-12T01:12:04.303732+0000","last_fullsized":"2024-09-12T01:12:04.303732+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:04.303551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:04.303551+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.303551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:42.894837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'16","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.405292+0000","last_change":"2024-09-12T01:11:59.405292+0000","last_active":"2024-09-12T01:11:59.405292+0000","last_peered":"2024-09-12T01:11:59.405292+0000","last_clean":"2024-09-12T01:11:59.405292+0000","last_became_active":"2024-09-12T00:44:37.818054+0000","last_became_peered":"2024-09-12T00:44:37.818054+0000","last_unstale":"2024-09-12T01:11:59.405292+0000","last_undegraded":"2024-09-12T01:11:59.405292+0000","last_fullsized":"2024-09-12T01:11:59.405292+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T01:11:59.405209+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T01:11:59.405209+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.405209+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.070533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.609549+0000","last_change":"2024-09-12T00:56:52.991268+0000","last_active":"2024-09-12T01:09:23.609549+0000","last_peered":"2024-09-12T01:09:23.609549+0000","last_clean":"2024-09-12T01:09:23.609549+0000","last_became_active":"2024-09-12T00:56:52.990601+0000","last_became_peered":"2024-09-12T00:56:52.990601+0000","last_unstale":"2024-09-12T01:09:23.609549+0000","last_undegraded":"2024-09-12T01:09:23.609549+0000","last_fullsized":"2024-09-12T01:09:23.609549+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:14.400256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.556819+0000","last_change":"2024-09-12T00:46:19.282146+0000","last_active":"2024-09-12T01:11:22.556819+0000","last_peered":"2024-09-12T01:11:22.556819+0000","last_clean":"2024-09-12T01:11:22.556819+0000","last_became_active":"2024-09-12T00:46:19.281732+0000","last_became_peered":"2024-09-12T00:46:19.281732+0000","last_unstale":"2024-09-12T01:11:22.556819+0000","last_undegraded":"2024-09-12T01:11:22.556819+0000","last_fullsized":"2024-09-12T01:11:22.556819+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'5","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:27.042767+0000","last_change":"2024-09-12T01:12:27.042767+0000","last_active":"2024-09-12T01:12:27.042767+0000","last_peered":"2024-09-12T01:12:27.042767+0000","last_clean":"2024-09-12T01:12:27.042767+0000","last_became_active":"2024-09-12T00:46:16.277261+0000","last_became_peered":"2024-09-12T00:46:16.277261+0000","last_unstale":"2024-09-12T01:12:27.042767+0000","last_undegraded":"2024-09-12T01:12:27.042767+0000","last_fullsized":"2024-09-12T01:12:27.042767+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:12:27.042663+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:12:27.042663+0000","last_clean_scrub_stamp":"2024-09-12T01:12:27.042663+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:09.549875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'33","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.699881+0000","last_change":"2024-09-12T01:11:58.699881+0000","last_active":"2024-09-12T01:11:58.699881+0000","last_peered":"2024-09-12T01:11:58.699881+0000","last_clean":"2024-09-12T01:11:58.699881+0000","last_became_active":"2024-09-12T00:44:37.818055+0000","last_became_peered":"2024-09-12T00:44:37.818055+0000","last_unstale":"2024-09-12T01:11:58.699881+0000","last_undegraded":"2024-09-12T01:11:58.699881+0000","last_fullsized":"2024-09-12T01:11:58.699881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T01:11:58.699796+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T01:11:58.699796+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.699796+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:03.097781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":106,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.852528+0000","last_change":"2024-09-12T01:12:18.852528+0000","last_active":"2024-09-12T01:12:18.852528+0000","last_peered":"2024-09-12T01:12:18.852528+0000","last_clean":"2024-09-12T01:12:18.852528+0000","last_became_active":"2024-09-12T00:56:52.989396+0000","last_became_peered":"2024-09-12T00:56:52.989396+0000","last_unstale":"2024-09-12T01:12:18.852528+0000","last_undegraded":"2024-09-12T01:12:18.852528+0000","last_fullsized":"2024-09-12T01:12:18.852528+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:18.852438+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:18.852438+0000","last_clean_scrub_stamp":"2024-09-12T01:12:18.852438+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:12.443001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.327894+0000","last_change":"2024-09-12T01:12:13.327894+0000","last_active":"2024-09-12T01:12:13.327894+0000","last_peered":"2024-09-12T01:12:13.327894+0000","last_clean":"2024-09-12T01:12:13.327894+0000","last_became_active":"2024-09-12T00:46:19.281231+0000","last_became_peered":"2024-09-12T00:46:19.281231+0000","last_unstale":"2024-09-12T01:12:13.327894+0000","last_undegraded":"2024-09-12T01:12:13.327894+0000","last_fullsized":"2024-09-12T01:12:13.327894+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:13.327769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:13.327769+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.327769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:11.009295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"264'7","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.387678+0000","last_change":"2024-09-12T01:12:02.387557+0000","last_active":"2024-09-12T01:12:02.387678+0000","last_peered":"2024-09-12T01:12:02.387678+0000","last_clean":"2024-09-12T01:12:02.387678+0000","last_became_active":"2024-09-12T00:46:16.276730+0000","last_became_peered":"2024-09-12T00:46:16.276730+0000","last_unstale":"2024-09-12T01:12:02.387678+0000","last_undegraded":"2024-09-12T01:12:02.387678+0000","last_fullsized":"2024-09-12T01:12:02.387678+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T01:12:02.387460+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T01:12:02.387460+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.387460+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:57.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7172,"num_write":12,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'54","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.427056+0000","last_change":"2024-09-12T01:12:01.427056+0000","last_active":"2024-09-12T01:12:01.427056+0000","last_peered":"2024-09-12T01:12:01.427056+0000","last_clean":"2024-09-12T01:12:01.427056+0000","last_became_active":"2024-09-12T00:44:37.817249+0000","last_became_peered":"2024-09-12T00:44:37.817249+0000","last_unstale":"2024-09-12T01:12:01.427056+0000","last_undegraded":"2024-09-12T01:12:01.427056+0000","last_fullsized":"2024-09-12T01:12:01.427056+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'54","last_scrub_stamp":"2024-09-12T01:12:01.426966+0000","last_deep_scrub":"261'54","last_deep_scrub_stamp":"2024-09-12T01:12:01.426966+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.426966+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:42.391302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":217,"num_write":83,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.351393+0000","last_change":"2024-09-12T01:12:15.351393+0000","last_active":"2024-09-12T01:12:15.351393+0000","last_peered":"2024-09-12T01:12:15.351393+0000","last_clean":"2024-09-12T01:12:15.351393+0000","last_became_active":"2024-09-12T00:56:52.992289+0000","last_became_peered":"2024-09-12T00:56:52.992289+0000","last_unstale":"2024-09-12T01:12:15.351393+0000","last_undegraded":"2024-09-12T01:12:15.351393+0000","last_fullsized":"2024-09-12T01:12:15.351393+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:15.351305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:15.351305+0000","last_clean_scrub_stamp":"2024-09-12T01:12:15.351305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:34.031755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:10:23.617652+0000","last_change":"2024-09-12T00:46:19.281027+0000","last_active":"2024-09-12T01:10:23.617652+0000","last_peered":"2024-09-12T01:10:23.617652+0000","last_clean":"2024-09-12T01:10:23.617652+0000","last_became_active":"2024-09-12T00:46:19.280725+0000","last_became_peered":"2024-09-12T00:46:19.280725+0000","last_unstale":"2024-09-12T01:10:23.617652+0000","last_undegraded":"2024-09-12T01:10:23.617652+0000","last_fullsized":"2024-09-12T01:10:23.617652+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:18.258060+0000","last_clean_scrub_stamp":"2024-09-12T00:46:18.258060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:23.937023+0000","last_change":"2024-09-12T01:12:23.937023+0000","last_active":"2024-09-12T01:12:23.937023+0000","last_peered":"2024-09-12T01:12:23.937023+0000","last_clean":"2024-09-12T01:12:23.937023+0000","last_became_active":"2024-09-12T00:46:16.272417+0000","last_became_peered":"2024-09-12T00:46:16.272417+0000","last_unstale":"2024-09-12T01:12:23.937023+0000","last_undegraded":"2024-09-12T01:12:23.937023+0000","last_fullsized":"2024-09-12T01:12:23.937023+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T01:12:23.936919+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T01:12:23.936919+0000","last_clean_scrub_stamp":"2024-09-12T01:12:23.936919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:46.076986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2052,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'44","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:19.954274+0000","last_change":"2024-09-12T01:12:19.954274+0000","last_active":"2024-09-12T01:12:19.954274+0000","last_peered":"2024-09-12T01:12:19.954274+0000","last_clean":"2024-09-12T01:12:19.954274+0000","last_became_active":"2024-09-12T00:44:37.815722+0000","last_became_peered":"2024-09-12T00:44:37.815722+0000","last_unstale":"2024-09-12T01:12:19.954274+0000","last_undegraded":"2024-09-12T01:12:19.954274+0000","last_fullsized":"2024-09-12T01:12:19.954274+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T01:12:19.954184+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T01:12:19.954184+0000","last_clean_scrub_stamp":"2024-09-12T01:12:19.954184+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:39.041250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":150,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:25.359823+0000","last_change":"2024-09-12T01:12:25.359823+0000","last_active":"2024-09-12T01:12:25.359823+0000","last_peered":"2024-09-12T01:12:25.359823+0000","last_clean":"2024-09-12T01:12:25.359823+0000","last_became_active":"2024-09-12T00:56:52.989218+0000","last_became_peered":"2024-09-12T00:56:52.989218+0000","last_unstale":"2024-09-12T01:12:25.359823+0000","last_undegraded":"2024-09-12T01:12:25.359823+0000","last_fullsized":"2024-09-12T01:12:25.359823+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:25.359734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:25.359734+0000","last_clean_scrub_stamp":"2024-09-12T01:12:25.359734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:10.873812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.342931+0000","last_change":"2024-09-12T01:12:08.342931+0000","last_active":"2024-09-12T01:12:08.342931+0000","last_peered":"2024-09-12T01:12:08.342931+0000","last_clean":"2024-09-12T01:12:08.342931+0000","last_became_active":"2024-09-12T00:46:19.282270+0000","last_became_peered":"2024-09-12T00:46:19.282270+0000","last_unstale":"2024-09-12T01:12:08.342931+0000","last_undegraded":"2024-09-12T01:12:08.342931+0000","last_fullsized":"2024-09-12T01:12:08.342931+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:08.342829+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:08.342829+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.342829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:40.735440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.276560+0000","last_change":"2024-09-12T01:12:06.276560+0000","last_active":"2024-09-12T01:12:06.276560+0000","last_peered":"2024-09-12T01:12:06.276560+0000","last_clean":"2024-09-12T01:12:06.276560+0000","last_became_active":"2024-09-12T00:46:16.276368+0000","last_became_peered":"2024-09-12T00:46:16.276368+0000","last_unstale":"2024-09-12T01:12:06.276560+0000","last_undegraded":"2024-09-12T01:12:06.276560+0000","last_fullsized":"2024-09-12T01:12:06.276560+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:06.276465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:06.276465+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.276465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:41.953408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.970599+0000","last_change":"2024-09-12T01:12:18.970599+0000","last_active":"2024-09-12T01:12:18.970599+0000","last_peered":"2024-09-12T01:12:18.970599+0000","last_clean":"2024-09-12T01:12:18.970599+0000","last_became_active":"2024-09-12T00:44:37.821172+0000","last_became_peered":"2024-09-12T00:44:37.821172+0000","last_unstale":"2024-09-12T01:12:18.970599+0000","last_undegraded":"2024-09-12T01:12:18.970599+0000","last_fullsized":"2024-09-12T01:12:18.970599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T01:12:18.970505+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T01:12:18.970505+0000","last_clean_scrub_stamp":"2024-09-12T01:12:18.970505+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:30.864237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":156,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.610223+0000","last_change":"2024-09-12T00:56:52.993348+0000","last_active":"2024-09-12T01:09:28.610223+0000","last_peered":"2024-09-12T01:09:28.610223+0000","last_clean":"2024-09-12T01:09:28.610223+0000","last_became_active":"2024-09-12T00:56:52.993079+0000","last_became_peered":"2024-09-12T00:56:52.993079+0000","last_unstale":"2024-09-12T01:09:28.610223+0000","last_undegraded":"2024-09-12T01:09:28.610223+0000","last_fullsized":"2024-09-12T01:09:28.610223+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:56:51.966439+0000","last_clean_scrub_stamp":"2024-09-12T00:56:51.966439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.338219+0000","last_change":"2024-09-12T01:12:07.338219+0000","last_active":"2024-09-12T01:12:07.338219+0000","last_peered":"2024-09-12T01:12:07.338219+0000","last_clean":"2024-09-12T01:12:07.338219+0000","last_became_active":"2024-09-12T00:46:19.279630+0000","last_became_peered":"2024-09-12T00:46:19.279630+0000","last_unstale":"2024-09-12T01:12:07.338219+0000","last_undegraded":"2024-09-12T01:12:07.338219+0000","last_fullsized":"2024-09-12T01:12:07.338219+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:07.338132+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:07.338132+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.338132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.231901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.740030+0000","last_change":"2024-09-12T01:12:00.740030+0000","last_active":"2024-09-12T01:12:00.740030+0000","last_peered":"2024-09-12T01:12:00.740030+0000","last_clean":"2024-09-12T01:12:00.740030+0000","last_became_active":"2024-09-12T00:46:16.266854+0000","last_became_peered":"2024-09-12T00:46:16.266854+0000","last_unstale":"2024-09-12T01:12:00.740030+0000","last_undegraded":"2024-09-12T01:12:00.740030+0000","last_fullsized":"2024-09-12T01:12:00.740030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:00.739896+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:00.739896+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.739896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:37.172009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'16","reported_seq":91,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.436389+0000","last_change":"2024-09-12T01:11:58.436389+0000","last_active":"2024-09-12T01:11:58.436389+0000","last_peered":"2024-09-12T01:11:58.436389+0000","last_clean":"2024-09-12T01:11:58.436389+0000","last_became_active":"2024-09-12T00:44:37.822277+0000","last_became_peered":"2024-09-12T00:44:37.822277+0000","last_unstale":"2024-09-12T01:11:58.436389+0000","last_undegraded":"2024-09-12T01:11:58.436389+0000","last_fullsized":"2024-09-12T01:11:58.436389+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T01:11:58.436300+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T01:11:58.436300+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.436300+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:53.723745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'407","reported_seq":1187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.407182+0000","last_change":"2024-09-12T01:11:48.407090+0000","last_active":"2024-09-12T01:11:48.407182+0000","last_peered":"2024-09-12T01:11:48.407182+0000","last_clean":"2024-09-12T01:11:48.407182+0000","last_became_active":"2024-09-12T00:30:11.107706+0000","last_became_peered":"2024-09-12T00:30:11.107706+0000","last_unstale":"2024-09-12T01:11:48.407182+0000","last_undegraded":"2024-09-12T01:11:48.407182+0000","last_fullsized":"2024-09-12T01:11:48.407182+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T01:11:48.406922+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T01:11:48.406922+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.406922+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:05.383919+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436870,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":772,"num_read_kb":12989,"num_write":1306,"num_write_kb":41879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'141","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.834184+0000","last_change":"2024-09-12T01:11:47.834184+0000","last_active":"2024-09-12T01:11:47.834184+0000","last_peered":"2024-09-12T01:11:47.834184+0000","last_clean":"2024-09-12T01:11:47.834184+0000","last_became_active":"2024-09-12T00:30:13.126147+0000","last_became_peered":"2024-09-12T00:30:13.126147+0000","last_unstale":"2024-09-12T01:11:47.834184+0000","last_undegraded":"2024-09-12T01:11:47.834184+0000","last_fullsized":"2024-09-12T01:11:47.834184+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T01:11:47.834094+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T01:11:47.834094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.834094+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:12.812212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":527,"num_write":201,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'354","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.354790+0000","last_change":"2024-09-12T01:11:44.354725+0000","last_active":"2024-09-12T01:11:44.354790+0000","last_peered":"2024-09-12T01:11:44.354790+0000","last_clean":"2024-09-12T01:11:44.354790+0000","last_became_active":"2024-09-12T00:30:11.101252+0000","last_became_peered":"2024-09-12T00:30:11.101252+0000","last_unstale":"2024-09-12T01:11:44.354790+0000","last_undegraded":"2024-09-12T01:11:44.354790+0000","last_fullsized":"2024-09-12T01:11:44.354790+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-12T01:11:44.354589+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-12T01:11:44.354589+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.354589+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:43.412106+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":19965,"num_write":1084,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'209","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.857299+0000","last_change":"2024-09-12T01:11:55.857299+0000","last_active":"2024-09-12T01:11:55.857299+0000","last_peered":"2024-09-12T01:11:55.857299+0000","last_clean":"2024-09-12T01:11:55.857299+0000","last_became_active":"2024-09-12T00:30:13.123880+0000","last_became_peered":"2024-09-12T00:30:13.123880+0000","last_unstale":"2024-09-12T01:11:55.857299+0000","last_undegraded":"2024-09-12T01:11:55.857299+0000","last_fullsized":"2024-09-12T01:11:55.857299+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-12T01:11:55.857208+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-12T01:11:55.857208+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.857208+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:36.363370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":720,"num_write":314,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'300","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.325606+0000","last_change":"2024-09-12T01:11:43.325526+0000","last_active":"2024-09-12T01:11:43.325606+0000","last_peered":"2024-09-12T01:11:43.325606+0000","last_clean":"2024-09-12T01:11:43.325606+0000","last_became_active":"2024-09-12T00:30:11.096381+0000","last_became_peered":"2024-09-12T00:30:11.096381+0000","last_unstale":"2024-09-12T01:11:43.325606+0000","last_undegraded":"2024-09-12T01:11:43.325606+0000","last_fullsized":"2024-09-12T01:11:43.325606+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'300","last_scrub_stamp":"2024-09-12T01:11:43.325415+0000","last_deep_scrub":"264'300","last_deep_scrub_stamp":"2024-09-12T01:11:43.325415+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.325415+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:58.190997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155766,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":52760,"num_write":991,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'151","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.850009+0000","last_change":"2024-09-12T01:11:58.850009+0000","last_active":"2024-09-12T01:11:58.850009+0000","last_peered":"2024-09-12T01:11:58.850009+0000","last_clean":"2024-09-12T01:11:58.850009+0000","last_became_active":"2024-09-12T00:30:13.120834+0000","last_became_peered":"2024-09-12T00:30:13.120834+0000","last_unstale":"2024-09-12T01:11:58.850009+0000","last_undegraded":"2024-09-12T01:11:58.850009+0000","last_fullsized":"2024-09-12T01:11:58.850009+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T01:11:58.849919+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T01:11:58.849919+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.849919+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:44.007174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":556,"num_write":237,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'320","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.443115+0000","last_change":"2024-09-12T01:11:35.443053+0000","last_active":"2024-09-12T01:11:35.443115+0000","last_peered":"2024-09-12T01:11:35.443115+0000","last_clean":"2024-09-12T01:11:35.443115+0000","last_became_active":"2024-09-12T00:30:11.101773+0000","last_became_peered":"2024-09-12T00:30:11.101773+0000","last_unstale":"2024-09-12T01:11:35.443115+0000","last_undegraded":"2024-09-12T01:11:35.443115+0000","last_fullsized":"2024-09-12T01:11:35.443115+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'320","last_scrub_stamp":"2024-09-12T01:11:35.442897+0000","last_deep_scrub":"264'320","last_deep_scrub_stamp":"2024-09-12T01:11:35.442897+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.442897+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:33.195530+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262280,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":453,"num_read_kb":6783,"num_write":940,"num_write_kb":20709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4368","reported_seq":4975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.323139+0000","last_change":"2024-09-12T01:11:46.323139+0000","last_active":"2024-09-12T01:11:46.323139+0000","last_peered":"2024-09-12T01:11:46.323139+0000","last_clean":"2024-09-12T01:11:46.323139+0000","last_became_active":"2024-09-12T00:30:13.113812+0000","last_became_peered":"2024-09-12T00:30:13.113812+0000","last_unstale":"2024-09-12T01:11:46.323139+0000","last_undegraded":"2024-09-12T01:11:46.323139+0000","last_fullsized":"2024-09-12T01:11:46.323139+0000","mapping_epoch":28,"log_start":"264'4300","ondisk_log_start":"264'4300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4368","last_scrub_stamp":"2024-09-12T01:11:46.323056+0000","last_deep_scrub":"264'4368","last_deep_scrub_stamp":"2024-09-12T01:11:46.323056+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.323056+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:31.432326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17553,"num_read_kb":14742,"num_write":6586,"num_write_kb":3311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'326","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.473231+0000","last_change":"2024-09-12T01:11:37.473231+0000","last_active":"2024-09-12T01:11:37.473231+0000","last_peered":"2024-09-12T01:11:37.473231+0000","last_clean":"2024-09-12T01:11:37.473231+0000","last_became_active":"2024-09-12T00:30:11.097339+0000","last_became_peered":"2024-09-12T00:30:11.097339+0000","last_unstale":"2024-09-12T01:11:37.473231+0000","last_undegraded":"2024-09-12T01:11:37.473231+0000","last_fullsized":"2024-09-12T01:11:37.473231+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T01:11:37.473039+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T01:11:37.473039+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.473039+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:13.523857+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":4533,"num_write":1139,"num_write_kb":19662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"264'202","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.333099+0000","last_change":"2024-09-12T01:11:51.333000+0000","last_active":"2024-09-12T01:11:51.333099+0000","last_peered":"2024-09-12T01:11:51.333099+0000","last_clean":"2024-09-12T01:11:51.333099+0000","last_became_active":"2024-09-12T00:30:13.125363+0000","last_became_peered":"2024-09-12T00:30:13.125363+0000","last_unstale":"2024-09-12T01:11:51.333099+0000","last_undegraded":"2024-09-12T01:11:51.333099+0000","last_fullsized":"2024-09-12T01:11:51.333099+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T01:11:51.332895+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T01:11:51.332895+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.332895+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:19.094184+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":845,"num_read_kb":691,"num_write":311,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'352","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.393821+0000","last_change":"2024-09-12T01:11:34.393821+0000","last_active":"2024-09-12T01:11:34.393821+0000","last_peered":"2024-09-12T01:11:34.393821+0000","last_clean":"2024-09-12T01:11:34.393821+0000","last_became_active":"2024-09-12T00:30:11.104535+0000","last_became_peered":"2024-09-12T00:30:11.104535+0000","last_unstale":"2024-09-12T01:11:34.393821+0000","last_undegraded":"2024-09-12T01:11:34.393821+0000","last_fullsized":"2024-09-12T01:11:34.393821+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-12T01:11:34.393680+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-12T01:11:34.393680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.393680+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:03.783815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174750,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":66788,"num_write":989,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'115","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.451792+0000","last_change":"2024-09-12T01:11:44.451717+0000","last_active":"2024-09-12T01:11:44.451792+0000","last_peered":"2024-09-12T01:11:44.451792+0000","last_clean":"2024-09-12T01:11:44.451792+0000","last_became_active":"2024-09-12T00:30:13.124774+0000","last_became_peered":"2024-09-12T00:30:13.124774+0000","last_unstale":"2024-09-12T01:11:44.451792+0000","last_undegraded":"2024-09-12T01:11:44.451792+0000","last_fullsized":"2024-09-12T01:11:44.451792+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T01:11:44.451630+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T01:11:44.451630+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.451630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.872379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":451,"num_write":180,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'309","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.403865+0000","last_change":"2024-09-12T01:11:40.403865+0000","last_active":"2024-09-12T01:11:40.403865+0000","last_peered":"2024-09-12T01:11:40.403865+0000","last_clean":"2024-09-12T01:11:40.403865+0000","last_became_active":"2024-09-12T00:30:11.102281+0000","last_became_peered":"2024-09-12T00:30:11.102281+0000","last_unstale":"2024-09-12T01:11:40.403865+0000","last_undegraded":"2024-09-12T01:11:40.403865+0000","last_fullsized":"2024-09-12T01:11:40.403865+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T01:11:40.403724+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T01:11:40.403724+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.403724+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:13.642901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3622998,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":454,"num_read_kb":13880,"num_write":954,"num_write_kb":40348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'545","reported_seq":1250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.361177+0000","last_change":"2024-09-12T01:11:45.361112+0000","last_active":"2024-09-12T01:11:45.361177+0000","last_peered":"2024-09-12T01:11:45.361177+0000","last_clean":"2024-09-12T01:11:45.361177+0000","last_became_active":"2024-09-12T00:30:13.126123+0000","last_became_peered":"2024-09-12T00:30:13.126123+0000","last_unstale":"2024-09-12T01:11:45.361177+0000","last_undegraded":"2024-09-12T01:11:45.361177+0000","last_fullsized":"2024-09-12T01:11:45.361177+0000","mapping_epoch":28,"log_start":"264'500","ondisk_log_start":"264'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'545","last_scrub_stamp":"2024-09-12T01:11:45.361027+0000","last_deep_scrub":"264'545","last_deep_scrub_stamp":"2024-09-12T01:11:45.361027+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.361027+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:32.122143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2509,"num_read_kb":2200,"num_write":899,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25757,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'299","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.286745+0000","last_change":"2024-09-12T01:11:42.286745+0000","last_active":"2024-09-12T01:11:42.286745+0000","last_peered":"2024-09-12T01:11:42.286745+0000","last_clean":"2024-09-12T01:11:42.286745+0000","last_became_active":"2024-09-12T00:30:11.104084+0000","last_became_peered":"2024-09-12T00:30:11.104084+0000","last_unstale":"2024-09-12T01:11:42.286745+0000","last_undegraded":"2024-09-12T01:11:42.286745+0000","last_fullsized":"2024-09-12T01:11:42.286745+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T01:11:42.286619+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T01:11:42.286619+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.286619+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:50.160187+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":483,"num_read_kb":14633,"num_write":970,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'231","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.388819+0000","last_change":"2024-09-12T01:11:53.388819+0000","last_active":"2024-09-12T01:11:53.388819+0000","last_peered":"2024-09-12T01:11:53.388819+0000","last_clean":"2024-09-12T01:11:53.388819+0000","last_became_active":"2024-09-12T00:30:13.127581+0000","last_became_peered":"2024-09-12T00:30:13.127581+0000","last_unstale":"2024-09-12T01:11:53.388819+0000","last_undegraded":"2024-09-12T01:11:53.388819+0000","last_fullsized":"2024-09-12T01:11:53.388819+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T01:11:53.388734+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T01:11:53.388734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.388734+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:24.192130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1008,"num_read_kb":834,"num_write":338,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'462","reported_seq":1247,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.803436+0000","last_change":"2024-09-12T01:11:49.803359+0000","last_active":"2024-09-12T01:11:49.803436+0000","last_peered":"2024-09-12T01:11:49.803436+0000","last_clean":"2024-09-12T01:11:49.803436+0000","last_became_active":"2024-09-12T00:30:13.121154+0000","last_became_peered":"2024-09-12T00:30:13.121154+0000","last_unstale":"2024-09-12T01:11:49.803436+0000","last_undegraded":"2024-09-12T01:11:49.803436+0000","last_fullsized":"2024-09-12T01:11:49.803436+0000","mapping_epoch":28,"log_start":"264'400","ondisk_log_start":"264'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'462","last_scrub_stamp":"2024-09-12T01:11:49.803243+0000","last_deep_scrub":"264'462","last_deep_scrub_stamp":"2024-09-12T01:11:49.803243+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.803243+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:20.220457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2284,"num_read_kb":1967,"num_write":806,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'287","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.803024+0000","last_change":"2024-09-12T01:11:31.803024+0000","last_active":"2024-09-12T01:11:31.803024+0000","last_peered":"2024-09-12T01:11:31.803024+0000","last_clean":"2024-09-12T01:11:31.803024+0000","last_became_active":"2024-09-12T00:30:11.103437+0000","last_became_peered":"2024-09-12T00:30:11.103437+0000","last_unstale":"2024-09-12T01:11:31.803024+0000","last_undegraded":"2024-09-12T01:11:31.803024+0000","last_fullsized":"2024-09-12T01:11:31.803024+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'287","last_scrub_stamp":"2024-09-12T01:11:31.802921+0000","last_deep_scrub":"264'287","last_deep_scrub_stamp":"2024-09-12T01:11:31.802921+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.802921+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:24.521722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767235,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":430,"num_read_kb":35388,"num_write":888,"num_write_kb":32368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'227","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.433041+0000","last_change":"2024-09-12T01:11:45.432953+0000","last_active":"2024-09-12T01:11:45.433041+0000","last_peered":"2024-09-12T01:11:45.433041+0000","last_clean":"2024-09-12T01:11:45.433041+0000","last_became_active":"2024-09-12T00:30:13.128977+0000","last_became_peered":"2024-09-12T00:30:13.128977+0000","last_unstale":"2024-09-12T01:11:45.433041+0000","last_undegraded":"2024-09-12T01:11:45.433041+0000","last_fullsized":"2024-09-12T01:11:45.433041+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-12T01:11:45.432855+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-12T01:11:45.432855+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.432855+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.213964+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1058,"num_read_kb":878,"num_write":388,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'310","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.446257+0000","last_change":"2024-09-12T01:11:36.446257+0000","last_active":"2024-09-12T01:11:36.446257+0000","last_peered":"2024-09-12T01:11:36.446257+0000","last_clean":"2024-09-12T01:11:36.446257+0000","last_became_active":"2024-09-12T00:30:11.114961+0000","last_became_peered":"2024-09-12T00:30:11.114961+0000","last_unstale":"2024-09-12T01:11:36.446257+0000","last_undegraded":"2024-09-12T01:11:36.446257+0000","last_fullsized":"2024-09-12T01:11:36.446257+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T01:11:36.446124+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T01:11:36.446124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.446124+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.906220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":433,"num_read_kb":13562,"num_write":946,"num_write_kb":25787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'212","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.855711+0000","last_change":"2024-09-12T01:11:39.855585+0000","last_active":"2024-09-12T01:11:39.855711+0000","last_peered":"2024-09-12T01:11:39.855711+0000","last_clean":"2024-09-12T01:11:39.855711+0000","last_became_active":"2024-09-12T00:30:13.127190+0000","last_became_peered":"2024-09-12T00:30:13.127190+0000","last_unstale":"2024-09-12T01:11:39.855711+0000","last_undegraded":"2024-09-12T01:11:39.855711+0000","last_fullsized":"2024-09-12T01:11:39.855711+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T01:11:39.855488+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T01:11:39.855488+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.855488+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:33.985807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":739,"num_write":341,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'368","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.424540+0000","last_change":"2024-09-12T01:11:35.424540+0000","last_active":"2024-09-12T01:11:35.424540+0000","last_peered":"2024-09-12T01:11:35.424540+0000","last_clean":"2024-09-12T01:11:35.424540+0000","last_became_active":"2024-09-12T00:30:11.105844+0000","last_became_peered":"2024-09-12T00:30:11.105844+0000","last_unstale":"2024-09-12T01:11:35.424540+0000","last_undegraded":"2024-09-12T01:11:35.424540+0000","last_fullsized":"2024-09-12T01:11:35.424540+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-12T01:11:35.424385+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-12T01:11:35.424385+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.424385+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:55.565109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242896,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":46849,"num_write":1178,"num_write_kb":40470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'183","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.095594+0000","last_change":"2024-09-12T01:11:44.095594+0000","last_active":"2024-09-12T01:11:44.095594+0000","last_peered":"2024-09-12T01:11:44.095594+0000","last_clean":"2024-09-12T01:11:44.095594+0000","last_became_active":"2024-09-12T00:30:13.124627+0000","last_became_peered":"2024-09-12T00:30:13.124627+0000","last_unstale":"2024-09-12T01:11:44.095594+0000","last_undegraded":"2024-09-12T01:11:44.095594+0000","last_fullsized":"2024-09-12T01:11:44.095594+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-09-12T01:11:44.095499+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-09-12T01:11:44.095499+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.095499+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:48.009771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":804,"num_read_kb":662,"num_write":262,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'315","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.375607+0000","last_change":"2024-09-12T01:11:34.375607+0000","last_active":"2024-09-12T01:11:34.375607+0000","last_peered":"2024-09-12T01:11:34.375607+0000","last_clean":"2024-09-12T01:11:34.375607+0000","last_became_active":"2024-09-12T00:30:11.114309+0000","last_became_peered":"2024-09-12T00:30:11.114309+0000","last_unstale":"2024-09-12T01:11:34.375607+0000","last_undegraded":"2024-09-12T01:11:34.375607+0000","last_fullsized":"2024-09-12T01:11:34.375607+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T01:11:34.375465+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T01:11:34.375465+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.375465+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.864011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052685,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":64152,"num_write":970,"num_write_kb":27626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'205","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.391069+0000","last_change":"2024-09-12T01:11:52.391069+0000","last_active":"2024-09-12T01:11:52.391069+0000","last_peered":"2024-09-12T01:11:52.391069+0000","last_clean":"2024-09-12T01:11:52.391069+0000","last_became_active":"2024-09-12T00:30:13.129718+0000","last_became_peered":"2024-09-12T00:30:13.129718+0000","last_unstale":"2024-09-12T01:11:52.391069+0000","last_undegraded":"2024-09-12T01:11:52.391069+0000","last_fullsized":"2024-09-12T01:11:52.391069+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'205","last_scrub_stamp":"2024-09-12T01:11:52.390951+0000","last_deep_scrub":"264'205","last_deep_scrub_stamp":"2024-09-12T01:11:52.390951+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.390951+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:25.975769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":749,"num_write":336,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'388","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.074143+0000","last_change":"2024-09-12T01:11:37.074143+0000","last_active":"2024-09-12T01:11:37.074143+0000","last_peered":"2024-09-12T01:11:37.074143+0000","last_clean":"2024-09-12T01:11:37.074143+0000","last_became_active":"2024-09-12T00:30:11.108958+0000","last_became_peered":"2024-09-12T00:30:11.108958+0000","last_unstale":"2024-09-12T01:11:37.074143+0000","last_undegraded":"2024-09-12T01:11:37.074143+0000","last_fullsized":"2024-09-12T01:11:37.074143+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'388","last_scrub_stamp":"2024-09-12T01:11:37.074011+0000","last_deep_scrub":"264'388","last_deep_scrub_stamp":"2024-09-12T01:11:37.074011+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.074011+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:15.101690+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1489630,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":577,"num_read_kb":32016,"num_write":1378,"num_write_kb":50601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'152","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.881871+0000","last_change":"2024-09-12T01:11:41.881871+0000","last_active":"2024-09-12T01:11:41.881871+0000","last_peered":"2024-09-12T01:11:41.881871+0000","last_clean":"2024-09-12T01:11:41.881871+0000","last_became_active":"2024-09-12T00:30:13.126143+0000","last_became_peered":"2024-09-12T00:30:13.126143+0000","last_unstale":"2024-09-12T01:11:41.881871+0000","last_undegraded":"2024-09-12T01:11:41.881871+0000","last_fullsized":"2024-09-12T01:11:41.881871+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T01:11:41.881760+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T01:11:41.881760+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.881760+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:50.664271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":565,"num_write":225,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'347","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.071130+0000","last_change":"2024-09-12T01:11:38.071064+0000","last_active":"2024-09-12T01:11:38.071130+0000","last_peered":"2024-09-12T01:11:38.071130+0000","last_clean":"2024-09-12T01:11:38.071130+0000","last_became_active":"2024-09-12T00:30:11.096162+0000","last_became_peered":"2024-09-12T00:30:11.096162+0000","last_unstale":"2024-09-12T01:11:38.071130+0000","last_undegraded":"2024-09-12T01:11:38.071130+0000","last_fullsized":"2024-09-12T01:11:38.071130+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:38.070939+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:38.070939+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.070939+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.813945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340490,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":7249,"num_write":983,"num_write_kb":14577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'151","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.327934+0000","last_change":"2024-09-12T01:11:55.327934+0000","last_active":"2024-09-12T01:11:55.327934+0000","last_peered":"2024-09-12T01:11:55.327934+0000","last_clean":"2024-09-12T01:11:55.327934+0000","last_became_active":"2024-09-12T00:30:21.192654+0000","last_became_peered":"2024-09-12T00:30:21.192654+0000","last_unstale":"2024-09-12T01:11:55.327934+0000","last_undegraded":"2024-09-12T01:11:55.327934+0000","last_fullsized":"2024-09-12T01:11:55.327934+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T01:11:55.327843+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T01:11:55.327843+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.327843+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:24.249456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":350,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'101","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.031644+0000","last_change":"2024-09-12T01:11:42.031586+0000","last_active":"2024-09-12T01:11:42.031644+0000","last_peered":"2024-09-12T01:11:42.031644+0000","last_clean":"2024-09-12T01:11:42.031644+0000","last_became_active":"2024-09-12T00:30:13.130030+0000","last_became_peered":"2024-09-12T00:30:13.130030+0000","last_unstale":"2024-09-12T01:11:42.031644+0000","last_undegraded":"2024-09-12T01:11:42.031644+0000","last_fullsized":"2024-09-12T01:11:42.031644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T01:11:42.031492+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T01:11:42.031492+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.031492+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:53.639664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":143,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'440","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.883081+0000","last_change":"2024-09-12T01:11:38.883016+0000","last_active":"2024-09-12T01:11:38.883081+0000","last_peered":"2024-09-12T01:11:38.883081+0000","last_clean":"2024-09-12T01:11:38.883081+0000","last_became_active":"2024-09-12T00:30:46.767516+0000","last_became_peered":"2024-09-12T00:30:46.767516+0000","last_unstale":"2024-09-12T01:11:38.883081+0000","last_undegraded":"2024-09-12T01:11:38.883081+0000","last_fullsized":"2024-09-12T01:11:38.883081+0000","mapping_epoch":39,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'440","last_scrub_stamp":"2024-09-12T01:11:38.882878+0000","last_deep_scrub":"264'440","last_deep_scrub_stamp":"2024-09-12T01:11:38.882878+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.882878+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:35.403537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1451987,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38823,"num_write":1374,"num_write_kb":62705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,4],"acting":[3,5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.822489+0000","last_change":"2024-09-12T01:12:00.822489+0000","last_active":"2024-09-12T01:12:00.822489+0000","last_peered":"2024-09-12T01:12:00.822489+0000","last_clean":"2024-09-12T01:12:00.822489+0000","last_became_active":"2024-09-12T00:30:15.127067+0000","last_became_peered":"2024-09-12T00:30:15.127067+0000","last_unstale":"2024-09-12T01:12:00.822489+0000","last_undegraded":"2024-09-12T01:12:00.822489+0000","last_fullsized":"2024-09-12T01:12:00.822489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:00.822404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:00.822404+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.822404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:28.679018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'330","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.356814+0000","last_change":"2024-09-12T01:11:59.356814+0000","last_active":"2024-09-12T01:11:59.356814+0000","last_peered":"2024-09-12T01:11:59.356814+0000","last_clean":"2024-09-12T01:11:59.356814+0000","last_became_active":"2024-09-12T00:30:17.145455+0000","last_became_peered":"2024-09-12T00:30:17.145455+0000","last_unstale":"2024-09-12T01:11:59.356814+0000","last_undegraded":"2024-09-12T01:11:59.356814+0000","last_fullsized":"2024-09-12T01:11:59.356814+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-09-12T01:11:59.356704+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-09-12T01:11:59.356704+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.356704+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:54.248777+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45268,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":1055,"num_write":410,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.794369+0000","last_change":"2024-09-12T01:11:54.794369+0000","last_active":"2024-09-12T01:11:54.794369+0000","last_peered":"2024-09-12T01:11:54.794369+0000","last_clean":"2024-09-12T01:11:54.794369+0000","last_became_active":"2024-09-12T00:30:19.168192+0000","last_became_peered":"2024-09-12T00:30:19.168192+0000","last_unstale":"2024-09-12T01:11:54.794369+0000","last_undegraded":"2024-09-12T01:11:54.794369+0000","last_fullsized":"2024-09-12T01:11:54.794369+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.794275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.794275+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.794275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:44.014529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'149","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.784697+0000","last_change":"2024-09-12T01:11:59.784697+0000","last_active":"2024-09-12T01:11:59.784697+0000","last_peered":"2024-09-12T01:11:59.784697+0000","last_clean":"2024-09-12T01:11:59.784697+0000","last_became_active":"2024-09-12T00:30:21.189141+0000","last_became_peered":"2024-09-12T00:30:21.189141+0000","last_unstale":"2024-09-12T01:11:59.784697+0000","last_undegraded":"2024-09-12T01:11:59.784697+0000","last_fullsized":"2024-09-12T01:11:59.784697+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T01:11:59.784580+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T01:11:59.784580+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.784580+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:54.478034+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":204,"num_write":274,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'90","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.830989+0000","last_change":"2024-09-12T01:11:51.830989+0000","last_active":"2024-09-12T01:11:51.830989+0000","last_peered":"2024-09-12T01:11:51.830989+0000","last_clean":"2024-09-12T01:11:51.830989+0000","last_became_active":"2024-09-12T00:30:13.127577+0000","last_became_peered":"2024-09-12T00:30:13.127577+0000","last_unstale":"2024-09-12T01:11:51.830989+0000","last_undegraded":"2024-09-12T01:11:51.830989+0000","last_fullsized":"2024-09-12T01:11:51.830989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-09-12T01:11:51.830881+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-09-12T01:11:51.830881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.830881+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:18.867029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":367,"num_write":144,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'311","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.095163+0000","last_change":"2024-09-12T01:11:35.095067+0000","last_active":"2024-09-12T01:11:35.095163+0000","last_peered":"2024-09-12T01:11:35.095163+0000","last_clean":"2024-09-12T01:11:35.095163+0000","last_became_active":"2024-09-12T00:30:11.091860+0000","last_became_peered":"2024-09-12T00:30:11.091860+0000","last_unstale":"2024-09-12T01:11:35.095163+0000","last_undegraded":"2024-09-12T01:11:35.095163+0000","last_fullsized":"2024-09-12T01:11:35.095163+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T01:11:35.094942+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T01:11:35.094942+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.094942+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:31.385294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":88630,"num_write":981,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.307949+0000","last_change":"2024-09-12T01:11:51.307817+0000","last_active":"2024-09-12T01:11:51.307949+0000","last_peered":"2024-09-12T01:11:51.307949+0000","last_clean":"2024-09-12T01:11:51.307949+0000","last_became_active":"2024-09-12T00:30:15.130254+0000","last_became_peered":"2024-09-12T00:30:15.130254+0000","last_unstale":"2024-09-12T01:11:51.307949+0000","last_undegraded":"2024-09-12T01:11:51.307949+0000","last_fullsized":"2024-09-12T01:11:51.307949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.307722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.307722+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.307722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:56.894557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'112","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.814903+0000","last_change":"2024-09-12T01:11:49.814903+0000","last_active":"2024-09-12T01:11:49.814903+0000","last_peered":"2024-09-12T01:11:49.814903+0000","last_clean":"2024-09-12T01:11:49.814903+0000","last_became_active":"2024-09-12T00:30:17.148422+0000","last_became_peered":"2024-09-12T00:30:17.148422+0000","last_unstale":"2024-09-12T01:11:49.814903+0000","last_undegraded":"2024-09-12T01:11:49.814903+0000","last_fullsized":"2024-09-12T01:11:49.814903+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T01:11:49.814806+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T01:11:49.814806+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.814806+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:36.594354+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":99,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.784192+0000","last_change":"2024-09-12T01:11:53.784192+0000","last_active":"2024-09-12T01:11:53.784192+0000","last_peered":"2024-09-12T01:11:53.784192+0000","last_clean":"2024-09-12T01:11:53.784192+0000","last_became_active":"2024-09-12T00:30:19.163363+0000","last_became_peered":"2024-09-12T00:30:19.163363+0000","last_unstale":"2024-09-12T01:11:53.784192+0000","last_undegraded":"2024-09-12T01:11:53.784192+0000","last_fullsized":"2024-09-12T01:11:53.784192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.784070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.784070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.784070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:27.826504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'138","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.243432+0000","last_change":"2024-09-12T01:11:59.243432+0000","last_active":"2024-09-12T01:11:59.243432+0000","last_peered":"2024-09-12T01:11:59.243432+0000","last_clean":"2024-09-12T01:11:59.243432+0000","last_became_active":"2024-09-12T00:30:21.180419+0000","last_became_peered":"2024-09-12T00:30:21.180419+0000","last_unstale":"2024-09-12T01:11:59.243432+0000","last_undegraded":"2024-09-12T01:11:59.243432+0000","last_fullsized":"2024-09-12T01:11:59.243432+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-12T01:11:59.243350+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-12T01:11:59.243350+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.243350+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:06.416764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":136,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'120","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.315178+0000","last_change":"2024-09-12T01:11:47.315178+0000","last_active":"2024-09-12T01:11:47.315178+0000","last_peered":"2024-09-12T01:11:47.315178+0000","last_clean":"2024-09-12T01:11:47.315178+0000","last_became_active":"2024-09-12T00:30:13.126531+0000","last_became_peered":"2024-09-12T00:30:13.126531+0000","last_unstale":"2024-09-12T01:11:47.315178+0000","last_undegraded":"2024-09-12T01:11:47.315178+0000","last_fullsized":"2024-09-12T01:11:47.315178+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T01:11:47.315083+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T01:11:47.315083+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.315083+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:02.492593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":438,"num_write":171,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'350","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.902966+0000","last_change":"2024-09-12T01:11:40.902895+0000","last_active":"2024-09-12T01:11:40.902966+0000","last_peered":"2024-09-12T01:11:40.902966+0000","last_clean":"2024-09-12T01:11:40.902966+0000","last_became_active":"2024-09-12T00:30:11.110001+0000","last_became_peered":"2024-09-12T00:30:11.110001+0000","last_unstale":"2024-09-12T01:11:40.902966+0000","last_undegraded":"2024-09-12T01:11:40.902966+0000","last_fullsized":"2024-09-12T01:11:40.902966+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T01:11:40.902786+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T01:11:40.902786+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.902786+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:44.491567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371860,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":4100,"num_write":1032,"num_write_kb":26242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.272198+0000","last_change":"2024-09-12T01:11:52.272198+0000","last_active":"2024-09-12T01:11:52.272198+0000","last_peered":"2024-09-12T01:11:52.272198+0000","last_clean":"2024-09-12T01:11:52.272198+0000","last_became_active":"2024-09-12T00:30:15.125728+0000","last_became_peered":"2024-09-12T00:30:15.125728+0000","last_unstale":"2024-09-12T01:11:52.272198+0000","last_undegraded":"2024-09-12T01:11:52.272198+0000","last_fullsized":"2024-09-12T01:11:52.272198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.272102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.272102+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.272102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:19.840928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'152","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.325350+0000","last_change":"2024-09-12T01:11:58.325286+0000","last_active":"2024-09-12T01:11:58.325350+0000","last_peered":"2024-09-12T01:11:58.325350+0000","last_clean":"2024-09-12T01:11:58.325350+0000","last_became_active":"2024-09-12T00:30:17.144701+0000","last_became_peered":"2024-09-12T00:30:17.144701+0000","last_unstale":"2024-09-12T01:11:58.325350+0000","last_undegraded":"2024-09-12T01:11:58.325350+0000","last_fullsized":"2024-09-12T01:11:58.325350+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T01:11:58.325196+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T01:11:58.325196+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.325196+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:25.004989+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":141,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'778","reported_seq":2325,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.958583+0000","last_change":"2024-09-12T01:12:13.958583+0000","last_active":"2024-09-12T01:12:13.958583+0000","last_peered":"2024-09-12T01:12:13.958583+0000","last_clean":"2024-09-12T01:12:13.958583+0000","last_became_active":"2024-09-12T00:30:19.170568+0000","last_became_peered":"2024-09-12T00:30:19.170568+0000","last_unstale":"2024-09-12T01:12:13.958583+0000","last_undegraded":"2024-09-12T01:12:13.958583+0000","last_fullsized":"2024-09-12T01:12:13.958583+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'778","last_scrub_stamp":"2024-09-12T01:12:13.958501+0000","last_deep_scrub":"264'778","last_deep_scrub_stamp":"2024-09-12T01:12:13.958501+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.958501+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:57.331603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'215","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.422104+0000","last_change":"2024-09-12T01:11:57.422104+0000","last_active":"2024-09-12T01:11:57.422104+0000","last_peered":"2024-09-12T01:11:57.422104+0000","last_clean":"2024-09-12T01:11:57.422104+0000","last_became_active":"2024-09-12T00:30:21.188312+0000","last_became_peered":"2024-09-12T00:30:21.188312+0000","last_unstale":"2024-09-12T01:11:57.422104+0000","last_undegraded":"2024-09-12T01:11:57.422104+0000","last_fullsized":"2024-09-12T01:11:57.422104+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-09-12T01:11:57.422016+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-09-12T01:11:57.422016+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.422016+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:22.406098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":596,"num_write":468,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'84","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.309383+0000","last_change":"2024-09-12T01:11:49.309383+0000","last_active":"2024-09-12T01:11:49.309383+0000","last_peered":"2024-09-12T01:11:49.309383+0000","last_clean":"2024-09-12T01:11:49.309383+0000","last_became_active":"2024-09-12T00:30:13.125323+0000","last_became_peered":"2024-09-12T00:30:13.125323+0000","last_unstale":"2024-09-12T01:11:49.309383+0000","last_undegraded":"2024-09-12T01:11:49.309383+0000","last_fullsized":"2024-09-12T01:11:49.309383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T01:11:49.309301+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T01:11:49.309301+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.309301+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:50.800564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":383,"num_read_kb":333,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'407","reported_seq":1107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.820352+0000","last_change":"2024-09-12T01:11:30.820266+0000","last_active":"2024-09-12T01:11:30.820352+0000","last_peered":"2024-09-12T01:11:30.820352+0000","last_clean":"2024-09-12T01:11:30.820352+0000","last_became_active":"2024-09-12T00:30:11.101745+0000","last_became_peered":"2024-09-12T00:30:11.101745+0000","last_unstale":"2024-09-12T01:11:30.820352+0000","last_undegraded":"2024-09-12T01:11:30.820352+0000","last_fullsized":"2024-09-12T01:11:30.820352+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T01:11:30.820135+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T01:11:30.820135+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.820135+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:48.119318+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":23420,"num_write":1255,"num_write_kb":19418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.819892+0000","last_change":"2024-09-12T01:12:01.819892+0000","last_active":"2024-09-12T01:12:01.819892+0000","last_peered":"2024-09-12T01:12:01.819892+0000","last_clean":"2024-09-12T01:12:01.819892+0000","last_became_active":"2024-09-12T00:30:15.124597+0000","last_became_peered":"2024-09-12T00:30:15.124597+0000","last_unstale":"2024-09-12T01:12:01.819892+0000","last_undegraded":"2024-09-12T01:12:01.819892+0000","last_fullsized":"2024-09-12T01:12:01.819892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.819785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.819785+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.819785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:51.290859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'266","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.322995+0000","last_change":"2024-09-12T01:11:48.322995+0000","last_active":"2024-09-12T01:11:48.322995+0000","last_peered":"2024-09-12T01:11:48.322995+0000","last_clean":"2024-09-12T01:11:48.322995+0000","last_became_active":"2024-09-12T00:30:17.145866+0000","last_became_peered":"2024-09-12T00:30:17.145866+0000","last_unstale":"2024-09-12T01:11:48.322995+0000","last_undegraded":"2024-09-12T01:11:48.322995+0000","last_fullsized":"2024-09-12T01:11:48.322995+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T01:11:48.322893+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T01:11:48.322893+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.322893+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:17.414187+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47562,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":1006,"num_write":354,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'803","reported_seq":2270,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.429790+0000","last_change":"2024-09-12T01:12:01.429714+0000","last_active":"2024-09-12T01:12:01.429790+0000","last_peered":"2024-09-12T01:12:01.429790+0000","last_clean":"2024-09-12T01:12:01.429790+0000","last_became_active":"2024-09-12T00:30:19.172403+0000","last_became_peered":"2024-09-12T00:30:19.172403+0000","last_unstale":"2024-09-12T01:12:01.429790+0000","last_undegraded":"2024-09-12T01:12:01.429790+0000","last_fullsized":"2024-09-12T01:12:01.429790+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-12T01:12:01.429628+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-12T01:12:01.429628+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.429628+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:59.201995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'133","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.840668+0000","last_change":"2024-09-12T01:11:46.840668+0000","last_active":"2024-09-12T01:11:46.840668+0000","last_peered":"2024-09-12T01:11:46.840668+0000","last_clean":"2024-09-12T01:11:46.840668+0000","last_became_active":"2024-09-12T00:30:13.120524+0000","last_became_peered":"2024-09-12T00:30:13.120524+0000","last_unstale":"2024-09-12T01:11:46.840668+0000","last_undegraded":"2024-09-12T01:11:46.840668+0000","last_fullsized":"2024-09-12T01:11:46.840668+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-09-12T01:11:46.840552+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-09-12T01:11:46.840552+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.840552+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:14.214542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":538,"num_write":190,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3594,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'385","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.397564+0000","last_change":"2024-09-12T01:11:31.397564+0000","last_active":"2024-09-12T01:11:31.397564+0000","last_peered":"2024-09-12T01:11:31.397564+0000","last_clean":"2024-09-12T01:11:31.397564+0000","last_became_active":"2024-09-12T00:30:11.105769+0000","last_became_peered":"2024-09-12T00:30:11.105769+0000","last_unstale":"2024-09-12T01:11:31.397564+0000","last_undegraded":"2024-09-12T01:11:31.397564+0000","last_fullsized":"2024-09-12T01:11:31.397564+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T01:11:31.397440+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T01:11:31.397440+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.397440+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:46.946497+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8955677,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":22715,"num_write":1115,"num_write_kb":62157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.860393+0000","last_change":"2024-09-12T01:11:43.860393+0000","last_active":"2024-09-12T01:11:43.860393+0000","last_peered":"2024-09-12T01:11:43.860393+0000","last_clean":"2024-09-12T01:11:43.860393+0000","last_became_active":"2024-09-12T00:30:15.132719+0000","last_became_peered":"2024-09-12T00:30:15.132719+0000","last_unstale":"2024-09-12T01:11:43.860393+0000","last_undegraded":"2024-09-12T01:11:43.860393+0000","last_fullsized":"2024-09-12T01:11:43.860393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:43.860305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:43.860305+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.860305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:54.848289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'368","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.381765+0000","last_change":"2024-09-12T01:11:49.381765+0000","last_active":"2024-09-12T01:11:49.381765+0000","last_peered":"2024-09-12T01:11:49.381765+0000","last_clean":"2024-09-12T01:11:49.381765+0000","last_became_active":"2024-09-12T00:30:17.146465+0000","last_became_peered":"2024-09-12T00:30:17.146465+0000","last_unstale":"2024-09-12T01:11:49.381765+0000","last_undegraded":"2024-09-12T01:11:49.381765+0000","last_fullsized":"2024-09-12T01:11:49.381765+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-12T01:11:49.381635+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-12T01:11:49.381635+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.381635+0000","objects_scrubbed":10,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:35.562295+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45471,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":600,"num_read_kb":1250,"num_write":474,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.207983+0000","last_change":"2024-09-12T01:11:55.207983+0000","last_active":"2024-09-12T01:11:55.207983+0000","last_peered":"2024-09-12T01:11:55.207983+0000","last_clean":"2024-09-12T01:11:55.207983+0000","last_became_active":"2024-09-12T00:30:19.164249+0000","last_became_peered":"2024-09-12T00:30:19.164249+0000","last_unstale":"2024-09-12T01:11:55.207983+0000","last_undegraded":"2024-09-12T01:11:55.207983+0000","last_fullsized":"2024-09-12T01:11:55.207983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:55.207885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:55.207885+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.207885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:20.018136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'548","reported_seq":1365,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.374746+0000","last_change":"2024-09-12T01:11:55.374641+0000","last_active":"2024-09-12T01:11:55.374746+0000","last_peered":"2024-09-12T01:11:55.374746+0000","last_clean":"2024-09-12T01:11:55.374746+0000","last_became_active":"2024-09-12T00:30:21.189156+0000","last_became_peered":"2024-09-12T00:30:21.189156+0000","last_unstale":"2024-09-12T01:11:55.374746+0000","last_undegraded":"2024-09-12T01:11:55.374746+0000","last_fullsized":"2024-09-12T01:11:55.374746+0000","mapping_epoch":36,"log_start":"264'500","ondisk_log_start":"264'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'548","last_scrub_stamp":"2024-09-12T01:11:55.374537+0000","last_deep_scrub":"264'548","last_deep_scrub_stamp":"2024-09-12T01:11:55.374537+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.374537+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:47.353067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1309,"num_read_kb":1298,"num_write":1161,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'143","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.841516+0000","last_change":"2024-09-12T01:11:34.841516+0000","last_active":"2024-09-12T01:11:34.841516+0000","last_peered":"2024-09-12T01:11:34.841516+0000","last_clean":"2024-09-12T01:11:34.841516+0000","last_became_active":"2024-09-12T00:30:13.124006+0000","last_became_peered":"2024-09-12T00:30:13.124006+0000","last_unstale":"2024-09-12T01:11:34.841516+0000","last_undegraded":"2024-09-12T01:11:34.841516+0000","last_fullsized":"2024-09-12T01:11:34.841516+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-09-12T01:11:34.841433+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-09-12T01:11:34.841433+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.841433+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:22.429642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":534,"num_write":203,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'416","reported_seq":1230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.346226+0000","last_change":"2024-09-12T01:11:30.346226+0000","last_active":"2024-09-12T01:11:30.346226+0000","last_peered":"2024-09-12T01:11:30.346226+0000","last_clean":"2024-09-12T01:11:30.346226+0000","last_became_active":"2024-09-12T00:30:11.104314+0000","last_became_peered":"2024-09-12T00:30:11.104314+0000","last_unstale":"2024-09-12T01:11:30.346226+0000","last_undegraded":"2024-09-12T01:11:30.346226+0000","last_fullsized":"2024-09-12T01:11:30.346226+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.346090+0000","objects_scrubbed":12,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:23.118149+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496547,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":809,"num_read_kb":45639,"num_write":1542,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.086776+0000","last_change":"2024-09-12T01:11:45.086776+0000","last_active":"2024-09-12T01:11:45.086776+0000","last_peered":"2024-09-12T01:11:45.086776+0000","last_clean":"2024-09-12T01:11:45.086776+0000","last_became_active":"2024-09-12T00:30:15.125380+0000","last_became_peered":"2024-09-12T00:30:15.125380+0000","last_unstale":"2024-09-12T01:11:45.086776+0000","last_undegraded":"2024-09-12T01:11:45.086776+0000","last_fullsized":"2024-09-12T01:11:45.086776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.086679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.086679+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.086679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.313099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'258","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.321356+0000","last_change":"2024-09-12T01:11:57.321356+0000","last_active":"2024-09-12T01:11:57.321356+0000","last_peered":"2024-09-12T01:11:57.321356+0000","last_clean":"2024-09-12T01:11:57.321356+0000","last_became_active":"2024-09-12T00:30:17.145155+0000","last_became_peered":"2024-09-12T00:30:17.145155+0000","last_unstale":"2024-09-12T01:11:57.321356+0000","last_undegraded":"2024-09-12T01:11:57.321356+0000","last_fullsized":"2024-09-12T01:11:57.321356+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'258","last_scrub_stamp":"2024-09-12T01:11:57.321246+0000","last_deep_scrub":"264'258","last_deep_scrub_stamp":"2024-09-12T01:11:57.321246+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.321246+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:25.723354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53484,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":958,"num_write":338,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.374218+0000","last_change":"2024-09-12T01:12:04.374218+0000","last_active":"2024-09-12T01:12:04.374218+0000","last_peered":"2024-09-12T01:12:04.374218+0000","last_clean":"2024-09-12T01:12:04.374218+0000","last_became_active":"2024-09-12T00:30:19.171189+0000","last_became_peered":"2024-09-12T00:30:19.171189+0000","last_unstale":"2024-09-12T01:12:04.374218+0000","last_undegraded":"2024-09-12T01:12:04.374218+0000","last_fullsized":"2024-09-12T01:12:04.374218+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:04.374135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:04.374135+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.374135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:31.656837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2418","reported_seq":4291,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.824281+0000","last_change":"2024-09-12T01:11:56.824210+0000","last_active":"2024-09-12T01:11:56.824281+0000","last_peered":"2024-09-12T01:11:56.824281+0000","last_clean":"2024-09-12T01:11:56.824281+0000","last_became_active":"2024-09-12T00:30:21.183561+0000","last_became_peered":"2024-09-12T00:30:21.183561+0000","last_unstale":"2024-09-12T01:11:56.824281+0000","last_undegraded":"2024-09-12T01:11:56.824281+0000","last_fullsized":"2024-09-12T01:11:56.824281+0000","mapping_epoch":36,"log_start":"264'2400","ondisk_log_start":"264'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2418","last_scrub_stamp":"2024-09-12T01:11:56.824111+0000","last_deep_scrub":"264'2418","last_deep_scrub_stamp":"2024-09-12T01:11:56.824111+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.824111+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":2400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.381858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6196,"num_read_kb":6147,"num_write":4885,"num_write_kb":1795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'180","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.419931+0000","last_change":"2024-09-12T01:11:37.419931+0000","last_active":"2024-09-12T01:11:37.419931+0000","last_peered":"2024-09-12T01:11:37.419931+0000","last_clean":"2024-09-12T01:11:37.419931+0000","last_became_active":"2024-09-12T00:30:13.122098+0000","last_became_peered":"2024-09-12T00:30:13.122098+0000","last_unstale":"2024-09-12T01:11:37.419931+0000","last_undegraded":"2024-09-12T01:11:37.419931+0000","last_fullsized":"2024-09-12T01:11:37.419931+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T01:11:37.419846+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T01:11:37.419846+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.419846+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:33.172289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":634,"num_write":261,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'304","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.852338+0000","last_change":"2024-09-12T01:11:35.852338+0000","last_active":"2024-09-12T01:11:35.852338+0000","last_peered":"2024-09-12T01:11:35.852338+0000","last_clean":"2024-09-12T01:11:35.852338+0000","last_became_active":"2024-09-12T00:30:11.112302+0000","last_became_peered":"2024-09-12T00:30:11.112302+0000","last_unstale":"2024-09-12T01:11:35.852338+0000","last_undegraded":"2024-09-12T01:11:35.852338+0000","last_fullsized":"2024-09-12T01:11:35.852338+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-12T01:11:35.852227+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-12T01:11:35.852227+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.852227+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:03.092960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":10144,"num_write":972,"num_write_kb":18823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.407080+0000","last_change":"2024-09-12T01:11:55.407080+0000","last_active":"2024-09-12T01:11:55.407080+0000","last_peered":"2024-09-12T01:11:55.407080+0000","last_clean":"2024-09-12T01:11:55.407080+0000","last_became_active":"2024-09-12T00:30:15.129311+0000","last_became_peered":"2024-09-12T00:30:15.129311+0000","last_unstale":"2024-09-12T01:11:55.407080+0000","last_undegraded":"2024-09-12T01:11:55.407080+0000","last_fullsized":"2024-09-12T01:11:55.407080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:55.407003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:55.407003+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.407003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:30.044743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'314","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.940525+0000","last_change":"2024-09-12T01:12:04.940525+0000","last_active":"2024-09-12T01:12:04.940525+0000","last_peered":"2024-09-12T01:12:04.940525+0000","last_clean":"2024-09-12T01:12:04.940525+0000","last_became_active":"2024-09-12T00:30:17.147148+0000","last_became_peered":"2024-09-12T00:30:17.147148+0000","last_unstale":"2024-09-12T01:12:04.940525+0000","last_undegraded":"2024-09-12T01:12:04.940525+0000","last_fullsized":"2024-09-12T01:12:04.940525+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T01:12:04.940404+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T01:12:04.940404+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.940404+0000","objects_scrubbed":9,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:38.290878+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47594,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":517,"num_read_kb":1147,"num_write":414,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2339,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.420965+0000","last_change":"2024-09-12T01:12:00.420965+0000","last_active":"2024-09-12T01:12:00.420965+0000","last_peered":"2024-09-12T01:12:00.420965+0000","last_clean":"2024-09-12T01:12:00.420965+0000","last_became_active":"2024-09-12T00:30:19.168419+0000","last_became_peered":"2024-09-12T00:30:19.168419+0000","last_unstale":"2024-09-12T01:12:00.420965+0000","last_undegraded":"2024-09-12T01:12:00.420965+0000","last_fullsized":"2024-09-12T01:12:00.420965+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-12T01:12:00.420887+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-12T01:12:00.420887+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.420887+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:46.132374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'163","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.227428+0000","last_change":"2024-09-12T01:11:58.227428+0000","last_active":"2024-09-12T01:11:58.227428+0000","last_peered":"2024-09-12T01:11:58.227428+0000","last_clean":"2024-09-12T01:11:58.227428+0000","last_became_active":"2024-09-12T00:30:21.179533+0000","last_became_peered":"2024-09-12T00:30:21.179533+0000","last_unstale":"2024-09-12T01:11:58.227428+0000","last_undegraded":"2024-09-12T01:11:58.227428+0000","last_fullsized":"2024-09-12T01:11:58.227428+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T01:11:58.227343+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T01:11:58.227343+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.227343+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:34.643155+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":87,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'98","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.293986+0000","last_change":"2024-09-12T01:11:46.293986+0000","last_active":"2024-09-12T01:11:46.293986+0000","last_peered":"2024-09-12T01:11:46.293986+0000","last_clean":"2024-09-12T01:11:46.293986+0000","last_became_active":"2024-09-12T00:30:13.131423+0000","last_became_peered":"2024-09-12T00:30:13.131423+0000","last_unstale":"2024-09-12T01:11:46.293986+0000","last_undegraded":"2024-09-12T01:11:46.293986+0000","last_fullsized":"2024-09-12T01:11:46.293986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'98","last_scrub_stamp":"2024-09-12T01:11:46.293901+0000","last_deep_scrub":"264'98","last_deep_scrub_stamp":"2024-09-12T01:11:46.293901+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.293901+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:41.760950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":366,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'380","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.402539+0000","last_change":"2024-09-12T01:11:33.402539+0000","last_active":"2024-09-12T01:11:33.402539+0000","last_peered":"2024-09-12T01:11:33.402539+0000","last_clean":"2024-09-12T01:11:33.402539+0000","last_became_active":"2024-09-12T00:30:11.103285+0000","last_became_peered":"2024-09-12T00:30:11.103285+0000","last_unstale":"2024-09-12T01:11:33.402539+0000","last_undegraded":"2024-09-12T01:11:33.402539+0000","last_fullsized":"2024-09-12T01:11:33.402539+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-12T01:11:33.402382+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-12T01:11:33.402382+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.402382+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:57.850138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":3264,"num_write":1093,"num_write_kb":35970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.102852+0000","last_change":"2024-09-12T01:11:46.102852+0000","last_active":"2024-09-12T01:11:46.102852+0000","last_peered":"2024-09-12T01:11:46.102852+0000","last_clean":"2024-09-12T01:11:46.102852+0000","last_became_active":"2024-09-12T00:30:15.132695+0000","last_became_peered":"2024-09-12T00:30:15.132695+0000","last_unstale":"2024-09-12T01:11:46.102852+0000","last_undegraded":"2024-09-12T01:11:46.102852+0000","last_fullsized":"2024-09-12T01:11:46.102852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.102769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.102769+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.102769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:16.249060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'464","reported_seq":1105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.334024+0000","last_change":"2024-09-12T01:11:55.334024+0000","last_active":"2024-09-12T01:11:55.334024+0000","last_peered":"2024-09-12T01:11:55.334024+0000","last_clean":"2024-09-12T01:11:55.334024+0000","last_became_active":"2024-09-12T00:30:17.147015+0000","last_became_peered":"2024-09-12T00:30:17.147015+0000","last_unstale":"2024-09-12T01:11:55.334024+0000","last_undegraded":"2024-09-12T01:11:55.334024+0000","last_fullsized":"2024-09-12T01:11:55.334024+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'464","last_scrub_stamp":"2024-09-12T01:11:55.333937+0000","last_deep_scrub":"264'464","last_deep_scrub_stamp":"2024-09-12T01:11:55.333937+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.333937+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:17.007555+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69788,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":1853,"num_write":630,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.438295+0000","last_change":"2024-09-12T01:11:59.438295+0000","last_active":"2024-09-12T01:11:59.438295+0000","last_peered":"2024-09-12T01:11:59.438295+0000","last_clean":"2024-09-12T01:11:59.438295+0000","last_became_active":"2024-09-12T00:30:19.167503+0000","last_became_peered":"2024-09-12T00:30:19.167503+0000","last_unstale":"2024-09-12T01:11:59.438295+0000","last_undegraded":"2024-09-12T01:11:59.438295+0000","last_fullsized":"2024-09-12T01:11:59.438295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:59.438199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:59.438199+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.438199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:02.777851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'97","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.685630+0000","last_change":"2024-09-12T01:11:55.685630+0000","last_active":"2024-09-12T01:11:55.685630+0000","last_peered":"2024-09-12T01:11:55.685630+0000","last_clean":"2024-09-12T01:11:55.685630+0000","last_became_active":"2024-09-12T00:30:21.192700+0000","last_became_peered":"2024-09-12T00:30:21.192700+0000","last_unstale":"2024-09-12T01:11:55.685630+0000","last_undegraded":"2024-09-12T01:11:55.685630+0000","last_fullsized":"2024-09-12T01:11:55.685630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-12T01:11:55.685541+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-12T01:11:55.685541+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.685541+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:52.590816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":205,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'119","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.435937+0000","last_change":"2024-09-12T01:11:38.435937+0000","last_active":"2024-09-12T01:11:38.435937+0000","last_peered":"2024-09-12T01:11:38.435937+0000","last_clean":"2024-09-12T01:11:38.435937+0000","last_became_active":"2024-09-12T00:30:13.128253+0000","last_became_peered":"2024-09-12T00:30:13.128253+0000","last_unstale":"2024-09-12T01:11:38.435937+0000","last_undegraded":"2024-09-12T01:11:38.435937+0000","last_fullsized":"2024-09-12T01:11:38.435937+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T01:11:38.435862+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T01:11:38.435862+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.435862+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.099253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":431,"num_write":189,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'311","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.492446+0000","last_change":"2024-09-12T01:11:33.492446+0000","last_active":"2024-09-12T01:11:33.492446+0000","last_peered":"2024-09-12T01:11:33.492446+0000","last_clean":"2024-09-12T01:11:33.492446+0000","last_became_active":"2024-09-12T00:30:11.100056+0000","last_became_peered":"2024-09-12T00:30:11.100056+0000","last_unstale":"2024-09-12T01:11:33.492446+0000","last_undegraded":"2024-09-12T01:11:33.492446+0000","last_fullsized":"2024-09-12T01:11:33.492446+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T01:11:33.492354+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T01:11:33.492354+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.492354+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:25.053401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":62849,"num_write":1084,"num_write_kb":31335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.557200+0000","last_change":"2024-09-12T01:11:47.557200+0000","last_active":"2024-09-12T01:11:47.557200+0000","last_peered":"2024-09-12T01:11:47.557200+0000","last_clean":"2024-09-12T01:11:47.557200+0000","last_became_active":"2024-09-12T00:30:15.132801+0000","last_became_peered":"2024-09-12T00:30:15.132801+0000","last_unstale":"2024-09-12T01:11:47.557200+0000","last_undegraded":"2024-09-12T01:11:47.557200+0000","last_fullsized":"2024-09-12T01:11:47.557200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.557077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.557077+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.557077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:33.239839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'299","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.864074+0000","last_change":"2024-09-12T01:11:48.864074+0000","last_active":"2024-09-12T01:11:48.864074+0000","last_peered":"2024-09-12T01:11:48.864074+0000","last_clean":"2024-09-12T01:11:48.864074+0000","last_became_active":"2024-09-12T00:30:17.149603+0000","last_became_peered":"2024-09-12T00:30:17.149603+0000","last_unstale":"2024-09-12T01:11:48.864074+0000","last_undegraded":"2024-09-12T01:11:48.864074+0000","last_fullsized":"2024-09-12T01:11:48.864074+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T01:11:48.863986+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T01:11:48.863986+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.863986+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:22.417240+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57292,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":510,"num_read_kb":1117,"num_write":456,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.581178+0000","last_change":"2024-09-12T01:11:50.581178+0000","last_active":"2024-09-12T01:11:50.581178+0000","last_peered":"2024-09-12T01:11:50.581178+0000","last_clean":"2024-09-12T01:11:50.581178+0000","last_became_active":"2024-09-12T00:30:19.168223+0000","last_became_peered":"2024-09-12T00:30:19.168223+0000","last_unstale":"2024-09-12T01:11:50.581178+0000","last_undegraded":"2024-09-12T01:11:50.581178+0000","last_fullsized":"2024-09-12T01:11:50.581178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.581086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.581086+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.581086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:20.933529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'127","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.452059+0000","last_change":"2024-09-12T01:12:04.452004+0000","last_active":"2024-09-12T01:12:04.452059+0000","last_peered":"2024-09-12T01:12:04.452059+0000","last_clean":"2024-09-12T01:12:04.452059+0000","last_became_active":"2024-09-12T00:30:21.192509+0000","last_became_peered":"2024-09-12T00:30:21.192509+0000","last_unstale":"2024-09-12T01:12:04.452059+0000","last_undegraded":"2024-09-12T01:12:04.452059+0000","last_fullsized":"2024-09-12T01:12:04.452059+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-12T01:12:04.451918+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-12T01:12:04.451918+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.451918+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:01.817710+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'134","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.852081+0000","last_change":"2024-09-12T01:11:50.852081+0000","last_active":"2024-09-12T01:11:50.852081+0000","last_peered":"2024-09-12T01:11:50.852081+0000","last_clean":"2024-09-12T01:11:50.852081+0000","last_became_active":"2024-09-12T00:30:13.123412+0000","last_became_peered":"2024-09-12T00:30:13.123412+0000","last_unstale":"2024-09-12T01:11:50.852081+0000","last_undegraded":"2024-09-12T01:11:50.852081+0000","last_fullsized":"2024-09-12T01:11:50.852081+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-12T01:11:50.851995+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-12T01:11:50.851995+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.851995+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:08.959022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":514,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'283","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.891985+0000","last_change":"2024-09-12T01:11:37.891985+0000","last_active":"2024-09-12T01:11:37.891985+0000","last_peered":"2024-09-12T01:11:37.891985+0000","last_clean":"2024-09-12T01:11:37.891985+0000","last_became_active":"2024-09-12T00:30:11.097902+0000","last_became_peered":"2024-09-12T00:30:11.097902+0000","last_unstale":"2024-09-12T01:11:37.891985+0000","last_undegraded":"2024-09-12T01:11:37.891985+0000","last_fullsized":"2024-09-12T01:11:37.891985+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T01:11:37.891780+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T01:11:37.891780+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.891780+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:26.776654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170421,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":17154,"num_write":985,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.417233+0000","last_change":"2024-09-12T01:11:54.417233+0000","last_active":"2024-09-12T01:11:54.417233+0000","last_peered":"2024-09-12T01:11:54.417233+0000","last_clean":"2024-09-12T01:11:54.417233+0000","last_became_active":"2024-09-12T00:30:15.125629+0000","last_became_peered":"2024-09-12T00:30:15.125629+0000","last_unstale":"2024-09-12T01:11:54.417233+0000","last_undegraded":"2024-09-12T01:11:54.417233+0000","last_fullsized":"2024-09-12T01:11:54.417233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.417146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.417146+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.417146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:07.825711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'290","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.462086+0000","last_change":"2024-09-12T01:11:58.462086+0000","last_active":"2024-09-12T01:11:58.462086+0000","last_peered":"2024-09-12T01:11:58.462086+0000","last_clean":"2024-09-12T01:11:58.462086+0000","last_became_active":"2024-09-12T00:30:17.149661+0000","last_became_peered":"2024-09-12T00:30:17.149661+0000","last_unstale":"2024-09-12T01:11:58.462086+0000","last_undegraded":"2024-09-12T01:11:58.462086+0000","last_fullsized":"2024-09-12T01:11:58.462086+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'290","last_scrub_stamp":"2024-09-12T01:11:58.461988+0000","last_deep_scrub":"264'290","last_deep_scrub_stamp":"2024-09-12T01:11:58.461988+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.461988+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:56.514745+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59535,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":1016,"num_write":372,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'762","reported_seq":2265,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.569125+0000","last_change":"2024-09-12T01:11:49.569125+0000","last_active":"2024-09-12T01:11:49.569125+0000","last_peered":"2024-09-12T01:11:49.569125+0000","last_clean":"2024-09-12T01:11:49.569125+0000","last_became_active":"2024-09-12T00:30:19.167476+0000","last_became_peered":"2024-09-12T00:30:19.167476+0000","last_unstale":"2024-09-12T01:11:49.569125+0000","last_undegraded":"2024-09-12T01:11:49.569125+0000","last_fullsized":"2024-09-12T01:11:49.569125+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'762","last_scrub_stamp":"2024-09-12T01:11:49.569037+0000","last_deep_scrub":"264'762","last_deep_scrub_stamp":"2024-09-12T01:11:49.569037+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.569037+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:56.774664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'163","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.191869+0000","last_change":"2024-09-12T01:11:57.191808+0000","last_active":"2024-09-12T01:11:57.191869+0000","last_peered":"2024-09-12T01:11:57.191869+0000","last_clean":"2024-09-12T01:11:57.191869+0000","last_became_active":"2024-09-12T00:30:21.185553+0000","last_became_peered":"2024-09-12T00:30:21.185553+0000","last_unstale":"2024-09-12T01:11:57.191869+0000","last_undegraded":"2024-09-12T01:11:57.191869+0000","last_fullsized":"2024-09-12T01:11:57.191869+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T01:11:57.191712+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T01:11:57.191712+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.191712+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:35.496120+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":222,"num_write":391,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'167","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.347977+0000","last_change":"2024-09-12T01:11:40.347977+0000","last_active":"2024-09-12T01:11:40.347977+0000","last_peered":"2024-09-12T01:11:40.347977+0000","last_clean":"2024-09-12T01:11:40.347977+0000","last_became_active":"2024-09-12T00:30:13.121664+0000","last_became_peered":"2024-09-12T00:30:13.121664+0000","last_unstale":"2024-09-12T01:11:40.347977+0000","last_undegraded":"2024-09-12T01:11:40.347977+0000","last_fullsized":"2024-09-12T01:11:40.347977+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-09-12T01:11:40.347879+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-09-12T01:11:40.347879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.347879+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:35.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":568,"num_write":259,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'538","reported_seq":1360,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.895438+0000","last_change":"2024-09-12T01:11:34.895438+0000","last_active":"2024-09-12T01:11:34.895438+0000","last_peered":"2024-09-12T01:11:34.895438+0000","last_clean":"2024-09-12T01:11:34.895438+0000","last_became_active":"2024-09-12T00:30:11.110370+0000","last_became_peered":"2024-09-12T00:30:11.110370+0000","last_unstale":"2024-09-12T01:11:34.895438+0000","last_undegraded":"2024-09-12T01:11:34.895438+0000","last_fullsized":"2024-09-12T01:11:34.895438+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'538","last_scrub_stamp":"2024-09-12T01:11:34.895276+0000","last_deep_scrub":"264'538","last_deep_scrub_stamp":"2024-09-12T01:11:34.895276+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.895276+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:45.682560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174759,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1243,"num_read_kb":75461,"num_write":1612,"num_write_kb":22075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1463,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.870320+0000","last_change":"2024-09-12T01:11:44.870320+0000","last_active":"2024-09-12T01:11:44.870320+0000","last_peered":"2024-09-12T01:11:44.870320+0000","last_clean":"2024-09-12T01:11:44.870320+0000","last_became_active":"2024-09-12T00:30:15.132802+0000","last_became_peered":"2024-09-12T00:30:15.132802+0000","last_unstale":"2024-09-12T01:11:44.870320+0000","last_undegraded":"2024-09-12T01:11:44.870320+0000","last_fullsized":"2024-09-12T01:11:44.870320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:11:44.870207+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:11:44.870207+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.870207+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:45.970093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'79","reported_seq":596,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.170222+0000","last_change":"2024-09-12T01:11:51.170222+0000","last_active":"2024-09-12T01:11:51.170222+0000","last_peered":"2024-09-12T01:11:51.170222+0000","last_clean":"2024-09-12T01:11:51.170222+0000","last_became_active":"2024-09-12T00:30:17.147864+0000","last_became_peered":"2024-09-12T00:30:17.147864+0000","last_unstale":"2024-09-12T01:11:51.170222+0000","last_undegraded":"2024-09-12T01:11:51.170222+0000","last_fullsized":"2024-09-12T01:11:51.170222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-09-12T01:11:51.170119+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-09-12T01:11:51.170119+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.170119+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:54.031616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'783","reported_seq":2342,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.760830+0000","last_change":"2024-09-12T01:11:51.760830+0000","last_active":"2024-09-12T01:11:51.760830+0000","last_peered":"2024-09-12T01:11:51.760830+0000","last_clean":"2024-09-12T01:11:51.760830+0000","last_became_active":"2024-09-12T00:30:19.168960+0000","last_became_peered":"2024-09-12T00:30:19.168960+0000","last_unstale":"2024-09-12T01:11:51.760830+0000","last_undegraded":"2024-09-12T01:11:51.760830+0000","last_fullsized":"2024-09-12T01:11:51.760830+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'783","last_scrub_stamp":"2024-09-12T01:11:51.760734+0000","last_deep_scrub":"264'783","last_deep_scrub_stamp":"2024-09-12T01:11:51.760734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.760734+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:25.225611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'119","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.324365+0000","last_change":"2024-09-12T01:11:54.324300+0000","last_active":"2024-09-12T01:11:54.324365+0000","last_peered":"2024-09-12T01:11:54.324365+0000","last_clean":"2024-09-12T01:11:54.324365+0000","last_became_active":"2024-09-12T00:30:21.185618+0000","last_became_peered":"2024-09-12T00:30:21.185618+0000","last_unstale":"2024-09-12T01:11:54.324365+0000","last_undegraded":"2024-09-12T01:11:54.324365+0000","last_fullsized":"2024-09-12T01:11:54.324365+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T01:11:54.324212+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T01:11:54.324212+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.324212+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:45.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":151,"num_write":299,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":906,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.526779+0000","last_change":"2024-09-12T01:11:35.526779+0000","last_active":"2024-09-12T01:11:35.526779+0000","last_peered":"2024-09-12T01:11:35.526779+0000","last_clean":"2024-09-12T01:11:35.526779+0000","last_became_active":"2024-09-12T00:30:13.129892+0000","last_became_peered":"2024-09-12T00:30:13.129892+0000","last_unstale":"2024-09-12T01:11:35.526779+0000","last_undegraded":"2024-09-12T01:11:35.526779+0000","last_fullsized":"2024-09-12T01:11:35.526779+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T01:11:35.526685+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T01:11:35.526685+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.526685+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:59.274285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":984,"num_read_kb":836,"num_write":303,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'321","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.382246+0000","last_change":"2024-09-12T01:11:34.382246+0000","last_active":"2024-09-12T01:11:34.382246+0000","last_peered":"2024-09-12T01:11:34.382246+0000","last_clean":"2024-09-12T01:11:34.382246+0000","last_became_active":"2024-09-12T00:30:11.103195+0000","last_became_peered":"2024-09-12T00:30:11.103195+0000","last_unstale":"2024-09-12T01:11:34.382246+0000","last_undegraded":"2024-09-12T01:11:34.382246+0000","last_fullsized":"2024-09-12T01:11:34.382246+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T01:11:34.382128+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T01:11:34.382128+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.382128+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:39.745506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254394,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":8246,"num_write":945,"num_write_kb":41947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.905296+0000","last_change":"2024-09-12T01:11:56.905296+0000","last_active":"2024-09-12T01:11:56.905296+0000","last_peered":"2024-09-12T01:11:56.905296+0000","last_clean":"2024-09-12T01:11:56.905296+0000","last_became_active":"2024-09-12T00:30:15.127047+0000","last_became_peered":"2024-09-12T00:30:15.127047+0000","last_unstale":"2024-09-12T01:11:56.905296+0000","last_undegraded":"2024-09-12T01:11:56.905296+0000","last_fullsized":"2024-09-12T01:11:56.905296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:56.905201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:56.905201+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.905201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.672497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'316","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.848686+0000","last_change":"2024-09-12T01:11:46.848686+0000","last_active":"2024-09-12T01:11:46.848686+0000","last_peered":"2024-09-12T01:11:46.848686+0000","last_clean":"2024-09-12T01:11:46.848686+0000","last_became_active":"2024-09-12T00:30:17.149579+0000","last_became_peered":"2024-09-12T00:30:17.149579+0000","last_unstale":"2024-09-12T01:11:46.848686+0000","last_undegraded":"2024-09-12T01:11:46.848686+0000","last_fullsized":"2024-09-12T01:11:46.848686+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T01:11:46.848586+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T01:11:46.848586+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.848586+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:28.252461+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":993,"num_write":388,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.363086+0000","last_change":"2024-09-12T01:11:51.363086+0000","last_active":"2024-09-12T01:11:51.363086+0000","last_peered":"2024-09-12T01:11:51.363086+0000","last_clean":"2024-09-12T01:11:51.363086+0000","last_became_active":"2024-09-12T00:30:19.169468+0000","last_became_peered":"2024-09-12T00:30:19.169468+0000","last_unstale":"2024-09-12T01:11:51.363086+0000","last_undegraded":"2024-09-12T01:11:51.363086+0000","last_fullsized":"2024-09-12T01:11:51.363086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.362984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.362984+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.362984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:04.867972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'113","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.640181+0000","last_change":"2024-09-12T01:11:54.640109+0000","last_active":"2024-09-12T01:11:54.640181+0000","last_peered":"2024-09-12T01:11:54.640181+0000","last_clean":"2024-09-12T01:11:54.640181+0000","last_became_active":"2024-09-12T00:30:21.184033+0000","last_became_peered":"2024-09-12T00:30:21.184033+0000","last_unstale":"2024-09-12T01:11:54.640181+0000","last_undegraded":"2024-09-12T01:11:54.640181+0000","last_fullsized":"2024-09-12T01:11:54.640181+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-12T01:11:54.640026+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-12T01:11:54.640026+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.640026+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:34.375790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":266,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'245","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.861331+0000","last_change":"2024-09-12T01:11:47.861264+0000","last_active":"2024-09-12T01:11:47.861331+0000","last_peered":"2024-09-12T01:11:47.861331+0000","last_clean":"2024-09-12T01:11:47.861331+0000","last_became_active":"2024-09-12T00:30:13.120962+0000","last_became_peered":"2024-09-12T00:30:13.120962+0000","last_unstale":"2024-09-12T01:11:47.861331+0000","last_undegraded":"2024-09-12T01:11:47.861331+0000","last_fullsized":"2024-09-12T01:11:47.861331+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T01:11:47.861179+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T01:11:47.861179+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.861179+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:22.003599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":839,"num_write":403,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.846255+0000","last_change":"2024-09-12T01:11:29.846210+0000","last_active":"2024-09-12T01:11:29.846255+0000","last_peered":"2024-09-12T01:11:29.846255+0000","last_clean":"2024-09-12T01:11:29.846255+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T01:11:29.846255+0000","last_undegraded":"2024-09-12T01:11:29.846255+0000","last_fullsized":"2024-09-12T01:11:29.846255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T01:11:29.846146+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T01:11:29.846146+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.846146+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:43.920303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.905025+0000","last_change":"2024-09-12T01:11:30.904927+0000","last_active":"2024-09-12T01:11:30.905025+0000","last_peered":"2024-09-12T01:11:30.905025+0000","last_clean":"2024-09-12T01:11:30.905025+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T01:11:30.905025+0000","last_undegraded":"2024-09-12T01:11:30.905025+0000","last_fullsized":"2024-09-12T01:11:30.905025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:30.904805+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:30.904805+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.904805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:38.997041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'317","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.380787+0000","last_change":"2024-09-12T01:11:32.380726+0000","last_active":"2024-09-12T01:11:32.380787+0000","last_peered":"2024-09-12T01:11:32.380787+0000","last_clean":"2024-09-12T01:11:32.380787+0000","last_became_active":"2024-09-12T00:30:11.102144+0000","last_became_peered":"2024-09-12T00:30:11.102144+0000","last_unstale":"2024-09-12T01:11:32.380787+0000","last_undegraded":"2024-09-12T01:11:32.380787+0000","last_fullsized":"2024-09-12T01:11:32.380787+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T01:11:32.380545+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T01:11:32.380545+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.380545+0000","objects_scrubbed":12,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:59.777398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505108,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":430,"num_read_kb":17991,"num_write":985,"num_write_kb":40410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"264'4","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.366291+0000","last_change":"2024-09-12T01:11:42.366234+0000","last_active":"2024-09-12T01:11:42.366291+0000","last_peered":"2024-09-12T01:11:42.366291+0000","last_clean":"2024-09-12T01:11:42.366291+0000","last_became_active":"2024-09-12T00:30:15.132332+0000","last_became_peered":"2024-09-12T00:30:15.132332+0000","last_unstale":"2024-09-12T01:11:42.366291+0000","last_undegraded":"2024-09-12T01:11:42.366291+0000","last_fullsized":"2024-09-12T01:11:42.366291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:11:42.366139+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:11:42.366139+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.366139+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:39.262944+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'719","reported_seq":1422,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.899520+0000","last_change":"2024-09-12T01:12:03.899520+0000","last_active":"2024-09-12T01:12:03.899520+0000","last_peered":"2024-09-12T01:12:03.899520+0000","last_clean":"2024-09-12T01:12:03.899520+0000","last_became_active":"2024-09-12T00:30:17.149842+0000","last_became_peered":"2024-09-12T00:30:17.149842+0000","last_unstale":"2024-09-12T01:12:03.899520+0000","last_undegraded":"2024-09-12T01:12:03.899520+0000","last_fullsized":"2024-09-12T01:12:03.899520+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'719","last_scrub_stamp":"2024-09-12T01:12:03.899420+0000","last_deep_scrub":"264'719","last_deep_scrub_stamp":"2024-09-12T01:12:03.899420+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.899420+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:24.007354+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1403,"num_read_kb":3182,"num_write":1320,"num_write_kb":1183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106952,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.424273+0000","last_change":"2024-09-12T01:12:03.424273+0000","last_active":"2024-09-12T01:12:03.424273+0000","last_peered":"2024-09-12T01:12:03.424273+0000","last_clean":"2024-09-12T01:12:03.424273+0000","last_became_active":"2024-09-12T00:30:19.168219+0000","last_became_peered":"2024-09-12T00:30:19.168219+0000","last_unstale":"2024-09-12T01:12:03.424273+0000","last_undegraded":"2024-09-12T01:12:03.424273+0000","last_fullsized":"2024-09-12T01:12:03.424273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.424188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.424188+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.424188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:54.976112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'217","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.356378+0000","last_change":"2024-09-12T01:11:54.356378+0000","last_active":"2024-09-12T01:11:54.356378+0000","last_peered":"2024-09-12T01:11:54.356378+0000","last_clean":"2024-09-12T01:11:54.356378+0000","last_became_active":"2024-09-12T00:30:21.191389+0000","last_became_peered":"2024-09-12T00:30:21.191389+0000","last_unstale":"2024-09-12T01:11:54.356378+0000","last_undegraded":"2024-09-12T01:11:54.356378+0000","last_fullsized":"2024-09-12T01:11:54.356378+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'217","last_scrub_stamp":"2024-09-12T01:11:54.356283+0000","last_deep_scrub":"264'217","last_deep_scrub_stamp":"2024-09-12T01:11:54.356283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.356283+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:00.464287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":544,"num_write":463,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'84","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.322102+0000","last_change":"2024-09-12T01:11:45.322102+0000","last_active":"2024-09-12T01:11:45.322102+0000","last_peered":"2024-09-12T01:11:45.322102+0000","last_clean":"2024-09-12T01:11:45.322102+0000","last_became_active":"2024-09-12T00:30:13.124407+0000","last_became_peered":"2024-09-12T00:30:13.124407+0000","last_unstale":"2024-09-12T01:11:45.322102+0000","last_undegraded":"2024-09-12T01:11:45.322102+0000","last_fullsized":"2024-09-12T01:11:45.322102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T01:11:45.322015+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T01:11:45.322015+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.322015+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:57.115441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":258,"num_write":150,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.850992+0000","last_change":"2024-09-12T01:11:36.850934+0000","last_active":"2024-09-12T01:11:36.850992+0000","last_peered":"2024-09-12T01:11:36.850992+0000","last_clean":"2024-09-12T01:11:36.850992+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T01:11:36.850992+0000","last_undegraded":"2024-09-12T01:11:36.850992+0000","last_fullsized":"2024-09-12T01:11:36.850992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.850849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.850849+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.850849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:50.093006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'385","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.093336+0000","last_change":"2024-09-12T01:11:32.093255+0000","last_active":"2024-09-12T01:11:32.093336+0000","last_peered":"2024-09-12T01:11:32.093336+0000","last_clean":"2024-09-12T01:11:32.093336+0000","last_became_active":"2024-09-12T00:30:11.099065+0000","last_became_peered":"2024-09-12T00:30:11.099065+0000","last_unstale":"2024-09-12T01:11:32.093336+0000","last_undegraded":"2024-09-12T01:11:32.093336+0000","last_fullsized":"2024-09-12T01:11:32.093336+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T01:11:32.093094+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T01:11:32.093094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.093094+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:51.292680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":8968,"num_write":1169,"num_write_kb":21800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.799649+0000","last_change":"2024-09-12T01:11:53.799649+0000","last_active":"2024-09-12T01:11:53.799649+0000","last_peered":"2024-09-12T01:11:53.799649+0000","last_clean":"2024-09-12T01:11:53.799649+0000","last_became_active":"2024-09-12T00:30:15.130490+0000","last_became_peered":"2024-09-12T00:30:15.130490+0000","last_unstale":"2024-09-12T01:11:53.799649+0000","last_undegraded":"2024-09-12T01:11:53.799649+0000","last_fullsized":"2024-09-12T01:11:53.799649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.799585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.799585+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.799585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:42.700401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'1365","reported_seq":2802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.529334+0000","last_change":"2024-09-12T01:11:46.529275+0000","last_active":"2024-09-12T01:11:46.529334+0000","last_peered":"2024-09-12T01:11:46.529334+0000","last_clean":"2024-09-12T01:11:46.529334+0000","last_became_active":"2024-09-12T00:30:17.146374+0000","last_became_peered":"2024-09-12T00:30:17.146374+0000","last_unstale":"2024-09-12T01:11:46.529334+0000","last_undegraded":"2024-09-12T01:11:46.529334+0000","last_fullsized":"2024-09-12T01:11:46.529334+0000","mapping_epoch":32,"log_start":"264'1300","ondisk_log_start":"264'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1365","last_scrub_stamp":"2024-09-12T01:11:46.529145+0000","last_deep_scrub":"264'1365","last_deep_scrub_stamp":"2024-09-12T01:11:46.529145+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.529145+0000","objects_scrubbed":12,"log_size":65,"log_dups_size":1300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:23.834431+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162102,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2173,"num_read_kb":4252,"num_write":1262,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.013963+0000","last_change":"2024-09-12T01:12:09.013963+0000","last_active":"2024-09-12T01:12:09.013963+0000","last_peered":"2024-09-12T01:12:09.013963+0000","last_clean":"2024-09-12T01:12:09.013963+0000","last_became_active":"2024-09-12T00:30:19.169700+0000","last_became_peered":"2024-09-12T00:30:19.169700+0000","last_unstale":"2024-09-12T01:12:09.013963+0000","last_undegraded":"2024-09-12T01:12:09.013963+0000","last_fullsized":"2024-09-12T01:12:09.013963+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:09.013873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:09.013873+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.013873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:02.383045+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'97","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.489162+0000","last_change":"2024-09-12T01:12:05.489162+0000","last_active":"2024-09-12T01:12:05.489162+0000","last_peered":"2024-09-12T01:12:05.489162+0000","last_clean":"2024-09-12T01:12:05.489162+0000","last_became_active":"2024-09-12T00:30:21.193491+0000","last_became_peered":"2024-09-12T00:30:21.193491+0000","last_unstale":"2024-09-12T01:12:05.489162+0000","last_undegraded":"2024-09-12T01:12:05.489162+0000","last_fullsized":"2024-09-12T01:12:05.489162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-12T01:12:05.489054+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-12T01:12:05.489054+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.489054+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.438964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":108,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'102","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.003162+0000","last_change":"2024-09-12T01:11:41.003162+0000","last_active":"2024-09-12T01:11:41.003162+0000","last_peered":"2024-09-12T01:11:41.003162+0000","last_clean":"2024-09-12T01:11:41.003162+0000","last_became_active":"2024-09-12T00:30:13.124085+0000","last_became_peered":"2024-09-12T00:30:13.124085+0000","last_unstale":"2024-09-12T01:11:41.003162+0000","last_undegraded":"2024-09-12T01:11:41.003162+0000","last_fullsized":"2024-09-12T01:11:41.003162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-12T01:11:41.003082+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-12T01:11:41.003082+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.003082+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:30.129863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":146,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.502852+0000","last_change":"2024-09-12T01:11:32.502795+0000","last_active":"2024-09-12T01:11:32.502852+0000","last_peered":"2024-09-12T01:11:32.502852+0000","last_clean":"2024-09-12T01:11:32.502852+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T01:11:32.502852+0000","last_undegraded":"2024-09-12T01:11:32.502852+0000","last_fullsized":"2024-09-12T01:11:32.502852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.502719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.502719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.502719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:31.918266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'337","reported_seq":975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.312291+0000","last_change":"2024-09-12T01:11:34.312196+0000","last_active":"2024-09-12T01:11:34.312291+0000","last_peered":"2024-09-12T01:11:34.312291+0000","last_clean":"2024-09-12T01:11:34.312291+0000","last_became_active":"2024-09-12T00:30:46.766731+0000","last_became_peered":"2024-09-12T00:30:46.766731+0000","last_unstale":"2024-09-12T01:11:34.312291+0000","last_undegraded":"2024-09-12T01:11:34.312291+0000","last_fullsized":"2024-09-12T01:11:34.312291+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T01:11:34.311972+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T01:11:34.311972+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.311972+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:31.110464+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7776863,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":511,"num_read_kb":16356,"num_write":1167,"num_write_kb":34470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,4],"acting":[5,7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.573198+0000","last_change":"2024-09-12T01:11:45.573198+0000","last_active":"2024-09-12T01:11:45.573198+0000","last_peered":"2024-09-12T01:11:45.573198+0000","last_clean":"2024-09-12T01:11:45.573198+0000","last_became_active":"2024-09-12T00:30:15.132744+0000","last_became_peered":"2024-09-12T00:30:15.132744+0000","last_unstale":"2024-09-12T01:11:45.573198+0000","last_undegraded":"2024-09-12T01:11:45.573198+0000","last_fullsized":"2024-09-12T01:11:45.573198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:45.573109+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:45.573109+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.573109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:55.353583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'226","reported_seq":1271,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.460893+0000","last_change":"2024-09-12T01:11:46.460831+0000","last_active":"2024-09-12T01:11:46.460893+0000","last_peered":"2024-09-12T01:11:46.460893+0000","last_clean":"2024-09-12T01:11:46.460893+0000","last_became_active":"2024-09-12T00:30:17.145284+0000","last_became_peered":"2024-09-12T00:30:17.145284+0000","last_unstale":"2024-09-12T01:11:46.460893+0000","last_undegraded":"2024-09-12T01:11:46.460893+0000","last_fullsized":"2024-09-12T01:11:46.460893+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-09-12T01:11:46.460719+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-09-12T01:11:46.460719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.460719+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:56.553885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":145,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.351194+0000","last_change":"2024-09-12T01:12:02.351133+0000","last_active":"2024-09-12T01:12:02.351194+0000","last_peered":"2024-09-12T01:12:02.351194+0000","last_clean":"2024-09-12T01:12:02.351194+0000","last_became_active":"2024-09-12T00:30:19.169439+0000","last_became_peered":"2024-09-12T00:30:19.169439+0000","last_unstale":"2024-09-12T01:12:02.351194+0000","last_undegraded":"2024-09-12T01:12:02.351194+0000","last_fullsized":"2024-09-12T01:12:02.351194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:02.351050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:02.351050+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.351050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:26.348607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'344","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.409194+0000","last_change":"2024-09-12T01:12:06.409194+0000","last_active":"2024-09-12T01:12:06.409194+0000","last_peered":"2024-09-12T01:12:06.409194+0000","last_clean":"2024-09-12T01:12:06.409194+0000","last_became_active":"2024-09-12T00:30:21.187616+0000","last_became_peered":"2024-09-12T00:30:21.187616+0000","last_unstale":"2024-09-12T01:12:06.409194+0000","last_undegraded":"2024-09-12T01:12:06.409194+0000","last_fullsized":"2024-09-12T01:12:06.409194+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T01:12:06.409109+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T01:12:06.409109+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.409109+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:35.067425+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":676,"num_read_kb":665,"num_write":755,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'375","reported_seq":1092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.030374+0000","last_change":"2024-09-12T01:11:40.030234+0000","last_active":"2024-09-12T01:11:40.030374+0000","last_peered":"2024-09-12T01:11:40.030374+0000","last_clean":"2024-09-12T01:11:40.030374+0000","last_became_active":"2024-09-12T00:30:13.122751+0000","last_became_peered":"2024-09-12T00:30:13.122751+0000","last_unstale":"2024-09-12T01:11:40.030374+0000","last_undegraded":"2024-09-12T01:11:40.030374+0000","last_fullsized":"2024-09-12T01:11:40.030374+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:40.030125+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:40.030125+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.030125+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:16.425527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1941,"num_read_kb":1679,"num_write":648,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.926825+0000","last_change":"2024-09-12T01:11:32.926782+0000","last_active":"2024-09-12T01:11:32.926825+0000","last_peered":"2024-09-12T01:11:32.926825+0000","last_clean":"2024-09-12T01:11:32.926825+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T01:11:32.926825+0000","last_undegraded":"2024-09-12T01:11:32.926825+0000","last_fullsized":"2024-09-12T01:11:32.926825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:11:32.926707+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:11:32.926707+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.926707+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:26.696475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'399","reported_seq":1141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.438450+0000","last_change":"2024-09-12T01:11:32.438397+0000","last_active":"2024-09-12T01:11:32.438450+0000","last_peered":"2024-09-12T01:11:32.438450+0000","last_clean":"2024-09-12T01:11:32.438450+0000","last_became_active":"2024-09-12T00:30:11.100253+0000","last_became_peered":"2024-09-12T00:30:11.100253+0000","last_unstale":"2024-09-12T01:11:32.438450+0000","last_undegraded":"2024-09-12T01:11:32.438450+0000","last_fullsized":"2024-09-12T01:11:32.438450+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'399","last_scrub_stamp":"2024-09-12T01:11:32.438283+0000","last_deep_scrub":"264'399","last_deep_scrub_stamp":"2024-09-12T01:11:32.438283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.438283+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:47.427418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7586776,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":852,"num_read_kb":32409,"num_write":1258,"num_write_kb":44212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.603613+0000","last_change":"2024-09-12T01:11:44.603535+0000","last_active":"2024-09-12T01:11:44.603613+0000","last_peered":"2024-09-12T01:11:44.603613+0000","last_clean":"2024-09-12T01:11:44.603613+0000","last_became_active":"2024-09-12T00:30:15.127835+0000","last_became_peered":"2024-09-12T00:30:15.127835+0000","last_unstale":"2024-09-12T01:11:44.603613+0000","last_undegraded":"2024-09-12T01:11:44.603613+0000","last_fullsized":"2024-09-12T01:11:44.603613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.603445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.603445+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.603445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:54.508744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'130","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.460639+0000","last_change":"2024-09-12T01:11:56.460639+0000","last_active":"2024-09-12T01:11:56.460639+0000","last_peered":"2024-09-12T01:11:56.460639+0000","last_clean":"2024-09-12T01:11:56.460639+0000","last_became_active":"2024-09-12T00:30:17.148548+0000","last_became_peered":"2024-09-12T00:30:17.148548+0000","last_unstale":"2024-09-12T01:11:56.460639+0000","last_undegraded":"2024-09-12T01:11:56.460639+0000","last_fullsized":"2024-09-12T01:11:56.460639+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T01:11:56.460539+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T01:11:56.460539+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.460539+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:22.881152+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.979184+0000","last_change":"2024-09-12T01:12:10.979184+0000","last_active":"2024-09-12T01:12:10.979184+0000","last_peered":"2024-09-12T01:12:10.979184+0000","last_clean":"2024-09-12T01:12:10.979184+0000","last_became_active":"2024-09-12T00:30:19.165120+0000","last_became_peered":"2024-09-12T00:30:19.165120+0000","last_unstale":"2024-09-12T01:12:10.979184+0000","last_undegraded":"2024-09-12T01:12:10.979184+0000","last_fullsized":"2024-09-12T01:12:10.979184+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:10.979089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:10.979089+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.979089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:03.580315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'134","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.773246+0000","last_change":"2024-09-12T01:11:57.773246+0000","last_active":"2024-09-12T01:11:57.773246+0000","last_peered":"2024-09-12T01:11:57.773246+0000","last_clean":"2024-09-12T01:11:57.773246+0000","last_became_active":"2024-09-12T00:30:21.180708+0000","last_became_peered":"2024-09-12T00:30:21.180708+0000","last_unstale":"2024-09-12T01:11:57.773246+0000","last_undegraded":"2024-09-12T01:11:57.773246+0000","last_fullsized":"2024-09-12T01:11:57.773246+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-12T01:11:57.773164+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-12T01:11:57.773164+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.773164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:52.985256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":239,"num_write":325,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'171","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.027208+0000","last_change":"2024-09-12T01:11:39.027134+0000","last_active":"2024-09-12T01:11:39.027208+0000","last_peered":"2024-09-12T01:11:39.027208+0000","last_clean":"2024-09-12T01:11:39.027208+0000","last_became_active":"2024-09-12T00:30:13.130610+0000","last_became_peered":"2024-09-12T00:30:13.130610+0000","last_unstale":"2024-09-12T01:11:39.027208+0000","last_undegraded":"2024-09-12T01:11:39.027208+0000","last_fullsized":"2024-09-12T01:11:39.027208+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T01:11:39.027047+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T01:11:39.027047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.027047+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:23.518560+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":757,"num_read_kb":608,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'326","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.394914+0000","last_change":"2024-09-12T01:11:31.394860+0000","last_active":"2024-09-12T01:11:31.394914+0000","last_peered":"2024-09-12T01:11:31.394914+0000","last_clean":"2024-09-12T01:11:31.394914+0000","last_became_active":"2024-09-12T00:30:11.104002+0000","last_became_peered":"2024-09-12T00:30:11.104002+0000","last_unstale":"2024-09-12T01:11:31.394914+0000","last_undegraded":"2024-09-12T01:11:31.394914+0000","last_fullsized":"2024-09-12T01:11:31.394914+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.394736+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:03.175443+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452439,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":13269,"num_write":941,"num_write_kb":33802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.213348+0000","last_change":"2024-09-12T01:11:32.213270+0000","last_active":"2024-09-12T01:11:32.213348+0000","last_peered":"2024-09-12T01:11:32.213348+0000","last_clean":"2024-09-12T01:11:32.213348+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T01:11:32.213348+0000","last_undegraded":"2024-09-12T01:11:32.213348+0000","last_fullsized":"2024-09-12T01:11:32.213348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.213181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.213181+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.213181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:55.736193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.282338+0000","last_change":"2024-09-12T01:11:50.282272+0000","last_active":"2024-09-12T01:11:50.282338+0000","last_peered":"2024-09-12T01:11:50.282338+0000","last_clean":"2024-09-12T01:11:50.282338+0000","last_became_active":"2024-09-12T00:30:15.127513+0000","last_became_peered":"2024-09-12T00:30:15.127513+0000","last_unstale":"2024-09-12T01:11:50.282338+0000","last_undegraded":"2024-09-12T01:11:50.282338+0000","last_fullsized":"2024-09-12T01:11:50.282338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.282187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.282187+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.282187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:50.522854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'574","reported_seq":1251,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.625837+0000","last_change":"2024-09-12T01:11:43.625759+0000","last_active":"2024-09-12T01:11:43.625837+0000","last_peered":"2024-09-12T01:11:43.625837+0000","last_clean":"2024-09-12T01:11:43.625837+0000","last_became_active":"2024-09-12T00:30:17.146141+0000","last_became_peered":"2024-09-12T00:30:17.146141+0000","last_unstale":"2024-09-12T01:11:43.625837+0000","last_undegraded":"2024-09-12T01:11:43.625837+0000","last_fullsized":"2024-09-12T01:11:43.625837+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'574","last_scrub_stamp":"2024-09-12T01:11:43.625634+0000","last_deep_scrub":"264'574","last_deep_scrub_stamp":"2024-09-12T01:11:43.625634+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.625634+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:48.119734+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1559,"num_read_kb":2701,"num_write":2018,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":507816,"num_omap_keys":1152,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.331589+0000","last_change":"2024-09-12T01:11:50.331499+0000","last_active":"2024-09-12T01:11:50.331589+0000","last_peered":"2024-09-12T01:11:50.331589+0000","last_clean":"2024-09-12T01:11:50.331589+0000","last_became_active":"2024-09-12T00:30:19.167819+0000","last_became_peered":"2024-09-12T00:30:19.167819+0000","last_unstale":"2024-09-12T01:11:50.331589+0000","last_undegraded":"2024-09-12T01:11:50.331589+0000","last_fullsized":"2024-09-12T01:11:50.331589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.331408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.331408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.331408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:26.591133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'181","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.478435+0000","last_change":"2024-09-12T01:12:07.478435+0000","last_active":"2024-09-12T01:12:07.478435+0000","last_peered":"2024-09-12T01:12:07.478435+0000","last_clean":"2024-09-12T01:12:07.478435+0000","last_became_active":"2024-09-12T00:30:21.192893+0000","last_became_peered":"2024-09-12T00:30:21.192893+0000","last_unstale":"2024-09-12T01:12:07.478435+0000","last_undegraded":"2024-09-12T01:12:07.478435+0000","last_fullsized":"2024-09-12T01:12:07.478435+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-12T01:12:07.478345+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-12T01:12:07.478345+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.478345+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:40.582868+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":195,"num_read_kb":181,"num_write":424,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'295","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.072383+0000","last_change":"2024-09-12T01:11:43.072329+0000","last_active":"2024-09-12T01:11:43.072383+0000","last_peered":"2024-09-12T01:11:43.072383+0000","last_clean":"2024-09-12T01:11:43.072383+0000","last_became_active":"2024-09-12T00:30:13.125487+0000","last_became_peered":"2024-09-12T00:30:13.125487+0000","last_unstale":"2024-09-12T01:11:43.072383+0000","last_undegraded":"2024-09-12T01:11:43.072383+0000","last_fullsized":"2024-09-12T01:11:43.072383+0000","mapping_epoch":28,"log_start":"261'200","ondisk_log_start":"261'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'295","last_scrub_stamp":"2024-09-12T01:11:43.072246+0000","last_deep_scrub":"264'295","last_deep_scrub_stamp":"2024-09-12T01:11:43.072246+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.072246+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:38.938472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1016,"num_write":432,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'308","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.079678+0000","last_change":"2024-09-12T01:11:33.079611+0000","last_active":"2024-09-12T01:11:33.079678+0000","last_peered":"2024-09-12T01:11:33.079678+0000","last_clean":"2024-09-12T01:11:33.079678+0000","last_became_active":"2024-09-12T00:30:11.108257+0000","last_became_peered":"2024-09-12T00:30:11.108257+0000","last_unstale":"2024-09-12T01:11:33.079678+0000","last_undegraded":"2024-09-12T01:11:33.079678+0000","last_fullsized":"2024-09-12T01:11:33.079678+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-12T01:11:33.079481+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-12T01:11:33.079481+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.079481+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:37.289345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":29050,"num_write":952,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.924888+0000","last_change":"2024-09-12T01:11:31.924834+0000","last_active":"2024-09-12T01:11:31.924888+0000","last_peered":"2024-09-12T01:11:31.924888+0000","last_clean":"2024-09-12T01:11:31.924888+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T01:11:31.924888+0000","last_undegraded":"2024-09-12T01:11:31.924888+0000","last_fullsized":"2024-09-12T01:11:31.924888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.924761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.924761+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.924761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.589363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.448214+0000","last_change":"2024-09-12T01:11:47.448139+0000","last_active":"2024-09-12T01:11:47.448214+0000","last_peered":"2024-09-12T01:11:47.448214+0000","last_clean":"2024-09-12T01:11:47.448214+0000","last_became_active":"2024-09-12T00:30:15.124765+0000","last_became_peered":"2024-09-12T00:30:15.124765+0000","last_unstale":"2024-09-12T01:11:47.448214+0000","last_undegraded":"2024-09-12T01:11:47.448214+0000","last_fullsized":"2024-09-12T01:11:47.448214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.448047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.448047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.448047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:26.268517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'170","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.208398+0000","last_change":"2024-09-12T01:11:50.208331+0000","last_active":"2024-09-12T01:11:50.208398+0000","last_peered":"2024-09-12T01:11:50.208398+0000","last_clean":"2024-09-12T01:11:50.208398+0000","last_became_active":"2024-09-12T00:30:17.147297+0000","last_became_peered":"2024-09-12T00:30:17.147297+0000","last_unstale":"2024-09-12T01:11:50.208398+0000","last_undegraded":"2024-09-12T01:11:50.208398+0000","last_fullsized":"2024-09-12T01:11:50.208398+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T01:11:50.208237+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T01:11:50.208237+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.208237+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:31.146209+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":197,"num_write":138,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'783","reported_seq":4286,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.782303+0000","last_change":"2024-09-12T01:11:55.782247+0000","last_active":"2024-09-12T01:11:55.782303+0000","last_peered":"2024-09-12T01:11:55.782303+0000","last_clean":"2024-09-12T01:11:55.782303+0000","last_became_active":"2024-09-12T00:30:19.169689+0000","last_became_peered":"2024-09-12T00:30:19.169689+0000","last_unstale":"2024-09-12T01:11:55.782303+0000","last_undegraded":"2024-09-12T01:11:55.782303+0000","last_fullsized":"2024-09-12T01:11:55.782303+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'783","last_scrub_stamp":"2024-09-12T01:11:55.782161+0000","last_deep_scrub":"264'783","last_deep_scrub_stamp":"2024-09-12T01:11:55.782161+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.782161+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:52.245663+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'139","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.665326+0000","last_change":"2024-09-12T01:11:56.665326+0000","last_active":"2024-09-12T01:11:56.665326+0000","last_peered":"2024-09-12T01:11:56.665326+0000","last_clean":"2024-09-12T01:11:56.665326+0000","last_became_active":"2024-09-12T00:30:21.189546+0000","last_became_peered":"2024-09-12T00:30:21.189546+0000","last_unstale":"2024-09-12T01:11:56.665326+0000","last_undegraded":"2024-09-12T01:11:56.665326+0000","last_fullsized":"2024-09-12T01:11:56.665326+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'139","last_scrub_stamp":"2024-09-12T01:11:56.665223+0000","last_deep_scrub":"264'139","last_deep_scrub_stamp":"2024-09-12T01:11:56.665223+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.665223+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:06.441855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":147,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'196","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.285827+0000","last_change":"2024-09-12T01:11:37.285722+0000","last_active":"2024-09-12T01:11:37.285827+0000","last_peered":"2024-09-12T01:11:37.285827+0000","last_clean":"2024-09-12T01:11:37.285827+0000","last_became_active":"2024-09-12T00:30:13.118656+0000","last_became_peered":"2024-09-12T00:30:13.118656+0000","last_unstale":"2024-09-12T01:11:37.285827+0000","last_undegraded":"2024-09-12T01:11:37.285827+0000","last_fullsized":"2024-09-12T01:11:37.285827+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T01:11:37.285627+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T01:11:37.285627+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.285627+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:30.901502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":942,"num_read_kb":795,"num_write":340,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'370","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.361161+0000","last_change":"2024-09-12T01:11:35.361161+0000","last_active":"2024-09-12T01:11:35.361161+0000","last_peered":"2024-09-12T01:11:35.361161+0000","last_clean":"2024-09-12T01:11:35.361161+0000","last_became_active":"2024-09-12T00:30:11.090114+0000","last_became_peered":"2024-09-12T00:30:11.090114+0000","last_unstale":"2024-09-12T01:11:35.361161+0000","last_undegraded":"2024-09-12T01:11:35.361161+0000","last_fullsized":"2024-09-12T01:11:35.361161+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'370","last_scrub_stamp":"2024-09-12T01:11:35.360991+0000","last_deep_scrub":"264'370","last_deep_scrub_stamp":"2024-09-12T01:11:35.360991+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.360991+0000","objects_scrubbed":10,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.207634+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9433118,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":605,"num_read_kb":27258,"num_write":1271,"num_write_kb":43330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.405044+0000","last_change":"2024-09-12T01:11:31.405044+0000","last_active":"2024-09-12T01:11:31.405044+0000","last_peered":"2024-09-12T01:11:31.405044+0000","last_clean":"2024-09-12T01:11:31.405044+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T01:11:31.405044+0000","last_undegraded":"2024-09-12T01:11:31.405044+0000","last_fullsized":"2024-09-12T01:11:31.405044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.404954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.404954+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.404954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:13.972945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.873795+0000","last_change":"2024-09-12T01:11:57.873711+0000","last_active":"2024-09-12T01:11:57.873795+0000","last_peered":"2024-09-12T01:11:57.873795+0000","last_clean":"2024-09-12T01:11:57.873795+0000","last_became_active":"2024-09-12T00:30:15.126949+0000","last_became_peered":"2024-09-12T00:30:15.126949+0000","last_unstale":"2024-09-12T01:11:57.873795+0000","last_undegraded":"2024-09-12T01:11:57.873795+0000","last_fullsized":"2024-09-12T01:11:57.873795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:57.873617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:57.873617+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.873617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:08.766588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'113","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.856158+0000","last_change":"2024-09-12T01:12:02.856158+0000","last_active":"2024-09-12T01:12:02.856158+0000","last_peered":"2024-09-12T01:12:02.856158+0000","last_clean":"2024-09-12T01:12:02.856158+0000","last_became_active":"2024-09-12T00:30:17.149791+0000","last_became_peered":"2024-09-12T00:30:17.149791+0000","last_unstale":"2024-09-12T01:12:02.856158+0000","last_undegraded":"2024-09-12T01:12:02.856158+0000","last_fullsized":"2024-09-12T01:12:02.856158+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-12T01:12:02.855997+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-12T01:12:02.855997+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.855997+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:14.157955+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'803","reported_seq":4550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.506714+0000","last_change":"2024-09-12T01:11:57.506616+0000","last_active":"2024-09-12T01:11:57.506714+0000","last_peered":"2024-09-12T01:11:57.506714+0000","last_clean":"2024-09-12T01:11:57.506714+0000","last_became_active":"2024-09-12T00:30:19.166687+0000","last_became_peered":"2024-09-12T00:30:19.166687+0000","last_unstale":"2024-09-12T01:11:57.506714+0000","last_undegraded":"2024-09-12T01:11:57.506714+0000","last_fullsized":"2024-09-12T01:11:57.506714+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-12T01:11:57.506505+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-12T01:11:57.506505+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.506505+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:55.538085+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'273","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.524299+0000","last_change":"2024-09-12T01:12:06.524299+0000","last_active":"2024-09-12T01:12:06.524299+0000","last_peered":"2024-09-12T01:12:06.524299+0000","last_clean":"2024-09-12T01:12:06.524299+0000","last_became_active":"2024-09-12T00:30:21.192189+0000","last_became_peered":"2024-09-12T00:30:21.192189+0000","last_unstale":"2024-09-12T01:12:06.524299+0000","last_undegraded":"2024-09-12T01:12:06.524299+0000","last_fullsized":"2024-09-12T01:12:06.524299+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-12T01:12:06.524198+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-12T01:12:06.524198+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.524198+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.096400+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":326,"num_read_kb":325,"num_write":560,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'395","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.432082+0000","last_change":"2024-09-12T01:11:36.432024+0000","last_active":"2024-09-12T01:11:36.432082+0000","last_peered":"2024-09-12T01:11:36.432082+0000","last_clean":"2024-09-12T01:11:36.432082+0000","last_became_active":"2024-09-12T00:30:13.120906+0000","last_became_peered":"2024-09-12T00:30:13.120906+0000","last_unstale":"2024-09-12T01:11:36.432082+0000","last_undegraded":"2024-09-12T01:11:36.432082+0000","last_fullsized":"2024-09-12T01:11:36.432082+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-12T01:11:36.431932+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-12T01:11:36.431932+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.431932+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:46.567143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1876,"num_read_kb":1541,"num_write":715,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'329","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.404850+0000","last_change":"2024-09-12T01:11:33.404850+0000","last_active":"2024-09-12T01:11:33.404850+0000","last_peered":"2024-09-12T01:11:33.404850+0000","last_clean":"2024-09-12T01:11:33.404850+0000","last_became_active":"2024-09-12T00:30:11.101931+0000","last_became_peered":"2024-09-12T00:30:11.101931+0000","last_unstale":"2024-09-12T01:11:33.404850+0000","last_undegraded":"2024-09-12T01:11:33.404850+0000","last_fullsized":"2024-09-12T01:11:33.404850+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T01:11:33.404737+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T01:11:33.404737+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.404737+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:04.479639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359495,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":501,"num_read_kb":50204,"num_write":1062,"num_write_kb":37284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.877931+0000","last_change":"2024-09-12T01:11:33.877931+0000","last_active":"2024-09-12T01:11:33.877931+0000","last_peered":"2024-09-12T01:11:33.877931+0000","last_clean":"2024-09-12T01:11:33.877931+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T01:11:33.877931+0000","last_undegraded":"2024-09-12T01:11:33.877931+0000","last_fullsized":"2024-09-12T01:11:33.877931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.877841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.877841+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.877841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:36.694365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.323365+0000","last_change":"2024-09-12T01:11:48.323292+0000","last_active":"2024-09-12T01:11:48.323365+0000","last_peered":"2024-09-12T01:11:48.323365+0000","last_clean":"2024-09-12T01:11:48.323365+0000","last_became_active":"2024-09-12T00:30:15.126041+0000","last_became_peered":"2024-09-12T00:30:15.126041+0000","last_unstale":"2024-09-12T01:11:48.323365+0000","last_undegraded":"2024-09-12T01:11:48.323365+0000","last_fullsized":"2024-09-12T01:11:48.323365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.323209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.323209+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.323209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:59.170409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'771","reported_seq":1502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.419306+0000","last_change":"2024-09-12T01:11:43.419218+0000","last_active":"2024-09-12T01:11:43.419306+0000","last_peered":"2024-09-12T01:11:43.419306+0000","last_clean":"2024-09-12T01:11:43.419306+0000","last_became_active":"2024-09-12T00:30:17.148954+0000","last_became_peered":"2024-09-12T00:30:17.148954+0000","last_unstale":"2024-09-12T01:11:43.419306+0000","last_undegraded":"2024-09-12T01:11:43.419306+0000","last_fullsized":"2024-09-12T01:11:43.419306+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-12T01:11:43.419108+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-12T01:11:43.419108+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.419108+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:57.967218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141519,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1386,"num_read_kb":3323,"num_write":1142,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.386244+0000","last_change":"2024-09-12T01:12:00.386123+0000","last_active":"2024-09-12T01:12:00.386244+0000","last_peered":"2024-09-12T01:12:00.386244+0000","last_clean":"2024-09-12T01:12:00.386244+0000","last_became_active":"2024-09-12T00:30:19.168965+0000","last_became_peered":"2024-09-12T00:30:19.168965+0000","last_unstale":"2024-09-12T01:12:00.386244+0000","last_undegraded":"2024-09-12T01:12:00.386244+0000","last_fullsized":"2024-09-12T01:12:00.386244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:00.386023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:00.386023+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.386023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:29.239817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'136","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.413699+0000","last_change":"2024-09-12T01:11:56.413699+0000","last_active":"2024-09-12T01:11:56.413699+0000","last_peered":"2024-09-12T01:11:56.413699+0000","last_clean":"2024-09-12T01:11:56.413699+0000","last_became_active":"2024-09-12T00:30:21.186262+0000","last_became_peered":"2024-09-12T00:30:21.186262+0000","last_unstale":"2024-09-12T01:11:56.413699+0000","last_undegraded":"2024-09-12T01:11:56.413699+0000","last_fullsized":"2024-09-12T01:11:56.413699+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-12T01:11:56.413596+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-12T01:11:56.413596+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.413596+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:03.823692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":332,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'145","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.367269+0000","last_change":"2024-09-12T01:12:07.367269+0000","last_active":"2024-09-12T01:12:07.367269+0000","last_peered":"2024-09-12T01:12:07.367269+0000","last_clean":"2024-09-12T01:12:07.367269+0000","last_became_active":"2024-09-12T00:30:21.193010+0000","last_became_peered":"2024-09-12T00:30:21.193010+0000","last_unstale":"2024-09-12T01:12:07.367269+0000","last_undegraded":"2024-09-12T01:12:07.367269+0000","last_fullsized":"2024-09-12T01:12:07.367269+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T01:12:07.367145+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T01:12:07.367145+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.367145+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:25.231816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'64","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.347768+0000","last_change":"2024-09-12T01:11:39.347695+0000","last_active":"2024-09-12T01:11:39.347768+0000","last_peered":"2024-09-12T01:11:39.347768+0000","last_clean":"2024-09-12T01:11:39.347768+0000","last_became_active":"2024-09-12T00:30:13.121613+0000","last_became_peered":"2024-09-12T00:30:13.121613+0000","last_unstale":"2024-09-12T01:11:39.347768+0000","last_undegraded":"2024-09-12T01:11:39.347768+0000","last_fullsized":"2024-09-12T01:11:39.347768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-12T01:11:39.347611+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-12T01:11:39.347611+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.347611+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:04.410478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":107,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'377","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.884160+0000","last_change":"2024-09-12T01:11:41.884100+0000","last_active":"2024-09-12T01:11:41.884160+0000","last_peered":"2024-09-12T01:11:41.884160+0000","last_clean":"2024-09-12T01:11:41.884160+0000","last_became_active":"2024-09-12T00:30:11.109653+0000","last_became_peered":"2024-09-12T00:30:11.109653+0000","last_unstale":"2024-09-12T01:11:41.884160+0000","last_undegraded":"2024-09-12T01:11:41.884160+0000","last_fullsized":"2024-09-12T01:11:41.884160+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-12T01:11:41.883946+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-12T01:11:41.883946+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.883946+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:36.450437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105416,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":3254,"num_write":1234,"num_write_kb":30224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.144796+0000","last_change":"2024-09-12T01:11:48.144738+0000","last_active":"2024-09-12T01:11:48.144796+0000","last_peered":"2024-09-12T01:11:48.144796+0000","last_clean":"2024-09-12T01:11:48.144796+0000","last_became_active":"2024-09-12T00:30:15.132784+0000","last_became_peered":"2024-09-12T00:30:15.132784+0000","last_unstale":"2024-09-12T01:11:48.144796+0000","last_undegraded":"2024-09-12T01:11:48.144796+0000","last_fullsized":"2024-09-12T01:11:48.144796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.144638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.144638+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.144638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:44.115258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'265","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.162819+0000","last_change":"2024-09-12T01:11:52.162751+0000","last_active":"2024-09-12T01:11:52.162819+0000","last_peered":"2024-09-12T01:11:52.162819+0000","last_clean":"2024-09-12T01:11:52.162819+0000","last_became_active":"2024-09-12T00:30:17.146483+0000","last_became_peered":"2024-09-12T00:30:17.146483+0000","last_unstale":"2024-09-12T01:11:52.162819+0000","last_undegraded":"2024-09-12T01:11:52.162819+0000","last_fullsized":"2024-09-12T01:11:52.162819+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-09-12T01:11:52.162658+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-09-12T01:11:52.162658+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.162658+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.289153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51465,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":944,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.583911+0000","last_change":"2024-09-12T01:11:51.583814+0000","last_active":"2024-09-12T01:11:51.583911+0000","last_peered":"2024-09-12T01:11:51.583911+0000","last_clean":"2024-09-12T01:11:51.583911+0000","last_became_active":"2024-09-12T00:30:19.168980+0000","last_became_peered":"2024-09-12T00:30:19.168980+0000","last_unstale":"2024-09-12T01:11:51.583911+0000","last_undegraded":"2024-09-12T01:11:51.583911+0000","last_fullsized":"2024-09-12T01:11:51.583911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.583717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.583717+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.583717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:33.975499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'109","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.681425+0000","last_change":"2024-09-12T01:11:57.681342+0000","last_active":"2024-09-12T01:11:57.681425+0000","last_peered":"2024-09-12T01:11:57.681425+0000","last_clean":"2024-09-12T01:11:57.681425+0000","last_became_active":"2024-09-12T00:30:21.187742+0000","last_became_peered":"2024-09-12T00:30:21.187742+0000","last_unstale":"2024-09-12T01:11:57.681425+0000","last_undegraded":"2024-09-12T01:11:57.681425+0000","last_fullsized":"2024-09-12T01:11:57.681425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T01:11:57.681228+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T01:11:57.681228+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.681228+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:55.746205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'264","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.224850+0000","last_change":"2024-09-12T01:11:40.224777+0000","last_active":"2024-09-12T01:11:40.224850+0000","last_peered":"2024-09-12T01:11:40.224850+0000","last_clean":"2024-09-12T01:11:40.224850+0000","last_became_active":"2024-09-12T00:30:13.131204+0000","last_became_peered":"2024-09-12T00:30:13.131204+0000","last_unstale":"2024-09-12T01:11:40.224850+0000","last_undegraded":"2024-09-12T01:11:40.224850+0000","last_fullsized":"2024-09-12T01:11:40.224850+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-12T01:11:40.224678+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-12T01:11:40.224678+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.224678+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:44.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":908,"num_write":395,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'365","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.378631+0000","last_change":"2024-09-12T01:11:29.378631+0000","last_active":"2024-09-12T01:11:29.378631+0000","last_peered":"2024-09-12T01:11:29.378631+0000","last_clean":"2024-09-12T01:11:29.378631+0000","last_became_active":"2024-09-12T00:30:11.104403+0000","last_became_peered":"2024-09-12T00:30:11.104403+0000","last_unstale":"2024-09-12T01:11:29.378631+0000","last_undegraded":"2024-09-12T01:11:29.378631+0000","last_fullsized":"2024-09-12T01:11:29.378631+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'365","last_scrub_stamp":"2024-09-12T01:11:29.378485+0000","last_deep_scrub":"264'365","last_deep_scrub_stamp":"2024-09-12T01:11:29.378485+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.378485+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.993161+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190266,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":58051,"num_write":1218,"num_write_kb":38205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.317414+0000","last_change":"2024-09-12T01:11:49.317361+0000","last_active":"2024-09-12T01:11:49.317414+0000","last_peered":"2024-09-12T01:11:49.317414+0000","last_clean":"2024-09-12T01:11:49.317414+0000","last_became_active":"2024-09-12T00:30:15.128366+0000","last_became_peered":"2024-09-12T00:30:15.128366+0000","last_unstale":"2024-09-12T01:11:49.317414+0000","last_undegraded":"2024-09-12T01:11:49.317414+0000","last_fullsized":"2024-09-12T01:11:49.317414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.317271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.317271+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.317271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:12.699314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'48","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.311868+0000","last_change":"2024-09-12T01:11:56.311815+0000","last_active":"2024-09-12T01:11:56.311868+0000","last_peered":"2024-09-12T01:11:56.311868+0000","last_clean":"2024-09-12T01:11:56.311868+0000","last_became_active":"2024-09-12T00:30:17.138399+0000","last_became_peered":"2024-09-12T00:30:17.138399+0000","last_unstale":"2024-09-12T01:11:56.311868+0000","last_undegraded":"2024-09-12T01:11:56.311868+0000","last_fullsized":"2024-09-12T01:11:56.311868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-12T01:11:56.311717+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-12T01:11:56.311717+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.311717+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:01.521119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":31,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.346322+0000","last_change":"2024-09-12T01:11:53.346265+0000","last_active":"2024-09-12T01:11:53.346322+0000","last_peered":"2024-09-12T01:11:53.346322+0000","last_clean":"2024-09-12T01:11:53.346322+0000","last_became_active":"2024-09-12T00:30:19.167213+0000","last_became_peered":"2024-09-12T00:30:19.167213+0000","last_unstale":"2024-09-12T01:11:53.346322+0000","last_undegraded":"2024-09-12T01:11:53.346322+0000","last_fullsized":"2024-09-12T01:11:53.346322+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.346201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.346201+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.346201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:08.482365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'203","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.215718+0000","last_change":"2024-09-12T01:12:00.215718+0000","last_active":"2024-09-12T01:12:00.215718+0000","last_peered":"2024-09-12T01:12:00.215718+0000","last_clean":"2024-09-12T01:12:00.215718+0000","last_became_active":"2024-09-12T00:30:21.185636+0000","last_became_peered":"2024-09-12T00:30:21.185636+0000","last_unstale":"2024-09-12T01:12:00.215718+0000","last_undegraded":"2024-09-12T01:12:00.215718+0000","last_fullsized":"2024-09-12T01:12:00.215718+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T01:12:00.215608+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T01:12:00.215608+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.215608+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:45.482051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":299,"num_write":483,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'101","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.369684+0000","last_change":"2024-09-12T01:11:47.369628+0000","last_active":"2024-09-12T01:11:47.369684+0000","last_peered":"2024-09-12T01:11:47.369684+0000","last_clean":"2024-09-12T01:11:47.369684+0000","last_became_active":"2024-09-12T00:30:13.124163+0000","last_became_peered":"2024-09-12T00:30:13.124163+0000","last_unstale":"2024-09-12T01:11:47.369684+0000","last_undegraded":"2024-09-12T01:11:47.369684+0000","last_fullsized":"2024-09-12T01:11:47.369684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T01:11:47.369535+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T01:11:47.369535+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.369535+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:17.905362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":380,"num_write":155,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'347","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.398998+0000","last_change":"2024-09-12T01:11:32.398998+0000","last_active":"2024-09-12T01:11:32.398998+0000","last_peered":"2024-09-12T01:11:32.398998+0000","last_clean":"2024-09-12T01:11:32.398998+0000","last_became_active":"2024-09-12T00:30:11.110736+0000","last_became_peered":"2024-09-12T00:30:11.110736+0000","last_unstale":"2024-09-12T01:11:32.398998+0000","last_undegraded":"2024-09-12T01:11:32.398998+0000","last_fullsized":"2024-09-12T01:11:32.398998+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:32.398902+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:32.398902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.398902+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:00.088675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380458,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":820,"num_read_kb":34556,"num_write":1163,"num_write_kb":41998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.333979+0000","last_change":"2024-09-12T01:11:44.333925+0000","last_active":"2024-09-12T01:11:44.333979+0000","last_peered":"2024-09-12T01:11:44.333979+0000","last_clean":"2024-09-12T01:11:44.333979+0000","last_became_active":"2024-09-12T00:30:15.121068+0000","last_became_peered":"2024-09-12T00:30:15.121068+0000","last_unstale":"2024-09-12T01:11:44.333979+0000","last_undegraded":"2024-09-12T01:11:44.333979+0000","last_fullsized":"2024-09-12T01:11:44.333979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.333836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.333836+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.333836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:08.954732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'318","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.543231+0000","last_change":"2024-09-12T01:11:48.543166+0000","last_active":"2024-09-12T01:11:48.543231+0000","last_peered":"2024-09-12T01:11:48.543231+0000","last_clean":"2024-09-12T01:11:48.543231+0000","last_became_active":"2024-09-12T00:30:17.147946+0000","last_became_peered":"2024-09-12T00:30:17.147946+0000","last_unstale":"2024-09-12T01:11:48.543231+0000","last_undegraded":"2024-09-12T01:11:48.543231+0000","last_fullsized":"2024-09-12T01:11:48.543231+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T01:11:48.543075+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T01:11:48.543075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.543075+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:23.858040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":1151,"num_write":414,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.778033+0000","last_change":"2024-09-12T01:11:50.777973+0000","last_active":"2024-09-12T01:11:50.778033+0000","last_peered":"2024-09-12T01:11:50.778033+0000","last_clean":"2024-09-12T01:11:50.778033+0000","last_became_active":"2024-09-12T00:30:19.167407+0000","last_became_peered":"2024-09-12T00:30:19.167407+0000","last_unstale":"2024-09-12T01:11:50.778033+0000","last_undegraded":"2024-09-12T01:11:50.778033+0000","last_fullsized":"2024-09-12T01:11:50.778033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.777878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.777878+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.777878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:52.228704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'122","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.994259+0000","last_change":"2024-09-12T01:12:16.994259+0000","last_active":"2024-09-12T01:12:16.994259+0000","last_peered":"2024-09-12T01:12:16.994259+0000","last_clean":"2024-09-12T01:12:16.994259+0000","last_became_active":"2024-09-12T00:30:21.188801+0000","last_became_peered":"2024-09-12T00:30:21.188801+0000","last_unstale":"2024-09-12T01:12:16.994259+0000","last_undegraded":"2024-09-12T01:12:16.994259+0000","last_fullsized":"2024-09-12T01:12:16.994259+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-09-12T01:12:16.994177+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-09-12T01:12:16.994177+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.994177+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:42.811797+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":174,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'271","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.567174+0000","last_change":"2024-09-12T01:11:38.567103+0000","last_active":"2024-09-12T01:11:38.567174+0000","last_peered":"2024-09-12T01:11:38.567174+0000","last_clean":"2024-09-12T01:11:38.567174+0000","last_became_active":"2024-09-12T00:30:13.121687+0000","last_became_peered":"2024-09-12T00:30:13.121687+0000","last_unstale":"2024-09-12T01:11:38.567174+0000","last_undegraded":"2024-09-12T01:11:38.567174+0000","last_fullsized":"2024-09-12T01:11:38.567174+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T01:11:38.566980+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T01:11:38.566980+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.566980+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:30.059821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1180,"num_read_kb":936,"num_write":465,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'332","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.265680+0000","last_change":"2024-09-12T01:11:33.265680+0000","last_active":"2024-09-12T01:11:33.265680+0000","last_peered":"2024-09-12T01:11:33.265680+0000","last_clean":"2024-09-12T01:11:33.265680+0000","last_became_active":"2024-09-12T00:30:11.097863+0000","last_became_peered":"2024-09-12T00:30:11.097863+0000","last_unstale":"2024-09-12T01:11:33.265680+0000","last_undegraded":"2024-09-12T01:11:33.265680+0000","last_fullsized":"2024-09-12T01:11:33.265680+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T01:11:33.265543+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T01:11:33.265543+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.265543+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:12.068841+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4714622,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":74376,"num_write":1103,"num_write_kb":34671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.848214+0000","last_change":"2024-09-12T01:11:59.848163+0000","last_active":"2024-09-12T01:11:59.848214+0000","last_peered":"2024-09-12T01:11:59.848214+0000","last_clean":"2024-09-12T01:11:59.848214+0000","last_became_active":"2024-09-12T00:30:15.125505+0000","last_became_peered":"2024-09-12T00:30:15.125505+0000","last_unstale":"2024-09-12T01:11:59.848214+0000","last_undegraded":"2024-09-12T01:11:59.848214+0000","last_fullsized":"2024-09-12T01:11:59.848214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:59.848070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:59.848070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.848070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:45.445978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'281","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.298281+0000","last_change":"2024-09-12T01:11:52.298221+0000","last_active":"2024-09-12T01:11:52.298281+0000","last_peered":"2024-09-12T01:11:52.298281+0000","last_clean":"2024-09-12T01:11:52.298281+0000","last_became_active":"2024-09-12T00:30:17.146112+0000","last_became_peered":"2024-09-12T00:30:17.146112+0000","last_unstale":"2024-09-12T01:11:52.298281+0000","last_undegraded":"2024-09-12T01:11:52.298281+0000","last_fullsized":"2024-09-12T01:11:52.298281+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'281","last_scrub_stamp":"2024-09-12T01:11:52.298124+0000","last_deep_scrub":"264'281","last_deep_scrub_stamp":"2024-09-12T01:11:52.298124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.298124+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:45.416273+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56907,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":1155,"num_write":390,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.623624+0000","last_change":"2024-09-12T01:11:52.623510+0000","last_active":"2024-09-12T01:11:52.623624+0000","last_peered":"2024-09-12T01:11:52.623624+0000","last_clean":"2024-09-12T01:11:52.623624+0000","last_became_active":"2024-09-12T00:30:19.164820+0000","last_became_peered":"2024-09-12T00:30:19.164820+0000","last_unstale":"2024-09-12T01:11:52.623624+0000","last_undegraded":"2024-09-12T01:11:52.623624+0000","last_fullsized":"2024-09-12T01:11:52.623624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.623414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.623414+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.623414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:15.344847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'177","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.799130+0000","last_change":"2024-09-12T01:11:52.799021+0000","last_active":"2024-09-12T01:11:52.799130+0000","last_peered":"2024-09-12T01:11:52.799130+0000","last_clean":"2024-09-12T01:11:52.799130+0000","last_became_active":"2024-09-12T00:30:13.124584+0000","last_became_peered":"2024-09-12T00:30:13.124584+0000","last_unstale":"2024-09-12T01:11:52.799130+0000","last_undegraded":"2024-09-12T01:11:52.799130+0000","last_fullsized":"2024-09-12T01:11:52.799130+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T01:11:52.798926+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T01:11:52.798926+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.798926+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:57.986585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":813,"num_read_kb":670,"num_write":272,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'359","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.309657+0000","last_change":"2024-09-12T01:11:36.309657+0000","last_active":"2024-09-12T01:11:36.309657+0000","last_peered":"2024-09-12T01:11:36.309657+0000","last_clean":"2024-09-12T01:11:36.309657+0000","last_became_active":"2024-09-12T00:30:11.097890+0000","last_became_peered":"2024-09-12T00:30:11.097890+0000","last_unstale":"2024-09-12T01:11:36.309657+0000","last_undegraded":"2024-09-12T01:11:36.309657+0000","last_fullsized":"2024-09-12T01:11:36.309657+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-12T01:11:36.309476+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-12T01:11:36.309476+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.309476+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:38.549094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":38574,"num_write":1151,"num_write_kb":31383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"264'6","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.176992+0000","last_change":"2024-09-12T01:11:49.176935+0000","last_active":"2024-09-12T01:11:49.176992+0000","last_peered":"2024-09-12T01:11:49.176992+0000","last_clean":"2024-09-12T01:11:49.176992+0000","last_became_active":"2024-09-12T00:30:15.122172+0000","last_became_peered":"2024-09-12T00:30:15.122172+0000","last_unstale":"2024-09-12T01:11:49.176992+0000","last_undegraded":"2024-09-12T01:11:49.176992+0000","last_fullsized":"2024-09-12T01:11:49.176992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:11:49.176853+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:11:49.176853+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.176853+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:08.193883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'518","reported_seq":1151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.213229+0000","last_change":"2024-09-12T01:11:53.213229+0000","last_active":"2024-09-12T01:11:53.213229+0000","last_peered":"2024-09-12T01:11:53.213229+0000","last_clean":"2024-09-12T01:11:53.213229+0000","last_became_active":"2024-09-12T00:30:17.145882+0000","last_became_peered":"2024-09-12T00:30:17.145882+0000","last_unstale":"2024-09-12T01:11:53.213229+0000","last_undegraded":"2024-09-12T01:11:53.213229+0000","last_fullsized":"2024-09-12T01:11:53.213229+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'518","last_scrub_stamp":"2024-09-12T01:11:53.213086+0000","last_deep_scrub":"264'518","last_deep_scrub_stamp":"2024-09-12T01:11:53.213086+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.213086+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:22.122443+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96845,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":949,"num_read_kb":2301,"num_write":828,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26648,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.367040+0000","last_change":"2024-09-12T01:11:52.367040+0000","last_active":"2024-09-12T01:11:52.367040+0000","last_peered":"2024-09-12T01:11:52.367040+0000","last_clean":"2024-09-12T01:11:52.367040+0000","last_became_active":"2024-09-12T00:30:19.170776+0000","last_became_peered":"2024-09-12T00:30:19.170776+0000","last_unstale":"2024-09-12T01:11:52.367040+0000","last_undegraded":"2024-09-12T01:11:52.367040+0000","last_fullsized":"2024-09-12T01:11:52.367040+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.366946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.366946+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.366946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:36.669146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'145","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.514193+0000","last_change":"2024-09-12T01:12:08.514136+0000","last_active":"2024-09-12T01:12:08.514193+0000","last_peered":"2024-09-12T01:12:08.514193+0000","last_clean":"2024-09-12T01:12:08.514193+0000","last_became_active":"2024-09-12T00:30:21.188376+0000","last_became_peered":"2024-09-12T00:30:21.188376+0000","last_unstale":"2024-09-12T01:12:08.514193+0000","last_undegraded":"2024-09-12T01:12:08.514193+0000","last_fullsized":"2024-09-12T01:12:08.514193+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T01:12:08.514040+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T01:12:08.514040+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.514040+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:23.264771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":168,"num_write":312,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'188","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.280091+0000","last_change":"2024-09-12T01:11:42.280000+0000","last_active":"2024-09-12T01:11:42.280091+0000","last_peered":"2024-09-12T01:11:42.280091+0000","last_clean":"2024-09-12T01:11:42.280091+0000","last_became_active":"2024-09-12T00:30:13.118251+0000","last_became_peered":"2024-09-12T00:30:13.118251+0000","last_unstale":"2024-09-12T01:11:42.280091+0000","last_undegraded":"2024-09-12T01:11:42.280091+0000","last_fullsized":"2024-09-12T01:11:42.280091+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-09-12T01:11:42.279891+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-09-12T01:11:42.279891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.279891+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:04.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":709,"num_write":308,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'375","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.312581+0000","last_change":"2024-09-12T01:11:36.312581+0000","last_active":"2024-09-12T01:11:36.312581+0000","last_peered":"2024-09-12T01:11:36.312581+0000","last_clean":"2024-09-12T01:11:36.312581+0000","last_became_active":"2024-09-12T00:30:11.102929+0000","last_became_peered":"2024-09-12T00:30:11.102929+0000","last_unstale":"2024-09-12T01:11:36.312581+0000","last_undegraded":"2024-09-12T01:11:36.312581+0000","last_fullsized":"2024-09-12T01:11:36.312581+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:36.312446+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:36.312446+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.312446+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:28.083174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":62693,"num_write":1091,"num_write_kb":37872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.271695+0000","last_change":"2024-09-12T01:11:47.271635+0000","last_active":"2024-09-12T01:11:47.271695+0000","last_peered":"2024-09-12T01:11:47.271695+0000","last_clean":"2024-09-12T01:11:47.271695+0000","last_became_active":"2024-09-12T00:30:15.127268+0000","last_became_peered":"2024-09-12T00:30:15.127268+0000","last_unstale":"2024-09-12T01:11:47.271695+0000","last_undegraded":"2024-09-12T01:11:47.271695+0000","last_fullsized":"2024-09-12T01:11:47.271695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.271530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.271530+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.271530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.919338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'314","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.020906+0000","last_change":"2024-09-12T01:12:07.020906+0000","last_active":"2024-09-12T01:12:07.020906+0000","last_peered":"2024-09-12T01:12:07.020906+0000","last_clean":"2024-09-12T01:12:07.020906+0000","last_became_active":"2024-09-12T00:30:17.145504+0000","last_became_peered":"2024-09-12T00:30:17.145504+0000","last_unstale":"2024-09-12T01:12:07.020906+0000","last_undegraded":"2024-09-12T01:12:07.020906+0000","last_fullsized":"2024-09-12T01:12:07.020906+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T01:12:07.020794+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T01:12:07.020794+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.020794+0000","objects_scrubbed":8,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:30.811955+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1192,"num_write":444,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.468435+0000","last_change":"2024-09-12T01:12:02.468435+0000","last_active":"2024-09-12T01:12:02.468435+0000","last_peered":"2024-09-12T01:12:02.468435+0000","last_clean":"2024-09-12T01:12:02.468435+0000","last_became_active":"2024-09-12T00:30:19.169558+0000","last_became_peered":"2024-09-12T00:30:19.169558+0000","last_unstale":"2024-09-12T01:12:02.468435+0000","last_undegraded":"2024-09-12T01:12:02.468435+0000","last_fullsized":"2024-09-12T01:12:02.468435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:02.468352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:02.468352+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.468352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:10.180957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'182","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.022017+0000","last_change":"2024-09-12T01:12:18.021959+0000","last_active":"2024-09-12T01:12:18.022017+0000","last_peered":"2024-09-12T01:12:18.022017+0000","last_clean":"2024-09-12T01:12:18.022017+0000","last_became_active":"2024-09-12T00:30:21.188350+0000","last_became_peered":"2024-09-12T00:30:21.188350+0000","last_unstale":"2024-09-12T01:12:18.022017+0000","last_undegraded":"2024-09-12T01:12:18.022017+0000","last_fullsized":"2024-09-12T01:12:18.022017+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T01:12:18.021858+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T01:12:18.021858+0000","last_clean_scrub_stamp":"2024-09-12T01:12:18.021858+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:30.977052+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2246,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":214,"num_write":509,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'191","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.526183+0000","last_change":"2024-09-12T01:11:39.526183+0000","last_active":"2024-09-12T01:11:39.526183+0000","last_peered":"2024-09-12T01:11:39.526183+0000","last_clean":"2024-09-12T01:11:39.526183+0000","last_became_active":"2024-09-12T00:30:13.127294+0000","last_became_peered":"2024-09-12T00:30:13.127294+0000","last_unstale":"2024-09-12T01:11:39.526183+0000","last_undegraded":"2024-09-12T01:11:39.526183+0000","last_fullsized":"2024-09-12T01:11:39.526183+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'191","last_scrub_stamp":"2024-09-12T01:11:39.526081+0000","last_deep_scrub":"264'191","last_deep_scrub_stamp":"2024-09-12T01:11:39.526081+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.526081+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.075674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":881,"num_read_kb":750,"num_write":313,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'341","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.807113+0000","last_change":"2024-09-12T01:11:32.807113+0000","last_active":"2024-09-12T01:11:32.807113+0000","last_peered":"2024-09-12T01:11:32.807113+0000","last_clean":"2024-09-12T01:11:32.807113+0000","last_became_active":"2024-09-12T00:30:11.091027+0000","last_became_peered":"2024-09-12T00:30:11.091027+0000","last_unstale":"2024-09-12T01:11:32.807113+0000","last_undegraded":"2024-09-12T01:11:32.807113+0000","last_fullsized":"2024-09-12T01:11:32.807113+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T01:11:32.806954+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T01:11:32.806954+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.806954+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:48.132495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4477982,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":8604,"num_write":1162,"num_write_kb":27793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.318124+0000","last_change":"2024-09-12T01:11:49.318124+0000","last_active":"2024-09-12T01:11:49.318124+0000","last_peered":"2024-09-12T01:11:49.318124+0000","last_clean":"2024-09-12T01:11:49.318124+0000","last_became_active":"2024-09-12T00:30:15.126254+0000","last_became_peered":"2024-09-12T00:30:15.126254+0000","last_unstale":"2024-09-12T01:11:49.318124+0000","last_undegraded":"2024-09-12T01:11:49.318124+0000","last_fullsized":"2024-09-12T01:11:49.318124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.318016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.318016+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.318016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:56.146698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'290","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.182145+0000","last_change":"2024-09-12T01:11:56.182081+0000","last_active":"2024-09-12T01:11:56.182145+0000","last_peered":"2024-09-12T01:11:56.182145+0000","last_clean":"2024-09-12T01:11:56.182145+0000","last_became_active":"2024-09-12T00:30:17.146106+0000","last_became_peered":"2024-09-12T00:30:17.146106+0000","last_unstale":"2024-09-12T01:11:56.182145+0000","last_undegraded":"2024-09-12T01:11:56.182145+0000","last_fullsized":"2024-09-12T01:11:56.182145+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'290","last_scrub_stamp":"2024-09-12T01:11:56.181993+0000","last_deep_scrub":"264'290","last_deep_scrub_stamp":"2024-09-12T01:11:56.181993+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.181993+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:08.113456+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1084,"num_write":388,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.626932+0000","last_change":"2024-09-12T01:11:53.626813+0000","last_active":"2024-09-12T01:11:53.626932+0000","last_peered":"2024-09-12T01:11:53.626932+0000","last_clean":"2024-09-12T01:11:53.626932+0000","last_became_active":"2024-09-12T00:30:19.167119+0000","last_became_peered":"2024-09-12T00:30:19.167119+0000","last_unstale":"2024-09-12T01:11:53.626932+0000","last_undegraded":"2024-09-12T01:11:53.626932+0000","last_fullsized":"2024-09-12T01:11:53.626932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.626713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.626713+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.626713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:07.308732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'100","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.995499+0000","last_change":"2024-09-12T01:12:14.995438+0000","last_active":"2024-09-12T01:12:14.995499+0000","last_peered":"2024-09-12T01:12:14.995499+0000","last_clean":"2024-09-12T01:12:14.995499+0000","last_became_active":"2024-09-12T00:30:21.190937+0000","last_became_peered":"2024-09-12T00:30:21.190937+0000","last_unstale":"2024-09-12T01:12:14.995499+0000","last_undegraded":"2024-09-12T01:12:14.995499+0000","last_fullsized":"2024-09-12T01:12:14.995499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T01:12:14.995348+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T01:12:14.995348+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.995348+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:29.396160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":102,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'208","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.235533+0000","last_change":"2024-09-12T01:11:41.235533+0000","last_active":"2024-09-12T01:11:41.235533+0000","last_peered":"2024-09-12T01:11:41.235533+0000","last_clean":"2024-09-12T01:11:41.235533+0000","last_became_active":"2024-09-12T00:30:13.119843+0000","last_became_peered":"2024-09-12T00:30:13.119843+0000","last_unstale":"2024-09-12T01:11:41.235533+0000","last_undegraded":"2024-09-12T01:11:41.235533+0000","last_fullsized":"2024-09-12T01:11:41.235533+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T01:11:41.235444+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T01:11:41.235444+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.235444+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:10.729092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":901,"num_read_kb":747,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'375","reported_seq":1048,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.260021+0000","last_change":"2024-09-12T01:11:39.260021+0000","last_active":"2024-09-12T01:11:39.260021+0000","last_peered":"2024-09-12T01:11:39.260021+0000","last_clean":"2024-09-12T01:11:39.260021+0000","last_became_active":"2024-09-12T00:30:11.100750+0000","last_became_peered":"2024-09-12T00:30:11.100750+0000","last_unstale":"2024-09-12T01:11:39.260021+0000","last_undegraded":"2024-09-12T01:11:39.260021+0000","last_fullsized":"2024-09-12T01:11:39.260021+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:39.259889+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:39.259889+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.259889+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:23.779675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1340812,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":582,"num_read_kb":31919,"num_write":1306,"num_write_kb":26213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.306420+0000","last_change":"2024-09-12T01:11:54.306420+0000","last_active":"2024-09-12T01:11:54.306420+0000","last_peered":"2024-09-12T01:11:54.306420+0000","last_clean":"2024-09-12T01:11:54.306420+0000","last_became_active":"2024-09-12T00:30:15.127444+0000","last_became_peered":"2024-09-12T00:30:15.127444+0000","last_unstale":"2024-09-12T01:11:54.306420+0000","last_undegraded":"2024-09-12T01:11:54.306420+0000","last_fullsized":"2024-09-12T01:11:54.306420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.306326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.306326+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.306326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:36.609522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'91","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.037844+0000","last_change":"2024-09-12T01:12:08.037782+0000","last_active":"2024-09-12T01:12:08.037844+0000","last_peered":"2024-09-12T01:12:08.037844+0000","last_clean":"2024-09-12T01:12:08.037844+0000","last_became_active":"2024-09-12T00:30:17.144283+0000","last_became_peered":"2024-09-12T00:30:17.144283+0000","last_unstale":"2024-09-12T01:12:08.037844+0000","last_undegraded":"2024-09-12T01:12:08.037844+0000","last_fullsized":"2024-09-12T01:12:08.037844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'91","last_scrub_stamp":"2024-09-12T01:12:08.037667+0000","last_deep_scrub":"264'91","last_deep_scrub_stamp":"2024-09-12T01:12:08.037667+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.037667+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:49.830373+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":66,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'770","reported_seq":2407,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.338723+0000","last_change":"2024-09-12T01:11:53.338662+0000","last_active":"2024-09-12T01:11:53.338723+0000","last_peered":"2024-09-12T01:11:53.338723+0000","last_clean":"2024-09-12T01:11:53.338723+0000","last_became_active":"2024-09-12T00:30:19.166851+0000","last_became_peered":"2024-09-12T00:30:19.166851+0000","last_unstale":"2024-09-12T01:11:53.338723+0000","last_undegraded":"2024-09-12T01:11:53.338723+0000","last_fullsized":"2024-09-12T01:11:53.338723+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'770","last_scrub_stamp":"2024-09-12T01:11:53.338595+0000","last_deep_scrub":"264'770","last_deep_scrub_stamp":"2024-09-12T01:11:53.338595+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.338595+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:50.559711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'132","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.012251+0000","last_change":"2024-09-12T01:12:12.012179+0000","last_active":"2024-09-12T01:12:12.012251+0000","last_peered":"2024-09-12T01:12:12.012251+0000","last_clean":"2024-09-12T01:12:12.012251+0000","last_became_active":"2024-09-12T00:30:21.190151+0000","last_became_peered":"2024-09-12T00:30:21.190151+0000","last_unstale":"2024-09-12T01:12:12.012251+0000","last_undegraded":"2024-09-12T01:12:12.012251+0000","last_fullsized":"2024-09-12T01:12:12.012251+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T01:12:12.012086+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T01:12:12.012086+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.012086+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:35.515669+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'111","reported_seq":715,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.353880+0000","last_change":"2024-09-12T01:11:43.353880+0000","last_active":"2024-09-12T01:11:43.353880+0000","last_peered":"2024-09-12T01:11:43.353880+0000","last_clean":"2024-09-12T01:11:43.353880+0000","last_became_active":"2024-09-12T00:30:13.124167+0000","last_became_peered":"2024-09-12T00:30:13.124167+0000","last_unstale":"2024-09-12T01:11:43.353880+0000","last_undegraded":"2024-09-12T01:11:43.353880+0000","last_fullsized":"2024-09-12T01:11:43.353880+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-12T01:11:43.353764+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-12T01:11:43.353764+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.353764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:12.072323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":425,"num_write":152,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'457","reported_seq":1161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.807625+0000","last_change":"2024-09-12T01:11:33.807625+0000","last_active":"2024-09-12T01:11:33.807625+0000","last_peered":"2024-09-12T01:11:33.807625+0000","last_clean":"2024-09-12T01:11:33.807625+0000","last_became_active":"2024-09-12T00:30:11.108422+0000","last_became_peered":"2024-09-12T00:30:11.108422+0000","last_unstale":"2024-09-12T01:11:33.807625+0000","last_undegraded":"2024-09-12T01:11:33.807625+0000","last_fullsized":"2024-09-12T01:11:33.807625+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'457","last_scrub_stamp":"2024-09-12T01:11:33.807436+0000","last_deep_scrub":"264'457","last_deep_scrub_stamp":"2024-09-12T01:11:33.807436+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.807436+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:14.406328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314887,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":867,"num_read_kb":2765,"num_write":1329,"num_write_kb":29562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.823293+0000","last_change":"2024-09-12T01:11:45.823293+0000","last_active":"2024-09-12T01:11:45.823293+0000","last_peered":"2024-09-12T01:11:45.823293+0000","last_clean":"2024-09-12T01:11:45.823293+0000","last_became_active":"2024-09-12T00:30:15.124922+0000","last_became_peered":"2024-09-12T00:30:15.124922+0000","last_unstale":"2024-09-12T01:11:45.823293+0000","last_undegraded":"2024-09-12T01:11:45.823293+0000","last_fullsized":"2024-09-12T01:11:45.823293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.823172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.823172+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.823172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:20.010059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'360","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.339930+0000","last_change":"2024-09-12T01:11:50.339930+0000","last_active":"2024-09-12T01:11:50.339930+0000","last_peered":"2024-09-12T01:11:50.339930+0000","last_clean":"2024-09-12T01:11:50.339930+0000","last_became_active":"2024-09-12T00:30:17.148793+0000","last_became_peered":"2024-09-12T00:30:17.148793+0000","last_unstale":"2024-09-12T01:11:50.339930+0000","last_undegraded":"2024-09-12T01:11:50.339930+0000","last_fullsized":"2024-09-12T01:11:50.339930+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-12T01:11:50.339839+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-12T01:11:50.339839+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.339839+0000","objects_scrubbed":11,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.251001+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62476,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1247,"num_write":454,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.346416+0000","last_change":"2024-09-12T01:12:03.346416+0000","last_active":"2024-09-12T01:12:03.346416+0000","last_peered":"2024-09-12T01:12:03.346416+0000","last_clean":"2024-09-12T01:12:03.346416+0000","last_became_active":"2024-09-12T00:30:19.169982+0000","last_became_peered":"2024-09-12T00:30:19.169982+0000","last_unstale":"2024-09-12T01:12:03.346416+0000","last_undegraded":"2024-09-12T01:12:03.346416+0000","last_fullsized":"2024-09-12T01:12:03.346416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.346310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.346310+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.346310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:19.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'147","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.736398+0000","last_change":"2024-09-12T01:11:58.736398+0000","last_active":"2024-09-12T01:11:58.736398+0000","last_peered":"2024-09-12T01:11:58.736398+0000","last_clean":"2024-09-12T01:11:58.736398+0000","last_became_active":"2024-09-12T00:30:21.187641+0000","last_became_peered":"2024-09-12T00:30:21.187641+0000","last_unstale":"2024-09-12T01:11:58.736398+0000","last_undegraded":"2024-09-12T01:11:58.736398+0000","last_fullsized":"2024-09-12T01:11:58.736398+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T01:11:58.736290+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T01:11:58.736290+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.736290+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:18.096544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":136,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'195","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.316905+0000","last_change":"2024-09-12T01:11:42.316905+0000","last_active":"2024-09-12T01:11:42.316905+0000","last_peered":"2024-09-12T01:11:42.316905+0000","last_clean":"2024-09-12T01:11:42.316905+0000","last_became_active":"2024-09-12T00:30:13.122622+0000","last_became_peered":"2024-09-12T00:30:13.122622+0000","last_unstale":"2024-09-12T01:11:42.316905+0000","last_undegraded":"2024-09-12T01:11:42.316905+0000","last_fullsized":"2024-09-12T01:11:42.316905+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T01:11:42.316822+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T01:11:42.316822+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.316822+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:34.809995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":295,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'335","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.919664+0000","last_change":"2024-09-12T01:11:39.919664+0000","last_active":"2024-09-12T01:11:39.919664+0000","last_peered":"2024-09-12T01:11:39.919664+0000","last_clean":"2024-09-12T01:11:39.919664+0000","last_became_active":"2024-09-12T00:30:11.109855+0000","last_became_peered":"2024-09-12T00:30:11.109855+0000","last_unstale":"2024-09-12T01:11:39.919664+0000","last_undegraded":"2024-09-12T01:11:39.919664+0000","last_fullsized":"2024-09-12T01:11:39.919664+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T01:11:39.919561+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T01:11:39.919561+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.919561+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:13.840279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314923,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":64470,"num_write":1037,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.316987+0000","last_change":"2024-09-12T01:11:46.316987+0000","last_active":"2024-09-12T01:11:46.316987+0000","last_peered":"2024-09-12T01:11:46.316987+0000","last_clean":"2024-09-12T01:11:46.316987+0000","last_became_active":"2024-09-12T00:30:15.125870+0000","last_became_peered":"2024-09-12T00:30:15.125870+0000","last_unstale":"2024-09-12T01:11:46.316987+0000","last_undegraded":"2024-09-12T01:11:46.316987+0000","last_fullsized":"2024-09-12T01:11:46.316987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.316891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.316891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.316891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:19.260779+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'282","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.375619+0000","last_change":"2024-09-12T01:12:01.375619+0000","last_active":"2024-09-12T01:12:01.375619+0000","last_peered":"2024-09-12T01:12:01.375619+0000","last_clean":"2024-09-12T01:12:01.375619+0000","last_became_active":"2024-09-12T00:30:17.149226+0000","last_became_peered":"2024-09-12T00:30:17.149226+0000","last_unstale":"2024-09-12T01:12:01.375619+0000","last_undegraded":"2024-09-12T01:12:01.375619+0000","last_fullsized":"2024-09-12T01:12:01.375619+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'282","last_scrub_stamp":"2024-09-12T01:12:01.375500+0000","last_deep_scrub":"264'282","last_deep_scrub_stamp":"2024-09-12T01:12:01.375500+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.375500+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:24.160627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":1045,"num_write":368,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.002733+0000","last_change":"2024-09-12T01:12:13.002733+0000","last_active":"2024-09-12T01:12:13.002733+0000","last_peered":"2024-09-12T01:12:13.002733+0000","last_clean":"2024-09-12T01:12:13.002733+0000","last_became_active":"2024-09-12T00:30:19.164556+0000","last_became_peered":"2024-09-12T00:30:19.164556+0000","last_unstale":"2024-09-12T01:12:13.002733+0000","last_undegraded":"2024-09-12T01:12:13.002733+0000","last_fullsized":"2024-09-12T01:12:13.002733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:13.002632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:13.002632+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.002632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:06.601789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'137","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.485908+0000","last_change":"2024-09-12T01:12:09.485908+0000","last_active":"2024-09-12T01:12:09.485908+0000","last_peered":"2024-09-12T01:12:09.485908+0000","last_clean":"2024-09-12T01:12:09.485908+0000","last_became_active":"2024-09-12T00:30:21.193606+0000","last_became_peered":"2024-09-12T00:30:21.193606+0000","last_unstale":"2024-09-12T01:12:09.485908+0000","last_undegraded":"2024-09-12T01:12:09.485908+0000","last_fullsized":"2024-09-12T01:12:09.485908+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T01:12:09.485822+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T01:12:09.485822+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.485822+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:47.741605+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":946,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":239,"num_write":347,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'4096","reported_seq":4679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.542179+0000","last_change":"2024-09-12T01:11:37.542179+0000","last_active":"2024-09-12T01:11:37.542179+0000","last_peered":"2024-09-12T01:11:37.542179+0000","last_clean":"2024-09-12T01:11:37.542179+0000","last_became_active":"2024-09-12T00:30:13.120940+0000","last_became_peered":"2024-09-12T00:30:13.120940+0000","last_unstale":"2024-09-12T01:11:37.542179+0000","last_undegraded":"2024-09-12T01:11:37.542179+0000","last_fullsized":"2024-09-12T01:11:37.542179+0000","mapping_epoch":28,"log_start":"264'4000","ondisk_log_start":"264'4000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4096","last_scrub_stamp":"2024-09-12T01:11:37.542072+0000","last_deep_scrub":"264'4096","last_deep_scrub_stamp":"2024-09-12T01:11:37.542072+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.542072+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:02.815247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16459,"num_read_kb":13812,"num_write":6134,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'369","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.291365+0000","last_change":"2024-09-12T01:11:35.291283+0000","last_active":"2024-09-12T01:11:35.291365+0000","last_peered":"2024-09-12T01:11:35.291365+0000","last_clean":"2024-09-12T01:11:35.291365+0000","last_became_active":"2024-09-12T00:30:11.098879+0000","last_became_peered":"2024-09-12T00:30:11.098879+0000","last_unstale":"2024-09-12T01:11:35.291365+0000","last_undegraded":"2024-09-12T01:11:35.291365+0000","last_fullsized":"2024-09-12T01:11:35.291365+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T01:11:35.291178+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T01:11:35.291178+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.291178+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.339007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4317103,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":44113,"num_write":1057,"num_write_kb":43739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.735465+0000","last_change":"2024-09-12T01:11:52.735465+0000","last_active":"2024-09-12T01:11:52.735465+0000","last_peered":"2024-09-12T01:11:52.735465+0000","last_clean":"2024-09-12T01:11:52.735465+0000","last_became_active":"2024-09-12T00:30:15.125452+0000","last_became_peered":"2024-09-12T00:30:15.125452+0000","last_unstale":"2024-09-12T01:11:52.735465+0000","last_undegraded":"2024-09-12T01:11:52.735465+0000","last_fullsized":"2024-09-12T01:11:52.735465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.735325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.735325+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.735325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:19.511992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'236","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.224588+0000","last_change":"2024-09-12T01:11:54.224588+0000","last_active":"2024-09-12T01:11:54.224588+0000","last_peered":"2024-09-12T01:11:54.224588+0000","last_clean":"2024-09-12T01:11:54.224588+0000","last_became_active":"2024-09-12T00:30:17.145961+0000","last_became_peered":"2024-09-12T00:30:17.145961+0000","last_unstale":"2024-09-12T01:11:54.224588+0000","last_undegraded":"2024-09-12T01:11:54.224588+0000","last_fullsized":"2024-09-12T01:11:54.224588+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-12T01:11:54.224485+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-12T01:11:54.224485+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.224485+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:36.818548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":376,"num_read_kb":862,"num_write":304,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.003257+0000","last_change":"2024-09-12T01:12:10.003257+0000","last_active":"2024-09-12T01:12:10.003257+0000","last_peered":"2024-09-12T01:12:10.003257+0000","last_clean":"2024-09-12T01:12:10.003257+0000","last_became_active":"2024-09-12T00:30:19.167723+0000","last_became_peered":"2024-09-12T00:30:19.167723+0000","last_unstale":"2024-09-12T01:12:10.003257+0000","last_undegraded":"2024-09-12T01:12:10.003257+0000","last_fullsized":"2024-09-12T01:12:10.003257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:10.003171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:10.003171+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.003171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:30.043709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'178","reported_seq":1630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.018212+0000","last_change":"2024-09-12T01:12:16.018212+0000","last_active":"2024-09-12T01:12:16.018212+0000","last_peered":"2024-09-12T01:12:16.018212+0000","last_clean":"2024-09-12T01:12:16.018212+0000","last_became_active":"2024-09-12T00:30:21.188363+0000","last_became_peered":"2024-09-12T00:30:21.188363+0000","last_unstale":"2024-09-12T01:12:16.018212+0000","last_undegraded":"2024-09-12T01:12:16.018212+0000","last_fullsized":"2024-09-12T01:12:16.018212+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-12T01:12:16.018106+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-12T01:12:16.018106+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.018106+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:18.982578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1158,"num_read_kb":1157,"num_write":386,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'184","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.326891+0000","last_change":"2024-09-12T01:11:41.326891+0000","last_active":"2024-09-12T01:11:41.326891+0000","last_peered":"2024-09-12T01:11:41.326891+0000","last_clean":"2024-09-12T01:11:41.326891+0000","last_became_active":"2024-09-12T00:30:13.125727+0000","last_became_peered":"2024-09-12T00:30:13.125727+0000","last_unstale":"2024-09-12T01:11:41.326891+0000","last_undegraded":"2024-09-12T01:11:41.326891+0000","last_fullsized":"2024-09-12T01:11:41.326891+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-12T01:11:41.326789+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-12T01:11:41.326789+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.326789+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:11.817358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":704,"num_write":275,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'321","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.361618+0000","last_change":"2024-09-12T01:11:37.361524+0000","last_active":"2024-09-12T01:11:37.361618+0000","last_peered":"2024-09-12T01:11:37.361618+0000","last_clean":"2024-09-12T01:11:37.361618+0000","last_became_active":"2024-09-12T00:30:11.091808+0000","last_became_peered":"2024-09-12T00:30:11.091808+0000","last_unstale":"2024-09-12T01:11:37.361618+0000","last_undegraded":"2024-09-12T01:11:37.361618+0000","last_fullsized":"2024-09-12T01:11:37.361618+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T01:11:37.361380+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T01:11:37.361380+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.361380+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:30.917946+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380471,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":432,"num_read_kb":10679,"num_write":986,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.289347+0000","last_change":"2024-09-12T01:11:53.289347+0000","last_active":"2024-09-12T01:11:53.289347+0000","last_peered":"2024-09-12T01:11:53.289347+0000","last_clean":"2024-09-12T01:11:53.289347+0000","last_became_active":"2024-09-12T00:30:15.126206+0000","last_became_peered":"2024-09-12T00:30:15.126206+0000","last_unstale":"2024-09-12T01:11:53.289347+0000","last_undegraded":"2024-09-12T01:11:53.289347+0000","last_fullsized":"2024-09-12T01:11:53.289347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:53.289269+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:53.289269+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.289269+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:30.334875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'308","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.969287+0000","last_change":"2024-09-12T01:12:05.969287+0000","last_active":"2024-09-12T01:12:05.969287+0000","last_peered":"2024-09-12T01:12:05.969287+0000","last_clean":"2024-09-12T01:12:05.969287+0000","last_became_active":"2024-09-12T00:30:17.144724+0000","last_became_peered":"2024-09-12T00:30:17.144724+0000","last_unstale":"2024-09-12T01:12:05.969287+0000","last_undegraded":"2024-09-12T01:12:05.969287+0000","last_fullsized":"2024-09-12T01:12:05.969287+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-12T01:12:05.969160+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-12T01:12:05.969160+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.969160+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:15.801949+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48397,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":1068,"num_write":398,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.356472+0000","last_change":"2024-09-12T01:12:05.356472+0000","last_active":"2024-09-12T01:12:05.356472+0000","last_peered":"2024-09-12T01:12:05.356472+0000","last_clean":"2024-09-12T01:12:05.356472+0000","last_became_active":"2024-09-12T00:30:19.172265+0000","last_became_peered":"2024-09-12T00:30:19.172265+0000","last_unstale":"2024-09-12T01:12:05.356472+0000","last_undegraded":"2024-09-12T01:12:05.356472+0000","last_fullsized":"2024-09-12T01:12:05.356472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:05.356389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:05.356389+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.356389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:02.127439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'132","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.288847+0000","last_change":"2024-09-12T01:11:56.288779+0000","last_active":"2024-09-12T01:11:56.288847+0000","last_peered":"2024-09-12T01:11:56.288847+0000","last_clean":"2024-09-12T01:11:56.288847+0000","last_became_active":"2024-09-12T00:30:21.191837+0000","last_became_peered":"2024-09-12T00:30:21.191837+0000","last_unstale":"2024-09-12T01:11:56.288847+0000","last_undegraded":"2024-09-12T01:11:56.288847+0000","last_fullsized":"2024-09-12T01:11:56.288847+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T01:11:56.288686+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T01:11:56.288686+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.288686+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:05.149635+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":99,"num_write":307,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'142","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.285051+0000","last_change":"2024-09-12T01:11:43.285051+0000","last_active":"2024-09-12T01:11:43.285051+0000","last_peered":"2024-09-12T01:11:43.285051+0000","last_clean":"2024-09-12T01:11:43.285051+0000","last_became_active":"2024-09-12T00:30:13.121828+0000","last_became_peered":"2024-09-12T00:30:13.121828+0000","last_unstale":"2024-09-12T01:11:43.285051+0000","last_undegraded":"2024-09-12T01:11:43.285051+0000","last_fullsized":"2024-09-12T01:11:43.285051+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T01:11:43.284952+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T01:11:43.284952+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.284952+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:06.141716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":656,"num_read_kb":543,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'369","reported_seq":1110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.422327+0000","last_change":"2024-09-12T01:11:33.422242+0000","last_active":"2024-09-12T01:11:33.422327+0000","last_peered":"2024-09-12T01:11:33.422327+0000","last_clean":"2024-09-12T01:11:33.422327+0000","last_became_active":"2024-09-12T00:30:11.105480+0000","last_became_peered":"2024-09-12T00:30:11.105480+0000","last_unstale":"2024-09-12T01:11:33.422327+0000","last_undegraded":"2024-09-12T01:11:33.422327+0000","last_fullsized":"2024-09-12T01:11:33.422327+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T01:11:33.422113+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T01:11:33.422113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.422113+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:29.910170+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029011,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":778,"num_read_kb":27112,"num_write":1220,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'88","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.550819+0000","last_change":"2024-09-12T01:11:40.550819+0000","last_active":"2024-09-12T01:11:40.550819+0000","last_peered":"2024-09-12T01:11:40.550819+0000","last_clean":"2024-09-12T01:11:40.550819+0000","last_became_active":"2024-09-12T00:30:13.130421+0000","last_became_peered":"2024-09-12T00:30:13.130421+0000","last_unstale":"2024-09-12T01:11:40.550819+0000","last_undegraded":"2024-09-12T01:11:40.550819+0000","last_fullsized":"2024-09-12T01:11:40.550819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'88","last_scrub_stamp":"2024-09-12T01:11:40.550737+0000","last_deep_scrub":"264'88","last_deep_scrub_stamp":"2024-09-12T01:11:40.550737+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.550737+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:24.149286+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":312,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'345","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.529883+0000","last_change":"2024-09-12T01:11:34.529826+0000","last_active":"2024-09-12T01:11:34.529883+0000","last_peered":"2024-09-12T01:11:34.529883+0000","last_clean":"2024-09-12T01:11:34.529883+0000","last_became_active":"2024-09-12T00:30:11.092318+0000","last_became_peered":"2024-09-12T00:30:11.092318+0000","last_unstale":"2024-09-12T01:11:34.529883+0000","last_undegraded":"2024-09-12T01:11:34.529883+0000","last_fullsized":"2024-09-12T01:11:34.529883+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T01:11:34.529704+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T01:11:34.529704+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.529704+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:03.024603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287236,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":12148,"num_write":1066,"num_write_kb":57585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'404","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.812921+0000","last_change":"2024-09-12T01:11:54.812921+0000","last_active":"2024-09-12T01:11:54.812921+0000","last_peered":"2024-09-12T01:11:54.812921+0000","last_clean":"2024-09-12T01:11:54.812921+0000","last_became_active":"2024-09-12T00:30:13.126912+0000","last_became_peered":"2024-09-12T00:30:13.126912+0000","last_unstale":"2024-09-12T01:11:54.812921+0000","last_undegraded":"2024-09-12T01:11:54.812921+0000","last_fullsized":"2024-09-12T01:11:54.812921+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'404","last_scrub_stamp":"2024-09-12T01:11:54.812831+0000","last_deep_scrub":"264'404","last_deep_scrub_stamp":"2024-09-12T01:11:54.812831+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.812831+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:55.192863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1731,"num_read_kb":1377,"num_write":679,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'430","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.905125+0000","last_change":"2024-09-12T01:11:42.905031+0000","last_active":"2024-09-12T01:11:42.905125+0000","last_peered":"2024-09-12T01:11:42.905125+0000","last_clean":"2024-09-12T01:11:42.905125+0000","last_became_active":"2024-09-12T00:30:11.099069+0000","last_became_peered":"2024-09-12T00:30:11.099069+0000","last_unstale":"2024-09-12T01:11:42.905125+0000","last_undegraded":"2024-09-12T01:11:42.905125+0000","last_fullsized":"2024-09-12T01:11:42.905125+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-09-12T01:11:42.904875+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-09-12T01:11:42.904875+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.904875+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:17.846461+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380696,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":691,"num_read_kb":70901,"num_write":1282,"num_write_kb":51705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'117","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.327787+0000","last_change":"2024-09-12T01:11:50.327787+0000","last_active":"2024-09-12T01:11:50.327787+0000","last_peered":"2024-09-12T01:11:50.327787+0000","last_clean":"2024-09-12T01:11:50.327787+0000","last_became_active":"2024-09-12T00:30:13.126860+0000","last_became_peered":"2024-09-12T00:30:13.126860+0000","last_unstale":"2024-09-12T01:11:50.327787+0000","last_undegraded":"2024-09-12T01:11:50.327787+0000","last_fullsized":"2024-09-12T01:11:50.327787+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T01:11:50.327702+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T01:11:50.327702+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.327702+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:21.477416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":463,"num_write":200,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'328","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.324364+0000","last_change":"2024-09-12T01:11:38.324299+0000","last_active":"2024-09-12T01:11:38.324364+0000","last_peered":"2024-09-12T01:11:38.324364+0000","last_clean":"2024-09-12T01:11:38.324364+0000","last_became_active":"2024-09-12T00:30:11.105196+0000","last_became_peered":"2024-09-12T00:30:11.105196+0000","last_unstale":"2024-09-12T01:11:38.324364+0000","last_undegraded":"2024-09-12T01:11:38.324364+0000","last_fullsized":"2024-09-12T01:11:38.324364+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'328","last_scrub_stamp":"2024-09-12T01:11:38.324193+0000","last_deep_scrub":"264'328","last_deep_scrub_stamp":"2024-09-12T01:11:38.324193+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.324193+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.266767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":8473,"num_write":1002,"num_write_kb":46203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'4191","reported_seq":4841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.275565+0000","last_change":"2024-09-12T01:11:48.275510+0000","last_active":"2024-09-12T01:11:48.275565+0000","last_peered":"2024-09-12T01:11:48.275565+0000","last_clean":"2024-09-12T01:11:48.275565+0000","last_became_active":"2024-09-12T00:30:13.125353+0000","last_became_peered":"2024-09-12T00:30:13.125353+0000","last_unstale":"2024-09-12T01:11:48.275565+0000","last_undegraded":"2024-09-12T01:11:48.275565+0000","last_fullsized":"2024-09-12T01:11:48.275565+0000","mapping_epoch":28,"log_start":"264'4100","ondisk_log_start":"264'4100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4191","last_scrub_stamp":"2024-09-12T01:11:48.275422+0000","last_deep_scrub":"264'4191","last_deep_scrub_stamp":"2024-09-12T01:11:48.275422+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.275422+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":3000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:02.155433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16885,"num_read_kb":14166,"num_write":6282,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'387","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.090306+0000","last_change":"2024-09-12T01:11:34.090306+0000","last_active":"2024-09-12T01:11:34.090306+0000","last_peered":"2024-09-12T01:11:34.090306+0000","last_clean":"2024-09-12T01:11:34.090306+0000","last_became_active":"2024-09-12T00:30:11.108127+0000","last_became_peered":"2024-09-12T00:30:11.108127+0000","last_unstale":"2024-09-12T01:11:34.090306+0000","last_undegraded":"2024-09-12T01:11:34.090306+0000","last_fullsized":"2024-09-12T01:11:34.090306+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'387","last_scrub_stamp":"2024-09-12T01:11:34.090152+0000","last_deep_scrub":"264'387","last_deep_scrub_stamp":"2024-09-12T01:11:34.090152+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.090152+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.953945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105411,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":473,"num_read_kb":2771,"num_write":1102,"num_write_kb":29841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'185","reported_seq":785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.371411+0000","last_change":"2024-09-12T01:11:41.371298+0000","last_active":"2024-09-12T01:11:41.371411+0000","last_peered":"2024-09-12T01:11:41.371411+0000","last_clean":"2024-09-12T01:11:41.371411+0000","last_became_active":"2024-09-12T00:30:13.129432+0000","last_became_peered":"2024-09-12T00:30:13.129432+0000","last_unstale":"2024-09-12T01:11:41.371411+0000","last_undegraded":"2024-09-12T01:11:41.371411+0000","last_fullsized":"2024-09-12T01:11:41.371411+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T01:11:41.371181+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T01:11:41.371181+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.371181+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:10.754863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":694,"num_write":316,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'364","reported_seq":1080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.098210+0000","last_change":"2024-09-12T01:11:36.098210+0000","last_active":"2024-09-12T01:11:36.098210+0000","last_peered":"2024-09-12T01:11:36.098210+0000","last_clean":"2024-09-12T01:11:36.098210+0000","last_became_active":"2024-09-12T00:30:11.108351+0000","last_became_peered":"2024-09-12T00:30:11.108351+0000","last_unstale":"2024-09-12T01:11:36.098210+0000","last_undegraded":"2024-09-12T01:11:36.098210+0000","last_fullsized":"2024-09-12T01:11:36.098210+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-12T01:11:36.098005+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-12T01:11:36.098005+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.098005+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:33.871781+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648362,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":667,"num_read_kb":30774,"num_write":1247,"num_write_kb":36026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'164","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.102572+0000","last_change":"2024-09-12T01:11:47.102484+0000","last_active":"2024-09-12T01:11:47.102572+0000","last_peered":"2024-09-12T01:11:47.102572+0000","last_clean":"2024-09-12T01:11:47.102572+0000","last_became_active":"2024-09-12T00:30:13.124637+0000","last_became_peered":"2024-09-12T00:30:13.124637+0000","last_unstale":"2024-09-12T01:11:47.102572+0000","last_undegraded":"2024-09-12T01:11:47.102572+0000","last_fullsized":"2024-09-12T01:11:47.102572+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-12T01:11:47.102372+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-12T01:11:47.102372+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.102372+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:35.485046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":588,"num_write":241,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'372","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.386029+0000","last_change":"2024-09-12T01:11:38.386029+0000","last_active":"2024-09-12T01:11:38.386029+0000","last_peered":"2024-09-12T01:11:38.386029+0000","last_clean":"2024-09-12T01:11:38.386029+0000","last_became_active":"2024-09-12T00:30:11.108084+0000","last_became_peered":"2024-09-12T00:30:11.108084+0000","last_unstale":"2024-09-12T01:11:38.386029+0000","last_undegraded":"2024-09-12T01:11:38.386029+0000","last_fullsized":"2024-09-12T01:11:38.386029+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T01:11:38.385902+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T01:11:38.385902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.385902+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:00.631378+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5025600,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":616,"num_read_kb":11433,"num_write":1237,"num_write_kb":28830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'237","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.845480+0000","last_change":"2024-09-12T01:11:36.845384+0000","last_active":"2024-09-12T01:11:36.845480+0000","last_peered":"2024-09-12T01:11:36.845480+0000","last_clean":"2024-09-12T01:11:36.845480+0000","last_became_active":"2024-09-12T00:30:13.128799+0000","last_became_peered":"2024-09-12T00:30:13.128799+0000","last_unstale":"2024-09-12T01:11:36.845480+0000","last_undegraded":"2024-09-12T01:11:36.845480+0000","last_fullsized":"2024-09-12T01:11:36.845480+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-09-12T01:11:36.845275+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-09-12T01:11:36.845275+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.845275+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.874151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":871,"num_write":360,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'352","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.309076+0000","last_change":"2024-09-12T01:11:39.309076+0000","last_active":"2024-09-12T01:11:39.309076+0000","last_peered":"2024-09-12T01:11:39.309076+0000","last_clean":"2024-09-12T01:11:39.309076+0000","last_became_active":"2024-09-12T00:30:11.102617+0000","last_became_peered":"2024-09-12T00:30:11.102617+0000","last_unstale":"2024-09-12T01:11:39.309076+0000","last_undegraded":"2024-09-12T01:11:39.309076+0000","last_fullsized":"2024-09-12T01:11:39.309076+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-12T01:11:39.308936+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-12T01:11:39.308936+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.308936+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:27.572801+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364846,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":18671,"num_write":1023,"num_write_kb":28835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'52","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.555429+0000","last_change":"2024-09-12T01:11:41.555361+0000","last_active":"2024-09-12T01:11:41.555429+0000","last_peered":"2024-09-12T01:11:41.555429+0000","last_clean":"2024-09-12T01:11:41.555429+0000","last_became_active":"2024-09-12T00:30:13.123035+0000","last_became_peered":"2024-09-12T00:30:13.123035+0000","last_unstale":"2024-09-12T01:11:41.555429+0000","last_undegraded":"2024-09-12T01:11:41.555429+0000","last_fullsized":"2024-09-12T01:11:41.555429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T01:11:41.555280+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T01:11:41.555280+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.555280+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:57.286919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":222,"num_write":77,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'336","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.894219+0000","last_change":"2024-09-12T01:11:43.894219+0000","last_active":"2024-09-12T01:11:43.894219+0000","last_peered":"2024-09-12T01:11:43.894219+0000","last_clean":"2024-09-12T01:11:43.894219+0000","last_became_active":"2024-09-12T00:30:11.110299+0000","last_became_peered":"2024-09-12T00:30:11.110299+0000","last_unstale":"2024-09-12T01:11:43.894219+0000","last_undegraded":"2024-09-12T01:11:43.894219+0000","last_fullsized":"2024-09-12T01:11:43.894219+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-12T01:11:43.894098+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-12T01:11:43.894098+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.894098+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:37.338640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":443,"num_read_kb":30015,"num_write":1046,"num_write_kb":30187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'180","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.406443+0000","last_change":"2024-09-12T01:11:39.406375+0000","last_active":"2024-09-12T01:11:39.406443+0000","last_peered":"2024-09-12T01:11:39.406443+0000","last_clean":"2024-09-12T01:11:39.406443+0000","last_became_active":"2024-09-12T00:30:13.123217+0000","last_became_peered":"2024-09-12T00:30:13.123217+0000","last_unstale":"2024-09-12T01:11:39.406443+0000","last_undegraded":"2024-09-12T01:11:39.406443+0000","last_fullsized":"2024-09-12T01:11:39.406443+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T01:11:39.406291+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T01:11:39.406291+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.406291+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.832105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":608,"num_write":257,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'316","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.267042+0000","last_change":"2024-09-12T01:11:40.267042+0000","last_active":"2024-09-12T01:11:40.267042+0000","last_peered":"2024-09-12T01:11:40.267042+0000","last_clean":"2024-09-12T01:11:40.267042+0000","last_became_active":"2024-09-12T00:30:11.102436+0000","last_became_peered":"2024-09-12T00:30:11.102436+0000","last_unstale":"2024-09-12T01:11:40.267042+0000","last_undegraded":"2024-09-12T01:11:40.267042+0000","last_fullsized":"2024-09-12T01:11:40.267042+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T01:11:40.266922+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T01:11:40.266922+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.266922+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:22.297560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315002,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":79108,"num_write":1106,"num_write_kb":40469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'217","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.366851+0000","last_change":"2024-09-12T01:11:51.366851+0000","last_active":"2024-09-12T01:11:51.366851+0000","last_peered":"2024-09-12T01:11:51.366851+0000","last_clean":"2024-09-12T01:11:51.366851+0000","last_became_active":"2024-09-12T00:30:13.129733+0000","last_became_peered":"2024-09-12T00:30:13.129733+0000","last_unstale":"2024-09-12T01:11:51.366851+0000","last_undegraded":"2024-09-12T01:11:51.366851+0000","last_fullsized":"2024-09-12T01:11:51.366851+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'217","last_scrub_stamp":"2024-09-12T01:11:51.366771+0000","last_deep_scrub":"264'217","last_deep_scrub_stamp":"2024-09-12T01:11:51.366771+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.366771+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:43.523061+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":953,"num_read_kb":786,"num_write":335,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'382","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.875020+0000","last_change":"2024-09-12T01:11:35.875020+0000","last_active":"2024-09-12T01:11:35.875020+0000","last_peered":"2024-09-12T01:11:35.875020+0000","last_clean":"2024-09-12T01:11:35.875020+0000","last_became_active":"2024-09-12T00:30:11.105950+0000","last_became_peered":"2024-09-12T00:30:11.105950+0000","last_unstale":"2024-09-12T01:11:35.875020+0000","last_undegraded":"2024-09-12T01:11:35.875020+0000","last_fullsized":"2024-09-12T01:11:35.875020+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-12T01:11:35.874867+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-12T01:11:35.874867+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.874867+0000","objects_scrubbed":12,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:15.332168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4299828,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":589,"num_read_kb":20762,"num_write":1342,"num_write_kb":32414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'173","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.878947+0000","last_change":"2024-09-12T01:11:40.878947+0000","last_active":"2024-09-12T01:11:40.878947+0000","last_peered":"2024-09-12T01:11:40.878947+0000","last_clean":"2024-09-12T01:11:40.878947+0000","last_became_active":"2024-09-12T00:30:13.128009+0000","last_became_peered":"2024-09-12T00:30:13.128009+0000","last_unstale":"2024-09-12T01:11:40.878947+0000","last_undegraded":"2024-09-12T01:11:40.878947+0000","last_fullsized":"2024-09-12T01:11:40.878947+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-12T01:11:40.878859+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-12T01:11:40.878859+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.878859+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:39.949418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":738,"num_read_kb":604,"num_write":258,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'395","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.263014+0000","last_change":"2024-09-12T01:11:38.263014+0000","last_active":"2024-09-12T01:11:38.263014+0000","last_peered":"2024-09-12T01:11:38.263014+0000","last_clean":"2024-09-12T01:11:38.263014+0000","last_became_active":"2024-09-12T00:30:11.096908+0000","last_became_peered":"2024-09-12T00:30:11.096908+0000","last_unstale":"2024-09-12T01:11:38.263014+0000","last_undegraded":"2024-09-12T01:11:38.263014+0000","last_fullsized":"2024-09-12T01:11:38.263014+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-12T01:11:38.262881+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-12T01:11:38.262881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.262881+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:54.179820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":27824,"num_write":1325,"num_write_kb":35997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'130","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.865328+0000","last_change":"2024-09-12T01:11:38.865328+0000","last_active":"2024-09-12T01:11:38.865328+0000","last_peered":"2024-09-12T01:11:38.865328+0000","last_clean":"2024-09-12T01:11:38.865328+0000","last_became_active":"2024-09-12T00:30:13.126817+0000","last_became_peered":"2024-09-12T00:30:13.126817+0000","last_unstale":"2024-09-12T01:11:38.865328+0000","last_undegraded":"2024-09-12T01:11:38.865328+0000","last_fullsized":"2024-09-12T01:11:38.865328+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T01:11:38.865238+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T01:11:38.865238+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.865238+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:46.059324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":588,"num_read_kb":486,"num_write":195,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'337","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.427130+0000","last_change":"2024-09-12T01:11:30.427130+0000","last_active":"2024-09-12T01:11:30.427130+0000","last_peered":"2024-09-12T01:11:30.427130+0000","last_clean":"2024-09-12T01:11:30.427130+0000","last_became_active":"2024-09-12T00:30:11.105575+0000","last_became_peered":"2024-09-12T00:30:11.105575+0000","last_unstale":"2024-09-12T01:11:30.427130+0000","last_undegraded":"2024-09-12T01:11:30.427130+0000","last_fullsized":"2024-09-12T01:11:30.427130+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T01:11:30.427034+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T01:11:30.427034+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.427034+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:04.883192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":45130,"num_write":1156,"num_write_kb":46621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'202","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.577784+0000","last_change":"2024-09-12T01:11:42.577784+0000","last_active":"2024-09-12T01:11:42.577784+0000","last_peered":"2024-09-12T01:11:42.577784+0000","last_clean":"2024-09-12T01:11:42.577784+0000","last_became_active":"2024-09-12T00:30:13.129092+0000","last_became_peered":"2024-09-12T00:30:13.129092+0000","last_unstale":"2024-09-12T01:11:42.577784+0000","last_undegraded":"2024-09-12T01:11:42.577784+0000","last_fullsized":"2024-09-12T01:11:42.577784+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T01:11:42.577693+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T01:11:42.577693+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.577693+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:29.344845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":854,"num_read_kb":707,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'347","reported_seq":1195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.846455+0000","last_change":"2024-09-12T01:11:44.846455+0000","last_active":"2024-09-12T01:11:44.846455+0000","last_peered":"2024-09-12T01:11:44.846455+0000","last_clean":"2024-09-12T01:11:44.846455+0000","last_became_active":"2024-09-12T00:30:11.108616+0000","last_became_peered":"2024-09-12T00:30:11.108616+0000","last_unstale":"2024-09-12T01:11:44.846455+0000","last_undegraded":"2024-09-12T01:11:44.846455+0000","last_fullsized":"2024-09-12T01:11:44.846455+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:44.846295+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:44.846295+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.846295+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:52.600725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":955,"num_read_kb":21858,"num_write":1152,"num_write_kb":27958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'147","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.265816+0000","last_change":"2024-09-12T01:11:44.265816+0000","last_active":"2024-09-12T01:11:44.265816+0000","last_peered":"2024-09-12T01:11:44.265816+0000","last_clean":"2024-09-12T01:11:44.265816+0000","last_became_active":"2024-09-12T00:30:13.125887+0000","last_became_peered":"2024-09-12T00:30:13.125887+0000","last_unstale":"2024-09-12T01:11:44.265816+0000","last_undegraded":"2024-09-12T01:11:44.265816+0000","last_fullsized":"2024-09-12T01:11:44.265816+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T01:11:44.265735+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T01:11:44.265735+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.265735+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:34.728050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":559,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'335","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.555081+0000","last_change":"2024-09-12T01:11:36.555016+0000","last_active":"2024-09-12T01:11:36.555081+0000","last_peered":"2024-09-12T01:11:36.555081+0000","last_clean":"2024-09-12T01:11:36.555081+0000","last_became_active":"2024-09-12T00:30:46.396288+0000","last_became_peered":"2024-09-12T00:30:46.396288+0000","last_unstale":"2024-09-12T01:11:36.555081+0000","last_undegraded":"2024-09-12T01:11:36.555081+0000","last_fullsized":"2024-09-12T01:11:36.555081+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T01:11:36.554891+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T01:11:36.554891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.554891+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:31.851264+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8687076,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":21015,"num_write":1060,"num_write_kb":30668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'251","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.851278+0000","last_change":"2024-09-12T01:11:37.851278+0000","last_active":"2024-09-12T01:11:37.851278+0000","last_peered":"2024-09-12T01:11:37.851278+0000","last_clean":"2024-09-12T01:11:37.851278+0000","last_became_active":"2024-09-12T00:30:13.127513+0000","last_became_peered":"2024-09-12T00:30:13.127513+0000","last_unstale":"2024-09-12T01:11:37.851278+0000","last_undegraded":"2024-09-12T01:11:37.851278+0000","last_fullsized":"2024-09-12T01:11:37.851278+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T01:11:37.851124+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T01:11:37.851124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.851124+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:02.058983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":791,"num_write":358,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8300,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'328","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.826057+0000","last_change":"2024-09-12T01:11:48.825992+0000","last_active":"2024-09-12T01:11:48.826057+0000","last_peered":"2024-09-12T01:11:48.826057+0000","last_clean":"2024-09-12T01:11:48.826057+0000","last_became_active":"2024-09-12T00:30:11.109661+0000","last_became_peered":"2024-09-12T00:30:11.109661+0000","last_unstale":"2024-09-12T01:11:48.826057+0000","last_undegraded":"2024-09-12T01:11:48.826057+0000","last_fullsized":"2024-09-12T01:11:48.826057+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'328","last_scrub_stamp":"2024-09-12T01:11:48.825791+0000","last_deep_scrub":"264'328","last_deep_scrub_stamp":"2024-09-12T01:11:48.825791+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.825791+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:02.017430+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":8210,"num_write":1080,"num_write_kb":36173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'315","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.811331+0000","last_change":"2024-09-12T01:11:45.811270+0000","last_active":"2024-09-12T01:11:45.811331+0000","last_peered":"2024-09-12T01:11:45.811331+0000","last_clean":"2024-09-12T01:11:45.811331+0000","last_became_active":"2024-09-12T00:30:11.113173+0000","last_became_peered":"2024-09-12T00:30:11.113173+0000","last_unstale":"2024-09-12T01:11:45.811331+0000","last_undegraded":"2024-09-12T01:11:45.811331+0000","last_fullsized":"2024-09-12T01:11:45.811331+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T01:11:45.811155+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T01:11:45.811155+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.811155+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:57.504861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":50214,"num_write":1057,"num_write_kb":47204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'24","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.282085+0000","last_change":"2024-09-12T01:11:45.282085+0000","last_active":"2024-09-12T01:11:45.282085+0000","last_peered":"2024-09-12T01:11:45.282085+0000","last_clean":"2024-09-12T01:11:45.282085+0000","last_became_active":"2024-09-12T00:30:13.126264+0000","last_became_peered":"2024-09-12T00:30:13.126264+0000","last_unstale":"2024-09-12T01:11:45.282085+0000","last_undegraded":"2024-09-12T01:11:45.282085+0000","last_fullsized":"2024-09-12T01:11:45.282085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T01:11:45.281991+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T01:11:45.281991+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.281991+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:59.791991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":113,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'377","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.282699+0000","last_change":"2024-09-12T01:11:41.282638+0000","last_active":"2024-09-12T01:11:41.282699+0000","last_peered":"2024-09-12T01:11:41.282699+0000","last_clean":"2024-09-12T01:11:41.282699+0000","last_became_active":"2024-09-12T00:30:11.102026+0000","last_became_peered":"2024-09-12T00:30:11.102026+0000","last_unstale":"2024-09-12T01:11:41.282699+0000","last_undegraded":"2024-09-12T01:11:41.282699+0000","last_fullsized":"2024-09-12T01:11:41.282699+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-12T01:11:41.282464+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-12T01:11:41.282464+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.282464+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:04.065353+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4360630,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":672,"num_read_kb":9482,"num_write":1213,"num_write_kb":28977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'250","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.895038+0000","last_change":"2024-09-12T01:11:42.895038+0000","last_active":"2024-09-12T01:11:42.895038+0000","last_peered":"2024-09-12T01:11:42.895038+0000","last_clean":"2024-09-12T01:11:42.895038+0000","last_became_active":"2024-09-12T00:30:13.119872+0000","last_became_peered":"2024-09-12T00:30:13.119872+0000","last_unstale":"2024-09-12T01:11:42.895038+0000","last_undegraded":"2024-09-12T01:11:42.895038+0000","last_fullsized":"2024-09-12T01:11:42.895038+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-12T01:11:42.894943+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-12T01:11:42.894943+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.894943+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.400595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":987,"num_write":428,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5946,"num_read_kb":4236,"num_write":1962,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5476,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1035,"ondisk_log_size":1035,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15005,"num_read_kb":14670,"num_write":16786,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1654,"ondisk_log_size":1654,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":685,"ondisk_log_size":685,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548725,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17648,"num_read_kb":36949,"num_write":14701,"num_write_kb":11551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686502,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1727,"ondisk_log_size":1727,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102018,"num_read_kb":85254,"num_write":36979,"num_write_kb":18604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44076,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4245,"ondisk_log_size":4245,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":166688013,"num_objects":400,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":400,"num_whiteouts":0,"num_read":36140,"num_read_kb":1917452,"num_write":72064,"num_write_kb":2191736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":224706560,"data_stored":224706560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3667,"ondisk_log_size":3667,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170064,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168795,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509959,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264752,"kb_used_data":35040,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94107088,"statfs":{"total":96636764160,"available":96365658112,"internally_reserved":0,"allocated":35880960,"data_stored":33872164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509956,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341752,"kb_used_data":31528,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94030088,"statfs":{"total":96636764160,"available":96286810112,"internally_reserved":0,"allocated":32284672,"data_stored":30297333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509956,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156088,"kb_used_data":34728,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94215752,"statfs":{"total":96636764160,"available":96476930048,"internally_reserved":0,"allocated":35561472,"data_stored":33552270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542661,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252368,"kb_used_data":32448,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94119472,"statfs":{"total":96636764160,"available":96378339328,"internally_reserved":0,"allocated":33226752,"data_stored":31260225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542660,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151548,"kb_used_data":21868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94220292,"statfs":{"total":96636764160,"available":96481579008,"internally_reserved":0,"allocated":22392832,"data_stored":20398857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542658,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289684,"kb_used_data":33604,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94082156,"statfs":{"total":96636764160,"available":96340127744,"internally_reserved":0,"allocated":34410496,"data_stored":32405240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262207941},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542661,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251100,"kb_used_data":31180,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94120740,"statfs":{"total":96636764160,"available":96379637760,"internally_reserved":0,"allocated":31928320,"data_stored":29931227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225180101},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575365,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172604,"kb_used_data":33132,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94199236,"statfs":{"total":96636764160,"available":96460017664,"internally_reserved":0,"allocated":33927168,"data_stored":31936990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31330304,"data_stored":31330304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27488256,"data_stored":27488256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29716480,"data_stored":29716480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31649792,"data_stored":31649792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":27709440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29593600,"data_stored":29593600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18178048,"data_stored":18178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29040640,"data_stored":29040640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:12:34.019 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.019 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.019 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.020 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.020 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:46:15.238906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.020 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.021 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.021 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.022 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.023 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.023 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.023 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:46:18.258060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.024 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:56:51.966439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=56, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:34.030 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:12:54.030 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:12:54.366 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-12T01:12:54.377 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-12T01:12:54.380 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":1548,"stamp":"2024-09-12T01:12:54.272141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":168845237,"num_objects":756,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":756,"num_whiteouts":0,"num_read":179589,"num_read_kb":2400386,"num_write":143007,"num_write_kb":2482898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740116,"num_omap_keys":1789,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13374,"ondisk_log_size":13374,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1879896,"kb_used_data":253528,"kb_used_omap":12,"kb_used_meta":1626227,"kb_avail":753094824,"statfs":{"total":773094113280,"available":771169099776,"internally_reserved":0,"allocated":259612672,"data_stored":243654306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1665257010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005213"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.170470+0000","last_change":"2024-09-12T01:12:06.170470+0000","last_active":"2024-09-12T01:12:06.170470+0000","last_peered":"2024-09-12T01:12:06.170470+0000","last_clean":"2024-09-12T01:12:06.170470+0000","last_became_active":"2024-09-12T00:56:52.990975+0000","last_became_peered":"2024-09-12T00:56:52.990975+0000","last_unstale":"2024-09-12T01:12:06.170470+0000","last_undegraded":"2024-09-12T01:12:06.170470+0000","last_fullsized":"2024-09-12T01:12:06.170470+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:06.170381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:06.170381+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.170381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:41.174560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.769515+0000","last_change":"2024-09-12T01:12:05.769515+0000","last_active":"2024-09-12T01:12:05.769515+0000","last_peered":"2024-09-12T01:12:05.769515+0000","last_clean":"2024-09-12T01:12:05.769515+0000","last_became_active":"2024-09-12T00:46:19.284774+0000","last_became_peered":"2024-09-12T00:46:19.284774+0000","last_unstale":"2024-09-12T01:12:05.769515+0000","last_undegraded":"2024-09-12T01:12:05.769515+0000","last_fullsized":"2024-09-12T01:12:05.769515+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:05.769422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:05.769422+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.769422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.065734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.701914+0000","last_change":"2024-09-12T01:12:09.701914+0000","last_active":"2024-09-12T01:12:09.701914+0000","last_peered":"2024-09-12T01:12:09.701914+0000","last_clean":"2024-09-12T01:12:09.701914+0000","last_became_active":"2024-09-12T00:46:16.275529+0000","last_became_peered":"2024-09-12T00:46:16.275529+0000","last_unstale":"2024-09-12T01:12:09.701914+0000","last_undegraded":"2024-09-12T01:12:09.701914+0000","last_fullsized":"2024-09-12T01:12:09.701914+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:09.701827+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:09.701827+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.701827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:25.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'24","reported_seq":113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.374392+0000","last_change":"2024-09-12T01:12:12.374392+0000","last_active":"2024-09-12T01:12:12.374392+0000","last_peered":"2024-09-12T01:12:12.374392+0000","last_clean":"2024-09-12T01:12:12.374392+0000","last_became_active":"2024-09-12T00:44:37.816192+0000","last_became_peered":"2024-09-12T00:44:37.816192+0000","last_unstale":"2024-09-12T01:12:12.374392+0000","last_undegraded":"2024-09-12T01:12:12.374392+0000","last_fullsized":"2024-09-12T01:12:12.374392+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T01:12:12.374286+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T01:12:12.374286+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.374286+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:01.125236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.181807+0000","last_change":"2024-09-12T01:12:13.181807+0000","last_active":"2024-09-12T01:12:13.181807+0000","last_peered":"2024-09-12T01:12:13.181807+0000","last_clean":"2024-09-12T01:12:13.181807+0000","last_became_active":"2024-09-12T00:56:52.995871+0000","last_became_peered":"2024-09-12T00:56:52.995871+0000","last_unstale":"2024-09-12T01:12:13.181807+0000","last_undegraded":"2024-09-12T01:12:13.181807+0000","last_fullsized":"2024-09-12T01:12:13.181807+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:13.181727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:13.181727+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.181727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:06.840656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.308551+0000","last_change":"2024-09-12T01:12:11.308551+0000","last_active":"2024-09-12T01:12:11.308551+0000","last_peered":"2024-09-12T01:12:11.308551+0000","last_clean":"2024-09-12T01:12:11.308551+0000","last_became_active":"2024-09-12T00:46:19.284875+0000","last_became_peered":"2024-09-12T00:46:19.284875+0000","last_unstale":"2024-09-12T01:12:11.308551+0000","last_undegraded":"2024-09-12T01:12:11.308551+0000","last_fullsized":"2024-09-12T01:12:11.308551+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:11.308438+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:11.308438+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.308438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:14.759811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.329419+0000","last_change":"2024-09-12T01:12:16.329419+0000","last_active":"2024-09-12T01:12:16.329419+0000","last_peered":"2024-09-12T01:12:16.329419+0000","last_clean":"2024-09-12T01:12:16.329419+0000","last_became_active":"2024-09-12T00:46:16.275381+0000","last_became_peered":"2024-09-12T00:46:16.275381+0000","last_unstale":"2024-09-12T01:12:16.329419+0000","last_undegraded":"2024-09-12T01:12:16.329419+0000","last_fullsized":"2024-09-12T01:12:16.329419+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:16.329306+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:16.329306+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.329306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:09.457138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'45","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.404032+0000","last_change":"2024-09-12T01:12:11.403911+0000","last_active":"2024-09-12T01:12:11.404032+0000","last_peered":"2024-09-12T01:12:11.404032+0000","last_clean":"2024-09-12T01:12:11.404032+0000","last_became_active":"2024-09-12T00:44:37.819561+0000","last_became_peered":"2024-09-12T00:44:37.819561+0000","last_unstale":"2024-09-12T01:12:11.404032+0000","last_undegraded":"2024-09-12T01:12:11.404032+0000","last_fullsized":"2024-09-12T01:12:11.404032+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-12T01:12:11.403816+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-12T01:12:11.403816+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.403816+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:43.010940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":164,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.722507+0000","last_change":"2024-09-12T01:12:09.722507+0000","last_active":"2024-09-12T01:12:09.722507+0000","last_peered":"2024-09-12T01:12:09.722507+0000","last_clean":"2024-09-12T01:12:09.722507+0000","last_became_active":"2024-09-12T00:56:52.990364+0000","last_became_peered":"2024-09-12T00:56:52.990364+0000","last_unstale":"2024-09-12T01:12:09.722507+0000","last_undegraded":"2024-09-12T01:12:09.722507+0000","last_fullsized":"2024-09-12T01:12:09.722507+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:09.722421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:09.722421+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.722421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:36.374184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:23.317087+0000","last_change":"2024-09-12T01:12:23.317087+0000","last_active":"2024-09-12T01:12:23.317087+0000","last_peered":"2024-09-12T01:12:23.317087+0000","last_clean":"2024-09-12T01:12:23.317087+0000","last_became_active":"2024-09-12T00:46:19.285357+0000","last_became_peered":"2024-09-12T00:46:19.285357+0000","last_unstale":"2024-09-12T01:12:23.317087+0000","last_undegraded":"2024-09-12T01:12:23.317087+0000","last_fullsized":"2024-09-12T01:12:23.317087+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:23.316988+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:23.316988+0000","last_clean_scrub_stamp":"2024-09-12T01:12:23.316988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:48.416105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"261'7","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.684480+0000","last_change":"2024-09-12T01:12:11.684417+0000","last_active":"2024-09-12T01:12:11.684480+0000","last_peered":"2024-09-12T01:12:11.684480+0000","last_clean":"2024-09-12T01:12:11.684480+0000","last_became_active":"2024-09-12T00:46:16.278221+0000","last_became_peered":"2024-09-12T00:46:16.278221+0000","last_unstale":"2024-09-12T01:12:11.684480+0000","last_undegraded":"2024-09-12T01:12:11.684480+0000","last_fullsized":"2024-09-12T01:12:11.684480+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T01:12:11.684324+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T01:12:11.684324+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.684324+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:38.819437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5130,"num_write":12,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'37","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.289433+0000","last_change":"2024-09-12T01:12:07.289367+0000","last_active":"2024-09-12T01:12:07.289433+0000","last_peered":"2024-09-12T01:12:07.289433+0000","last_clean":"2024-09-12T01:12:07.289433+0000","last_became_active":"2024-09-12T00:44:37.818239+0000","last_became_peered":"2024-09-12T00:44:37.818239+0000","last_unstale":"2024-09-12T01:12:07.289433+0000","last_undegraded":"2024-09-12T01:12:07.289433+0000","last_fullsized":"2024-09-12T01:12:07.289433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-12T01:12:07.289241+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-12T01:12:07.289241+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.289241+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:26.374834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":144,"num_write":70,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:30.432809+0000","last_change":"2024-09-12T01:12:30.432809+0000","last_active":"2024-09-12T01:12:30.432809+0000","last_peered":"2024-09-12T01:12:30.432809+0000","last_clean":"2024-09-12T01:12:30.432809+0000","last_became_active":"2024-09-12T00:56:52.995062+0000","last_became_peered":"2024-09-12T00:56:52.995062+0000","last_unstale":"2024-09-12T01:12:30.432809+0000","last_undegraded":"2024-09-12T01:12:30.432809+0000","last_fullsized":"2024-09-12T01:12:30.432809+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:30.432695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:30.432695+0000","last_clean_scrub_stamp":"2024-09-12T01:12:30.432695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:57.453262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:21.320448+0000","last_change":"2024-09-12T01:12:21.320393+0000","last_active":"2024-09-12T01:12:21.320448+0000","last_peered":"2024-09-12T01:12:21.320448+0000","last_clean":"2024-09-12T01:12:21.320448+0000","last_became_active":"2024-09-12T00:46:19.284822+0000","last_became_peered":"2024-09-12T00:46:19.284822+0000","last_unstale":"2024-09-12T01:12:21.320448+0000","last_undegraded":"2024-09-12T01:12:21.320448+0000","last_fullsized":"2024-09-12T01:12:21.320448+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:21.320302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:21.320302+0000","last_clean_scrub_stamp":"2024-09-12T01:12:21.320302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:15.381180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.723081+0000","last_change":"2024-09-12T01:12:03.723081+0000","last_active":"2024-09-12T01:12:03.723081+0000","last_peered":"2024-09-12T01:12:03.723081+0000","last_clean":"2024-09-12T01:12:03.723081+0000","last_became_active":"2024-09-12T00:46:16.261617+0000","last_became_peered":"2024-09-12T00:46:16.261617+0000","last_unstale":"2024-09-12T01:12:03.723081+0000","last_undegraded":"2024-09-12T01:12:03.723081+0000","last_fullsized":"2024-09-12T01:12:03.723081+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.722994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.722994+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.722994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:14.319282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.282013+0000","last_change":"2024-09-12T01:12:05.281948+0000","last_active":"2024-09-12T01:12:05.282013+0000","last_peered":"2024-09-12T01:12:05.282013+0000","last_clean":"2024-09-12T01:12:05.282013+0000","last_became_active":"2024-09-12T00:44:37.815325+0000","last_became_peered":"2024-09-12T00:44:37.815325+0000","last_unstale":"2024-09-12T01:12:05.282013+0000","last_undegraded":"2024-09-12T01:12:05.282013+0000","last_fullsized":"2024-09-12T01:12:05.282013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-09-12T01:12:05.281862+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-09-12T01:12:05.281862+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.281862+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:45.941101+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":218,"num_write":105,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.906247+0000","last_change":"2024-09-12T01:12:20.906169+0000","last_active":"2024-09-12T01:12:20.906247+0000","last_peered":"2024-09-12T01:12:20.906247+0000","last_clean":"2024-09-12T01:12:20.906247+0000","last_became_active":"2024-09-12T00:56:52.991358+0000","last_became_peered":"2024-09-12T00:56:52.991358+0000","last_unstale":"2024-09-12T01:12:20.906247+0000","last_undegraded":"2024-09-12T01:12:20.906247+0000","last_fullsized":"2024-09-12T01:12:20.906247+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:20.906083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:20.906083+0000","last_clean_scrub_stamp":"2024-09-12T01:12:20.906083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:27.465640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.180629+0000","last_change":"2024-09-12T01:12:02.180629+0000","last_active":"2024-09-12T01:12:02.180629+0000","last_peered":"2024-09-12T01:12:02.180629+0000","last_clean":"2024-09-12T01:12:02.180629+0000","last_became_active":"2024-09-12T00:46:19.274024+0000","last_became_peered":"2024-09-12T00:46:19.274024+0000","last_unstale":"2024-09-12T01:12:02.180629+0000","last_undegraded":"2024-09-12T01:12:02.180629+0000","last_fullsized":"2024-09-12T01:12:02.180629+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T01:12:02.180532+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T01:12:02.180532+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.180532+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:47.568862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.412386+0000","last_change":"2024-09-12T01:12:13.412294+0000","last_active":"2024-09-12T01:12:13.412386+0000","last_peered":"2024-09-12T01:12:13.412386+0000","last_clean":"2024-09-12T01:12:13.412386+0000","last_became_active":"2024-09-12T00:46:16.272230+0000","last_became_peered":"2024-09-12T00:46:16.272230+0000","last_unstale":"2024-09-12T01:12:13.412386+0000","last_undegraded":"2024-09-12T01:12:13.412386+0000","last_fullsized":"2024-09-12T01:12:13.412386+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:13.412197+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:13.412197+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.412197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:24.318645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'26","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.249035+0000","last_change":"2024-09-12T01:12:04.248958+0000","last_active":"2024-09-12T01:12:04.249035+0000","last_peered":"2024-09-12T01:12:04.249035+0000","last_clean":"2024-09-12T01:12:04.249035+0000","last_became_active":"2024-09-12T00:44:37.821297+0000","last_became_peered":"2024-09-12T00:44:37.821297+0000","last_unstale":"2024-09-12T01:12:04.249035+0000","last_undegraded":"2024-09-12T01:12:04.249035+0000","last_fullsized":"2024-09-12T01:12:04.249035+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T01:12:04.248875+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T01:12:04.248875+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.248875+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:52.200263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:17.340421+0000","last_change":"2024-09-12T01:12:17.340421+0000","last_active":"2024-09-12T01:12:17.340421+0000","last_peered":"2024-09-12T01:12:17.340421+0000","last_clean":"2024-09-12T01:12:17.340421+0000","last_became_active":"2024-09-12T00:56:52.990528+0000","last_became_peered":"2024-09-12T00:56:52.990528+0000","last_unstale":"2024-09-12T01:12:17.340421+0000","last_undegraded":"2024-09-12T01:12:17.340421+0000","last_fullsized":"2024-09-12T01:12:17.340421+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:17.340334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:17.340334+0000","last_clean_scrub_stamp":"2024-09-12T01:12:17.340334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:02.095576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:33.012331+0000","last_change":"2024-09-12T01:12:33.012271+0000","last_active":"2024-09-12T01:12:33.012331+0000","last_peered":"2024-09-12T01:12:33.012331+0000","last_clean":"2024-09-12T01:12:33.012331+0000","last_became_active":"2024-09-12T00:46:19.280794+0000","last_became_peered":"2024-09-12T00:46:19.280794+0000","last_unstale":"2024-09-12T01:12:33.012331+0000","last_undegraded":"2024-09-12T01:12:33.012331+0000","last_fullsized":"2024-09-12T01:12:33.012331+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:12:33.012164+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:12:33.012164+0000","last_clean_scrub_stamp":"2024-09-12T01:12:33.012164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:28.541857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12296,"num_write":8,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:29.049042+0000","last_change":"2024-09-12T01:12:29.049042+0000","last_active":"2024-09-12T01:12:29.049042+0000","last_peered":"2024-09-12T01:12:29.049042+0000","last_clean":"2024-09-12T01:12:29.049042+0000","last_became_active":"2024-09-12T00:46:16.267528+0000","last_became_peered":"2024-09-12T00:46:16.267528+0000","last_unstale":"2024-09-12T01:12:29.049042+0000","last_undegraded":"2024-09-12T01:12:29.049042+0000","last_fullsized":"2024-09-12T01:12:29.049042+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:12:29.048944+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:12:29.048944+0000","last_clean_scrub_stamp":"2024-09-12T01:12:29.048944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:02.143240+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8204,"num_write":6,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'129","reported_seq":440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.333689+0000","last_change":"2024-09-12T01:12:05.333607+0000","last_active":"2024-09-12T01:12:05.333689+0000","last_peered":"2024-09-12T01:12:05.333689+0000","last_clean":"2024-09-12T01:12:05.333689+0000","last_became_active":"2024-09-12T00:44:37.819556+0000","last_became_peered":"2024-09-12T00:44:37.819556+0000","last_unstale":"2024-09-12T01:12:05.333689+0000","last_undegraded":"2024-09-12T01:12:05.333689+0000","last_fullsized":"2024-09-12T01:12:05.333689+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-12T01:12:05.333523+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-12T01:12:05.333523+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.333523+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:59.312207+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":767,"num_read_kb":571,"num_write":157,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3976,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.209667+0000","last_change":"2024-09-12T01:12:14.209667+0000","last_active":"2024-09-12T01:12:14.209667+0000","last_peered":"2024-09-12T01:12:14.209667+0000","last_clean":"2024-09-12T01:12:14.209667+0000","last_became_active":"2024-09-12T00:56:52.992081+0000","last_became_peered":"2024-09-12T00:56:52.992081+0000","last_unstale":"2024-09-12T01:12:14.209667+0000","last_undegraded":"2024-09-12T01:12:14.209667+0000","last_fullsized":"2024-09-12T01:12:14.209667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:14.209594+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:14.209594+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.209594+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:47.869607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'7","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.305081+0000","last_change":"2024-09-12T01:12:10.305081+0000","last_active":"2024-09-12T01:12:10.305081+0000","last_peered":"2024-09-12T01:12:10.305081+0000","last_clean":"2024-09-12T01:12:10.305081+0000","last_became_active":"2024-09-12T00:46:19.279811+0000","last_became_peered":"2024-09-12T00:46:19.279811+0000","last_unstale":"2024-09-12T01:12:10.305081+0000","last_undegraded":"2024-09-12T01:12:10.305081+0000","last_fullsized":"2024-09-12T01:12:10.305081+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T01:12:10.304983+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T01:12:10.304983+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.304983+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:26.397813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":13308,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'5","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.252593+0000","last_change":"2024-09-12T01:11:59.252593+0000","last_active":"2024-09-12T01:11:59.252593+0000","last_peered":"2024-09-12T01:11:59.252593+0000","last_clean":"2024-09-12T01:11:59.252593+0000","last_became_active":"2024-09-12T00:46:16.274541+0000","last_became_peered":"2024-09-12T00:46:16.274541+0000","last_unstale":"2024-09-12T01:11:59.252593+0000","last_undegraded":"2024-09-12T01:11:59.252593+0000","last_fullsized":"2024-09-12T01:11:59.252593+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:11:59.252508+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:11:59.252508+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.252508+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:01.509300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'13","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.644506+0000","last_change":"2024-09-12T01:12:03.644506+0000","last_active":"2024-09-12T01:12:03.644506+0000","last_peered":"2024-09-12T01:12:03.644506+0000","last_clean":"2024-09-12T01:12:03.644506+0000","last_became_active":"2024-09-12T00:44:37.817108+0000","last_became_peered":"2024-09-12T00:44:37.817108+0000","last_unstale":"2024-09-12T01:12:03.644506+0000","last_undegraded":"2024-09-12T01:12:03.644506+0000","last_fullsized":"2024-09-12T01:12:03.644506+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-12T01:12:03.644413+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-12T01:12:03.644413+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.644413+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:31.680128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.177483+0000","last_change":"2024-09-12T01:12:09.177483+0000","last_active":"2024-09-12T01:12:09.177483+0000","last_peered":"2024-09-12T01:12:09.177483+0000","last_clean":"2024-09-12T01:12:09.177483+0000","last_became_active":"2024-09-12T00:56:52.989394+0000","last_became_peered":"2024-09-12T00:56:52.989394+0000","last_unstale":"2024-09-12T01:12:09.177483+0000","last_undegraded":"2024-09-12T01:12:09.177483+0000","last_fullsized":"2024-09-12T01:12:09.177483+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:09.177399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:09.177399+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.177399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:50.094753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"264'7","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.820474+0000","last_change":"2024-09-12T01:12:15.820474+0000","last_active":"2024-09-12T01:12:15.820474+0000","last_peered":"2024-09-12T01:12:15.820474+0000","last_clean":"2024-09-12T01:12:15.820474+0000","last_became_active":"2024-09-12T00:46:19.280878+0000","last_became_peered":"2024-09-12T00:46:19.280878+0000","last_unstale":"2024-09-12T01:12:15.820474+0000","last_undegraded":"2024-09-12T01:12:15.820474+0000","last_fullsized":"2024-09-12T01:12:15.820474+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T01:12:15.820387+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T01:12:15.820387+0000","last_clean_scrub_stamp":"2024-09-12T01:12:15.820387+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:04.395673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.223001+0000","last_change":"2024-09-12T01:12:09.223001+0000","last_active":"2024-09-12T01:12:09.223001+0000","last_peered":"2024-09-12T01:12:09.223001+0000","last_clean":"2024-09-12T01:12:09.223001+0000","last_became_active":"2024-09-12T00:46:16.277776+0000","last_became_peered":"2024-09-12T00:46:16.277776+0000","last_unstale":"2024-09-12T01:12:09.223001+0000","last_undegraded":"2024-09-12T01:12:09.223001+0000","last_fullsized":"2024-09-12T01:12:09.223001+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:09.222892+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:09.222892+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.222892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:06.374785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'18","reported_seq":95,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.213287+0000","last_change":"2024-09-12T01:12:03.213287+0000","last_active":"2024-09-12T01:12:03.213287+0000","last_peered":"2024-09-12T01:12:03.213287+0000","last_clean":"2024-09-12T01:12:03.213287+0000","last_became_active":"2024-09-12T00:44:37.815820+0000","last_became_peered":"2024-09-12T00:44:37.815820+0000","last_unstale":"2024-09-12T01:12:03.213287+0000","last_undegraded":"2024-09-12T01:12:03.213287+0000","last_fullsized":"2024-09-12T01:12:03.213287+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-12T01:12:03.213208+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-12T01:12:03.213208+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.213208+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:30.498570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":57,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:28.428331+0000","last_change":"2024-09-12T01:12:28.428331+0000","last_active":"2024-09-12T01:12:28.428331+0000","last_peered":"2024-09-12T01:12:28.428331+0000","last_clean":"2024-09-12T01:12:28.428331+0000","last_became_active":"2024-09-12T00:56:52.995696+0000","last_became_peered":"2024-09-12T00:56:52.995696+0000","last_unstale":"2024-09-12T01:12:28.428331+0000","last_undegraded":"2024-09-12T01:12:28.428331+0000","last_fullsized":"2024-09-12T01:12:28.428331+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:28.428243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:28.428243+0000","last_clean_scrub_stamp":"2024-09-12T01:12:28.428243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:29.882483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.847582+0000","last_change":"2024-09-12T01:12:16.847582+0000","last_active":"2024-09-12T01:12:16.847582+0000","last_peered":"2024-09-12T01:12:16.847582+0000","last_clean":"2024-09-12T01:12:16.847582+0000","last_became_active":"2024-09-12T00:46:19.282466+0000","last_became_peered":"2024-09-12T00:46:19.282466+0000","last_unstale":"2024-09-12T01:12:16.847582+0000","last_undegraded":"2024-09-12T01:12:16.847582+0000","last_fullsized":"2024-09-12T01:12:16.847582+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:16.847485+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:16.847485+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.847485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:37.141238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:30.012668+0000","last_change":"2024-09-12T01:12:30.012668+0000","last_active":"2024-09-12T01:12:30.012668+0000","last_peered":"2024-09-12T01:12:30.012668+0000","last_clean":"2024-09-12T01:12:30.012668+0000","last_became_active":"2024-09-12T00:46:16.268479+0000","last_became_peered":"2024-09-12T00:46:16.268479+0000","last_unstale":"2024-09-12T01:12:30.012668+0000","last_undegraded":"2024-09-12T01:12:30.012668+0000","last_fullsized":"2024-09-12T01:12:30.012668+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:30.012584+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:30.012584+0000","last_clean_scrub_stamp":"2024-09-12T01:12:30.012584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:14.745954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'15","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.394090+0000","last_change":"2024-09-12T01:12:10.394090+0000","last_active":"2024-09-12T01:12:10.394090+0000","last_peered":"2024-09-12T01:12:10.394090+0000","last_clean":"2024-09-12T01:12:10.394090+0000","last_became_active":"2024-09-12T00:44:37.811697+0000","last_became_peered":"2024-09-12T00:44:37.811697+0000","last_unstale":"2024-09-12T01:12:10.394090+0000","last_undegraded":"2024-09-12T01:12:10.394090+0000","last_fullsized":"2024-09-12T01:12:10.394090+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-09-12T01:12:10.394004+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-09-12T01:12:10.394004+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.394004+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:21.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":57,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.229140+0000","last_change":"2024-09-12T01:12:11.229140+0000","last_active":"2024-09-12T01:12:11.229140+0000","last_peered":"2024-09-12T01:12:11.229140+0000","last_clean":"2024-09-12T01:12:11.229140+0000","last_became_active":"2024-09-12T00:56:52.984878+0000","last_became_peered":"2024-09-12T00:56:52.984878+0000","last_unstale":"2024-09-12T01:12:11.229140+0000","last_undegraded":"2024-09-12T01:12:11.229140+0000","last_fullsized":"2024-09-12T01:12:11.229140+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:11.229052+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:11.229052+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.229052+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.412445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.314528+0000","last_change":"2024-09-12T01:12:20.314528+0000","last_active":"2024-09-12T01:12:20.314528+0000","last_peered":"2024-09-12T01:12:20.314528+0000","last_clean":"2024-09-12T01:12:20.314528+0000","last_became_active":"2024-09-12T00:46:19.276197+0000","last_became_peered":"2024-09-12T00:46:19.276197+0000","last_unstale":"2024-09-12T01:12:20.314528+0000","last_undegraded":"2024-09-12T01:12:20.314528+0000","last_fullsized":"2024-09-12T01:12:20.314528+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:20.314428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:20.314428+0000","last_clean_scrub_stamp":"2024-09-12T01:12:20.314428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:17.280276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.268512+0000","last_change":"2024-09-12T01:11:58.268421+0000","last_active":"2024-09-12T01:11:58.268512+0000","last_peered":"2024-09-12T01:11:58.268512+0000","last_clean":"2024-09-12T01:11:58.268512+0000","last_became_active":"2024-09-12T00:46:16.263870+0000","last_became_peered":"2024-09-12T00:46:16.263870+0000","last_unstale":"2024-09-12T01:11:58.268512+0000","last_undegraded":"2024-09-12T01:11:58.268512+0000","last_fullsized":"2024-09-12T01:11:58.268512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:11:58.268310+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:11:58.268310+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.268310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:14.647884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2048,"num_write":18,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'37","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.421520+0000","last_change":"2024-09-12T01:12:09.421520+0000","last_active":"2024-09-12T01:12:09.421520+0000","last_peered":"2024-09-12T01:12:09.421520+0000","last_clean":"2024-09-12T01:12:09.421520+0000","last_became_active":"2024-09-12T00:44:37.820232+0000","last_became_peered":"2024-09-12T00:44:37.820232+0000","last_unstale":"2024-09-12T01:12:09.421520+0000","last_undegraded":"2024-09-12T01:12:09.421520+0000","last_fullsized":"2024-09-12T01:12:09.421520+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-12T01:12:09.421430+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-12T01:12:09.421430+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.421430+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.135571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":132,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.254294+0000","last_change":"2024-09-12T01:12:13.254294+0000","last_active":"2024-09-12T01:12:13.254294+0000","last_peered":"2024-09-12T01:12:13.254294+0000","last_clean":"2024-09-12T01:12:13.254294+0000","last_became_active":"2024-09-12T00:56:52.987492+0000","last_became_peered":"2024-09-12T00:56:52.987492+0000","last_unstale":"2024-09-12T01:12:13.254294+0000","last_undegraded":"2024-09-12T01:12:13.254294+0000","last_fullsized":"2024-09-12T01:12:13.254294+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:13.254197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:13.254197+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.254197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:59.368060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"261'9","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:17.823666+0000","last_change":"2024-09-12T01:12:17.823666+0000","last_active":"2024-09-12T01:12:17.823666+0000","last_peered":"2024-09-12T01:12:17.823666+0000","last_clean":"2024-09-12T01:12:17.823666+0000","last_became_active":"2024-09-12T00:46:19.286860+0000","last_became_peered":"2024-09-12T00:46:19.286860+0000","last_unstale":"2024-09-12T01:12:17.823666+0000","last_undegraded":"2024-09-12T01:12:17.823666+0000","last_fullsized":"2024-09-12T01:12:17.823666+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'9","last_scrub_stamp":"2024-09-12T01:12:17.823561+0000","last_deep_scrub":"261'9","last_deep_scrub_stamp":"2024-09-12T01:12:17.823561+0000","last_clean_scrub_stamp":"2024-09-12T01:12:17.823561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:55.471643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":13316,"num_write":14,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.697903+0000","last_change":"2024-09-12T01:12:08.697847+0000","last_active":"2024-09-12T01:12:08.697903+0000","last_peered":"2024-09-12T01:12:08.697903+0000","last_clean":"2024-09-12T01:12:08.697903+0000","last_became_active":"2024-09-12T00:46:16.279114+0000","last_became_peered":"2024-09-12T00:46:16.279114+0000","last_unstale":"2024-09-12T01:12:08.697903+0000","last_undegraded":"2024-09-12T01:12:08.697903+0000","last_fullsized":"2024-09-12T01:12:08.697903+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:08.697744+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:08.697744+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.697744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:12.893237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'25","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.649528+0000","last_change":"2024-09-12T01:12:02.649528+0000","last_active":"2024-09-12T01:12:02.649528+0000","last_peered":"2024-09-12T01:12:02.649528+0000","last_clean":"2024-09-12T01:12:02.649528+0000","last_became_active":"2024-09-12T00:44:37.819153+0000","last_became_peered":"2024-09-12T00:44:37.819153+0000","last_unstale":"2024-09-12T01:12:02.649528+0000","last_undegraded":"2024-09-12T01:12:02.649528+0000","last_fullsized":"2024-09-12T01:12:02.649528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-12T01:12:02.649425+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-12T01:12:02.649425+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.649425+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:22.865583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":89,"num_write":41,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.151506+0000","last_change":"2024-09-12T01:12:07.151506+0000","last_active":"2024-09-12T01:12:07.151506+0000","last_peered":"2024-09-12T01:12:07.151506+0000","last_clean":"2024-09-12T01:12:07.151506+0000","last_became_active":"2024-09-12T00:56:52.990265+0000","last_became_peered":"2024-09-12T00:56:52.990265+0000","last_unstale":"2024-09-12T01:12:07.151506+0000","last_undegraded":"2024-09-12T01:12:07.151506+0000","last_fullsized":"2024-09-12T01:12:07.151506+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:07.151401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:07.151401+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.151401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:30.414409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.165694+0000","last_change":"2024-09-12T01:12:01.165637+0000","last_active":"2024-09-12T01:12:01.165694+0000","last_peered":"2024-09-12T01:12:01.165694+0000","last_clean":"2024-09-12T01:12:01.165694+0000","last_became_active":"2024-09-12T00:46:19.277011+0000","last_became_peered":"2024-09-12T00:46:19.277011+0000","last_unstale":"2024-09-12T01:12:01.165694+0000","last_undegraded":"2024-09-12T01:12:01.165694+0000","last_fullsized":"2024-09-12T01:12:01.165694+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.165547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.165547+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.165547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:08.466888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"264'4","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.363288+0000","last_change":"2024-09-12T01:12:14.363230+0000","last_active":"2024-09-12T01:12:14.363288+0000","last_peered":"2024-09-12T01:12:14.363288+0000","last_clean":"2024-09-12T01:12:14.363288+0000","last_became_active":"2024-09-12T00:46:16.275403+0000","last_became_peered":"2024-09-12T00:46:16.275403+0000","last_unstale":"2024-09-12T01:12:14.363288+0000","last_undegraded":"2024-09-12T01:12:14.363288+0000","last_fullsized":"2024-09-12T01:12:14.363288+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:14.363149+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:14.363149+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.363149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:46.308375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"264'69","reported_seq":276,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:21.930958+0000","last_change":"2024-09-12T01:12:21.930866+0000","last_active":"2024-09-12T01:12:21.930958+0000","last_peered":"2024-09-12T01:12:21.930958+0000","last_clean":"2024-09-12T01:12:21.930958+0000","last_became_active":"2024-09-12T00:44:37.821192+0000","last_became_peered":"2024-09-12T00:44:37.821192+0000","last_unstale":"2024-09-12T01:12:21.930958+0000","last_undegraded":"2024-09-12T01:12:21.930958+0000","last_fullsized":"2024-09-12T01:12:21.930958+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-12T01:12:21.930741+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-12T01:12:21.930741+0000","last_clean_scrub_stamp":"2024-09-12T01:12:21.930741+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:34.398194+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":443,"num_read_kb":323,"num_write":87,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:29.454098+0000","last_change":"2024-09-12T01:12:29.454098+0000","last_active":"2024-09-12T01:12:29.454098+0000","last_peered":"2024-09-12T01:12:29.454098+0000","last_clean":"2024-09-12T01:12:29.454098+0000","last_became_active":"2024-09-12T00:56:52.995495+0000","last_became_peered":"2024-09-12T00:56:52.995495+0000","last_unstale":"2024-09-12T01:12:29.454098+0000","last_undegraded":"2024-09-12T01:12:29.454098+0000","last_fullsized":"2024-09-12T01:12:29.454098+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:29.454004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:29.454004+0000","last_clean_scrub_stamp":"2024-09-12T01:12:29.454004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:52.839377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:22.284814+0000","last_change":"2024-09-12T01:12:22.284814+0000","last_active":"2024-09-12T01:12:22.284814+0000","last_peered":"2024-09-12T01:12:22.284814+0000","last_clean":"2024-09-12T01:12:22.284814+0000","last_became_active":"2024-09-12T00:46:19.280653+0000","last_became_peered":"2024-09-12T00:46:19.280653+0000","last_unstale":"2024-09-12T01:12:22.284814+0000","last_undegraded":"2024-09-12T01:12:22.284814+0000","last_fullsized":"2024-09-12T01:12:22.284814+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:12:22.284725+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:12:22.284725+0000","last_clean_scrub_stamp":"2024-09-12T01:12:22.284725+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:28.531796+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10256,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.778408+0000","last_change":"2024-09-12T01:12:01.778408+0000","last_active":"2024-09-12T01:12:01.778408+0000","last_peered":"2024-09-12T01:12:01.778408+0000","last_clean":"2024-09-12T01:12:01.778408+0000","last_became_active":"2024-09-12T00:46:16.270004+0000","last_became_peered":"2024-09-12T00:46:16.270004+0000","last_unstale":"2024-09-12T01:12:01.778408+0000","last_undegraded":"2024-09-12T01:12:01.778408+0000","last_fullsized":"2024-09-12T01:12:01.778408+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T01:12:01.778304+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T01:12:01.778304+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.778304+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:34.611521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'15","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:22.975924+0000","last_change":"2024-09-12T01:12:22.975865+0000","last_active":"2024-09-12T01:12:22.975924+0000","last_peered":"2024-09-12T01:12:22.975924+0000","last_clean":"2024-09-12T01:12:22.975924+0000","last_became_active":"2024-09-12T00:44:37.820639+0000","last_became_peered":"2024-09-12T00:44:37.820639+0000","last_unstale":"2024-09-12T01:12:22.975924+0000","last_undegraded":"2024-09-12T01:12:22.975924+0000","last_fullsized":"2024-09-12T01:12:22.975924+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-09-12T01:12:22.975765+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-09-12T01:12:22.975765+0000","last_clean_scrub_stamp":"2024-09-12T01:12:22.975765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:38.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":52,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.170592+0000","last_change":"2024-09-12T01:12:14.170592+0000","last_active":"2024-09-12T01:12:14.170592+0000","last_peered":"2024-09-12T01:12:14.170592+0000","last_clean":"2024-09-12T01:12:14.170592+0000","last_became_active":"2024-09-12T00:56:52.991261+0000","last_became_peered":"2024-09-12T00:56:52.991261+0000","last_unstale":"2024-09-12T01:12:14.170592+0000","last_undegraded":"2024-09-12T01:12:14.170592+0000","last_fullsized":"2024-09-12T01:12:14.170592+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:14.170500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:14.170500+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.170500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:33.394905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.275571+0000","last_change":"2024-09-12T01:12:18.275571+0000","last_active":"2024-09-12T01:12:18.275571+0000","last_peered":"2024-09-12T01:12:18.275571+0000","last_clean":"2024-09-12T01:12:18.275571+0000","last_became_active":"2024-09-12T00:46:19.281676+0000","last_became_peered":"2024-09-12T00:46:19.281676+0000","last_unstale":"2024-09-12T01:12:18.275571+0000","last_undegraded":"2024-09-12T01:12:18.275571+0000","last_fullsized":"2024-09-12T01:12:18.275571+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:18.275485+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:18.275485+0000","last_clean_scrub_stamp":"2024-09-12T01:12:18.275485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:46.131166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.458762+0000","last_change":"2024-09-12T01:12:12.458762+0000","last_active":"2024-09-12T01:12:12.458762+0000","last_peered":"2024-09-12T01:12:12.458762+0000","last_clean":"2024-09-12T01:12:12.458762+0000","last_became_active":"2024-09-12T00:46:16.276180+0000","last_became_peered":"2024-09-12T00:46:16.276180+0000","last_unstale":"2024-09-12T01:12:12.458762+0000","last_undegraded":"2024-09-12T01:12:12.458762+0000","last_fullsized":"2024-09-12T01:12:12.458762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T01:12:12.458676+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T01:12:12.458676+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.458676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:51.962632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'35","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.681411+0000","last_change":"2024-09-12T01:12:01.681342+0000","last_active":"2024-09-12T01:12:01.681411+0000","last_peered":"2024-09-12T01:12:01.681411+0000","last_clean":"2024-09-12T01:12:01.681411+0000","last_became_active":"2024-09-12T00:44:37.820217+0000","last_became_peered":"2024-09-12T00:44:37.820217+0000","last_unstale":"2024-09-12T01:12:01.681411+0000","last_undegraded":"2024-09-12T01:12:01.681411+0000","last_fullsized":"2024-09-12T01:12:01.681411+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-12T01:12:01.681254+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-12T01:12:01.681254+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.681254+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:39.318596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":127,"num_write":61,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.367933+0000","last_change":"2024-09-12T01:12:16.367933+0000","last_active":"2024-09-12T01:12:16.367933+0000","last_peered":"2024-09-12T01:12:16.367933+0000","last_clean":"2024-09-12T01:12:16.367933+0000","last_became_active":"2024-09-12T00:56:52.988302+0000","last_became_peered":"2024-09-12T00:56:52.988302+0000","last_unstale":"2024-09-12T01:12:16.367933+0000","last_undegraded":"2024-09-12T01:12:16.367933+0000","last_fullsized":"2024-09-12T01:12:16.367933+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:16.367845+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:16.367845+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.367845+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.884784+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'7","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.773912+0000","last_change":"2024-09-12T01:12:14.773912+0000","last_active":"2024-09-12T01:12:14.773912+0000","last_peered":"2024-09-12T01:12:14.773912+0000","last_clean":"2024-09-12T01:12:14.773912+0000","last_became_active":"2024-09-12T00:46:19.280889+0000","last_became_peered":"2024-09-12T00:46:19.280889+0000","last_unstale":"2024-09-12T01:12:14.773912+0000","last_undegraded":"2024-09-12T01:12:14.773912+0000","last_fullsized":"2024-09-12T01:12:14.773912+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-12T01:12:14.773821+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-12T01:12:14.773821+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.773821+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:49.056474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7182,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.809016+0000","last_change":"2024-09-12T01:12:06.809016+0000","last_active":"2024-09-12T01:12:06.809016+0000","last_peered":"2024-09-12T01:12:06.809016+0000","last_clean":"2024-09-12T01:12:06.809016+0000","last_became_active":"2024-09-12T00:46:16.263065+0000","last_became_peered":"2024-09-12T00:46:16.263065+0000","last_unstale":"2024-09-12T01:12:06.809016+0000","last_undegraded":"2024-09-12T01:12:06.809016+0000","last_fullsized":"2024-09-12T01:12:06.809016+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:12:06.808921+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:12:06.808921+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.808921+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:45.527274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.391828+0000","last_change":"2024-09-12T01:12:00.391774+0000","last_active":"2024-09-12T01:12:00.391828+0000","last_peered":"2024-09-12T01:12:00.391828+0000","last_clean":"2024-09-12T01:12:00.391828+0000","last_became_active":"2024-09-12T00:44:37.814584+0000","last_became_peered":"2024-09-12T00:44:37.814584+0000","last_unstale":"2024-09-12T01:12:00.391828+0000","last_undegraded":"2024-09-12T01:12:00.391828+0000","last_fullsized":"2024-09-12T01:12:00.391828+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-12T01:12:00.391675+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-12T01:12:00.391675+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.391675+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:27.708969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.197338+0000","last_change":"2024-09-12T01:12:12.197338+0000","last_active":"2024-09-12T01:12:12.197338+0000","last_peered":"2024-09-12T01:12:12.197338+0000","last_clean":"2024-09-12T01:12:12.197338+0000","last_became_active":"2024-09-12T00:56:52.990830+0000","last_became_peered":"2024-09-12T00:56:52.990830+0000","last_unstale":"2024-09-12T01:12:12.197338+0000","last_undegraded":"2024-09-12T01:12:12.197338+0000","last_fullsized":"2024-09-12T01:12:12.197338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:12.197242+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:12.197242+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.197242+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:44.781930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'11","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:32.006651+0000","last_change":"2024-09-12T01:12:32.006651+0000","last_active":"2024-09-12T01:12:32.006651+0000","last_peered":"2024-09-12T01:12:32.006651+0000","last_clean":"2024-09-12T01:12:32.006651+0000","last_became_active":"2024-09-12T00:46:19.284748+0000","last_became_peered":"2024-09-12T00:46:19.284748+0000","last_unstale":"2024-09-12T01:12:32.006651+0000","last_undegraded":"2024-09-12T01:12:32.006651+0000","last_fullsized":"2024-09-12T01:12:32.006651+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-12T01:12:32.006563+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-12T01:12:32.006563+0000","last_clean_scrub_stamp":"2024-09-12T01:12:32.006563+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:44.760837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8194,"num_write":16,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"261'5","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.771536+0000","last_change":"2024-09-12T01:12:02.771536+0000","last_active":"2024-09-12T01:12:02.771536+0000","last_peered":"2024-09-12T01:12:02.771536+0000","last_clean":"2024-09-12T01:12:02.771536+0000","last_became_active":"2024-09-12T00:46:16.274209+0000","last_became_peered":"2024-09-12T00:46:16.274209+0000","last_unstale":"2024-09-12T01:12:02.771536+0000","last_undegraded":"2024-09-12T01:12:02.771536+0000","last_fullsized":"2024-09-12T01:12:02.771536+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T01:12:02.771444+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T01:12:02.771444+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.771444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:59.663528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":10,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'40","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.640712+0000","last_change":"2024-09-12T01:12:00.640620+0000","last_active":"2024-09-12T01:12:00.640712+0000","last_peered":"2024-09-12T01:12:00.640712+0000","last_clean":"2024-09-12T01:12:00.640712+0000","last_became_active":"2024-09-12T00:44:37.819298+0000","last_became_peered":"2024-09-12T00:44:37.819298+0000","last_unstale":"2024-09-12T01:12:00.640712+0000","last_undegraded":"2024-09-12T01:12:00.640712+0000","last_fullsized":"2024-09-12T01:12:00.640712+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-12T01:12:00.640490+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-12T01:12:00.640490+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.640490+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:43.774391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":142,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:26.398395+0000","last_change":"2024-09-12T01:12:26.398395+0000","last_active":"2024-09-12T01:12:26.398395+0000","last_peered":"2024-09-12T01:12:26.398395+0000","last_clean":"2024-09-12T01:12:26.398395+0000","last_became_active":"2024-09-12T00:56:52.996048+0000","last_became_peered":"2024-09-12T00:56:52.996048+0000","last_unstale":"2024-09-12T01:12:26.398395+0000","last_undegraded":"2024-09-12T01:12:26.398395+0000","last_fullsized":"2024-09-12T01:12:26.398395+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:26.398274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:26.398274+0000","last_clean_scrub_stamp":"2024-09-12T01:12:26.398274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:48.326529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.713784+0000","last_change":"2024-09-12T01:12:12.713784+0000","last_active":"2024-09-12T01:12:12.713784+0000","last_peered":"2024-09-12T01:12:12.713784+0000","last_clean":"2024-09-12T01:12:12.713784+0000","last_became_active":"2024-09-12T00:46:19.285304+0000","last_became_peered":"2024-09-12T00:46:19.285304+0000","last_unstale":"2024-09-12T01:12:12.713784+0000","last_undegraded":"2024-09-12T01:12:12.713784+0000","last_fullsized":"2024-09-12T01:12:12.713784+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:12.713692+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:12.713692+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.713692+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:08.672773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2428,"num_write":4,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.352766+0000","last_change":"2024-09-12T01:12:06.352766+0000","last_active":"2024-09-12T01:12:06.352766+0000","last_peered":"2024-09-12T01:12:06.352766+0000","last_clean":"2024-09-12T01:12:06.352766+0000","last_became_active":"2024-09-12T00:46:16.271839+0000","last_became_peered":"2024-09-12T00:46:16.271839+0000","last_unstale":"2024-09-12T01:12:06.352766+0000","last_undegraded":"2024-09-12T01:12:06.352766+0000","last_fullsized":"2024-09-12T01:12:06.352766+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:06.352670+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:06.352670+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.352670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:22.443702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"264'41","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.688231+0000","last_change":"2024-09-12T01:11:59.688231+0000","last_active":"2024-09-12T01:11:59.688231+0000","last_peered":"2024-09-12T01:11:59.688231+0000","last_clean":"2024-09-12T01:11:59.688231+0000","last_became_active":"2024-09-12T00:44:37.821837+0000","last_became_peered":"2024-09-12T00:44:37.821837+0000","last_unstale":"2024-09-12T01:11:59.688231+0000","last_undegraded":"2024-09-12T01:11:59.688231+0000","last_fullsized":"2024-09-12T01:11:59.688231+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T01:11:59.688148+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T01:11:59.688148+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.688148+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:43.832110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":140,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.754427+0000","last_change":"2024-09-12T01:12:08.754361+0000","last_active":"2024-09-12T01:12:08.754427+0000","last_peered":"2024-09-12T01:12:08.754427+0000","last_clean":"2024-09-12T01:12:08.754427+0000","last_became_active":"2024-09-12T00:56:52.996287+0000","last_became_peered":"2024-09-12T00:56:52.996287+0000","last_unstale":"2024-09-12T01:12:08.754427+0000","last_undegraded":"2024-09-12T01:12:08.754427+0000","last_fullsized":"2024-09-12T01:12:08.754427+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:08.754270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:08.754270+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.754270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:09.635270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.701762+0000","last_change":"2024-09-12T01:12:10.701762+0000","last_active":"2024-09-12T01:12:10.701762+0000","last_peered":"2024-09-12T01:12:10.701762+0000","last_clean":"2024-09-12T01:12:10.701762+0000","last_became_active":"2024-09-12T00:46:19.284490+0000","last_became_peered":"2024-09-12T00:46:19.284490+0000","last_unstale":"2024-09-12T01:12:10.701762+0000","last_undegraded":"2024-09-12T01:12:10.701762+0000","last_fullsized":"2024-09-12T01:12:10.701762+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:12:10.701676+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:12:10.701676+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.701676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:21.297284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"264'10","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.247141+0000","last_change":"2024-09-12T01:12:08.247141+0000","last_active":"2024-09-12T01:12:08.247141+0000","last_peered":"2024-09-12T01:12:08.247141+0000","last_clean":"2024-09-12T01:12:08.247141+0000","last_became_active":"2024-09-12T00:46:16.275312+0000","last_became_peered":"2024-09-12T00:46:16.275312+0000","last_unstale":"2024-09-12T01:12:08.247141+0000","last_undegraded":"2024-09-12T01:12:08.247141+0000","last_fullsized":"2024-09-12T01:12:08.247141+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-12T01:12:08.247043+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-12T01:12:08.247043+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.247043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:20.366332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20478,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'42","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:24.983557+0000","last_change":"2024-09-12T01:12:24.983557+0000","last_active":"2024-09-12T01:12:24.983557+0000","last_peered":"2024-09-12T01:12:24.983557+0000","last_clean":"2024-09-12T01:12:24.983557+0000","last_became_active":"2024-09-12T00:44:37.819289+0000","last_became_peered":"2024-09-12T00:44:37.819289+0000","last_unstale":"2024-09-12T01:12:24.983557+0000","last_undegraded":"2024-09-12T01:12:24.983557+0000","last_fullsized":"2024-09-12T01:12:24.983557+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-12T01:12:24.983431+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-12T01:12:24.983431+0000","last_clean_scrub_stamp":"2024-09-12T01:12:24.983431+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:19.655251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":167,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:38.078274+0000","last_change":"2024-09-12T01:12:38.078274+0000","last_active":"2024-09-12T01:12:38.078274+0000","last_peered":"2024-09-12T01:12:38.078274+0000","last_clean":"2024-09-12T01:12:38.078274+0000","last_became_active":"2024-09-12T00:56:52.987226+0000","last_became_peered":"2024-09-12T00:56:52.987226+0000","last_unstale":"2024-09-12T01:12:38.078274+0000","last_undegraded":"2024-09-12T01:12:38.078274+0000","last_fullsized":"2024-09-12T01:12:38.078274+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:38.078151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:38.078151+0000","last_clean_scrub_stamp":"2024-09-12T01:12:38.078151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:46.835780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.752229+0000","last_change":"2024-09-12T01:12:13.752229+0000","last_active":"2024-09-12T01:12:13.752229+0000","last_peered":"2024-09-12T01:12:13.752229+0000","last_clean":"2024-09-12T01:12:13.752229+0000","last_became_active":"2024-09-12T00:46:19.287067+0000","last_became_peered":"2024-09-12T00:46:19.287067+0000","last_unstale":"2024-09-12T01:12:13.752229+0000","last_undegraded":"2024-09-12T01:12:13.752229+0000","last_fullsized":"2024-09-12T01:12:13.752229+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:13.752138+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:13.752138+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.752138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:01.345829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2174,"num_write":4,"num_write_kb":1603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.693299+0000","last_change":"2024-09-12T01:12:07.693299+0000","last_active":"2024-09-12T01:12:07.693299+0000","last_peered":"2024-09-12T01:12:07.693299+0000","last_clean":"2024-09-12T01:12:07.693299+0000","last_became_active":"2024-09-12T00:46:16.278205+0000","last_became_peered":"2024-09-12T00:46:16.278205+0000","last_unstale":"2024-09-12T01:12:07.693299+0000","last_undegraded":"2024-09-12T01:12:07.693299+0000","last_fullsized":"2024-09-12T01:12:07.693299+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:07.693189+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:07.693189+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.693189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:12.595955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'62","reported_seq":220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.759000+0000","last_change":"2024-09-12T01:12:04.759000+0000","last_active":"2024-09-12T01:12:04.759000+0000","last_peered":"2024-09-12T01:12:04.759000+0000","last_clean":"2024-09-12T01:12:04.759000+0000","last_became_active":"2024-09-12T00:44:37.811544+0000","last_became_peered":"2024-09-12T00:44:37.811544+0000","last_unstale":"2024-09-12T01:12:04.759000+0000","last_undegraded":"2024-09-12T01:12:04.759000+0000","last_fullsized":"2024-09-12T01:12:04.759000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'62","last_scrub_stamp":"2024-09-12T01:12:04.758917+0000","last_deep_scrub":"264'62","last_deep_scrub_stamp":"2024-09-12T01:12:04.758917+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.758917+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:10.647898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":232,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.780609+0000","last_change":"2024-09-12T01:12:07.780609+0000","last_active":"2024-09-12T01:12:07.780609+0000","last_peered":"2024-09-12T01:12:07.780609+0000","last_clean":"2024-09-12T01:12:07.780609+0000","last_became_active":"2024-09-12T00:56:52.988985+0000","last_became_peered":"2024-09-12T00:56:52.988985+0000","last_unstale":"2024-09-12T01:12:07.780609+0000","last_undegraded":"2024-09-12T01:12:07.780609+0000","last_fullsized":"2024-09-12T01:12:07.780609+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:07.780496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:07.780496+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.780496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:42.826635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"261'10","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:17.294016+0000","last_change":"2024-09-12T01:12:17.294016+0000","last_active":"2024-09-12T01:12:17.294016+0000","last_peered":"2024-09-12T01:12:17.294016+0000","last_clean":"2024-09-12T01:12:17.294016+0000","last_became_active":"2024-09-12T00:46:19.279527+0000","last_became_peered":"2024-09-12T00:46:19.279527+0000","last_unstale":"2024-09-12T01:12:17.294016+0000","last_undegraded":"2024-09-12T01:12:17.294016+0000","last_fullsized":"2024-09-12T01:12:17.294016+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T01:12:17.293917+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T01:12:17.293917+0000","last_clean_scrub_stamp":"2024-09-12T01:12:17.293917+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:48.254374+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8190,"num_write":20,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.726093+0000","last_change":"2024-09-12T01:12:06.726093+0000","last_active":"2024-09-12T01:12:06.726093+0000","last_peered":"2024-09-12T01:12:06.726093+0000","last_clean":"2024-09-12T01:12:06.726093+0000","last_became_active":"2024-09-12T00:46:16.273598+0000","last_became_peered":"2024-09-12T00:46:16.273598+0000","last_unstale":"2024-09-12T01:12:06.726093+0000","last_undegraded":"2024-09-12T01:12:06.726093+0000","last_fullsized":"2024-09-12T01:12:06.726093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:06.726000+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:06.726000+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.726000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:37.079282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'41","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.182830+0000","last_change":"2024-09-12T01:12:02.182830+0000","last_active":"2024-09-12T01:12:02.182830+0000","last_peered":"2024-09-12T01:12:02.182830+0000","last_clean":"2024-09-12T01:12:02.182830+0000","last_became_active":"2024-09-12T00:44:37.813081+0000","last_became_peered":"2024-09-12T00:44:37.813081+0000","last_unstale":"2024-09-12T01:12:02.182830+0000","last_undegraded":"2024-09-12T01:12:02.182830+0000","last_fullsized":"2024-09-12T01:12:02.182830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T01:12:02.182750+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T01:12:02.182750+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.182750+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:31.355347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":146,"num_write":78,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:27.403844+0000","last_change":"2024-09-12T01:12:27.403772+0000","last_active":"2024-09-12T01:12:27.403844+0000","last_peered":"2024-09-12T01:12:27.403844+0000","last_clean":"2024-09-12T01:12:27.403844+0000","last_became_active":"2024-09-12T00:56:52.995412+0000","last_became_peered":"2024-09-12T00:56:52.995412+0000","last_unstale":"2024-09-12T01:12:27.403844+0000","last_undegraded":"2024-09-12T01:12:27.403844+0000","last_fullsized":"2024-09-12T01:12:27.403844+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:27.403684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:27.403684+0000","last_clean_scrub_stamp":"2024-09-12T01:12:27.403684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:21.108089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:35.026893+0000","last_change":"2024-09-12T01:12:35.026893+0000","last_active":"2024-09-12T01:12:35.026893+0000","last_peered":"2024-09-12T01:12:35.026893+0000","last_clean":"2024-09-12T01:12:35.026893+0000","last_became_active":"2024-09-12T00:46:19.282672+0000","last_became_peered":"2024-09-12T00:46:19.282672+0000","last_unstale":"2024-09-12T01:12:35.026893+0000","last_undegraded":"2024-09-12T01:12:35.026893+0000","last_fullsized":"2024-09-12T01:12:35.026893+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:35.026794+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:35.026794+0000","last_clean_scrub_stamp":"2024-09-12T01:12:35.026794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:57.000136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'9","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.689295+0000","last_change":"2024-09-12T01:12:04.689190+0000","last_active":"2024-09-12T01:12:04.689295+0000","last_peered":"2024-09-12T01:12:04.689295+0000","last_clean":"2024-09-12T01:12:04.689295+0000","last_became_active":"2024-09-12T00:46:16.265927+0000","last_became_peered":"2024-09-12T00:46:16.265927+0000","last_unstale":"2024-09-12T01:12:04.689295+0000","last_undegraded":"2024-09-12T01:12:04.689295+0000","last_fullsized":"2024-09-12T01:12:04.689295+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-12T01:12:04.689067+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-12T01:12:04.689067+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.689067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:48.646995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11266,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'26","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.177653+0000","last_change":"2024-09-12T01:12:01.177653+0000","last_active":"2024-09-12T01:12:01.177653+0000","last_peered":"2024-09-12T01:12:01.177653+0000","last_clean":"2024-09-12T01:12:01.177653+0000","last_became_active":"2024-09-12T00:44:37.820584+0000","last_became_peered":"2024-09-12T00:44:37.820584+0000","last_unstale":"2024-09-12T01:12:01.177653+0000","last_undegraded":"2024-09-12T01:12:01.177653+0000","last_fullsized":"2024-09-12T01:12:01.177653+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T01:12:01.177520+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T01:12:01.177520+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.177520+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:02.561584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":54,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.284138+0000","last_change":"2024-09-12T01:12:12.284068+0000","last_active":"2024-09-12T01:12:12.284138+0000","last_peered":"2024-09-12T01:12:12.284138+0000","last_clean":"2024-09-12T01:12:12.284138+0000","last_became_active":"2024-09-12T00:56:52.994132+0000","last_became_peered":"2024-09-12T00:56:52.994132+0000","last_unstale":"2024-09-12T01:12:12.284138+0000","last_undegraded":"2024-09-12T01:12:12.284138+0000","last_fullsized":"2024-09-12T01:12:12.284138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:12.283973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:12.283973+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.283973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:39.540264+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.301579+0000","last_change":"2024-09-12T01:12:09.301520+0000","last_active":"2024-09-12T01:12:09.301579+0000","last_peered":"2024-09-12T01:12:09.301579+0000","last_clean":"2024-09-12T01:12:09.301579+0000","last_became_active":"2024-09-12T00:46:19.280726+0000","last_became_peered":"2024-09-12T00:46:19.280726+0000","last_unstale":"2024-09-12T01:12:09.301579+0000","last_undegraded":"2024-09-12T01:12:09.301579+0000","last_fullsized":"2024-09-12T01:12:09.301579+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:12:09.301424+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:12:09.301424+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.301424+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:12.439753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5128,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:11.466403+0000","last_change":"2024-09-12T01:12:11.466343+0000","last_active":"2024-09-12T01:12:11.466403+0000","last_peered":"2024-09-12T01:12:11.466403+0000","last_clean":"2024-09-12T01:12:11.466403+0000","last_became_active":"2024-09-12T00:46:16.275908+0000","last_became_peered":"2024-09-12T00:46:16.275908+0000","last_unstale":"2024-09-12T01:12:11.466403+0000","last_undegraded":"2024-09-12T01:12:11.466403+0000","last_fullsized":"2024-09-12T01:12:11.466403+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:11.466257+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:11.466257+0000","last_clean_scrub_stamp":"2024-09-12T01:12:11.466257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:36.822751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'33","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.352700+0000","last_change":"2024-09-12T01:12:03.352700+0000","last_active":"2024-09-12T01:12:03.352700+0000","last_peered":"2024-09-12T01:12:03.352700+0000","last_clean":"2024-09-12T01:12:03.352700+0000","last_became_active":"2024-09-12T00:44:37.811613+0000","last_became_peered":"2024-09-12T00:44:37.811613+0000","last_unstale":"2024-09-12T01:12:03.352700+0000","last_undegraded":"2024-09-12T01:12:03.352700+0000","last_fullsized":"2024-09-12T01:12:03.352700+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T01:12:03.352619+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T01:12:03.352619+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.352619+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:42.794372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":70,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.142258+0000","last_change":"2024-09-12T01:12:08.142201+0000","last_active":"2024-09-12T01:12:08.142258+0000","last_peered":"2024-09-12T01:12:08.142258+0000","last_clean":"2024-09-12T01:12:08.142258+0000","last_became_active":"2024-09-12T00:56:52.989552+0000","last_became_peered":"2024-09-12T00:56:52.989552+0000","last_unstale":"2024-09-12T01:12:08.142258+0000","last_undegraded":"2024-09-12T01:12:08.142258+0000","last_fullsized":"2024-09-12T01:12:08.142258+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:08.142119+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:08.142119+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.142119+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:11.740822+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'4","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.217411+0000","last_change":"2024-09-12T01:12:10.217411+0000","last_active":"2024-09-12T01:12:10.217411+0000","last_peered":"2024-09-12T01:12:10.217411+0000","last_clean":"2024-09-12T01:12:10.217411+0000","last_became_active":"2024-09-12T00:46:19.282137+0000","last_became_peered":"2024-09-12T00:46:19.282137+0000","last_unstale":"2024-09-12T01:12:10.217411+0000","last_undegraded":"2024-09-12T01:12:10.217411+0000","last_fullsized":"2024-09-12T01:12:10.217411+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T01:12:10.217309+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T01:12:10.217309+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.217309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:16.838211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.682734+0000","last_change":"2024-09-12T01:12:05.682676+0000","last_active":"2024-09-12T01:12:05.682734+0000","last_peered":"2024-09-12T01:12:05.682734+0000","last_clean":"2024-09-12T01:12:05.682734+0000","last_became_active":"2024-09-12T00:46:16.274198+0000","last_became_peered":"2024-09-12T00:46:16.274198+0000","last_unstale":"2024-09-12T01:12:05.682734+0000","last_undegraded":"2024-09-12T01:12:05.682734+0000","last_fullsized":"2024-09-12T01:12:05.682734+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:12:05.682595+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:12:05.682595+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.682595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:53.155169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2619,"num_write":4,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'26","reported_seq":121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.495093+0000","last_change":"2024-09-12T01:12:10.495032+0000","last_active":"2024-09-12T01:12:10.495093+0000","last_peered":"2024-09-12T01:12:10.495093+0000","last_clean":"2024-09-12T01:12:10.495093+0000","last_became_active":"2024-09-12T00:44:37.814480+0000","last_became_peered":"2024-09-12T00:44:37.814480+0000","last_unstale":"2024-09-12T01:12:10.495093+0000","last_undegraded":"2024-09-12T01:12:10.495093+0000","last_fullsized":"2024-09-12T01:12:10.495093+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-12T01:12:10.494941+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-12T01:12:10.494941+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.494941+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:10.347907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":86,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:19.876931+0000","last_change":"2024-09-12T01:12:19.876866+0000","last_active":"2024-09-12T01:12:19.876931+0000","last_peered":"2024-09-12T01:12:19.876931+0000","last_clean":"2024-09-12T01:12:19.876931+0000","last_became_active":"2024-09-12T00:56:52.996816+0000","last_became_peered":"2024-09-12T00:56:52.996816+0000","last_unstale":"2024-09-12T01:12:19.876931+0000","last_undegraded":"2024-09-12T01:12:19.876931+0000","last_fullsized":"2024-09-12T01:12:19.876931+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:19.876778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:19.876778+0000","last_clean_scrub_stamp":"2024-09-12T01:12:19.876778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:20.313848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.203475+0000","last_change":"2024-09-12T01:12:03.203382+0000","last_active":"2024-09-12T01:12:03.203475+0000","last_peered":"2024-09-12T01:12:03.203475+0000","last_clean":"2024-09-12T01:12:03.203475+0000","last_became_active":"2024-09-12T00:46:19.276366+0000","last_became_peered":"2024-09-12T00:46:19.276366+0000","last_unstale":"2024-09-12T01:12:03.203475+0000","last_undegraded":"2024-09-12T01:12:03.203475+0000","last_fullsized":"2024-09-12T01:12:03.203475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:12:03.203275+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:12:03.203275+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.203275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:54.836932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:28.068278+0000","last_change":"2024-09-12T01:12:28.068278+0000","last_active":"2024-09-12T01:12:28.068278+0000","last_peered":"2024-09-12T01:12:28.068278+0000","last_clean":"2024-09-12T01:12:28.068278+0000","last_became_active":"2024-09-12T00:46:16.273821+0000","last_became_peered":"2024-09-12T00:46:16.273821+0000","last_unstale":"2024-09-12T01:12:28.068278+0000","last_undegraded":"2024-09-12T01:12:28.068278+0000","last_fullsized":"2024-09-12T01:12:28.068278+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T01:12:28.068175+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T01:12:28.068175+0000","last_clean_scrub_stamp":"2024-09-12T01:12:28.068175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:39.373982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'33","reported_seq":139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.248094+0000","last_change":"2024-09-12T01:11:57.247998+0000","last_active":"2024-09-12T01:11:57.248094+0000","last_peered":"2024-09-12T01:11:57.248094+0000","last_clean":"2024-09-12T01:11:57.248094+0000","last_became_active":"2024-09-12T00:44:37.817357+0000","last_became_peered":"2024-09-12T00:44:37.817357+0000","last_unstale":"2024-09-12T01:11:57.248094+0000","last_undegraded":"2024-09-12T01:11:57.248094+0000","last_fullsized":"2024-09-12T01:11:57.248094+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T01:11:57.247891+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T01:11:57.247891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.247891+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:57.564026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":112,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.235206+0000","last_change":"2024-09-12T01:12:04.235206+0000","last_active":"2024-09-12T01:12:04.235206+0000","last_peered":"2024-09-12T01:12:04.235206+0000","last_clean":"2024-09-12T01:12:04.235206+0000","last_became_active":"2024-09-12T00:56:52.990450+0000","last_became_peered":"2024-09-12T00:56:52.990450+0000","last_unstale":"2024-09-12T01:12:04.235206+0000","last_undegraded":"2024-09-12T01:12:04.235206+0000","last_fullsized":"2024-09-12T01:12:04.235206+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:04.235092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:04.235092+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.235092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:29.130516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:19.283705+0000","last_change":"2024-09-12T01:12:19.283705+0000","last_active":"2024-09-12T01:12:19.283705+0000","last_peered":"2024-09-12T01:12:19.283705+0000","last_clean":"2024-09-12T01:12:19.283705+0000","last_became_active":"2024-09-12T00:46:19.281413+0000","last_became_peered":"2024-09-12T00:46:19.281413+0000","last_unstale":"2024-09-12T01:12:19.283705+0000","last_undegraded":"2024-09-12T01:12:19.283705+0000","last_fullsized":"2024-09-12T01:12:19.283705+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:12:19.283607+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:12:19.283607+0000","last_clean_scrub_stamp":"2024-09-12T01:12:19.283607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:27.211363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16941,"num_write":8,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"264'8","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:25.998362+0000","last_change":"2024-09-12T01:12:25.998362+0000","last_active":"2024-09-12T01:12:25.998362+0000","last_peered":"2024-09-12T01:12:25.998362+0000","last_clean":"2024-09-12T01:12:25.998362+0000","last_became_active":"2024-09-12T00:46:16.271730+0000","last_became_peered":"2024-09-12T00:46:16.271730+0000","last_unstale":"2024-09-12T01:12:25.998362+0000","last_undegraded":"2024-09-12T01:12:25.998362+0000","last_fullsized":"2024-09-12T01:12:25.998362+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T01:12:25.998257+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T01:12:25.998257+0000","last_clean_scrub_stamp":"2024-09-12T01:12:25.998257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:30.603361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11841,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'15","reported_seq":93,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.372389+0000","last_change":"2024-09-12T01:12:08.372324+0000","last_active":"2024-09-12T01:12:08.372389+0000","last_peered":"2024-09-12T01:12:08.372389+0000","last_clean":"2024-09-12T01:12:08.372389+0000","last_became_active":"2024-09-12T00:44:37.815542+0000","last_became_peered":"2024-09-12T00:44:37.815542+0000","last_unstale":"2024-09-12T01:12:08.372389+0000","last_undegraded":"2024-09-12T01:12:08.372389+0000","last_fullsized":"2024-09-12T01:12:08.372389+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'15","last_scrub_stamp":"2024-09-12T01:12:08.372224+0000","last_deep_scrub":"261'15","last_deep_scrub_stamp":"2024-09-12T01:12:08.372224+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.372224+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:25.772193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":55,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.198009+0000","last_change":"2024-09-12T01:12:05.198009+0000","last_active":"2024-09-12T01:12:05.198009+0000","last_peered":"2024-09-12T01:12:05.198009+0000","last_clean":"2024-09-12T01:12:05.198009+0000","last_became_active":"2024-09-12T00:56:52.988702+0000","last_became_peered":"2024-09-12T00:56:52.988702+0000","last_unstale":"2024-09-12T01:12:05.198009+0000","last_undegraded":"2024-09-12T01:12:05.198009+0000","last_fullsized":"2024-09-12T01:12:05.198009+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:05.197913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:05.197913+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.197913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:01.406564+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.348618+0000","last_change":"2024-09-12T01:12:15.348618+0000","last_active":"2024-09-12T01:12:15.348618+0000","last_peered":"2024-09-12T01:12:15.348618+0000","last_clean":"2024-09-12T01:12:15.348618+0000","last_became_active":"2024-09-12T00:46:19.276538+0000","last_became_peered":"2024-09-12T00:46:19.276538+0000","last_unstale":"2024-09-12T01:12:15.348618+0000","last_undegraded":"2024-09-12T01:12:15.348618+0000","last_fullsized":"2024-09-12T01:12:15.348618+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:15.348516+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:15.348516+0000","last_clean_scrub_stamp":"2024-09-12T01:12:15.348516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:16.870479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.312512+0000","last_change":"2024-09-12T01:12:14.312512+0000","last_active":"2024-09-12T01:12:14.312512+0000","last_peered":"2024-09-12T01:12:14.312512+0000","last_clean":"2024-09-12T01:12:14.312512+0000","last_became_active":"2024-09-12T00:46:16.272892+0000","last_became_peered":"2024-09-12T00:46:16.272892+0000","last_unstale":"2024-09-12T01:12:14.312512+0000","last_undegraded":"2024-09-12T01:12:14.312512+0000","last_fullsized":"2024-09-12T01:12:14.312512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:14.312423+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:14.312423+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.312423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:14.807326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"264'6","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:20.976764+0000","last_change":"2024-09-12T01:12:20.976680+0000","last_active":"2024-09-12T01:12:20.976764+0000","last_peered":"2024-09-12T01:12:20.976764+0000","last_clean":"2024-09-12T01:12:20.976764+0000","last_became_active":"2024-09-12T00:44:37.819232+0000","last_became_peered":"2024-09-12T00:44:37.819232+0000","last_unstale":"2024-09-12T01:12:20.976764+0000","last_undegraded":"2024-09-12T01:12:20.976764+0000","last_fullsized":"2024-09-12T01:12:20.976764+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:12:20.976584+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:12:20.976584+0000","last_clean_scrub_stamp":"2024-09-12T01:12:20.976584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:31.363156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:24.347307+0000","last_change":"2024-09-12T01:12:24.347307+0000","last_active":"2024-09-12T01:12:24.347307+0000","last_peered":"2024-09-12T01:12:24.347307+0000","last_clean":"2024-09-12T01:12:24.347307+0000","last_became_active":"2024-09-12T00:56:52.994128+0000","last_became_peered":"2024-09-12T00:56:52.994128+0000","last_unstale":"2024-09-12T01:12:24.347307+0000","last_undegraded":"2024-09-12T01:12:24.347307+0000","last_fullsized":"2024-09-12T01:12:24.347307+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:24.347223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:24.347223+0000","last_clean_scrub_stamp":"2024-09-12T01:12:24.347223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:37.893640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.215323+0000","last_change":"2024-09-12T01:12:00.215225+0000","last_active":"2024-09-12T01:12:00.215323+0000","last_peered":"2024-09-12T01:12:00.215323+0000","last_clean":"2024-09-12T01:12:00.215323+0000","last_became_active":"2024-09-12T00:46:19.281782+0000","last_became_peered":"2024-09-12T00:46:19.281782+0000","last_unstale":"2024-09-12T01:12:00.215323+0000","last_undegraded":"2024-09-12T01:12:00.215323+0000","last_fullsized":"2024-09-12T01:12:00.215323+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:00.215119+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:00.215119+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.215119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:03.911763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.303732+0000","last_change":"2024-09-12T01:12:04.303643+0000","last_active":"2024-09-12T01:12:04.303732+0000","last_peered":"2024-09-12T01:12:04.303732+0000","last_clean":"2024-09-12T01:12:04.303732+0000","last_became_active":"2024-09-12T00:46:16.273356+0000","last_became_peered":"2024-09-12T00:46:16.273356+0000","last_unstale":"2024-09-12T01:12:04.303732+0000","last_undegraded":"2024-09-12T01:12:04.303732+0000","last_fullsized":"2024-09-12T01:12:04.303732+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:04.303551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:04.303551+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.303551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:42.894837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'16","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.405292+0000","last_change":"2024-09-12T01:11:59.405292+0000","last_active":"2024-09-12T01:11:59.405292+0000","last_peered":"2024-09-12T01:11:59.405292+0000","last_clean":"2024-09-12T01:11:59.405292+0000","last_became_active":"2024-09-12T00:44:37.818054+0000","last_became_peered":"2024-09-12T00:44:37.818054+0000","last_unstale":"2024-09-12T01:11:59.405292+0000","last_undegraded":"2024-09-12T01:11:59.405292+0000","last_fullsized":"2024-09-12T01:11:59.405292+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T01:11:59.405209+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T01:11:59.405209+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.405209+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:00.070533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:36.067858+0000","last_change":"2024-09-12T01:12:36.067858+0000","last_active":"2024-09-12T01:12:36.067858+0000","last_peered":"2024-09-12T01:12:36.067858+0000","last_clean":"2024-09-12T01:12:36.067858+0000","last_became_active":"2024-09-12T00:56:52.990601+0000","last_became_peered":"2024-09-12T00:56:52.990601+0000","last_unstale":"2024-09-12T01:12:36.067858+0000","last_undegraded":"2024-09-12T01:12:36.067858+0000","last_fullsized":"2024-09-12T01:12:36.067858+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:36.067757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:36.067757+0000","last_clean_scrub_stamp":"2024-09-12T01:12:36.067757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:20.720476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:33.984828+0000","last_change":"2024-09-12T01:12:33.984828+0000","last_active":"2024-09-12T01:12:33.984828+0000","last_peered":"2024-09-12T01:12:33.984828+0000","last_clean":"2024-09-12T01:12:33.984828+0000","last_became_active":"2024-09-12T00:46:19.281732+0000","last_became_peered":"2024-09-12T00:46:19.281732+0000","last_unstale":"2024-09-12T01:12:33.984828+0000","last_undegraded":"2024-09-12T01:12:33.984828+0000","last_fullsized":"2024-09-12T01:12:33.984828+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:33.984741+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:33.984741+0000","last_clean_scrub_stamp":"2024-09-12T01:12:33.984741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:22.887123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'5","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:27.042767+0000","last_change":"2024-09-12T01:12:27.042767+0000","last_active":"2024-09-12T01:12:27.042767+0000","last_peered":"2024-09-12T01:12:27.042767+0000","last_clean":"2024-09-12T01:12:27.042767+0000","last_became_active":"2024-09-12T00:46:16.277261+0000","last_became_peered":"2024-09-12T00:46:16.277261+0000","last_unstale":"2024-09-12T01:12:27.042767+0000","last_undegraded":"2024-09-12T01:12:27.042767+0000","last_fullsized":"2024-09-12T01:12:27.042767+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T01:12:27.042663+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T01:12:27.042663+0000","last_clean_scrub_stamp":"2024-09-12T01:12:27.042663+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:09.549875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'33","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.699881+0000","last_change":"2024-09-12T01:11:58.699881+0000","last_active":"2024-09-12T01:11:58.699881+0000","last_peered":"2024-09-12T01:11:58.699881+0000","last_clean":"2024-09-12T01:11:58.699881+0000","last_became_active":"2024-09-12T00:44:37.818055+0000","last_became_peered":"2024-09-12T00:44:37.818055+0000","last_unstale":"2024-09-12T01:11:58.699881+0000","last_undegraded":"2024-09-12T01:11:58.699881+0000","last_fullsized":"2024-09-12T01:11:58.699881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-12T01:11:58.699796+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-12T01:11:58.699796+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.699796+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:03.097781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":106,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.852528+0000","last_change":"2024-09-12T01:12:18.852528+0000","last_active":"2024-09-12T01:12:18.852528+0000","last_peered":"2024-09-12T01:12:18.852528+0000","last_clean":"2024-09-12T01:12:18.852528+0000","last_became_active":"2024-09-12T00:56:52.989396+0000","last_became_peered":"2024-09-12T00:56:52.989396+0000","last_unstale":"2024-09-12T01:12:18.852528+0000","last_undegraded":"2024-09-12T01:12:18.852528+0000","last_fullsized":"2024-09-12T01:12:18.852528+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:18.852438+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:18.852438+0000","last_clean_scrub_stamp":"2024-09-12T01:12:18.852438+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:12.443001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.327894+0000","last_change":"2024-09-12T01:12:13.327894+0000","last_active":"2024-09-12T01:12:13.327894+0000","last_peered":"2024-09-12T01:12:13.327894+0000","last_clean":"2024-09-12T01:12:13.327894+0000","last_became_active":"2024-09-12T00:46:19.281231+0000","last_became_peered":"2024-09-12T00:46:19.281231+0000","last_unstale":"2024-09-12T01:12:13.327894+0000","last_undegraded":"2024-09-12T01:12:13.327894+0000","last_fullsized":"2024-09-12T01:12:13.327894+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:13.327769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:13.327769+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.327769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:11.009295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"264'7","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.387678+0000","last_change":"2024-09-12T01:12:02.387557+0000","last_active":"2024-09-12T01:12:02.387678+0000","last_peered":"2024-09-12T01:12:02.387678+0000","last_clean":"2024-09-12T01:12:02.387678+0000","last_became_active":"2024-09-12T00:46:16.276730+0000","last_became_peered":"2024-09-12T00:46:16.276730+0000","last_unstale":"2024-09-12T01:12:02.387678+0000","last_undegraded":"2024-09-12T01:12:02.387678+0000","last_fullsized":"2024-09-12T01:12:02.387678+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T01:12:02.387460+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T01:12:02.387460+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.387460+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:57.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7172,"num_write":12,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'54","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.427056+0000","last_change":"2024-09-12T01:12:01.427056+0000","last_active":"2024-09-12T01:12:01.427056+0000","last_peered":"2024-09-12T01:12:01.427056+0000","last_clean":"2024-09-12T01:12:01.427056+0000","last_became_active":"2024-09-12T00:44:37.817249+0000","last_became_peered":"2024-09-12T00:44:37.817249+0000","last_unstale":"2024-09-12T01:12:01.427056+0000","last_undegraded":"2024-09-12T01:12:01.427056+0000","last_fullsized":"2024-09-12T01:12:01.427056+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'54","last_scrub_stamp":"2024-09-12T01:12:01.426966+0000","last_deep_scrub":"261'54","last_deep_scrub_stamp":"2024-09-12T01:12:01.426966+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.426966+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:42.391302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":217,"num_write":83,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:15.351393+0000","last_change":"2024-09-12T01:12:15.351393+0000","last_active":"2024-09-12T01:12:15.351393+0000","last_peered":"2024-09-12T01:12:15.351393+0000","last_clean":"2024-09-12T01:12:15.351393+0000","last_became_active":"2024-09-12T00:56:52.992289+0000","last_became_peered":"2024-09-12T00:56:52.992289+0000","last_unstale":"2024-09-12T01:12:15.351393+0000","last_undegraded":"2024-09-12T01:12:15.351393+0000","last_fullsized":"2024-09-12T01:12:15.351393+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:15.351305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:15.351305+0000","last_clean_scrub_stamp":"2024-09-12T01:12:15.351305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:34.031755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:31.007280+0000","last_change":"2024-09-12T01:12:31.007280+0000","last_active":"2024-09-12T01:12:31.007280+0000","last_peered":"2024-09-12T01:12:31.007280+0000","last_clean":"2024-09-12T01:12:31.007280+0000","last_became_active":"2024-09-12T00:46:19.280725+0000","last_became_peered":"2024-09-12T00:46:19.280725+0000","last_unstale":"2024-09-12T01:12:31.007280+0000","last_undegraded":"2024-09-12T01:12:31.007280+0000","last_fullsized":"2024-09-12T01:12:31.007280+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:31.007185+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:31.007185+0000","last_clean_scrub_stamp":"2024-09-12T01:12:31.007185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:24.174075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:23.937023+0000","last_change":"2024-09-12T01:12:23.937023+0000","last_active":"2024-09-12T01:12:23.937023+0000","last_peered":"2024-09-12T01:12:23.937023+0000","last_clean":"2024-09-12T01:12:23.937023+0000","last_became_active":"2024-09-12T00:46:16.272417+0000","last_became_peered":"2024-09-12T00:46:16.272417+0000","last_unstale":"2024-09-12T01:12:23.937023+0000","last_undegraded":"2024-09-12T01:12:23.937023+0000","last_fullsized":"2024-09-12T01:12:23.937023+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-12T01:12:23.936919+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-12T01:12:23.936919+0000","last_clean_scrub_stamp":"2024-09-12T01:12:23.936919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:46.076986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2052,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'44","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:19.954274+0000","last_change":"2024-09-12T01:12:19.954274+0000","last_active":"2024-09-12T01:12:19.954274+0000","last_peered":"2024-09-12T01:12:19.954274+0000","last_clean":"2024-09-12T01:12:19.954274+0000","last_became_active":"2024-09-12T00:44:37.815722+0000","last_became_peered":"2024-09-12T00:44:37.815722+0000","last_unstale":"2024-09-12T01:12:19.954274+0000","last_undegraded":"2024-09-12T01:12:19.954274+0000","last_fullsized":"2024-09-12T01:12:19.954274+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-12T01:12:19.954184+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-12T01:12:19.954184+0000","last_clean_scrub_stamp":"2024-09-12T01:12:19.954184+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:39.041250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":150,"num_write":82,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:25.359823+0000","last_change":"2024-09-12T01:12:25.359823+0000","last_active":"2024-09-12T01:12:25.359823+0000","last_peered":"2024-09-12T01:12:25.359823+0000","last_clean":"2024-09-12T01:12:25.359823+0000","last_became_active":"2024-09-12T00:56:52.989218+0000","last_became_peered":"2024-09-12T00:56:52.989218+0000","last_unstale":"2024-09-12T01:12:25.359823+0000","last_undegraded":"2024-09-12T01:12:25.359823+0000","last_fullsized":"2024-09-12T01:12:25.359823+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:25.359734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:25.359734+0000","last_clean_scrub_stamp":"2024-09-12T01:12:25.359734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:10.873812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.342931+0000","last_change":"2024-09-12T01:12:08.342931+0000","last_active":"2024-09-12T01:12:08.342931+0000","last_peered":"2024-09-12T01:12:08.342931+0000","last_clean":"2024-09-12T01:12:08.342931+0000","last_became_active":"2024-09-12T00:46:19.282270+0000","last_became_peered":"2024-09-12T00:46:19.282270+0000","last_unstale":"2024-09-12T01:12:08.342931+0000","last_undegraded":"2024-09-12T01:12:08.342931+0000","last_fullsized":"2024-09-12T01:12:08.342931+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T01:12:08.342829+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T01:12:08.342829+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.342829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:40.735440+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.276560+0000","last_change":"2024-09-12T01:12:06.276560+0000","last_active":"2024-09-12T01:12:06.276560+0000","last_peered":"2024-09-12T01:12:06.276560+0000","last_clean":"2024-09-12T01:12:06.276560+0000","last_became_active":"2024-09-12T00:46:16.276368+0000","last_became_peered":"2024-09-12T00:46:16.276368+0000","last_unstale":"2024-09-12T01:12:06.276560+0000","last_undegraded":"2024-09-12T01:12:06.276560+0000","last_fullsized":"2024-09-12T01:12:06.276560+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:06.276465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:06.276465+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.276465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:41.953408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'41","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.970599+0000","last_change":"2024-09-12T01:12:18.970599+0000","last_active":"2024-09-12T01:12:18.970599+0000","last_peered":"2024-09-12T01:12:18.970599+0000","last_clean":"2024-09-12T01:12:18.970599+0000","last_became_active":"2024-09-12T00:44:37.821172+0000","last_became_peered":"2024-09-12T00:44:37.821172+0000","last_unstale":"2024-09-12T01:12:18.970599+0000","last_undegraded":"2024-09-12T01:12:18.970599+0000","last_fullsized":"2024-09-12T01:12:18.970599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-12T01:12:18.970505+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-12T01:12:18.970505+0000","last_clean_scrub_stamp":"2024-09-12T01:12:18.970505+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:30.864237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":156,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:37.092567+0000","last_change":"2024-09-12T01:12:37.092567+0000","last_active":"2024-09-12T01:12:37.092567+0000","last_peered":"2024-09-12T01:12:37.092567+0000","last_clean":"2024-09-12T01:12:37.092567+0000","last_became_active":"2024-09-12T00:56:52.993079+0000","last_became_peered":"2024-09-12T00:56:52.993079+0000","last_unstale":"2024-09-12T01:12:37.092567+0000","last_undegraded":"2024-09-12T01:12:37.092567+0000","last_fullsized":"2024-09-12T01:12:37.092567+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:37.092473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:37.092473+0000","last_clean_scrub_stamp":"2024-09-12T01:12:37.092473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:27.749273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.338219+0000","last_change":"2024-09-12T01:12:07.338219+0000","last_active":"2024-09-12T01:12:07.338219+0000","last_peered":"2024-09-12T01:12:07.338219+0000","last_clean":"2024-09-12T01:12:07.338219+0000","last_became_active":"2024-09-12T00:46:19.279630+0000","last_became_peered":"2024-09-12T00:46:19.279630+0000","last_unstale":"2024-09-12T01:12:07.338219+0000","last_undegraded":"2024-09-12T01:12:07.338219+0000","last_fullsized":"2024-09-12T01:12:07.338219+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:07.338132+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:07.338132+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.338132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.231901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.740030+0000","last_change":"2024-09-12T01:12:00.740030+0000","last_active":"2024-09-12T01:12:00.740030+0000","last_peered":"2024-09-12T01:12:00.740030+0000","last_clean":"2024-09-12T01:12:00.740030+0000","last_became_active":"2024-09-12T00:46:16.266854+0000","last_became_peered":"2024-09-12T00:46:16.266854+0000","last_unstale":"2024-09-12T01:12:00.740030+0000","last_undegraded":"2024-09-12T01:12:00.740030+0000","last_fullsized":"2024-09-12T01:12:00.740030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:12:00.739896+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:12:00.739896+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.739896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:37.172009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'16","reported_seq":92,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.436469+0000","last_change":"2024-09-12T01:11:58.436389+0000","last_active":"2024-09-12T01:11:58.436469+0000","last_peered":"2024-09-12T01:11:58.436469+0000","last_clean":"2024-09-12T01:11:58.436469+0000","last_became_active":"2024-09-12T00:44:37.822277+0000","last_became_peered":"2024-09-12T00:44:37.822277+0000","last_unstale":"2024-09-12T01:11:58.436469+0000","last_undegraded":"2024-09-12T01:11:58.436469+0000","last_fullsized":"2024-09-12T01:11:58.436469+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-12T01:11:58.436300+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-12T01:11:58.436300+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.436300+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:53.723745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'407","reported_seq":1187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.407182+0000","last_change":"2024-09-12T01:11:48.407090+0000","last_active":"2024-09-12T01:11:48.407182+0000","last_peered":"2024-09-12T01:11:48.407182+0000","last_clean":"2024-09-12T01:11:48.407182+0000","last_became_active":"2024-09-12T00:30:11.107706+0000","last_became_peered":"2024-09-12T00:30:11.107706+0000","last_unstale":"2024-09-12T01:11:48.407182+0000","last_undegraded":"2024-09-12T01:11:48.407182+0000","last_fullsized":"2024-09-12T01:11:48.407182+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T01:11:48.406922+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T01:11:48.406922+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.406922+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:05.383919+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436870,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":772,"num_read_kb":12989,"num_write":1306,"num_write_kb":41879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'141","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.834252+0000","last_change":"2024-09-12T01:11:47.834184+0000","last_active":"2024-09-12T01:11:47.834252+0000","last_peered":"2024-09-12T01:11:47.834252+0000","last_clean":"2024-09-12T01:11:47.834252+0000","last_became_active":"2024-09-12T00:30:13.126147+0000","last_became_peered":"2024-09-12T00:30:13.126147+0000","last_unstale":"2024-09-12T01:11:47.834252+0000","last_undegraded":"2024-09-12T01:11:47.834252+0000","last_fullsized":"2024-09-12T01:11:47.834252+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'141","last_scrub_stamp":"2024-09-12T01:11:47.834094+0000","last_deep_scrub":"264'141","last_deep_scrub_stamp":"2024-09-12T01:11:47.834094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.834094+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:12.812212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":527,"num_write":201,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'354","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.354790+0000","last_change":"2024-09-12T01:11:44.354725+0000","last_active":"2024-09-12T01:11:44.354790+0000","last_peered":"2024-09-12T01:11:44.354790+0000","last_clean":"2024-09-12T01:11:44.354790+0000","last_became_active":"2024-09-12T00:30:11.101252+0000","last_became_peered":"2024-09-12T00:30:11.101252+0000","last_unstale":"2024-09-12T01:11:44.354790+0000","last_undegraded":"2024-09-12T01:11:44.354790+0000","last_fullsized":"2024-09-12T01:11:44.354790+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-12T01:11:44.354589+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-12T01:11:44.354589+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.354589+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:43.412106+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":19965,"num_write":1084,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'209","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.857399+0000","last_change":"2024-09-12T01:11:55.857299+0000","last_active":"2024-09-12T01:11:55.857399+0000","last_peered":"2024-09-12T01:11:55.857399+0000","last_clean":"2024-09-12T01:11:55.857399+0000","last_became_active":"2024-09-12T00:30:13.123880+0000","last_became_peered":"2024-09-12T00:30:13.123880+0000","last_unstale":"2024-09-12T01:11:55.857399+0000","last_undegraded":"2024-09-12T01:11:55.857399+0000","last_fullsized":"2024-09-12T01:11:55.857399+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-12T01:11:55.857208+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-12T01:11:55.857208+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.857208+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:36.363370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":883,"num_read_kb":720,"num_write":314,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'300","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.325606+0000","last_change":"2024-09-12T01:11:43.325526+0000","last_active":"2024-09-12T01:11:43.325606+0000","last_peered":"2024-09-12T01:11:43.325606+0000","last_clean":"2024-09-12T01:11:43.325606+0000","last_became_active":"2024-09-12T00:30:11.096381+0000","last_became_peered":"2024-09-12T00:30:11.096381+0000","last_unstale":"2024-09-12T01:11:43.325606+0000","last_undegraded":"2024-09-12T01:11:43.325606+0000","last_fullsized":"2024-09-12T01:11:43.325606+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'300","last_scrub_stamp":"2024-09-12T01:11:43.325415+0000","last_deep_scrub":"264'300","last_deep_scrub_stamp":"2024-09-12T01:11:43.325415+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.325415+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:58.190997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155766,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":52760,"num_write":991,"num_write_kb":34805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'151","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.850072+0000","last_change":"2024-09-12T01:11:58.850009+0000","last_active":"2024-09-12T01:11:58.850072+0000","last_peered":"2024-09-12T01:11:58.850072+0000","last_clean":"2024-09-12T01:11:58.850072+0000","last_became_active":"2024-09-12T00:30:13.120834+0000","last_became_peered":"2024-09-12T00:30:13.120834+0000","last_unstale":"2024-09-12T01:11:58.850072+0000","last_undegraded":"2024-09-12T01:11:58.850072+0000","last_fullsized":"2024-09-12T01:11:58.850072+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T01:11:58.849919+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T01:11:58.849919+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.849919+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:44.007174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":673,"num_read_kb":556,"num_write":237,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'320","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.443115+0000","last_change":"2024-09-12T01:11:35.443053+0000","last_active":"2024-09-12T01:11:35.443115+0000","last_peered":"2024-09-12T01:11:35.443115+0000","last_clean":"2024-09-12T01:11:35.443115+0000","last_became_active":"2024-09-12T00:30:11.101773+0000","last_became_peered":"2024-09-12T00:30:11.101773+0000","last_unstale":"2024-09-12T01:11:35.443115+0000","last_undegraded":"2024-09-12T01:11:35.443115+0000","last_fullsized":"2024-09-12T01:11:35.443115+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'320","last_scrub_stamp":"2024-09-12T01:11:35.442897+0000","last_deep_scrub":"264'320","last_deep_scrub_stamp":"2024-09-12T01:11:35.442897+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.442897+0000","objects_scrubbed":9,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:33.195530+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262280,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":453,"num_read_kb":6783,"num_write":940,"num_write_kb":20709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'4368","reported_seq":4976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.323200+0000","last_change":"2024-09-12T01:11:46.323139+0000","last_active":"2024-09-12T01:11:46.323200+0000","last_peered":"2024-09-12T01:11:46.323200+0000","last_clean":"2024-09-12T01:11:46.323200+0000","last_became_active":"2024-09-12T00:30:13.113812+0000","last_became_peered":"2024-09-12T00:30:13.113812+0000","last_unstale":"2024-09-12T01:11:46.323200+0000","last_undegraded":"2024-09-12T01:11:46.323200+0000","last_fullsized":"2024-09-12T01:11:46.323200+0000","mapping_epoch":28,"log_start":"264'4300","ondisk_log_start":"264'4300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4368","last_scrub_stamp":"2024-09-12T01:11:46.323056+0000","last_deep_scrub":"264'4368","last_deep_scrub_stamp":"2024-09-12T01:11:46.323056+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.323056+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:31.432326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17553,"num_read_kb":14742,"num_write":6586,"num_write_kb":3311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'326","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.473317+0000","last_change":"2024-09-12T01:11:37.473231+0000","last_active":"2024-09-12T01:11:37.473317+0000","last_peered":"2024-09-12T01:11:37.473317+0000","last_clean":"2024-09-12T01:11:37.473317+0000","last_became_active":"2024-09-12T00:30:11.097339+0000","last_became_peered":"2024-09-12T00:30:11.097339+0000","last_unstale":"2024-09-12T01:11:37.473317+0000","last_undegraded":"2024-09-12T01:11:37.473317+0000","last_fullsized":"2024-09-12T01:11:37.473317+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T01:11:37.473039+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T01:11:37.473039+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.473039+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:13.523857+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":4533,"num_write":1139,"num_write_kb":19662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"264'202","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.333099+0000","last_change":"2024-09-12T01:11:51.333000+0000","last_active":"2024-09-12T01:11:51.333099+0000","last_peered":"2024-09-12T01:11:51.333099+0000","last_clean":"2024-09-12T01:11:51.333099+0000","last_became_active":"2024-09-12T00:30:13.125363+0000","last_became_peered":"2024-09-12T00:30:13.125363+0000","last_unstale":"2024-09-12T01:11:51.333099+0000","last_undegraded":"2024-09-12T01:11:51.333099+0000","last_fullsized":"2024-09-12T01:11:51.333099+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T01:11:51.332895+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T01:11:51.332895+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.332895+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:19.094184+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":845,"num_read_kb":691,"num_write":311,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'352","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.393879+0000","last_change":"2024-09-12T01:11:34.393821+0000","last_active":"2024-09-12T01:11:34.393879+0000","last_peered":"2024-09-12T01:11:34.393879+0000","last_clean":"2024-09-12T01:11:34.393879+0000","last_became_active":"2024-09-12T00:30:11.104535+0000","last_became_peered":"2024-09-12T00:30:11.104535+0000","last_unstale":"2024-09-12T01:11:34.393879+0000","last_undegraded":"2024-09-12T01:11:34.393879+0000","last_fullsized":"2024-09-12T01:11:34.393879+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-12T01:11:34.393680+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-12T01:11:34.393680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.393680+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:03.783815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174750,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":66788,"num_write":989,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'115","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.451792+0000","last_change":"2024-09-12T01:11:44.451717+0000","last_active":"2024-09-12T01:11:44.451792+0000","last_peered":"2024-09-12T01:11:44.451792+0000","last_clean":"2024-09-12T01:11:44.451792+0000","last_became_active":"2024-09-12T00:30:13.124774+0000","last_became_peered":"2024-09-12T00:30:13.124774+0000","last_unstale":"2024-09-12T01:11:44.451792+0000","last_undegraded":"2024-09-12T01:11:44.451792+0000","last_fullsized":"2024-09-12T01:11:44.451792+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-12T01:11:44.451630+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-12T01:11:44.451630+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.451630+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.872379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":451,"num_write":180,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'309","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.403931+0000","last_change":"2024-09-12T01:11:40.403865+0000","last_active":"2024-09-12T01:11:40.403931+0000","last_peered":"2024-09-12T01:11:40.403931+0000","last_clean":"2024-09-12T01:11:40.403931+0000","last_became_active":"2024-09-12T00:30:11.102281+0000","last_became_peered":"2024-09-12T00:30:11.102281+0000","last_unstale":"2024-09-12T01:11:40.403931+0000","last_undegraded":"2024-09-12T01:11:40.403931+0000","last_fullsized":"2024-09-12T01:11:40.403931+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-09-12T01:11:40.403724+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-09-12T01:11:40.403724+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.403724+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:13.642901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3622998,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":454,"num_read_kb":13880,"num_write":954,"num_write_kb":40348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'545","reported_seq":1250,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.361177+0000","last_change":"2024-09-12T01:11:45.361112+0000","last_active":"2024-09-12T01:11:45.361177+0000","last_peered":"2024-09-12T01:11:45.361177+0000","last_clean":"2024-09-12T01:11:45.361177+0000","last_became_active":"2024-09-12T00:30:13.126123+0000","last_became_peered":"2024-09-12T00:30:13.126123+0000","last_unstale":"2024-09-12T01:11:45.361177+0000","last_undegraded":"2024-09-12T01:11:45.361177+0000","last_fullsized":"2024-09-12T01:11:45.361177+0000","mapping_epoch":28,"log_start":"264'500","ondisk_log_start":"264'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'545","last_scrub_stamp":"2024-09-12T01:11:45.361027+0000","last_deep_scrub":"264'545","last_deep_scrub_stamp":"2024-09-12T01:11:45.361027+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.361027+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:32.122143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2509,"num_read_kb":2200,"num_write":899,"num_write_kb":495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25757,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'299","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.286808+0000","last_change":"2024-09-12T01:11:42.286745+0000","last_active":"2024-09-12T01:11:42.286808+0000","last_peered":"2024-09-12T01:11:42.286808+0000","last_clean":"2024-09-12T01:11:42.286808+0000","last_became_active":"2024-09-12T00:30:11.104084+0000","last_became_peered":"2024-09-12T00:30:11.104084+0000","last_unstale":"2024-09-12T01:11:42.286808+0000","last_undegraded":"2024-09-12T01:11:42.286808+0000","last_fullsized":"2024-09-12T01:11:42.286808+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T01:11:42.286619+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T01:11:42.286619+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.286619+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:50.160187+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":483,"num_read_kb":14633,"num_write":970,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'231","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.388819+0000","last_change":"2024-09-12T01:11:53.388819+0000","last_active":"2024-09-12T01:11:53.388819+0000","last_peered":"2024-09-12T01:11:53.388819+0000","last_clean":"2024-09-12T01:11:53.388819+0000","last_became_active":"2024-09-12T00:30:13.127581+0000","last_became_peered":"2024-09-12T00:30:13.127581+0000","last_unstale":"2024-09-12T01:11:53.388819+0000","last_undegraded":"2024-09-12T01:11:53.388819+0000","last_fullsized":"2024-09-12T01:11:53.388819+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-12T01:11:53.388734+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-12T01:11:53.388734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.388734+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:24.192130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1008,"num_read_kb":834,"num_write":338,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'462","reported_seq":1247,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.803436+0000","last_change":"2024-09-12T01:11:49.803359+0000","last_active":"2024-09-12T01:11:49.803436+0000","last_peered":"2024-09-12T01:11:49.803436+0000","last_clean":"2024-09-12T01:11:49.803436+0000","last_became_active":"2024-09-12T00:30:13.121154+0000","last_became_peered":"2024-09-12T00:30:13.121154+0000","last_unstale":"2024-09-12T01:11:49.803436+0000","last_undegraded":"2024-09-12T01:11:49.803436+0000","last_fullsized":"2024-09-12T01:11:49.803436+0000","mapping_epoch":28,"log_start":"264'400","ondisk_log_start":"264'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'462","last_scrub_stamp":"2024-09-12T01:11:49.803243+0000","last_deep_scrub":"264'462","last_deep_scrub_stamp":"2024-09-12T01:11:49.803243+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.803243+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:20.220457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2284,"num_read_kb":1967,"num_write":806,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'287","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.803024+0000","last_change":"2024-09-12T01:11:31.803024+0000","last_active":"2024-09-12T01:11:31.803024+0000","last_peered":"2024-09-12T01:11:31.803024+0000","last_clean":"2024-09-12T01:11:31.803024+0000","last_became_active":"2024-09-12T00:30:11.103437+0000","last_became_peered":"2024-09-12T00:30:11.103437+0000","last_unstale":"2024-09-12T01:11:31.803024+0000","last_undegraded":"2024-09-12T01:11:31.803024+0000","last_fullsized":"2024-09-12T01:11:31.803024+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'287","last_scrub_stamp":"2024-09-12T01:11:31.802921+0000","last_deep_scrub":"264'287","last_deep_scrub_stamp":"2024-09-12T01:11:31.802921+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.802921+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:24.521722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767235,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":430,"num_read_kb":35388,"num_write":888,"num_write_kb":32368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'227","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.433041+0000","last_change":"2024-09-12T01:11:45.432953+0000","last_active":"2024-09-12T01:11:45.433041+0000","last_peered":"2024-09-12T01:11:45.433041+0000","last_clean":"2024-09-12T01:11:45.433041+0000","last_became_active":"2024-09-12T00:30:13.128977+0000","last_became_peered":"2024-09-12T00:30:13.128977+0000","last_unstale":"2024-09-12T01:11:45.433041+0000","last_undegraded":"2024-09-12T01:11:45.433041+0000","last_fullsized":"2024-09-12T01:11:45.433041+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-12T01:11:45.432855+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-12T01:11:45.432855+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.432855+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.213964+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1058,"num_read_kb":878,"num_write":388,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'310","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.446257+0000","last_change":"2024-09-12T01:11:36.446257+0000","last_active":"2024-09-12T01:11:36.446257+0000","last_peered":"2024-09-12T01:11:36.446257+0000","last_clean":"2024-09-12T01:11:36.446257+0000","last_became_active":"2024-09-12T00:30:11.114961+0000","last_became_peered":"2024-09-12T00:30:11.114961+0000","last_unstale":"2024-09-12T01:11:36.446257+0000","last_undegraded":"2024-09-12T01:11:36.446257+0000","last_fullsized":"2024-09-12T01:11:36.446257+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-12T01:11:36.446124+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-12T01:11:36.446124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.446124+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:20.906220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":433,"num_read_kb":13562,"num_write":946,"num_write_kb":25787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'212","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.855711+0000","last_change":"2024-09-12T01:11:39.855585+0000","last_active":"2024-09-12T01:11:39.855711+0000","last_peered":"2024-09-12T01:11:39.855711+0000","last_clean":"2024-09-12T01:11:39.855711+0000","last_became_active":"2024-09-12T00:30:13.127190+0000","last_became_peered":"2024-09-12T00:30:13.127190+0000","last_unstale":"2024-09-12T01:11:39.855711+0000","last_undegraded":"2024-09-12T01:11:39.855711+0000","last_fullsized":"2024-09-12T01:11:39.855711+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-12T01:11:39.855488+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-12T01:11:39.855488+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.855488+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:33.985807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":739,"num_write":341,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'368","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.424540+0000","last_change":"2024-09-12T01:11:35.424540+0000","last_active":"2024-09-12T01:11:35.424540+0000","last_peered":"2024-09-12T01:11:35.424540+0000","last_clean":"2024-09-12T01:11:35.424540+0000","last_became_active":"2024-09-12T00:30:11.105844+0000","last_became_peered":"2024-09-12T00:30:11.105844+0000","last_unstale":"2024-09-12T01:11:35.424540+0000","last_undegraded":"2024-09-12T01:11:35.424540+0000","last_fullsized":"2024-09-12T01:11:35.424540+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-12T01:11:35.424385+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-12T01:11:35.424385+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.424385+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:55.565109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242896,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":46849,"num_write":1178,"num_write_kb":40470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'183","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.095594+0000","last_change":"2024-09-12T01:11:44.095594+0000","last_active":"2024-09-12T01:11:44.095594+0000","last_peered":"2024-09-12T01:11:44.095594+0000","last_clean":"2024-09-12T01:11:44.095594+0000","last_became_active":"2024-09-12T00:30:13.124627+0000","last_became_peered":"2024-09-12T00:30:13.124627+0000","last_unstale":"2024-09-12T01:11:44.095594+0000","last_undegraded":"2024-09-12T01:11:44.095594+0000","last_fullsized":"2024-09-12T01:11:44.095594+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-09-12T01:11:44.095499+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-09-12T01:11:44.095499+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.095499+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:48.009771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":804,"num_read_kb":662,"num_write":262,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'315","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.375607+0000","last_change":"2024-09-12T01:11:34.375607+0000","last_active":"2024-09-12T01:11:34.375607+0000","last_peered":"2024-09-12T01:11:34.375607+0000","last_clean":"2024-09-12T01:11:34.375607+0000","last_became_active":"2024-09-12T00:30:11.114309+0000","last_became_peered":"2024-09-12T00:30:11.114309+0000","last_unstale":"2024-09-12T01:11:34.375607+0000","last_undegraded":"2024-09-12T01:11:34.375607+0000","last_fullsized":"2024-09-12T01:11:34.375607+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T01:11:34.375465+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T01:11:34.375465+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.375465+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:34.864011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052685,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":64152,"num_write":970,"num_write_kb":27626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'205","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.391069+0000","last_change":"2024-09-12T01:11:52.391069+0000","last_active":"2024-09-12T01:11:52.391069+0000","last_peered":"2024-09-12T01:11:52.391069+0000","last_clean":"2024-09-12T01:11:52.391069+0000","last_became_active":"2024-09-12T00:30:13.129718+0000","last_became_peered":"2024-09-12T00:30:13.129718+0000","last_unstale":"2024-09-12T01:11:52.391069+0000","last_undegraded":"2024-09-12T01:11:52.391069+0000","last_fullsized":"2024-09-12T01:11:52.391069+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'205","last_scrub_stamp":"2024-09-12T01:11:52.390951+0000","last_deep_scrub":"264'205","last_deep_scrub_stamp":"2024-09-12T01:11:52.390951+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.390951+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:25.975769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":749,"num_write":336,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'388","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.074143+0000","last_change":"2024-09-12T01:11:37.074143+0000","last_active":"2024-09-12T01:11:37.074143+0000","last_peered":"2024-09-12T01:11:37.074143+0000","last_clean":"2024-09-12T01:11:37.074143+0000","last_became_active":"2024-09-12T00:30:11.108958+0000","last_became_peered":"2024-09-12T00:30:11.108958+0000","last_unstale":"2024-09-12T01:11:37.074143+0000","last_undegraded":"2024-09-12T01:11:37.074143+0000","last_fullsized":"2024-09-12T01:11:37.074143+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'388","last_scrub_stamp":"2024-09-12T01:11:37.074011+0000","last_deep_scrub":"264'388","last_deep_scrub_stamp":"2024-09-12T01:11:37.074011+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.074011+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:15.101690+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1489630,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":577,"num_read_kb":32016,"num_write":1378,"num_write_kb":50601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'152","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.881871+0000","last_change":"2024-09-12T01:11:41.881871+0000","last_active":"2024-09-12T01:11:41.881871+0000","last_peered":"2024-09-12T01:11:41.881871+0000","last_clean":"2024-09-12T01:11:41.881871+0000","last_became_active":"2024-09-12T00:30:13.126143+0000","last_became_peered":"2024-09-12T00:30:13.126143+0000","last_unstale":"2024-09-12T01:11:41.881871+0000","last_undegraded":"2024-09-12T01:11:41.881871+0000","last_fullsized":"2024-09-12T01:11:41.881871+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T01:11:41.881760+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T01:11:41.881760+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.881760+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:50.664271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":565,"num_write":225,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'347","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.071130+0000","last_change":"2024-09-12T01:11:38.071064+0000","last_active":"2024-09-12T01:11:38.071130+0000","last_peered":"2024-09-12T01:11:38.071130+0000","last_clean":"2024-09-12T01:11:38.071130+0000","last_became_active":"2024-09-12T00:30:11.096162+0000","last_became_peered":"2024-09-12T00:30:11.096162+0000","last_unstale":"2024-09-12T01:11:38.071130+0000","last_undegraded":"2024-09-12T01:11:38.071130+0000","last_fullsized":"2024-09-12T01:11:38.071130+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:38.070939+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:38.070939+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.070939+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.813945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340490,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":475,"num_read_kb":7249,"num_write":983,"num_write_kb":14577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'151","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.327934+0000","last_change":"2024-09-12T01:11:55.327934+0000","last_active":"2024-09-12T01:11:55.327934+0000","last_peered":"2024-09-12T01:11:55.327934+0000","last_clean":"2024-09-12T01:11:55.327934+0000","last_became_active":"2024-09-12T00:30:21.192654+0000","last_became_peered":"2024-09-12T00:30:21.192654+0000","last_unstale":"2024-09-12T01:11:55.327934+0000","last_undegraded":"2024-09-12T01:11:55.327934+0000","last_fullsized":"2024-09-12T01:11:55.327934+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-12T01:11:55.327843+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-12T01:11:55.327843+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.327843+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:24.249456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":350,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'101","reported_seq":714,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.031644+0000","last_change":"2024-09-12T01:11:42.031586+0000","last_active":"2024-09-12T01:11:42.031644+0000","last_peered":"2024-09-12T01:11:42.031644+0000","last_clean":"2024-09-12T01:11:42.031644+0000","last_became_active":"2024-09-12T00:30:13.130030+0000","last_became_peered":"2024-09-12T00:30:13.130030+0000","last_unstale":"2024-09-12T01:11:42.031644+0000","last_undegraded":"2024-09-12T01:11:42.031644+0000","last_fullsized":"2024-09-12T01:11:42.031644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T01:11:42.031492+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T01:11:42.031492+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.031492+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:53.639664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":423,"num_write":143,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'440","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.883081+0000","last_change":"2024-09-12T01:11:38.883016+0000","last_active":"2024-09-12T01:11:38.883081+0000","last_peered":"2024-09-12T01:11:38.883081+0000","last_clean":"2024-09-12T01:11:38.883081+0000","last_became_active":"2024-09-12T00:30:46.767516+0000","last_became_peered":"2024-09-12T00:30:46.767516+0000","last_unstale":"2024-09-12T01:11:38.883081+0000","last_undegraded":"2024-09-12T01:11:38.883081+0000","last_fullsized":"2024-09-12T01:11:38.883081+0000","mapping_epoch":39,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'440","last_scrub_stamp":"2024-09-12T01:11:38.882878+0000","last_deep_scrub":"264'440","last_deep_scrub_stamp":"2024-09-12T01:11:38.882878+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.882878+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:35.403537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1451987,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":38823,"num_write":1374,"num_write_kb":62705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,4],"acting":[3,5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.822489+0000","last_change":"2024-09-12T01:12:00.822489+0000","last_active":"2024-09-12T01:12:00.822489+0000","last_peered":"2024-09-12T01:12:00.822489+0000","last_clean":"2024-09-12T01:12:00.822489+0000","last_became_active":"2024-09-12T00:30:15.127067+0000","last_became_peered":"2024-09-12T00:30:15.127067+0000","last_unstale":"2024-09-12T01:12:00.822489+0000","last_undegraded":"2024-09-12T01:12:00.822489+0000","last_fullsized":"2024-09-12T01:12:00.822489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:00.822404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:00.822404+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.822404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:28.679018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'330","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.356814+0000","last_change":"2024-09-12T01:11:59.356814+0000","last_active":"2024-09-12T01:11:59.356814+0000","last_peered":"2024-09-12T01:11:59.356814+0000","last_clean":"2024-09-12T01:11:59.356814+0000","last_became_active":"2024-09-12T00:30:17.145455+0000","last_became_peered":"2024-09-12T00:30:17.145455+0000","last_unstale":"2024-09-12T01:11:59.356814+0000","last_undegraded":"2024-09-12T01:11:59.356814+0000","last_fullsized":"2024-09-12T01:11:59.356814+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-09-12T01:11:59.356704+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-09-12T01:11:59.356704+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.356704+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:54.248777+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45268,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":524,"num_read_kb":1055,"num_write":410,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.794369+0000","last_change":"2024-09-12T01:11:54.794369+0000","last_active":"2024-09-12T01:11:54.794369+0000","last_peered":"2024-09-12T01:11:54.794369+0000","last_clean":"2024-09-12T01:11:54.794369+0000","last_became_active":"2024-09-12T00:30:19.168192+0000","last_became_peered":"2024-09-12T00:30:19.168192+0000","last_unstale":"2024-09-12T01:11:54.794369+0000","last_undegraded":"2024-09-12T01:11:54.794369+0000","last_fullsized":"2024-09-12T01:11:54.794369+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.794275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.794275+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.794275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:44.014529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'149","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.784697+0000","last_change":"2024-09-12T01:11:59.784697+0000","last_active":"2024-09-12T01:11:59.784697+0000","last_peered":"2024-09-12T01:11:59.784697+0000","last_clean":"2024-09-12T01:11:59.784697+0000","last_became_active":"2024-09-12T00:30:21.189141+0000","last_became_peered":"2024-09-12T00:30:21.189141+0000","last_unstale":"2024-09-12T01:11:59.784697+0000","last_undegraded":"2024-09-12T01:11:59.784697+0000","last_fullsized":"2024-09-12T01:11:59.784697+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-12T01:11:59.784580+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-12T01:11:59.784580+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.784580+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:54.478034+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":213,"num_read_kb":204,"num_write":274,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'90","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.830989+0000","last_change":"2024-09-12T01:11:51.830989+0000","last_active":"2024-09-12T01:11:51.830989+0000","last_peered":"2024-09-12T01:11:51.830989+0000","last_clean":"2024-09-12T01:11:51.830989+0000","last_became_active":"2024-09-12T00:30:13.127577+0000","last_became_peered":"2024-09-12T00:30:13.127577+0000","last_unstale":"2024-09-12T01:11:51.830989+0000","last_undegraded":"2024-09-12T01:11:51.830989+0000","last_fullsized":"2024-09-12T01:11:51.830989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-09-12T01:11:51.830881+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-09-12T01:11:51.830881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.830881+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:18.867029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":367,"num_write":144,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'311","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.095163+0000","last_change":"2024-09-12T01:11:35.095067+0000","last_active":"2024-09-12T01:11:35.095163+0000","last_peered":"2024-09-12T01:11:35.095163+0000","last_clean":"2024-09-12T01:11:35.095163+0000","last_became_active":"2024-09-12T00:30:11.091860+0000","last_became_peered":"2024-09-12T00:30:11.091860+0000","last_unstale":"2024-09-12T01:11:35.095163+0000","last_undegraded":"2024-09-12T01:11:35.095163+0000","last_fullsized":"2024-09-12T01:11:35.095163+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T01:11:35.094942+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T01:11:35.094942+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.094942+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:31.385294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":454,"num_read_kb":88630,"num_write":981,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.307949+0000","last_change":"2024-09-12T01:11:51.307817+0000","last_active":"2024-09-12T01:11:51.307949+0000","last_peered":"2024-09-12T01:11:51.307949+0000","last_clean":"2024-09-12T01:11:51.307949+0000","last_became_active":"2024-09-12T00:30:15.130254+0000","last_became_peered":"2024-09-12T00:30:15.130254+0000","last_unstale":"2024-09-12T01:11:51.307949+0000","last_undegraded":"2024-09-12T01:11:51.307949+0000","last_fullsized":"2024-09-12T01:11:51.307949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.307722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.307722+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.307722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:56.894557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'112","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.814903+0000","last_change":"2024-09-12T01:11:49.814903+0000","last_active":"2024-09-12T01:11:49.814903+0000","last_peered":"2024-09-12T01:11:49.814903+0000","last_clean":"2024-09-12T01:11:49.814903+0000","last_became_active":"2024-09-12T00:30:17.148422+0000","last_became_peered":"2024-09-12T00:30:17.148422+0000","last_unstale":"2024-09-12T01:11:49.814903+0000","last_undegraded":"2024-09-12T01:11:49.814903+0000","last_fullsized":"2024-09-12T01:11:49.814903+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-12T01:11:49.814806+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-12T01:11:49.814806+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.814806+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:36.594354+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":99,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.784192+0000","last_change":"2024-09-12T01:11:53.784192+0000","last_active":"2024-09-12T01:11:53.784192+0000","last_peered":"2024-09-12T01:11:53.784192+0000","last_clean":"2024-09-12T01:11:53.784192+0000","last_became_active":"2024-09-12T00:30:19.163363+0000","last_became_peered":"2024-09-12T00:30:19.163363+0000","last_unstale":"2024-09-12T01:11:53.784192+0000","last_undegraded":"2024-09-12T01:11:53.784192+0000","last_fullsized":"2024-09-12T01:11:53.784192+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.784070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.784070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.784070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:27.826504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'138","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.243506+0000","last_change":"2024-09-12T01:11:59.243432+0000","last_active":"2024-09-12T01:11:59.243506+0000","last_peered":"2024-09-12T01:11:59.243506+0000","last_clean":"2024-09-12T01:11:59.243506+0000","last_became_active":"2024-09-12T00:30:21.180419+0000","last_became_peered":"2024-09-12T00:30:21.180419+0000","last_unstale":"2024-09-12T01:11:59.243506+0000","last_undegraded":"2024-09-12T01:11:59.243506+0000","last_fullsized":"2024-09-12T01:11:59.243506+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-12T01:11:59.243350+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-12T01:11:59.243350+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.243350+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:06.416764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":136,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'120","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.315178+0000","last_change":"2024-09-12T01:11:47.315178+0000","last_active":"2024-09-12T01:11:47.315178+0000","last_peered":"2024-09-12T01:11:47.315178+0000","last_clean":"2024-09-12T01:11:47.315178+0000","last_became_active":"2024-09-12T00:30:13.126531+0000","last_became_peered":"2024-09-12T00:30:13.126531+0000","last_unstale":"2024-09-12T01:11:47.315178+0000","last_undegraded":"2024-09-12T01:11:47.315178+0000","last_fullsized":"2024-09-12T01:11:47.315178+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-12T01:11:47.315083+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-12T01:11:47.315083+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.315083+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:02.492593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":438,"num_write":171,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'350","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.902966+0000","last_change":"2024-09-12T01:11:40.902895+0000","last_active":"2024-09-12T01:11:40.902966+0000","last_peered":"2024-09-12T01:11:40.902966+0000","last_clean":"2024-09-12T01:11:40.902966+0000","last_became_active":"2024-09-12T00:30:11.110001+0000","last_became_peered":"2024-09-12T00:30:11.110001+0000","last_unstale":"2024-09-12T01:11:40.902966+0000","last_undegraded":"2024-09-12T01:11:40.902966+0000","last_fullsized":"2024-09-12T01:11:40.902966+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-12T01:11:40.902786+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-12T01:11:40.902786+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.902786+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:44.491567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":371860,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":4100,"num_write":1032,"num_write_kb":26242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.272198+0000","last_change":"2024-09-12T01:11:52.272198+0000","last_active":"2024-09-12T01:11:52.272198+0000","last_peered":"2024-09-12T01:11:52.272198+0000","last_clean":"2024-09-12T01:11:52.272198+0000","last_became_active":"2024-09-12T00:30:15.125728+0000","last_became_peered":"2024-09-12T00:30:15.125728+0000","last_unstale":"2024-09-12T01:11:52.272198+0000","last_undegraded":"2024-09-12T01:11:52.272198+0000","last_fullsized":"2024-09-12T01:11:52.272198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.272102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.272102+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.272102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:19.840928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'152","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.325350+0000","last_change":"2024-09-12T01:11:58.325286+0000","last_active":"2024-09-12T01:11:58.325350+0000","last_peered":"2024-09-12T01:11:58.325350+0000","last_clean":"2024-09-12T01:11:58.325350+0000","last_became_active":"2024-09-12T00:30:17.144701+0000","last_became_peered":"2024-09-12T00:30:17.144701+0000","last_unstale":"2024-09-12T01:11:58.325350+0000","last_undegraded":"2024-09-12T01:11:58.325350+0000","last_fullsized":"2024-09-12T01:11:58.325350+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-12T01:11:58.325196+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-12T01:11:58.325196+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.325196+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:25.004989+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":141,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'778","reported_seq":2325,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.958583+0000","last_change":"2024-09-12T01:12:13.958583+0000","last_active":"2024-09-12T01:12:13.958583+0000","last_peered":"2024-09-12T01:12:13.958583+0000","last_clean":"2024-09-12T01:12:13.958583+0000","last_became_active":"2024-09-12T00:30:19.170568+0000","last_became_peered":"2024-09-12T00:30:19.170568+0000","last_unstale":"2024-09-12T01:12:13.958583+0000","last_undegraded":"2024-09-12T01:12:13.958583+0000","last_fullsized":"2024-09-12T01:12:13.958583+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'778","last_scrub_stamp":"2024-09-12T01:12:13.958501+0000","last_deep_scrub":"264'778","last_deep_scrub_stamp":"2024-09-12T01:12:13.958501+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.958501+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:57.331603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'215","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.422178+0000","last_change":"2024-09-12T01:11:57.422104+0000","last_active":"2024-09-12T01:11:57.422178+0000","last_peered":"2024-09-12T01:11:57.422178+0000","last_clean":"2024-09-12T01:11:57.422178+0000","last_became_active":"2024-09-12T00:30:21.188312+0000","last_became_peered":"2024-09-12T00:30:21.188312+0000","last_unstale":"2024-09-12T01:11:57.422178+0000","last_undegraded":"2024-09-12T01:11:57.422178+0000","last_fullsized":"2024-09-12T01:11:57.422178+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-09-12T01:11:57.422016+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-09-12T01:11:57.422016+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.422016+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:22.406098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":596,"num_write":468,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'84","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.309383+0000","last_change":"2024-09-12T01:11:49.309383+0000","last_active":"2024-09-12T01:11:49.309383+0000","last_peered":"2024-09-12T01:11:49.309383+0000","last_clean":"2024-09-12T01:11:49.309383+0000","last_became_active":"2024-09-12T00:30:13.125323+0000","last_became_peered":"2024-09-12T00:30:13.125323+0000","last_unstale":"2024-09-12T01:11:49.309383+0000","last_undegraded":"2024-09-12T01:11:49.309383+0000","last_fullsized":"2024-09-12T01:11:49.309383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T01:11:49.309301+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T01:11:49.309301+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.309301+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:50.800564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":383,"num_read_kb":333,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'407","reported_seq":1107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.820352+0000","last_change":"2024-09-12T01:11:30.820266+0000","last_active":"2024-09-12T01:11:30.820352+0000","last_peered":"2024-09-12T01:11:30.820352+0000","last_clean":"2024-09-12T01:11:30.820352+0000","last_became_active":"2024-09-12T00:30:11.101745+0000","last_became_peered":"2024-09-12T00:30:11.101745+0000","last_unstale":"2024-09-12T01:11:30.820352+0000","last_undegraded":"2024-09-12T01:11:30.820352+0000","last_fullsized":"2024-09-12T01:11:30.820352+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'407","last_scrub_stamp":"2024-09-12T01:11:30.820135+0000","last_deep_scrub":"264'407","last_deep_scrub_stamp":"2024-09-12T01:11:30.820135+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.820135+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:48.119318+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1052724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":23420,"num_write":1255,"num_write_kb":19418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.819892+0000","last_change":"2024-09-12T01:12:01.819892+0000","last_active":"2024-09-12T01:12:01.819892+0000","last_peered":"2024-09-12T01:12:01.819892+0000","last_clean":"2024-09-12T01:12:01.819892+0000","last_became_active":"2024-09-12T00:30:15.124597+0000","last_became_peered":"2024-09-12T00:30:15.124597+0000","last_unstale":"2024-09-12T01:12:01.819892+0000","last_undegraded":"2024-09-12T01:12:01.819892+0000","last_fullsized":"2024-09-12T01:12:01.819892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.819785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.819785+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.819785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:51.290859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'266","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.322995+0000","last_change":"2024-09-12T01:11:48.322995+0000","last_active":"2024-09-12T01:11:48.322995+0000","last_peered":"2024-09-12T01:11:48.322995+0000","last_clean":"2024-09-12T01:11:48.322995+0000","last_became_active":"2024-09-12T00:30:17.145866+0000","last_became_peered":"2024-09-12T00:30:17.145866+0000","last_unstale":"2024-09-12T01:11:48.322995+0000","last_undegraded":"2024-09-12T01:11:48.322995+0000","last_fullsized":"2024-09-12T01:11:48.322995+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-09-12T01:11:48.322893+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-09-12T01:11:48.322893+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.322893+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:17.414187+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47562,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":1006,"num_write":354,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'803","reported_seq":2270,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.429790+0000","last_change":"2024-09-12T01:12:01.429714+0000","last_active":"2024-09-12T01:12:01.429790+0000","last_peered":"2024-09-12T01:12:01.429790+0000","last_clean":"2024-09-12T01:12:01.429790+0000","last_became_active":"2024-09-12T00:30:19.172403+0000","last_became_peered":"2024-09-12T00:30:19.172403+0000","last_unstale":"2024-09-12T01:12:01.429790+0000","last_undegraded":"2024-09-12T01:12:01.429790+0000","last_fullsized":"2024-09-12T01:12:01.429790+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-12T01:12:01.429628+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-12T01:12:01.429628+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.429628+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:59.201995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'133","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.840668+0000","last_change":"2024-09-12T01:11:46.840668+0000","last_active":"2024-09-12T01:11:46.840668+0000","last_peered":"2024-09-12T01:11:46.840668+0000","last_clean":"2024-09-12T01:11:46.840668+0000","last_became_active":"2024-09-12T00:30:13.120524+0000","last_became_peered":"2024-09-12T00:30:13.120524+0000","last_unstale":"2024-09-12T01:11:46.840668+0000","last_undegraded":"2024-09-12T01:11:46.840668+0000","last_fullsized":"2024-09-12T01:11:46.840668+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-09-12T01:11:46.840552+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-09-12T01:11:46.840552+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.840552+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:14.214542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":538,"num_write":190,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3594,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'385","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.397564+0000","last_change":"2024-09-12T01:11:31.397564+0000","last_active":"2024-09-12T01:11:31.397564+0000","last_peered":"2024-09-12T01:11:31.397564+0000","last_clean":"2024-09-12T01:11:31.397564+0000","last_became_active":"2024-09-12T00:30:11.105769+0000","last_became_peered":"2024-09-12T00:30:11.105769+0000","last_unstale":"2024-09-12T01:11:31.397564+0000","last_undegraded":"2024-09-12T01:11:31.397564+0000","last_fullsized":"2024-09-12T01:11:31.397564+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T01:11:31.397440+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T01:11:31.397440+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.397440+0000","objects_scrubbed":9,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:46.946497+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8955677,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":22715,"num_write":1115,"num_write_kb":62157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.860393+0000","last_change":"2024-09-12T01:11:43.860393+0000","last_active":"2024-09-12T01:11:43.860393+0000","last_peered":"2024-09-12T01:11:43.860393+0000","last_clean":"2024-09-12T01:11:43.860393+0000","last_became_active":"2024-09-12T00:30:15.132719+0000","last_became_peered":"2024-09-12T00:30:15.132719+0000","last_unstale":"2024-09-12T01:11:43.860393+0000","last_undegraded":"2024-09-12T01:11:43.860393+0000","last_fullsized":"2024-09-12T01:11:43.860393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:43.860305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:43.860305+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.860305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:54.848289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'368","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.381765+0000","last_change":"2024-09-12T01:11:49.381765+0000","last_active":"2024-09-12T01:11:49.381765+0000","last_peered":"2024-09-12T01:11:49.381765+0000","last_clean":"2024-09-12T01:11:49.381765+0000","last_became_active":"2024-09-12T00:30:17.146465+0000","last_became_peered":"2024-09-12T00:30:17.146465+0000","last_unstale":"2024-09-12T01:11:49.381765+0000","last_undegraded":"2024-09-12T01:11:49.381765+0000","last_fullsized":"2024-09-12T01:11:49.381765+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-12T01:11:49.381635+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-12T01:11:49.381635+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.381635+0000","objects_scrubbed":10,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:35.562295+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45471,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":600,"num_read_kb":1250,"num_write":474,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.207983+0000","last_change":"2024-09-12T01:11:55.207983+0000","last_active":"2024-09-12T01:11:55.207983+0000","last_peered":"2024-09-12T01:11:55.207983+0000","last_clean":"2024-09-12T01:11:55.207983+0000","last_became_active":"2024-09-12T00:30:19.164249+0000","last_became_peered":"2024-09-12T00:30:19.164249+0000","last_unstale":"2024-09-12T01:11:55.207983+0000","last_undegraded":"2024-09-12T01:11:55.207983+0000","last_fullsized":"2024-09-12T01:11:55.207983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:55.207885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:55.207885+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.207885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:20.018136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'548","reported_seq":1365,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.374746+0000","last_change":"2024-09-12T01:11:55.374641+0000","last_active":"2024-09-12T01:11:55.374746+0000","last_peered":"2024-09-12T01:11:55.374746+0000","last_clean":"2024-09-12T01:11:55.374746+0000","last_became_active":"2024-09-12T00:30:21.189156+0000","last_became_peered":"2024-09-12T00:30:21.189156+0000","last_unstale":"2024-09-12T01:11:55.374746+0000","last_undegraded":"2024-09-12T01:11:55.374746+0000","last_fullsized":"2024-09-12T01:11:55.374746+0000","mapping_epoch":36,"log_start":"264'500","ondisk_log_start":"264'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'548","last_scrub_stamp":"2024-09-12T01:11:55.374537+0000","last_deep_scrub":"264'548","last_deep_scrub_stamp":"2024-09-12T01:11:55.374537+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.374537+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:47.353067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1309,"num_read_kb":1298,"num_write":1161,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'143","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.841516+0000","last_change":"2024-09-12T01:11:34.841516+0000","last_active":"2024-09-12T01:11:34.841516+0000","last_peered":"2024-09-12T01:11:34.841516+0000","last_clean":"2024-09-12T01:11:34.841516+0000","last_became_active":"2024-09-12T00:30:13.124006+0000","last_became_peered":"2024-09-12T00:30:13.124006+0000","last_unstale":"2024-09-12T01:11:34.841516+0000","last_undegraded":"2024-09-12T01:11:34.841516+0000","last_fullsized":"2024-09-12T01:11:34.841516+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-09-12T01:11:34.841433+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-09-12T01:11:34.841433+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.841433+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:22.429642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":534,"num_write":203,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'416","reported_seq":1230,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.346226+0000","last_change":"2024-09-12T01:11:30.346226+0000","last_active":"2024-09-12T01:11:30.346226+0000","last_peered":"2024-09-12T01:11:30.346226+0000","last_clean":"2024-09-12T01:11:30.346226+0000","last_became_active":"2024-09-12T00:30:11.104314+0000","last_became_peered":"2024-09-12T00:30:11.104314+0000","last_unstale":"2024-09-12T01:11:30.346226+0000","last_undegraded":"2024-09-12T01:11:30.346226+0000","last_fullsized":"2024-09-12T01:11:30.346226+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-12T01:11:30.346090+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.346090+0000","objects_scrubbed":12,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:23.118149+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496547,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":809,"num_read_kb":45639,"num_write":1542,"num_write_kb":34585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.086776+0000","last_change":"2024-09-12T01:11:45.086776+0000","last_active":"2024-09-12T01:11:45.086776+0000","last_peered":"2024-09-12T01:11:45.086776+0000","last_clean":"2024-09-12T01:11:45.086776+0000","last_became_active":"2024-09-12T00:30:15.125380+0000","last_became_peered":"2024-09-12T00:30:15.125380+0000","last_unstale":"2024-09-12T01:11:45.086776+0000","last_undegraded":"2024-09-12T01:11:45.086776+0000","last_fullsized":"2024-09-12T01:11:45.086776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.086679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.086679+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.086679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.313099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'258","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.321356+0000","last_change":"2024-09-12T01:11:57.321356+0000","last_active":"2024-09-12T01:11:57.321356+0000","last_peered":"2024-09-12T01:11:57.321356+0000","last_clean":"2024-09-12T01:11:57.321356+0000","last_became_active":"2024-09-12T00:30:17.145155+0000","last_became_peered":"2024-09-12T00:30:17.145155+0000","last_unstale":"2024-09-12T01:11:57.321356+0000","last_undegraded":"2024-09-12T01:11:57.321356+0000","last_fullsized":"2024-09-12T01:11:57.321356+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'258","last_scrub_stamp":"2024-09-12T01:11:57.321246+0000","last_deep_scrub":"264'258","last_deep_scrub_stamp":"2024-09-12T01:11:57.321246+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.321246+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:25.723354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53484,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":958,"num_write":338,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.374218+0000","last_change":"2024-09-12T01:12:04.374218+0000","last_active":"2024-09-12T01:12:04.374218+0000","last_peered":"2024-09-12T01:12:04.374218+0000","last_clean":"2024-09-12T01:12:04.374218+0000","last_became_active":"2024-09-12T00:30:19.171189+0000","last_became_peered":"2024-09-12T00:30:19.171189+0000","last_unstale":"2024-09-12T01:12:04.374218+0000","last_undegraded":"2024-09-12T01:12:04.374218+0000","last_fullsized":"2024-09-12T01:12:04.374218+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:04.374135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:04.374135+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.374135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:31.656837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2418","reported_seq":4291,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.824281+0000","last_change":"2024-09-12T01:11:56.824210+0000","last_active":"2024-09-12T01:11:56.824281+0000","last_peered":"2024-09-12T01:11:56.824281+0000","last_clean":"2024-09-12T01:11:56.824281+0000","last_became_active":"2024-09-12T00:30:21.183561+0000","last_became_peered":"2024-09-12T00:30:21.183561+0000","last_unstale":"2024-09-12T01:11:56.824281+0000","last_undegraded":"2024-09-12T01:11:56.824281+0000","last_fullsized":"2024-09-12T01:11:56.824281+0000","mapping_epoch":36,"log_start":"264'2400","ondisk_log_start":"264'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2418","last_scrub_stamp":"2024-09-12T01:11:56.824111+0000","last_deep_scrub":"264'2418","last_deep_scrub_stamp":"2024-09-12T01:11:56.824111+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.824111+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":2400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.381858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6196,"num_read_kb":6147,"num_write":4885,"num_write_kb":1795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'180","reported_seq":808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.419931+0000","last_change":"2024-09-12T01:11:37.419931+0000","last_active":"2024-09-12T01:11:37.419931+0000","last_peered":"2024-09-12T01:11:37.419931+0000","last_clean":"2024-09-12T01:11:37.419931+0000","last_became_active":"2024-09-12T00:30:13.122098+0000","last_became_peered":"2024-09-12T00:30:13.122098+0000","last_unstale":"2024-09-12T01:11:37.419931+0000","last_undegraded":"2024-09-12T01:11:37.419931+0000","last_fullsized":"2024-09-12T01:11:37.419931+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T01:11:37.419846+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T01:11:37.419846+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.419846+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:33.172289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":634,"num_write":261,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'304","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.852338+0000","last_change":"2024-09-12T01:11:35.852338+0000","last_active":"2024-09-12T01:11:35.852338+0000","last_peered":"2024-09-12T01:11:35.852338+0000","last_clean":"2024-09-12T01:11:35.852338+0000","last_became_active":"2024-09-12T00:30:11.112302+0000","last_became_peered":"2024-09-12T00:30:11.112302+0000","last_unstale":"2024-09-12T01:11:35.852338+0000","last_undegraded":"2024-09-12T01:11:35.852338+0000","last_fullsized":"2024-09-12T01:11:35.852338+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-12T01:11:35.852227+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-12T01:11:35.852227+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.852227+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:03.092960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":10144,"num_write":972,"num_write_kb":18823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.407080+0000","last_change":"2024-09-12T01:11:55.407080+0000","last_active":"2024-09-12T01:11:55.407080+0000","last_peered":"2024-09-12T01:11:55.407080+0000","last_clean":"2024-09-12T01:11:55.407080+0000","last_became_active":"2024-09-12T00:30:15.129311+0000","last_became_peered":"2024-09-12T00:30:15.129311+0000","last_unstale":"2024-09-12T01:11:55.407080+0000","last_undegraded":"2024-09-12T01:11:55.407080+0000","last_fullsized":"2024-09-12T01:11:55.407080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:55.407003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:55.407003+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.407003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:30.044743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'314","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.940525+0000","last_change":"2024-09-12T01:12:04.940525+0000","last_active":"2024-09-12T01:12:04.940525+0000","last_peered":"2024-09-12T01:12:04.940525+0000","last_clean":"2024-09-12T01:12:04.940525+0000","last_became_active":"2024-09-12T00:30:17.147148+0000","last_became_peered":"2024-09-12T00:30:17.147148+0000","last_unstale":"2024-09-12T01:12:04.940525+0000","last_undegraded":"2024-09-12T01:12:04.940525+0000","last_fullsized":"2024-09-12T01:12:04.940525+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T01:12:04.940404+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T01:12:04.940404+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.940404+0000","objects_scrubbed":9,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:38.290878+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47594,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":517,"num_read_kb":1147,"num_write":414,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2339,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.420965+0000","last_change":"2024-09-12T01:12:00.420965+0000","last_active":"2024-09-12T01:12:00.420965+0000","last_peered":"2024-09-12T01:12:00.420965+0000","last_clean":"2024-09-12T01:12:00.420965+0000","last_became_active":"2024-09-12T00:30:19.168419+0000","last_became_peered":"2024-09-12T00:30:19.168419+0000","last_unstale":"2024-09-12T01:12:00.420965+0000","last_undegraded":"2024-09-12T01:12:00.420965+0000","last_fullsized":"2024-09-12T01:12:00.420965+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-12T01:12:00.420887+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-12T01:12:00.420887+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.420887+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:46.132374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'163","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.227428+0000","last_change":"2024-09-12T01:11:58.227428+0000","last_active":"2024-09-12T01:11:58.227428+0000","last_peered":"2024-09-12T01:11:58.227428+0000","last_clean":"2024-09-12T01:11:58.227428+0000","last_became_active":"2024-09-12T00:30:21.179533+0000","last_became_peered":"2024-09-12T00:30:21.179533+0000","last_unstale":"2024-09-12T01:11:58.227428+0000","last_undegraded":"2024-09-12T01:11:58.227428+0000","last_fullsized":"2024-09-12T01:11:58.227428+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T01:11:58.227343+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T01:11:58.227343+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.227343+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:34.643155+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":87,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'98","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.293986+0000","last_change":"2024-09-12T01:11:46.293986+0000","last_active":"2024-09-12T01:11:46.293986+0000","last_peered":"2024-09-12T01:11:46.293986+0000","last_clean":"2024-09-12T01:11:46.293986+0000","last_became_active":"2024-09-12T00:30:13.131423+0000","last_became_peered":"2024-09-12T00:30:13.131423+0000","last_unstale":"2024-09-12T01:11:46.293986+0000","last_undegraded":"2024-09-12T01:11:46.293986+0000","last_fullsized":"2024-09-12T01:11:46.293986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'98","last_scrub_stamp":"2024-09-12T01:11:46.293901+0000","last_deep_scrub":"264'98","last_deep_scrub_stamp":"2024-09-12T01:11:46.293901+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.293901+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:41.760950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":439,"num_read_kb":366,"num_write":140,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'380","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.402539+0000","last_change":"2024-09-12T01:11:33.402539+0000","last_active":"2024-09-12T01:11:33.402539+0000","last_peered":"2024-09-12T01:11:33.402539+0000","last_clean":"2024-09-12T01:11:33.402539+0000","last_became_active":"2024-09-12T00:30:11.103285+0000","last_became_peered":"2024-09-12T00:30:11.103285+0000","last_unstale":"2024-09-12T01:11:33.402539+0000","last_undegraded":"2024-09-12T01:11:33.402539+0000","last_fullsized":"2024-09-12T01:11:33.402539+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-12T01:11:33.402382+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-12T01:11:33.402382+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.402382+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:57.850138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":575,"num_read_kb":3264,"num_write":1093,"num_write_kb":35970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.102852+0000","last_change":"2024-09-12T01:11:46.102852+0000","last_active":"2024-09-12T01:11:46.102852+0000","last_peered":"2024-09-12T01:11:46.102852+0000","last_clean":"2024-09-12T01:11:46.102852+0000","last_became_active":"2024-09-12T00:30:15.132695+0000","last_became_peered":"2024-09-12T00:30:15.132695+0000","last_unstale":"2024-09-12T01:11:46.102852+0000","last_undegraded":"2024-09-12T01:11:46.102852+0000","last_fullsized":"2024-09-12T01:11:46.102852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.102769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.102769+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.102769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:16.249060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'464","reported_seq":1105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.334024+0000","last_change":"2024-09-12T01:11:55.334024+0000","last_active":"2024-09-12T01:11:55.334024+0000","last_peered":"2024-09-12T01:11:55.334024+0000","last_clean":"2024-09-12T01:11:55.334024+0000","last_became_active":"2024-09-12T00:30:17.147015+0000","last_became_peered":"2024-09-12T00:30:17.147015+0000","last_unstale":"2024-09-12T01:11:55.334024+0000","last_undegraded":"2024-09-12T01:11:55.334024+0000","last_fullsized":"2024-09-12T01:11:55.334024+0000","mapping_epoch":32,"log_start":"264'400","ondisk_log_start":"264'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'464","last_scrub_stamp":"2024-09-12T01:11:55.333937+0000","last_deep_scrub":"264'464","last_deep_scrub_stamp":"2024-09-12T01:11:55.333937+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.333937+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:17.007555+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69788,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":1853,"num_write":630,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.438295+0000","last_change":"2024-09-12T01:11:59.438295+0000","last_active":"2024-09-12T01:11:59.438295+0000","last_peered":"2024-09-12T01:11:59.438295+0000","last_clean":"2024-09-12T01:11:59.438295+0000","last_became_active":"2024-09-12T00:30:19.167503+0000","last_became_peered":"2024-09-12T00:30:19.167503+0000","last_unstale":"2024-09-12T01:11:59.438295+0000","last_undegraded":"2024-09-12T01:11:59.438295+0000","last_fullsized":"2024-09-12T01:11:59.438295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:59.438199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:59.438199+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.438199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:02.777851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'97","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.685630+0000","last_change":"2024-09-12T01:11:55.685630+0000","last_active":"2024-09-12T01:11:55.685630+0000","last_peered":"2024-09-12T01:11:55.685630+0000","last_clean":"2024-09-12T01:11:55.685630+0000","last_became_active":"2024-09-12T00:30:21.192700+0000","last_became_peered":"2024-09-12T00:30:21.192700+0000","last_unstale":"2024-09-12T01:11:55.685630+0000","last_undegraded":"2024-09-12T01:11:55.685630+0000","last_fullsized":"2024-09-12T01:11:55.685630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-12T01:11:55.685541+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-12T01:11:55.685541+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.685541+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:52.590816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":205,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'119","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.435937+0000","last_change":"2024-09-12T01:11:38.435937+0000","last_active":"2024-09-12T01:11:38.435937+0000","last_peered":"2024-09-12T01:11:38.435937+0000","last_clean":"2024-09-12T01:11:38.435937+0000","last_became_active":"2024-09-12T00:30:13.128253+0000","last_became_peered":"2024-09-12T00:30:13.128253+0000","last_unstale":"2024-09-12T01:11:38.435937+0000","last_undegraded":"2024-09-12T01:11:38.435937+0000","last_fullsized":"2024-09-12T01:11:38.435937+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T01:11:38.435862+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T01:11:38.435862+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.435862+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.099253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":431,"num_write":189,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'311","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.492446+0000","last_change":"2024-09-12T01:11:33.492446+0000","last_active":"2024-09-12T01:11:33.492446+0000","last_peered":"2024-09-12T01:11:33.492446+0000","last_clean":"2024-09-12T01:11:33.492446+0000","last_became_active":"2024-09-12T00:30:11.100056+0000","last_became_peered":"2024-09-12T00:30:11.100056+0000","last_unstale":"2024-09-12T01:11:33.492446+0000","last_undegraded":"2024-09-12T01:11:33.492446+0000","last_fullsized":"2024-09-12T01:11:33.492446+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-09-12T01:11:33.492354+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-09-12T01:11:33.492354+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.492354+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:25.053401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":62849,"num_write":1084,"num_write_kb":31335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.557200+0000","last_change":"2024-09-12T01:11:47.557200+0000","last_active":"2024-09-12T01:11:47.557200+0000","last_peered":"2024-09-12T01:11:47.557200+0000","last_clean":"2024-09-12T01:11:47.557200+0000","last_became_active":"2024-09-12T00:30:15.132801+0000","last_became_peered":"2024-09-12T00:30:15.132801+0000","last_unstale":"2024-09-12T01:11:47.557200+0000","last_undegraded":"2024-09-12T01:11:47.557200+0000","last_fullsized":"2024-09-12T01:11:47.557200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.557077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.557077+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.557077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:33.239839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'299","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.864074+0000","last_change":"2024-09-12T01:11:48.864074+0000","last_active":"2024-09-12T01:11:48.864074+0000","last_peered":"2024-09-12T01:11:48.864074+0000","last_clean":"2024-09-12T01:11:48.864074+0000","last_became_active":"2024-09-12T00:30:17.149603+0000","last_became_peered":"2024-09-12T00:30:17.149603+0000","last_unstale":"2024-09-12T01:11:48.864074+0000","last_undegraded":"2024-09-12T01:11:48.864074+0000","last_fullsized":"2024-09-12T01:11:48.864074+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'299","last_scrub_stamp":"2024-09-12T01:11:48.863986+0000","last_deep_scrub":"264'299","last_deep_scrub_stamp":"2024-09-12T01:11:48.863986+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.863986+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:22.417240+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57292,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":510,"num_read_kb":1117,"num_write":456,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.581178+0000","last_change":"2024-09-12T01:11:50.581178+0000","last_active":"2024-09-12T01:11:50.581178+0000","last_peered":"2024-09-12T01:11:50.581178+0000","last_clean":"2024-09-12T01:11:50.581178+0000","last_became_active":"2024-09-12T00:30:19.168223+0000","last_became_peered":"2024-09-12T00:30:19.168223+0000","last_unstale":"2024-09-12T01:11:50.581178+0000","last_undegraded":"2024-09-12T01:11:50.581178+0000","last_fullsized":"2024-09-12T01:11:50.581178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.581086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.581086+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.581086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:20.933529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'127","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.452059+0000","last_change":"2024-09-12T01:12:04.452004+0000","last_active":"2024-09-12T01:12:04.452059+0000","last_peered":"2024-09-12T01:12:04.452059+0000","last_clean":"2024-09-12T01:12:04.452059+0000","last_became_active":"2024-09-12T00:30:21.192509+0000","last_became_peered":"2024-09-12T00:30:21.192509+0000","last_unstale":"2024-09-12T01:12:04.452059+0000","last_undegraded":"2024-09-12T01:12:04.452059+0000","last_fullsized":"2024-09-12T01:12:04.452059+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-12T01:12:04.451918+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-12T01:12:04.451918+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.451918+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:01.817710+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'134","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.852081+0000","last_change":"2024-09-12T01:11:50.852081+0000","last_active":"2024-09-12T01:11:50.852081+0000","last_peered":"2024-09-12T01:11:50.852081+0000","last_clean":"2024-09-12T01:11:50.852081+0000","last_became_active":"2024-09-12T00:30:13.123412+0000","last_became_peered":"2024-09-12T00:30:13.123412+0000","last_unstale":"2024-09-12T01:11:50.852081+0000","last_undegraded":"2024-09-12T01:11:50.852081+0000","last_fullsized":"2024-09-12T01:11:50.852081+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-12T01:11:50.851995+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-12T01:11:50.851995+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.851995+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:08.959022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":514,"num_write":215,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'283","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.891985+0000","last_change":"2024-09-12T01:11:37.891985+0000","last_active":"2024-09-12T01:11:37.891985+0000","last_peered":"2024-09-12T01:11:37.891985+0000","last_clean":"2024-09-12T01:11:37.891985+0000","last_became_active":"2024-09-12T00:30:11.097902+0000","last_became_peered":"2024-09-12T00:30:11.097902+0000","last_unstale":"2024-09-12T01:11:37.891985+0000","last_undegraded":"2024-09-12T01:11:37.891985+0000","last_fullsized":"2024-09-12T01:11:37.891985+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'283","last_scrub_stamp":"2024-09-12T01:11:37.891780+0000","last_deep_scrub":"264'283","last_deep_scrub_stamp":"2024-09-12T01:11:37.891780+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.891780+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:26.776654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170421,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":429,"num_read_kb":17154,"num_write":985,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.417233+0000","last_change":"2024-09-12T01:11:54.417233+0000","last_active":"2024-09-12T01:11:54.417233+0000","last_peered":"2024-09-12T01:11:54.417233+0000","last_clean":"2024-09-12T01:11:54.417233+0000","last_became_active":"2024-09-12T00:30:15.125629+0000","last_became_peered":"2024-09-12T00:30:15.125629+0000","last_unstale":"2024-09-12T01:11:54.417233+0000","last_undegraded":"2024-09-12T01:11:54.417233+0000","last_fullsized":"2024-09-12T01:11:54.417233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.417146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.417146+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.417146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:07.825711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'290","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.462086+0000","last_change":"2024-09-12T01:11:58.462086+0000","last_active":"2024-09-12T01:11:58.462086+0000","last_peered":"2024-09-12T01:11:58.462086+0000","last_clean":"2024-09-12T01:11:58.462086+0000","last_became_active":"2024-09-12T00:30:17.149661+0000","last_became_peered":"2024-09-12T00:30:17.149661+0000","last_unstale":"2024-09-12T01:11:58.462086+0000","last_undegraded":"2024-09-12T01:11:58.462086+0000","last_fullsized":"2024-09-12T01:11:58.462086+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'290","last_scrub_stamp":"2024-09-12T01:11:58.461988+0000","last_deep_scrub":"264'290","last_deep_scrub_stamp":"2024-09-12T01:11:58.461988+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.461988+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:56.514745+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59535,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":1016,"num_write":372,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'762","reported_seq":2265,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.569125+0000","last_change":"2024-09-12T01:11:49.569125+0000","last_active":"2024-09-12T01:11:49.569125+0000","last_peered":"2024-09-12T01:11:49.569125+0000","last_clean":"2024-09-12T01:11:49.569125+0000","last_became_active":"2024-09-12T00:30:19.167476+0000","last_became_peered":"2024-09-12T00:30:19.167476+0000","last_unstale":"2024-09-12T01:11:49.569125+0000","last_undegraded":"2024-09-12T01:11:49.569125+0000","last_fullsized":"2024-09-12T01:11:49.569125+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'762","last_scrub_stamp":"2024-09-12T01:11:49.569037+0000","last_deep_scrub":"264'762","last_deep_scrub_stamp":"2024-09-12T01:11:49.569037+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.569037+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:56.774664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'163","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.191869+0000","last_change":"2024-09-12T01:11:57.191808+0000","last_active":"2024-09-12T01:11:57.191869+0000","last_peered":"2024-09-12T01:11:57.191869+0000","last_clean":"2024-09-12T01:11:57.191869+0000","last_became_active":"2024-09-12T00:30:21.185553+0000","last_became_peered":"2024-09-12T00:30:21.185553+0000","last_unstale":"2024-09-12T01:11:57.191869+0000","last_undegraded":"2024-09-12T01:11:57.191869+0000","last_fullsized":"2024-09-12T01:11:57.191869+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-12T01:11:57.191712+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-12T01:11:57.191712+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.191712+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:35.496120+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":222,"num_write":391,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'167","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.347977+0000","last_change":"2024-09-12T01:11:40.347977+0000","last_active":"2024-09-12T01:11:40.347977+0000","last_peered":"2024-09-12T01:11:40.347977+0000","last_clean":"2024-09-12T01:11:40.347977+0000","last_became_active":"2024-09-12T00:30:13.121664+0000","last_became_peered":"2024-09-12T00:30:13.121664+0000","last_unstale":"2024-09-12T01:11:40.347977+0000","last_undegraded":"2024-09-12T01:11:40.347977+0000","last_fullsized":"2024-09-12T01:11:40.347977+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'167","last_scrub_stamp":"2024-09-12T01:11:40.347879+0000","last_deep_scrub":"264'167","last_deep_scrub_stamp":"2024-09-12T01:11:40.347879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.347879+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:35.652313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":684,"num_read_kb":568,"num_write":259,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'538","reported_seq":1360,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.895438+0000","last_change":"2024-09-12T01:11:34.895438+0000","last_active":"2024-09-12T01:11:34.895438+0000","last_peered":"2024-09-12T01:11:34.895438+0000","last_clean":"2024-09-12T01:11:34.895438+0000","last_became_active":"2024-09-12T00:30:11.110370+0000","last_became_peered":"2024-09-12T00:30:11.110370+0000","last_unstale":"2024-09-12T01:11:34.895438+0000","last_undegraded":"2024-09-12T01:11:34.895438+0000","last_fullsized":"2024-09-12T01:11:34.895438+0000","mapping_epoch":26,"log_start":"264'500","ondisk_log_start":"264'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'538","last_scrub_stamp":"2024-09-12T01:11:34.895276+0000","last_deep_scrub":"264'538","last_deep_scrub_stamp":"2024-09-12T01:11:34.895276+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.895276+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:45.682560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174759,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1243,"num_read_kb":75461,"num_write":1612,"num_write_kb":22075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1463,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.870320+0000","last_change":"2024-09-12T01:11:44.870320+0000","last_active":"2024-09-12T01:11:44.870320+0000","last_peered":"2024-09-12T01:11:44.870320+0000","last_clean":"2024-09-12T01:11:44.870320+0000","last_became_active":"2024-09-12T00:30:15.132802+0000","last_became_peered":"2024-09-12T00:30:15.132802+0000","last_unstale":"2024-09-12T01:11:44.870320+0000","last_undegraded":"2024-09-12T01:11:44.870320+0000","last_fullsized":"2024-09-12T01:11:44.870320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:11:44.870207+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:11:44.870207+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.870207+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:45.970093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'79","reported_seq":596,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.170222+0000","last_change":"2024-09-12T01:11:51.170222+0000","last_active":"2024-09-12T01:11:51.170222+0000","last_peered":"2024-09-12T01:11:51.170222+0000","last_clean":"2024-09-12T01:11:51.170222+0000","last_became_active":"2024-09-12T00:30:17.147864+0000","last_became_peered":"2024-09-12T00:30:17.147864+0000","last_unstale":"2024-09-12T01:11:51.170222+0000","last_undegraded":"2024-09-12T01:11:51.170222+0000","last_fullsized":"2024-09-12T01:11:51.170222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-09-12T01:11:51.170119+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-09-12T01:11:51.170119+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.170119+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:54.031616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'783","reported_seq":2342,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.760830+0000","last_change":"2024-09-12T01:11:51.760830+0000","last_active":"2024-09-12T01:11:51.760830+0000","last_peered":"2024-09-12T01:11:51.760830+0000","last_clean":"2024-09-12T01:11:51.760830+0000","last_became_active":"2024-09-12T00:30:19.168960+0000","last_became_peered":"2024-09-12T00:30:19.168960+0000","last_unstale":"2024-09-12T01:11:51.760830+0000","last_undegraded":"2024-09-12T01:11:51.760830+0000","last_fullsized":"2024-09-12T01:11:51.760830+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'783","last_scrub_stamp":"2024-09-12T01:11:51.760734+0000","last_deep_scrub":"264'783","last_deep_scrub_stamp":"2024-09-12T01:11:51.760734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.760734+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:25.225611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'119","reported_seq":627,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.324365+0000","last_change":"2024-09-12T01:11:54.324300+0000","last_active":"2024-09-12T01:11:54.324365+0000","last_peered":"2024-09-12T01:11:54.324365+0000","last_clean":"2024-09-12T01:11:54.324365+0000","last_became_active":"2024-09-12T00:30:21.185618+0000","last_became_peered":"2024-09-12T00:30:21.185618+0000","last_unstale":"2024-09-12T01:11:54.324365+0000","last_undegraded":"2024-09-12T01:11:54.324365+0000","last_fullsized":"2024-09-12T01:11:54.324365+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-12T01:11:54.324212+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-12T01:11:54.324212+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.324212+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:45.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":151,"num_write":299,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'206","reported_seq":906,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.526779+0000","last_change":"2024-09-12T01:11:35.526779+0000","last_active":"2024-09-12T01:11:35.526779+0000","last_peered":"2024-09-12T01:11:35.526779+0000","last_clean":"2024-09-12T01:11:35.526779+0000","last_became_active":"2024-09-12T00:30:13.129892+0000","last_became_peered":"2024-09-12T00:30:13.129892+0000","last_unstale":"2024-09-12T01:11:35.526779+0000","last_undegraded":"2024-09-12T01:11:35.526779+0000","last_fullsized":"2024-09-12T01:11:35.526779+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-12T01:11:35.526685+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-12T01:11:35.526685+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.526685+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:59.274285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":984,"num_read_kb":836,"num_write":303,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'321","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.382246+0000","last_change":"2024-09-12T01:11:34.382246+0000","last_active":"2024-09-12T01:11:34.382246+0000","last_peered":"2024-09-12T01:11:34.382246+0000","last_clean":"2024-09-12T01:11:34.382246+0000","last_became_active":"2024-09-12T00:30:11.103195+0000","last_became_peered":"2024-09-12T00:30:11.103195+0000","last_unstale":"2024-09-12T01:11:34.382246+0000","last_undegraded":"2024-09-12T01:11:34.382246+0000","last_fullsized":"2024-09-12T01:11:34.382246+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T01:11:34.382128+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T01:11:34.382128+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.382128+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:39.745506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254394,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":8246,"num_write":945,"num_write_kb":41947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.905296+0000","last_change":"2024-09-12T01:11:56.905296+0000","last_active":"2024-09-12T01:11:56.905296+0000","last_peered":"2024-09-12T01:11:56.905296+0000","last_clean":"2024-09-12T01:11:56.905296+0000","last_became_active":"2024-09-12T00:30:15.127047+0000","last_became_peered":"2024-09-12T00:30:15.127047+0000","last_unstale":"2024-09-12T01:11:56.905296+0000","last_undegraded":"2024-09-12T01:11:56.905296+0000","last_fullsized":"2024-09-12T01:11:56.905296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:56.905201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:56.905201+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.905201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.672497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'316","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.848686+0000","last_change":"2024-09-12T01:11:46.848686+0000","last_active":"2024-09-12T01:11:46.848686+0000","last_peered":"2024-09-12T01:11:46.848686+0000","last_clean":"2024-09-12T01:11:46.848686+0000","last_became_active":"2024-09-12T00:30:17.149579+0000","last_became_peered":"2024-09-12T00:30:17.149579+0000","last_unstale":"2024-09-12T01:11:46.848686+0000","last_undegraded":"2024-09-12T01:11:46.848686+0000","last_fullsized":"2024-09-12T01:11:46.848686+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T01:11:46.848586+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T01:11:46.848586+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.848586+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:28.252461+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14370,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":993,"num_write":388,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.363086+0000","last_change":"2024-09-12T01:11:51.363086+0000","last_active":"2024-09-12T01:11:51.363086+0000","last_peered":"2024-09-12T01:11:51.363086+0000","last_clean":"2024-09-12T01:11:51.363086+0000","last_became_active":"2024-09-12T00:30:19.169468+0000","last_became_peered":"2024-09-12T00:30:19.169468+0000","last_unstale":"2024-09-12T01:11:51.363086+0000","last_undegraded":"2024-09-12T01:11:51.363086+0000","last_fullsized":"2024-09-12T01:11:51.363086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.362984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.362984+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.362984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:04.867972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'113","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.640181+0000","last_change":"2024-09-12T01:11:54.640109+0000","last_active":"2024-09-12T01:11:54.640181+0000","last_peered":"2024-09-12T01:11:54.640181+0000","last_clean":"2024-09-12T01:11:54.640181+0000","last_became_active":"2024-09-12T00:30:21.184033+0000","last_became_peered":"2024-09-12T00:30:21.184033+0000","last_unstale":"2024-09-12T01:11:54.640181+0000","last_undegraded":"2024-09-12T01:11:54.640181+0000","last_fullsized":"2024-09-12T01:11:54.640181+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-12T01:11:54.640026+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-12T01:11:54.640026+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.640026+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:34.375790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":266,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'245","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.861331+0000","last_change":"2024-09-12T01:11:47.861264+0000","last_active":"2024-09-12T01:11:47.861331+0000","last_peered":"2024-09-12T01:11:47.861331+0000","last_clean":"2024-09-12T01:11:47.861331+0000","last_became_active":"2024-09-12T00:30:13.120962+0000","last_became_peered":"2024-09-12T00:30:13.120962+0000","last_unstale":"2024-09-12T01:11:47.861331+0000","last_undegraded":"2024-09-12T01:11:47.861331+0000","last_fullsized":"2024-09-12T01:11:47.861331+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-12T01:11:47.861179+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-12T01:11:47.861179+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.861179+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:22.003599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":839,"num_write":403,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.846255+0000","last_change":"2024-09-12T01:11:29.846210+0000","last_active":"2024-09-12T01:11:29.846255+0000","last_peered":"2024-09-12T01:11:29.846255+0000","last_clean":"2024-09-12T01:11:29.846255+0000","last_became_active":"2024-09-12T00:29:54.470723+0000","last_became_peered":"2024-09-12T00:29:54.470723+0000","last_unstale":"2024-09-12T01:11:29.846255+0000","last_undegraded":"2024-09-12T01:11:29.846255+0000","last_fullsized":"2024-09-12T01:11:29.846255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-12T01:11:29.846146+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-12T01:11:29.846146+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.846146+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:43.920303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.905025+0000","last_change":"2024-09-12T01:11:30.904927+0000","last_active":"2024-09-12T01:11:30.905025+0000","last_peered":"2024-09-12T01:11:30.905025+0000","last_clean":"2024-09-12T01:11:30.905025+0000","last_became_active":"2024-09-12T00:29:59.525216+0000","last_became_peered":"2024-09-12T00:29:59.525216+0000","last_unstale":"2024-09-12T01:11:30.905025+0000","last_undegraded":"2024-09-12T01:11:30.905025+0000","last_fullsized":"2024-09-12T01:11:30.905025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:30.904805+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:30.904805+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.904805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:38.997041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001092499,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'317","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.380787+0000","last_change":"2024-09-12T01:11:32.380726+0000","last_active":"2024-09-12T01:11:32.380787+0000","last_peered":"2024-09-12T01:11:32.380787+0000","last_clean":"2024-09-12T01:11:32.380787+0000","last_became_active":"2024-09-12T00:30:11.102144+0000","last_became_peered":"2024-09-12T00:30:11.102144+0000","last_unstale":"2024-09-12T01:11:32.380787+0000","last_undegraded":"2024-09-12T01:11:32.380787+0000","last_fullsized":"2024-09-12T01:11:32.380787+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-12T01:11:32.380545+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-12T01:11:32.380545+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.380545+0000","objects_scrubbed":12,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:59.777398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505108,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":430,"num_read_kb":17991,"num_write":985,"num_write_kb":40410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"264'4","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.366291+0000","last_change":"2024-09-12T01:11:42.366234+0000","last_active":"2024-09-12T01:11:42.366291+0000","last_peered":"2024-09-12T01:11:42.366291+0000","last_clean":"2024-09-12T01:11:42.366291+0000","last_became_active":"2024-09-12T00:30:15.132332+0000","last_became_peered":"2024-09-12T00:30:15.132332+0000","last_unstale":"2024-09-12T01:11:42.366291+0000","last_undegraded":"2024-09-12T01:11:42.366291+0000","last_fullsized":"2024-09-12T01:11:42.366291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-12T01:11:42.366139+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-12T01:11:42.366139+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.366139+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:39.262944+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'719","reported_seq":1422,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.899520+0000","last_change":"2024-09-12T01:12:03.899520+0000","last_active":"2024-09-12T01:12:03.899520+0000","last_peered":"2024-09-12T01:12:03.899520+0000","last_clean":"2024-09-12T01:12:03.899520+0000","last_became_active":"2024-09-12T00:30:17.149842+0000","last_became_peered":"2024-09-12T00:30:17.149842+0000","last_unstale":"2024-09-12T01:12:03.899520+0000","last_undegraded":"2024-09-12T01:12:03.899520+0000","last_fullsized":"2024-09-12T01:12:03.899520+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'719","last_scrub_stamp":"2024-09-12T01:12:03.899420+0000","last_deep_scrub":"264'719","last_deep_scrub_stamp":"2024-09-12T01:12:03.899420+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.899420+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:24.007354+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166874,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1403,"num_read_kb":3182,"num_write":1320,"num_write_kb":1183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106952,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.424273+0000","last_change":"2024-09-12T01:12:03.424273+0000","last_active":"2024-09-12T01:12:03.424273+0000","last_peered":"2024-09-12T01:12:03.424273+0000","last_clean":"2024-09-12T01:12:03.424273+0000","last_became_active":"2024-09-12T00:30:19.168219+0000","last_became_peered":"2024-09-12T00:30:19.168219+0000","last_unstale":"2024-09-12T01:12:03.424273+0000","last_undegraded":"2024-09-12T01:12:03.424273+0000","last_fullsized":"2024-09-12T01:12:03.424273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.424188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.424188+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.424188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:54.976112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'217","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.356378+0000","last_change":"2024-09-12T01:11:54.356378+0000","last_active":"2024-09-12T01:11:54.356378+0000","last_peered":"2024-09-12T01:11:54.356378+0000","last_clean":"2024-09-12T01:11:54.356378+0000","last_became_active":"2024-09-12T00:30:21.191389+0000","last_became_peered":"2024-09-12T00:30:21.191389+0000","last_unstale":"2024-09-12T01:11:54.356378+0000","last_undegraded":"2024-09-12T01:11:54.356378+0000","last_fullsized":"2024-09-12T01:11:54.356378+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'217","last_scrub_stamp":"2024-09-12T01:11:54.356283+0000","last_deep_scrub":"264'217","last_deep_scrub_stamp":"2024-09-12T01:11:54.356283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.356283+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:00.464287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":544,"num_write":463,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'84","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.322102+0000","last_change":"2024-09-12T01:11:45.322102+0000","last_active":"2024-09-12T01:11:45.322102+0000","last_peered":"2024-09-12T01:11:45.322102+0000","last_clean":"2024-09-12T01:11:45.322102+0000","last_became_active":"2024-09-12T00:30:13.124407+0000","last_became_peered":"2024-09-12T00:30:13.124407+0000","last_unstale":"2024-09-12T01:11:45.322102+0000","last_undegraded":"2024-09-12T01:11:45.322102+0000","last_fullsized":"2024-09-12T01:11:45.322102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-12T01:11:45.322015+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-12T01:11:45.322015+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.322015+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:57.115441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":258,"num_write":150,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.850992+0000","last_change":"2024-09-12T01:11:36.850934+0000","last_active":"2024-09-12T01:11:36.850992+0000","last_peered":"2024-09-12T01:11:36.850992+0000","last_clean":"2024-09-12T01:11:36.850992+0000","last_became_active":"2024-09-12T00:29:59.529397+0000","last_became_peered":"2024-09-12T00:29:59.529397+0000","last_unstale":"2024-09-12T01:11:36.850992+0000","last_undegraded":"2024-09-12T01:11:36.850992+0000","last_fullsized":"2024-09-12T01:11:36.850992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.850849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.850849+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.850849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:50.093006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00052747700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'385","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.093336+0000","last_change":"2024-09-12T01:11:32.093255+0000","last_active":"2024-09-12T01:11:32.093336+0000","last_peered":"2024-09-12T01:11:32.093336+0000","last_clean":"2024-09-12T01:11:32.093336+0000","last_became_active":"2024-09-12T00:30:11.099065+0000","last_became_peered":"2024-09-12T00:30:11.099065+0000","last_unstale":"2024-09-12T01:11:32.093336+0000","last_undegraded":"2024-09-12T01:11:32.093336+0000","last_fullsized":"2024-09-12T01:11:32.093336+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'385","last_scrub_stamp":"2024-09-12T01:11:32.093094+0000","last_deep_scrub":"264'385","last_deep_scrub_stamp":"2024-09-12T01:11:32.093094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.093094+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:51.292680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":521,"num_read_kb":8968,"num_write":1169,"num_write_kb":21800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.799649+0000","last_change":"2024-09-12T01:11:53.799649+0000","last_active":"2024-09-12T01:11:53.799649+0000","last_peered":"2024-09-12T01:11:53.799649+0000","last_clean":"2024-09-12T01:11:53.799649+0000","last_became_active":"2024-09-12T00:30:15.130490+0000","last_became_peered":"2024-09-12T00:30:15.130490+0000","last_unstale":"2024-09-12T01:11:53.799649+0000","last_undegraded":"2024-09-12T01:11:53.799649+0000","last_fullsized":"2024-09-12T01:11:53.799649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.799585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.799585+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.799585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:42.700401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'1365","reported_seq":2802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.529334+0000","last_change":"2024-09-12T01:11:46.529275+0000","last_active":"2024-09-12T01:11:46.529334+0000","last_peered":"2024-09-12T01:11:46.529334+0000","last_clean":"2024-09-12T01:11:46.529334+0000","last_became_active":"2024-09-12T00:30:17.146374+0000","last_became_peered":"2024-09-12T00:30:17.146374+0000","last_unstale":"2024-09-12T01:11:46.529334+0000","last_undegraded":"2024-09-12T01:11:46.529334+0000","last_fullsized":"2024-09-12T01:11:46.529334+0000","mapping_epoch":32,"log_start":"264'1300","ondisk_log_start":"264'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1365","last_scrub_stamp":"2024-09-12T01:11:46.529145+0000","last_deep_scrub":"264'1365","last_deep_scrub_stamp":"2024-09-12T01:11:46.529145+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.529145+0000","objects_scrubbed":12,"log_size":65,"log_dups_size":1300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:23.834431+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162102,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2173,"num_read_kb":4252,"num_write":1262,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.013963+0000","last_change":"2024-09-12T01:12:09.013963+0000","last_active":"2024-09-12T01:12:09.013963+0000","last_peered":"2024-09-12T01:12:09.013963+0000","last_clean":"2024-09-12T01:12:09.013963+0000","last_became_active":"2024-09-12T00:30:19.169700+0000","last_became_peered":"2024-09-12T00:30:19.169700+0000","last_unstale":"2024-09-12T01:12:09.013963+0000","last_undegraded":"2024-09-12T01:12:09.013963+0000","last_fullsized":"2024-09-12T01:12:09.013963+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:09.013873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:09.013873+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.013873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:02.383045+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'97","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.489162+0000","last_change":"2024-09-12T01:12:05.489162+0000","last_active":"2024-09-12T01:12:05.489162+0000","last_peered":"2024-09-12T01:12:05.489162+0000","last_clean":"2024-09-12T01:12:05.489162+0000","last_became_active":"2024-09-12T00:30:21.193491+0000","last_became_peered":"2024-09-12T00:30:21.193491+0000","last_unstale":"2024-09-12T01:12:05.489162+0000","last_undegraded":"2024-09-12T01:12:05.489162+0000","last_fullsized":"2024-09-12T01:12:05.489162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-12T01:12:05.489054+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-12T01:12:05.489054+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.489054+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.438964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":108,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'102","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.003162+0000","last_change":"2024-09-12T01:11:41.003162+0000","last_active":"2024-09-12T01:11:41.003162+0000","last_peered":"2024-09-12T01:11:41.003162+0000","last_clean":"2024-09-12T01:11:41.003162+0000","last_became_active":"2024-09-12T00:30:13.124085+0000","last_became_peered":"2024-09-12T00:30:13.124085+0000","last_unstale":"2024-09-12T01:11:41.003162+0000","last_undegraded":"2024-09-12T01:11:41.003162+0000","last_fullsized":"2024-09-12T01:11:41.003162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-12T01:11:41.003082+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-12T01:11:41.003082+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.003082+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:30.129863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":146,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.502852+0000","last_change":"2024-09-12T01:11:32.502795+0000","last_active":"2024-09-12T01:11:32.502852+0000","last_peered":"2024-09-12T01:11:32.502852+0000","last_clean":"2024-09-12T01:11:32.502852+0000","last_became_active":"2024-09-12T00:29:59.529474+0000","last_became_peered":"2024-09-12T00:29:59.529474+0000","last_unstale":"2024-09-12T01:11:32.502852+0000","last_undegraded":"2024-09-12T01:11:32.502852+0000","last_fullsized":"2024-09-12T01:11:32.502852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.502719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.502719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.502719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:31.918266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054406500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'337","reported_seq":975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.312291+0000","last_change":"2024-09-12T01:11:34.312196+0000","last_active":"2024-09-12T01:11:34.312291+0000","last_peered":"2024-09-12T01:11:34.312291+0000","last_clean":"2024-09-12T01:11:34.312291+0000","last_became_active":"2024-09-12T00:30:46.766731+0000","last_became_peered":"2024-09-12T00:30:46.766731+0000","last_unstale":"2024-09-12T01:11:34.312291+0000","last_undegraded":"2024-09-12T01:11:34.312291+0000","last_fullsized":"2024-09-12T01:11:34.312291+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T01:11:34.311972+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T01:11:34.311972+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.311972+0000","objects_scrubbed":8,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:31.110464+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7776863,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":511,"num_read_kb":16356,"num_write":1167,"num_write_kb":34470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,4],"acting":[5,7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.573198+0000","last_change":"2024-09-12T01:11:45.573198+0000","last_active":"2024-09-12T01:11:45.573198+0000","last_peered":"2024-09-12T01:11:45.573198+0000","last_clean":"2024-09-12T01:11:45.573198+0000","last_became_active":"2024-09-12T00:30:15.132744+0000","last_became_peered":"2024-09-12T00:30:15.132744+0000","last_unstale":"2024-09-12T01:11:45.573198+0000","last_undegraded":"2024-09-12T01:11:45.573198+0000","last_fullsized":"2024-09-12T01:11:45.573198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:45.573109+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:45.573109+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.573109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:55.353583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'226","reported_seq":1271,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.460893+0000","last_change":"2024-09-12T01:11:46.460831+0000","last_active":"2024-09-12T01:11:46.460893+0000","last_peered":"2024-09-12T01:11:46.460893+0000","last_clean":"2024-09-12T01:11:46.460893+0000","last_became_active":"2024-09-12T00:30:17.145284+0000","last_became_peered":"2024-09-12T00:30:17.145284+0000","last_unstale":"2024-09-12T01:11:46.460893+0000","last_undegraded":"2024-09-12T01:11:46.460893+0000","last_fullsized":"2024-09-12T01:11:46.460893+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-09-12T01:11:46.460719+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-09-12T01:11:46.460719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.460719+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:56.553885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":169,"num_write":145,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.351194+0000","last_change":"2024-09-12T01:12:02.351133+0000","last_active":"2024-09-12T01:12:02.351194+0000","last_peered":"2024-09-12T01:12:02.351194+0000","last_clean":"2024-09-12T01:12:02.351194+0000","last_became_active":"2024-09-12T00:30:19.169439+0000","last_became_peered":"2024-09-12T00:30:19.169439+0000","last_unstale":"2024-09-12T01:12:02.351194+0000","last_undegraded":"2024-09-12T01:12:02.351194+0000","last_fullsized":"2024-09-12T01:12:02.351194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:02.351050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:02.351050+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.351050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:26.348607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'344","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.409194+0000","last_change":"2024-09-12T01:12:06.409194+0000","last_active":"2024-09-12T01:12:06.409194+0000","last_peered":"2024-09-12T01:12:06.409194+0000","last_clean":"2024-09-12T01:12:06.409194+0000","last_became_active":"2024-09-12T00:30:21.187616+0000","last_became_peered":"2024-09-12T00:30:21.187616+0000","last_unstale":"2024-09-12T01:12:06.409194+0000","last_undegraded":"2024-09-12T01:12:06.409194+0000","last_fullsized":"2024-09-12T01:12:06.409194+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-12T01:12:06.409109+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-12T01:12:06.409109+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.409109+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:35.067425+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":676,"num_read_kb":665,"num_write":755,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'375","reported_seq":1092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.030374+0000","last_change":"2024-09-12T01:11:40.030234+0000","last_active":"2024-09-12T01:11:40.030374+0000","last_peered":"2024-09-12T01:11:40.030374+0000","last_clean":"2024-09-12T01:11:40.030374+0000","last_became_active":"2024-09-12T00:30:13.122751+0000","last_became_peered":"2024-09-12T00:30:13.122751+0000","last_unstale":"2024-09-12T01:11:40.030374+0000","last_undegraded":"2024-09-12T01:11:40.030374+0000","last_fullsized":"2024-09-12T01:11:40.030374+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:40.030125+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:40.030125+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.030125+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:16.425527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1941,"num_read_kb":1679,"num_write":648,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.926825+0000","last_change":"2024-09-12T01:11:32.926782+0000","last_active":"2024-09-12T01:11:32.926825+0000","last_peered":"2024-09-12T01:11:32.926825+0000","last_clean":"2024-09-12T01:11:32.926825+0000","last_became_active":"2024-09-12T00:29:59.596992+0000","last_became_peered":"2024-09-12T00:29:59.596992+0000","last_unstale":"2024-09-12T01:11:32.926825+0000","last_undegraded":"2024-09-12T01:11:32.926825+0000","last_fullsized":"2024-09-12T01:11:32.926825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T01:11:32.926707+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T01:11:32.926707+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.926707+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:26.696475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000992204,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'399","reported_seq":1141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.438450+0000","last_change":"2024-09-12T01:11:32.438397+0000","last_active":"2024-09-12T01:11:32.438450+0000","last_peered":"2024-09-12T01:11:32.438450+0000","last_clean":"2024-09-12T01:11:32.438450+0000","last_became_active":"2024-09-12T00:30:11.100253+0000","last_became_peered":"2024-09-12T00:30:11.100253+0000","last_unstale":"2024-09-12T01:11:32.438450+0000","last_undegraded":"2024-09-12T01:11:32.438450+0000","last_fullsized":"2024-09-12T01:11:32.438450+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'399","last_scrub_stamp":"2024-09-12T01:11:32.438283+0000","last_deep_scrub":"264'399","last_deep_scrub_stamp":"2024-09-12T01:11:32.438283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.438283+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:47.427418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7586776,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":852,"num_read_kb":32409,"num_write":1258,"num_write_kb":44212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.603613+0000","last_change":"2024-09-12T01:11:44.603535+0000","last_active":"2024-09-12T01:11:44.603613+0000","last_peered":"2024-09-12T01:11:44.603613+0000","last_clean":"2024-09-12T01:11:44.603613+0000","last_became_active":"2024-09-12T00:30:15.127835+0000","last_became_peered":"2024-09-12T00:30:15.127835+0000","last_unstale":"2024-09-12T01:11:44.603613+0000","last_undegraded":"2024-09-12T01:11:44.603613+0000","last_fullsized":"2024-09-12T01:11:44.603613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.603445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.603445+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.603445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:54.508744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'130","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.460639+0000","last_change":"2024-09-12T01:11:56.460639+0000","last_active":"2024-09-12T01:11:56.460639+0000","last_peered":"2024-09-12T01:11:56.460639+0000","last_clean":"2024-09-12T01:11:56.460639+0000","last_became_active":"2024-09-12T00:30:17.148548+0000","last_became_peered":"2024-09-12T00:30:17.148548+0000","last_unstale":"2024-09-12T01:11:56.460639+0000","last_undegraded":"2024-09-12T01:11:56.460639+0000","last_fullsized":"2024-09-12T01:11:56.460639+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T01:11:56.460539+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T01:11:56.460539+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.460539+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:22.881152+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.979184+0000","last_change":"2024-09-12T01:12:10.979184+0000","last_active":"2024-09-12T01:12:10.979184+0000","last_peered":"2024-09-12T01:12:10.979184+0000","last_clean":"2024-09-12T01:12:10.979184+0000","last_became_active":"2024-09-12T00:30:19.165120+0000","last_became_peered":"2024-09-12T00:30:19.165120+0000","last_unstale":"2024-09-12T01:12:10.979184+0000","last_undegraded":"2024-09-12T01:12:10.979184+0000","last_fullsized":"2024-09-12T01:12:10.979184+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:10.979089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:10.979089+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.979089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:03.580315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'134","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.773246+0000","last_change":"2024-09-12T01:11:57.773246+0000","last_active":"2024-09-12T01:11:57.773246+0000","last_peered":"2024-09-12T01:11:57.773246+0000","last_clean":"2024-09-12T01:11:57.773246+0000","last_became_active":"2024-09-12T00:30:21.180708+0000","last_became_peered":"2024-09-12T00:30:21.180708+0000","last_unstale":"2024-09-12T01:11:57.773246+0000","last_undegraded":"2024-09-12T01:11:57.773246+0000","last_fullsized":"2024-09-12T01:11:57.773246+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-12T01:11:57.773164+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-12T01:11:57.773164+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.773164+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:52.985256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":239,"num_write":325,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'171","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.027208+0000","last_change":"2024-09-12T01:11:39.027134+0000","last_active":"2024-09-12T01:11:39.027208+0000","last_peered":"2024-09-12T01:11:39.027208+0000","last_clean":"2024-09-12T01:11:39.027208+0000","last_became_active":"2024-09-12T00:30:13.130610+0000","last_became_peered":"2024-09-12T00:30:13.130610+0000","last_unstale":"2024-09-12T01:11:39.027208+0000","last_undegraded":"2024-09-12T01:11:39.027208+0000","last_fullsized":"2024-09-12T01:11:39.027208+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-12T01:11:39.027047+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-12T01:11:39.027047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.027047+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:23.518560+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":757,"num_read_kb":608,"num_write":292,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'326","reported_seq":945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.394914+0000","last_change":"2024-09-12T01:11:31.394860+0000","last_active":"2024-09-12T01:11:31.394914+0000","last_peered":"2024-09-12T01:11:31.394914+0000","last_clean":"2024-09-12T01:11:31.394914+0000","last_became_active":"2024-09-12T00:30:11.104002+0000","last_became_peered":"2024-09-12T00:30:11.104002+0000","last_unstale":"2024-09-12T01:11:31.394914+0000","last_undegraded":"2024-09-12T01:11:31.394914+0000","last_fullsized":"2024-09-12T01:11:31.394914+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-12T01:11:31.394736+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.394736+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:03.175443+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4452439,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":415,"num_read_kb":13269,"num_write":941,"num_write_kb":33802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.213348+0000","last_change":"2024-09-12T01:11:32.213270+0000","last_active":"2024-09-12T01:11:32.213348+0000","last_peered":"2024-09-12T01:11:32.213348+0000","last_clean":"2024-09-12T01:11:32.213348+0000","last_became_active":"2024-09-12T00:29:59.597003+0000","last_became_peered":"2024-09-12T00:29:59.597003+0000","last_unstale":"2024-09-12T01:11:32.213348+0000","last_undegraded":"2024-09-12T01:11:32.213348+0000","last_fullsized":"2024-09-12T01:11:32.213348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.213181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.213181+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.213181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:55.736193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049988799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.282338+0000","last_change":"2024-09-12T01:11:50.282272+0000","last_active":"2024-09-12T01:11:50.282338+0000","last_peered":"2024-09-12T01:11:50.282338+0000","last_clean":"2024-09-12T01:11:50.282338+0000","last_became_active":"2024-09-12T00:30:15.127513+0000","last_became_peered":"2024-09-12T00:30:15.127513+0000","last_unstale":"2024-09-12T01:11:50.282338+0000","last_undegraded":"2024-09-12T01:11:50.282338+0000","last_fullsized":"2024-09-12T01:11:50.282338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.282187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.282187+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.282187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:50.522854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'574","reported_seq":1251,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.625837+0000","last_change":"2024-09-12T01:11:43.625759+0000","last_active":"2024-09-12T01:11:43.625837+0000","last_peered":"2024-09-12T01:11:43.625837+0000","last_clean":"2024-09-12T01:11:43.625837+0000","last_became_active":"2024-09-12T00:30:17.146141+0000","last_became_peered":"2024-09-12T00:30:17.146141+0000","last_unstale":"2024-09-12T01:11:43.625837+0000","last_undegraded":"2024-09-12T01:11:43.625837+0000","last_fullsized":"2024-09-12T01:11:43.625837+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'574","last_scrub_stamp":"2024-09-12T01:11:43.625634+0000","last_deep_scrub":"264'574","last_deep_scrub_stamp":"2024-09-12T01:11:43.625634+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.625634+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":500,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:48.119734+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93926,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1559,"num_read_kb":2701,"num_write":2018,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":507816,"num_omap_keys":1152,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.331589+0000","last_change":"2024-09-12T01:11:50.331499+0000","last_active":"2024-09-12T01:11:50.331589+0000","last_peered":"2024-09-12T01:11:50.331589+0000","last_clean":"2024-09-12T01:11:50.331589+0000","last_became_active":"2024-09-12T00:30:19.167819+0000","last_became_peered":"2024-09-12T00:30:19.167819+0000","last_unstale":"2024-09-12T01:11:50.331589+0000","last_undegraded":"2024-09-12T01:11:50.331589+0000","last_fullsized":"2024-09-12T01:11:50.331589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.331408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.331408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.331408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:26.591133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'181","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.478435+0000","last_change":"2024-09-12T01:12:07.478435+0000","last_active":"2024-09-12T01:12:07.478435+0000","last_peered":"2024-09-12T01:12:07.478435+0000","last_clean":"2024-09-12T01:12:07.478435+0000","last_became_active":"2024-09-12T00:30:21.192893+0000","last_became_peered":"2024-09-12T00:30:21.192893+0000","last_unstale":"2024-09-12T01:12:07.478435+0000","last_undegraded":"2024-09-12T01:12:07.478435+0000","last_fullsized":"2024-09-12T01:12:07.478435+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-12T01:12:07.478345+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-12T01:12:07.478345+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.478345+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:40.582868+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":195,"num_read_kb":181,"num_write":424,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'295","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.072383+0000","last_change":"2024-09-12T01:11:43.072329+0000","last_active":"2024-09-12T01:11:43.072383+0000","last_peered":"2024-09-12T01:11:43.072383+0000","last_clean":"2024-09-12T01:11:43.072383+0000","last_became_active":"2024-09-12T00:30:13.125487+0000","last_became_peered":"2024-09-12T00:30:13.125487+0000","last_unstale":"2024-09-12T01:11:43.072383+0000","last_undegraded":"2024-09-12T01:11:43.072383+0000","last_fullsized":"2024-09-12T01:11:43.072383+0000","mapping_epoch":28,"log_start":"261'200","ondisk_log_start":"261'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'295","last_scrub_stamp":"2024-09-12T01:11:43.072246+0000","last_deep_scrub":"264'295","last_deep_scrub_stamp":"2024-09-12T01:11:43.072246+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.072246+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:38.938472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1016,"num_write":432,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'308","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.079678+0000","last_change":"2024-09-12T01:11:33.079611+0000","last_active":"2024-09-12T01:11:33.079678+0000","last_peered":"2024-09-12T01:11:33.079678+0000","last_clean":"2024-09-12T01:11:33.079678+0000","last_became_active":"2024-09-12T00:30:11.108257+0000","last_became_peered":"2024-09-12T00:30:11.108257+0000","last_unstale":"2024-09-12T01:11:33.079678+0000","last_undegraded":"2024-09-12T01:11:33.079678+0000","last_fullsized":"2024-09-12T01:11:33.079678+0000","mapping_epoch":26,"log_start":"264'200","ondisk_log_start":"264'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-12T01:11:33.079481+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-12T01:11:33.079481+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.079481+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:37.289345+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":29050,"num_write":952,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.924888+0000","last_change":"2024-09-12T01:11:31.924834+0000","last_active":"2024-09-12T01:11:31.924888+0000","last_peered":"2024-09-12T01:11:31.924888+0000","last_clean":"2024-09-12T01:11:31.924888+0000","last_became_active":"2024-09-12T00:29:59.527080+0000","last_became_peered":"2024-09-12T00:29:59.527080+0000","last_unstale":"2024-09-12T01:11:31.924888+0000","last_undegraded":"2024-09-12T01:11:31.924888+0000","last_fullsized":"2024-09-12T01:11:31.924888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.924761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.924761+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.924761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.589363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047664000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.448214+0000","last_change":"2024-09-12T01:11:47.448139+0000","last_active":"2024-09-12T01:11:47.448214+0000","last_peered":"2024-09-12T01:11:47.448214+0000","last_clean":"2024-09-12T01:11:47.448214+0000","last_became_active":"2024-09-12T00:30:15.124765+0000","last_became_peered":"2024-09-12T00:30:15.124765+0000","last_unstale":"2024-09-12T01:11:47.448214+0000","last_undegraded":"2024-09-12T01:11:47.448214+0000","last_fullsized":"2024-09-12T01:11:47.448214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.448047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.448047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.448047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:26.268517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'170","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.208398+0000","last_change":"2024-09-12T01:11:50.208331+0000","last_active":"2024-09-12T01:11:50.208398+0000","last_peered":"2024-09-12T01:11:50.208398+0000","last_clean":"2024-09-12T01:11:50.208398+0000","last_became_active":"2024-09-12T00:30:17.147297+0000","last_became_peered":"2024-09-12T00:30:17.147297+0000","last_unstale":"2024-09-12T01:11:50.208398+0000","last_undegraded":"2024-09-12T01:11:50.208398+0000","last_fullsized":"2024-09-12T01:11:50.208398+0000","mapping_epoch":32,"log_start":"261'100","ondisk_log_start":"261'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'170","last_scrub_stamp":"2024-09-12T01:11:50.208237+0000","last_deep_scrub":"264'170","last_deep_scrub_stamp":"2024-09-12T01:11:50.208237+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.208237+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:31.146209+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":208,"num_read_kb":197,"num_write":138,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'783","reported_seq":4286,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.782303+0000","last_change":"2024-09-12T01:11:55.782247+0000","last_active":"2024-09-12T01:11:55.782303+0000","last_peered":"2024-09-12T01:11:55.782303+0000","last_clean":"2024-09-12T01:11:55.782303+0000","last_became_active":"2024-09-12T00:30:19.169689+0000","last_became_peered":"2024-09-12T00:30:19.169689+0000","last_unstale":"2024-09-12T01:11:55.782303+0000","last_undegraded":"2024-09-12T01:11:55.782303+0000","last_fullsized":"2024-09-12T01:11:55.782303+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'783","last_scrub_stamp":"2024-09-12T01:11:55.782161+0000","last_deep_scrub":"264'783","last_deep_scrub_stamp":"2024-09-12T01:11:55.782161+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.782161+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:52.245663+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'139","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.665326+0000","last_change":"2024-09-12T01:11:56.665326+0000","last_active":"2024-09-12T01:11:56.665326+0000","last_peered":"2024-09-12T01:11:56.665326+0000","last_clean":"2024-09-12T01:11:56.665326+0000","last_became_active":"2024-09-12T00:30:21.189546+0000","last_became_peered":"2024-09-12T00:30:21.189546+0000","last_unstale":"2024-09-12T01:11:56.665326+0000","last_undegraded":"2024-09-12T01:11:56.665326+0000","last_fullsized":"2024-09-12T01:11:56.665326+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'139","last_scrub_stamp":"2024-09-12T01:11:56.665223+0000","last_deep_scrub":"264'139","last_deep_scrub_stamp":"2024-09-12T01:11:56.665223+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.665223+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:06.441855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":147,"num_write":325,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'196","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.285827+0000","last_change":"2024-09-12T01:11:37.285722+0000","last_active":"2024-09-12T01:11:37.285827+0000","last_peered":"2024-09-12T01:11:37.285827+0000","last_clean":"2024-09-12T01:11:37.285827+0000","last_became_active":"2024-09-12T00:30:13.118656+0000","last_became_peered":"2024-09-12T00:30:13.118656+0000","last_unstale":"2024-09-12T01:11:37.285827+0000","last_undegraded":"2024-09-12T01:11:37.285827+0000","last_fullsized":"2024-09-12T01:11:37.285827+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-12T01:11:37.285627+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-12T01:11:37.285627+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.285627+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:30.901502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":942,"num_read_kb":795,"num_write":340,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'370","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.361161+0000","last_change":"2024-09-12T01:11:35.361161+0000","last_active":"2024-09-12T01:11:35.361161+0000","last_peered":"2024-09-12T01:11:35.361161+0000","last_clean":"2024-09-12T01:11:35.361161+0000","last_became_active":"2024-09-12T00:30:11.090114+0000","last_became_peered":"2024-09-12T00:30:11.090114+0000","last_unstale":"2024-09-12T01:11:35.361161+0000","last_undegraded":"2024-09-12T01:11:35.361161+0000","last_fullsized":"2024-09-12T01:11:35.361161+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'370","last_scrub_stamp":"2024-09-12T01:11:35.360991+0000","last_deep_scrub":"264'370","last_deep_scrub_stamp":"2024-09-12T01:11:35.360991+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.360991+0000","objects_scrubbed":10,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.207634+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9433118,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":605,"num_read_kb":27258,"num_write":1271,"num_write_kb":43330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.405044+0000","last_change":"2024-09-12T01:11:31.405044+0000","last_active":"2024-09-12T01:11:31.405044+0000","last_peered":"2024-09-12T01:11:31.405044+0000","last_clean":"2024-09-12T01:11:31.405044+0000","last_became_active":"2024-09-12T00:29:59.597117+0000","last_became_peered":"2024-09-12T00:29:59.597117+0000","last_unstale":"2024-09-12T01:11:31.405044+0000","last_undegraded":"2024-09-12T01:11:31.405044+0000","last_fullsized":"2024-09-12T01:11:31.405044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.404954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.404954+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.404954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:13.972945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051703899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.873795+0000","last_change":"2024-09-12T01:11:57.873711+0000","last_active":"2024-09-12T01:11:57.873795+0000","last_peered":"2024-09-12T01:11:57.873795+0000","last_clean":"2024-09-12T01:11:57.873795+0000","last_became_active":"2024-09-12T00:30:15.126949+0000","last_became_peered":"2024-09-12T00:30:15.126949+0000","last_unstale":"2024-09-12T01:11:57.873795+0000","last_undegraded":"2024-09-12T01:11:57.873795+0000","last_fullsized":"2024-09-12T01:11:57.873795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:57.873617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:57.873617+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.873617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:08.766588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'113","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.856158+0000","last_change":"2024-09-12T01:12:02.856158+0000","last_active":"2024-09-12T01:12:02.856158+0000","last_peered":"2024-09-12T01:12:02.856158+0000","last_clean":"2024-09-12T01:12:02.856158+0000","last_became_active":"2024-09-12T00:30:17.149791+0000","last_became_peered":"2024-09-12T00:30:17.149791+0000","last_unstale":"2024-09-12T01:12:02.856158+0000","last_undegraded":"2024-09-12T01:12:02.856158+0000","last_fullsized":"2024-09-12T01:12:02.856158+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-12T01:12:02.855997+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-12T01:12:02.855997+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.855997+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:14.157955+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'803","reported_seq":4550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.506714+0000","last_change":"2024-09-12T01:11:57.506616+0000","last_active":"2024-09-12T01:11:57.506714+0000","last_peered":"2024-09-12T01:11:57.506714+0000","last_clean":"2024-09-12T01:11:57.506714+0000","last_became_active":"2024-09-12T00:30:19.166687+0000","last_became_peered":"2024-09-12T00:30:19.166687+0000","last_unstale":"2024-09-12T01:11:57.506714+0000","last_undegraded":"2024-09-12T01:11:57.506714+0000","last_fullsized":"2024-09-12T01:11:57.506714+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-12T01:11:57.506505+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-12T01:11:57.506505+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.506505+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:55.538085+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'273","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.524299+0000","last_change":"2024-09-12T01:12:06.524299+0000","last_active":"2024-09-12T01:12:06.524299+0000","last_peered":"2024-09-12T01:12:06.524299+0000","last_clean":"2024-09-12T01:12:06.524299+0000","last_became_active":"2024-09-12T00:30:21.192189+0000","last_became_peered":"2024-09-12T00:30:21.192189+0000","last_unstale":"2024-09-12T01:12:06.524299+0000","last_undegraded":"2024-09-12T01:12:06.524299+0000","last_fullsized":"2024-09-12T01:12:06.524299+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-12T01:12:06.524198+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-12T01:12:06.524198+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.524198+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.096400+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":326,"num_read_kb":325,"num_write":560,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'395","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.432082+0000","last_change":"2024-09-12T01:11:36.432024+0000","last_active":"2024-09-12T01:11:36.432082+0000","last_peered":"2024-09-12T01:11:36.432082+0000","last_clean":"2024-09-12T01:11:36.432082+0000","last_became_active":"2024-09-12T00:30:13.120906+0000","last_became_peered":"2024-09-12T00:30:13.120906+0000","last_unstale":"2024-09-12T01:11:36.432082+0000","last_undegraded":"2024-09-12T01:11:36.432082+0000","last_fullsized":"2024-09-12T01:11:36.432082+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-12T01:11:36.431932+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-12T01:11:36.431932+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.431932+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:46.567143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1876,"num_read_kb":1541,"num_write":715,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'329","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.404850+0000","last_change":"2024-09-12T01:11:33.404850+0000","last_active":"2024-09-12T01:11:33.404850+0000","last_peered":"2024-09-12T01:11:33.404850+0000","last_clean":"2024-09-12T01:11:33.404850+0000","last_became_active":"2024-09-12T00:30:11.101931+0000","last_became_peered":"2024-09-12T00:30:11.101931+0000","last_unstale":"2024-09-12T01:11:33.404850+0000","last_undegraded":"2024-09-12T01:11:33.404850+0000","last_fullsized":"2024-09-12T01:11:33.404850+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-12T01:11:33.404737+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-12T01:11:33.404737+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.404737+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:04.479639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359495,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":501,"num_read_kb":50204,"num_write":1062,"num_write_kb":37284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.877931+0000","last_change":"2024-09-12T01:11:33.877931+0000","last_active":"2024-09-12T01:11:33.877931+0000","last_peered":"2024-09-12T01:11:33.877931+0000","last_clean":"2024-09-12T01:11:33.877931+0000","last_became_active":"2024-09-12T00:29:59.597093+0000","last_became_peered":"2024-09-12T00:29:59.597093+0000","last_unstale":"2024-09-12T01:11:33.877931+0000","last_undegraded":"2024-09-12T01:11:33.877931+0000","last_fullsized":"2024-09-12T01:11:33.877931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.877841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.877841+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.877841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:36.694365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012712170000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.323365+0000","last_change":"2024-09-12T01:11:48.323292+0000","last_active":"2024-09-12T01:11:48.323365+0000","last_peered":"2024-09-12T01:11:48.323365+0000","last_clean":"2024-09-12T01:11:48.323365+0000","last_became_active":"2024-09-12T00:30:15.126041+0000","last_became_peered":"2024-09-12T00:30:15.126041+0000","last_unstale":"2024-09-12T01:11:48.323365+0000","last_undegraded":"2024-09-12T01:11:48.323365+0000","last_fullsized":"2024-09-12T01:11:48.323365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.323209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.323209+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.323209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:59.170409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'771","reported_seq":1502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.419306+0000","last_change":"2024-09-12T01:11:43.419218+0000","last_active":"2024-09-12T01:11:43.419306+0000","last_peered":"2024-09-12T01:11:43.419306+0000","last_clean":"2024-09-12T01:11:43.419306+0000","last_became_active":"2024-09-12T00:30:17.148954+0000","last_became_peered":"2024-09-12T00:30:17.148954+0000","last_unstale":"2024-09-12T01:11:43.419306+0000","last_undegraded":"2024-09-12T01:11:43.419306+0000","last_fullsized":"2024-09-12T01:11:43.419306+0000","mapping_epoch":32,"log_start":"264'700","ondisk_log_start":"264'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-12T01:11:43.419108+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-12T01:11:43.419108+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.419108+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:57.967218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141519,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1386,"num_read_kb":3323,"num_write":1142,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.386244+0000","last_change":"2024-09-12T01:12:00.386123+0000","last_active":"2024-09-12T01:12:00.386244+0000","last_peered":"2024-09-12T01:12:00.386244+0000","last_clean":"2024-09-12T01:12:00.386244+0000","last_became_active":"2024-09-12T00:30:19.168965+0000","last_became_peered":"2024-09-12T00:30:19.168965+0000","last_unstale":"2024-09-12T01:12:00.386244+0000","last_undegraded":"2024-09-12T01:12:00.386244+0000","last_fullsized":"2024-09-12T01:12:00.386244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:00.386023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:00.386023+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.386023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:29.239817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'136","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.413699+0000","last_change":"2024-09-12T01:11:56.413699+0000","last_active":"2024-09-12T01:11:56.413699+0000","last_peered":"2024-09-12T01:11:56.413699+0000","last_clean":"2024-09-12T01:11:56.413699+0000","last_became_active":"2024-09-12T00:30:21.186262+0000","last_became_peered":"2024-09-12T00:30:21.186262+0000","last_unstale":"2024-09-12T01:11:56.413699+0000","last_undegraded":"2024-09-12T01:11:56.413699+0000","last_fullsized":"2024-09-12T01:11:56.413699+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-12T01:11:56.413596+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-12T01:11:56.413596+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.413596+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:03.823692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":332,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'145","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.367269+0000","last_change":"2024-09-12T01:12:07.367269+0000","last_active":"2024-09-12T01:12:07.367269+0000","last_peered":"2024-09-12T01:12:07.367269+0000","last_clean":"2024-09-12T01:12:07.367269+0000","last_became_active":"2024-09-12T00:30:21.193010+0000","last_became_peered":"2024-09-12T00:30:21.193010+0000","last_unstale":"2024-09-12T01:12:07.367269+0000","last_undegraded":"2024-09-12T01:12:07.367269+0000","last_fullsized":"2024-09-12T01:12:07.367269+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T01:12:07.367145+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T01:12:07.367145+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.367145+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:25.231816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":358,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'64","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.347768+0000","last_change":"2024-09-12T01:11:39.347695+0000","last_active":"2024-09-12T01:11:39.347768+0000","last_peered":"2024-09-12T01:11:39.347768+0000","last_clean":"2024-09-12T01:11:39.347768+0000","last_became_active":"2024-09-12T00:30:13.121613+0000","last_became_peered":"2024-09-12T00:30:13.121613+0000","last_unstale":"2024-09-12T01:11:39.347768+0000","last_undegraded":"2024-09-12T01:11:39.347768+0000","last_fullsized":"2024-09-12T01:11:39.347768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-12T01:11:39.347611+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-12T01:11:39.347611+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.347611+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:04.410478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":107,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'377","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.884160+0000","last_change":"2024-09-12T01:11:41.884100+0000","last_active":"2024-09-12T01:11:41.884160+0000","last_peered":"2024-09-12T01:11:41.884160+0000","last_clean":"2024-09-12T01:11:41.884160+0000","last_became_active":"2024-09-12T00:30:11.109653+0000","last_became_peered":"2024-09-12T00:30:11.109653+0000","last_unstale":"2024-09-12T01:11:41.884160+0000","last_undegraded":"2024-09-12T01:11:41.884160+0000","last_fullsized":"2024-09-12T01:11:41.884160+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-12T01:11:41.883946+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-12T01:11:41.883946+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.883946+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:36.450437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105416,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":703,"num_read_kb":3254,"num_write":1234,"num_write_kb":30224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.144796+0000","last_change":"2024-09-12T01:11:48.144738+0000","last_active":"2024-09-12T01:11:48.144796+0000","last_peered":"2024-09-12T01:11:48.144796+0000","last_clean":"2024-09-12T01:11:48.144796+0000","last_became_active":"2024-09-12T00:30:15.132784+0000","last_became_peered":"2024-09-12T00:30:15.132784+0000","last_unstale":"2024-09-12T01:11:48.144796+0000","last_undegraded":"2024-09-12T01:11:48.144796+0000","last_fullsized":"2024-09-12T01:11:48.144796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.144638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.144638+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.144638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:44.115258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'265","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.162819+0000","last_change":"2024-09-12T01:11:52.162751+0000","last_active":"2024-09-12T01:11:52.162819+0000","last_peered":"2024-09-12T01:11:52.162819+0000","last_clean":"2024-09-12T01:11:52.162819+0000","last_became_active":"2024-09-12T00:30:17.146483+0000","last_became_peered":"2024-09-12T00:30:17.146483+0000","last_unstale":"2024-09-12T01:11:52.162819+0000","last_undegraded":"2024-09-12T01:11:52.162819+0000","last_fullsized":"2024-09-12T01:11:52.162819+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-09-12T01:11:52.162658+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-09-12T01:11:52.162658+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.162658+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.289153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51465,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":944,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.583911+0000","last_change":"2024-09-12T01:11:51.583814+0000","last_active":"2024-09-12T01:11:51.583911+0000","last_peered":"2024-09-12T01:11:51.583911+0000","last_clean":"2024-09-12T01:11:51.583911+0000","last_became_active":"2024-09-12T00:30:19.168980+0000","last_became_peered":"2024-09-12T00:30:19.168980+0000","last_unstale":"2024-09-12T01:11:51.583911+0000","last_undegraded":"2024-09-12T01:11:51.583911+0000","last_fullsized":"2024-09-12T01:11:51.583911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.583717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.583717+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.583717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:33.975499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'109","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.681425+0000","last_change":"2024-09-12T01:11:57.681342+0000","last_active":"2024-09-12T01:11:57.681425+0000","last_peered":"2024-09-12T01:11:57.681425+0000","last_clean":"2024-09-12T01:11:57.681425+0000","last_became_active":"2024-09-12T00:30:21.187742+0000","last_became_peered":"2024-09-12T00:30:21.187742+0000","last_unstale":"2024-09-12T01:11:57.681425+0000","last_undegraded":"2024-09-12T01:11:57.681425+0000","last_fullsized":"2024-09-12T01:11:57.681425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-12T01:11:57.681228+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-12T01:11:57.681228+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.681228+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:55.746205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":243,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'264","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.224850+0000","last_change":"2024-09-12T01:11:40.224777+0000","last_active":"2024-09-12T01:11:40.224850+0000","last_peered":"2024-09-12T01:11:40.224850+0000","last_clean":"2024-09-12T01:11:40.224850+0000","last_became_active":"2024-09-12T00:30:13.131204+0000","last_became_peered":"2024-09-12T00:30:13.131204+0000","last_unstale":"2024-09-12T01:11:40.224850+0000","last_undegraded":"2024-09-12T01:11:40.224850+0000","last_fullsized":"2024-09-12T01:11:40.224850+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-12T01:11:40.224678+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-12T01:11:40.224678+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.224678+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:44.854316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":908,"num_write":395,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'365","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.378631+0000","last_change":"2024-09-12T01:11:29.378631+0000","last_active":"2024-09-12T01:11:29.378631+0000","last_peered":"2024-09-12T01:11:29.378631+0000","last_clean":"2024-09-12T01:11:29.378631+0000","last_became_active":"2024-09-12T00:30:11.104403+0000","last_became_peered":"2024-09-12T00:30:11.104403+0000","last_unstale":"2024-09-12T01:11:29.378631+0000","last_undegraded":"2024-09-12T01:11:29.378631+0000","last_fullsized":"2024-09-12T01:11:29.378631+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'365","last_scrub_stamp":"2024-09-12T01:11:29.378485+0000","last_deep_scrub":"264'365","last_deep_scrub_stamp":"2024-09-12T01:11:29.378485+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.378485+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.993161+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190266,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":58051,"num_write":1218,"num_write_kb":38205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.317414+0000","last_change":"2024-09-12T01:11:49.317361+0000","last_active":"2024-09-12T01:11:49.317414+0000","last_peered":"2024-09-12T01:11:49.317414+0000","last_clean":"2024-09-12T01:11:49.317414+0000","last_became_active":"2024-09-12T00:30:15.128366+0000","last_became_peered":"2024-09-12T00:30:15.128366+0000","last_unstale":"2024-09-12T01:11:49.317414+0000","last_undegraded":"2024-09-12T01:11:49.317414+0000","last_fullsized":"2024-09-12T01:11:49.317414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.317271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.317271+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.317271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:12.699314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'48","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.311868+0000","last_change":"2024-09-12T01:11:56.311815+0000","last_active":"2024-09-12T01:11:56.311868+0000","last_peered":"2024-09-12T01:11:56.311868+0000","last_clean":"2024-09-12T01:11:56.311868+0000","last_became_active":"2024-09-12T00:30:17.138399+0000","last_became_peered":"2024-09-12T00:30:17.138399+0000","last_unstale":"2024-09-12T01:11:56.311868+0000","last_undegraded":"2024-09-12T01:11:56.311868+0000","last_fullsized":"2024-09-12T01:11:56.311868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-12T01:11:56.311717+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-12T01:11:56.311717+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.311717+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:01.521119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":31,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.346322+0000","last_change":"2024-09-12T01:11:53.346265+0000","last_active":"2024-09-12T01:11:53.346322+0000","last_peered":"2024-09-12T01:11:53.346322+0000","last_clean":"2024-09-12T01:11:53.346322+0000","last_became_active":"2024-09-12T00:30:19.167213+0000","last_became_peered":"2024-09-12T00:30:19.167213+0000","last_unstale":"2024-09-12T01:11:53.346322+0000","last_undegraded":"2024-09-12T01:11:53.346322+0000","last_fullsized":"2024-09-12T01:11:53.346322+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.346201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.346201+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.346201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:08.482365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'203","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.215808+0000","last_change":"2024-09-12T01:12:00.215718+0000","last_active":"2024-09-12T01:12:00.215808+0000","last_peered":"2024-09-12T01:12:00.215808+0000","last_clean":"2024-09-12T01:12:00.215808+0000","last_became_active":"2024-09-12T00:30:21.185636+0000","last_became_peered":"2024-09-12T00:30:21.185636+0000","last_unstale":"2024-09-12T01:12:00.215808+0000","last_undegraded":"2024-09-12T01:12:00.215808+0000","last_fullsized":"2024-09-12T01:12:00.215808+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-12T01:12:00.215608+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-12T01:12:00.215608+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.215608+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:45.482051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":305,"num_read_kb":299,"num_write":483,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'101","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.369684+0000","last_change":"2024-09-12T01:11:47.369628+0000","last_active":"2024-09-12T01:11:47.369684+0000","last_peered":"2024-09-12T01:11:47.369684+0000","last_clean":"2024-09-12T01:11:47.369684+0000","last_became_active":"2024-09-12T00:30:13.124163+0000","last_became_peered":"2024-09-12T00:30:13.124163+0000","last_unstale":"2024-09-12T01:11:47.369684+0000","last_undegraded":"2024-09-12T01:11:47.369684+0000","last_fullsized":"2024-09-12T01:11:47.369684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'101","last_scrub_stamp":"2024-09-12T01:11:47.369535+0000","last_deep_scrub":"264'101","last_deep_scrub_stamp":"2024-09-12T01:11:47.369535+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.369535+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:17.905362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":460,"num_read_kb":380,"num_write":155,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'347","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.398998+0000","last_change":"2024-09-12T01:11:32.398998+0000","last_active":"2024-09-12T01:11:32.398998+0000","last_peered":"2024-09-12T01:11:32.398998+0000","last_clean":"2024-09-12T01:11:32.398998+0000","last_became_active":"2024-09-12T00:30:11.110736+0000","last_became_peered":"2024-09-12T00:30:11.110736+0000","last_unstale":"2024-09-12T01:11:32.398998+0000","last_undegraded":"2024-09-12T01:11:32.398998+0000","last_fullsized":"2024-09-12T01:11:32.398998+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:32.398902+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:32.398902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.398902+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:00.088675+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380458,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":820,"num_read_kb":34556,"num_write":1163,"num_write_kb":41998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.333979+0000","last_change":"2024-09-12T01:11:44.333925+0000","last_active":"2024-09-12T01:11:44.333979+0000","last_peered":"2024-09-12T01:11:44.333979+0000","last_clean":"2024-09-12T01:11:44.333979+0000","last_became_active":"2024-09-12T00:30:15.121068+0000","last_became_peered":"2024-09-12T00:30:15.121068+0000","last_unstale":"2024-09-12T01:11:44.333979+0000","last_undegraded":"2024-09-12T01:11:44.333979+0000","last_fullsized":"2024-09-12T01:11:44.333979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.333836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.333836+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.333836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:08.954732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'318","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.543231+0000","last_change":"2024-09-12T01:11:48.543166+0000","last_active":"2024-09-12T01:11:48.543231+0000","last_peered":"2024-09-12T01:11:48.543231+0000","last_clean":"2024-09-12T01:11:48.543231+0000","last_became_active":"2024-09-12T00:30:17.147946+0000","last_became_peered":"2024-09-12T00:30:17.147946+0000","last_unstale":"2024-09-12T01:11:48.543231+0000","last_undegraded":"2024-09-12T01:11:48.543231+0000","last_fullsized":"2024-09-12T01:11:48.543231+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-12T01:11:48.543075+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-12T01:11:48.543075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.543075+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:23.858040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42943,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":1151,"num_write":414,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.778033+0000","last_change":"2024-09-12T01:11:50.777973+0000","last_active":"2024-09-12T01:11:50.778033+0000","last_peered":"2024-09-12T01:11:50.778033+0000","last_clean":"2024-09-12T01:11:50.778033+0000","last_became_active":"2024-09-12T00:30:19.167407+0000","last_became_peered":"2024-09-12T00:30:19.167407+0000","last_unstale":"2024-09-12T01:11:50.778033+0000","last_undegraded":"2024-09-12T01:11:50.778033+0000","last_fullsized":"2024-09-12T01:11:50.778033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:50.777878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:50.777878+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.777878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:52.228704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'122","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.994320+0000","last_change":"2024-09-12T01:12:16.994259+0000","last_active":"2024-09-12T01:12:16.994320+0000","last_peered":"2024-09-12T01:12:16.994320+0000","last_clean":"2024-09-12T01:12:16.994320+0000","last_became_active":"2024-09-12T00:30:21.188801+0000","last_became_peered":"2024-09-12T00:30:21.188801+0000","last_unstale":"2024-09-12T01:12:16.994320+0000","last_undegraded":"2024-09-12T01:12:16.994320+0000","last_fullsized":"2024-09-12T01:12:16.994320+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-09-12T01:12:16.994177+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-09-12T01:12:16.994177+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.994177+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:42.811797+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":174,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'271","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.567174+0000","last_change":"2024-09-12T01:11:38.567103+0000","last_active":"2024-09-12T01:11:38.567174+0000","last_peered":"2024-09-12T01:11:38.567174+0000","last_clean":"2024-09-12T01:11:38.567174+0000","last_became_active":"2024-09-12T00:30:13.121687+0000","last_became_peered":"2024-09-12T00:30:13.121687+0000","last_unstale":"2024-09-12T01:11:38.567174+0000","last_undegraded":"2024-09-12T01:11:38.567174+0000","last_fullsized":"2024-09-12T01:11:38.567174+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-12T01:11:38.566980+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-12T01:11:38.566980+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.566980+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:30.059821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1180,"num_read_kb":936,"num_write":465,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'332","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.265680+0000","last_change":"2024-09-12T01:11:33.265680+0000","last_active":"2024-09-12T01:11:33.265680+0000","last_peered":"2024-09-12T01:11:33.265680+0000","last_clean":"2024-09-12T01:11:33.265680+0000","last_became_active":"2024-09-12T00:30:11.097863+0000","last_became_peered":"2024-09-12T00:30:11.097863+0000","last_unstale":"2024-09-12T01:11:33.265680+0000","last_undegraded":"2024-09-12T01:11:33.265680+0000","last_fullsized":"2024-09-12T01:11:33.265680+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-12T01:11:33.265543+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-12T01:11:33.265543+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.265543+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:12.068841+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4714622,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":74376,"num_write":1103,"num_write_kb":34671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.848214+0000","last_change":"2024-09-12T01:11:59.848163+0000","last_active":"2024-09-12T01:11:59.848214+0000","last_peered":"2024-09-12T01:11:59.848214+0000","last_clean":"2024-09-12T01:11:59.848214+0000","last_became_active":"2024-09-12T00:30:15.125505+0000","last_became_peered":"2024-09-12T00:30:15.125505+0000","last_unstale":"2024-09-12T01:11:59.848214+0000","last_undegraded":"2024-09-12T01:11:59.848214+0000","last_fullsized":"2024-09-12T01:11:59.848214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:59.848070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:59.848070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.848070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:45.445978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'281","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.298281+0000","last_change":"2024-09-12T01:11:52.298221+0000","last_active":"2024-09-12T01:11:52.298281+0000","last_peered":"2024-09-12T01:11:52.298281+0000","last_clean":"2024-09-12T01:11:52.298281+0000","last_became_active":"2024-09-12T00:30:17.146112+0000","last_became_peered":"2024-09-12T00:30:17.146112+0000","last_unstale":"2024-09-12T01:11:52.298281+0000","last_undegraded":"2024-09-12T01:11:52.298281+0000","last_fullsized":"2024-09-12T01:11:52.298281+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'281","last_scrub_stamp":"2024-09-12T01:11:52.298124+0000","last_deep_scrub":"264'281","last_deep_scrub_stamp":"2024-09-12T01:11:52.298124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.298124+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:45.416273+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56907,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":1155,"num_write":390,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.623624+0000","last_change":"2024-09-12T01:11:52.623510+0000","last_active":"2024-09-12T01:11:52.623624+0000","last_peered":"2024-09-12T01:11:52.623624+0000","last_clean":"2024-09-12T01:11:52.623624+0000","last_became_active":"2024-09-12T00:30:19.164820+0000","last_became_peered":"2024-09-12T00:30:19.164820+0000","last_unstale":"2024-09-12T01:11:52.623624+0000","last_undegraded":"2024-09-12T01:11:52.623624+0000","last_fullsized":"2024-09-12T01:11:52.623624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.623414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.623414+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.623414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:15.344847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'177","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.799130+0000","last_change":"2024-09-12T01:11:52.799021+0000","last_active":"2024-09-12T01:11:52.799130+0000","last_peered":"2024-09-12T01:11:52.799130+0000","last_clean":"2024-09-12T01:11:52.799130+0000","last_became_active":"2024-09-12T00:30:13.124584+0000","last_became_peered":"2024-09-12T00:30:13.124584+0000","last_unstale":"2024-09-12T01:11:52.799130+0000","last_undegraded":"2024-09-12T01:11:52.799130+0000","last_fullsized":"2024-09-12T01:11:52.799130+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-12T01:11:52.798926+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-12T01:11:52.798926+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.798926+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:57.986585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":813,"num_read_kb":670,"num_write":272,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'359","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.309657+0000","last_change":"2024-09-12T01:11:36.309657+0000","last_active":"2024-09-12T01:11:36.309657+0000","last_peered":"2024-09-12T01:11:36.309657+0000","last_clean":"2024-09-12T01:11:36.309657+0000","last_became_active":"2024-09-12T00:30:11.097890+0000","last_became_peered":"2024-09-12T00:30:11.097890+0000","last_unstale":"2024-09-12T01:11:36.309657+0000","last_undegraded":"2024-09-12T01:11:36.309657+0000","last_fullsized":"2024-09-12T01:11:36.309657+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-12T01:11:36.309476+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-12T01:11:36.309476+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.309476+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:38.549094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":38574,"num_write":1151,"num_write_kb":31383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"264'6","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.176992+0000","last_change":"2024-09-12T01:11:49.176935+0000","last_active":"2024-09-12T01:11:49.176992+0000","last_peered":"2024-09-12T01:11:49.176992+0000","last_clean":"2024-09-12T01:11:49.176992+0000","last_became_active":"2024-09-12T00:30:15.122172+0000","last_became_peered":"2024-09-12T00:30:15.122172+0000","last_unstale":"2024-09-12T01:11:49.176992+0000","last_undegraded":"2024-09-12T01:11:49.176992+0000","last_fullsized":"2024-09-12T01:11:49.176992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T01:11:49.176853+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T01:11:49.176853+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.176853+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:08.193883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'518","reported_seq":1152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.213335+0000","last_change":"2024-09-12T01:11:53.213229+0000","last_active":"2024-09-12T01:11:53.213335+0000","last_peered":"2024-09-12T01:11:53.213335+0000","last_clean":"2024-09-12T01:11:53.213335+0000","last_became_active":"2024-09-12T00:30:17.145882+0000","last_became_peered":"2024-09-12T00:30:17.145882+0000","last_unstale":"2024-09-12T01:11:53.213335+0000","last_undegraded":"2024-09-12T01:11:53.213335+0000","last_fullsized":"2024-09-12T01:11:53.213335+0000","mapping_epoch":32,"log_start":"264'500","ondisk_log_start":"264'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'518","last_scrub_stamp":"2024-09-12T01:11:53.213086+0000","last_deep_scrub":"264'518","last_deep_scrub_stamp":"2024-09-12T01:11:53.213086+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.213086+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:22.122443+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96845,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":949,"num_read_kb":2301,"num_write":828,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26648,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.367150+0000","last_change":"2024-09-12T01:11:52.367040+0000","last_active":"2024-09-12T01:11:52.367150+0000","last_peered":"2024-09-12T01:11:52.367150+0000","last_clean":"2024-09-12T01:11:52.367150+0000","last_became_active":"2024-09-12T00:30:19.170776+0000","last_became_peered":"2024-09-12T00:30:19.170776+0000","last_unstale":"2024-09-12T01:11:52.367150+0000","last_undegraded":"2024-09-12T01:11:52.367150+0000","last_fullsized":"2024-09-12T01:11:52.367150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.366946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.366946+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.366946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:36.669146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'145","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.514193+0000","last_change":"2024-09-12T01:12:08.514136+0000","last_active":"2024-09-12T01:12:08.514193+0000","last_peered":"2024-09-12T01:12:08.514193+0000","last_clean":"2024-09-12T01:12:08.514193+0000","last_became_active":"2024-09-12T00:30:21.188376+0000","last_became_peered":"2024-09-12T00:30:21.188376+0000","last_unstale":"2024-09-12T01:12:08.514193+0000","last_undegraded":"2024-09-12T01:12:08.514193+0000","last_fullsized":"2024-09-12T01:12:08.514193+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-12T01:12:08.514040+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-12T01:12:08.514040+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.514040+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:23.264771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":168,"num_write":312,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'188","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.280091+0000","last_change":"2024-09-12T01:11:42.280000+0000","last_active":"2024-09-12T01:11:42.280091+0000","last_peered":"2024-09-12T01:11:42.280091+0000","last_clean":"2024-09-12T01:11:42.280091+0000","last_became_active":"2024-09-12T00:30:13.118251+0000","last_became_peered":"2024-09-12T00:30:13.118251+0000","last_unstale":"2024-09-12T01:11:42.280091+0000","last_undegraded":"2024-09-12T01:11:42.280091+0000","last_fullsized":"2024-09-12T01:11:42.280091+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-09-12T01:11:42.279891+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-09-12T01:11:42.279891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.279891+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:04.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":709,"num_write":308,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'375","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.312581+0000","last_change":"2024-09-12T01:11:36.312581+0000","last_active":"2024-09-12T01:11:36.312581+0000","last_peered":"2024-09-12T01:11:36.312581+0000","last_clean":"2024-09-12T01:11:36.312581+0000","last_became_active":"2024-09-12T00:30:11.102929+0000","last_became_peered":"2024-09-12T00:30:11.102929+0000","last_unstale":"2024-09-12T01:11:36.312581+0000","last_undegraded":"2024-09-12T01:11:36.312581+0000","last_fullsized":"2024-09-12T01:11:36.312581+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:36.312446+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:36.312446+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.312446+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:28.083174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":62693,"num_write":1091,"num_write_kb":37872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.271695+0000","last_change":"2024-09-12T01:11:47.271635+0000","last_active":"2024-09-12T01:11:47.271695+0000","last_peered":"2024-09-12T01:11:47.271695+0000","last_clean":"2024-09-12T01:11:47.271695+0000","last_became_active":"2024-09-12T00:30:15.127268+0000","last_became_peered":"2024-09-12T00:30:15.127268+0000","last_unstale":"2024-09-12T01:11:47.271695+0000","last_undegraded":"2024-09-12T01:11:47.271695+0000","last_fullsized":"2024-09-12T01:11:47.271695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.271530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.271530+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.271530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.919338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'314","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.020997+0000","last_change":"2024-09-12T01:12:07.020906+0000","last_active":"2024-09-12T01:12:07.020997+0000","last_peered":"2024-09-12T01:12:07.020997+0000","last_clean":"2024-09-12T01:12:07.020997+0000","last_became_active":"2024-09-12T00:30:17.145504+0000","last_became_peered":"2024-09-12T00:30:17.145504+0000","last_unstale":"2024-09-12T01:12:07.020997+0000","last_undegraded":"2024-09-12T01:12:07.020997+0000","last_fullsized":"2024-09-12T01:12:07.020997+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-12T01:12:07.020794+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-12T01:12:07.020794+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.020794+0000","objects_scrubbed":8,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:30.811955+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49877,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1192,"num_write":444,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.468493+0000","last_change":"2024-09-12T01:12:02.468435+0000","last_active":"2024-09-12T01:12:02.468493+0000","last_peered":"2024-09-12T01:12:02.468493+0000","last_clean":"2024-09-12T01:12:02.468493+0000","last_became_active":"2024-09-12T00:30:19.169558+0000","last_became_peered":"2024-09-12T00:30:19.169558+0000","last_unstale":"2024-09-12T01:12:02.468493+0000","last_undegraded":"2024-09-12T01:12:02.468493+0000","last_fullsized":"2024-09-12T01:12:02.468493+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:02.468352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:02.468352+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.468352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:10.180957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'182","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:18.022017+0000","last_change":"2024-09-12T01:12:18.021959+0000","last_active":"2024-09-12T01:12:18.022017+0000","last_peered":"2024-09-12T01:12:18.022017+0000","last_clean":"2024-09-12T01:12:18.022017+0000","last_became_active":"2024-09-12T00:30:21.188350+0000","last_became_peered":"2024-09-12T00:30:21.188350+0000","last_unstale":"2024-09-12T01:12:18.022017+0000","last_undegraded":"2024-09-12T01:12:18.022017+0000","last_fullsized":"2024-09-12T01:12:18.022017+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-12T01:12:18.021858+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-12T01:12:18.021858+0000","last_clean_scrub_stamp":"2024-09-12T01:12:18.021858+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:30.977052+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2246,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":214,"num_write":509,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'191","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.526283+0000","last_change":"2024-09-12T01:11:39.526183+0000","last_active":"2024-09-12T01:11:39.526283+0000","last_peered":"2024-09-12T01:11:39.526283+0000","last_clean":"2024-09-12T01:11:39.526283+0000","last_became_active":"2024-09-12T00:30:13.127294+0000","last_became_peered":"2024-09-12T00:30:13.127294+0000","last_unstale":"2024-09-12T01:11:39.526283+0000","last_undegraded":"2024-09-12T01:11:39.526283+0000","last_fullsized":"2024-09-12T01:11:39.526283+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'191","last_scrub_stamp":"2024-09-12T01:11:39.526081+0000","last_deep_scrub":"264'191","last_deep_scrub_stamp":"2024-09-12T01:11:39.526081+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.526081+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.075674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":881,"num_read_kb":750,"num_write":313,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'341","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.807200+0000","last_change":"2024-09-12T01:11:32.807113+0000","last_active":"2024-09-12T01:11:32.807200+0000","last_peered":"2024-09-12T01:11:32.807200+0000","last_clean":"2024-09-12T01:11:32.807200+0000","last_became_active":"2024-09-12T00:30:11.091027+0000","last_became_peered":"2024-09-12T00:30:11.091027+0000","last_unstale":"2024-09-12T01:11:32.807200+0000","last_undegraded":"2024-09-12T01:11:32.807200+0000","last_fullsized":"2024-09-12T01:11:32.807200+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'341","last_scrub_stamp":"2024-09-12T01:11:32.806954+0000","last_deep_scrub":"264'341","last_deep_scrub_stamp":"2024-09-12T01:11:32.806954+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.806954+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:48.132495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4477982,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":8604,"num_write":1162,"num_write_kb":27793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.318209+0000","last_change":"2024-09-12T01:11:49.318124+0000","last_active":"2024-09-12T01:11:49.318209+0000","last_peered":"2024-09-12T01:11:49.318209+0000","last_clean":"2024-09-12T01:11:49.318209+0000","last_became_active":"2024-09-12T00:30:15.126254+0000","last_became_peered":"2024-09-12T00:30:15.126254+0000","last_unstale":"2024-09-12T01:11:49.318209+0000","last_undegraded":"2024-09-12T01:11:49.318209+0000","last_fullsized":"2024-09-12T01:11:49.318209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.318016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.318016+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.318016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:56.146698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'290","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.182145+0000","last_change":"2024-09-12T01:11:56.182081+0000","last_active":"2024-09-12T01:11:56.182145+0000","last_peered":"2024-09-12T01:11:56.182145+0000","last_clean":"2024-09-12T01:11:56.182145+0000","last_became_active":"2024-09-12T00:30:17.146106+0000","last_became_peered":"2024-09-12T00:30:17.146106+0000","last_unstale":"2024-09-12T01:11:56.182145+0000","last_undegraded":"2024-09-12T01:11:56.182145+0000","last_fullsized":"2024-09-12T01:11:56.182145+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'290","last_scrub_stamp":"2024-09-12T01:11:56.181993+0000","last_deep_scrub":"264'290","last_deep_scrub_stamp":"2024-09-12T01:11:56.181993+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.181993+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:08.113456+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50306,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1084,"num_write":388,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.626932+0000","last_change":"2024-09-12T01:11:53.626813+0000","last_active":"2024-09-12T01:11:53.626932+0000","last_peered":"2024-09-12T01:11:53.626932+0000","last_clean":"2024-09-12T01:11:53.626932+0000","last_became_active":"2024-09-12T00:30:19.167119+0000","last_became_peered":"2024-09-12T00:30:19.167119+0000","last_unstale":"2024-09-12T01:11:53.626932+0000","last_undegraded":"2024-09-12T01:11:53.626932+0000","last_fullsized":"2024-09-12T01:11:53.626932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.626713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.626713+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.626713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:07.308732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'100","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:14.995499+0000","last_change":"2024-09-12T01:12:14.995438+0000","last_active":"2024-09-12T01:12:14.995499+0000","last_peered":"2024-09-12T01:12:14.995499+0000","last_clean":"2024-09-12T01:12:14.995499+0000","last_became_active":"2024-09-12T00:30:21.190937+0000","last_became_peered":"2024-09-12T00:30:21.190937+0000","last_unstale":"2024-09-12T01:12:14.995499+0000","last_undegraded":"2024-09-12T01:12:14.995499+0000","last_fullsized":"2024-09-12T01:12:14.995499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-12T01:12:14.995348+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-12T01:12:14.995348+0000","last_clean_scrub_stamp":"2024-09-12T01:12:14.995348+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:29.396160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":102,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'208","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.235635+0000","last_change":"2024-09-12T01:11:41.235533+0000","last_active":"2024-09-12T01:11:41.235635+0000","last_peered":"2024-09-12T01:11:41.235635+0000","last_clean":"2024-09-12T01:11:41.235635+0000","last_became_active":"2024-09-12T00:30:13.119843+0000","last_became_peered":"2024-09-12T00:30:13.119843+0000","last_unstale":"2024-09-12T01:11:41.235635+0000","last_undegraded":"2024-09-12T01:11:41.235635+0000","last_fullsized":"2024-09-12T01:11:41.235635+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'208","last_scrub_stamp":"2024-09-12T01:11:41.235444+0000","last_deep_scrub":"264'208","last_deep_scrub_stamp":"2024-09-12T01:11:41.235444+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.235444+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:10.729092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":901,"num_read_kb":747,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'375","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.260086+0000","last_change":"2024-09-12T01:11:39.260021+0000","last_active":"2024-09-12T01:11:39.260086+0000","last_peered":"2024-09-12T01:11:39.260086+0000","last_clean":"2024-09-12T01:11:39.260086+0000","last_became_active":"2024-09-12T00:30:11.100750+0000","last_became_peered":"2024-09-12T00:30:11.100750+0000","last_unstale":"2024-09-12T01:11:39.260086+0000","last_undegraded":"2024-09-12T01:11:39.260086+0000","last_fullsized":"2024-09-12T01:11:39.260086+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-12T01:11:39.259889+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-12T01:11:39.259889+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.259889+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:23.779675+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1340812,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":582,"num_read_kb":31919,"num_write":1306,"num_write_kb":26213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.306484+0000","last_change":"2024-09-12T01:11:54.306420+0000","last_active":"2024-09-12T01:11:54.306484+0000","last_peered":"2024-09-12T01:11:54.306484+0000","last_clean":"2024-09-12T01:11:54.306484+0000","last_became_active":"2024-09-12T00:30:15.127444+0000","last_became_peered":"2024-09-12T00:30:15.127444+0000","last_unstale":"2024-09-12T01:11:54.306484+0000","last_undegraded":"2024-09-12T01:11:54.306484+0000","last_fullsized":"2024-09-12T01:11:54.306484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.306326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.306326+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.306326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:36.609522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'91","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.037844+0000","last_change":"2024-09-12T01:12:08.037782+0000","last_active":"2024-09-12T01:12:08.037844+0000","last_peered":"2024-09-12T01:12:08.037844+0000","last_clean":"2024-09-12T01:12:08.037844+0000","last_became_active":"2024-09-12T00:30:17.144283+0000","last_became_peered":"2024-09-12T00:30:17.144283+0000","last_unstale":"2024-09-12T01:12:08.037844+0000","last_undegraded":"2024-09-12T01:12:08.037844+0000","last_fullsized":"2024-09-12T01:12:08.037844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'91","last_scrub_stamp":"2024-09-12T01:12:08.037667+0000","last_deep_scrub":"264'91","last_deep_scrub_stamp":"2024-09-12T01:12:08.037667+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.037667+0000","objects_scrubbed":7,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:49.830373+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":89,"num_read_kb":83,"num_write":66,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'770","reported_seq":2407,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.338723+0000","last_change":"2024-09-12T01:11:53.338662+0000","last_active":"2024-09-12T01:11:53.338723+0000","last_peered":"2024-09-12T01:11:53.338723+0000","last_clean":"2024-09-12T01:11:53.338723+0000","last_became_active":"2024-09-12T00:30:19.166851+0000","last_became_peered":"2024-09-12T00:30:19.166851+0000","last_unstale":"2024-09-12T01:11:53.338723+0000","last_undegraded":"2024-09-12T01:11:53.338723+0000","last_fullsized":"2024-09-12T01:11:53.338723+0000","mapping_epoch":34,"log_start":"264'700","ondisk_log_start":"264'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'770","last_scrub_stamp":"2024-09-12T01:11:53.338595+0000","last_deep_scrub":"264'770","last_deep_scrub_stamp":"2024-09-12T01:11:53.338595+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.338595+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:50.559711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'132","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:12.012251+0000","last_change":"2024-09-12T01:12:12.012179+0000","last_active":"2024-09-12T01:12:12.012251+0000","last_peered":"2024-09-12T01:12:12.012251+0000","last_clean":"2024-09-12T01:12:12.012251+0000","last_became_active":"2024-09-12T00:30:21.190151+0000","last_became_peered":"2024-09-12T00:30:21.190151+0000","last_unstale":"2024-09-12T01:12:12.012251+0000","last_undegraded":"2024-09-12T01:12:12.012251+0000","last_fullsized":"2024-09-12T01:12:12.012251+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T01:12:12.012086+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T01:12:12.012086+0000","last_clean_scrub_stamp":"2024-09-12T01:12:12.012086+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:35.515669+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":157,"num_write":325,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'111","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.353957+0000","last_change":"2024-09-12T01:11:43.353880+0000","last_active":"2024-09-12T01:11:43.353957+0000","last_peered":"2024-09-12T01:11:43.353957+0000","last_clean":"2024-09-12T01:11:43.353957+0000","last_became_active":"2024-09-12T00:30:13.124167+0000","last_became_peered":"2024-09-12T00:30:13.124167+0000","last_unstale":"2024-09-12T01:11:43.353957+0000","last_undegraded":"2024-09-12T01:11:43.353957+0000","last_fullsized":"2024-09-12T01:11:43.353957+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-12T01:11:43.353764+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-12T01:11:43.353764+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.353764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:12.072323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":425,"num_write":152,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'457","reported_seq":1162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.807713+0000","last_change":"2024-09-12T01:11:33.807625+0000","last_active":"2024-09-12T01:11:33.807713+0000","last_peered":"2024-09-12T01:11:33.807713+0000","last_clean":"2024-09-12T01:11:33.807713+0000","last_became_active":"2024-09-12T00:30:11.108422+0000","last_became_peered":"2024-09-12T00:30:11.108422+0000","last_unstale":"2024-09-12T01:11:33.807713+0000","last_undegraded":"2024-09-12T01:11:33.807713+0000","last_fullsized":"2024-09-12T01:11:33.807713+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'457","last_scrub_stamp":"2024-09-12T01:11:33.807436+0000","last_deep_scrub":"264'457","last_deep_scrub_stamp":"2024-09-12T01:11:33.807436+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.807436+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:14.406328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314887,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":867,"num_read_kb":2765,"num_write":1329,"num_write_kb":29562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.823366+0000","last_change":"2024-09-12T01:11:45.823293+0000","last_active":"2024-09-12T01:11:45.823366+0000","last_peered":"2024-09-12T01:11:45.823366+0000","last_clean":"2024-09-12T01:11:45.823366+0000","last_became_active":"2024-09-12T00:30:15.124922+0000","last_became_peered":"2024-09-12T00:30:15.124922+0000","last_unstale":"2024-09-12T01:11:45.823366+0000","last_undegraded":"2024-09-12T01:11:45.823366+0000","last_fullsized":"2024-09-12T01:11:45.823366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.823172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.823172+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.823172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:20.010059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'360","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.339930+0000","last_change":"2024-09-12T01:11:50.339930+0000","last_active":"2024-09-12T01:11:50.339930+0000","last_peered":"2024-09-12T01:11:50.339930+0000","last_clean":"2024-09-12T01:11:50.339930+0000","last_became_active":"2024-09-12T00:30:17.148793+0000","last_became_peered":"2024-09-12T00:30:17.148793+0000","last_unstale":"2024-09-12T01:11:50.339930+0000","last_undegraded":"2024-09-12T01:11:50.339930+0000","last_fullsized":"2024-09-12T01:11:50.339930+0000","mapping_epoch":32,"log_start":"264'300","ondisk_log_start":"264'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-12T01:11:50.339839+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-12T01:11:50.339839+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.339839+0000","objects_scrubbed":11,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.251001+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62476,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1247,"num_write":454,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.346416+0000","last_change":"2024-09-12T01:12:03.346416+0000","last_active":"2024-09-12T01:12:03.346416+0000","last_peered":"2024-09-12T01:12:03.346416+0000","last_clean":"2024-09-12T01:12:03.346416+0000","last_became_active":"2024-09-12T00:30:19.169982+0000","last_became_peered":"2024-09-12T00:30:19.169982+0000","last_unstale":"2024-09-12T01:12:03.346416+0000","last_undegraded":"2024-09-12T01:12:03.346416+0000","last_fullsized":"2024-09-12T01:12:03.346416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.346310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.346310+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.346310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:19.074502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'147","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.736398+0000","last_change":"2024-09-12T01:11:58.736398+0000","last_active":"2024-09-12T01:11:58.736398+0000","last_peered":"2024-09-12T01:11:58.736398+0000","last_clean":"2024-09-12T01:11:58.736398+0000","last_became_active":"2024-09-12T00:30:21.187641+0000","last_became_peered":"2024-09-12T00:30:21.187641+0000","last_unstale":"2024-09-12T01:11:58.736398+0000","last_undegraded":"2024-09-12T01:11:58.736398+0000","last_fullsized":"2024-09-12T01:11:58.736398+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T01:11:58.736290+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T01:11:58.736290+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.736290+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:18.096544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":136,"num_write":322,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'195","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.316959+0000","last_change":"2024-09-12T01:11:42.316905+0000","last_active":"2024-09-12T01:11:42.316959+0000","last_peered":"2024-09-12T01:11:42.316959+0000","last_clean":"2024-09-12T01:11:42.316959+0000","last_became_active":"2024-09-12T00:30:13.122622+0000","last_became_peered":"2024-09-12T00:30:13.122622+0000","last_unstale":"2024-09-12T01:11:42.316959+0000","last_undegraded":"2024-09-12T01:11:42.316959+0000","last_fullsized":"2024-09-12T01:11:42.316959+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'195","last_scrub_stamp":"2024-09-12T01:11:42.316822+0000","last_deep_scrub":"264'195","last_deep_scrub_stamp":"2024-09-12T01:11:42.316822+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.316822+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:34.809995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":295,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'335","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.919719+0000","last_change":"2024-09-12T01:11:39.919664+0000","last_active":"2024-09-12T01:11:39.919719+0000","last_peered":"2024-09-12T01:11:39.919719+0000","last_clean":"2024-09-12T01:11:39.919719+0000","last_became_active":"2024-09-12T00:30:11.109855+0000","last_became_peered":"2024-09-12T00:30:11.109855+0000","last_unstale":"2024-09-12T01:11:39.919719+0000","last_undegraded":"2024-09-12T01:11:39.919719+0000","last_fullsized":"2024-09-12T01:11:39.919719+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T01:11:39.919561+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T01:11:39.919561+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.919561+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:13.840279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314923,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":608,"num_read_kb":64470,"num_write":1037,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.317043+0000","last_change":"2024-09-12T01:11:46.316987+0000","last_active":"2024-09-12T01:11:46.317043+0000","last_peered":"2024-09-12T01:11:46.317043+0000","last_clean":"2024-09-12T01:11:46.317043+0000","last_became_active":"2024-09-12T00:30:15.125870+0000","last_became_peered":"2024-09-12T00:30:15.125870+0000","last_unstale":"2024-09-12T01:11:46.317043+0000","last_undegraded":"2024-09-12T01:11:46.317043+0000","last_fullsized":"2024-09-12T01:11:46.317043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.316891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.316891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.316891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:19.260779+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'282","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.375619+0000","last_change":"2024-09-12T01:12:01.375619+0000","last_active":"2024-09-12T01:12:01.375619+0000","last_peered":"2024-09-12T01:12:01.375619+0000","last_clean":"2024-09-12T01:12:01.375619+0000","last_became_active":"2024-09-12T00:30:17.149226+0000","last_became_peered":"2024-09-12T00:30:17.149226+0000","last_unstale":"2024-09-12T01:12:01.375619+0000","last_undegraded":"2024-09-12T01:12:01.375619+0000","last_fullsized":"2024-09-12T01:12:01.375619+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'282","last_scrub_stamp":"2024-09-12T01:12:01.375500+0000","last_deep_scrub":"264'282","last_deep_scrub_stamp":"2024-09-12T01:12:01.375500+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.375500+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:24.160627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41099,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":1045,"num_write":368,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:13.002733+0000","last_change":"2024-09-12T01:12:13.002733+0000","last_active":"2024-09-12T01:12:13.002733+0000","last_peered":"2024-09-12T01:12:13.002733+0000","last_clean":"2024-09-12T01:12:13.002733+0000","last_became_active":"2024-09-12T00:30:19.164556+0000","last_became_peered":"2024-09-12T00:30:19.164556+0000","last_unstale":"2024-09-12T01:12:13.002733+0000","last_undegraded":"2024-09-12T01:12:13.002733+0000","last_fullsized":"2024-09-12T01:12:13.002733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:13.002632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:13.002632+0000","last_clean_scrub_stamp":"2024-09-12T01:12:13.002632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:06.601789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'137","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.485908+0000","last_change":"2024-09-12T01:12:09.485908+0000","last_active":"2024-09-12T01:12:09.485908+0000","last_peered":"2024-09-12T01:12:09.485908+0000","last_clean":"2024-09-12T01:12:09.485908+0000","last_became_active":"2024-09-12T00:30:21.193606+0000","last_became_peered":"2024-09-12T00:30:21.193606+0000","last_unstale":"2024-09-12T01:12:09.485908+0000","last_undegraded":"2024-09-12T01:12:09.485908+0000","last_fullsized":"2024-09-12T01:12:09.485908+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-12T01:12:09.485822+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-12T01:12:09.485822+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.485822+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:47.741605+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":946,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":266,"num_read_kb":239,"num_write":347,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'4096","reported_seq":4679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.542179+0000","last_change":"2024-09-12T01:11:37.542179+0000","last_active":"2024-09-12T01:11:37.542179+0000","last_peered":"2024-09-12T01:11:37.542179+0000","last_clean":"2024-09-12T01:11:37.542179+0000","last_became_active":"2024-09-12T00:30:13.120940+0000","last_became_peered":"2024-09-12T00:30:13.120940+0000","last_unstale":"2024-09-12T01:11:37.542179+0000","last_undegraded":"2024-09-12T01:11:37.542179+0000","last_fullsized":"2024-09-12T01:11:37.542179+0000","mapping_epoch":28,"log_start":"264'4000","ondisk_log_start":"264'4000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4096","last_scrub_stamp":"2024-09-12T01:11:37.542072+0000","last_deep_scrub":"264'4096","last_deep_scrub_stamp":"2024-09-12T01:11:37.542072+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.542072+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:02.815247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16459,"num_read_kb":13812,"num_write":6134,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'369","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.291365+0000","last_change":"2024-09-12T01:11:35.291283+0000","last_active":"2024-09-12T01:11:35.291365+0000","last_peered":"2024-09-12T01:11:35.291365+0000","last_clean":"2024-09-12T01:11:35.291365+0000","last_became_active":"2024-09-12T00:30:11.098879+0000","last_became_peered":"2024-09-12T00:30:11.098879+0000","last_unstale":"2024-09-12T01:11:35.291365+0000","last_undegraded":"2024-09-12T01:11:35.291365+0000","last_fullsized":"2024-09-12T01:11:35.291365+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T01:11:35.291178+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T01:11:35.291178+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.291178+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.339007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4317103,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":44113,"num_write":1057,"num_write_kb":43739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.735465+0000","last_change":"2024-09-12T01:11:52.735465+0000","last_active":"2024-09-12T01:11:52.735465+0000","last_peered":"2024-09-12T01:11:52.735465+0000","last_clean":"2024-09-12T01:11:52.735465+0000","last_became_active":"2024-09-12T00:30:15.125452+0000","last_became_peered":"2024-09-12T00:30:15.125452+0000","last_unstale":"2024-09-12T01:11:52.735465+0000","last_undegraded":"2024-09-12T01:11:52.735465+0000","last_fullsized":"2024-09-12T01:11:52.735465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:52.735325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:52.735325+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.735325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:19.511992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'236","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.224672+0000","last_change":"2024-09-12T01:11:54.224588+0000","last_active":"2024-09-12T01:11:54.224672+0000","last_peered":"2024-09-12T01:11:54.224672+0000","last_clean":"2024-09-12T01:11:54.224672+0000","last_became_active":"2024-09-12T00:30:17.145961+0000","last_became_peered":"2024-09-12T00:30:17.145961+0000","last_unstale":"2024-09-12T01:11:54.224672+0000","last_undegraded":"2024-09-12T01:11:54.224672+0000","last_fullsized":"2024-09-12T01:11:54.224672+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-12T01:11:54.224485+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-12T01:11:54.224485+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.224485+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:36.818548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":376,"num_read_kb":862,"num_write":304,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.003314+0000","last_change":"2024-09-12T01:12:10.003257+0000","last_active":"2024-09-12T01:12:10.003314+0000","last_peered":"2024-09-12T01:12:10.003314+0000","last_clean":"2024-09-12T01:12:10.003314+0000","last_became_active":"2024-09-12T00:30:19.167723+0000","last_became_peered":"2024-09-12T00:30:19.167723+0000","last_unstale":"2024-09-12T01:12:10.003314+0000","last_undegraded":"2024-09-12T01:12:10.003314+0000","last_fullsized":"2024-09-12T01:12:10.003314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:10.003171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:10.003171+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.003171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:30.043709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'178","reported_seq":1630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:16.018212+0000","last_change":"2024-09-12T01:12:16.018212+0000","last_active":"2024-09-12T01:12:16.018212+0000","last_peered":"2024-09-12T01:12:16.018212+0000","last_clean":"2024-09-12T01:12:16.018212+0000","last_became_active":"2024-09-12T00:30:21.188363+0000","last_became_peered":"2024-09-12T00:30:21.188363+0000","last_unstale":"2024-09-12T01:12:16.018212+0000","last_undegraded":"2024-09-12T01:12:16.018212+0000","last_fullsized":"2024-09-12T01:12:16.018212+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-12T01:12:16.018106+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-12T01:12:16.018106+0000","last_clean_scrub_stamp":"2024-09-12T01:12:16.018106+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:18.982578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1158,"num_read_kb":1157,"num_write":386,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'184","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.326891+0000","last_change":"2024-09-12T01:11:41.326891+0000","last_active":"2024-09-12T01:11:41.326891+0000","last_peered":"2024-09-12T01:11:41.326891+0000","last_clean":"2024-09-12T01:11:41.326891+0000","last_became_active":"2024-09-12T00:30:13.125727+0000","last_became_peered":"2024-09-12T00:30:13.125727+0000","last_unstale":"2024-09-12T01:11:41.326891+0000","last_undegraded":"2024-09-12T01:11:41.326891+0000","last_fullsized":"2024-09-12T01:11:41.326891+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-12T01:11:41.326789+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-12T01:11:41.326789+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.326789+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:11.817358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":704,"num_write":275,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'321","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.361618+0000","last_change":"2024-09-12T01:11:37.361524+0000","last_active":"2024-09-12T01:11:37.361618+0000","last_peered":"2024-09-12T01:11:37.361618+0000","last_clean":"2024-09-12T01:11:37.361618+0000","last_became_active":"2024-09-12T00:30:11.091808+0000","last_became_peered":"2024-09-12T00:30:11.091808+0000","last_unstale":"2024-09-12T01:11:37.361618+0000","last_undegraded":"2024-09-12T01:11:37.361618+0000","last_fullsized":"2024-09-12T01:11:37.361618+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-12T01:11:37.361380+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-12T01:11:37.361380+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.361380+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:30.917946+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380471,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":432,"num_read_kb":10679,"num_write":986,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.289347+0000","last_change":"2024-09-12T01:11:53.289347+0000","last_active":"2024-09-12T01:11:53.289347+0000","last_peered":"2024-09-12T01:11:53.289347+0000","last_clean":"2024-09-12T01:11:53.289347+0000","last_became_active":"2024-09-12T00:30:15.126206+0000","last_became_peered":"2024-09-12T00:30:15.126206+0000","last_unstale":"2024-09-12T01:11:53.289347+0000","last_undegraded":"2024-09-12T01:11:53.289347+0000","last_fullsized":"2024-09-12T01:11:53.289347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T01:11:53.289269+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T01:11:53.289269+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.289269+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:30.334875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'308","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.969371+0000","last_change":"2024-09-12T01:12:05.969287+0000","last_active":"2024-09-12T01:12:05.969371+0000","last_peered":"2024-09-12T01:12:05.969371+0000","last_clean":"2024-09-12T01:12:05.969371+0000","last_became_active":"2024-09-12T00:30:17.144724+0000","last_became_peered":"2024-09-12T00:30:17.144724+0000","last_unstale":"2024-09-12T01:12:05.969371+0000","last_undegraded":"2024-09-12T01:12:05.969371+0000","last_fullsized":"2024-09-12T01:12:05.969371+0000","mapping_epoch":32,"log_start":"264'200","ondisk_log_start":"264'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-12T01:12:05.969160+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-12T01:12:05.969160+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.969160+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:15.801949+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48397,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":1068,"num_write":398,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.356530+0000","last_change":"2024-09-12T01:12:05.356472+0000","last_active":"2024-09-12T01:12:05.356530+0000","last_peered":"2024-09-12T01:12:05.356530+0000","last_clean":"2024-09-12T01:12:05.356530+0000","last_became_active":"2024-09-12T00:30:19.172265+0000","last_became_peered":"2024-09-12T00:30:19.172265+0000","last_unstale":"2024-09-12T01:12:05.356530+0000","last_undegraded":"2024-09-12T01:12:05.356530+0000","last_fullsized":"2024-09-12T01:12:05.356530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:05.356389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:05.356389+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.356389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:02.127439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'132","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.288847+0000","last_change":"2024-09-12T01:11:56.288779+0000","last_active":"2024-09-12T01:11:56.288847+0000","last_peered":"2024-09-12T01:11:56.288847+0000","last_clean":"2024-09-12T01:11:56.288847+0000","last_became_active":"2024-09-12T00:30:21.191837+0000","last_became_peered":"2024-09-12T00:30:21.191837+0000","last_unstale":"2024-09-12T01:11:56.288847+0000","last_undegraded":"2024-09-12T01:11:56.288847+0000","last_fullsized":"2024-09-12T01:11:56.288847+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'132","last_scrub_stamp":"2024-09-12T01:11:56.288686+0000","last_deep_scrub":"264'132","last_deep_scrub_stamp":"2024-09-12T01:11:56.288686+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.288686+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:05.149635+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":99,"num_write":307,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'142","reported_seq":748,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.285051+0000","last_change":"2024-09-12T01:11:43.285051+0000","last_active":"2024-09-12T01:11:43.285051+0000","last_peered":"2024-09-12T01:11:43.285051+0000","last_clean":"2024-09-12T01:11:43.285051+0000","last_became_active":"2024-09-12T00:30:13.121828+0000","last_became_peered":"2024-09-12T00:30:13.121828+0000","last_unstale":"2024-09-12T01:11:43.285051+0000","last_undegraded":"2024-09-12T01:11:43.285051+0000","last_fullsized":"2024-09-12T01:11:43.285051+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-12T01:11:43.284952+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-12T01:11:43.284952+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.284952+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:06.141716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":656,"num_read_kb":543,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'369","reported_seq":1110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.422327+0000","last_change":"2024-09-12T01:11:33.422242+0000","last_active":"2024-09-12T01:11:33.422327+0000","last_peered":"2024-09-12T01:11:33.422327+0000","last_clean":"2024-09-12T01:11:33.422327+0000","last_became_active":"2024-09-12T00:30:11.105480+0000","last_became_peered":"2024-09-12T00:30:11.105480+0000","last_unstale":"2024-09-12T01:11:33.422327+0000","last_undegraded":"2024-09-12T01:11:33.422327+0000","last_fullsized":"2024-09-12T01:11:33.422327+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-12T01:11:33.422113+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-12T01:11:33.422113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.422113+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:29.910170+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029011,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":778,"num_read_kb":27112,"num_write":1220,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'88","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.550819+0000","last_change":"2024-09-12T01:11:40.550819+0000","last_active":"2024-09-12T01:11:40.550819+0000","last_peered":"2024-09-12T01:11:40.550819+0000","last_clean":"2024-09-12T01:11:40.550819+0000","last_became_active":"2024-09-12T00:30:13.130421+0000","last_became_peered":"2024-09-12T00:30:13.130421+0000","last_unstale":"2024-09-12T01:11:40.550819+0000","last_undegraded":"2024-09-12T01:11:40.550819+0000","last_fullsized":"2024-09-12T01:11:40.550819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'88","last_scrub_stamp":"2024-09-12T01:11:40.550737+0000","last_deep_scrub":"264'88","last_deep_scrub_stamp":"2024-09-12T01:11:40.550737+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.550737+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:24.149286+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":372,"num_read_kb":312,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'345","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.529883+0000","last_change":"2024-09-12T01:11:34.529826+0000","last_active":"2024-09-12T01:11:34.529883+0000","last_peered":"2024-09-12T01:11:34.529883+0000","last_clean":"2024-09-12T01:11:34.529883+0000","last_became_active":"2024-09-12T00:30:11.092318+0000","last_became_peered":"2024-09-12T00:30:11.092318+0000","last_unstale":"2024-09-12T01:11:34.529883+0000","last_undegraded":"2024-09-12T01:11:34.529883+0000","last_fullsized":"2024-09-12T01:11:34.529883+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-12T01:11:34.529704+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-12T01:11:34.529704+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.529704+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:03.024603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287236,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":12148,"num_write":1066,"num_write_kb":57585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'404","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.812921+0000","last_change":"2024-09-12T01:11:54.812921+0000","last_active":"2024-09-12T01:11:54.812921+0000","last_peered":"2024-09-12T01:11:54.812921+0000","last_clean":"2024-09-12T01:11:54.812921+0000","last_became_active":"2024-09-12T00:30:13.126912+0000","last_became_peered":"2024-09-12T00:30:13.126912+0000","last_unstale":"2024-09-12T01:11:54.812921+0000","last_undegraded":"2024-09-12T01:11:54.812921+0000","last_fullsized":"2024-09-12T01:11:54.812921+0000","mapping_epoch":28,"log_start":"264'300","ondisk_log_start":"264'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'404","last_scrub_stamp":"2024-09-12T01:11:54.812831+0000","last_deep_scrub":"264'404","last_deep_scrub_stamp":"2024-09-12T01:11:54.812831+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.812831+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:55.192863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1731,"num_read_kb":1377,"num_write":679,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'430","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.905125+0000","last_change":"2024-09-12T01:11:42.905031+0000","last_active":"2024-09-12T01:11:42.905125+0000","last_peered":"2024-09-12T01:11:42.905125+0000","last_clean":"2024-09-12T01:11:42.905125+0000","last_became_active":"2024-09-12T00:30:11.099069+0000","last_became_peered":"2024-09-12T00:30:11.099069+0000","last_unstale":"2024-09-12T01:11:42.905125+0000","last_undegraded":"2024-09-12T01:11:42.905125+0000","last_fullsized":"2024-09-12T01:11:42.905125+0000","mapping_epoch":26,"log_start":"264'400","ondisk_log_start":"264'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-09-12T01:11:42.904875+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-09-12T01:11:42.904875+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.904875+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:17.846461+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380696,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":691,"num_read_kb":70901,"num_write":1282,"num_write_kb":51705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'117","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.327787+0000","last_change":"2024-09-12T01:11:50.327787+0000","last_active":"2024-09-12T01:11:50.327787+0000","last_peered":"2024-09-12T01:11:50.327787+0000","last_clean":"2024-09-12T01:11:50.327787+0000","last_became_active":"2024-09-12T00:30:13.126860+0000","last_became_peered":"2024-09-12T00:30:13.126860+0000","last_unstale":"2024-09-12T01:11:50.327787+0000","last_undegraded":"2024-09-12T01:11:50.327787+0000","last_fullsized":"2024-09-12T01:11:50.327787+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-12T01:11:50.327702+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-12T01:11:50.327702+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.327702+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:21.477416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":554,"num_read_kb":463,"num_write":200,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'328","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.324364+0000","last_change":"2024-09-12T01:11:38.324299+0000","last_active":"2024-09-12T01:11:38.324364+0000","last_peered":"2024-09-12T01:11:38.324364+0000","last_clean":"2024-09-12T01:11:38.324364+0000","last_became_active":"2024-09-12T00:30:11.105196+0000","last_became_peered":"2024-09-12T00:30:11.105196+0000","last_unstale":"2024-09-12T01:11:38.324364+0000","last_undegraded":"2024-09-12T01:11:38.324364+0000","last_fullsized":"2024-09-12T01:11:38.324364+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'328","last_scrub_stamp":"2024-09-12T01:11:38.324193+0000","last_deep_scrub":"264'328","last_deep_scrub_stamp":"2024-09-12T01:11:38.324193+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.324193+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.266767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":8473,"num_write":1002,"num_write_kb":46203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'4191","reported_seq":4841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.275565+0000","last_change":"2024-09-12T01:11:48.275510+0000","last_active":"2024-09-12T01:11:48.275565+0000","last_peered":"2024-09-12T01:11:48.275565+0000","last_clean":"2024-09-12T01:11:48.275565+0000","last_became_active":"2024-09-12T00:30:13.125353+0000","last_became_peered":"2024-09-12T00:30:13.125353+0000","last_unstale":"2024-09-12T01:11:48.275565+0000","last_undegraded":"2024-09-12T01:11:48.275565+0000","last_fullsized":"2024-09-12T01:11:48.275565+0000","mapping_epoch":28,"log_start":"264'4100","ondisk_log_start":"264'4100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4191","last_scrub_stamp":"2024-09-12T01:11:48.275422+0000","last_deep_scrub":"264'4191","last_deep_scrub_stamp":"2024-09-12T01:11:48.275422+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.275422+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":3000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:02.155433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16885,"num_read_kb":14166,"num_write":6282,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'387","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.090306+0000","last_change":"2024-09-12T01:11:34.090306+0000","last_active":"2024-09-12T01:11:34.090306+0000","last_peered":"2024-09-12T01:11:34.090306+0000","last_clean":"2024-09-12T01:11:34.090306+0000","last_became_active":"2024-09-12T00:30:11.108127+0000","last_became_peered":"2024-09-12T00:30:11.108127+0000","last_unstale":"2024-09-12T01:11:34.090306+0000","last_undegraded":"2024-09-12T01:11:34.090306+0000","last_fullsized":"2024-09-12T01:11:34.090306+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'387","last_scrub_stamp":"2024-09-12T01:11:34.090152+0000","last_deep_scrub":"264'387","last_deep_scrub_stamp":"2024-09-12T01:11:34.090152+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.090152+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:56.953945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105411,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":473,"num_read_kb":2771,"num_write":1102,"num_write_kb":29841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'185","reported_seq":785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.371411+0000","last_change":"2024-09-12T01:11:41.371298+0000","last_active":"2024-09-12T01:11:41.371411+0000","last_peered":"2024-09-12T01:11:41.371411+0000","last_clean":"2024-09-12T01:11:41.371411+0000","last_became_active":"2024-09-12T00:30:13.129432+0000","last_became_peered":"2024-09-12T00:30:13.129432+0000","last_unstale":"2024-09-12T01:11:41.371411+0000","last_undegraded":"2024-09-12T01:11:41.371411+0000","last_fullsized":"2024-09-12T01:11:41.371411+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-12T01:11:41.371181+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-12T01:11:41.371181+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.371181+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:10.754863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":853,"num_read_kb":694,"num_write":316,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'364","reported_seq":1080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.098210+0000","last_change":"2024-09-12T01:11:36.098210+0000","last_active":"2024-09-12T01:11:36.098210+0000","last_peered":"2024-09-12T01:11:36.098210+0000","last_clean":"2024-09-12T01:11:36.098210+0000","last_became_active":"2024-09-12T00:30:11.108351+0000","last_became_peered":"2024-09-12T00:30:11.108351+0000","last_unstale":"2024-09-12T01:11:36.098210+0000","last_undegraded":"2024-09-12T01:11:36.098210+0000","last_fullsized":"2024-09-12T01:11:36.098210+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-12T01:11:36.098005+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-12T01:11:36.098005+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.098005+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:33.871781+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648362,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":667,"num_read_kb":30774,"num_write":1247,"num_write_kb":36026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'164","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.102572+0000","last_change":"2024-09-12T01:11:47.102484+0000","last_active":"2024-09-12T01:11:47.102572+0000","last_peered":"2024-09-12T01:11:47.102572+0000","last_clean":"2024-09-12T01:11:47.102572+0000","last_became_active":"2024-09-12T00:30:13.124637+0000","last_became_peered":"2024-09-12T00:30:13.124637+0000","last_unstale":"2024-09-12T01:11:47.102572+0000","last_undegraded":"2024-09-12T01:11:47.102572+0000","last_fullsized":"2024-09-12T01:11:47.102572+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-12T01:11:47.102372+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-12T01:11:47.102372+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.102372+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:35.485046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":588,"num_write":241,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'372","reported_seq":1043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.386029+0000","last_change":"2024-09-12T01:11:38.386029+0000","last_active":"2024-09-12T01:11:38.386029+0000","last_peered":"2024-09-12T01:11:38.386029+0000","last_clean":"2024-09-12T01:11:38.386029+0000","last_became_active":"2024-09-12T00:30:11.108084+0000","last_became_peered":"2024-09-12T00:30:11.108084+0000","last_unstale":"2024-09-12T01:11:38.386029+0000","last_undegraded":"2024-09-12T01:11:38.386029+0000","last_fullsized":"2024-09-12T01:11:38.386029+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-12T01:11:38.385902+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-12T01:11:38.385902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.385902+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:00.631378+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5025600,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":616,"num_read_kb":11433,"num_write":1237,"num_write_kb":28830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'237","reported_seq":883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.845480+0000","last_change":"2024-09-12T01:11:36.845384+0000","last_active":"2024-09-12T01:11:36.845480+0000","last_peered":"2024-09-12T01:11:36.845480+0000","last_clean":"2024-09-12T01:11:36.845480+0000","last_became_active":"2024-09-12T00:30:13.128799+0000","last_became_peered":"2024-09-12T00:30:13.128799+0000","last_unstale":"2024-09-12T01:11:36.845480+0000","last_undegraded":"2024-09-12T01:11:36.845480+0000","last_fullsized":"2024-09-12T01:11:36.845480+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'237","last_scrub_stamp":"2024-09-12T01:11:36.845275+0000","last_deep_scrub":"264'237","last_deep_scrub_stamp":"2024-09-12T01:11:36.845275+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.845275+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.874151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":871,"num_write":360,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'352","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.309076+0000","last_change":"2024-09-12T01:11:39.309076+0000","last_active":"2024-09-12T01:11:39.309076+0000","last_peered":"2024-09-12T01:11:39.309076+0000","last_clean":"2024-09-12T01:11:39.309076+0000","last_became_active":"2024-09-12T00:30:11.102617+0000","last_became_peered":"2024-09-12T00:30:11.102617+0000","last_unstale":"2024-09-12T01:11:39.309076+0000","last_undegraded":"2024-09-12T01:11:39.309076+0000","last_fullsized":"2024-09-12T01:11:39.309076+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-12T01:11:39.308936+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-12T01:11:39.308936+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.308936+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:27.572801+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364846,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":18671,"num_write":1023,"num_write_kb":28835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'52","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.555429+0000","last_change":"2024-09-12T01:11:41.555361+0000","last_active":"2024-09-12T01:11:41.555429+0000","last_peered":"2024-09-12T01:11:41.555429+0000","last_clean":"2024-09-12T01:11:41.555429+0000","last_became_active":"2024-09-12T00:30:13.123035+0000","last_became_peered":"2024-09-12T00:30:13.123035+0000","last_unstale":"2024-09-12T01:11:41.555429+0000","last_undegraded":"2024-09-12T01:11:41.555429+0000","last_fullsized":"2024-09-12T01:11:41.555429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-12T01:11:41.555280+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-12T01:11:41.555280+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.555280+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:57.286919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":253,"num_read_kb":222,"num_write":77,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'336","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.894219+0000","last_change":"2024-09-12T01:11:43.894219+0000","last_active":"2024-09-12T01:11:43.894219+0000","last_peered":"2024-09-12T01:11:43.894219+0000","last_clean":"2024-09-12T01:11:43.894219+0000","last_became_active":"2024-09-12T00:30:11.110299+0000","last_became_peered":"2024-09-12T00:30:11.110299+0000","last_unstale":"2024-09-12T01:11:43.894219+0000","last_undegraded":"2024-09-12T01:11:43.894219+0000","last_fullsized":"2024-09-12T01:11:43.894219+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-12T01:11:43.894098+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-12T01:11:43.894098+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.894098+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:37.338640+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":443,"num_read_kb":30015,"num_write":1046,"num_write_kb":30187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'180","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.406443+0000","last_change":"2024-09-12T01:11:39.406375+0000","last_active":"2024-09-12T01:11:39.406443+0000","last_peered":"2024-09-12T01:11:39.406443+0000","last_clean":"2024-09-12T01:11:39.406443+0000","last_became_active":"2024-09-12T00:30:13.123217+0000","last_became_peered":"2024-09-12T00:30:13.123217+0000","last_unstale":"2024-09-12T01:11:39.406443+0000","last_undegraded":"2024-09-12T01:11:39.406443+0000","last_fullsized":"2024-09-12T01:11:39.406443+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-12T01:11:39.406291+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-12T01:11:39.406291+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.406291+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.832105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":608,"num_write":257,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'316","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.267042+0000","last_change":"2024-09-12T01:11:40.267042+0000","last_active":"2024-09-12T01:11:40.267042+0000","last_peered":"2024-09-12T01:11:40.267042+0000","last_clean":"2024-09-12T01:11:40.267042+0000","last_became_active":"2024-09-12T00:30:11.102436+0000","last_became_peered":"2024-09-12T00:30:11.102436+0000","last_unstale":"2024-09-12T01:11:40.267042+0000","last_undegraded":"2024-09-12T01:11:40.267042+0000","last_fullsized":"2024-09-12T01:11:40.267042+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-12T01:11:40.266922+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-12T01:11:40.266922+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.266922+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:22.297560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315002,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":79108,"num_write":1106,"num_write_kb":40469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'217","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.366851+0000","last_change":"2024-09-12T01:11:51.366851+0000","last_active":"2024-09-12T01:11:51.366851+0000","last_peered":"2024-09-12T01:11:51.366851+0000","last_clean":"2024-09-12T01:11:51.366851+0000","last_became_active":"2024-09-12T00:30:13.129733+0000","last_became_peered":"2024-09-12T00:30:13.129733+0000","last_unstale":"2024-09-12T01:11:51.366851+0000","last_undegraded":"2024-09-12T01:11:51.366851+0000","last_fullsized":"2024-09-12T01:11:51.366851+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'217","last_scrub_stamp":"2024-09-12T01:11:51.366771+0000","last_deep_scrub":"264'217","last_deep_scrub_stamp":"2024-09-12T01:11:51.366771+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.366771+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:43.523061+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":953,"num_read_kb":786,"num_write":335,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'382","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.875020+0000","last_change":"2024-09-12T01:11:35.875020+0000","last_active":"2024-09-12T01:11:35.875020+0000","last_peered":"2024-09-12T01:11:35.875020+0000","last_clean":"2024-09-12T01:11:35.875020+0000","last_became_active":"2024-09-12T00:30:11.105950+0000","last_became_peered":"2024-09-12T00:30:11.105950+0000","last_unstale":"2024-09-12T01:11:35.875020+0000","last_undegraded":"2024-09-12T01:11:35.875020+0000","last_fullsized":"2024-09-12T01:11:35.875020+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-12T01:11:35.874867+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-12T01:11:35.874867+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.874867+0000","objects_scrubbed":12,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:15.332168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4299828,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":589,"num_read_kb":20762,"num_write":1342,"num_write_kb":32414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'173","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.878947+0000","last_change":"2024-09-12T01:11:40.878947+0000","last_active":"2024-09-12T01:11:40.878947+0000","last_peered":"2024-09-12T01:11:40.878947+0000","last_clean":"2024-09-12T01:11:40.878947+0000","last_became_active":"2024-09-12T00:30:13.128009+0000","last_became_peered":"2024-09-12T00:30:13.128009+0000","last_unstale":"2024-09-12T01:11:40.878947+0000","last_undegraded":"2024-09-12T01:11:40.878947+0000","last_fullsized":"2024-09-12T01:11:40.878947+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-12T01:11:40.878859+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-12T01:11:40.878859+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.878859+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:39.949418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":738,"num_read_kb":604,"num_write":258,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'395","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.263014+0000","last_change":"2024-09-12T01:11:38.263014+0000","last_active":"2024-09-12T01:11:38.263014+0000","last_peered":"2024-09-12T01:11:38.263014+0000","last_clean":"2024-09-12T01:11:38.263014+0000","last_became_active":"2024-09-12T00:30:11.096908+0000","last_became_peered":"2024-09-12T00:30:11.096908+0000","last_unstale":"2024-09-12T01:11:38.263014+0000","last_undegraded":"2024-09-12T01:11:38.263014+0000","last_fullsized":"2024-09-12T01:11:38.263014+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-12T01:11:38.262881+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-12T01:11:38.262881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.262881+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:54.179820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":27824,"num_write":1325,"num_write_kb":35997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'130","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.865328+0000","last_change":"2024-09-12T01:11:38.865328+0000","last_active":"2024-09-12T01:11:38.865328+0000","last_peered":"2024-09-12T01:11:38.865328+0000","last_clean":"2024-09-12T01:11:38.865328+0000","last_became_active":"2024-09-12T00:30:13.126817+0000","last_became_peered":"2024-09-12T00:30:13.126817+0000","last_unstale":"2024-09-12T01:11:38.865328+0000","last_undegraded":"2024-09-12T01:11:38.865328+0000","last_fullsized":"2024-09-12T01:11:38.865328+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-12T01:11:38.865238+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-12T01:11:38.865238+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.865238+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:46.059324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":588,"num_read_kb":486,"num_write":195,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'337","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.427130+0000","last_change":"2024-09-12T01:11:30.427130+0000","last_active":"2024-09-12T01:11:30.427130+0000","last_peered":"2024-09-12T01:11:30.427130+0000","last_clean":"2024-09-12T01:11:30.427130+0000","last_became_active":"2024-09-12T00:30:11.105575+0000","last_became_peered":"2024-09-12T00:30:11.105575+0000","last_unstale":"2024-09-12T01:11:30.427130+0000","last_undegraded":"2024-09-12T01:11:30.427130+0000","last_fullsized":"2024-09-12T01:11:30.427130+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'337","last_scrub_stamp":"2024-09-12T01:11:30.427034+0000","last_deep_scrub":"264'337","last_deep_scrub_stamp":"2024-09-12T01:11:30.427034+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.427034+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:04.883192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524326,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":581,"num_read_kb":45130,"num_write":1156,"num_write_kb":46621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'202","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.577784+0000","last_change":"2024-09-12T01:11:42.577784+0000","last_active":"2024-09-12T01:11:42.577784+0000","last_peered":"2024-09-12T01:11:42.577784+0000","last_clean":"2024-09-12T01:11:42.577784+0000","last_became_active":"2024-09-12T00:30:13.129092+0000","last_became_peered":"2024-09-12T00:30:13.129092+0000","last_unstale":"2024-09-12T01:11:42.577784+0000","last_undegraded":"2024-09-12T01:11:42.577784+0000","last_fullsized":"2024-09-12T01:11:42.577784+0000","mapping_epoch":28,"log_start":"261'100","ondisk_log_start":"261'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'202","last_scrub_stamp":"2024-09-12T01:11:42.577693+0000","last_deep_scrub":"264'202","last_deep_scrub_stamp":"2024-09-12T01:11:42.577693+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.577693+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:29.344845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":854,"num_read_kb":707,"num_write":299,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'347","reported_seq":1195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.846455+0000","last_change":"2024-09-12T01:11:44.846455+0000","last_active":"2024-09-12T01:11:44.846455+0000","last_peered":"2024-09-12T01:11:44.846455+0000","last_clean":"2024-09-12T01:11:44.846455+0000","last_became_active":"2024-09-12T00:30:11.108616+0000","last_became_peered":"2024-09-12T00:30:11.108616+0000","last_unstale":"2024-09-12T01:11:44.846455+0000","last_undegraded":"2024-09-12T01:11:44.846455+0000","last_fullsized":"2024-09-12T01:11:44.846455+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-12T01:11:44.846295+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-12T01:11:44.846295+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.846295+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:52.600725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":955,"num_read_kb":21858,"num_write":1152,"num_write_kb":27958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'147","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.265816+0000","last_change":"2024-09-12T01:11:44.265816+0000","last_active":"2024-09-12T01:11:44.265816+0000","last_peered":"2024-09-12T01:11:44.265816+0000","last_clean":"2024-09-12T01:11:44.265816+0000","last_became_active":"2024-09-12T00:30:13.125887+0000","last_became_peered":"2024-09-12T00:30:13.125887+0000","last_unstale":"2024-09-12T01:11:44.265816+0000","last_undegraded":"2024-09-12T01:11:44.265816+0000","last_fullsized":"2024-09-12T01:11:44.265816+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'147","last_scrub_stamp":"2024-09-12T01:11:44.265735+0000","last_deep_scrub":"264'147","last_deep_scrub_stamp":"2024-09-12T01:11:44.265735+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.265735+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:34.728050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":559,"num_write":247,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'335","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.555081+0000","last_change":"2024-09-12T01:11:36.555016+0000","last_active":"2024-09-12T01:11:36.555081+0000","last_peered":"2024-09-12T01:11:36.555081+0000","last_clean":"2024-09-12T01:11:36.555081+0000","last_became_active":"2024-09-12T00:30:46.396288+0000","last_became_peered":"2024-09-12T00:30:46.396288+0000","last_unstale":"2024-09-12T01:11:36.555081+0000","last_undegraded":"2024-09-12T01:11:36.555081+0000","last_fullsized":"2024-09-12T01:11:36.555081+0000","mapping_epoch":39,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-12T01:11:36.554891+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-12T01:11:36.554891+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.554891+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:31.851264+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8687076,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":21015,"num_write":1060,"num_write_kb":30668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3,0],"acting":[7,5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'251","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.851278+0000","last_change":"2024-09-12T01:11:37.851278+0000","last_active":"2024-09-12T01:11:37.851278+0000","last_peered":"2024-09-12T01:11:37.851278+0000","last_clean":"2024-09-12T01:11:37.851278+0000","last_became_active":"2024-09-12T00:30:13.127513+0000","last_became_peered":"2024-09-12T00:30:13.127513+0000","last_unstale":"2024-09-12T01:11:37.851278+0000","last_undegraded":"2024-09-12T01:11:37.851278+0000","last_fullsized":"2024-09-12T01:11:37.851278+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-12T01:11:37.851124+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-12T01:11:37.851124+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.851124+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:02.058983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":989,"num_read_kb":791,"num_write":358,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8300,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'328","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.826057+0000","last_change":"2024-09-12T01:11:48.825992+0000","last_active":"2024-09-12T01:11:48.826057+0000","last_peered":"2024-09-12T01:11:48.826057+0000","last_clean":"2024-09-12T01:11:48.826057+0000","last_became_active":"2024-09-12T00:30:11.109661+0000","last_became_peered":"2024-09-12T00:30:11.109661+0000","last_unstale":"2024-09-12T01:11:48.826057+0000","last_undegraded":"2024-09-12T01:11:48.826057+0000","last_fullsized":"2024-09-12T01:11:48.826057+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'328","last_scrub_stamp":"2024-09-12T01:11:48.825791+0000","last_deep_scrub":"264'328","last_deep_scrub_stamp":"2024-09-12T01:11:48.825791+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.825791+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:02.017430+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":8210,"num_write":1080,"num_write_kb":36173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'315","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.811331+0000","last_change":"2024-09-12T01:11:45.811270+0000","last_active":"2024-09-12T01:11:45.811331+0000","last_peered":"2024-09-12T01:11:45.811331+0000","last_clean":"2024-09-12T01:11:45.811331+0000","last_became_active":"2024-09-12T00:30:11.113173+0000","last_became_peered":"2024-09-12T00:30:11.113173+0000","last_unstale":"2024-09-12T01:11:45.811331+0000","last_undegraded":"2024-09-12T01:11:45.811331+0000","last_fullsized":"2024-09-12T01:11:45.811331+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-09-12T01:11:45.811155+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-09-12T01:11:45.811155+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.811155+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:57.504861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":50214,"num_write":1057,"num_write_kb":47204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'24","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.282085+0000","last_change":"2024-09-12T01:11:45.282085+0000","last_active":"2024-09-12T01:11:45.282085+0000","last_peered":"2024-09-12T01:11:45.282085+0000","last_clean":"2024-09-12T01:11:45.282085+0000","last_became_active":"2024-09-12T00:30:13.126264+0000","last_became_peered":"2024-09-12T00:30:13.126264+0000","last_unstale":"2024-09-12T01:11:45.282085+0000","last_undegraded":"2024-09-12T01:11:45.282085+0000","last_fullsized":"2024-09-12T01:11:45.282085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-12T01:11:45.281991+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-12T01:11:45.281991+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.281991+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:59.791991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":113,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'377","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.282699+0000","last_change":"2024-09-12T01:11:41.282638+0000","last_active":"2024-09-12T01:11:41.282699+0000","last_peered":"2024-09-12T01:11:41.282699+0000","last_clean":"2024-09-12T01:11:41.282699+0000","last_became_active":"2024-09-12T00:30:11.102026+0000","last_became_peered":"2024-09-12T00:30:11.102026+0000","last_unstale":"2024-09-12T01:11:41.282699+0000","last_undegraded":"2024-09-12T01:11:41.282699+0000","last_fullsized":"2024-09-12T01:11:41.282699+0000","mapping_epoch":26,"log_start":"264'300","ondisk_log_start":"264'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-12T01:11:41.282464+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-12T01:11:41.282464+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.282464+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:04.065353+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4360630,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":672,"num_read_kb":9482,"num_write":1213,"num_write_kb":28977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'250","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.895038+0000","last_change":"2024-09-12T01:11:42.895038+0000","last_active":"2024-09-12T01:11:42.895038+0000","last_peered":"2024-09-12T01:11:42.895038+0000","last_clean":"2024-09-12T01:11:42.895038+0000","last_became_active":"2024-09-12T00:30:13.119872+0000","last_became_peered":"2024-09-12T00:30:13.119872+0000","last_unstale":"2024-09-12T01:11:42.895038+0000","last_undegraded":"2024-09-12T01:11:42.895038+0000","last_fullsized":"2024-09-12T01:11:42.895038+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-12T01:11:42.894943+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-12T01:11:42.894943+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.894943+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.400595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":987,"num_write":428,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5946,"num_read_kb":4236,"num_write":1962,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5476,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1035,"ondisk_log_size":1035,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15005,"num_read_kb":14670,"num_write":16786,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1654,"ondisk_log_size":1654,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":685,"ondisk_log_size":685,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1548725,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17648,"num_read_kb":36949,"num_write":14701,"num_write_kb":11551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":686502,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1727,"ondisk_log_size":1727,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":102018,"num_read_kb":85254,"num_write":36979,"num_write_kb":18604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44076,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4245,"ondisk_log_size":4245,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":166688013,"num_objects":400,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":400,"num_whiteouts":0,"num_read":36140,"num_read_kb":1917452,"num_write":72064,"num_write_kb":2191736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":224706560,"data_stored":224706560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3667,"ondisk_log_size":3667,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170064,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168795,"num_write":186,"num_write_kb":126797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509964,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264752,"kb_used_data":35040,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94107088,"statfs":{"total":96636764160,"available":96365658112,"internally_reserved":0,"allocated":35880960,"data_stored":33872164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509961,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341752,"kb_used_data":31528,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94030088,"statfs":{"total":96636764160,"available":96286810112,"internally_reserved":0,"allocated":32284672,"data_stored":30297333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509961,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156088,"kb_used_data":34728,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94215752,"statfs":{"total":96636764160,"available":96476930048,"internally_reserved":0,"allocated":35561472,"data_stored":33552270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542666,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252368,"kb_used_data":32448,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94119472,"statfs":{"total":96636764160,"available":96378339328,"internally_reserved":0,"allocated":33226752,"data_stored":31260225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542665,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151548,"kb_used_data":21868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94220292,"statfs":{"total":96636764160,"available":96481579008,"internally_reserved":0,"allocated":22392832,"data_stored":20398857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132774343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542663,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289684,"kb_used_data":33604,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94082156,"statfs":{"total":96636764160,"available":96340127744,"internally_reserved":0,"allocated":34410496,"data_stored":32405240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262207941},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542666,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251100,"kb_used_data":31180,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94120740,"statfs":{"total":96636764160,"available":96379637760,"internally_reserved":0,"allocated":31928320,"data_stored":29931227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225180101},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575369,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172604,"kb_used_data":33132,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94199236,"statfs":{"total":96636764160,"available":96460017664,"internally_reserved":0,"allocated":33927168,"data_stored":31936990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31330304,"data_stored":31330304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27488256,"data_stored":27488256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29716480,"data_stored":29716480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31649792,"data_stored":31649792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27709440,"data_stored":27709440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29593600,"data_stored":29593600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18178048,"data_stored":18178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29040640,"data_stored":29040640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:12:54.402 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:12:54.729 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:12:54.729 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:12:54.730 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:12:54.730 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:54.782 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:12:54.782 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:12:54.782 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:54.830 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:12:54.830 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:12:54.830 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:54.877 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:12:54.878 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:12:54.878 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:54.931 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:12:54.931 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:12:54.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:54.983 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:12:54.983 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:12:54.983 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:55.033 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:12:55.033 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:12:55.033 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:55.080 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:12:55.081 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:12:55.081 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:55.132 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:12:55.132 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:12:55.132 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:12:55.132 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:55.159 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:12:55.160 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:12:55.160 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:55.186 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:12:55.186 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:12:55.186 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:12:55.186 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:55.215 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:12:55.215 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:12:55.215 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:55.266 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:12:55.267 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:12:55.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:55.279 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:12:55.279 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:12:55.279 DEBUG:teuthology.orchestra.run.smithi083:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:12:55.348 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T01:12:55.348 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:12:55.715 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T01:12:55.715 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:12:55.822 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T01:12:55.822 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:12:55.899 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T01:12:55.900 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:12:55.977 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T01:12:55.978 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:12:56.178 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T01:12:56.178 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:12:56.269 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T01:12:56.269 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:12:56.338 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T01:12:56.338 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:12:56.421 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:12:56.422 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869/data/mon.a.tgz 2024-09-12T01:12:56.422 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-09-12T01:12:56.451 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.Qh2lKo5xBA 2024-09-12T01:12:56.452 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Qh2lKo5xBA 2024-09-12T01:12:56.644 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.Qh2lKo5xBA 2024-09-12T01:12:56.756 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.Qh2lKo5xBA is 486KB 2024-09-12T01:12:56.858 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.Qh2lKo5xBA 2024-09-12T01:12:56.888 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869/data/mon.c.tgz 2024-09-12T01:12:56.888 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-09-12T01:12:56.956 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.gTV8gx9r4o 2024-09-12T01:12:56.956 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gTV8gx9r4o 2024-09-12T01:12:57.140 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.gTV8gx9r4o 2024-09-12T01:12:57.250 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.gTV8gx9r4o is 502KB 2024-09-12T01:12:57.350 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.gTV8gx9r4o 2024-09-12T01:12:57.379 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869/data/mon.b.tgz 2024-09-12T01:12:57.379 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-12T01:12:57.409 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.kv96oEbljr 2024-09-12T01:12:57.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kv96oEbljr 2024-09-12T01:12:57.620 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.kv96oEbljr 2024-09-12T01:12:57.732 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.kv96oEbljr is 502KB 2024-09-12T01:12:57.831 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.kv96oEbljr 2024-09-12T01:12:57.860 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:12:57.860 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:12:57.863 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:12:57.974 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:12:58.005 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:12:58.006 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:12:58.007 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869/remote/smithi083/crash 2024-09-12T01:12:58.008 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:12:58.055 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869/remote/smithi120/crash 2024-09-12T01:12:58.056 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:12:58.094 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:12:58.094 DEBUG:teuthology.orchestra.run.smithi083:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:12:58.099 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:12:58.195 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32903.log 2024-09-12T01:12:58.195 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32771.log 2024-09-12T01:12:58.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32903.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32903.log.gz 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32859.log 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32771.log.gz 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32859.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.32859.log.gz -- 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph.audit.log 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32639.log 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32639.log.gz 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:12:58.196 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32683.log 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mgr.x.log: 90.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32815.log 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32683.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32683.log.gz 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32815.log.gz 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32579.log 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32727.log 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32579.log.gz 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32727.log.gz 2024-09-12T01:12:58.197 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:12:58.211 INFO:teuthology.orchestra.run.smithi120.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:12:58.259 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:12:58.259 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190024.log 2024-09-12T01:12:58.259 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110739.log 2024-09-12T01:12:58.259 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.190024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47146.log 2024-09-12T01:12:58.259 INFO:teuthology.orchestra.run.smithi083.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.190024.log.gz 2024-09-12T01:12:58.259 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.110739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166204.log 2024-09-12T01:12:58.259 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.110739.log.gz 2024-09-12T01:12:58.259 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86001.log 2024-09-12T01:12:58.259 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.166204.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.47146.log.gz 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166204.log.gz 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193209.log 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.86001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91891.log 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.86001.log.gz 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59389.log 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193209.log.gz 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.91891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93658.log 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.59389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150795.log 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.59389.log.gz 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.93658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49232.log 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93658.log.gz 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151384.log 2024-09-12T01:12:58.260 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.150795.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.150795.log.gz 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49232.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.91891.log.gz 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50410.log 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.49232.log.gz 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81289.log 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.151384.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.151384.log.gz 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50410.log: /var/log/ceph/ceph-client.admin.147261.log 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50410.log.gz 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.81289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66737.log 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.81289.log.gz 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.147261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39114.log 2024-09-12T01:12:58.261 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.147261.log.gz 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141960.log 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.66737.log: /var/log/ceph/ceph-client.admin.39114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38607.log 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39114.log.gz 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.141960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149028.log 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.141960.log.gz 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38607.log.gz 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32773.log 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.149028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171076.log 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.149028.log.gz 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.32773.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.32773.log.gz 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.133714.log 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.171076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109561.log 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.133714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193439.log 2024-09-12T01:12:58.262 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.133714.log.gz 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.109561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189954.log 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162009.log 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.109561.log.gz 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193439.log: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.171076.log.gz 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193439.log.gz 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.189954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76488.log 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.189954.log.gz 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.162009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190709.log 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.162009.log.gz 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.76488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174871.log 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.76488.log.gz 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.190709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190709.log.gz 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96014.log 2024-09-12T01:12:58.263 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121341.log 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.174871.log: /var/log/ceph/ceph-client.admin.96014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100726.log 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.96014.log.gz 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.121341.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.174871.log.gz 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140193.log 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.66737.log.gz 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121341.log.gz 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193761.log 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.100726.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.100726.log.gz 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.140193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101315.log 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140193.log.gz 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87768.log 2024-09-12T01:12:58.264 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193761.log.gz 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.101315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74715.log 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.101315.log.gz 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.87768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128412.log 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.87768.log.gz 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.74715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120163.log 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.128412.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.74715.log.gz 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.128412.log.gz 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.120163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52814.log 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.120163.log.gz 2024-09-12T01:12:58.265 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180672.log 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.52814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59978.log 0.0% 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52814.log.gz 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.180672.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.180672.log.gz 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.59978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94836.log 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.59978.log.gz 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55218.log 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.94836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154919.log 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94836.log.gz 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193946.log 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.55218.log: /var/log/ceph/ceph-client.admin.154919.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.55218.log.gz 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175479.log 2024-09-12T01:12:58.266 INFO:teuthology.orchestra.run.smithi083.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.154919.log.gz 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194037.log 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193946.log.gz 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.175479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190000.log 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.194037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77834.log 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.175479.log.gz 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194037.log.gz 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.190000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63523.log 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190000.log.gz 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.77834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48643.log 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.77834.log.gz 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.63523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54040.log 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.63523.log.gz 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190660.log 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.48643.log.gz 2024-09-12T01:12:58.267 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.54040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154330.log 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.190660.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.54040.log.gz 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190660.log.gz 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102493.log 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56396.log 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.154330.log: /var/log/ceph/ceph-client.admin.102493.log: gzip 82.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.154330.log.gz --verbose 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr: -- /var/log/ceph/ceph-client.admin.166817.log 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102493.log.gz 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.56396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132536.log 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.56396.log.gz 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.166817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77079.log 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143138.log 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.132536.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.166817.log.gz 2024-09-12T01:12:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.77079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181890.log 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.132536.log.gz 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.77079.log.gz 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5/var/log/ceph/ceph-client.admin.143138.log: --verbose -- /var/log/ceph/ceph-client.0.42482.log 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9%/var/log/ceph/ceph-client.0.181890.log: -- replaced with /var/log/ceph/ceph-client.admin.143138.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33195.log 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.181890.log.gz 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.42482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193255.log 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.42482.log.gz 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190684.log 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33195.log.gz 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193255.log.gz 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184326.log 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107205.log 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.190684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190684.log.gz 2024-09-12T01:12:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.184326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193531.log 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.184326.log.gz 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.107205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123697.log 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.107205.log.gz 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61156.log 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193531.log.gz 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.123697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52862.log 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.123697.log.gz 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.61156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51636.log 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61156.log.gz 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146672.log 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.52862.log: /var/log/ceph/ceph-client.admin.51636.log: 81.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80700.log 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52862.log.gz 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.51636.log.gz 2024-09-12T01:12:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.146672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137248.log 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.146672.log.gz 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.80700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117218.log 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.80700.log.gz 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.137248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104260.log 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38366.log 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.117218.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.137248.log.gz 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.104260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54629.log 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.117218.log.gz 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104260.log.gz 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91302.log 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38366.log.gz 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115451.log 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.54629.log: /var/log/ceph/ceph-client.admin.91302.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.54629.log.gz 2024-09-12T01:12:58.271 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106027.log 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.91302.log.gz 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.115451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64793.log 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115451.log.gz 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.106027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94247.log 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106027.log.gz 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185544.log/var/log/ceph/ceph-client.admin.64793.log: 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.64793.log.gz 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.94247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176986.log 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.94247.log.gz 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.185544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179454.log 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.185544.log.gz 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.176986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81878.log 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.176986.log.gz 2024-09-12T01:12:58.272 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.179454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119574.log 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.179454.log.gz 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39805.log 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.81878.log: /var/log/ceph/ceph-client.admin.119574.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.81878.log.gz 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176378.log 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119574.log.gz 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39805.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.39805.log.gz /var/log/ceph/ceph-client.admin.114273.log 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.176378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69220.log 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.114273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58800.log 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.114273.log.gz 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.69220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130769.log 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.58800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39527.log 2024-09-12T01:12:58.273 INFO:teuthology.orchestra.run.smithi083.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.58800.log.gz 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.176378.log.gz 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.130769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39113.log 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.130769.log.gz 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39527.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39527.log.gz 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48054.log 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39113.log.gz 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153151.log 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69220.log.gz 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.48054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190636.log 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.48054.log.gz 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.153151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161399.log 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.153151.log.gz 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.190636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190636.log.gz 2024-09-12T01:12:58.274 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64079.log 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158453.log 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.161399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161399.log.gz 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.64079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136070.log 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr: 51.8% -- replaced with /var/log/ceph/ceph-client.admin.64079.log.gz 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.158453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186153.log 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.136070.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.158453.log.gz 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83056.log 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136070.log.gz 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.186153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38653.log 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.83056.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.186153.log.gz 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145494.log 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.83056.log.gz 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116629.log 2024-09-12T01:12:58.275 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38653.log.gz 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129001.log 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.145494.log: /var/log/ceph/ceph-client.admin.116629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193163.log 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.145494.log.gz 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.116629.log.gz 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.129001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39234.log 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47741.log 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193163.log.gz 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165591.log 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39234.log.gz 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.47741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38867.log 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.47741.log.gz 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189976.log 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.165591.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.129001.log.gz 2024-09-12T01:12:58.276 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38867.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.165591.log.gz 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38867.log.gz 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65496.log 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.189976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189976.log.gz 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193577.log 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:gzip/var/log/ceph/ceph-client.admin.65496.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39115.log 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193577.log.gz 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100137.log 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39115.log.gz 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190733.log 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.100137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146083.log 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.190733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140782.log 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.190733.log.gz 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.146083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53451.log 2024-09-12T01:12:58.277 INFO:teuthology.orchestra.run.smithi083.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.100137.log.gz/var/log/ceph/ceph-client.admin.140782.log: 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.146083.log.gz 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.140782.log.gz 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174263.log 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.53451.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84823.log 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.53451.log.gz 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.174263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193347.log 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.84823.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.174263.log.gz 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.84823.log.gz 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193669.log 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58776.log 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193347.log.gz 2024-09-12T01:12:58.278 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58163.log 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193669.log.gz 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38455.log 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.58776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58776.log.gz 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.58163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113684.log 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.58163.log.gz 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38455.log.gz 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193117.log 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.113684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63868.log 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.113684.log.gz 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193117.log.gz 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89535.log 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.191428.log 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.63868.log: /var/log/ceph/ceph-client.admin.89535.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.63868.log.gz 2024-09-12T01:12:58.279 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110150.log 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.89535.log.gz 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.191428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180063.log 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.191428.log.gz 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.110150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181281.log 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110150.log.gz 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.180063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38859.log 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr:gzip 80.3% -- replaced with /var/log/ceph/ceph-client.0.180063.log.gz 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.181281.log: -5 --verbose -- /var/log/ceph/ceph-client.0.43694.log 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38859.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.181281.log.gz 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38859.log.gz 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82467.log 2024-09-12T01:12:58.280 INFO:teuthology.orchestra.run.smithi083.stderr:gzip/var/log/ceph/ceph-client.0.43694.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.139604.log 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.43694.log.gz 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.82467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147850.log 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.82467.log.gz 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.139604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87179.log 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.139604.log.gz 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.147850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39895.log 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.87179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134892.log 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.87179.log.gz 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39895.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138426.log 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41228.log 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr: 86.2% 81.5% -- replaced with /var/log/ceph/ceph-client.admin.147850.log.gz 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.134892.log.gz 2024-09-12T01:12:58.281 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67359.log 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.138426.log: /var/log/ceph/ceph-client.0.41228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139015.log 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.138426.log.gz 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.41228.log.gz 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.67359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193807.log 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70459.log 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.139015.log: /var/log/ceph/ceph-client.admin.193807.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193807.log.gz 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.70459.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.139015.log.gz 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63949.log 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118985.log 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.65496.log.gz 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.63949.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79277.log 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63949.log.gz 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.118985.log: 92.7% 81.7% -- replaced with /var/log/ceph/ceph-client.admin.118985.log.gz 2024-09-12T01:12:58.282 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70459.log.gz 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192933.log 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129590.log 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.79277.log: /var/log/ceph/ceph-client.admin.192933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38865.log 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192933.log.gz 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr: 79.9%/var/log/ceph/ceph-client.admin.129590.log: -- replaced with /var/log/ceph/ceph-client.0.79277.log.gz 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131947.log 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129590.log.gz 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38865.log: gzip 93.1% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.67359.log.gz 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr: /var/log/ceph/ceph-client.admin.71078.log 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38865.log.gz 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166228.log 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.131947.log: /var/log/ceph/ceph-client.admin.71078.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.131947.log.gz 2024-09-12T01:12:58.283 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56985.log 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61204.log 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.56985.log: /var/log/ceph/ceph-client.admin.166228.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.56985.log.gz 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55807.log 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164365.log 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.61204.log: -- replaced with /var/log/ceph/ceph-client.admin.166228.log.gz 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71078.log.gz 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.61204.log.gz 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.55807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183108.log 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.55807.log.gz 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.164365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164365.log.gz 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93069.log 2024-09-12T01:12:58.284 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.183108.log: /var/log/ceph/ceph-client.admin.93069.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.183108.log.gz 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72980.log 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.93069.log.gz 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134303.log 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.72980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124289.log 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.72980.log.gz 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.134303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50434.log 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.134303.log.gz 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.124289.log: -- /var/log/ceph/ceph-client.admin.193025.log 2024-09-12T01:12:58.285 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50434.log.gz 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124289.log.gz 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90124.log 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96603.log 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193025.log.gz 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.90124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97781.log 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.90124.log.gz 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.96603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61180.log 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96603.log.gz 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.97781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95425.log 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.97781.log.gz 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.61180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61180.log.gz 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80111.log 2024-09-12T01:12:58.286 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.95425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63249.log 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.95425.log.gz 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.80111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126645.log 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.80111.log.gz 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5/var/log/ceph/ceph-client.admin.63249.log: --verbose -- /var/log/ceph/ceph-client.0.41837.log 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr: 58.2% -- replaced with /var/log/ceph/ceph-client.admin.63249.log.gz 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.126645.log: gzip -5 --verbose 82.1% -- replaced with /var/log/ceph/ceph-client.admin.126645.log.gz 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr: -- /var/log/ceph/ceph-client.admin.126056.log 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.41837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157864.log 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.41837.log.gz 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.126056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114862.log 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.126056.log.gz 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.157864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39939.log 2024-09-12T01:12:58.287 INFO:teuthology.orchestra.run.smithi083.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.157864.log.gz 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.114862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43091.log 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39939.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39939.log.gz 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr: --verbose -- /var/log/ceph/ceph-client.admin.193993.log 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.43091.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.43091.log.gz 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57574.log 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193993.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193993.log.gz 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.114862.log.gz 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr: -- /var/log/ceph/ceph-client.admin.167406.log 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.57574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127823.log 80.5% -- replaced with /var/log/ceph/ceph-client.admin.57574.log.gz 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.167406.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.167406.log.gz 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182499.log 2024-09-12T01:12:58.288 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52225.log 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.127823.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.127823.log.gz 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.182499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78668.log 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.182499.log.gz 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.52225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127234.log 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.52225.log.gz 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75307.log 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.78668.log: /var/log/ceph/ceph-client.admin.127234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38866.log 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.75307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106616.log 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.127234.log.gz 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71697.log 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.106616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38866.log.gz 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.75307.log.gz 2024-09-12T01:12:58.289 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156686.log 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.106616.log.gz 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.71697.log: /var/log/ceph/ceph-client.admin.173655.log 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.156686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163776.log 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.156686.log.gz 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.173655.log: gzip 92.0% -- replaced with /var/log/ceph/ceph-client.0.78668.log.gz 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.163776.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71697.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38515.log 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.173655.log.gz 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.163776.log.gz 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111328.log 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.38515.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38515.log.gz 2024-09-12T01:12:58.290 INFO:teuthology.orchestra.run.smithi083.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.170138.log 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.111328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193301.log 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.111328.log.gz 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.170138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164389.log 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.170138.log.gz 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113095.log 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193301.log: /var/log/ceph/ceph-client.admin.164389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193301.log.gz 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149617.log 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164389.log.gz 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.113095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193899.log 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 87.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.113095.log.gz -- 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr: /var/log/ceph/ceph-client.admin.108383.log 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.149617.log: gzip/var/log/ceph/ceph-client.admin.193899.log: -5 --verbose -- /var/log/ceph/ceph-client.0.184935.log 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193899.log.gz 2024-09-12T01:12:58.291 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149617.log.gz 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.108383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105438.log 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.184935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116040.log 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.184935.log.gz 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.105438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142549.log 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.108383.log.gz 81.5% -- replaced with /var/log/ceph/ceph-client.admin.105438.log.gz 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.116040.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.116040.log.gz 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64013.log 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64727.log/var/log/ceph/ceph-client.admin.142549.log: 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.64013.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.142549.log.gz 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38862.log 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58752.log 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.64727.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.64727.log.gz 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38862.log.gz 2024-09-12T01:12:58.292 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38863.log 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.58752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58752.log.gz 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38863.log.gz 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90713.log 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159042.log 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.90713.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.90713.log.gz 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64013.log.gz 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186762.log 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.159042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39231.log 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.186762.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.159042.log.gz 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.186762.log.gz 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130179.log 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39231.log.gz 2024-09-12T01:12:58.293 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143727.log 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.130179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150206.log 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr: 81.4%/var/log/ceph/ceph-client.admin.143727.log: -- replaced with /var/log/ceph/ceph-client.admin.130179.log.gz 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44900.log 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.150206.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.150206.log.gz 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- 86.1% /var/log/ceph/ceph-client.admin.193715.log 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.143727.log.gz 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.44900.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.44900.log.gz 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38864.log 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39235.log 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193715.log.gz 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38864.log.gz 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148439.log 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39235.log.gz 2024-09-12T01:12:58.294 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124878.log 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.148439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60567.log 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr: 82.0%/var/log/ceph/ceph-client.admin.124878.log: -- replaced with /var/log/ceph/ceph-client.admin.148439.log.gz 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.124878.log.gz 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.60567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39230.log 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr: 80.7%/var/log/ceph/ceph-mgr.y.log: -- replaced with /var/log/ceph/ceph-client.admin.60567.log.gz 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40625.log 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39230.log.gz 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74126.log 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.40625.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.40625.log.gz 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112506.log 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.74126.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.74126.log.gz 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135481.log 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.112506.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.112506.log.gz 2024-09-12T01:12:58.295 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137837.log 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.135481.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.135481.log.gz 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161420.log 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.137837.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.137837.log.gz 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98959.log 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.161420.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.161420.log.gz 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177625.log 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.98959.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.98959.log.gz 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160220.log 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.177625.log: 83.7% -- replaced with /var/log/ceph/ceph-client.0.177625.log.gz 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.160220.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.160220.log.gz 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39435.log 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.log: 93.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163187.log 2024-09-12T01:12:58.296 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39435.log.gz 2024-09-12T01:12:58.297 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:12:58.297 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160809.log 2024-09-12T01:12:58.297 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.163187.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.163187.log.gz 2024-09-12T01:12:58.317 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40008.log 2024-09-12T01:12:58.317 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.160809.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.160809.log.gz 2024-09-12T01:12:58.317 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39849.log 2024-09-12T01:12:58.317 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.40008.log: 95.8% -- replaced with /var/log/ceph/ceph-client.0.40008.log.gz 2024-09-12T01:12:58.317 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:12:58.317 INFO:teuthology.orchestra.run.smithi083.stderr: --verbose -- /var/log/ceph/ceph-client.admin.83645.log 2024-09-12T01:12:58.317 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39849.log.gz 2024-09-12T01:12:58.317 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78544.log 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193071.log 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.83645.log: /var/log/ceph/ceph-client.admin.78544.log: 81.7% 48.8% -- replaced with /var/log/ceph/ceph-client.admin.78544.log.gz 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83645.log.gz 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66118.log 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193071.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192887.log 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.193071.log.gz 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.66118.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.66118.log.gz 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190614.log 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.192887.log: -- /var/log/ceph/ceph-client.admin.121930.log 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192887.log.gz 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.190614.log: 25.8% -- replaced with /var/log/ceph/ceph-client.admin.190614.log.gz 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88357.log 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.121930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46548.log 2024-09-12T01:12:58.318 INFO:teuthology.orchestra.run.smithi083.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.121930.log.gz 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.88357.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88357.log.gz 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162598.log 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.46548.log: /var/log/ceph/ceph-client.admin.38861.log 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.46548.log.gz 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.162598.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.162598.log.gz 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164413.log 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38861.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111917.log 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38861.log.gz 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.164413.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.164413.log.gz 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52838.log 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.111917.log: /var/log/ceph/ceph-client.admin.103671.log 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.111917.log.gz 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.52838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52838.log.gz 2024-09-12T01:12:58.319 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39229.log 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101904.log 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.103671.log: /var/log/ceph/ceph-client.admin.39229.log: 82.7% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103671.log.gz 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39229.log.gz 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103082.log 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.101904.log: /var/log/ceph/ceph-client.admin.120752.log 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.101904.log.gz 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.103082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193853.log 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103082.log.gz 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.120752.log: 81.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157275.log 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120752.log.gz 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193853.log.gz 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84234.log 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108972.log 2024-09-12T01:12:58.320 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.157275.log: /var/log/ceph/ceph-client.admin.84234.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.157275.log.gz 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.84234.log.gz 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98370.log 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123108.log 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.108972.log: /var/log/ceph/ceph-client.admin.98370.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.108972.log.gz 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107794.log 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98370.log.gz 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.123108.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.123108.log.gz 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178843.log 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.107794.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.107794.log.gz 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39985.log 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153741.log 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.178843.log: /var/log/ceph/ceph-client.admin.39985.log: 79.9% -- replaced with /var/log/ceph/ceph-client.0.178843.log.gz 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39985.log.gz 2024-09-12T01:12:58.321 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61793.log 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38430.log 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.153741.log: /var/log/ceph/ceph-client.admin.61793.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.61793.log.gz 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.153741.log.gz 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68601.log 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69840.log 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38430.log: /var/log/ceph/ceph-client.admin.68601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38430.log.gz 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50458.log 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.69840.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.68601.log.gz 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86590.log 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.50458.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.50458.log.gz 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.192122.log 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.86590.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.86590.log.gz 2024-09-12T01:12:58.322 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193393.log 2024-09-12T01:12:58.323 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.192122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51047.log 2024-09-12T01:12:58.323 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193393.log.gz 2024-09-12T01:12:58.323 INFO:teuthology.orchestra.run.smithi083.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.69840.log.gz 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88946.log 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.51047.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.51047.log.gz 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144316.log 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.88946.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.88946.log.gz 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62382.log 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.144316.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.144316.log.gz 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144905.log 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.62382.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.62382.log.gz 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49821.log 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.144905.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.144905.log.gz 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85412.log 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.49821.log: 86.9% -- replaced with /var/log/ceph/ceph-client.0.192122.log.gz 2024-09-12T01:12:58.331 INFO:teuthology.orchestra.run.smithi083.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.49821.log.gz 2024-09-12T01:12:58.332 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125467.log 2024-09-12T01:12:58.332 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.85412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189364.log 2024-09-12T01:12:58.332 INFO:teuthology.orchestra.run.smithi083.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.85412.log.gz 2024-09-12T01:12:58.332 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.125467.log: 81.7%gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:12:58.332 INFO:teuthology.orchestra.run.smithi083.stderr: -- replaced with /var/log/ceph/ceph-client.admin.125467.log.gz 2024-09-12T01:12:58.332 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.189364.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.189364.log.gz 2024-09-12T01:12:58.332 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152562.log 2024-09-12T01:12:58.334 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75897.log 2024-09-12T01:12:58.335 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.152562.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.152562.log.gz 2024-09-12T01:12:58.337 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33111.log 2024-09-12T01:12:58.337 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.75897.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.75897.log.gz 2024-09-12T01:12:58.337 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183717.log 2024-09-12T01:12:58.337 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.33111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33111.log.gz 2024-09-12T01:12:58.339 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122519.log 2024-09-12T01:12:58.339 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.183717.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.183717.log.gz 2024-09-12T01:12:58.339 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193623.log 2024-09-12T01:12:58.341 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.122519.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.122519.log.gz 2024-09-12T01:12:58.341 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155508.log 2024-09-12T01:12:58.341 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193623.log.gz 2024-09-12T01:12:58.341 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159631.log 2024-09-12T01:12:58.344 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.155508.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.155508.log.gz 2024-09-12T01:12:58.344 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131358.log 2024-09-12T01:12:58.345 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.159631.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.159631.log.gz 2024-09-12T01:12:58.345 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156097.log 2024-09-12T01:12:58.347 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.131358.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.131358.log.gz 2024-09-12T01:12:58.347 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169530.log 2024-09-12T01:12:58.347 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.156097.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.156097.log.gz 2024-09-12T01:12:58.348 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171684.log 2024-09-12T01:12:58.352 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.169530.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169530.log.gz 2024-09-12T01:12:58.352 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63641.log 2024-09-12T01:12:58.353 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.171684.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171684.log.gz 2024-09-12T01:12:58.353 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193485.log 2024-09-12T01:12:58.355 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.63641.log: 48.3% -- replaced with /var/log/ceph/ceph-client.admin.63641.log.gz 2024-09-12T01:12:58.355 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117807.log 2024-09-12T01:12:58.355 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.193485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193485.log.gz 2024-09-12T01:12:58.357 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192979.log 2024-09-12T01:12:58.357 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.117807.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.117807.log.gz 2024-09-12T01:12:58.357 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64143.log 2024-09-12T01:12:58.357 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.192979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192979.log.gz 2024-09-12T01:12:58.359 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188775.log 2024-09-12T01:12:58.359 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.64143.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.64143.log.gz 2024-09-12T01:12:58.359 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38561.log 2024-09-12T01:12:58.361 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.188775.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.188775.log.gz 2024-09-12T01:12:58.361 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26680.log 2024-09-12T01:12:58.361 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.38561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38561.log.gz 2024-09-12T01:12:58.363 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136659.log 2024-09-12T01:12:58.363 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.tmp-client.admin.26680.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26680.log.gz 2024-09-12T01:12:58.363 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172292.log 2024-09-12T01:12:58.364 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.136659.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.136659.log.gz 2024-09-12T01:12:58.364 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99548.log 2024-09-12T01:12:58.365 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.172292.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172292.log.gz 2024-09-12T01:12:58.365 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92480.log 2024-09-12T01:12:58.366 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.99548.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99548.log.gz 2024-09-12T01:12:58.366 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151973.log 2024-09-12T01:12:58.367 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.92480.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.92480.log.gz 2024-09-12T01:12:58.368 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168881.log 2024-09-12T01:12:58.370 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.151973.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.151973.log.gz 2024-09-12T01:12:58.370 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104849.log 2024-09-12T01:12:58.371 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.168881.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.168881.log.gz 2024-09-12T01:12:58.372 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165002.log 2024-09-12T01:12:58.372 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.104849.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104849.log.gz 2024-09-12T01:12:58.374 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64907.log 2024-09-12T01:12:58.374 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.165002.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.165002.log.gz 2024-09-12T01:12:58.374 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44297.log 2024-09-12T01:12:58.377 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.64907.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.64907.log.gz 2024-09-12T01:12:58.377 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77225.log 2024-09-12T01:12:58.377 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.44297.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.44297.log.gz 2024-09-12T01:12:58.377 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39481.log 2024-09-12T01:12:58.379 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.77225.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.77225.log.gz 2024-09-12T01:12:58.379 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:12:58.379 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.39481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39481.log.gz 2024-09-12T01:12:58.379 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166180.log 2024-09-12T01:12:58.400 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133125.log 2024-09-12T01:12:58.400 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.166180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166180.log.gz 2024-09-12T01:12:58.414 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37879.log 2024-09-12T01:12:58.415 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.133125.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.133125.log.gz 2024-09-12T01:12:58.421 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118396.log 2024-09-12T01:12:58.430 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.187371.log 2024-09-12T01:12:58.433 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.118396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37879.log.gz 2024-09-12T01:12:58.443 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97192.log 2024-09-12T01:12:58.444 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.187371.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.187371.log.gz 2024-09-12T01:12:58.444 INFO:teuthology.orchestra.run.smithi083.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.118396.log.gz 2024-09-12T01:12:58.449 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72316.log 2024-09-12T01:12:58.458 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.97192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172900.log 2024-09-12T01:12:58.467 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.72316.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.97192.log.gz 2024-09-12T01:12:58.475 INFO:teuthology.orchestra.run.smithi083.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.72316.log.gz 2024-09-12T01:12:58.479 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67982.log 2024-09-12T01:12:58.482 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.172900.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172900.log.gz 2024-09-12T01:12:58.487 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141371.log 2024-09-12T01:12:58.499 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.67982.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.67982.log.gz 2024-09-12T01:12:58.507 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178234.log 2024-09-12T01:12:58.508 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.141371.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141371.log.gz 2024-09-12T01:12:58.521 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.178234.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.178234.log.gz 2024-09-12T01:12:58.662 INFO:teuthology.orchestra.run.smithi083.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:12:59.035 INFO:teuthology.orchestra.run.smithi120.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:12:59.059 INFO:teuthology.orchestra.run.smithi083.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:13:00.410 INFO:teuthology.orchestra.run.smithi083.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:13:01.062 INFO:teuthology.orchestra.run.smithi083.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:13:07.193 INFO:teuthology.orchestra.run.smithi083.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:13:07.613 INFO:teuthology.orchestra.run.smithi120.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:13:07.624 INFO:teuthology.orchestra.run.smithi120.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:13:08.222 INFO:teuthology.orchestra.run.smithi083.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:13:09.816 INFO:teuthology.orchestra.run.smithi083.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:13:12.103 INFO:teuthology.orchestra.run.smithi120.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:13:18.044 INFO:teuthology.orchestra.run.smithi120.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:13:18.046 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-12T01:13:18.046 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m19.879s 2024-09-12T01:13:18.046 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m51.582s 2024-09-12T01:13:18.046 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m1.908s 2024-09-12T01:13:18.318 INFO:teuthology.orchestra.run.smithi083.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:13:18.320 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-12T01:13:18.320 INFO:teuthology.orchestra.run.smithi083.stderr:real 0m20.195s 2024-09-12T01:13:18.320 INFO:teuthology.orchestra.run.smithi083.stderr:user 0m55.143s 2024-09-12T01:13:18.320 INFO:teuthology.orchestra.run.smithi083.stderr:sys 0m2.212s 2024-09-12T01:13:18.320 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:13:18.321 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869/remote/smithi083/log 2024-09-12T01:13:18.322 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:13:25.942 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869/remote/smithi120/log 2024-09-12T01:13:25.943 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:13:33.252 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:13:33.262 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:13:33.262 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:13:33.265 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:13:33.387 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:13:33.398 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:13:33.398 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:13:33.401 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:13:33.430 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:13:33.433 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:13:33.435 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:13:33.435 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-12T01:13:33.435 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv01.front.sepia.ceph.com 3 7 377 27 -885us[ -895us] +/- 57ms 2024-09-12T01:13:33.435 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -623us[ -623us] +/- 65ms 2024-09-12T01:13:33.435 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 90 +1795us[+1783us] +/- 78ms 2024-09-12T01:13:33.436 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:13:33.438 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:13:33.438 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-12T01:13:33.438 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 -837us[ -858us] +/- 57ms 2024-09-12T01:13:33.438 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -555us[ -555us] +/- 65ms 2024-09-12T01:13:33.438 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +1845us[+1845us] +/- 79ms 2024-09-12T01:13:33.438 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:13:33.439 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:13:33.449 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:13:33.450 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:13:33.480 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:13:33.562 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:13:33.643 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:13:33.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:13:33.685 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:13:33.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:13:33.728 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:13:33.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:13:33.770 INFO:teuthology.task.internal:Duration was 3037.908532 seconds 2024-09-12T01:13:33.771 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:13:33.803 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:13:33.804 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:13:33.806 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:13:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:13:33.860 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:13:34.343 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:13:34.343 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2024-09-12T01:13:34.343 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:13:34.377 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-09-12T01:13:34.378 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:13:34.416 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:13:34.416 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:13:34.420 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:13:34.496 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:13:34.497 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:13:34.501 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:13:34.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:13:34.663 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:13:34.663 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:13:34.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:13:34.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:13:34.762 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:13:34.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:13:34.799 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2024-09-12T01:13:34.818 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-09-12T01:13:34.874 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:13:34.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:13:34.902 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:13:34.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:13:34.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:13:34.963 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:13:34.964 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869/remote/smithi083 2024-09-12T01:13:34.964 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:13:35.020 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901869/remote/smithi120 2024-09-12T01:13:35.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:13:35.071 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:13:35.071 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:13:35.074 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:13:35.134 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:13:35.148 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:13:35.148 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:13:35.170 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:13:35.171 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:13:35.174 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:13:35.200 INFO:teuthology.orchestra.run.smithi083.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:13 /home/ubuntu/cephtest 2024-09-12T01:13:35.202 INFO:teuthology.orchestra.run.smithi120.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:13 /home/ubuntu/cephtest 2024-09-12T01:13:35.203 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:13:35.216 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:13:35.273 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3037.9085323810577 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T01:13:35.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:13:35.353 INFO:teuthology.run:pass